The second of five children born to the theologian Henry James Sr. and the heiress Mary Walsh, James grew up moving between his native New York, New England, London, Paris and Geneva.