He was the son of Zara Whitman Kallman, a Broadway actress, and Alvan Kallman, a barnstorming pilot, who owned the Savoy-Plaza Hotel in New York City, The Balsams Grand Resort Hotel in New Hampshire, and the St. Johns Hotel in Havana.
His paternal grandparents were German Jewish immigrants, and his maternal grandparents were Russian Jews.
