He married Jessie Fay Sargent in 1938. She wrote a memoir in 1973 about their time in office, entitled The Governor's Wife:A View from Within.