Fred Gray, the son of prominent New York doctor Dr. John F. Gray and Elizabeth Hull-Gray, was born in New York in 1840. His two siblings died before they reached adulthood. Gray enrolled in William’s College in Massachusetts in 1858, studying science and medicine and eager to follow in his father’s esteemed footsteps. He studied in Germany at the University of Heidelberg from 1860 to 1861, but left before finishing his degree to serve in the Union army (Blalock 52).