Little is known about the specific details of Charles Chauncey’s early life. We know that, along with Walt Whitman, he was one of several men who made up the Fred Gray Association, "a loose confederation of young men who seemed anxious to explore new possibilities of male-male affection" (Folsom and Price Re-Scripting 62). Stephanie Blalock, when describing the Fred Gray Association, lists Chauncey as one of the many members of the group that were later included in Whitman’s memory book (179).
