Abraham G. Graham was born on his grandmother's plantation in Horry County, South Carolina on November 22, 1851.
His great-grandfather, Captain Edward Connor, served in the South Carolina militia during the American Revolution, under Brigadier General Francis Marion. His father, Hosea A. Graham, had married his first cousin Martha Ann Graham, and while Abraham was still a child the family moved to Texas in covered wagons in 1859.
