Olivia Blount Grimes was born in Washington, Beaufort County, North Carolina on February 2, 1840. She and her sister, Anna Grimes, attended St. Mary's school in Raleigh alongside their friend Margaret Eliza Cotten. Grimes eventually moved to Louisiana and died in New Orleans, Louisiana, on October 29, 1866.