Ellen F. Eglin was born in Washington, D.C. The precise date of her birth is not definitively known, but it is estimated to be around 1849. Information about her parents and immediate family is limited.

Growing up in Washington D.C. during this period meant facing significant challenges as an African American child. Access to formal education was limited, and segregated schools were the norm. Details of her specific schooling are scarce, but it is known that she received some form of education, likely from schools founded by or catering to the African American community.

Even with formal schooling being restricted, Ellen Eglin developed a great skill for sewing. She was able to make clothes for herself and others, showcasing her talent and resourcefulness. This skill would later prove to be very important to her life.