Elijah J. McCoy was born in Colchester, Ontario, Canada, to George and Mildred (Goins) McCoy. His parents were fugitive slaves who had escaped from Kentucky to Canada via the Underground Railroad. They arrived in Canada in 1837.

Elijah spent his early years in Canada, where he likely received basic education. Living in a community of former slaves would have instilled values of self-reliance and resourcefulness. Although formal records are scarce, it's believed he showed an early aptitude for mechanics.

Recognizing his mechanical talent, Elijah's parents used their savings to send him to Scotland for an apprenticeship in mechanical engineering. He studied at the University of Edinburgh, demonstrating exceptional skill and absorbing European engineering knowledge and practices.

After completing his apprenticeship, Elijah returned to North America, seeking opportunities to apply his engineering skills. However, racial prejudice limited his options.