Teller married Augusta Maria 'Mici' Harkanyi, whom he met in Göttingen. She was the sister of a fellow physicist, and they enjoyed a long and devoted marriage. Mici played a vital role in supporting Teller throughout his career.

Edward and Augusta Teller's first child, a son named Paul, was born. Paul would later become an academic in philosophy.

The Tellers had a daughter, Wendy, who also pursued academic interests. His family life, despite the pressures of his work, was a source of personal stability.

Teller maintained a close-knit family and was deeply involved in his children's lives. He was known for his intellectual curiosity and his ability to engage in stimulating conversations with his family.