Audrey Kathleen Ruston was born in Ixelles, Brussels, Belgium, to Joseph Victor Anthony Ruston, a British subject, and Baroness Ella van Heemstra, a Dutch aristocrat.

Audrey was sent to a private boarding school in Kent, England.

With the outbreak of World War II, Audrey's mother moved her and her brothers back to Arnhem, Netherlands, believing it would be safer than England. However, the Netherlands was soon occupied by Nazi Germany.

Audrey and her family endured immense hardship during the German occupation. They faced starvation, disease, and constant fear. Audrey's mother changed her name to Edda van Heemstra to avoid sounding too 'English'. She privately supported the Dutch Resistance, and Audrey contributed by performing dance recitals to raise money.

The 'Hongerwinter' (Hunger Winter) of 1944-45 brought severe famine to the Netherlands. Audrey suffered from malnutrition, which likely contributed to health problems later in life. She survived on tulip bulbs and endive.

The liberation of the Netherlands brought an end to the occupation and the hardships the family endured. Audrey experienced a profound sense of relief and hope.