Throughout her career, Stoler was large and often played villainesses (such as in The Honeymoon Killers and on TV in an episode of Charlie's Angels) whose scariness often derived from Stoler's physical strength and size. A character actress as well as an occasional lead, Stoler appeared in small roles in classic films including Klute, The Deer Hunter, and Desperately Seeking Susan.

The highlight of her film career arguably was her turn as the repulsive Nazi female prison commandant in Lina Wertmüller's Pasqualino Settebellezze (1975) (Seven Beauties), in which she plays a cat and mouse game of seduction with the concentration camp inmate played by Giancarlo Giannini. Though a profile of Stoler was featured on the front page of the New York Times Arts section, her performance was ignored during the awards season, likely as her dialogue had to be dubbed into Italian. The film, the success of which depended a great deal on her, was nominated for an Academy Award for Best Foreign Language Film of 1976, and garnered Wertmüller nominations as Best Director (a first for a woman) and Best Original Screenplay, and Stoler's co-star Giannini a nod as Best Actor.

Stoler also appeared on Broadway and in daytime soap operas, as well as Saturday morning television, playing the role of Mrs. Steve on Pee-wee's Playhouse.

Stoler lived in Manhattan until her death from heart failure at the age of 69.