The story unfolds at the Hotel Beauregard located in the picturesque Bournemouth on the southern coast of England. The plot centers around Major David Angus Pollock (David Niven), who attempts to keep a damning article about himself, published in the West Hampshire Weekly News, from being seen by the guests. Ironically, his efforts to hide it draw even more attention, especially from the stern and demanding Mrs. Railton-Bell (Gladys Cooper) and the more understanding Lady Matheson (Cathleen Nesbitt). The article reveals that Major Pollock has admitted to sexually harassing multiple young women in a theater, prompting Mrs. Railton-Bell to push for his expulsion from the hotel. She organizes a meeting with the long-term residents to discuss this grave matter before bringing it to Miss Pat Cooper (Wendy Hiller), the hotel manager. Despite the varied opinions among the guests, Mrs. Railton-Bell insists that the Major should leave.
Meanwhile, the film also explores the complicated relationship between Anne (Rita Hayworth) and John (Burt Lancaster), who share a history as former spouses. Their paths cross again, and Anne playfully informs John of her engagement while he, in turn, deceives her about his own. John accuses Anne of manipulating him into marrying her, suggesting that she deliberately chose a man like him from a less privileged background to assert control over him. Regardless of past grievances, the remnants of their attraction linger, leading Anne to invite John to her room for a more private talk.
Upon entering the hotel, Miss Cooper interrupts, indicating that Anne has a phone call. In a private conversation with John, she subtly hints at Anne’s true intentions for being in the hotel. Initially, John defends Anne, attributing his bad luck solely to his own decisions, but he grows suspicious when he learns she is discussing matters with his publisher— the only one who knows about his engagement to Miss Cooper. In a moment of confrontation, John visits Anne in her room where, in a cruel twist, he remarks on her aging and diminished beauty, claiming it prohibits her ability to manipulate others as before. Hurt and desperate, she pleads for him to stay, but he leaves after striking her. Devastated, Anne confesses to Miss Cooper her struggles with emotional turmoil and her dependence on sleeping pills.
The next day, Mrs. Railton-Bell's beleaguered daughter, Sibyl (Deborah Kerr), confronts Major Pollock about his actions, to which he reveals his lifelong fear of intimacy, noting that he relates well to her fearfulness. As he prepares to leave the hotel, Sibyl expresses concern over his future prospects.
When John returns the following morning, Miss Cooper informs him of Anne's fragile emotional state and encourages him to see her before she departs. After John's visit, Miss Cooper tries to persuade Major Pollock to reconsider his decision to leave, but he remains steadfast in his choice.
The atmosphere becomes tense when Major Pollock joins the other diners and is met with a mixed reception. In a moment of defiance, Sibyl disobeys her mother’s wishes and chooses to stay and finish her breakfast with Major Pollock instead. This marks a pivotal moment for her, as she asserts her independence. As the film draws to a close, the residents enjoy their breakfasts in solitude, while John and Anne find themselves in a tentative reconciliation, uncertain of their ability to find happiness, either together or apart.
