An ambulance drives through Sydney, hijacked by escaped convict Matt Kirk [Aldo Ray] and his three accomplices: Matt's brother Johnny [Neil McCallum], the Italian Luke [Carlo Giustini], and Bert [Victor Maddern]. The four men manage to slip past the bustle of Sydney Hospital and slip out into Sydney Harbour aboard a purchased vessel, with every intention of making their way north. But the boat falters before they can break through the Sydney Heads, forcing them to seek refuge instead in Fort Denison (Pinchgut), unaware that it is already occupied by caretaker Pat Fulton [Gerry Duggan], his wife, and daughter Ann [Heather Sears].
Matt's gang seizes the Fultons as hostages and dictates that they bide their time until the following night before attempting to move again. A fleeting moment of normalcy comes when a boatload of tourists arrives, but Pat Fulton [Gerry Duggan] keeps up the act of calm in front of the visitors. Trouble erupts when Constable Macey [Grant Taylor] comes ashore with milk, and Ann [Heather Sears] cries out for help, tipping off the authorities to the siege.
The police, led by Superintendent Hanna [Alan Tilvern], lockdown the fort and the siege intensifies. Matt Kirk's resolve hardens: he is reluctant to hurt anyone at first, but his stance hardens after Johnny [Neil McCallum] is shot and wounded by Macey [Grant Taylor]. Bert [Victor Maddern], a former naval gunner, realizes that the fort’s big gun could be used to threaten a nearby munitions ship in the harbor, potentially causing devastation comparable to the Bombay Explosion of 1944. Yet the gun’s shells are secured behind three heavy doors at the bottom of the fort, requiring a painstaking effort to pry them open.
Matt demands a retrial for his conviction in exchange for sparing the ship from being fired upon. The police order an evacuation of the harbourside suburbs and quietly move the munitions boat away, while snipers are positioned around the fort as negotiations for a peaceful surrender unfold. Amid the tense standoff, Johnny [Neil McCallum] begins to fall for Ann [Heather Sears], and suggests they surrender, but Matt refuses to yield.
Tragedy marks the standoff: Luke [Carlo Giustini] is killed by the snipers, and a sailor on the munitions ship becomes trapped under crates. Matt and Bert mount a final bid to move the ammunition toward the gun, but Bert is shot and killed in the process. With the weapon ready and Matt set to discharge, Johnny reveals that he has disabled the firing pin, reigniting the fury. Matt, furious, turns on Johnny in a desperate outburst.
Hanna [Alan Tilvern] leads a bold raid of the island, and Matt is killed in the ensuing confrontation. Johnny is seized and taken away, while Pat Fulton [Gerry Duggan] pledges to speak up on his behalf, leaving Ann [Heather Sears] and her family to confront the aftermath of the ordeal.