In a shantyboat community in Pecan Point, Tennesse, Ernie Holley Joel McCrea marries Pearl Elliott Holley Barbara Stanwyck. Businessman Mr. Slade Victor Kilian crashes the wedding’s afterparty and, in a bid to secure his business ties with the community, attempts to kiss the bride. Pearl hesitantly allows the kiss for the sake of maintaining those ties. After the kiss, Ernie punches Mr. Slade, sending him toppling into the river. When search parties fail to locate him, Mr. Slade is presumed dead. However, he later returns with a police patrol, and Newt Holley Walter Brennan, Ernie’s father, urges Ernie to flee the community. Ernie complies and sets off to sail the world.
During Ernie’s time away, Pearl meets Warfield Scott Walter Catlett, a New Orleans portraitist who makes romantic advances and offers her a job at his studio. Pearl is drawn to his offer because of loneliness, but she ultimately rejects it. Ernie returns with a plan to move his family to Aruba. The two argue about their future, and Pearl leaves with Warfield for New Orleans. Ernie chases after her, while Newt pursues him to keep the family together.
In New Orleans, Pearl decides to part ways with Warfield and takes a job in a café to repay her travel expenses. Ernie confronts Warfield in his studio, demanding to see Pearl, but Warfield won’t reveal her location. He punches Warfield and departs. On a night of despondent drinking at the café, Ernie reconnects with friends from a past voyage and leaves with them for Cuba, narrowly missing Pearl as he goes.
Later, Pearl and Newt reunite and become performers at the café, along with the venue’s singer Chick Bean Tony Martin, whom Pearl has admired. Chick confesses his love for Pearl and asks her to leave New Orleans with him. Before she can decide, Ernie’s cousin Buddy Buddy Ebsen arrives with a letter from Ernie indicating he’ll be in New Orleans the following day. While waiting for Ernie, Pearl is approached by Warfield. When Ernie sees Pearl and Warfield together, he attacks Warfield in a fit of rage. The police arrest Ernie, and Pearl leaves New Orleans with Chick.
Ernie’s fine is paid by Leota Long Katherine DeMille, a Pecan Point woman who is romantically interested in him and jealous of Pearl. Leota and the Holley men return home, where Ernie is compelled to wed Leota. During the wedding, Pearl returns for her possessions and fights Leota, who cuts the Holley houseboat loose in a storm. After landing safely, Newt serenades Ernie and Pearl as they reconcile, bringing the story to a quiet, hopeful close.