Willie Clark's father came from the Ganyju people at Lockhart River but was removed from his family as a teenager because he was the son of a Scotchman. Clark's mother was a school teacher at Yarrabah mission, Clark stayed in school until he was fourteen and expected to start working; he began working with a horse team on cane farms, and then cut cane for twenty years until he injured his back. After this, he found work with the railways. Willie Clark's sister married
Norman Underwood (q.v.).