"The Daffodil Sky."
A man recently released from prison relives the events that put him there. He goes to visit his girlfriend from before his sentencing, and is greeted by her daughter, perhaps his daughter as well; the two of them go together to a pub. Serialized in the Daily Sketch (beginning January 5, 1953), The Daffodil Sky (1955), Seven by Five/The Best of H.E. Bates (1963). Reprinted in Go, Lovely Rose: Three Short Stories (1989), Short Stories for Students, v. 7 (2000), Booksworms Club Gold (2007).
Online Full Text at Hathi Trust Digital Library.