In the Book of Joseph, it is canon that Jacob Seed would steal things like candy for his brothers because they lived in extreme poverty, and he wanted them to have some joy because their father was an abusive drunk. Despite Jacob being cold, he has a soft spot for his brothers, and he would do whatever he could to protect and provide for them. I imagine this inludes Jacob taking John and Joseph to places so they could have a childhood. - even just for a moment.
This is one of my favorite SPN scenes.