If it's on public property, or unfenced common property, or sompelace where a casual passerby can find it, it ain't stealing, it's the grower being stupid.

Other side of the equation:

If it's behind a fence in someone's private field, yer buddy's asking for trouble.