20-60 plants all in one place is bound to attract attention. Be careful with that.

I'll second a mile as a reasonable distance. Place your seed patch downwind (look up prevailing wind direction in your area) from the bud patch. Cannabis is a wind-pollinated plant. This should be fine to ensure that you have the fewest possible seeds in your crop.