"would pay for some low quality bud from the local gas station?"

It wouldn't be low quality for exactly the reasons you state and not everyone would want to grow their own. A Canadian government study worked out that with their current population they would make £3.5 billion per year in tax. Do the maths.