havent u heard of rastafarianism? well u should look that up because thats basically what u are talking about.
they smoke weed as part of their religion and dont have any form of church service or preists. but even though the bill of rights says we have religious freedom, rastas or still arrested.
timothy leary tried the same thing u are talking about, only with lsd, and it worked for a while but then the government changed their views on "religious freedom"