Moderating
I want to remind respondents that just because your experiences personally differ from the OP's doesn't mean that his problem's not valid. Cannabis is a medicinal substance. So everyone responds to it differently.

Now for my own response to the post:
So we start with the fact that cannabis is a plant-based drug, which it is. And despite what people like to cite as the it's-impossible-to-get-addicted-to-cannabis argument, there really are people who can. Just like there are folks who get addicted to food. To shopping. To video games. Or to the regular old stand-bys of withdrawal-addiction substances like painkillers, alcohol, and withdrawal-craving response illicit drugs. In a specific type of brain with a specific type of neurotransmitters and a tendency for substance receptors to begin work in concert systemically, cannabis addition can be very real. It's a matter of the opioid, caffeine, cannabinoid, and alcohol receptors beginning to respond together as a system in an addictive fashion. This is why these people even have withdrawal symptoms, probably (because the opioid and alcohol receptors are triggering that response).

Here's a really good, bibliographically sourced site with information about this phenomenon. There's much more information out there to be read, too. Follow some of the links in this site. Talk to a medical school librarian or anyone who's done g-protein/cannabinoid/endocannabinoid research.
The Why Files | 4. Recognizing drug receptors

The bottom line, Chrons, is that pot probably is working against you because you have that brain chemistry. So you can numb out on it and let the rest of your life go into the crapper. Or you can face up to the fact that you're not one of those people who can smoke it in moderation and begin work on the process of recovery. By the way, you're not doing your anxiety any favors, either, with it. It's almost certainly making your anxiety and depression worse. You're contending with addiction in addition to anxiety and depression.

Do you know how to seek some help for yourself? A referral from your doctor. A visit to your county mental health service. Those are good places to start. You probably need some sort of program through which to begin to facilitate recovery. And you could stand to be open to being evaluated for medical treatment of another kind. Depression and anxiety, especially if you're self-medicating, don't tend to get better on their own. You may be strongly opposed to prescription meds, but you're medicating yourself already, only with a fairly random dosage and different strains of medicine.