Ditch the clay.
Yes, in a lawn for example it's a water holder... for cannabis, it's not your best bet... try the polymer 'crystals' that hold water.
Also mulch heavily around the base of your plant, using leaves, which will conserve water and discourage weeds.
Things to worry about:
drought
not noticing diseases or nutrient problems because you're not there
weeds