If they're crawling in and out of the soil they are probably not spider mites. The mites live, breed and die on your leaves. Could be fungus gnat larvae. Do you have little black flying bugs, as well?