you can use pulverized diatomacious earth if you wanna keep it organic. All you have to do is sprinkle a layer on top of the soil.

It also acts as an insecticide against crawling insects as well.