Repotting is likely not necessary, but certainly wouldn't hurt, but you'll still need to address the problem since you cannot just remove the whole root ball without killing the plant.
I would simply water with Hydrogen Peroxide, use a 3% solution, as in 3% regular h2o2 and 97% water. That will handle what's in the ground which is were they are coming from. For the leaves, if you can just pick them off that's great. If you can't then spray with Pyrethrin or BT.