I usually have the opposite happen. Perlite should break down from chunks to what it actually is, volcanic sand and sink or mix in with the soil. It could be the quality of the soil...?