I highly doubt they could peruse any action against you legally for switching caregivers, especially since it sounds like they aren't providing you the care you need. That kind of caregiver selection is highly suspicious in my opinion anyway. You must be free to choose a caregiver who can actually provide you care, right?