You have a right, but that doesn't mean squat if someone wants to make trouble for ya.

If you rent or own your place, they cannot enter without permission.

Keep it on the QT and if you get noticed, then you show your permit.