You cannot "get yourself sick", from your own germs, by not washing your hands after going to the bathroom. You can pick up diseases from germs left behind by others, though. You have to completly wash, not just rinse, your hands in soap and hot water before leaving the restroom to be safe.