Listen to Rusty on how to deal with it.
As for potential problems, sure you can lock out nutrients with any sort of mineral buildup in the soil; your goal is going to be managing this so you don't ever get there. When you water, do it at correct pH and water to slight runoff, letting the soil dry out fairly well between waterings. You don't have to worry about letting it sit. That's not an issue.