Carbonated water tastes sour. We don't actally taste the CO2, but once in water, CO2 become H2CO3 which is an acid.

All acids taste sour, H2CO3 is no exception.

Simple as this really.