When testing the pH of the water, you'll want to check the unadulterated water source that you'll be using...and you'll also want to periodically check the pH of the runoff that collects at the bottom of the pot after a soil-flush. These will give you the best indication of whether or not the soil and the water have a pH issue. As for leaving water sitting to evaporate chlorine, this is really a personal preference, and isn't necessarily a mandatory step. Many a good crop has been grown using water straight from the tap.

As for growing in soil, you'll find that many folks prefer growing in an organic soil when growing for personal consumption. Hydro setups have their benefits, but they're more appropriate for commercial grows, in my opinion. Where individual watering of numerous plants isn't feasible. Read through the various Cultivation forums & Organic Growing threads to find out what has worked best for many of the growers here. There's no one right answer as to the "best" soil available on the market.