Indoor or outdoor?
Indoor, it shoudl not make much difference, although I prefer white because it adds to the overall brightness of the room...
OUtdoors, black pots absorb a lot of sunlight energy (heat) and are suitable for gettting started in a cool climate, but I would not use them in direct sunlight where summers are hot.
I suspect that what you are seeing is primarily coincidental.