I would agree that you would have to have sight at some point in your life to have "hallucinations".

But you would still "see" something if you had never had sight.

It may be the best way to show color to the blind.