I had these feelings too...i experimented and actually found I prefered the company of men over women so i would consider myself more gay than straight...but i am still slightly attracted to women!
Nothing you can do really, except either pretend your not (like most homophobes)
or accept it and experiment...

Most normal people experiment at some point in their lives
Thats the only way your going to find out what your happy with

Nothing weird about it really...and fuck what anyone else thinks....
It's your life, live it how you please
(just dont hurt anyone in the process!!)