Just take it, whats he gonna do? "Ma', dad! someone took my glass pipe!" that is, if you don't like your bro that much.

Otherwise make the bitch hook you up with some glass. If hes smoked you out before I'm sure he wouldn't mind getting you a glass piece. He might not want to sell you pot just incase you got caught, or just because he only buys enough for himself.