It might stress it slightly and you may notice slower growth for a week or so, but probably not. It should be just fine. Some people do that on purpose, believe it or not. I have broken stems completely off, taped them back together, and they recovered nicely.