They can even triple in height yo.
I flowered mine after five weeks. You should be fine with 4. Obviously a few more weeks in veg would be beneficial, but its not that beneficial if you run out of space!