I think it was actually THopreau who built the shack on his friend Ralph Waldo Emerson's land at Walden Pond.
Whitman did live out on his own though, as far as I know.