This is what I was told as well, you can do it with a mill, but it won't be fun.
"Buy the lathe, build your mill." Hell, google the phrase "The only machine tool that can replicate itself".
Look at guys facing giant pieces of square stock using the lathe chuck as the tool hold, like a giant...