I would personally prefer it to load chunks in, more or less, a "bubble" around the chunk-loader.
Which a player could set.
I like the possibility of going fully infinite.
But really infinite is of no great use to me.
But would LOVE deeper worlds and higher mountains.
Well put sir.