This is getting really annoying, and it doesn't even make sense.
I've tried allocating more and less RAM and it makes no difference, texture pack or not makes no difference, not even render distance helps.
The only thing I've found out is that it's to do with the Game Render, it's up to around...