If I recall, thats you either reloading or loading areas of chunks, which happens gradually as you travel, building a buffer, whereas when you spawn, you have to load all of them again.
Oh, and FTB is so much more memory intensive because you have many more things to render/block types to...