This is result of low download speed on your end on the server, or low upload speed by the server.
In essence, when you join a world, you download the data, and to my experience, the "initial join lag" as I would like to say is basically the client trying to download the data in queues, and...