Even if the server loads a chunk, that doesn't mean your client is constantly aware of what's going on in it. Again, a communication problem between the client and the server is probably the issue.
Unless you're in SSP, in which case do you happen to have Optifine?