The only thing that I can narrow it down to that caused lag in Infinity 1.4.1 is a big hungry node with 8 other nodes around it at the corners of a 9x9 cube, but I'm not entirely convinced that that was the cause.
I thought it was that too, it was actually AE2 doing it