I figured it out. When I first added thaumcraft to my pack I changed the tick setting in the cfg to 3 instead of
"# How many ticks a golem waits between checking for tasks. Setting it higher will save server ticks, but will make the golems slower to react.
I:golem_delay=5"