Nope destroying the spawner will do nothing, there is a Dark Node somewhere near that Totem Platform it will keep spitting out Wisps constantly, so the only way to stop the wisps being an annoyance is to build a box around the node, as you can't see it since I take it you don't have Goggles of...