Yeah, they are pretty weak, health-wise. You want to keep the portal turret far, far away.
In Beta A they had a ridiculous 40 block firing range. And, once they start firing, they have a high knock-back value, so the wisps probably wouldn't get close.
IIRC, if you grab one with a...