I think it's ethically wrong but doesn't break the rules. It could possibly be considered greifing but you'd need to prove they did it to annoy the quarry owner.
Personally I would just talk to them and tell them not to do it again.
As the quarry owner how I feel would depend on whether or not...