Just out of curiosity, do you play on a server with limited area for building?
I mean, the world is effectively infinite. If someone finds a nice patch of dirt and makes a hovel to live in, what's wrong with accepting that and moving to a different area? (it's an honest question). If someone is making little cobble houses all around the world and not doing anything with them, you might have a discussion (and my response would be 'leave anything they've lit up alone and do what you want with the rest').