Shame on you. ;)
Seriously, though. Take inspiration from wherever. I've used places I've been like Montezuma's Castle, Jerome and Arcosanti (all in Arizona) the Hearst Mansion and that weird house, the name escapes me, with stairways and doors leading nowhere (both in California) places in...