They are hollow, and have stairways that go up as well (made of birch, I think). From what I recall, they're a work in progress by the mod author, and should gain more functionality/purpose in the weeks/months ahead.
Fun fact, if you break the bricks, and move them, they'll change color. I haven't worked out how they know what color to change into.