Once you get teleported to the place with the dollhouses it has almost none houses, if you find the pendulum it wont let you finish the quest
You will be able to turn in the pendulum now at least. The problem where houses stack on top of each other is a known bug.