I successfully used door in a previous patch, so either there's some weird bug that happens randomly, or this recent patch screwed it up.
Found a workaround, this bug does not occur if the bishop is the party leader and invites other party members.