The 3 onsens were first-come, first-serve. If the lights are on, they are occupied. This door led to 2 of the 3, and as you can see by the lights (and the slippers), they are both occupied.
The 3rd onsen is down the hall fromthe first two.
Try again later.
