In Japan, you have to remove your shoes in all kinds of different buildings. It is the same in many other Asian countries and to a rather lesser extent in some cold weather countries like Sweden.
Which public buildings would you feel most comfortable removing your shoes in? Which would you feel most uncomfortable having to remove your shoes in? Here are the options:
Swimming Pool (the whole building not just the pool side)
Museums and arts galleries
Local government office
Primary School (as visitor not as a pupil)