Yes, many bathhouses and saunas in Taiwan have facilities for changing clothes and taking a shower. In fact, most of them offer this service as part of their amenities.