You can swim at various hotels in town, including Hôtel Neptune.