The Jesuit Church of the Holy Saviour, just off Hlavné nám, was built in the 17th century. It's worth peeping inside to see the baroque altar.
You'll often find a musician in traditional costume playing a fujara (tall woodwind instrument) near the steps.