Up the hill from the Columbus Monument is the exquisite Catholic church of Our Lady of Perpetual Help, built in contemporary Spanish design by an Irish priest in 1939 with stones recovered from the ruins of Sevilla la Nueva.

At the corner of Market St is the courthouse, erected in elegant cut limestone and red brick in 1866, with a pedimented porch bearing the scales of justice. Across the way is the market, which gets busy on Friday and Saturday. Further west lies quaint St Ann’s Bay Baptist Church. Statues at either end of St Ann's Bay provide neat bookends to the town's history: Columbus stands at one end, Garvey at the other.