The city’s waterfront centerpiece won't ever win best in show, but its decrepit bandstand, paths and greenery are surprisingly appealing, all shaded by palms and facing the docks.