Deep armchairs, light jazz, fortified wines and stunning night-time views over the island – this is the kind of place that makes you wish you owned a velvet smoking jacket.