Dramatic sea cliff walks and the UK’s smallest city are a stone’s throw from one of the finest boutique hotels in Wales, as James Ruddy discovered.