We took a little train ride over to the caves while there too... well worth a visit but very steep steps coming back out of it.
Will definitely go back again. Lovely for a long weekend away October time.
The caves are very impressive. I was at a concert there some years ago.
Story goes that the caves were discovered when a young boy fell through a hole in the ground while playing. Not sure if true though!
Great place for a short break also.