Morning Ken,
Depends how much pampering you are used to! Accommodation ain't cheap anywhere these days but there are self catering places too. Obviously depends on the season as some places just shut if not enough interest. Christine and I went to the Christmas markets in Cologne recently but as it was quite icy in the days before, we decided to stay at an hotel in Kirkwall the night before the flights to shorten by 20 miles, the distance to the Airport - I think we paid about £85 for a double with no breakfast (very early flight)
Riding up to Scrabster puts you into some great scenery and biking roads and it's nearer at the other side if you are staying in the West Mainland (of Orkney) as we do.
Lots of stuff to google:
Skara Brae
Italian Chapel
Kirkwall Cathedral
Churchill Barriers
Outer Isles Westray, Rousay, Shapinsay
Ian