We stayed at the Pelagos Apartments at the end of Oct 2005. Our top floor apartment was great with a balcony at the front and rear. The apartments are about 5 mins from the village there is a short but steep incline upto the apartments. We had beatuiful views of the sea and the mountains. The apartments was clean and the beds were changed mid week.
I would sugggest a car hire to see the rest of the Island.