This island is almost always an add-on between Athens and Santorini. Keep the suitcase still.
2 nights
Town and windmills the afternoon you arrive, one beach the next day, evening lanes, morning ferry.
4 nights
A second beach, a slower morning in Chora, and nightlife only if you want it. Enough without moving hotels.