Even Greece can be a little chilly in April - too cold to swim normally. Crete etc. will be a little warmer than further north.
Have you considered Morocco? Safe, and reliably better weather. You can rent an amazing place there for not much money. We rented a villa near essaouira which was great - jardin des douars. But travel there is a little trickier than Europe, for sure.