Stayed there 15 years ago for a wedding in a 1BR cottage where the wedding party booked out the entire place. It was cute and serviceable. Not fancy, but also not "rustic." Very unpretentious.
Easy walk to Menemsha Beach, plus staying at the property gives you access to a few other beaches in Chilmark. Would stay there again with my spouse or as a family after reading reviews. The place is 100 years old, so staying on top of maintenance is paramount.
The wedding was quite nice as they had the ceremony on the grounds of the Menemsha Cottages property, then the reception was at a nearby country club. Tbh, that was an awesome wedding.