In the fall, they tend of have special events, like car shows or some type of festival.
One time, they had a car show...so many different cars, from monster to classic cars. Celtic festival, wine/beer festival.
Certainly nothing that involves swimming in the water. They do have some cruising thing.
http://www.ocean-city.com/ocean-city-maryland-events
ENJOY!