Yes, Rehoboth is the closest thing in our area to Provincetown, although overall it still isn't all that close.
Cape May isn't Rehoboth obviously but has long had a reputation for being gay friendly:
https://www.movoto.com/guide/nj/the-7-best-towns-in-new-jersey-for-lgbt-families/
None of these towns is all that great for African Americans. There's no reason to think that the vibe in either Rehoboth or Dewey for African Americans would be significantly different than Cape May.
That's why I asked about OP's Cape May experience. I was asking from an AA perspective, not a gay one, because my sense is that it was the experience as an AA that OP was referring to.