We drove from RI to DC on Labor Day last year. We took a ferry from Block Island and it landed on the mainland at 2 pm, I think. Then we drove straight through. Stopped for dinner outside NYC off the turnpike, I think.
We had only mild traffic through Connecticut. It was very easy. We got home just shy of midnight. The kids had fallen asleep by then.