This isn't quite like the full freight residential college system that you are describing, but UVA has three: Brown College at Monroe Hill, Hereford College, and the International Residential College. I've heard that they're all wonderful places.
Also, before the UVA bashers roll up, I am not affiliated with the school! I have just been going on toooons of college tours with DC recently, and this popped into my head.