Uncovered would have helped. I don't know that the dryness of the bread matters that much, although you might want to cut back on the milk/cream if you're using soft bread.
You did let it sit in the fridge overnight, right? By the time the bread has soaked that long, it's going to be mushy.