We were in Marrakech and Agadir in Oct with two toddlers. I would love to do Fez and Essouria too. We had an amazing time and I would go again in a heartbeat. I don't speak French or arabic and we had not problem at all. Just know how to haggle and take the delux suprabus if traveling in country by bus. I also highly recommend hiring a guide for the medina--we had a great experience and wouldn't have wanted to get lost in the Medina with little ones.
Everyone is super child friendly, for starters. I kept my head and both children's heads covered and wore lightweight long pants and sleeves for sun protection and modesty--it was a really good move to attract less attention in Marrakech. The
I highly recommend the Sofitel in Agadir if you need a beach break.