It will get easier!!!! In the beginning it will be very hard and than get better.
I was with my first family for 8 years as a live in and the youngest was born while I was there. It was extremely tough when I first left. Especially because 2 weeks after I left I found out I was unable to have children. I ended up changing careers for a bit, but went back to nanning when I missed being with children.
I was lucky I still am in contact with that family and see them at least once a week. The two oldest are now in college, third oldest a senior in highschool (and just got excepted to his fourth college) & the youngest is 13. They tell me I'm their second mom and I'm in the will to take care of the kids if both parents die (yikes! Horrid thought makes me sad

)