Depends on your child. The open house is less about you meeting the teacher or even your child meeting your teacher but about your child getting the lay of the land. She'd see her classroom, desk, what kids are in her class and at least get a visual of the teacher.
Our DD's K teacher was so busy kissing up to the parents on the PTA foundation that she barely said hi to any of the kids much less the other parents that I wished we had skipped. But this is for a kid who doesn't really get anxious about this kind of stuff.
For DD's younger sibling who is more nervous about this stuff we made it a point to go even knowing he wouldn't actually get to "meet" the teacher and I think it helped him anyway. (DS had the same teacher as DD.)