We had long curtains. We put the rods up with oversized anchors and then used pinch clips on rings to hold the curtains. If you pull the curtains just unclip. Totally safe.
We also hung pictures over the crib and changing table. We replaced the glass with plexiglass and screwed the frames into studs. They were totally secure.