OP. You can look at this in different ways. There are many people out there who are not getting physical early. They tend to find each other. You might have dated some of them. They might have sensed that you wanted to make a move and thus walked away.
In my experience, the desire to move quickly was a characteristic shared by a personality that I avoided. There was an impulsiveness, and a live for today attitude that scared me. Often less sophisticated than the kind of man that I liked. In the end, I never slept with a man that I would never have married. Therefore, I had to get to know them well. Not once did a man go packing simply because I would not have sex.
Use your judgement. Know what you want. Be patient.