I never have that problem BUT my pedi rubbed off completely one time when I went hiking and stepped into a creek I didn't see. Apparently there's something about the combo of athletic socks+moisture that kills nail polish. It doesn't sound like that's your situation but I wonder if your toes might be getting very small drops of sweat or some other moisture? just guessing.