Calcium supplements. Make sure you're getting 1200mg of calcium per day.
I used to have incredibly sore breasts during the second half of my cycle. I tried several different supplements alleging to alleviate the soreness with no change. Finally, the calcium did the job. I can't eat dairy so, clearly, I was deficient.