I would recommend a course of treatment with a Physical Therapist who specializes in overhand throwing. There are a number of exercises that can help strengthen the supporting structure of your shoulder. Keeping the joint in proper alignment helps reduce pain. I'm an old man, but I had a slap repair 7 years ago and I still have a couple of simple go-to exercises that help keep things in alignment.