I'd call it a minor disadvantage. Seems like there are enough other showcase/camp opportunities during the year where you can make up, for the most part, what is missed in the Fall.
I think I (internally) fretted more about the higher injury risk associated with football versus missed baseball opportunities.