All I can say is that just last week when faced with a situation strikingly similar to yours my son chose the school he preferred over his baseball offers. That certainly doesn't mean it is the right choice for you but it was for him.
And unfortunately, this is a decision only you can make. My son did a great deal of thinking about if he is ready to not have baseball be the dominant activity in his life and decided he'd like to continue playing but going to the school he felt was perfect for him was more important.
There are also other very good options in your area. Widener, Arcadia, York to name a few all D3 baseball schools with Sports Management programs.
Check College Board.com and see if there are others. Maybe you can have your Major and Baseball too.
Good Luck with you're decision.