No.
Not in my opinion anyway.
Not as long as he is on a good summer/fall team where he can get exposure. Locally, we had at least one player go D1 after his very young HS team had a miserable season. The key was that this kid was on a good summer team where he got plenty of exposure at a highly competitive level.
Speaking as a small school parent at a school that focuses on performing arts rather than athletics, it is hard to make the adjustment from the really good summer team playing at a high level to the less intense HS team - at least it is for me as a parent/spectator, and I would guess it is for the boys, too. But it's also a great opportunity for the more experienced player to be a leader.