Update
We lost the game 3-0 vs. returning state champions and all-state pitcher.
I did use four outfielders one time during the game. I moved my 2nd baseman to Right-Center. Center moved to Left-Center. We used it against their leadoff batter the third time he was at bat. First two times he crushed it to center and then to left. His third time up we used our 4 outfielders and I feel it threw him off. We got a 2-2 count and he popped-up to pitcher(which we dropped and only fielding error).
Our problem was not our pitching. They were instructed to pitch backwards(Curveballs, change-ups). Our opponents specialty is crushing fastballs.
Our fielding was good too, but our catchers is young, so they ran on us and got into more scoring positions. We did have bases loaded, but lack of hitting forced us not to capitalize.
Overall, I think I would do it again and earlier. Especially since most HS kids don't do a good job of hitting opposite field; they want to pull everything.
Let me know what you think.