When I was coaching, I would signal the pitch to the catcher then take off my hat. The catcher would then give the pitch sign as normal then adjust his facemask *after* the pitch sign. The SS and 2b would watch for that during the game. It did not happen often, so it would not get picked up by the other team.