Call a ball when the pitcher violates the 20 second rule. I doubt you will have to do it more than once.
Don't give a batter time unless there is a good reason. "No - stay in here." Eventually, they will stop asking (nobody likes to be told "no").