This movement is a balk, but not for the reason mentioned above.
6-2-4-e says it is a balk if the pitcher takes a hand off the ball while in a set position unless he pitches to the batter, throws to a base or steps toward and feints a throw to second or third.