If a coach gives you the "take sign", the batter is NOT allowed to swing at the next pitch.  You are expected to track the ball and focus on getting your timing down.