If he is that rude I would take it as a concession. But before picking the ball up just call out 'That was halved then!' (or whatever).