How should I have reacted to this? ?

Don't over-react. Tell him he is a dope and deserved a kick in the jewels. Most likely won't happen again.