Nope. the yearly one punch is consequence-free. Getting punched back is a consequence, so it would legally be considered assault as though you hadn’t punched them first.

Shhh… don’t question it.