I think that you should not go unless you can assert your right to decide how you spend your time on your visit - in other words, if you can assert your right NOT to go the lecture and just stick to your guns.

You can even say to your mom outright that you expect her to just be happy to see you, without directing your actions, and if she cannot be happy just to see you, then she won't see you. It is reasonable.