YES you should tell. If he knew going in that no guns was one of the rules of the house, and he's violating it, that's plenty of reason to kick him out. The property owner has the right to enforce whatever rules he or she pleases on his or her property.

I applaud your compassion in giving the young man a break, but it sounds like he's taken advantage of it.