With five good years of a relationship behind us, I'd ask him. It would bug me no end--I'd have to find out, & there's no reason not to be straightforward about it.
Admit it's silly, admit you hate being suspicious, then simply come out with it. Find out--hopefully laugh about it--& move on.
Good luck!
Roadie