Btw him saying that he could have married quite a few women could be a way to show you that they is no soulmate concept (at least your T doesnt think so)- many fishes in the sea (i.e. Sam isnt the one for you)
As you can see we only can guess what he meant by all that the only way to know is to ask him