He is a douche. You are not wrong to have these concerns. So many red flags.
First, if he is talking to multiple people re:bad sex, guess what honey- probs talking about u. Second, he doesn't mention you to work friends- this says a) I don't vale the relationship enough and 2) I'm keeping my options open.
Third, if he is not making an effort to call/text ( unless he is hectic at work) there is no excuse. Something is going on. You know this or your radar wouldn't be up.
Ok, so you have trust issues, past issues regarding this- but honestly. You already know the answer. Sorry to be so blunt.
Xx