I hope you won't play games with him about it, as you're concerned he may be doing with you. Expressing your deep concerns honestly is so important. One way or another, it will clear the air and resolve this as fast and painlessly as possible.