I would definitely tell him that you are not comfortable with this, and that he needs to respect your request that he not have contact of any kind with her. IMHO - it seems like he is sorta keeping the door open with her if you and he don't stay together. I would definitely put my foot down with a very loud "NO" !