It's not fair to date someone when you feel this way. You're stopping him from meeting someone who IS into him.

As to your mother, she sounds super controlling. Do you have to keep living there?