Hi, belle10, and welcome to Psych Central! I talked to my husband about this issue, so I'll share some of his thoughts, too. I think you are right that even if you had a boob job, then you would still not be comfortable with your body. Your boyfriend was attracted to you and what you perceive as your small breasts, so evidently breasts aren't a factor in his attraction. Otherwise, he would not have even gone out with you in the first place.
Did you go for a long time during your pregnancy without sex? Of course, you were supposed to wait at least six weeks after delivery to get back to sex, too. That could be a factor. Plus he might be getting used to you being the mother of his child as well as his lover. At least some men do have this issue.
Actually, he might have been into porn before your relationship, though. In this case, it's a strong habit for him. I do think he loves you.