I know how you feel. You sound exactly how my fiance and I felt in the start of our relationship. However, the quirky things will seem to disappear, the fear of "is he using me?" or "what the heck is wrong with him for wanting to be with me?" will go away. It takes a lot to fully open up to someone like that. Especially if its a person you don't typically go for. If something is really bothering you about him, you and him really need to sit down and talk about it and how to fix this without being too aggressive.