I don't believe that there is any rules as to how fast a relationship should or shouldn't go. I think that it's all about what both people feel comfortable with.

There is absolutely nothing wrong with going slower. Many go slower due to trust issues or they simply feel uncomfortable with rushing into things.

Finally, I don't think that he isn't attracted to you. It's likely that he isn't the type to rush into things for reasons specified above or he simply doesn't feel comfortable with taking charge. It might be best for you to be honest with him about it and communicate about the speed at which you want the relationship to move until you both come to a compromise.