I think that it could grow with time, maybe not in your case but it has happened as you see different facets of a person over time you could fall in love. There is no rush to fall in love anyway, be friends if it happens it happens. I think our notions of it has to be love at first sight is one of the reasons for the high divorce rate. A physical attraction is not going to be enough on its own to stand the test of time.