No matter whose fault it is, the fact that OP is so unhappy with the time he is willing to spend with her suggests that this is not a good match.