He isn't drifting away. You are. And, your letting yourself, because things don't seem as exciting to you.
I agree with Golden Waves. The newness is wearing off. It always does. What keeps people together is more then love.
I hope if you break up with him - something I don't think he is expecting - you make sure he knows, it wasn't him. You're both just young.
It is mature to understand when you are too young to say forever.
Just my opinion. Good luck to you both.