I think yes it's possible. I've fallen in love in one conversation or one kiss before.
Just be honest with him. If you're not ready that's ok! You don't have to say you love him if you're not sure or not ready. Make sure to take space for yourself if you need it too. Love shouldn't feel like being backed in a corner, if he does love you, he'll wait for you to be ready. Good luck