"I do like him and I do trust him".
"I don't want to ruin it by rushing it"
"I just want to get to know him"
Your answers are within your post here.
Don't be afraid to honestly talk to him and let him know you like him, want to get to know him better and would like to take time to build that relationship.