If your feeling used before you have even slept with him, its probably a good idea to stay away from him. I think its important to evaluate your friendship with him and determine if becoming friends with benefits would limit you two into being fuuk buddies. Its okay to have sex with multiple partners so long as everyone gets tested for hiv/stds.

Don't have sex with him if it makes you feel uncomfortable.