He seems clingy , reply with "sorry I am busy" about a couple days later. "I will" would make him think about it the whole day.

I would feel bad because he might just want to socialize, but he's doing it inapproprirately, doesn't he have your other friends to chill with?