There is a third alternative, you dropping his stuff off.

I think this a better situation because you have more control over what may transpire. What I mean is, that if things go badly you can simply leave. On the contrary if things get uncomfortable at your place you really have little control of demanding he leave and that could really get awkward.