That is a great suggestion, and no, it's not selfish at all and your reasons are perfectly valid.
Your friend I believe just wants your company, which is a nice thing, and perhaps is being a bit selfish themselves.
You have to do what is best and right for YOU. (((Hugs)))