It could be if you let it. If you talk to this person because you are good friends, then that's cool. But I wouldn't make it into such a habit that you neglect the guy you're with.
Be careful. Listen to your gut. If you think it's wrong, then it probably is. If it's innocent, then it is!