'Sorry but I have to do something/take care of something. I only have an hour (or say how much time you have). Then I'll have to get going.' Or say you are a little tired, or have a hobby or something you want to do as an excuse.