Usually I'd give a couple more days if he's not replying as much, before assuming he lost interest, but he's only been back yesterday, and it's a start of a busy weekday. Depends on his type. I would call to talk next time in the evening to name plans for the weekend