I’d say you could wait now for him to initiate next outing. You asked him for dinner and he responded positively. You had a good time. Now wait for him to ask you out to dinner (or lunch or breakfast or walk in the park), either at his house or out.

For me taking it slow means giving it time to develop naturally and see if there is reciprocation. Going too fast would be for you calling him and asking him out but him not reciprocating.

Also I’d say going too fast would be professing your love before you even date or are a couple.

There are no rules about sex on a third date, I don’t recall anyone insisting on sex on a third date. But I’ve met men who wanted sex too soon. Usually because that’s all they wanted. Doesn’t mean you have to give it. And yes there are women who push for it too soon too. A person who really values you and is serious about you will wait for it.