Absolutely. Ask to let you think about it for a couple days.

I wanted job B but job A contacted me first, I told them to give me a couple days, then heard back from job B who hired me, then I called job A and told them I had taken a position elsewhere.