In nearly all of my hiring experiences over the last decade, I had to provide work samples and/or do a short project to show my capabilities. At least for my current freelance position they paid me for the test project. The only situation where that was not required was with someone I knew professionally before I started working for the company he was launching.
You are in your right to refuse, but it is likely to limit your opportunities.