There are some good intelligent people in the world, the only way you know if you will get on is to spend time together, (not necessarily live together, I am similarly conservative) but over a long enough time to really know them and see the warts and all.
There's no shame in finding the warts and deciding it's not for you, that's what dating is for, it's the attitude that's casual, I believe, rather than the length.
Best wishes