Maybe my Eastern Europeaness, but I think sweatpants are for gym. I don't know, I would feel superawkward if I went out slacky.
If you can go out undone and not feel like you have huge neon sign "AWKWARD SLACK" above your head, than earth to you. I couldn't do it.