There are places around that sell candles, crystals, herbs, incense, spell books, tarot cards, etc. (New Age) a lot of these places are owned by witches and pagans. If you go to one of these places and explain your situation and ask if there is anything you can do they should be able to help. Make sure that the store isn't a franchise store though (Mystic Moon for example) because these people aren't always, uh, fully knowledgeable in what they sell. If you look under New Age in the phone book you may find a listing of different stores.
The places I've been to with real witches and pagans (and not people who just enjoy calling themselves that) have a real sense of safety, so if the second you walk into a store you can feel a really peaceful vibe, you know you're definitely in the right place! They should know exactly how to help you when you tell them what you need to get rid of, and will do more than just sell you something. When I went to get help the first person I spoke to went straight to the guy who worked there and told him everything, and then they both told me what to do, wrote down everything I needed to say, etc., and I didn't feel like a twat for it all.
If you're still not sure then go to a few places until you find someone that feels right. You may even find someone to come in your house and do it for you (when I did it I was absolutely terrified, having to tell someone you can't see to leave is more than a little unnerving, even if you aren't 100% sure anyone is even there!).