There's such thing as invasion of personal space with anything, relationship or not.
I hear where you're coming from, I went through rather a lot, particularly in my teens, this has led to two issues - needing affection way more than the average person and not wanting it at all. Two extremes, coming from the same place. What you go through doesn't make you who you are I don't think, more determines how you may react to certain things. I think you're completely 'normal', if something bad has happened to you in the past then it would be a normal reaction to perhaps not want to be touched. Certain things may trigger flashbacks that can lead you to not wanting affection in any way, being a social worker your partner should understand this. My husband used to work in mental health, he is constantly analysing me and it drives me insane at times. Everything always comes down to mental health, I can't just be having a crap day. Just because you've gone through something or you have mental health problems, it doesn't make you less human and it doesn't mean that you can't just be having a bad day just like the rest of us. It also doesn't mean that you aren't suffering from what you went through either.
As for things like housework, it annoys me that sometimes it doesn't get done as soon as it should, but it's not the end of the world. Other things annoy me more, but that is individual.