Don't fret. It's easy to mistake your house when it's surrounded by other houses that look exactly like it. He was just trying to help and I'm sure he was startled and confused by you being there.(and making loud noises. lol.) He doesn't necessarily know which duplex you live in. I've had awful neighbors before so I don't even think you overreacted.

It was just a bad moment...that seemed to get worse. We all have days like that especially us bipolars. As hard as it is try to stay optimistic, I highly doubt you will be kicked out of your house.

I hope you feel better now.