Ok, I am no expert at all when it comes to dream interpretation.
But it seems to me that his presence in your dream could represent the presence of the past abuse in your life, and your aversion of him sitting there is your aversion of that chapter. - It doesn't happen anymore, but it did, and the memories stay seated at the table like your father. Nothing can make that go away, even though it doesn't repeat itself.
I am glad to read that you have a nice and supporting husband