Hello scatterbrained04: I have two thoughts with regard to this. First is that, particularly since you are management, you need to establish some firm boundaries. From what you wrote it sounds as though some, or possibly most, of the employees who vent to you are not peers. They're people who are below you on the management pyramid, so to speak. If you are management, you cannot be these people's friends or confidants. And even if these "complainers" are your peers, allowing them to vent to you is a very bad idea. Based on my experience, I would have to say that no good will accrue to you as a result of allowing this practice to continue.
Second, since it sounds like you are wondering if there is a possibility you might be fired, I wonder if you could schedule a meeting with your immediate supervisor & talk candidly about how you're doing & where you stand with the company. This would also give you an opportunity to reaffirm your commitment to the company & your determination to do the best job possible.
Here again this is just my opinion (based on my educational background & employment history as a vocational counselor) but I don't believe there is anything to be gained by simply waiting & wondering. Better to get things out in the open & know where you stand. If there are areas in which you need to make improvements, knowing about them, at least you have the possibility of addressing them. Otherwise, you're just operating in the dark hoping that the ax isn't headed your direction, so to speak. Good luck!