People will think what they want. I'm a lifetime entrepreneur. It doesn't matter what they think. When I was successful everybody was my friend. When things went sideways, people vanished. All of these people work in an institution or worse, so it's easy to return fire. Entrepreneurism is tough, and it's a ride, even at the best of times.

My advice is to just work on the things you need to get done. Best approach is to manage lists of things to get done. Get a MVP (minimal viable product) working and selling. Then build. Entrepreneurs are resilient (one of the reasons I'm in here, to fix my issues), and we enjoy accomplishing the things that get in the way. When people piss you off, ask them how they handled their startup, and watch their face. Then say 'exactly'.

Treat yourself well (diet, exercise, sleep, hydration) and every week reflect on what you accomplished. Go out for a glass of wine and enjoy what you're doing.