Normally I’d never advise people to quit their jobs but in your case I think you should. This job isn’t the right fit. It causes you too many problems. Its too much

I’d say if you do want to work for retail, try TJX company (Marshall, Sierra, Homegoods, TJ Max). You could work strictly in stock or merchandising, not around customers. Also they are known (speak from experience) for providing specific hours. If you say you can only work M-W only 10 to 2, that’s what you’ll work. You need structure. But I’d probably wait for Christmas season to be over and try again in January. Not now