Feeling Guilty because of new job

So, got a new job at a much nicer place. I bartend and the new place is a high end place with craft cocktails and high end customers... equals bigger tips
Problem is, upon hiring, I told them my availability in TWO weeks and they said they needed me now or not at all.
I've been disliking my current job for a while: the managers are buddies and are rude to everyone. At one point, even talking trash about me behind my back to people I've know for many years.
Tomorrow, I work both the new job and will be working the last day of the old job... but they don't know that yet! My guilt is killing me cause this is not how I do business. However, the new place is worth it! They're brand new, opened up this past Sunday and I'm excited to not be in a dark little bar in a strip mall any more... while it's busy, it's not my cup of tea!
I know I can pull this off, but the guilt is eating at me!

Are you contractually obliged to give a period of notice? if not so be it, tough on them.

If so have any holiday to use up or can you throw a sickie? They might not like it but at least they are less likely to bad mouth you.

No, I'm in Florida "Right to Work State"... I'm not under contract.

Here's a little quick background: a few weeks ago there was a meeting, minus all employees. A "memo" was issued, written very unprofessionally with curse words and telling us not to be assholes, etc. Pot calling the kettle black... w/e
After this "memo" two people quit, gave notice, but quit. There were things on the memo I felt were directed at me and I was assured they were not. However, my shift directly following this memo, when I came in, I was met with an extra person and told that they were there just in case it got super busy. they were sent home 30 minutes later. A few days later she mentioned how in the many years she's been there, she's NEVER had anyone quit without giving a 2-wk notice... LIES!! Since this memo, four people have quit, I will be the fifth! I owe them nothing... I've been there six months, but I still feel guilty because I have more professionalism than she does!!
I think that's my point.... idk

Your first responsibility is to yourself - fundamental rule of capitalism.

^^This. Take care of yourself first.

Honestly, I wouldn't feel guilty over leaving your current place of employment especially since they are unprofessional and disrespectful to their employees. If it makes you feel better, consider them losing you so suddenly as an act of karma.

Sod 'em - second rule of capitalism

Not sure what that means...

I posted something similar recently. "The feeling of sneaking around" was my post subject line, I think, or something like it.
All I got was support. Wise and supportive words which I can now pay forward to you....
The truth is, if the shoe was on the other foot, they would not think twice about dumping you without any notice.
Your guilt is a good sign -- a sign that you are a caring person. Sociopaths feel no guilt when they dump people, but those of us with a conscience feel GUILT. However, this is not a healthy workplace and it seems to me that if you pull a sickie day in order to preserve your peace of mind in these dysfunctional times at this dysfunctional place, well, that's the Karma they have sown.
And just so you know, guilt is one symptom of change being made -- you are leaving the "old you" behind and entering new territory and it is a symptom of growth and change!

I like it. They treat everybody like crap and if it wasn't because so many people quit, I'm positive she would have everything to make me quit... Because, again, that's how they work and do not want to pay unemployment...
Thank you for this, truly! In my mind, I knew I wasn't in the wrong, necessarily, but my professionalism kept me feeling guilty!