Don't be hard on yourself. This happens all the time in so many different ways. I gave some phishing website my phone password a few weeks ago but realized my mistake quickly and changed all my passwords. Nothing happened.

I hope the fraud department is able to help.