An option is to not try to stop feeling guilty.

That option is to go ahead and do the right thing, even though you feel guilty.

You can do the right thing even though you lack self-confidence in your choice and even though you feel guilty.

We can’t control our feelings in the moment, but we can choose to do the right thing.