I lock the door behind me every time I come back inside. Even when my son or boyfriend are a few steps behind me. My son adapted and takes his keys everywhere. My boyfriend brought it to my attention a few months back, and I was flummoxed. I don't do it to be rude, it's just that if it's a lock and it's behind me, I am turning it.
Feeling unsafe is NOT an issue.