I dont think its wrong. The people that are noticing it are doing so from an outside perspective. As the prev poster said, its hard to see when you are in the middle of it.
You probably know the goals you have for yourself and where you would like to be and are focused on that rather than progress of the past.
I think thats good they noticed and told you. Maybe encouraged you?
Hugs

)