Reading your story was very odd for me because it was very much like/unlike my situation at that age.
I lived across the street from Normie Huff (presumably "Norman"? :-) and he and I were the same age and boyfriend/girlfriend from the age of 3 and I couldn't wait to go to school/kindergarten together with him. However, he ended up going to morning kindergarten and I had afternoon or we went to different schools, something; I remember watching him get on the bus that first morning and being so sad and anxious (I don't remember how I got to school). So your father's wondering why you didn't go with the boy across the street, made me wonder too

(I have 3 older brothers but don't remember the next older being in that school with me at that time, as I think he probably was; my father remarried and our family moved across town to my stepmother's house only two or three months into kindergarten).
But the walking to/from school and being afraid of your mother was poignant to me because I use to wander at that same age, alone, during the day; presumably after school or during summer or something. I remember the maid, who was nominally supposed to be looking after me; my three older brothers were in school all day and my father was working all day; would find me when I wandered home and I'd have my head literally over resting on my shoulder (not quite that flexible anymore :-) and the maid would threaten me with telling my father and assure me that my father would punish me. But I never feared he was; the whole thing would mostly make me feel lonely. I only remember good memories of my father and that lack of fear of my father punishing me always puzzled me such that I once asked him if he punished me at that time or Margaret (the maid's name, same as mine) told, etc. He didn't remember specifically and "imagined" he may have spanked me occasionally but my feeling toward him as a three to five year old and then my memories of my stepmother, four to seven, are so very different. I can see where the "base" experiences I remember of myself and them "made sense" later.
I'm glad your parents ended up on the "same page" as you started, I can imagine that feels good, as sad/poignant as it is for the older sunrise to have to experience that young sunrise now. Even your father's distracted "why didn't you walk with the boy across the street?" probably feels like true him to you now and is almost equally as sad?
I would definitely make an appointment with T to tell him about this and get his understanding and validation! Why not?