You could try to create schedules like what days or times you will have time for: insert sharing time or entertainment etc

You might need more people and resources than just him. Friends? Family? Therapist?

Also when you have quality time, do you reserve any time to just talking, not always entertainment etc?