I agree with an earlier post it sounds like diaper fetishism to me which is a distinct though connected group to adult babies. Perhaps you're just a diaper lover (or DL) as they say within the community. If it affects your daily life and causes you distress you should probably address those issues but it doesn't mean you have to give it up entirely or even necessarily explain it as long as you are happy and not hurting yourself or anyone else. You may want to try talking to some others within that community though, it may help.

Try for instance the forums on
dailydiapers.com