In my experience, babies will sleep through noise just fine.

BUT

As for your intolerance to noise, I really feel for you. What about getting him the headphones and handing them to him? HERE: Use these!