This link talks about ways to care for kittens... Maybe the nesting box is too big kitties like to be really close to momma all the time... You can use hot water bottle covered with towel to help... The animal shelter uses tube socks filled with rice and microwave them...
How to Feed and Care for Orphaned Kittens Rural Route 2 - Books About Life on a Farm