My son was like this, though not at all a "terrible" or rejecting infant. From what I've learned about child development that's not possible since infants do everything on instinct. My son didn't like being held, swaddled, being in baby carriers or anything like that. He didn't even like being rocked to sleep. The only time I could hold him was when I nursed him which was very often, so that took away some if the guilt I had for not holding him enough. Other than nursing, the only way to settle him was by walking him in a stroller was the only way to get him to settle down. He never liked touch growing up - hugging, holding hands or rough housing. He's grown out of some now and is totally well adjusted. He does have ADHD but his issues with touch and being held has been attributed to an underdeveloped nervous system. Very common in babies who grow up to have ADHD or on the autism spectrum.