Given how you describe the way he made the reference--stressing it was funny and entertaining, that the book is a novel, and that the book makes the mental health professionals seem just as "crazy" as their clients, I think you may be over interpreting. I'd say he was neither irresponsible or having countertransference issues when he recommended the book.

You suggest he also just up and left his patients? With no records? To me that's a far more serious beef than the book. I'd focus on that if you're trying to get over him.