I'm someone from Otaku country,still I think it's red flag.

1:he "show you"those books.(If it's secret hobby which harm no one,he will never show you)

2:If he didn't do anything and wrongly accused,many people(maybe there's exception)will not react like him.(sorry about my English)

so,trust your gut instinct and stay away from him.