I think it depends on the person, just like some people can drink socially and its no big thing, while others take one sip and go raging alcoholic instantly.

But i think a good rule of thumb would be if porn starts interfering with your ability to socialize or deal with life or find a partner than its probably too much.