I think it depends on dose, individual reaction, etc. There is "neuroleptic induced deficit syndrome," mostly reported with older drugs. Its basically what you're describing, from the neuroleptic. With depression on board, too, it could be a problem.