It sounds to me like this is more his problem that it is yours. Unfortunately I read about this type of thing all the time where Facebook is concerned. Some people feel obligated to accept friends requests. I think you are well within your right to delete anyone you want - it is your account after all.