I have lost consistently over time, but I have had weeks where my weight stayed pretty constant and weeks where I lost faster than average, which evened things out in the long run. I would have expected some loss from the 5 day fast; it's surprising but not shocking that you didn't see a change. Unless you accurately track calories on the bingeing and healthy days, it is hard to say how much effect they would have in the long run. Calculate how much you burn, eat a few hundred calories less than that (logging every single thing you eat) every day for 3 weeks and you will see the scale numbers dropping. Keep in mind you may burn less than the calculator says (adaptive thermogenesis from previous loss). If you read through the linked article or skip to the end, you will see that can be as much as 200-300 calories; not enough to explain any so called "starvation mode", but enough to cancel out what you might think is a slight deficit, or make you lose weight slower that expected from what you thought would be a big deficit.

EDIT - Note that I said it can be as much as 200-300 calories. There is no way to be sure how much it will affect you. I think I am off by less than 200. I use the figures for totally sedentary even though I have been walking about 4000 steps a day. It does not stop me from losing weight; it just makes it harder and slower. When I get to maintenance, I will have to eat less than the calculator says if I want to stay there (and I do).