Why did you remove healthy, high fiber food? it softens up hard stools, and bulks it up helps with diarrhea. Were you diagnosed with IBS? What did your doctor advise you?

If it's not helping, you may need more treatment, it could be infections, you may need breath tests for lactose yogurt has dairy (too much of something is never good), stool tests, scopes.

Keep doing the process of elimination with different food groups one at a time to see what you are specifically intolerant to, by writing in a food journal, stress managemtn is also one of the biggest things with ibs