You can use oil instead of capsules, which might be better anyways. Capsules might have a longer shelf life but you cannot tell if is is bad inless you break some open to check. Dose is usually alot lower in a capsule so you would have to take quite a few more depending on brand, which is not cheaper in long run. Tho not all oils are equal that is forsure. You can get a lemon or different flavour to mask the fishy tatse and with little to no after taste if you find that a problem. And always always look for a brand that actually publishes independant lab testing, and check it! Sometimes this info is available on the website for certain brands. I agree about the Krill Oil.
Here is a pretty good link of what you should look for when selecting an oil for omegas it is pretty informative...
The definitive fish oil buyer’s guide
Hope that helps. Or just eat a lot more fish

I do but still not enough.