I'd suggest not giving up and maybe asking your Dr about changing dose or med. Some people do well on Vyvanse and not Adderall, even though the two are very similar (Vyvanes is a simpler formulation and may have less of certain side effects)

Not to mention other stimulant options.

For me, Vyvanse works well, while Adderall made me feel weird.

This article discusses more on figuring out adhd meds. Good luck!