Ignore him. There's a lot to be said for the strength and courage that it takes and comes from perseverance. Do what is right for you, and whether it is school or anything else, do not let anyone sway you from your goals. Get the school code for financial aid and file your FAFSA at: http://www.fafsa.ed.gov/. Summer there are at least 6 credit hours required to get aid, but loans are still possible if less hours.
Do what is best for you and your goals, and all else will fall into line. Good luck!