Dont worry about what people say. Its not worth the aggravation and anxiety its giving you. You making your life better! Give it some time. Then get a job in your field and get some space.

People love to talk no matter. Next you will get a apartment and they will complain about that. Do your best, love yourself, and hek what people say!