Any good relationship should start with friendship for sure. In my opinion, there is nothing wrong or selfish about not wanting to get involved with someone with a disability. Don't take anything on that you know you won't be comfortable with. That won't keep you from loving the person and wanting to be with them. I'd say do pursue an emotionally beneficial relationship but don't commit to more than you can handle.