It does not matter how many hours you work, if you "can" work, the SSI is affected. The definition of handicapped they use pretty much says you are so handicapped, you cannot work to make money:

http://www.ssa.gov/ssi/text-disable-ussi.htm#sgact