Unfortunately society judges people, primarily on 2 things; looks and perceived economic worth (job,wealth, etc) . Both of these are erroneous assumptions. The ugliest person on the dating site could be your soulmate and that down and out could be a maths genius.
To the question 'what do you do' say 'i'm lucky enough to have money and I'm taking time out to develop my own business. I'm passionate about art and cookery and gardening, so they keep me busy.'
Google' meetup.com' and join a few groups.