I can't tell you the number of times I heard that - from my own family!!!! I still have a friend who tells me to get a job so I (64 in October) can get off Social Security, etc. He hasn't worked since he was 25!!! He got lucky and married my late cousin's ex, who worked at Ford for 25 years.
Me, I'm in a wheelchair. THAT's why I'm not rich. I worked, I owned a house for a bit, all the while collecting SSI. People told me since I was a kid, you're smart, intelligent, decent looking, but yet, all people see is my chair. I'm a liability, a burden.