Some of the reactions might be because of how society teaches us about work. Within a labour driven society like ours work is highly cherished, it is considered both a way for self actualization as well as alturism, having a job benefits society in great ways, while having a job is more arguable (It depends what you do!).
Basically, you were born into this society, so you're expected to bring some value to that society implicitly. The movement and mindset these days is shifting, that people who do actually bring no inherent value in society should still be cherished, so there is a shift in this thinking, but a lot of people still subscribe to the old method.
But an important concept to learn is that working is not an enemy, in fact it is one of the best ways to give your life some form of purpose. You know, I've read your previous posts before, and you're definitely aloof, and you've mentioned that you feel you don't bring anything to the table. If that was the case, working may be a way to fix it. And yes, it's hard, it's may not seem nice at first but you learn to cherish it (sometimes, sometimes you end up in a job you dislike, but this is the JOB you dislike, not the concept of work). Work is a good way to give you a sense of purpose and inherent value, to believe that you are contributing to this society in a positive way.
You don't HAVE to work to contribute, but working is an easy way to contribute. People can contribute with writing, advice, artistry, and what-not, while not strictly working in a full occupation, but to do this well is hard and most people who try generally don't end up adding this value. So, you've made a choice to not work, and you're very privileged to be in a situation where that is a choice, but emotionally and for your personal growth this may not be the right choice, it might be, but it might not and that's something to consider.
People want to believe they are worth something, working is a good way (not the only way) to achieve that feeling.