I've come to realize this very thing myself not so long ago. I've been reading Thoreau and various anarcho-primitivist writings for some time now, but only fairly recently actually tried to examine the practicality of it.
A substantial disconnect from the current socioeconomical confines is becoming less and less feasible due to the invasive overprotection enabled by technology (mind, I'm not a luddite) that we are subjected to as citizens, while the decision about participation in which is entirely not up to us. There's no "I understand the risks, let me out" form to fill out anywhere in the bowels of the state's gargantuan machinerie. The only approved way of life is a brownian, peer-enforced conformity to every new unnecessary and meaningless crap, be it material or ideological, since about every concept of noble intergenerational cohesion has been clubbed to death and then some by big money and even bigger emotional immaturity. If you don't want to tag along, with every move made more controlled and commodified, you're writing yourself off as a freak and lunatic.
We have collectively assumed that to torpidly wither away under a skin-deep illusion of diversity and freedom is a far better outcome than to die precariously as a master of one's own existence — and to think otherwise is a sign of dangerous madness that must be eradicated. We as a civilization have a growing, debilitating tumor on our body and fervently cherish it because we caused it ouselves; being able-bodied is passé anyway. It's so bizarre.
I'm currently saving up for a piece of land nowhere to some day live with like-minded someone(s) and maintain possibly minimal relations with institutional forces. This vision might be tough to achieve, but is one that fills my soul with hope.
Got sore throat from this rambling, another one of this firebreather please.
I'm perfectly content to be written off as a lunatic. Much of my childhood was filled with exasperated variations on "why can't you be NORMAL?" I'm used to it.
You do hit upon a very important point, though--this isn't a task to be done alone. There are very few people with the skills and the personal fortitude to live a non-institutional life all by themselves.
We need a tribe.