Personally? I think you've already got steps in that direction with things like the Internet Archive, but that's subtly different because the ergonomics are more around you need to know what you're looking for to find it.
The major issue that may hold it back though, is libraries wouldn't sacrifice their current duties and role in society to do it, (which I agree with wholeheartedly). and anyone trying to host an honest search index is going to have to deal with the political baggage associated therewith. If you host for profit, you will get sued. If you did it as a research project/labor of love (from the United States), arguably, you may have grounds to tell other people's lawyers to stuff it, but there are certain interests which will spend every hour and minute they can trying to get the courts to twist your arm into preserving the integrity of their business model. The law os also fraught with precedent that makes things like pirate site listing a no-no; but it is not clear to my knowledge if that is a blanket ban on indexing, or a ban on indexing + any type of amplification while reaping financial benefit thereby.
I've contemplated doing a project in that direction a few times. I always end up waffling before I get started though. I'd totally do it, but I have a feeling I'd better get a JD first unless I essentially want a hobby project to turn into some lawyer's recreational revenue stream. It's sad it's come to that, but it is what is.
It is definitely on my list of "Stuff to do once I've built myself up a nest egg". As I truly think an index unpoisoned by commercial concerns is something the world expected, and increasingly needs. I weep for a return to a more objective picture of the Web; one where it was in a literal sense more the worlds hypertext implemented phonebook rather than a cesspool of SEO garbage, and lawsuit driven optics management/platforming tool.
It just blows, because the moment you start getting people to help stave off what operational costs are incurred, and it goes beyond donation/volunteerism, you're done. Somebody will have an in to coerce you into distorting your search index. If not on commercial interest, then on the basis that of course, "some arsehole will host CP (or other verboten content) out there, and what do when you index it?"
I may be a militant enough "info must be free" personality to undertake the journey... But I'm one person, and my interest is prone to fickleness, and I've been called an absolute madman by enough people I have the feeling that if things did get off the ground sufficiently, I am unsure whether or not I'd find someone else willing to work on keeping the thing available.
And there are few things I hate in life more than being a Single Point Of Failure.
The major issue that may hold it back though, is libraries wouldn't sacrifice their current duties and role in society to do it, (which I agree with wholeheartedly). and anyone trying to host an honest search index is going to have to deal with the political baggage associated therewith. If you host for profit, you will get sued. If you did it as a research project/labor of love (from the United States), arguably, you may have grounds to tell other people's lawyers to stuff it, but there are certain interests which will spend every hour and minute they can trying to get the courts to twist your arm into preserving the integrity of their business model. The law os also fraught with precedent that makes things like pirate site listing a no-no; but it is not clear to my knowledge if that is a blanket ban on indexing, or a ban on indexing + any type of amplification while reaping financial benefit thereby.
I've contemplated doing a project in that direction a few times. I always end up waffling before I get started though. I'd totally do it, but I have a feeling I'd better get a JD first unless I essentially want a hobby project to turn into some lawyer's recreational revenue stream. It's sad it's come to that, but it is what is.
It is definitely on my list of "Stuff to do once I've built myself up a nest egg". As I truly think an index unpoisoned by commercial concerns is something the world expected, and increasingly needs. I weep for a return to a more objective picture of the Web; one where it was in a literal sense more the worlds hypertext implemented phonebook rather than a cesspool of SEO garbage, and lawsuit driven optics management/platforming tool.
It just blows, because the moment you start getting people to help stave off what operational costs are incurred, and it goes beyond donation/volunteerism, you're done. Somebody will have an in to coerce you into distorting your search index. If not on commercial interest, then on the basis that of course, "some arsehole will host CP (or other verboten content) out there, and what do when you index it?"
I may be a militant enough "info must be free" personality to undertake the journey... But I'm one person, and my interest is prone to fickleness, and I've been called an absolute madman by enough people I have the feeling that if things did get off the ground sufficiently, I am unsure whether or not I'd find someone else willing to work on keeping the thing available.
And there are few things I hate in life more than being a Single Point Of Failure.