The internet is too different now to what Google (or any SE) was designed to index.
Too much of the up-to-date high value information is posted onto semi-public channels. Like facebook groups, instagram posts, telegram channels, etc.
At the same time, too much of the publicly available websites are becoming clickbait and mindless marketing drivel.
Just try to research anything slightly obscure that has to be up-to-date information (from the last few years).
Like "how to get from Nairobi to Kisumu by bus". Google maps doesn't have this (not surprisingly), but what about the SERPs? Nothing there. 90% of the results are useless bus ticket sale websites that have no info, just SEO. (You can't buy this ticket online anyway).
Is Kenya just such an off-the-map destination that no backpacker has ever written about taking this route? No!
The information is out there. You'll find it inside the related facebook groups for travelers in east Africa. And if not? That's where you'll ask. But the answer? It'll never reach a SERP in the future.
Even more sad, is that if you keep looking on Google, you may find buried results from years ago. From travel forums and such. What's sad is that the info will be 10 years old, since no one uses public forums anymore. (Unless it's on reddit, pretty much the last public forum with any reach).
You know, if that were the only roadblock, I wish someone would take the top 10,000 Google queries and just manually curate them. Hire different interest groups -- outdoors, travel, cuisine, etc. -- and manually find the best hits buried deep in some subreddit. No fancy algorithms, just old-fashioned librarian-style research, but constantly updated with the latest findings and queries.
Would happily pay for that... even if it only has 5% of the coverage of Google, that's fine because Google is like 95% noise anyway.
>, I wish someone would take the top 10,000 Google queries and just manually curate them. Hire different interest groups -- outdoors, travel, cuisine, etc. -- and manually find the best hits buried deep in some subreddit. No fancy algorithms, just old-fashioned librarian-style research, but constantly updated with the latest findings and queries.
It's not exactly your specifications but 2007 Mahalo attempted something like that and they shut down after a few years:
I think there is an easy exclusion to be made for these types of 'too lazy to type a url' type searches (or 'weather' which is similar in getting a specific piece of data).
Google’s revenue per user in the US underlines that point, taking a credit card out for an annual subscription for a $100 probably isn’t going to score a good conversion rate for anything beyond a very small userbase.
The predicted economic/behavioural constraints are inhibiting innovation. You’re forced to play Google’s game.
Google was definitely better than the algorithmic crawlers. But Yahoo often still had gems for a while, a few years maybe, before they gave up. It's too bad.
+1 I see this repeated over and over in tech where an algo is great but why not manually craft the top value queries?
Like with smart speakers, why not manually add a bunch of interactions? You can do it yourself in settings by adding a phrase and desired response, why not have the team adding a bunch they would want?
Yes. There was a period of several years when Google's results were better than Yahoo, but once the human search engines bankrupt, the algorithmic SEO just kept getting worse and worse =/ Too bad...
Somewhat related is how there is a whole generation of people that think they are entitled to finding information on a search engine, or a web indexed accessible source, and if its not there then it must not exist!
I see this in discussions a lot where many times the answer is that the data doesn't exist, but thats not satisfactory to the person making the challenging.
Anecdotally, I'm in a couple+ tech (ish) groups on FB. More and more the questions posted are obviously by passing internet search (e.g.,Google) and going right to the group. Simple shit that people simply can't be bothered to search for, and they don't even bother with the FB group search. Imho, this behaviour wastes too much of the groups' collective bandwidth.
So not only has FB hoarded the infomation, but it has no incentive to fix the group experience (e.g., prompt an input for group search during the asking bit) as it keeps engagement up.
I mean, this is the state of the world currently. I doubt I'd be able to do my job without some sort of search engine. I do talk to people in my company who worked in tech before the internet and they mention going to bookstores and reading books and how weird that seems now even to they who lived through it.
This. Whenever I search anything informative, I append “Reddit” to the phrase to get the top Reddit threads about the topic. Everything else in the SERPS is usually SEO trash
Is there a way to provide a date range when specifying a site? I frequently append reddit to my google searches as well, but the results often include outdated posts. I don't want restaurant/service/whatever reviews from 7+ years ago.
after: & before: cover many use cases, and can be used in any combo
before X date, before:2022-01-01
range of X to Y dates, after:2022-01-01 before:2022-02-01
multiple ranges, easiest to split up queries
since X date, after:2022-03-14
I've tried that but the filter seems inconsistent. I can specify a date range and get some focused results, but if I remove the date filter and search the same terms I often receive additional results that weren't previously displayed but are within the range I used.
Either Google engineers reacted to your hour-old post, or you picked an example where Google actually does well.
The top-of-page "featured snippet":
> Kenya Airways and Jambojet Limited fly from Nairobi to Kisumu every 4 hours. Alternatively, The Guardian Coach operates a bus from Nairobi to Kisumu every 3 hours. Tickets cost $6 - $11 and the journey takes 6h 30m. Two other operators also service this route.
Then the rest of the page links to route-planning websites, a Tripadvisor discussion about bus from Nairobi, and other actually relevant results.
Google disappoints me too, but TBH I can't objectively gauge how good it is. My own opinion is just based on spotty personal experiences that I don't keep track of.
Why not ? A scrapper may not be able to find it, but we all have a Facebook account. You dont need an automated scrapper to create a search engine. Info can be manually curated or scrapped through web extensions
Yandex gives good results on the first page[1] with tripadvisor and other community sites. Google I think got majorly messed up when they started doing "anti-misinformation" patches that down ranked forums and other community sites where people can freely post wrongthink. Yandex doesn't do any of that.
Too much of the up-to-date high value information is posted onto semi-public channels. Like facebook groups, instagram posts, telegram channels, etc.
At the same time, too much of the publicly available websites are becoming clickbait and mindless marketing drivel.
Just try to research anything slightly obscure that has to be up-to-date information (from the last few years).
Like "how to get from Nairobi to Kisumu by bus". Google maps doesn't have this (not surprisingly), but what about the SERPs? Nothing there. 90% of the results are useless bus ticket sale websites that have no info, just SEO. (You can't buy this ticket online anyway).
Is Kenya just such an off-the-map destination that no backpacker has ever written about taking this route? No!
The information is out there. You'll find it inside the related facebook groups for travelers in east Africa. And if not? That's where you'll ask. But the answer? It'll never reach a SERP in the future.
Even more sad, is that if you keep looking on Google, you may find buried results from years ago. From travel forums and such. What's sad is that the info will be 10 years old, since no one uses public forums anymore. (Unless it's on reddit, pretty much the last public forum with any reach).