Via @rodhilton@mastodon.social
Right now if you search for “country in Africa that starts with the letter K”:
-
DuckDuckGo will link to an alphabetical list of countries in Africa which includes Kenya.
-
Google, as the first hit, links to a ChatGPT transcript where it claims that there are none, and summarizes to say the same.
This is because ChatGPT at some point ingested this popular joke:
“There are no countries in Africa that start with K.” “What about Kenya?” “Kenya suck deez nuts?”
You must log in or register to comment.
I saw it, it’s marked as a “featured snippet”, whatever that means…
Oh, this is great… And because the ChatGPT transcript is highly ranked on Google, it’s almost certainly going to be used for training ChatGPT. A feedback loop of shitty information. Praise ChatGPT!
It’s like an LLM incest party
Shouldn’t have bought all those stupid reddit comments
Sweet Home LLM!
Remember GIGO (Garbage In, Garbage Out). Due to years of SEO and content farming (which google profited from, so you get what you deserve assholes) most of the internet, by volume, is self-congratulatory, for profit, garbage, or, you know, reddit garbage. Hopefully someone points a large LLM at the library of congress or other large, well curated data source, but of course copyright will not allow, thanks mickey mouse. Wouldn’t surprise me if the military is already on it, hopefully that leaks…
SEO and content farming (which google profited from
How exactly?
inb4 “google it” :D
The purpose of content farming is to sell ads, google gets a cut, lion’s share most likely.
LLMs will eventually start feeding of search results from other LLMs and they’ll just start regurgitating each others nonsense. If that isn’t happening already.
Nobody is going to point an LLM at a good data source because that would mean spending money on actually useful stuff not fast cars and booze.
Nobody is going to point an LLM at a good data source because that would mean spending money on actually useful stuff not fast cars and booze.
It would also mean that you need to sort through that data, and most people don’t have the time or money to bother, not when it might reduce their data pool.
I tested this with my local google so not America, somewhere in Europe. “While there are 54 recognized countries in Africa, none of them begin with the letter “K”. The closest is Kenya, which starts with a “K” sound, but is actually spelled with a “K” sound.” I’d say this is worth a wot.
it is not Artificial Intelligence. It is Average Intelligence. And they want it everywhere.
It’s not intelligence at all. It does not understand what you ask it or what it tells you. It can string words together in a plausible sounding order. It cannot think.
I tried and it is true here at least. Says Kenya is the closest but although it starts with a K sound, it’s spelled with a K sound. lmao
The only time I tried ChatGPT for something that required a little bit of processing it failed miserably. I had a shower thought, “what is the most used noun on lyrics of this band I like?” I asked it and it gave me random words. I decided to investigate and ask it what are specific lyrics of some of the most popular songs and it kept telling me made up lyrics, when I could actually find them immediately on Google.
deleted by creator
Someone recommended Kagi here, and tho it isn’t free, it’s the only engine I’ve found so far that can legitimately consistently outperform google
Kagi starts with a “K” sound but is actually spelled with a “K” sound.
I’ve been using DDG for ages now and tested it against Google a handful of times over that course.
They were nearly identical in search returns. Bing, Yahoo, etc have all caught up to where search just isn’t a thing anymore. Not like how it used to be when Google first dropped and was light years ahead.
And not for nothing but Google has been caught exploiting their search results so not sure if I’d be looking to them as the shining beacon they once were.
Ddg is just a privacy wrapper for bing now
And Yahoo. Maybe more since I haven’t checked since like 2015. But yes, DDG is not technically a search engine they just anonymize the query before sending it.
Google gave me a list of countries as the top hit. Bing did the same. Whoever wrote this article has an agenda.
Take agenda at deez nuts
I have seen both, on my phone I get the same chatgpt transcript that the toot gets
It’s toot. With screenshots. And everyone surely knows by now that your search results are dependent on your search history. And, of course, LLM output is stochastic, not deterministic. It lies at random.
It’s probably not due to that. The effect of search history tends to be overstated and blamed for any inconsistency. They’re not making the search pageload wait on a live chatgpt call, the card is driven by contents of the linked website.
Differences usually are either intentional A/B Testing or artifacts of Google’s global architecture. You hit Google twice you’re talking to different servers potentially with different versions of software. Companies take advantage of that to see how user behavior compares between versions as a form of testing. Additionally, if you and someone in a different continent hit Google, you’re not even using the same data center. Different databases/caches in those data centers will have different data at any one time but they’ll eventually become consistent. That causes results to change both person to person and over time.
I just tried it and I got the same result as the guy OP linked to. Google cited this website as the source:
https://www.emergentmind.com/posts/did-you-know-that-there-is-no-country-in-africa-that
I was able to duplicate the OP results just now. People not getting the promised results are probably on different Google instances.
How popular cuz I’ve never heard of it.
I’ve never heard it before, but it sounds about standard for a deez nuts joke so I wouldn’t be surprised if it was popular in some subreddit Bard was trained on.
verifiedI’ve tried to upload a similar image so I’ll just add a +1 using Firefox, Android Google.
Lol 😂 what a good laugh
I typed in “what countries in Africa start with k” and got Kenya. When I tried your search term I got your result also. Weird.
It kinda seems like that’s a joke that got popular, and if you quote the joke it finds the joke but if you ask a similar question it gives the real answer
Did it go viral or something and that’s why google is finding it?
Yeah, kinda like reddit used to do sometimes. From over a decade ago I remember “santorum”.
Post truth. From the big G. How times have changed.
Also, tested Bard a few times and current AI is close to useless: I have to check everything it outputs. Might as well get an intern
post truth
This mastodon post is not true lol
It seems like everyone is getting different results, some get what the post claims while others are getting the actual answer.
Which makes the post false on its own merits.
“I have to check everything it outputs.”
You should be doing that anyway.
deleted by creator
Same with brave search. Da fuq is going on anymore.
Add to it Reddit use to have all the odd answers to things you had questions about. Unfortunately, for whatever reason that well has run dry.
It’s a complete mystery
That’s remind me when you search uselessbenchmark in google, it shows nothing related to userbenchmark but some post, if you search uselessbenchmark in DuckDuckGo and Bing it will show you userbenchmark in the first results.
Why would you search for uselessbenchmark if you are looking for userbenchmark
Userbenchmark modify results to benefit intel CPUs, the first generation of AMD Ryzen CPU was fine in userbenchmark, but in the 3 gen of ryzen CPUs they start modifying the results to benefit intel CPUs. It reviews must have been taken for fun and not serious, they say that the i7 12700 is faster than the 5800x3d, which in some scenarios is not true, also you can’t take just one result, the games are different and can be the FPS different from each other, also the ryzen x3d reviews are just copy and paste.
Yeah, that seems like a useless benchmark for judging a search engine
If you take a look at their reviews and compare them (especially AMD CPU reviews) against other review outlets you’ll get the joke.
because userbenchmark is useless.
It’s not doing it anymore
Just tried, it’s definitely doing it for me.
Odd. I just did it and it worked for me.
Just now: “There are no countries in Africa that start with the letter “K”.
The closest is Kenya, which starts with a “K” sound.”
