Is AI Content Detectable? And does Google even Care?

Matt Diggity
24 Apr 202410:14

Summary

TLDRIn this video, Matt Diggity explores the capabilities of AI in content creation, highlighting its ability to mimic human writing to the point of winning literary awards. He challenges the notion that Google can effectively detect AI-generated content, citing studies showing low accuracy rates and even misidentifying the U.S. Constitution as AI-written. Diggity argues that with proper fine-tuning and human oversight, AI content can be undetectable and of high quality, suggesting that Google's primary concern is not the source of the content but its quality and contribution to spam.

Takeaways

  • ๐Ÿ† An AI-written short story won a prestigious Japanese literary award, sparking discussions about AI's ability to mimic human writing.
  • ๐Ÿง  AI's capability to fool humans is not new; many people still believe in misconceptions like the flat Earth theory.
  • ๐Ÿ” Google's algorithm currently cannot reliably detect AI-generated content, contrary to what some might expect.
  • ๐Ÿ“Š Research data indicates that AI detection software has limited accuracy, with some achieving only 50% reliability.
  • ๐Ÿ‡บ๐Ÿ‡ธ The U.S. Constitution was mistakenly identified as AI-written, highlighting the flaws in current detection methods.
  • ๐Ÿ“ˆ Matt Diggity's personal experience suggests that Google does not penalize AI content if used correctly, as his AI site saw traffic growth after an update.
  • ๐Ÿ’ก Google's stance is that they have no issue with AI-generated content as long as it is high quality and not spammy.
  • ๐Ÿค– AI detectors rely on predicting word choices, but this method is flawed against advanced AI models that can mimic human writing styles.
  • ๐Ÿ“ Large language models (LLMs) can be fine-tuned for specific industries or styles, making AI-generated content even more indistinguishable from human writing.
  • ๐Ÿ“š AI tools are trained on vast amounts of text data, learning human language nuances, sentence structures, and writing styles.
  • ๐Ÿค Ethical considerations arise with undetectable AI content, such as the potential for fake news and literary awards won by AI instead of humans.
  • ๐Ÿ›‘ The March 2024 Google Core algorithm update did not target AI content but rather aimed to combat spam and low-quality content flooding search results.

Q & A

  • What significant event involving AI and literature did the speaker mention at the beginning of the script?

    -A short story written entirely by AI won one of Japan's most prestigious literary awards.

  • What is the speaker's opinion on Google's ability to detect AI-generated content?

    -The speaker suggests that Google's algorithm cannot reliably detect AI-generated content, as evidenced by the low accuracy rates of AI detection softwares.

  • What was the outcome of the March core update according to the speaker's website portfolio?

    -The speaker's entire website portfolio was flat after the update, except for the 100% pure AI site, which grew in traffic.

  • What does the speaker claim about Google's stance on AI-generated content?

    -The speaker states that Google doesn't have an issue with AI-generated content as long as it is used correctly and is of high quality.

  • What is the speaker's profession and how does AI relate to it?

    -The speaker, Matt Diggity, is the founder of multiple seven-figure SEO businesses and has been following the development of AI and content production closely.

  • How do AI detectors attempt to identify AI-generated content?

    -AI detectors work by predicting word choices and identifying likely next words in a text to determine if it is AI-generated.

  • What is the concept of 'human in the loop AI writing' mentioned in the script?

    -'Human in the loop AI writing' refers to the process of using human input to guide AI in generating content, adding nuances, experience, and avoiding patterns that AI detectors look for.

  • How does the speaker suggest improving the detection avoidance of AI-generated content?

    -The speaker suggests using advanced prompting techniques and tools like Surfer AI to humanize the content and make it less detectable by AI detectors.

  • What ethical considerations does the speaker raise about AI-generated content?

    -The speaker raises concerns about the potential for fake news generation and literary awards being won by AI, rather than human writers.

  • What was the actual issue Google was facing during the March core update according to the speaker?

    -Google was facing a crisis of spam and a decline in the quality of search results due to the mass production of AI content.

  • What indirect method does the speaker believe Google might be using to identify AI-generated content?

    -The speaker suggests that Google might be identifying AI-generated content indirectly by targeting sites that are spamming the search results with a large volume of content.

Outlines

00:00

๐Ÿค– AI's Literary Triumph and Detection Challenges

The video script begins by highlighting the surprising victory of an AI-written short story in a prestigious Japanese literary award. It questions the ability of AI to deceive humans and touches on the public's misconceptions, such as the flat Earth theory. The main focus shifts to the capabilities of AI, particularly questioning whether Google's algorithm can detect AI-generated content. The presenter, Matt Diggity, introduces himself as an SEO expert and discusses the limitations of AI writing detectors, citing a study that shows their low accuracy rates. He also shares his personal experience with the March core update by Google, which allegedly targeted AI sites, yet his AI site saw an increase in traffic. The script suggests that Google is more concerned with content quality than its source, as long as it meets user needs.

05:02

๐Ÿ” The Inherent Difficulty of AI Detection and Ethical Considerations

This paragraph delves into the technical aspects of how AI detectors operate, based on predicting word choices and the challenges they face due to AI's ability to generate complex text. It discusses the concept of fine-tuning large language models to mimic specific writing styles and the use of 'human in the loop' AI writing to add human nuances. The presenter shares an experiment where he used AI to write content on SEO, which was initially detected as AI-generated but became undetectable after applying humanizing prompts. The script also touches on the vast data sources that AI tools use to learn human language nuances and the ethical implications of undetectable AI content, such as the potential for fake news and literary awards won by AI. It concludes by emphasizing that AI content generation is advancing faster than detection methods.

10:02

๐Ÿ“‰ Google's Stance on AI Content and the Impact of the March Update

The final paragraph addresses the misconception that Google's March 2024 core algorithm update targeted AI content websites for penalties. The script clarifies that Google's real issue is with spam and low-quality content, not the use of AI. It explains that Google manually targeted SEO influencers who publicly used AI, causing fear among the SEO community. However, private AI projects that did not overtly abuse the technology were left untouched. The script suggests that Google rewards high-quality content regardless of its source, as long as it adds value for users. It advises against mass-producing AI content to avoid detection and emphasizes the importance of quality over quantity, recommending a maximum of 20 articles per day and the use of human editors or advanced AI tools to ensure content quality.

Mindmap

Keywords

๐Ÿ’กAI-generated content

AI-generated content refers to any written material created by artificial intelligence algorithms. In the video's context, it is a central theme as the script discusses the ability of AI to produce content that is indistinguishable from human writing. The video mentions a short story entirely written by AI that won a prestigious literary award, highlighting the sophistication of AI in mimicking human writing.

๐Ÿ’กGoogle algorithm

The Google algorithm is the set of rules that Google uses to rank websites in its search engine results. The script raises the question of whether Google's algorithm can detect AI-generated content, a significant issue given the increasing prevalence of AI in content creation. The video suggests that current AI detection methods are not reliable, with the accuracy compared to flipping a coin.

๐Ÿ’กAI detection software

AI detection software is designed to identify content created by artificial intelligence. The video references research showing the limited accuracy of such software when detecting AI-generated content from CHAT GPT 3.5, indicating that these tools are not yet fully capable of distinguishing between AI and human-written content.

๐Ÿ’กSEO (Search Engine Optimization)

SEO is the practice of improving and promoting a website to increase its visibility in search engine results. The video's speaker, Matt Diggity, is an SEO expert who discusses the impact of AI-generated content on SEO strategies. He shares his experience with AI content during a Google core update, suggesting that Google does not penalize AI content if used correctly.

๐Ÿ’กLarge Language Models (LLMs)

Large Language Models are AI systems trained on vast amounts of text data, enabling them to generate human-like text. The script explains that these models can be fine-tuned for specific industries or styles, making AI-generated content increasingly similar to human writing. This capability is crucial for understanding how AI can produce content that is difficult to distinguish from human writing.

๐Ÿ’กHumanizing AI content

Humanizing AI content involves techniques to make AI-generated text appear more natural and less mechanical. The video describes methods such as giving AI specific instructions to avoid patterns that AI detectors look for, or to match the tone and reading level of the target audience. An example from the script is using prompts to reduce the likelihood of AI detection to nearly zero.

๐Ÿ’กTopical authority

Topical authority is a concept in SEO where a website is recognized by search engines as a leading source of information on a specific topic. The video explains how AI can be used to quickly produce a breadth of content on a topic, potentially establishing topical authority faster and leading to increased search traffic.

๐Ÿ’กAI spam

AI spam refers to the mass production of low-quality content using AI, which can overwhelm search engines with duplicate or irrelevant information. The script discusses Google's struggle with AI spam, noting that it can degrade the quality of search results and is a challenge for Google to manage.

๐Ÿ’กGoogle Core algorithm update

A Google Core algorithm update is a modification to Google's search ranking system that can significantly affect website traffic. The video script mentions a specific update in March that was rumored to target AI-generated content. However, the speaker argues that Google's actual issue was with spammy practices, not AI content itself.

๐Ÿ’กEthical considerations

Ethical considerations in the context of AI-generated content involve the implications of undetectable AI writing on areas such as fake news and literary awards. The video raises questions about the authenticity and integrity of content and recognition when AI can convincingly imitate human writing.

๐Ÿ’กSurfer AI

Surfer AI is a tool mentioned in the script that is used to enhance the quality of AI-generated content. It is described as capable of advanced tasks such as fact collection and humanization, which can result in content that is of higher quality than much human-written content. This tool exemplifies efforts to improve the credibility and value of AI-generated content.

Highlights

AI-written short story won a prestigious Japanese literary award.

Google's algorithm cannot reliably detect AI-generated content.

OpenAI's document on the ineffectiveness of AI writing detectors.

Research study data showing 50% accuracy of AI detection softwares on GPT 3.5.

U.S. Constitution was detected as AI-written, raising questions about AI detection reliability.

Matt Diggity's experience with AI content during the March core update.

Google's stance that they do not have an issue with AI-generated content if used correctly.

AI detectors' reliance on predicting word choices and their limitations.

The ability of large language models to be fine-tuned for specific industries or styles.

Humanizing AI content to avoid detection by AI detectors.

Experiment showing AI content detection rates dropping to 0% with humanizing prompts.

Ethical considerations of undetectable AI content generation.

Google's indirect methods to check for AI-generated content through spam detection.

Explanation of the March Google Core algorithm update's impact on AI content websites.

Google's focus on combating spam rather than targeting AI content per se.

The importance of not overusing AI to avoid detection and penalties.

Recommendations for using AI responsibly in content creation.

The Search Initiative's special offer for SEO services.

Transcripts

play00:00

What the f k?

play00:01

Did you know a short story written entirely by AI won one of Japan's

play00:05

most prestigious literary awards?

play00:07

But that's not entirely surprising.

play00:09

So what if AI can fool humans?

play00:11

An alarming amount of us dummies think that the world is flat.

play00:13

But what about algorithms?

play00:15

In particular, can the Google algorithm detect if content is written by AI?

play00:19

Spoiler alert, it can't.

play00:21

And in this video, I'm going to prove to you why.

play00:23

And also, I'm going to discuss if AI ever became detectable.

play00:26

Should you even care?

play00:27

Does Google even care?

play00:28

In case we haven't met before, my name is Matt Diggity and I'm the founder of

play00:31

Multiple Seven Figure SEO Businesses.

play00:33

And I've been glued to the development of AI and content

play00:36

production since the beginning.

play00:38

Last year, OpenAI themselves released a document saying AI writing detectors

play00:42

don't work, and that no detectors, quote, reliably distinguish between AI

play00:47

generated and human generated content.

play00:49

But they're a bit biased when you say.

play00:51

They're in the business of mass AI adoption, and thus this is something

play00:54

that you'd expect them to say.

play00:56

So let's move on.

play00:57

The data from this research study from last year shows the accuracy of various

play01:00

AI detection softwares on CHAT GPT 3.

play01:03

5, which isn't even the current version.

play01:05

I don't know about you, but at 50 percent accuracy, you might as well flip a coin.

play01:09

This one is my favorite.

play01:10

The U.

play01:10

S.

play01:10

Constitution written in 1787 was also detected as being written by AI.

play01:16

Oh my god, what if it was?

play01:18

Now, I know this is just a personal anecdotal story, but in the March

play01:22

core update, which supposedly went after AI sites, ironically, my entire

play01:26

website portfolio was flat after the update, except for my 100 percent

play01:30

pure AI site, which grew in traffic.

play01:32

And that's because Google doesn't actually care about AI content

play01:35

being used if you use it correctly.

play01:37

Just last week, Gary Elias from Google said, On stage, Google doesn't have an

play01:41

issue with AI generated content websites.

play01:44

If we have a problem, it's with low quality content.

play01:47

But Matt, what about all the AI sites that got completely

play01:50

wiped out in the March update?

play01:51

Don't get your panties in a bunch, I'll explain what actually happened soon.

play01:54

And, by the way, real quick, I wanted to let you know that my SEO agency,

play01:58

The Search Initiative, is taking on a handful of clients right now for 1,

play02:01

000 off their first month, in exchange for a testimonial down the road.

play02:05

We've actually never once lowered prices since we formed seven years ago.

play02:08

Just head on over to thesearchinitiative.

play02:10

com, put in your deets into the form, and we'll give you a free audit to

play02:13

let you know what we can do for you.

play02:15

So why do AI detectors have such a hard job doing their job?

play02:19

You had one job.

play02:20

AI detectors work by relying on their ability to predict word choices.

play02:25

They read a word, then predict what are the most likely next

play02:28

words that will follow it.

play02:29

And if the next words truly are those predictable words, then

play02:31

oh my god that's definitely AI.

play02:33

Now I know how everyone loves reading white papers, so I'll

play02:36

summarize this next one for you.

play02:37

This research paper highlights the difficulty of detection due

play02:40

to the GPT's inherent ability to generate hyperplexity text.

play02:45

And that's before any fine tuning.

play02:47

The incredible thing about large language models is that they can be fine tuned

play02:50

for specific industries, topics, or styles, further blurring the lines

play02:54

between AI and human generated content.

play02:57

This is also known as human in the loop AI writing.

play03:00

And you can use it to inject human nuances, experience, and even

play03:03

tell the AI to avoid patterns that AI detectors look for.

play03:06

For example, you already know that AI detectors work by

play03:09

identifying likely next words.

play03:11

What if you simply told the AI not to use those words?

play03:14

What if you told it to write in the exact perfect tone and

play03:17

reading level for your audience?

play03:19

I asked ChatGPT to write me 200 words of content on a beginner's guide to SEO.

play03:23

Then I tossed that content into ZeroGPT's detector, and it said that it was 95.

play03:28

22 percent likely that it was written by AI.

play03:30

And then I did the same exact thing, but I gave chat GPT set of

play03:34

humanizing prompts and then bam, freaking 0% chance it was AI content.

play03:39

This detector is dead convinced that a human wrote it.

play03:42

By the way, after you finish here, check out my video called How I Humanize

play03:45

Chat, GPT AI Content For a full list of these prompts, link in the description.

play03:49

The thing is AI content tools and large language models are consistently

play03:54

getting better at mimicking humans.

play03:56

At the core of an LLM lies a massive amount of text data.

play03:59

These tools are trained using deep machine learning on vast libraries

play04:02

of books, articles, Wikipedia, Reddit, code, and even emails.

play04:06

This data exposes the AI to the nuances of human language, including

play04:10

sentence structures, word choice, and even different writing styles.

play04:13

Now, before we get to Google's stance on AI content, there are

play04:16

ethical considerations to think of.

play04:18

Just because AI is undetectable, is that actually a good thing?

play04:21

Think about all the fake news that's gonna get generated.

play04:24

Or literary awards that'll be won by expert prompt

play04:27

engineers instead of writers.

play04:29

Oh yeah, that's already happened.

play04:30

But regardless of where you stand, in this arms race between AI content

play04:34

generation and AI content detection, team generation is winning the race.

play04:39

By the way, here's a quick word from the sponsor of this

play04:41

video, Search Intelligence.

play04:42

This campaign got us big links in websites such as Lifehacker, Wales Online, Daily

play04:46

Record and about 20 other news websites.

play04:48

Let me show you how we've done it.

play04:50

We knew that people will be flying a lot this summer and we knew that journalists

play04:53

will be writing about this topic a lot.

play04:55

So, on behalf of our client, we put together a nice guide about

play04:59

how to fall asleep on the plane.

play05:01

Then, we use MuckRack to find journalists who write about travel.

play05:04

Then, we put our advice in a nice email and send the tips to the journalists.

play05:10

Within just a few days, the links started landing, securing our client

play05:14

natural placements in really big websites, just like this, this and this.

play05:18

This is a great example about how you can leverage seasonal

play05:22

trends to earn links to a website.

play05:24

Anticipate what journalists want to write about at all times and give

play05:28

them the stories that they need.

play05:29

They will reward you with some great, juicy links.

play05:33

I hope this is helpful.

play05:35

Now back to the video.

play05:36

Alright, so what the happened in the March Google Core algorithm update.

play05:40

In spam update.

play05:41

Didn't Google declare war against AI content websites and penalize

play05:45

them into the Smither Marines?

play05:46

A ISO enthusiast, Julian Goldie's.

play05:48

Public AI case studies went from kicking ass to having their asses clapped.

play05:52

And then we saw articles like this with A URL longer than a Kardashian

play05:55

Christmas list saying the March, 2024 core algorithm update is now targeting

play06:00

AI generated content with penalty.

play06:03

If you bought into this, sorry to say it, but YOU JUST GOT PUMPED!

play06:07

Here's what's really going on.

play06:09

Google is facing a crisis of spam.

play06:11

This is the first time in my life that I can ever recall that

play06:13

people around me are saying Google results are actually getting worse.

play06:17

And it's not just us sour SEOs that think this because we're losing traffic to

play06:21

Forbes, the world renowned expert on pre workouts and everything else that exists.

play06:25

Normies are starting to notice Google's result quality slipping too.

play06:28

Headlines like, It's not just you, Google search really has gotten

play06:31

worse, are becoming commonplace.

play06:33

To be honest, I feel for Google.

play06:35

They've got a difficult problem to tackle.

play06:37

This Business Insider article notes that when Google cut the word people

play06:41

from its search guidelines, AI content flooded the search results.

play06:44

Why?

play06:45

Because AI content, when done right, works really well.

play06:49

Here's how.

play06:50

If you're a subscriber to this channel, you know all about topical authority.

play06:53

If you write one article about traveling to Japan, Google's like, I don't give

play06:57

a f But if you write articles about the entire Japan travel topic, like

play07:01

hot destinations, culture, food, itineraries, and visa requirements,

play07:06

then Google's like, Arigato gozaimasu!

play07:08

Now here's a Japan travel topical authority.

play07:11

Let's give it massive traffic.

play07:12

Now with AI, you can print out articles super fast, and you can hit topical

play07:16

authority status faster than ever before.

play07:19

Some people are posting hundreds and even thousands of articles per day.

play07:22

Traffic graphs like these are typical.

play07:24

And then you end up with more headlines like these saying, quote, AI spam is

play07:27

already starting to ruin the internet, and that's not a good look for Google.

play07:31

Not only that, but there's hard costs for both indexing and ranking

play07:34

all this new content that's getting generated faster than ever in history.

play07:38

As you know, AI content is undetectable through direct means.

play07:41

That said, I do think that there's an indirect way that they're able to check

play07:45

for it, and we'll get to that soon.

play07:46

So if they can't detect it, in May, what did they do instead?

play07:49

They manually went after SEO influencers with public AI case studies.

play07:54

A real human watched their Twitter accounts and YouTube channels for case

play07:57

studies, found their GSE accounts, and then nuked their entire portfolios.

play08:01

They did this counting on the fact that the SEO community

play08:04

would find out and freak out.

play08:06

And it worked.

play08:07

They got the same result, fear.

play08:09

People now think that it's freaking illegal to use AI content.

play08:12

Google effectively pushed back on this wave of mass AI content generation

play08:16

that was a thorn in their side, and in the meantime took out some sites that

play08:20

admittedly were over abusing AI anyways.

play08:22

But here's the kicker.

play08:23

These same people that were targeted have private AI projects

play08:27

and those were untouched.

play08:28

Perfectly fine doing better than ever.

play08:30

Just like my AI project that I'll never tell anyone about.

play08:33

Google doesn't have a problem with AI.

play08:35

They have a problem with people going nuts with ultra mass produced AI

play08:39

and taking over the search results.

play08:41

Remember, they changed their definition of helpful content from helpful

play08:45

content written by people for people to helpful content created for people.

play08:49

And in their search guidance document about AI content, they said that

play08:52

they'll quote, reward high quality content, however it's produced.

play08:56

Now there's another twist to this story.

play08:58

There's plenty of non public AI case studies that were hit,

play09:01

like this one that got to 1.

play09:03

6 million traffic in a heartbeat.

play09:05

But how could an algorithm find a site like this if they can't detect AI content?

play09:09

Well there's one thing that people that abuse AI content do.

play09:12

They spam the sh out of it.

play09:14

My sites that use AI, and that's all of them, they never post

play09:17

more than 10 articles per day.

play09:18

This AI website here that got penalized got up to 16, 000 pages.

play09:23

It stuck out like a sore thumb.

play09:24

So if you ask me, use AI, it's completely fine.

play09:27

It's undetectable and Google doesn't care anyways as long as the content is good.

play09:31

What they do care about is looking bad.

play09:33

And even though you probably really want to, hold back from

play09:36

publishing 100 articles per day.

play09:38

Because you're going to stick out, you're going to get reported or

play09:41

detected, and Google will take action because they think that you're spamming.

play09:44

Publish 10, 20 articles per day tops.

play09:46

And make an effort.

play09:48

Either have a human editor polishing up your content, Use advanced

play09:51

prompting like you can find in my humanizing AI content video.

play09:55

Or use a tool like Surfer AI that does so much advanced stuff like fact

play09:58

collection and humanization that it's better quality than 99 percent of

play10:02

the human writers out there anyways.

play10:03

And don't forget to subscribe for more videos just like this one.

Rate This
โ˜…
โ˜…
โ˜…
โ˜…
โ˜…

5.0 / 5 (0 votes)

Related Tags
AI ContentSEOGoogle AlgorithmLiterary AwardsAI DetectionHumanizing AIContent QualityMachine LearningTopical AuthorityEthical Concerns