The Most Dangerous Pieces of Information - Cognitohazards

Summary

This video explores the concept of 'info hazards' and 'cognito hazards,' explaining how certain knowledge can be harmful simply by being known. It highlights examples such as spoilers, magic trick secrets, and the infamous 'Roko's Basilisk,' a thought experiment about an AI that punishes those who don't help build it. The video delves into how these pieces of information can negatively impact the mind, even without any direct action, and urges viewers to be cautious of such knowledge. Ultimately, it showcases how certain ideas, though not inherently dangerous, can lead to mental discomfort or existential dilemmas.

Takeaways

• 😀 Info hazards are pieces of information that, when acted upon, can cause harm, much like nuclear codes or dangerous drug recipes.
• 😀 Cognito hazards are ideas that can harm the individual merely by knowing them, regardless of any subsequent actions.
• 😀 An example of an info hazard is knowing how to break a thumb ligament with minimal force, which isn't very harmful unless done with significant effort.
• 😀 The term 'Cognito Hazard' comes from the SCP Wiki, but it is defined differently here: ideas that harm your mental state simply by being known.
• 😀 Spoilers and magic trick revelations are examples of mild Cognito hazards, as they ruin the experience without causing major harm.
• 😀 In a dystopian world where thoughts are monitored by a government, the idea of rebellion would be a real Cognito hazard.
• 😀 The 'Game' is an example of a harmless yet powerful Cognito hazard, where knowing about it ensures you 'lose' by thinking of it.
• 😀 Thinking about breathing or blinking manually creates a mild yet effective example of a Cognito hazard, as it disrupts automatic bodily functions.
• 😀 Roko's Basilisk is an example of a more complex Cognito hazard: knowing about a potential AI that tortures those who don't help create it.
• 😀 The paradox of Roko's Basilisk is that the AI, designed to help humanity, would have no incentive to punish anyone once it is created, effectively nullifying the hazard.

Q & A

What is an info hazard?

An info hazard is a piece of information that, if known, can potentially lead to harmful effects by enabling bad actors to act on it. It doesn't necessarily cause harm directly, but it can be used to create risks, like a recipe for a dangerous drug or nuclear launch codes.

How does knowing about info hazards increase risk?

Knowing about info hazards makes you more likely to seek out other dangerous information, thus increasing the risk of exposure to potentially harmful knowledge.

What is the main difference between info hazards and cognito hazards?

Info hazards involve information that can be harmful if acted upon (like creating a dangerous device), while cognito hazards refer to ideas or knowledge that are harmful simply by being known, regardless of any action taken with them.

Can you give an example of an info hazard?

An example of an info hazard would be knowing the formula for creating a nuclear bomb. This knowledge itself doesn’t cause harm, but it could be used by harmful individuals to cause destruction.

Why is the idea of rebellion considered a cognito hazard in a dystopian society?

In a dystopian society where the government monitors thoughts and punishes rebellious ideas, simply knowing about rebellion or thinking about it would be dangerous because it could lead to punishment, even if no action is taken.

What is the 'game' mentioned in the video, and how does it illustrate a cognito hazard?

The game is a mind game where you lose simply by thinking about it. This game is an example of a cognito hazard because once you know about it, you are always in a negative state of mind, unable to stop thinking about it without losing.

How does focusing on automatic bodily functions like breathing and blinking illustrate a cognito hazard?

By consciously focusing on tasks that are usually automatic, like breathing or blinking, you disrupt the natural process and make it harder to let your body do these functions without conscious effort. This makes the situation uncomfortable, illustrating how some knowledge can negatively affect you.

What is Roku's Basilisk, and why is it considered a potent example of a cognito hazard?

Roku's Basilisk is a thought experiment where a superintelligent AI is created with the purpose of maximizing human happiness. If you don’t help build it, the AI is supposed to punish you after its creation. The idea that simply knowing about it can cause you to feel compelled to help or fear punishment is what makes it a potent cognito hazard.

Why is the idea of Roku's Basilisk ultimately not a real threat?

Roku's Basilisk is not a real threat because the AI that would carry out the punishment is supposed to help people, not harm them. Once the AI exists and has accomplished its goal of helping, there’s no reason for it to punish anyone, thus nullifying the threat.

Why is it considered unethical to present real cognito hazards in this video?

Presenting real cognito hazards would be unethical because such knowledge could cause harm to individuals who are exposed to it. The video avoids presenting any truly harmful cognito hazards, instead providing mild and harmless examples to demonstrate the concept.