My Puzzle Robot is 200x Faster Than a Human

Mark Rober
13 Jul 202421:20

Summary

TLDRThe video script introduces 'Jigsaw,' a robot designed to excel at solving jigsaw puzzles with remarkable speed and precision. After three years of development, Jigsaw is claimed to be 200 times faster than the world's fastest human competitor. The script details the engineering feats and challenges in creating Jigsaw, from its dexterous gripper to its advanced pattern recognition. It also features a friendly competition between Jigsaw and human puzzlers, showcasing the robot's capabilities and the ingenuity of its creators.

Takeaways

  • 🧩 Jigsaw is a robot designed to excel at assembling jigsaw puzzles with remarkable speed, potentially 200 times faster than the fastest human.
  • 🤖 The development of Jigsaw took three years and involved overcoming complex challenges related to dexterity, precision, and pattern recognition.
  • 👐 Humans possess an innate ability to solve puzzles through a combination of hand dexterity, pattern recognition, and spatial reasoning, which Jigsaw had to replicate mechanically.
  • 🔧 Jigsaw uses a specialized suction cup to pick up puzzle pieces and a high-precision motor for accurate rotation and placement.
  • 🔬 The robot's pattern recognition is based on analyzing the edges of puzzle pieces rather than the images on them, simplifying the process.
  • 📱 Jigsaw's 'eyes' are essentially a smartphone camera that captures images of the puzzle pieces for edge analysis.
  • 🔄 The robot employs a process of elimination and spline matching to find where each puzzle piece fits within the overall picture.
  • 🔍 Jigsaw's algorithm can solve a 1000-piece puzzle in under a minute, demonstrating its advanced computational capabilities.
  • 🛠️ The robot was upgraded with a 'wiggle' routine and a z-height encoder to mimic human touch and make fine adjustments when placing pieces.
  • 🏆 Jigsaw competed against Tammy McLeod, a world-record-holding human jigsaw puzzler, showcasing a face-off between human and machine.
  • 🎓 The video also promoted the CrunchLabs Hack Pack, a subscription service offering programmable robots and engineering skill development for enthusiasts.

Q & A

  • What is the primary function of Jigsaw, the robot featured in the script?

    -Jigsaw is a robot specifically designed to solve jigsaw puzzles with high precision and speed, potentially faster than the fastest human jigsaw puzzler in the world.

  • How long did it take to develop Jigsaw to the point where it could compete with human jigsaw puzzlers?

    -It took three years of development to reach the stage where Jigsaw could be tested against human competitors.

  • What are the four tasks that humans perform when solving a jigsaw puzzle, as mentioned in the script?

    -The four tasks are picking up a piece, rotating it to the correct orientation, moving the piece into position, and deciding where the piece should go based on pattern recognition and spatial reasoning.

  • How do humans' hands contribute to their ability to solve puzzles efficiently?

    -Human hands are flexible, strong, and precise, with 27 bones and 34 muscles, as well as a high concentration of nerves in the fingertips for sensing pressure, textures, and temperature. The opposable thumb also aids in holding tools and manipulating objects.

  • What evolutionary advantage does the human brain provide that makes us excel at tasks like puzzle solving?

    -The human brain, which makes up 2% of body weight but consumes 20% of daily energy, allows for tool use, planning, problem-solving, language, and large-scale cooperation, giving humans a survival advantage and making us excellent at tasks like jigsaw puzzles.

  • How does Jigsaw's suction cup differ from a human hand in picking up puzzle pieces?

    -Jigsaw uses a tiny, specialized suction cup to pick up puzzle pieces, controlled by a solenoid connected to a vacuum pump, allowing it to pick up and release pieces with precision, unlike the complex structure and dexterity of a human hand.

  • What type of motor is attached to Jigsaw's suction cup for precise rotation of puzzle pieces?

    -Jigsaw's suction cup is attached to a donut motor that is precise to 0.005 degrees, allowing for incredibly fine adjustments when rotating puzzle pieces.

  • How did the creators of Jigsaw address the challenge of moving puzzle pieces with precision?

    -They modified an avid CNC router with ClearPath industrial servo motors, which are accurate to .0005 inches, enabling Jigsaw to place puzzle pieces with high precision.

  • What approach did Jigsaw use to solve the puzzle placement challenge, given the complexity of pattern recognition and spatial reasoning?

    -Instead of trying to replicate the human brain's complex neural network, Jigsaw used a simpler approach by ignoring the printed images on the puzzle pieces and focusing on the edges, analyzing them with a cell phone camera and comparing edge splines to find matches.

  • What was the solution developed by Ryan from Zipline that became the backbone of Jigsaw's puzzle-solving capability?

    -Ryan developed a software solution that focused on edge analysis, using a cell phone camera to take pictures of the puzzle pieces, converting the edges into splines, and then comparing these splines to find matching puzzle pieces.

  • How did Jigsaw handle assembling a 1000-piece all-white puzzle, which is a significant increase in complexity from a 12-piece puzzle?

    -Jigsaw scaled up its capabilities by taking pictures of all pieces, analyzing them, and using a combination of software algorithms and precise physical manipulation to solve and assemble the 1000-piece puzzle, despite the increased complexity.

  • What was the final feature added to Jigsaw to address the issue of pieces not snapping into place during assembly?

    -A z height encoder on a spring-loaded linear slider was added to provide feedback on the placement of pieces, allowing Jigsaw to make tiny adjustments, similar to the human sense of touch, and ensure pieces snapped into place correctly.

  • What was the outcome of the competition between Jigsaw and the world's fastest human jigsaw puzzler, Tammy McLeod?

    -Jigsaw won the competition, solving a 1000-piece puzzle in four hours, demonstrating its superior speed and precision over the human competitor.

  • What are the four tips provided by Tammy McLeod for amateur jigsaw puzzlers to solve puzzles faster?

    -The tips are: 1) Dump out all pieces and turn them over for a full view, 2) Don't always start with edge pieces, especially if there's a distinct pattern around the edge, 3) Organize pieces into piles by color, texture, or pattern to reduce the search space, and 4) For pieces that look the same, sort by shape based on the number of ins and outs and orient them the same way.

  • What is the CrunchLabs Hack Pack, and how does it relate to the theme of the script?

    -The CrunchLabs Hack Pack is a series of fun, programmable robots delivered to subscribers, designed to teach engineering skills and encourage creativity in building and programming. It relates to the script's theme of engineering and problem-solving, as demonstrated by Jigsaw's creation and competition.

Outlines

00:00

🤖 Introduction to Jigsaw: The Ultimate Puzzle-Solving Robot

The script introduces 'Jigsaw,' a specialized robot designed to excel at solving jigsaw puzzles at an unprecedented speed, potentially 200 times faster than the world's fastest human. The development took three years and involved creating a robot capable of performing four complex tasks involved in jigsaw puzzling: picking up pieces, rotating them, positioning them, and recognizing where they fit. The human hand's dexterity and the brain's pattern recognition and spatial reasoning are highlighted as remarkable attributes that the robot must emulate. The robot uses a suction cup for picking up pieces, a precision motor for rotation, and advanced servo motors for positioning. The challenge of replicating the human brain's subconscious processes for puzzle-solving is discussed, along with the introduction of a new character, Shane from 'Stuff Made Here,' who has also developed a puzzle-solving machine.

05:00

🔧 Engineering Mastery and the Development of Jigsaw's Puzzle-Solving Algorithm

The script details the journey of refining Jigsaw's capabilities, emphasizing the expertise of Shane, who is described as a well-rounded engineer. It outlines the process of simplifying the puzzle-solving algorithm by focusing on the edges rather than the patterns, which is a more manageable problem for a robot. The approach involves taking pictures of each puzzle piece, converting their edges into mathematical splines, and matching them based on minimal overlap. The script also describes the iterative process of solving the puzzle, which includes starting with corner pieces and backtracking when dead ends are encountered. The challenge of scaling the solution to a 1000-piece puzzle is addressed, along with the technical difficulties faced and the eventual success of Jigsaw's algorithm in solving the puzzle in under a minute.

10:02

🔧 Enhancing Jigsaw with Human-like Feedback and Final Assembly

The script discusses the final stages of Jigsaw's development, focusing on the addition of a z height encoder to mimic the human sense of touch and fine-tune the placement of puzzle pieces. It describes the 'wiggle routine' that Jigsaw uses to make minor adjustments to piece placement until they fit perfectly. The script also recounts the process of assembling a 1000-piece puzzle, highlighting the technical challenges and the iterative improvements made to Jigsaw's hardware and software. The successful completion of the puzzle by Jigsaw, despite initial setbacks, is celebrated, and the script concludes with the anticipation of a human versus robot jigsaw puzzle competition.

15:02

🧩 The Human-Robot Jigsaw Puzzle Showdown

The script sets the stage for a competition between Jigsaw and renowned human jigsaw puzzler Tammy McLeod, who also holds a Guinness World Record. It includes a preliminary face-off with actress Kristen Bell and a 30-piece puzzle, showcasing Tammy's speed and skill. The main event involves a 500-piece puzzle, and the script describes the strategies used by both Tammy and Jigsaw, including Tammy's use of the box image and Jigsaw's systematic approach. The script also provides insights into Tammy's puzzle-solving techniques and highlights the camaraderie and humor of the competition.

20:02

🏆 Jigsaw's Victory and the Introduction of the CrunchLabs Hack Pack

The script concludes with Jigsaw's victory over Tammy in the jigsaw puzzle challenge, acknowledging the robot's superior capabilities in this domain. It then shifts focus to the CrunchLabs Hack Pack, a subscription service offering a series of programmable robots designed for teenagers and adults. The script promotes the educational value of the Hack Pack, which teaches engineering skills and allows for customization and creativity. It also mentions a special offer for new subscribers and the potential prize of a platinum diploma in each box, which could cover college tuition.

Mindmap

Keywords

💡Jigsaw Puzzle

A jigsaw puzzle is a tiling puzzle that requires the assembly of numerous small, often oddly shaped, interlocking and tessellating pieces. Each piece has a small part of a picture on it, and when combined, they form a complete picture. In the video, the theme revolves around a robot named Jigsaw that is designed to solve jigsaw puzzles with exceptional speed and precision, highlighting the complexity of the task for both humans and machines.

💡Robotics

Robotics is the branch of technology, engineering, and science that deals with the design, construction, operation, and use of robots. The video script discusses the development of Jigsaw, a specialized robot, emphasizing the intricate process of creating a machine capable of performing a task—solving jigsaw puzzles—that is typically a human domain.

💡Pattern Recognition

Pattern recognition is the ability to identify and classify patterns in data, which is a fundamental aspect of machine learning and artificial intelligence. In the context of the video, pattern recognition is crucial for the robot Jigsaw to identify where puzzle pieces fit together, a task that humans perform subconsciously but is challenging for a robot to achieve through computational means.

💡Spatial Reasoning

Spatial reasoning is the cognitive process of understanding and manipulating the spatial relationships and orientations between objects. The video describes how humans use spatial reasoning to determine where puzzle pieces should be positioned within a jigsaw puzzle, a cognitive task that the robot Jigsaw must replicate algorithmically.

💡Suction Cup

A suction cup is a device that can adhere to smooth surfaces by creating a partial vacuum between the cup and the surface. In the script, a tiny specialized suction cup is used as part of Jigsaw's design to pick up and manipulate puzzle pieces, illustrating the need for innovative solutions to mimic human capabilities like opposable thumbs.

💡Donut Motor

A donut motor is a type of motor that is often used in precision applications due to its compact and robust design. The video mentions a finely tuned donut motor that allows Jigsaw to rotate puzzle pieces with incredible precision, demonstrating the level of accuracy required for the robot to compete with human puzzle solvers.

💡CNC Router

A CNC (Computer Numerical Control) router is a machine used in various manufacturing processes, capable of precise cutting, carving, and routing. The script describes how a CNC router was modified for Jigsaw to accurately place puzzle pieces, highlighting the use of advanced machinery in creating the robot's capabilities.

💡Servo Motors

Servo motors are a type of motor that includes a feedback system for precise control of position, velocity, and acceleration. The video script refers to ClearPath industrial servo motors used in Jigsaw's design, which enable the robot to place puzzle pieces with high accuracy, showcasing the importance of precise motor control in robotics.

💡Algorithm

An algorithm is a set of rules or steps used to solve a problem or perform a computation. The video describes how an algorithm was developed for Jigsaw to solve puzzles, ignoring the printed images and focusing on the edges of the pieces, which simplifies the complex task of pattern matching for the robot.

💡Feedback Loop

A feedback loop is a process that involves taking the output of a system and using it as input to adjust the system's behavior. In the video, the human ability to make fine adjustments when assembling puzzles is likened to a feedback loop, and Jigsaw uses a similar mechanism with a z height encoder to ensure pieces are correctly placed.

💡Guinness World Record

The Guinness World Record represents the highest or lowest levels of achievement within a particular field, verified by the Guinness World Records organization. The script mentions Tammy McLeod, who holds the Guinness World Record for the fastest puzzle solved by a human, providing a benchmark for Jigsaw's performance in the robot versus human puzzle-solving challenge.

Highlights

Introduction of Jigsaw, a robot designed to solve jigsaw puzzles at an unprecedented speed.

Jigsaw's potential to be 200 times faster than the fastest human puzzler, based on initial tests.

The human hand's dexterity and precision in picking up and manipulating puzzle pieces.

The evolutionary advantage of opposable thumbs in tool manipulation and puzzle solving.

The complexity of human visual perception and cognitive processes in solving puzzles.

The development of Jigsaw's specialized suction cup to mimic human hand functions.

Precision of Jigsaw's donut motor to an accuracy of 0.005 degrees for piece rotation.

Use of ClearPath industrial servo motors for accurate placement of puzzle pieces.

The challenge of programming Jigsaw to recognize and place puzzle pieces accurately.

Innovative approach to ignore puzzle图案, focusing on edge analysis for solving.

The use of a smartphone camera as Jigsaw's 'eyes' for capturing puzzle piece images.

Algorithm development for matching puzzle piece edges using splines and overlap area calculation.

Jigsaw's ability to backtrack and find alternative solutions when encountering dead ends.

The implementation of a z height encoder for fine-tuning piece placement like human touch.

Jigsaw's successful completion of a 1000-piece puzzle, showcasing its advanced capabilities.

The human-robot jigsaw puzzle competition, highlighting the speed and accuracy of Jigsaw.

Tammy McLeod, a world-record holder in jigsaw puzzles, facing off against Jigsaw.

Jigsaw's victory over a human champion, signifying a milestone in robotic puzzle-solving.

Introduction of the CrunchLabs Hack Pack, an educational tool for building and programming robots.

Details on the features and benefits of the CrunchLabs Hack Pack for makers and learners.

Transcripts

play00:00

This is jigsaw.

play00:01

He's a friendly little robot that's really, really good at only one thing:

play00:04

Putting together any jigsaw puzzle, no matter how complicated.

play00:07

Really, really fast.

play00:08

It's taken us three years to get to this point,

play00:11

but according to our initial tests, we have hopes he might be 200 times

play00:14

faster than the fastest competitive jigsaw puzzler in the world.

play00:18

So today, we're going to walk through what it took

play00:19

to get ready for the ultimate robot versus human face off.

play00:22

And along the way, we may just discover some tricks

play00:24

you might find helpful as a mere human jigsaw puzzler yourself.

play00:28

But before we unpack how jigsaw does what he does

play00:31

I first want to give us humans some well-deserved credit

play00:35

because while this seems pretty straightforward of me

play00:37

to be able to pick up and arrange

play00:39

these 12 pieces of a puzzle, I'm actually doing four very complicated tasks.

play00:44

The first is just picking up a piece.

play00:46

Have you ever stopped to think just how amazing our hands are?

play00:50

Hiding beneath that skin are 27 bones and 34 muscles,

play00:54

which makes them flexible and strong, but they're also incredibly precise and dexterous

play00:59

thanks to the high concentration of nerves in our fingertips

play01:01

for sensing pressure textures, and temperature.

play01:03

We've also evolved to have opposable thumbs,

play01:05

which makes it way easier to hold tools

play01:08

and to manipulate and pick things up

play01:09

than if it was just five fingers all side by side.

play01:12

Step two is rotating the piece

play01:14

to the correct orientation, which again is pretty straightforward

play01:17

when you have all the abilities I just mentioned.

play01:19

For step three,

play01:20

we need to move the piece into position, and that requires our whole arm.

play01:24

As I’ve mentioned before

play01:25

all mammals have the same basic arm bone configuration

play01:28

from a human to a bat, to a chicken to a turtle to a dolphin.

play01:32

But when you include the hand, our configuration

play01:35

is the most technically capable arm

play01:37

of any living thing to have ever existed on this planet.

play01:40

If you imagine a large cube in front of me, it's wild that us humans

play01:43

can move this puzzle piece to any position and orientation within that cube.

play01:47

That's really hard for a robot

play01:49

or pretty much any other species to do for that matter.

play01:52

For step four,

play01:52

we have to decide where this piece should go

play01:55

and for us humans, it's hard

play01:55

it’s hard to explain how

play01:57

but when we look at this, it just very quickly feels super obvious

play02:00

this piece should go here.

play02:03

What's actually happening, though, is our eyes communicate

play02:05

visual perception to our brains, which then subconsciously synthesize

play02:08

a complicated combination of pattern recognition, spatial reasoning,

play02:12

visual memory, and executive function, and as a result, in fractions of a second?

play02:16

The answer just feels obvious.

play02:17

And not to brag.

play02:18

But this is once again where us humans are the undisputed champions.

play02:22

Our complex brains are what make us special.

play02:25

Physically, we're kind of unremarkable in the animal kingdom.

play02:28

We're not faster than cheetahs or stronger than bears.

play02:31

We can't swim as well as dolphins or fly like an eagle.

play02:34

It's our brains that make up 2% of our body weight,

play02:38

yet they consume 20% of our energy every day.

play02:41

And that ratio is higher than any other living thing ever.

play02:44

And it's the reason we're the ultimate apex predators

play02:47

because it allows for the huge survival advantages that come from tool use planning,

play02:51

problem solving, language, and large scale cooperation with other humans.

play02:55

It's also what has possibly, up until this moment

play02:58

in history, made us the best...

play03:00

at jigsaw puzzles.

play03:01

So if we wanted to make a robot that was as good

play03:03

or better than us at puzzles, our daunting challenge

play03:06

was to take the 200 million years

play03:07

of evolution that enabled those four steps,

play03:09

and figure out how to translate it into things

play03:11

a robot can do

play03:12

For number one, to pick up a piece

play03:14

in lieu of an opposable thumb and 27 hand bones

play03:16

we used a tiny, specialized suction cup

play03:18

that's often used to manipulate small objects on assembly lines.

play03:21

This solenoid here can cut off and then connect to this vacuum pump,

play03:25

which means we could turn on the suction exactly when we want to pick it up,

play03:28

and then turn it off

play03:29

exactly when we want to let it go

play03:31

For number two

play03:31

we attached the suction cup grabber of jigsaw

play03:34

to this very fine tuned donut motor.

play03:36

That's precise to an incredible 0.005 degrees.

play03:40

That means if you attached an infinitely sharp knife to the end of the motor,

play03:43

it could slice your circular birthday cake into over 65,000 pieces.

play03:47

For number three to move a piece around, we modified our avid CNC router

play03:51

we're constantly using around here for our large builds

play03:54

by upgrading the motors to ClearPath industrial servo motors.

play03:57

These are the same motors we used on the Dominator.

play04:00

Our autonomous Domino robot.

play04:01

Once we did this, we saw it could

play04:02

accurately place a puzzle piece down to .0005 inches

play04:07

That's one tenth the width of a human hair,

play04:09

which means, as you can see here,

play04:10

jigsaw can take the lead out of a mechanical pencil

play04:13

and move all around the table, and then come back and put the lead right back in.

play04:17

So now that jigsaw could pick up

play04:19

rotate, and move any piece with terrifying precision.

play04:22

The only thing he lacked was step four, knowing exactly where to place the pieces.

play04:26

And as you might guess, this was by far the hardest one to solve

play04:29

because all the subconscious work performed by neural pathways in our brain

play04:33

that handle pattern recognition and spatial reasoning, that makes finding

play04:35

that makes finding the right piece feel so obvious to us

play04:38

is a really, really hard problem to solve

play04:40

using just computer logic and code

play04:43

To make matters worse

play04:44

just as we were really struggling to come up with a good solution to this problem,

play04:47

the most devastating thing that can happen as a YouTuber actually happened.

play04:51

My friend Shane from the YouTube channel Stuff Made Here

play04:54

released a video about, you guessed it, a machine that solves jigsaw puzzles.

play04:58

And what you should know about Shane is he's probably

play05:00

the most technically capable engineer I know.

play05:02

If there are like 15 categories that make you a good engineer,

play05:05

my knowledge goes pretty deep in maybe four, and I'm a generalist in the rest

play05:09

But then I have people like Ian and others on my team who help fill in the gaps.

play05:12

Shane, however, is somehow an expert in all 15

play05:15

which is why you should subscribe to his channel.

play05:17

When I told him he beat me to the finish line,

play05:19

he told me he personally wasn't satisfied with where he landed the project

play05:23

and encouraged me to keep trying. So I persevered.

play05:25

And that's when our fortunes improved, because while filming a video in Rwanda

play05:29

covering the work done at Zipline, where they deliver life saving blood

play05:32

using autonomous drones, I got to spend some time with Ryan,

play05:35

their co-founder, who's responsible for all their complicated software algorithms.

play05:38

And after hearing all of our challenges

play05:40

by the time the plane landed on the way back home, he'd coded up a solution

play05:44

that ended up being the backbone that unlocked everything for us.

play05:47

Basically, instead of trying to compete with our brains

play05:49

very complicated pattern-matching neural network

play05:51

we took a much more simple approach

play05:53

by completely ignoring what was printed on the puzzle

play05:55

and just looked at the edges

play05:57

so while painting it white

play05:58

makes it more impressive and way harder to solve for us humans.

play06:01

It would make no difference to jigsaw.

play06:02

So to do this edge analysis, we first need a set of eyes.

play06:05

but not those eyes.

play06:06

Those are just decorative because it's no secret

play06:08

I love a good pair of googly eyes.

play06:10

And these were our most advanced set of googly eyes ever.

play06:13

Because the googly is controlled by two servo motors

play06:16

jigsaws real eyes

play06:17

were just a cell phone camera.

play06:18

The idea was to run a serpentine pattern over all the pieces

play06:21

and take a picture of each one, and then isolate them against the background

play06:25

then convert the edges of every piece into four splines.

play06:28

So if we wanted to find a match, say for this edge,

play06:31

we would just need to take that spline and then find the puzzle piece

play06:34

that had a corresponding edge spline that matched up perfectly.

play06:38

Because matching pieces share identical edges.

play06:40

Now, even for a small, simple puzzle like this, that's over 200

play06:44

edge comparisons that need to be made.

play06:46

So the first step is just to look at the overall length of each spline

play06:48

and disregard any edges that were significantly longer or shorter,

play06:52

and that typically reduced the solution space by about 50%.

play06:55

Then for the remaining candidates, we would overlay the splines

play06:58

and then quantify the mismatch by calculating the area

play07:01

between the two edge splines.

play07:03

So two pieces that were obviously not a fit would have a lot of overlapping area,

play07:07

whereas two pieces that were a perfect match

play07:09

the overlap area would essentially be zero.

play07:11

From there, we looked at all the possible spline matchups and ranked the pieces

play07:15

as potential matches with each other from least overlap area to most.

play07:18

Then jigsaw would start

play07:20

with one of the four corner pieces and map out the potential solution space,

play07:24

which you could picture visually like this.

play07:26

So the correct solution

play07:27

is the only one that finds a good fit for all 12 pieces of the puzzle.

play07:31

But as you can see, there's lots of forks and dead ends.

play07:33

And that's because sometimes it was really obvious what the matching piece was.

play07:37

But sometimes there were 3 or 4 close contenders

play07:40

because the edges are so similar, and our pictures weren't always perfect,

play07:43

so jigsaw would always pick

play07:45

what seemed like the best match for a set of two pieces.

play07:47

But at some point the puzzle would only be halfway done

play07:50

and there would be no more good candidates to match the edges

play07:53

to continue solving the puzzle.

play07:54

And that's a dead giveaway

play07:56

he chose the wrong piece somewhere previously up the chain,

play07:58

so he would work his way

play07:59

back to the closest fork and then choose the next best option,

play08:03

and he would keep doing this over and over

play08:04

until he found a path that finally connected all 12 pieces

play08:08

with essentially zero spline mismatches at every connection.

play08:11

And then at that point,

play08:12

because he took pictures of all the pieces,

play08:14

he knows exactly where each of them is starting from over here.

play08:17

And he can simply assemble the puzzle using the precision

play08:19

he demonstrated back in steps one through three.

play08:22

So it was working on a 12 piece puzzle, but now for the real challenge.

play08:25

Could we scale that up to a 1000 piece, all-white puzzle?

play08:29

Since our ultimate goal was to dominate the world's fastest human puzzle solver.

play08:32

We figured maxing out the number of pieces would give the advantage

play08:35

to the non-overwhelmable robot.

play08:36

So after a couple more long weeks filled with plenty of late nights

play08:39

working through all the challenges that come from

play08:41

scaling up a simple prototype 100 times over...

play08:44

we landed here.

play08:44

It's 3 a.m.

play08:46

after three years.

play08:47

We're at this moment about to fully solve it for the first time.

play08:51

What's our confidence level?

play08:52

I'd say 100%.

play08:53

Wow!

play08:54

The code always works on the first try

play08:56

And so with that very heavy dose of sarcasm,

play08:59

jigsaw got to work starting first with taking all the pictures.

play09:02

And that took about 1.5 hours.

play09:04

And after we had the pictures, and we did the prep work on them I mentioned earlier

play09:08

it was time for jigsaw to actually try and solve the 1000 piece puzzle.

play09:12

And astoundingly, while running on just a simple laptop

play09:15

the actual time to figure out the correct placement

play09:18

of all 1000 pieces

play09:20

was less than a minute.

play09:21

And I love how you can actually see him

play09:22

working his way around the puzzle from the top corner

play09:25

solving, and then going back each time he hits a dead end

play09:28

to try and find a different fork in the solution space, until he finds

play09:31

the only combination that makes them all fit perfectly.

play09:34

So at this point, all that was left for

play09:36

jigsaw to do was get to work placing the pieces, since he now knew

play09:40

where every single one needed to go

play09:42

and things were looking really good.

play09:43

And just as we made the mistake of having some kind of glimmer of hope,

play09:47

a single piece didn't quite snap into place.

play09:49

And then a bunch more followed right behind.

play09:52

And upon troubleshooting, what we discovered was

play09:54

there were a few very small sources of error

play09:56

that tended to compound on each other.

play09:58

The more the puzzle was assembled.

play09:59

So, for example, there's always a little slop

play10:01

between any two puzzle pieces, which adds up over a lot of pieces.

play10:05

Or another source of error is the whole puzzle itself shifting slightly

play10:08

when certain pieces were laid down.

play10:10

And this led us the realized jigsaw was actually still missing

play10:12

one final important feature us impressive humans possess

play10:16

Because if you think about it,

play10:17

when we assemble a puzzle

play10:18

we first just approximately place the piece where it needs to go

play10:21

and then we rely on those highly sensitive nerves in our fingertips

play10:24

to form a feedback loop with the brain

play10:27

to make really tiny adjustments until we feel the piece fall into place

play10:31

and then a double tap is the customary move to make it official

play10:34

But since jigsaw doesn't have nerves in his gripper, we approximated

play10:37

that with the z height encoder on a spring-loaded linear slider

play10:40

and that encoder is so accurate

play10:42

if you slice a human hair lengthwise into 50 pieces,

play10:45

jigsaw could feel that tiny hair slice if it was resting on top of the table.

play10:50

So now if jigsaw went to place a piece

play10:51

and he could feel it hadn't quite snapped into place

play10:54

because it was resting too high,

play10:55

he would employ a wiggle routine where it would just barely translate

play10:58

the piece into various directions until he got the feedback from his finger

play11:02

that the piece was fully set down

play11:04

at which point he would give it the customary final tap

play11:06

like any puzzle solver worth his salt.

play11:08

And so, with Jigsaw's new hardware and software upgrades

play11:10

he was ready for one more final attempt.

play11:13

And I should mention, by the way, from a combined

play11:14

hardware software perspective, this is by far the most challenging

play11:18

build ever on my channel, and that includes

play11:20

the auto Bullseye dartboard and the automatic Domino Robot Dominator.

play11:23

So if you really want to appreciate

play11:25

all the juicy details, including all of the source code,

play11:27

you can find a link to the full write up in the video description.

play11:30

You boys ready to try this again officially for the 48th time?

play11:33

Better work this time.

play11:34

What's the confidence levels at?

play11:36

100%.

play11:36

Have you learned nothing Ian?!

play11:38

Hit the dang button

play11:39

So jigsaw got to work and after taking pictures

play11:42

of all the pieces, he once again actually solved the whole puzzle

play11:45

in a mere 55 seconds

play11:47

which meant it was time to put them all together.

play11:49

And thanks to the wiggle routine

play11:50

you got this jigsaw.

play11:52

The first 20% was knocked out in less than an hour.

play11:55

Okay, I guess we could sit back down

play11:57

And that meant while jigsaw was doing all the hard work,

play11:59

I just get to kick back and relax in a state of Zen

play12:02

gazing at this polar gantry sand garden that you can build yourself.

play12:05

Because unlike the CrunchLabs build box,

play12:07

which is made for kids, we just launched HackPack, which is kind of similar

play12:11

It's just more advanced and created specifically for teenagers and adults.

play12:15

With HackPack, you get a series of really fun programable robots

play12:18

delivered right to your door, where we build it together and learn,

play12:21

step by step, the kinds of engineering skills

play12:23

that go into making the builds on my channel.

play12:25

They're all super fun and even useful, and they'll work right out of the box.

play12:30

No programing required,

play12:33

but since my goal is to get you to always level up your skills

play12:36

with some simple code tweaks we walk you through,

play12:39

you can level up the functionality of your robot, or get totally creative

play12:43

with some hacks of your own.

play12:44

So if you want to enhance or even just take the first step

play12:46

of unlocking the really fun and rewarding hobby of making stuff,

play12:50

just go to CrunchLabs.com, or use the link in the video description

play12:53

where we're giving away one free box as an early subscriber special.

play12:56

and back over with Jigsaw

play12:58

Things were looking very promising for the world record attempt

play13:01

of an off the shelf puzzle, completely solved and assembled by a robot

play13:04

with no human intervention.

play13:07

Some pieces would go right in

play13:09

Uno

play13:10

Wow

play13:10

Some required a little bit of wiggle.

play13:13

Oh, actually, yeah.

play13:14

And some required a lot of wiggle

play13:19

But in the end.

play13:20

let’s go Jigsaw

play13:21

C’mon last piece

play13:23

Jigsaw always came through

play13:25

Yes!!

play13:26

Now feeling more confident in Jigsaw’s abilities

play13:29

It was time for him to meet the greatest jigsaw puzzler the human race had to offer

play13:33

What? Are you done?

play13:34

Who, fun fact

play13:35

also happens to be a national sudoku champion

play13:37

Tammy McLeod

play13:38

I’m the Human Benchmark according to my child

play13:40

I first wanted her to face off

play13:42

against the best jigsaw puzzler I personally know

play13:44

my dear friend Kristen Bell

play13:46

aka Anna, or Veronica mars, or Eleanor, or a bunch more

play13:50

Kristen

play13:51

ever since I told you I was making a puzzle robot, you've been talking so much trash.

play13:55

A little bit of trash. Yeah.

play13:56

The puzzle robot isn't here today.

play13:58

So instead, I have a friend I want you to... challenge.

play14:01

This is Tammy.

play14:02

She holds the Guinness World Record for

play14:04

the fastest puzzle

play14:05

Ever solved by a human being.

play14:06

Hi, Kristen.

play14:07

We kick things off with a simple 30 piece puzzle.

play14:09

And to be honest,

play14:10

Three, two, one. Go!

play14:11

Kristen started off pretty strong.

play14:13

Where's the elephant?

play14:14

Tammy, you don't talk while you're doing it?

play14:16

I mean, I could trash talk, but-

play14:18

Do it!

play14:18

You're gonna lose Tammy.

play14:20

And then you hit me back.

play14:21

Wow, that was one minute and five seconds for a 30 piece puzzle.

play14:26

I'm sweating so much

play14:27

and that was a pretty decisive win.

play14:28

But I wanted to see one more face off,

play14:30

only this time with a 500 piece puzzle

play14:33

and a huge advantage in Kristen's favor.

play14:35

I think I'm going to help you on this one.

play14:38

Okay?

play14:38

And with Kristen's renewed confidence, the clock started

play14:41

and out of the gate

play14:42

Tammy was so confident in this 2-v-1 matchup.

play14:45

She's just doing flipping?

play14:46

Oh my god, that's crazy organized.

play14:48

She saw no problem in helping our cause.

play14:50

What is that little guy?

play14:51

his tail

play14:52

She’s right

play14:53

SHE’S RIGHT

play14:54

Mark, can I ask you a sincere question?

play14:56

Is this the robot?

play14:58

Admittedly, I did have an ulterior motive for this matchup

play15:01

and that was espionage.

play15:03

Tammy, I noticed you're using the box.

play15:05

What!

play15:06

Tammy, get real.

play15:08

You have to look at the picture.

play15:09

It’ll just distract me.

play15:10

I look at the pictures.

play15:11

I have good color acuity.

play15:13

I have very bad shape memory.

play15:14

So if you say had to go against an all white puzzle...

play15:18

That would maybe be my Achilles heel.

play15:19

And this was a very useful bit of information.

play15:21

But she didn't stop there.

play15:23

Because she also told me the four tips

play15:24

she tells amateur jigsaw puzzlers to help them solve puzzles faster.

play15:28

First off, dump out all the pieces

play15:29

and turn them over so you can see them all at the same time.

play15:32

For number two

play15:33

most people start with the edge pieces,

play15:34

and that's not a bad move, but it's not always the best.

play15:37

For example, if there's a puzzle that has something

play15:39

like a gold frame around the outside

play15:41

you should set all the edge pieces aside

play15:43

and then leave them till the end, where there's a lot

play15:45

more information from the interior pieces to help with the border

play15:48

For tip three

play15:48

look for groupings that catch your eye and organize them into piles.

play15:51

So for example, you could organize by colors, textures, or patterns.

play15:55

But either way, you're trying to reduce the search space into smaller chunks

play15:59

because scanning and pattern matching are different parts of the brain.

play16:02

And this way you don't have to do them at the same time, which makes it easier.

play16:05

And finally,

play16:05

if you're down to a bunch of pieces that all look the same like a blue sky,

play16:08

sort by shape based on how many ins and outs they have

play16:11

and orient them all the same way.

play16:13

This will leave you with six total piles

play16:15

and will make it much easier to find the final matches.

play16:17

And I needed to look no further than our current match up-

play16:20

Oh no. I look away for one minute.

play16:22

Don't look at Tammy's, Kristen

play16:24

Things have gotten dire.

play16:25

-to understand there must be some validity to these four steps.

play16:28

I’m not seeing your hands move or your eyes look at the board

play16:30

I’M PANICKING

play16:31

I'm not trying to-

play16:32

DONE!?

play16:33

34 minutes and 2 seconds.

play16:36

500 pieces.

play16:38

Congratulations.

play16:38

Congratulations.

play16:39

Your next puzzle match will not be against mere humans.

play16:43

And indeed, after setting things up at CrunchLabs, we were ready to go.

play16:46

Tammy, I'd like to officially introduce you to jigsaw.

play16:49

This is my upgrade from Kristen

play16:51

And Jigsaw was in no mood for conversation as he got straight to work.

play16:54

All right, then!

play16:55

As Tammy entered the matchup of her life with the weight

play16:57

of all humanity resting on her capable shoulders.

play17:00

What's your strategy here?

play17:01

The only shape I can make use of is the edge.

play17:04

Okay, how are we doing, jigsaw?

play17:07

not really sure what I'm supposed to do now...

play17:09

But that’s when I remember I have a specialized skill set of my own

play17:11

I might need to take measurements on your neck later.

play17:14

I'm making you something.

play17:15

That's why you don't have any pieces placed yet on your team.

play17:17

Wow, Tammy

play17:19

you're familiar with the saying “measure once, cut twice.”

play17:21

No, that's not it.

play17:24

And as if on cue,

play17:26

My teammate, wrapped up his measuring.

play17:27

There's a corner piece!

play17:29

and began cutting.

play17:33

did you have to make him so noisy?

play17:34

Three pieces!

play17:35

Four pieces!

play17:36

Tammy, ignore me...

play17:38

Saying five pieces!

play17:40

It ain’t over till it's over.

play17:42

You're still winning, Tammy. Don't let it get to your head.

play17:44

And while I was tempted to count all 1000

play17:46

Nine pieces!

play17:48

I decided to take up woodworking instead.

play17:50

Are you nervous, Tammy?

play17:51

Even if I lost today, my family would still love me.

play17:53

Jigsaw.

play17:54

If he lost today, would you still love him?

play17:56

No

play17:57

My love is very conditional.

play17:58

Having properly reminded jigsaw what was at stake.

play18:00

Jigsaw has now officially taken the lead.

play18:02

Jigsaw continued to make steady progress while Tammy...

play18:06

Where’s that last edge?

play18:07

Oh, you need one edge piece

play18:08

faced the limits inherent in biology

play18:11

I really want to actually help find this for you

play18:13

That way I can say you needed my help.

play18:14

Without the precise search capabilities...

play18:17

I found it, I’m done with the edge!

play18:18

Of a smart phone to laptop nervous system.

play18:20

Click. I love that sound.

play18:21

Is there any way I could get some water.

play18:23

Jigsaw. Do you need a water break?

play18:26

You notice we are missing a piece in the middle

play18:29

that's on purpose

play18:29

I was the ideas guy and jigsaw was the muscle.

play18:32

Jigsaw. That's your next piece right there buddy.

play18:34

I'm a team player.

play18:35

The only thing is

play18:36

he could be a bit of a control freak

play18:38

So I opted to help Tammy instead.

play18:40

Tammy, do you need this piece? Do you need this piece?

play18:42

Do you need this piece? Do you need thi–

play18:44

And so while jigsaw continued to widen the gap

play18:47

I made myself useful by woodworking.

play18:50

Solitairing

play18:51

Finding Waldo.

play18:53

Tammy right here!

play18:53

Nah I’ll look later

play18:54

and just generally reverting to the role of my youth

play18:56

as the annoying youngest sibling.

play19:00

I love doing puzzles

play19:01

And after all that, Tammy had made a lot of progress-

play19:04

Tammy, I have good news and bad news.

play19:06

The bad news?

play19:07

There's only eight pieces left

play19:09

-but not enough.

play19:10

The good news is I made you a scarf!

play19:13

In fact, if you assume it takes one second per side

play19:16

to try all the remaining combination of pieces she had left

play19:19

working 12 hours a day, skipping weekends.

play19:22

It would take her one and a half months to finish

play19:24

which made this a good time

play19:26

to throw in the towel.

play19:27

Unless you're about to finish

play19:28

I think I'm good.

play19:29

Oh, this is a moment!

play19:30

1000 pieces in four hours.

play19:34

Okay, Tammy, you represented us humans well,

play19:38

But alas, it’s time we welcome our benevolent robot overlords.

play19:42

It's an honor to lose to him

play19:46

That was beautiful.

play19:47

I gotta say!

play19:48

Good work, jigsaw.

play19:50

At ease

play19:50

So while jigsaw took his victory lap

play19:52

I put the final touches

play19:54

on the trophy I'd carved her.

play19:55

You are the best the human race has to offer.

play19:58

And you did a great job.

play19:59

Just, you know, not that great

play20:02

if you're a teenager or adult

play20:03

and you've always wanted to make and build cool stuff

play20:06

but just have it figured out that first step

play20:07

This is it.

play20:08

It's called the CrunchLabs Hack Pack

play20:10

and it's basically a series

play20:12

of really fun programable robots that get delivered right to your door.

play20:15

Where we build it together and learn, step by step, the kinds of engineering skills

play20:19

that go into making the builds on my YouTube channel,

play20:21

and they all work with no programing required.

play20:24

But since my goal is to take you from wherever you're at

play20:26

and level you up, you can easily hack the microcontroller brains

play20:29

of any of these robots in a bunch of ways to completely level up the functionality.

play20:34

There's also a community

play20:35

where you could share your builds or post questions,

play20:37

as well as an AI chat bot named Mark Robot that will check your code for you

play20:40

and help you implement your most creative ideas.

play20:44

On top of all that, each box has a chance to contain a platinum diploma.

play20:47

If you're box has it, congratulations because college is now

play20:50

free for you or a loved one you want to transfer it to

play20:53

plus you get to come out here and brainstorm

play20:55

one of your own ideas with me and my team for a day.

play20:57

So if you want to enhance or even just take the first step

play21:00

of unlocking the really fun and rewarding hobby of making stuff,

play21:04

just go to CrunchLabs.com

play21:05

or use the link in the video description where to say thank you

play21:07

We're giving away that free box as an early subscriber special

play21:11

Thanks for watching.

Rate This

5.0 / 5 (0 votes)

الوسوم ذات الصلة
RoboticsPuzzle SolvingEngineeringHuman-RobotCompetitionInnovationTech ChallengeArtificial IntelligenceDIY ProjectsEducational
هل تحتاج إلى تلخيص باللغة الإنجليزية؟