WORCESTER, Mass. -- In the first two days of the NASA robotics challenge this week, every team failed.
Every. Single. Team.
NASA officials and roboticists were disappointed, but not shocked, at the less-than-spectacular results at yesterday's NASA robotics challenge -- even though researchers from the likes of Rensselaer Polytechnic Institute, Worcester Polytechnic Institute (WPI) and Oregon State University had worked on the fully autonomous machines.
It's not that robotics is particularly new territory. People by now are accustomed to iRobot's Roomba robotic vacuum cleaning our floors. Robots help assemble automobiles and smartphones. A humanoid robot is even working on the International Space Station, while robotic rovers are exploring Mars, looking for signs that the planet has ever been able to support life.
Those robots, though, aren't fully autonomous. There are humans calling the shots behind the scenes.
The robots that 18 teams from the U.S., Canada, Estonia and Mexico were looking to show off at a course on the WPI campus here this week are simply a different breed of machine.
In its third year, NASA's Sample Return Robot Challenge is focused on advancing fully autonomous robots. Researchers have built the hardware and software for robots that can traverse an area the size of one and a half football fields, find objects and retrieve them.
At least, that's what they're designed to do.
These machines have been designed to start up, figure out where they are and then proceed to do their work -- all without human guidance. Sounds simple, but it's not.
"There are so many ways to fail at this," said Jascha Little, a mechanical engineer on Team Survey, a Los Angeles-based group of individual researchers that competed unsuccessfully on Thursday. "We're still experimenting. This is nothing you can buy. You throw together parts and software libraries and try to make a system out of it.... It's just that hard."
After three years of work on their robot, after writing about 10,000 lines of code and sometimes spending as much time on this "spare-time project" as they do on their full-time jobs, Team Survey's robot didn't even make it off the starting platform.
They weren't alone in their frustrations.
Of all the participants, which included teams ranging from groups of individual researchers to university-led teams, a handful never made it off the starting platform.
But two teams nearly had a successful run.
One robot built by a group from Estonia found a sample on Wednesday, the first day of the challenge. But instead of retrieving the object, the robot accidentally ran over it.
Another team from West Virginia actually found an object and was able to pick it up. However, the robot didn't recognize that it had captured the objected and dropped it. It tried again and again, dropping it each time. By the time the robot stopped trying, the object had been driven into the ground.
"It's a problem of sensor fusion," said Craig Putnam, an adjunct computer science professor and robotics instructor at WPI. "You have lots of different kinds of things you're sensing and you have to fuse that all together to get the big picture. There's vision, odometry, the tilt of the ground, colors and shapes.... It's just a really hard problem."
Because there are so many systems -- like energy management, stability and sensor integration -- in an autonomous robot, the teams behind them are generally made up of mechanical and electrical engineers, software programmers and vision systems experts.
It's the technical version of "it takes a village."
With apologies to the future world of the Jetsons, it's difficult to build a robot maid that will cheerily and efficiently clean the house without accidentally vacuuming up the cat. And that hasn't been lost on the robotics community.
At a recent MIT symposium, Rodney Brooks, co-founder of iRobot, a former MIT robotics professor and co-founder and CTO of Rethink Robotics, posed a rather divisive question: Why hasn't robotics changed the world yet?
Some of Brooks' fellow roboticists disagreed with him, saying that robotics have changed the world. The issue is that people expect a Terminator or RoboCop version of a robot -- and they expect it sooner rather than later.
Alongside those lofty expectations comes Brook's own take on the situation: "Robotics is just really, really hard."
Team Survey's Little agrees with Brooks. But that doesn't mean he's discouraged.
As Little sagged a bit on a bench on the WPI campus after his robot's demonstration Thursday and mentioned how exhausted he was, he called the robot's unsuccessful run a good learning experience, noting it was the first time the machine had ever worked on a large course for two hours.
"This is a software problem and a sensor problem and a little bit of a hardware problem," he said. "And everything had to work.... It's hard, but it's not just hard. It's expensive."
Even so, Little said the group will be back next year to try again.
Ken Stafford, director of WPI's Robotics Resource Center and an associate professor of robotics, also remains hopeful.
Stafford excitedly explained that he saw one team competing this week that had equipped its robot with Saran plastic wrap, much like many people have in their kitchen drawers.
NASA, which needs its rovers on Mars to keep any soil or rock samples separate from each other so they don't become contaminated, required the challenge teams at WPI to do the same.
That's where the Saran wrap came into play. If the machine has been able to collect anything on the challenge course, it would have been ready.
That, said Stafford, was a great idea from a group of people thinking creatively about a problem.
"Creating is taking things that exist and using them differently," said Stafford. "It's not about winning this challenge. It's about getting what NASA needs done."
Many of the teams that failed their early challenges are expected to try again on Saturday if the weather holds.
Sharon Gaudin covers the Internet and Web 2.0, emerging technologies, and desktop and laptop chips for Computerworld. Follow Sharon on Twitter at @sgaudin, on Google+ or subscribe to Sharon's RSS feed. Her email address is firstname.lastname@example.org.
Read more about emerging technologies in Computerworld's Emerging Technologies Topic Center.
This story, "A Good Robot is Hard to Find -- Or Build" was originally published by Computerworld.