Walking on Mars: NASA, Microsoft Explore Red Planet with Wearable HoloLens
Humans on Earth could soon plan a route on Mars for a rover by strapping on a virtual-reality headset.
NASA is planning to do science operations with the Curiosity rover using software co-developed with Microsoft for its new wearable technology, the HoloLens. The software, which is called OnSight, will simulate the environment that Curiosity sees using data that the rover gathered on Mars. This will allow program scientists to examine the environment as if they were standing alongside the rover, NASA said.
"OnSight gives our rover scientists the ability to walk around and explore Mars right from their offices," Dave Lavery, program executive for the Mars Science Laboratory mission at NASA headquarters in Washington D.C, said in a statement. "It fundamentally changes our perception of Mars, and how we understand the Mars environment surrounding the rover." [Mars Photos by NASA's Curiosity Rover]
Using pictures for navigation is something Mars planners are very used to, and on occasion the Curiosity or Opportunity rovers will take pictures that can be converted into 3D stereo views. That said, it's hard for humans to see how far away objects are because depth is difficult to translate, even in 3D pictures of the planet.
To get around this problem, OnSight will use "holographic computing" — technology that pairs virtual reality with real imagery — so that the planners can see the environment and better gauge distance. Scientists can even crouch to get a better look at a Martian rock.
Mark Spoonauer, editor-in-chief of Space.com's sister website Tom's Guide, got to try out the OnSight tool firsthand during a test of the HoloLens.
"I walked around the surface of Mars, bending down to take a look at a rock that may provide clues to an earlier wet history for the planet," Spoonauer wrote on Tom's Guide. "I also collaborated with a remote JPL scientist, who helped me take higher-resolution photos of a mountainous region with a few air taps. During our interaction, I could see his bright green avatar (which looked more like the outline of a human than the real thing), as well as what he pointed to as we chatted."
Get the Space.com Newsletter
Breaking space news, the latest updates on rocket launches, skywatching events and more!
The Jet Propulsion Laboratory plans to start using OnSight for Curiosity mission operations later in 2015. NASA also plans to extend that work with the forthcoming Mars 2020 rover when it reaches the Red Planet.
You can read more about the HoloLens on Tom's Guide, Space.com's sister site.
Follow Elizabeth Howell @howellspace. Follow us @Spacedotcom, Facebook and Google+. Original article on Space.com.
Join our Space Forums to keep talking space on the latest missions, night sky and more! And if you have a news tip, correction or comment, let us know at: community@space.com.
Elizabeth Howell (she/her), Ph.D., was a staff writer in the spaceflight channel between 2022 and 2024 specializing in Canadian space news. She was contributing writer for Space.com for 10 years from 2012 to 2024. Elizabeth's reporting includes multiple exclusives with the White House, leading world coverage about a lost-and-found space tomato on the International Space Station, witnessing five human spaceflight launches on two continents, flying parabolic, working inside a spacesuit, and participating in a simulated Mars mission. Her latest book, "Why Am I Taller?" (ECW Press, 2022) is co-written with astronaut Dave Williams.