Tag Archives: hololens

Astronauts test new Holo-Lens Sidekick aboard the ISS

Astronaut Scott Kelly (seen in pic) and his colleagues stationed on the International Space Station now have a new Sidekick. The project is a collaboration between NASA and Microsoft aimed to help with astronaut duties, like repairs, experiments or space walks, using an out of this world augment reality device called the HoloLens.

ZME Science previously reported on how the HoleLens works and what’s it useful for. So, I’ll just mention that the HoloLens delivers everything that the virtual reality industry has falsely advertised for the past two decades:  immersive and interactive augmented reality. This is the real deal!

With a headset on, astronauts could see the inner workings of a telescope or instrument as if they had X-ray vision. An expert on ground who shares the same view as an astronaut could provide better and more accurate instructions. This remote sidekick could also draw or call animations visible in the astronaut’s view, superimposed on real objects or in a whole new virtual plane. Pre-HoloLens, astronauts could only rely on verbal or written instructions to carry out complicated repairs or experiments.

The HoloLens will also prove very useful during astronaut training. Cadets could immerse themselves in the ISS experience, but also that of Mars some day.

Last year  NASA tested the device on its Weightless Wonder C9 jet. The first HoloLens headsets were supposed to arrive last last year, but a SpaceX rocket tasked with delivering the cargo exploded in mid-air.

There’s not much word yet on how Kelly or other astronauts are using the device, but I have a feeling we’ll find out more soon. For the rest of us mortals, the HoloLens will supposedly cost $3,000 once it’s out publicly.

Photo of Sidekick tested in zero-g. Image: NASA

Astronauts on the ISS will soon work with holographic goggles: the HoloLens

This weekend, SpaceX is scheduled to deliver cargo and other much needed supplies to the International Space Station via its Dragon capsule. Among the supplies is a surprise for the astronauts on board: the latest high tech gadget from Microsoft, the HoloLens. If you missed ZME Science’s feature of the HoloLens, well you’re in for a treat if this is the first time you hear about it. Basically, the tech involves using holographic computing  which enables you to mix virtual reality with ..actual reality. Holograms following in your kitchen, weather reports on your coffee cup. Really, anything is possible with the HoloLens, let alone in the final frontier: space.

Photo of Sidekick tested in zero-g. Image: NASA

Photo of Sidekick tested in zero-g. Image: NASA

Microsoft’s HoloLens has been modified per NASA’s specifications under a project called “Sidekick.” As the name suggests, the virtual reality goggles and systems will help the astronauts perform better on their missions and, most importantly, improve their training.

“HoloLens and other virtual and mixed reality devices are cutting edge technologies that could help drive future exploration and provide new capabilities to the men and women conducting critical science on the International Space Station,” NASA’s Sam Scimemi said in a statement. “This new technology could also empower future explorers requiring greater autonomy on the journey to Mars.”

Sidekick works in two modes:  Remote Expert Mode and Procedure Mode. In the first mode, an expert on Earth is connected with the astronaut via Skype. The on ground specialist can guide the astronauts with procedures, draw pictures that show in the astronaut’s interface, play animations and so on. In Procedure Mode, astronauts can use holographic animations over the real-time viewing to help them get up to speed with their tasks. Scenario: an astronaut is in space tasked with repairing a satellite or telescope. The astronaut activates his Sidekick and is then shown animations or static graphics with the arrangement of the defective parts, how these work or what needs to replaced – all in real time superimposed over the real deal. This is possible with HoloLens, although not quite yet.

For now, this set of Sidekicks delivered to the ISS over the weekend will only work in Procedure Mode with limited capabilities. Just to get the astronauts familiar with the gear’s capabilities.  At another unspecified date in the future, a second set of the Sidekicks will arrive on the station to test the network functionality of the Remote Expert Mode.

That’s not all. Microsoft is working NASA on another project called “OnSight” which will use similar holographic computing technology to virtually visit Mars. Astronauts can step in the shoes, sort to speak, of a Martian rover and effectively borrow its eyes and ears. Yes, astronauts can technically visit the Red Planet without even having to set foot on it. Amazing!