VICE Motherboard interview: http://motherboard.vice.com/learn/berlins-preeminent-vr-artists-explain-why-augmenting-reality-matters
Intel weblog publish: https://software.intel.com/de-de/blogs/2015/06/19/see-the-world-like-a-terminator-t-800-augmented-reality-with-oculus-rift

The problem

The hardware hacking staff from TNG Expertise Consulting GmbH (http://tngtech.com/) began to work on a device which is succesful to do full subject of view augmented reality in March 2015 when the corporate’s winter retreat was happening.

The cell “TNG Augmented Rift” is a full subject of view Augmented Reality device succesful to do e.g. face monitoring, face identification, emotion detection, coronary heart charge detection, distance measurements, and so forth. Speech recognition for command and management is applied as nicely.

The purpose

The purpose was to constructed a device made with off-the-shelf hardware in a single working day. Inside this brief time period eleven TNG software consultants have been in a position to implement a prototype which is predicated on an Oculus Rift DK2 and an Intel RealSense F200 3D-camera.

With some further days and a core staff of about six TNG software builders we have been in a position so as to add some extra options for the Augmented Rift.

The options

The TNG Augmented Rift has the next options:

– See by means of” Augmented Reality head mounted display with Oculus Rift DK2 (in contradiction to the HoloLense the entire subject of view is augmented)
– You may see a whole lot of actual time components contained in the Augmented Rift in 3D

The next seen components are supported:

– Actual setting combined with augmented info and 3D objects
– Face detection components
– Face monitoring info
– Face landmarks
– Feelings
– Coronary heart charge as textual content
(in progress) Coronary heart charge as a graph (“Electrocardiography mode”)
– Speech recognition for command and management (“Okay Rift, this is Martin.” – “Is this really Martin?” – “Yes!” – “From now on I will remember that user 100 is Martin.”)
– “Terminator mode” (world augmented with red-shaded textures)

The setup

We’d like two cameras to report the true world setting. The video streams of the 2 cameras are merged to a stereo (3D) seize. The webcam processor itself consists of various elements.

We use the OpenCV library to do lengthy distance measuring and face recognition of individuals which aren’t within the nearer distance.

The Augmented Rift consists of two cameras for recording the true world. The knowledge will get streamed into the Oculus Rift DK2. The Intel RealSense F200 is used so as to add options like face monitoring, face identification, pulse detection and far more.

The Augmented Rift consists of two cameras for recording the true world. The knowledge will get streamed into the Oculus Rift DK2. The Intel RealSense F200 is used so as to add options like face monitoring, face identification, pulse detection and far more.

The Intel RealSense detector makes use of an F200 3D digicam that can be utilized for realizing the options talked about above (close to subject face monitoring, face identification, face landmark detection and monitoring, emotion detection a.s.o.). All of the Augmented Reality components we collect are added to our stereo webcam seize to counterpoint the true world setting seize with helpful info.

Wait however why?

After all this device primarily based on an Oculus Rift DK2 is slightly bit awkward. However think about what would occur if the computer systems and cameras used are getting smaller and smaller inside the subsequent few years? It doesn’t want a Oculus Rift DK2 to comprehend such tasks. What we want is glasses with an built-in full subject of view clear display to counterpoint the world with Augmented Reality components in a progressive method.

These days devices are only augmenting a small fraction of the sphere of view of the user (see Epson BT200 or Microsoft Hololens). You’ll want to concentrate on a particular course to see Augmented Reality components on the display. With the Augmented Rift this isn’t drawback however the device is big. If there can be glasses with clear shows available we may switch our resolution to those new devices.


Within the entrance view of the Augmented Rift you possibly can see two internet cameras for streaming a stereo seize picture into the Augmented Rift. This might not be obligatory when utilizing regular glasses with clear shows contained in the glasses and an R200 digicam.

Within the entrance view of the Augmented Rift you possibly can see two internet cameras for streaming a stereo seize picture into the Augmented Rift. This might not be obligatory when utilizing regular glasses with clear shows contained in the glasses and an R200 digicam.

The talks and demonstrations

The Augmented Rift was offered on the Augmented World Expo in Santa Clara, California, USA on the Intel sales space from the eighth to the 10th of June 2015. On the 12th of June we held a chat on the Huge Techday in Munich with greater than 100 builders. After the speak a whole lot of individuals needed to attempt the Augmented Rift with its Terminator mode on their very own!

Hasta la vista!

< source > worth a visit
< /source >

Leave a Reply