Disney has been doing lots of research within the VR, AR, and MR industry and their most up-to-date venture entails utilizing combined reality know-how on a venture known as the “Magic Bench.”
The Disney Analysis staff discovered that utilizing head mounted shows may be fairly isolating because it only immerses one user at a time. Others don’t get to experience the identical simulations and don’t get to take part within the VR experience.
So what the Disney Analysis staff is proposing is instrumenting an setting the place everybody can see and work together with the digital animations; a walk-up and play experience per say.
The staff managed to create a 3D reconstruction of a scene utilizing a mix of the depth and colour sensors on an off-the-shelf Microsoft Kinect. To do that, they drew polygons utilizing every level within the level cloud as a vertex, creating the looks of a strong mesh. The mesh is then aligned to the RGB digital camera feed of the scene from the identical Kinect. This alignment provides the mesh colour, and completes a 3D reconstructed video feed.
There are a number of issues that come up with the 3D constructed feed. First, the monocular feed creates “depth shadows” in areas the place there isn’t a direct line-of-sight to the depth sensor. Second, the depth digital camera is laterally offset from the RGB digital camera (since they can not bodily occupy the identical area) and due to this fact have barely completely different viewing angles, creating additional depth shadowing. The ensuing knowledge feed is sparse and can’t signify the entire scene. To unravel this, the Disney Analysis staff aligned the 3D depth feed with the 2D RGB feed from the Kinect. By compositing the depth feed over a 2D backdrop, the system successfully masks these depth shadows, making a seamless composite that may then be populated with 3D CG property.
This combined reality platform facilities across the easy setting of a bench. The bench works in an novel approach to constrain a number of issues, akin to figuring out the place a user is and subsequently inferring the route of the users gaze (i.e., towards the display). It creates a stage with a foreground and background, with the bench occupants within the center floor. The bench additionally acts as a controller; the combined reality experience gained’t set off till not less than one particular person is detected sitting on the bench. Additional, completely different seating formations on the bench set off completely different experiences.
Magic Bench is a customized Mushyware and customized platform, necessitating an answer to bridge each elements. Between the 2 exists a collection of patches created in Biking ’74 Max designed to transform indicators despatched from the sport engine (by way of OSC) concerning the positions and states of objects within the scene, into the haptic sensations felt on the bench. Haptic actuators are dynamically pushed primarily based on the placement of animated content material. e driving waveform for every actuator is designed in keeping with the specified really feel — within the present setup they can tweak base frequency, frequency of modulation, basic amplitude, amplitude envelope, and three-dimensional place
Haptic actuators are dynamically pushed primarily based on the placement of animated content material. The driving waveform for every actuator is designed in keeping with the specified really feel — within the present setup they can tweak base frequency, frequency of modulation, basic amplitude, amplitude envelope, and three-dimensional place