The PC desktop of the future might leap from the 2 dimensions of old-- MIT graduate Jinha Lee presents the SpaceTop at the 2013 TED conference, a 3D desktop environment where users "reach inside" the computer.
First developed at Microsoft Applied Science, the SpaceTop desktop unites 2D touch-based UIs, gesture-based control systems (such as Leap Motion or Kinect devices) and 3D visuals with the combination of transparent LED display, keyboard and a pair of cameras.
Users place their hands behind the transparent display, which acts as a "box" one manipulates the UI in. One camera tracks hand gestures in 3 dimensions (allowing users to grasp and flick through objects on the display) while the other camera tracks eye position to maintain the illusory 3D environment on the display.
SpaceTop demos shows different interactions, including one where one hand scrolling through a document before the other reaches up and flips through a pile of folders and another where a 3D model is created with free-form manipulation.