Apple is going to push the limits of “interactivity” and planning to go 3D. Using a camera to detect a user's position and overlay it onto an any on-screen object, giving the impression of a "reflection" and creating a more immerse experience. Apple's latest technology would address that through the use of a camera or appropriate "sensing mechanism."
Apple is filing a patent on this innovation. The technology is capable of defining the visual properties of different types of surfaces and decide on how well it would reflect light. Using this, images of the user and their environment could be recreated on the screen with effects added. "Using the detected position of the user, the electronic device may use any suitable approach to transform the perspective of three-dimensional objects displayed on the display," the application reads. "For example, the electronic device may use a parallax transform by which three-dimensional objects displayed on the screen may be modified to give the user the impression of viewing the object from a different perspective."
"To further enhance the user's experience, the detected environment may be reflected differently along curved surfaces of a displayed object (e.g. as if the user were actually moving around the displayed object and seeing his reflection based on his position and the portion of the object reflecting the image."
It's a kind of a virtual reality, crossing over the real world with a digitally created one, but giving the visual perception that an object is real.
This provide game developers new ways to use their imagination to come up with new games that cross the two worlds. It is a direct challenge to Wii. Nintendo has a lot to worry about. Gaming will go 3D very soon. The Blu-ray Disc Association released its finalized 3D specifications. 3D playback will be "display agnostic," meaning that the format will be compatible across "any compatible 3D display." What exactly a "compatible 3D display" is still an unknown, but I believe we need to get a new TV to watch 3D. PS3 is probably ahead in the game.