Apple VR headsets can use your fingers as 3D controllers – here’s how

Speculation about Apple VR and mixed-reality headphones continues to grow. The latest discovery provides more evidence that headphones will skip controllers in favor of tracking the body (and fingers).

This is detailed in a new patent discovered by Apple Patently. In it, we see how Apple VR headsets use external cameras and sensors to generate 3D models of the user’s fingertips to feel when they interact with real objects.