Apple Vision – Apple has been granted a patent for an Apple Pencil-like stylus that could detect virtual surface roughness and other features and relay them back to users through haptic feedback—an accessory aimed at making XR experiences more immersive.
A user holds a stylus in their hand, but what they feel isn’t real wood or paper. It’s the surface of something virtual—rough, smooth, or somewhere in between. Apple’s latest patent imagines that kind of tactile illusion as a natural extension of Apple Vision Pro. using a pencil-like accessory to translate “surface roughness and other surface features” into haptic sensations.
The idea is granted under a “Surface texture detection and emulation” patent. Apple describes the stylus relaying “surface roughness and other surface features. as well as motion data (e.g. trajectory and velocity) of the hand-held device” into virtual reality. The closest real-world analogy is an old children’s toy where one pencil is linked to another. so drawing with the first moves the second—but here. the link isn’t about copying the sketch. It’s about conveying what a surface would feel like, and how the user’s hand moves.
Apple says the pencil system is more than a narrow concept. The technology is “explicitly” tied to a pencil-like device, but the patent is presented as applicable to any handheld device. Whatever shape it ultimately takes. Apple positions it as an accessory for Apple Vision Pro intended to deliver “increased immersion during XR [Extended Reality] sessions.” That means two directions of travel: detecting the texture of a virtual object. and conveying that texture back to the person wearing the headset.
The patent lays out multiple possible mechanisms for doing this. One involves a gyroscope that could “alter the feeling of a surface depending on the roll angle of the device.” Another path is haptic feedback that can “create. emulate. or cancel an experience such as friction. texture. or roughness on a surface by applying forces. vibrations. or motions to the user of the device.”.
Apple’s diagrams—spanning almost 12. 000 words across nine pages of drawings—also describe hardware components that could make the sensation more physical. They include linear actuator components that could “extend or contract a portion of the device.” The drawings also reference an inertial measurement unit and color sensors. In one shown configuration, the stylus tip features a camera and interferometers; in another, it’s described with surface sensors.
This isn’t the first time Apple has thought about a Pencil that can detect texture. Earlier patent filings were centered on real-world applications, including color-detection alongside texture. In this new one. the emphasis appears to shift away from measurement for the physical world and toward creating something closer to believable touch inside virtual reality.
That goal also matters because the method—feeding feedback through a stylus the user holds—may be less cumbersome than other Apple accessory concepts aimed at sensation, like Apple Gloves.
The patent is credited to five inventors, including Nicholas C. Soldner. His prior work for Apple includes multiple annual patent applications regarding ultrasonic sensors, as well as respiration detection in Apple Vision Pro.
Even so, a granted patent is not a promise of a product. Apple can file patents to protect parts of long-running research. and patents can also be used to establish prior art in case of future litigation. Still, the filing signals attention and investment. It’s another indication that—contrary to rumors—Apple is continuing to pursue its Apple Vision Pro and visionOS plans.
Apple Vision Pro apple pencil haptic feedback extended reality XR texture detection surface emulation patent Nicholas C. Soldner visionOS
So basically it’s a pencil that lies to your hand? lol
I saw “texture-detecting” and assumed it was like real-time scanning of your desk or something. But it’s just making the headset feel rough? Kinda cool I guess, but also confusing.
Patents are always weird. If it already has motion data and haptics, why not just use the normal controllers? Feels like they’ll charge extra for the “pencil” and then it won’t even feel that different from regular vibrations.
This sounds like those old toys where one pencil makes another move, except it’s like… magic sandpaper in your head. I don’t get how they detect “virtual roughness” though, like where is the texture coming from? Also who’s drawing with a headset on, I can barely keep my phone charged, let alone a whole setup.