I built a prototype app called StickAR for Quest. It lets you clip specific regions from the passthrough view using the HMD camera. Even if the content is captured at an angle, it's automatically corrected to appear front-facing, significantly improving readability.
This perspective correction not only makes the content easier to read, but also improves the accuracy of text extraction using OCR or AI-based recognition.
Right now, the clipped area is simply displayed as a floating image in space. But the ultimate goal is to make quick note-taking in AR/VR easy and seamless—no need for a clunky virtual keyboard.
As noted earlier, combining this with text recognition could enable converting clipped content into actual text, opening up more flexible ways to use and manage information.
#AR #VR #Quest3 #augmentedreality #mixedreality #virtualreality
