StickAR (Demo ver.)

StickAR: An AR Sticky Note App StickAR is an application that captures handwritten notes or real-world text using the camera and converts them into digital text. When using XR glasses, I find it inconvenient to rely on virtual keyboards even for quick text input, so I started prototyping this app to explore a better solution. The app captures a specified region from the Quest 3’s passthrough view. Since using images taken from an angle reduces text-recognition accuracy, StickAR first transforms the captured image so that it appears front-facing. That processed image is then sent to an AI model to extract text. To make placing scan areas easier, I implemented a method that calculates the intersection between the controller’s ray and the depth information obtained from the Quest. Captured text can be shared with others through a virtual web browser inside the app. I also integrated Spatial Anchors to remember the positions of the web browser and scan areas, allowing users to resume work in the exact same layout the next time the app is launched. The app is now demo-ready, so if you’re interested, I can share the APK (you’ll need to have your Quest prepared to install APKs). #augmentedreality #mixedreality #virtualreality #metaquest3 #googlecloud