LightAnchors: Appropriating point lights for spatially anchored user interfaces in augmented reality [main page]

Augmented reality requires precise and instant overlay of digital information onto everyday objects. We present our work on LightAnchors, a new method for displaying spatially-anchored data. We take advantage of pervasive point lights โ€“ such as LEDs and light bulbs โ€“ for both in-view anchoring and data transmission. These lights are blinked at high speed to encode data. We built a proof-of-concept application that runs on iOS without any hardware or software modifications. We also ran a study to characterize the performance of LightAnchors and built eleven example demos to highlight the potential of our approach. Visit lightanchors.org for more information and to build your own lightanchors!

X-Ray: Screenshot Accessibility via embedded metadata [main page]

๐Ÿ† Won Best Artifact Award at ASSETS 2019!

Screenshots are frequently shared on social media, via personal communications, and in academic papers. Unfortunately, existing screenshot tools strip away semantics useful for making the content accessible, leaving only pixels. For example, a screenshot of a table removes the structural information useful for conveying it. Using the X-Ray screenshot tool, semantic information is captured and stored in the Exif data of the resulting image, allowing it to โ€œtag alongโ€ as the image is shared and reposted.

[Paper] [Code] [APK download]

FREAD (Feature Reading Accessibility Device) [main page]

A wearable system that enables persons with visual impairments to identify everyday objects. The system was designed to correct many issues with smartphone apps including difficulty in framing and focusing. A system of intuitive natural gestures and voice enabled control enables the device to disappear into the background of the user.

[Paper] [Main page]

3D printed facial prosthetics [main page]

Point Cloud acquired Interactive region selection
A 3D point cloud of someone's face, one eye is supposed to be damaged. Due to privacy concerns I put up a scan of myself User interactively selecting damaged region to fill and the other intact eye
Assisted CAD file generation 3D printed output
A CAD model of an eye prosthetic Final 3D printed prosthetics. They are colored white due to time constraints.

Lowering the cost of facial prosthetics by using 3D scanning and printing. I used symmetry detection algorithms to assist prosthetic design staff in the process. This was a proof of concept that I did as an intern at the Srujana Center for Innovation, LV Prasad Eye Institute.

Electro Muscle Stimulation Ping Pong game [main page]

This was my submission to the student innovation contest at UIST, 2016

๐Ÿ† Won Runner up for best implementation!

User with EMS brace equipped and holding a paddle

This is a game of Ping Pong with a fun twist. Players wear a brace on their arms which is equipped with Electromuscle Stimulation Pads. Using an Android phone, opponents can throw special attacks at strategic times.

[Code][Main page]