# Deaf Leppard

Wearable accessibility prototype combining speaker-attributed captions in AR glasses with directional haptic alerts.

Web page: /projects/hack-the-north-deaf-leppard

- From: Hack the North
- When: 2026-09
- Significance: featured
- Tags: hackathon, in-person

## Overview

I built Deaf Leppard with Sharanya Basu, Ellie Taghavi, and Aryan Gupta. We explored translating surrounding speech and sound into visual and tactile cues.

## Process

An OAK-1 camera and Jetson Orin Nano track faces and lip movement. The Beam Pro browser transcribes microphone audio with Speechmatics and associates captions with visible speakers for the XREAL One glasses. An independent Arduino sensor path drives TITAN-controlled haptic motors for coarse directional alerts.

## Role and constraints

The team worked across AR, computer vision, embedded software, and circuitry. We changed the hardware approach when microphones were unavailable and migrated from a Raspberry Pi prototype after encountering latency and camera limitations.

## Gallery

![Deaf Leppard hardware prototype at Hack the North](/assets/tab-panels/deaf-leppard.webp)

## Links

* [Devpost](https://devpost.com/software/temp-vkfiqz)
* [GitHub](https://github.com/ElyTgy/htn-2026)
* [Demo video](https://www.youtube.com/watch?v=ZaENFSr7BFY)
* [Hackathon](https://hackthenorth2026.devpost.com/)

## Menu

[Home](/index.md) · [Projects](/projects.md) · [Awards](/awards.md) · [Resume](/resume/resume.md)