Vaibhaw Mishra

Open sourceAssistive web technology

SLDP

Real-time, in-browser sign-language detection from a webcam feed, translated into English words. B.Tech capstone.

Role
Built
When
2022
Status
Archived
Stack
  • React
  • TensorFlow.js
  • Python
  • OpenCV
SLDP, the cover screen

In short

  1. Runs in the browser with TensorFlow.js

  2. Model trained in Python with TensorFlow and OpenCV

  3. B.Tech capstone, 2022

What it is

A web application that watches a webcam feed, detects hand signs in real time and translates them into English words. It was the capstone of a B.Tech in Computer Science, built so that a sign could be read by someone who does not know the language.

How it is built

The model was trained in Python with TensorFlow and OpenCV on labelled hand images, then exported to TensorFlow.js so detection runs in the browser with no server round trip. React and Tailwind CSS carry the interface.

Screens

SLDP, screen 1 of 3
SLDP, screen 2 of 3
SLDP, screen 3 of 3