SignSpeakHand Gesture Tracker
Real-time hand gesture recognition with browser-based AI feedback. Practice guided gestures, track your confidence, and study your progress — no install, no upload.
Guided practice, one gesture at a time
Each session sets a target confidence and rep goal. Complete reps by holding the gesture above the target threshold.
Open palm wave — a friendly greeting gesture.
Hands together at chest — an expression of gratitude.
Raised open hand — a request for assistance.
Thumbs up — an affirmative response.
Thumbs down — a negative response.
Cupped hands — a polite request.
Every practice, logged
Sessions stream from localStorage today — the API shape mirrors a Node.js backend for a drop-in swap later.
How SignSpeak is built
A portfolio breakdown of the architecture, honest about scope: this is a gesture recognition & practice tracker, not a full ASL translator.
Uses the browser MediaDevices API to stream a live camera feed with graceful permission handling.
Client-side model loading with automatic fallback to a realistic demo predictor when no model is present.
Reusable, strictly-typed primitives — CameraPanel, PredictionCard, ConfidenceMeter, ProgressStats, and more.
Deterministic React state for reps, confidence, timer, and completion feedback — with celebration UX.
Persists locally via a service layer that hides the storage backend from consumers.
sessionService is shaped after REST endpoints (GET/POST /api/sessions, GET/PUT /api/progress) for a drop-in swap.
Rebuilt a hand gesture recognition app with real-time browser camera input, prediction feedback, confidence scoring, guided practice sessions, session history, and user progress tracking.