hackquest logo

Gestura

GESTURA: A non-ML based gesture detection approach.

Videos

Description

Gestura is an innovative multi-platform solution that brings seamless gesture-based interaction to web, mobile, and desktop environments. Powered by a robust FastAPI backend, Gestura enables intuitive hands-free control.

THE BEST FEATURE ABOUT GESTURA, IS THAT IT IS A NON-ML BASED PROJECT. It uses simple logic, observation and optimization of code to predict the gestures.

 

The mobile and web clients integrate TTS (Text-to-Speech), STT (Speech-to-Text), and NLP (Natural Language Processing) for real-time sign prediction, allowing users to communicate effortlessly through gestures. On the desktop, Gestura offers a complete hands-free experience, enabling users to perform self-defined commands like opening Chrome, playing/pausing videos, and more using gestures.

Designed for accessibility, convenience, and efficiency, Gestura transforms the way users interact with technology by eliminated for traditional input methods.

 

Progress During Hackathon

Creating a non-ML script. Web frontend Android frontend Desktop integration

Tech Stack

flutter
Python
fastapi
Mediapipe
HTML
CSS
Spring
Javascript

Fundraising Status

Accepting Funds