BanglaTextAI
BanglaTextAI BanglaTextAI is an innovative web application that breaks language barriers by providing real-time English-Bengali translation coupled with facial emotion detection.
视频
描述
BanglaTextAI - Breaking Language Barriers with Emotional Intelligence
Inspiration
In our increasingly connected world, language barriers still prevent meaningful communication between English and Bengali speakers. We wanted to create a solution that not only translates text but also understands the emotional context of face-to-face interactions.
What it does:
BanglaTextAI is a dual-purpose application that combines:
1. Real-time bidirectional English-Bengali translation
2. Live facial emotion detection using machine learning
How we built it:
- Frontend: React.js with an intuitive, animated UI
- Backend: Flask server handling translation and ML inference
- ML Model: Custom CNN trained on FER2013 dataset (80.43% validation accuracy)
- Translation: Google Translate API integration
- Face Detection: OpenCV with Haar Cascade Classifier
Technical Features
- Bidirectional text translation
- Real-time emotion detection through webcam
- Interactive UI with smooth animations
- Robust error handling and fallback mechanisms
Challenges we overcame
- Implementing reliable face detection in various lighting conditions
- Ensuring accurate Bengali character rendering
- Optimizing ML model for real-time performance
- Creating seamless integration between React and Flask
Accomplishments
- Achieved 80.43% accuracy in emotion detection
- Created a responsive and intuitive user interface
- Successfully integrated multiple complex technologies
- Built a practical solution for real-world communication challenges
What we learned
- ML model deployment in production
- Real-time video processing
- Cross-language text processing
- Full-stack application architecture
What's next
- Offline translation support
- Mobile app development
- Multi-language expansion
- Enhanced emotion detection accuracy
- Real-time voice input
Built With
- React.js
- Flask
- TensorFlow
- OpenCV
- Google Translate API
Team: Script Kiddos
本次黑客松进展
BanglaTextAI Hackathon Progress: Day 1 - Set up React frontend architecture - Implemented basic UI components - Established Flask backend server - Integrated Google Translate API | Day 2 - Added real-time translation functionality - Implemented webcam integration - Set up emotion detection model - Created bidirectional translation toggle | Day 3 - Enhanced UI with animations - Improved error handling - Added real-time emotion detection - Optimized performance and reliability - Final testing and documentation Challenges Overcome - Real-time face detection in various lighting conditions - Seamless integration between React and Flask - Accurate Bengali character rendering - Optimizing ML model for performance