This project is a Gesture Calculator that uses AI and Computer Vision to recognize hand gestures and solve mathematical problems in real time. The system captures hand movements through a webcam, interprets gestures as mathematical inputs, and computes results using AI.
- Hand Gesture Recognition: Detects hand gestures to input mathematical symbols and equations.
- Real-time Calculation: Processes and solves math problems in real-time based on gestures.
- AI-Powered: Uses Google’s Generative AI to handle math problem solving.
- Web-based Interface: Built with Streamlit for an interactive experience.
Deployed App => https://huggingface.co/spaces/sandipan23/NeuraCalc
- Hand Detection: Using OpenCV and cvzone, the system tracks hand movements through the webcam.
- Gesture Recognition: Specific gestures represent mathematical inputs (e.g., numbers, operators).
- AI Computation: When the gesture input is complete, it is sent to Google Generative AI for solving.
- Real-time Output: The solution is displayed instantly.
- Python
- OpenCV for computer vision tasks
- cvzone for hand tracking
- Google Generative AI (gemini-1.5-flash)
- Streamlit for the web interface
- Pillow for image processing
Before running the project, ensure the following dependencies are installed:
- Python 3.8+
- OpenCV
- cvzone
- google-generativeai
- Streamlit
- Pillow
-
Clone the Repository:
git clone https://github.com/sandipanrakshit34/Guestures-Calculator-using-AI-and-Computer-vision.git cd gesture-calculator -
Install Dependencies:
pip install -r requirements.txt
-
Run the Application:
streamlit run app.py
-
Webcam Setup: Ensure your webcam is properly connected and working to capture hand gestures.