This project is an advanced virtual calculator that leverages hand gesture recognition using MediaPipe and a user-friendly interface built with Streamlit. Additionally, it integrates with Google Generative AI to provide content analysis for user inputs, enhancing its functionality beyond basic calculations.
- Draw: Raise the index finger to start drawing.
- Reset Origin: Raise both index and middle fingers to reset the drawing point.
- Clear Canvas: Show an open palm to clear everything.
- Submit Drawing: Give a thumbs-up to analyze the equation.
- Pick the favorite line color.
- Adjust the line thickness for precision.
- Change the background color to suit user style.
Once user submit his drawing, the app uses Google Generative AI to:
- Identify the mathematical equation user drew.
- Solve the equation.
- Explain the solution step by step.
- User's drawing is overlaid directly on the live webcam feed, making the experience seamless and real-time.
- MediaPipe: For real-time hand detection and gesture recognition.
- Streamlit: To build the web interface.
- OpenCV: For processing webcam feeds and drawing on the canvas.
- Google Generative AI: For analyzing and generating content.