Skip to content

SanditZZ/freak-detector

Β 
Β 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

11 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Freak Detector β€” Real-Time Gesture-Controlled Meme Player

Freak Detector is a real-time computer-vision system that detects facial + hand gestures and instantly plays a meme (GIF / video / image) based on your reaction.

Powered by MediaPipe, OpenCV, and Python, this project tracks your face and hands live through your webcam and responds with the perfect meme.

Features

Face Gestures

Gesture Description Meme
πŸ˜› Tongue out + head shake Shake head sideways while sticking tongue out freaky-orca.gif
🟒 Head nod Quick up-down movement ishowspeed.gif
😐 Idle stare Looking straight at the camera, no movement monkeytruth.jpg

Hand Gestures

Gesture Description Meme
🀲 Rubbing palms together Hands close, moving back and forth freaky-sonic.mp4
😩 Both hands on head β€œOh no” reaction ishowspeed-wow.gif
☝️ One finger up Index finger raised monkeyrealize.jpeg
πŸ€” Hand on chin Thinking pose monkeythink.jpg
πŸ‘ Thumbs up Positive gesture thumbsupmonkey.png

How It Works

The system uses: MediaPipe FaceMesh

  • Tracks 468 facial landmarks
  • Detects mouth/tongue, head motions, eye direction, and idle behavior

MediaPipe Hands

  • Tracks 21 landmarks per hand
  • Detects gestures like:
    • rubbing palms (oscillation tracking)
    • one-finger-up
    • hands on head
    • thumbs up
    • hand on chin proximity
    • hand convergence (two-hand gestures)

OpenCV

  • Webcam capture
  • Frame rendering
  • GIF/image/video playback side-by-side with webcam

Custom Gesture Engine

  • Gesture cooldown
  • Sustained detection
  • Priority system (so only the correct meme plays)

Output Display

The screen is split into two parts:

+---------------------------+---------------------------+
|         Webcam            |       Meme/GIF/Video      |
+---------------------------+---------------------------+

Whenever a gesture is detected, the right side updates instantly.

Project Structure

/freak-detector
│── freakdetector.py
│── /memes
β”‚     β”œβ”€β”€ freaky-orca.gif
β”‚     β”œβ”€β”€ freaky-sonic.mp4
β”‚     β”œβ”€β”€ ishowspeed.gif
β”‚     β”œβ”€β”€ ishowSpeed-wow.gif
β”‚     β”œβ”€β”€ monkeyrealize.jpeg
β”‚     β”œβ”€β”€ monkeythink.jpg
β”‚     β”œβ”€β”€ monkeytruth.jpg
β”‚     β”œβ”€β”€ thumbsupmonkey.png

Installation

1️⃣ Clone the repository

git clone https://github.com/your-username/freak-detector.git
cd freak-detector

2️⃣ Install Python dependencies

pip install opencv-python mediapipe pillow numpy

(You may need pip install opencv-contrib-python if using older OpenCV).


▢️ Running the Program

python freakdetector.py

Make sure your webcam is enabled.

The right side of the window will change whenever a gesture is detected.

Customization

You can easily:

βœ” Add new gestures βœ” Replace memes in the /memes/ folder βœ” Adjust gesture sensitivity βœ” Change cooldown times βœ” Add speech or audio reactions

Just edit the gesture detector functions or the filepath constants.

Requirements

  • Python 3.10+
  • OpenCV
  • MediaPipe
  • Pillow
  • Webcam (720p recommended)

Contributing

Pull requests are welcome!

If you'd like to add:

  • More gesture types
  • Meme packs
  • A GUI
  • Multi-person support

Feel free to fork and contribute.

License

This project is open-source under the MIT License.

Have Fun Freaking Out!

This project reacts to your emotions in real-time β€” let the memes fly

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 100.0%