The Wekinator is free, open source software originally created in 2009 by Rebecca Fiebrink. It allows anyone to use machine learning to build new musical instruments, gestural game controllers, computer vision or computer listening systems, and more.
The Wekinator allows users to build new interactive systems by demonstrating human actions and computer responses, instead of writing programming code.
Example applications include:
- Creation of new musical instruments
- Create mappings between gesture and computer sounds. Control a drum machine using your webcam! Play Ableton using a Kinect!
- Creation of gesturally-controlled animations and games
- Control interactive visual environments created in Processing, OpenFrameworks, or Quartz Composer, or game engines like Unity, using gestures sensed from webcam, Kinect, Arduino, etc.
- Creation of systems for gesture analysis and feedback
- Build classifiers to detect which gesture a user is performing. Use the identified gesture to control the computer or to inform the user how he’s doing.
- Creation of real-time music information retrieval and audio analysis systems
- Detect instrument, genre, pitch, rhythm, etc. of audio coming into the mic, and use this to control computer audio, visuals, etc.
- Creation of other interactive systems in which the computer responds in real-time to some action performed by a human user (or users)