Can a neural network learn to recognize doodling? Quick, Draw
Quick, Draw! is an online game developed by Google that challenges players to draw a picture of an object or idea and then uses a neural network artificial intelligence to guess what the drawings represent. The AI learns from each drawing, increasing its ability to guess correctly in the future.The game is similar to Pictionary in that the player only has a limited time to draw (20 seconds).The concepts that it guesses can be simple, like 'foot', or more complicated, like 'animal migration'. This game is one of many simple games created by Google that are AI based as part of a project known as 'A.I. Experiments'. Quick, Draw
Follow the documentation here to get the dataset. I got .npy files from google cloud for 4 drawings for the CNN part of the network and .ndjson files of the same drawings for the LSTM part.
- Alarm Clock: ⏰
- Cloud: 🌧️
- Book: 📚
- Campfire: 🔥
As of now, the LSTM starts predicting the drawing after it has recorded 100 points of the drawing. This can be optimised to provide padded input to the LSTM network and give predictions once the prediction confidence crosses a certain threshold.