In a recent post, Ray Lucchesi outlined why AI is at a crossroads. The piece points to research showing that most deep learning methodologies require a vast amount of input, but still end up with very brittle solutions. Research scientist and neural network enthusiast Janelle Shane perfectly illustrates this with the example of sheep in computer vision analysis.
At its core, a neural network is simply a pattern recognition system trained off of an immense dataset. The network itself has no context or intelligence at what it is actually analyzing, other than to see how it fits into its pattern recognition schema. The network can assign a confidence metric against what it claims to have seen, but as the piece illustrates, this can become problematic.
For sheep, the neural network is easily fooled when presented with pastoral imagery. Lush green fields devoid of the creatures are associated with them because of the dataset used for training. In fact, the actual presence of sheep doesn’t automatically trigger recognition. Put a leash on a sheep and it comes a dog. Put orange coats on them in a picturesque field and they become flowers.
Perhaps the most interesting takeaway is that network is at a loss for any surreal imagery. The bizarre sight of sheep in a tree resulted in the network thinking it was a flock of birds. There doesn’t seem to be any way around this for neural networks. To train them to be particularly aware of outlier images would (I think) decrease the overall certainty for ordinary object recognition.
This proves Ray’s point from his earlier piece. Current neural network and AI research is remarkable, but limited given how they must be trained. We’re starting to see the limits of pattern recognition, whether we’re talking about sheep or other objects. As unsupervised learning continues to advance, we’ll hopefully see neural networks that need less depth in training, and return more robust results.
Janelle Shane comments:
If you’ve been on the internet today, you’ve probably interacted with a neural network. They’re a type of machine learning algorithm that’s used for everything from language translation to finance modeling. One of their specialties is image recognition. Several companies – including Google, Microsoft, IBM, and Facebook – have their own algorithms for labeling photos. But image recognition algorithms can make really bizarre mistakes.
Read more at: Do neural nets dream of electric sheep?
- AMD Plays the Long Hygon | Gestalt IT Rundown: July 11, 2018 - July 12, 2018
- AIRI: Converging FlashBlade into an AI Reference Architecture - July 12, 2018
- 2018 MacBook Pros Comes Closer to Earning Their Name - July 12, 2018
- The Path of an IT Influencer Starts with a Single Post - July 12, 2018
- Leon Adato – IT Origins - July 10, 2018
- John Welsh – IT Origins - July 5, 2018
- Covering All Your Storage Bases - June 28, 2018
- WPA3 Is Certifiable | Gestalt IT Rundown: June 27, 2018 - June 27, 2018
- IT Burnout is Inevitable – The On-Premise IT Roundtable - June 26, 2018
- Oksana Sokolovsky – IT Origins - June 21, 2018