Nand Kishor Contributor

...

Data science is the big draw in business schools
3 days ago

7 Effective Methods for Fitting a Liner
13 days ago

3 Thoughts on Why Deep Learning Works So Well
13 days ago

3 million at risk from the rise of robots
13 days ago

15 Highest Paying Programming Languages Trending
14 days ago

Top 10 Hot Artificial Intelligence (AI) Technologies
151020 views

Want to be a millionaire before you turn 25? Study artificial intelligence or machine learning
57018 views

Here's why so many data scientists are leaving their jobs
50562 views

Google announces scholarship program to train 1.3 lakh Indian developers in emerging technologies
49866 views

2018 Data Science Interview Questions for Top Tech Companies
44724 views

Convolutional Neural Networks Deep Learning Deep Neural Network Neural Networks Quora Yann LeCun

3 Thoughts on Why Deep Learning Works So Well

Apr 11, 2018 | 1743 Views

While answering a posed question in his recent Quora Session, Yann LeCun also shared 3 high-level thoughts on why deep learning works so well.

Last week, deep learning research leader Yann LeCun took part in a Quora Session, during which he answered questions from community members on a wide variety of (mostly machine/deep learning) topics.

During the session, this question was posed:

When will we see a theoretical background and mathematical foundation for deep learning?

The answer turned into a very eloquent overview of three particular thoughts on why deep learning works so well. Here is a quick overview.

LeCun's first point of explanation, which maps to a good reason why deep learning works so well, is as follows:

One theoretical puzzle is why the type of non-convex optimization that needs to be done when training deep neural nets seems to work reliably.

The main idea here is that local minima do not arise in very high dimensional space, so greedy-search gradient optimization is not trapped in a "box." As LeCun states:

Itâ??s hard to build a box in 100 million dimensions.

Moving on, LeCun introduces his next point as:

Another interesting theoretical question is why multiple layers help.

The point here, beyond LeCun stating that there is not a complete understanding as to why, is that multiple layers help to implement complex functions more concisely. While he points out that computer scientists are accustomed to the idea of sequential steps and multiple layers of computation, this doesn't quite cover the reasons why multiple layers in deep neural networks work as they do.

For his last point, he turns to a specific neural network architecture.

A third interesting question is why ConvNets work so well.

Interesting question indeed. This article gets cited as reading for why ConvNet architectures are right for analyzing certain types of signals, touching on the fact that ConvNets actually work very well for some type of signals, like spatial. Sorting out why is this is so is one thing, but noting that it is true places squarely into perspective just how well ConvNets work when they do.

While Yann LeCun was answering the question posed to him on when we could expect a mathematical foundation for deep leaning to emerge, in doing so he provided valuable insight into why deep learning functions as well as it does.

Read the rest of his Quora Session here.

Source: HOB
Nand Kishor Contributor

...

Full Bio 

Data science is the big draw in business schools
3 days ago

7 Effective Methods for Fitting a Liner
13 days ago

3 Thoughts on Why Deep Learning Works So Well
13 days ago

3 million at risk from the rise of robots
13 days ago

15 Highest Paying Programming Languages Trending
14 days ago

Top 10 Hot Artificial Intelligence (AI) Technologies
151020 views

Want to be a millionaire before you turn 25? Study artificial intelligence or machine learning
57018 views

Here's why so many data scientists are leaving their jobs
50562 views

Google announces scholarship program to train 1.3 lakh Indian developers in emerging technologies
49866 views

2018 Data Science Interview Questions for Top Tech Companies
44724 views

Convolutional Neural Networks Deep Learning Deep Neural Network Neural Networks Quora Yann LeCun
Previous Story Next Story