NCA-AIIO · Question #16
What factors have led to significant breakthroughs in Deep Learning?
The correct answer is C. Advances in hardware, availability of large datasets, and improvements in training algorithms. The deep learning renaissance is widely attributed to three converging factors: (1) Hardware advances - especially GPUs (and later TPUs) that dramatically accelerated matrix operations required by neural networks; (2) Large datasets - the internet age produced massive labeled…
Question
What factors have led to significant breakthroughs in Deep Learning?
Options
- AAdvances in hardware, availability of fast internet connections, and improvements in training
- BAdvances in sensors, availability of large datasets, and improvements to the "Bag of Words"
- CAdvances in hardware, availability of large datasets, and improvements in training algorithms.
- DAdvances in smartphones, social media sites, and improvements in statistical techniques.
How the community answered
(36 responses)- A6% (2)
- B3% (1)
- C92% (33)
Explanation
The deep learning renaissance is widely attributed to three converging factors: (1) Hardware advances - especially GPUs (and later TPUs) that dramatically accelerated matrix operations required by neural networks; (2) Large datasets - the internet age produced massive labeled datasets like ImageNet that gave models enough examples to learn rich representations; and (3) Algorithmic improvements - techniques such as better activation functions (ReLU), dropout regularization, batch normalization, and improved optimizers (Adam, RMSProp) made training deep networks practical. Option A incorrectly substitutes 'fast internet connections' for large datasets. Option B references the 'Bag of Words' model, which is a classical NLP technique unrelated to deep learning breakthroughs. Option D references smartphones and social media, which are enablers of data collection but not direct technical breakthroughs.
Topics
Community Discussion
No community discussion yet for this question.