Question: What is the vanishing gradient problem, and how does it affect deep neural networks?Answer: The vanishing gradient problem occurs when gradients become extremely small during backpropagation, leading to negligible weight updates in early layers. This hinders the training of deep networks, as early layers fail to learn meaningful representations. |
Save For Revision
Bookmark this item, mark it difficult, or place it in a revision set.
Log in to save bookmarks, difficult questions, and revision sets.
Is it helpful? Yes No
Most helpful rated by users:
- Explain the purpose of an activation function in a neural network.
- What is transfer learning, and how is it used in deep learning?
- What is a convolutional neural network (CNN), and how is it different from a fully connected neural network?