☰
Notes
🔍
×
Statistics
Supervised Learning
Unsupervised Learning
Deep Learning
▼
Neural Network Basics
17
Neurons & Connections
5
Layers & Network Topology
8
Capacity & Theoretical Foundation
4
▼
Activation Functions
15
Saturating
4
ReLU Family
7
Smooth Modern Variants
3
Weight Initialization
7
Backpropagation
8
▼
Optimizers
23
Training Loop & Batching
5
Adaptive Optimizers
10
Learning-Rate Schedules
4
Gradient Handling & Precision
4
▼
Regularization & Normalization
13
Regularization & Sparsity
6
Normalization Layers
4
Data Augmentation
3
▼
Convolutional Networks
17
Convolution Concepts
8
Convolution Variants
5
Pooling
4
Recurrent Networks (RNN/LSTM)
14
▼
Transformer (Foundations)
19
Attention Mechanics
11
Architecture Blocks
6
Generation Modes
2
AI ML
>
Deep Learning
>
Recurrent Networks (…
Overview
◀
Map
Tree
Terms
Read
▶
Resources
Quiz
Play
Recurrent Networks (RNN/LSTM)
14
terms
Terms in this group
Recurrent Neural Network (RNN)
Hidden State
Long Short-Term Memory (LSTM)
Cell State
Forget Gate
Input Gate
Output Gate
Gated Recurrent Unit (GRU)
Update Gate (GRU)
Reset Gate (GRU)
Bidirectional RNN
Stacked RNN
Truncated BPTT
Teacher Forcing
Term
Open full page
↗
Loading...