☰
Notes
🔍
×
Statistics
Supervised Learning
Unsupervised Learning
Deep Learning
▼
Neural Network Basics
17
Neurons & Connections
5
Layers & Network Topology
8
Capacity & Theoretical Foundation
4
▼
Activation Functions
15
Saturating
4
ReLU Family
7
Smooth Modern Variants
3
Weight Initialization
7
Backpropagation
8
▼
Optimizers
23
Training Loop & Batching
5
Adaptive Optimizers
10
Learning-Rate Schedules
4
Gradient Handling & Precision
4
▼
Regularization & Normalization
13
Regularization & Sparsity
6
Normalization Layers
4
Data Augmentation
3
▼
Convolutional Networks
17
Convolution Concepts
8
Convolution Variants
5
Pooling
4
Recurrent Networks (RNN/LSTM)
14
▼
Transformer (Foundations)
19
Attention Mechanics
11
Architecture Blocks
6
Generation Modes
2
AI ML
>
Deep Learning
>
Activation Functions
>
Smooth Modern Varian…
Overview
◀
Map
Tree
Terms
Read
▶
Resources
Quiz
Play
Smooth Modern Variants
3
terms
Terms in this group
GELU
Swish
Mish
Term
Open full page
↗
Loading...