The Feed-Forward Network

The feed-forward network (FFN) is the position-wise two-layer MLP — a linear layer up, a ReLU (or GELU), a linear layer back down — that every transformer…

This lesson is part of BitBootcamp Pro. Unlock it with Pro, or browse the free courses.