Transformer-Evolution-Paper

⌘Ctrlk

Transformer-Evolution-Paper

README
数学符号
Act
Arch
FFN
Head
Memory
MHA
Normalize_And_Residual
Pe
Pretrain
Softmax
- Transformer with a Mixture of Gaussian Keys
- Normalized Attention Without Probability Cage
Others
LongConv
Rnn
CrossAttention
Inference
Peft
LLM

Powered by GitBook

On this page

Softmax

Transformer with a Mixture of Gaussian Keys Normalized Attention Without Probability Cage

PreviousCramming: Training a Language Model on a Single GPU in One Day NextTransformer with a Mixture of Gaussian Keys

Last updated 3 years ago