Transformer-Evolution-Paper
Ctrlk
  • README
  • 数学符号
  • Act
  • Arch
  • FFN
  • Head
  • Memory
  • MHA
  • Normalize_And_Residual
  • Pe
  • Pretrain
  • Softmax
    • Transformer with a Mixture of Gaussian Keys
    • Normalized Attention Without Probability Cage
  • Others
  • LongConv
  • Rnn
  • CrossAttention
  • Inference
  • Peft
  • LLM
Powered by GitBook
On this page

Softmax

Transformer with a Mixture of Gaussian KeysNormalized Attention Without Probability Cage
PreviousCramming: Training a Language Model on a Single GPU in One DayNextTransformer with a Mixture of Gaussian Keys

Last updated 3 years ago