Transformer-Evolution-Paper

⌘Ctrlk

Transformer-Evolution-Paper

README
数学符号
Act
- A survey on recently proposed activation functions for Deep Learning
Arch
FFN
Head
Memory
MHA
Normalize_And_Residual
Pe
Pretrain
Softmax
Others
LongConv
Rnn
CrossAttention
Inference
Peft
LLM

Powered by GitBook

On this page

Act

A survey on recently proposed activation functions for Deep Learning

Previous数学符号 NextA survey on recently proposed activation functions for Deep Learning

Last updated 2 years ago