# FFN

- [Large Memory Layers with Product Keys](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/001.md)
- [Transformer Feed-Forward Layers Are Key-Value Memories](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/002.md)
- [GLU Variants Improve Transformer](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/003.md)
- [Simple Recurrence Improves Masked Language Models](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/004.md)
- [Pay Attention to MLPs](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/005.md)
- [S2-MLP Spatial-Shift MLP Architecture for Vision](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/006.md)
- [S2-MLPv2 Improved Spatial-Shift MLP Architecture for Vision](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/007.md)
- [HyperMixer An MLP-based Green AI Alternative to Transformers](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/008.md)
- [DeFINE: DEep Factorized INput Token Embeddings for Neural Sequence Modeling & DeLighT: Deep and Light-weight Transformer](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/009.md)
- [When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/010.md)
- [Sparse MLP for Image Recognition: Is Self-Attention Really Necessary?](https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn/011.md)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://doraemonzzz.gitbook.io/transformer_evolution_paper/ffn.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.