# SparseOrLowRank

- [Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/001.md)
- [Scatterbrain: Unifying Sparse and Low-rank Attention Approximation](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/002.md)
- [Sparse Factorization of Large Square Matrices](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/003.md)
- [Blockwise Self-Attention for Long Document Understanding](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/004.md)
- [H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/005.md)
- [ChunkFormer: Learning Long Time Series with Multi-stage Chunked Transformer](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/006.md)
- [Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/007.md)
- [Fast Transformers with Clustered Attention](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/008.md)
- [Long-Short Transformer: Efficient Transformers for Language and Vision](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/009.md)
- [LongT5: Efficient Text-To-Text Transformer for Long Sequences](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/010.md)
- [Luna: Linear Unified Nested Attention](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/011.md)
- [Memory-efficient Transformers via Top-k Attention](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/012.md)
- [Separable Self-attention for Mobile Vision Transformers](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/013.md)
- [Simple Local Attentions Remain Competitive for Long-Context Tasks](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/014.md)
- [You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling](https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank/015.md)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://doraemonzzz.gitbook.io/transformer_evolution_paper/mha/sparseorlowrank.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.