AI

16 notes · updated 1st November 2026

Attention3 notes
- Causal Attention1st November 2026
- Flash Attention27th January 2026
- Self Attention1st November 2026
Long Context6 notes
- Big Bird26th January 2026
- How transformer-based language models got longer context windows2nd February 2026
- Linformer26th January 2026
- Longformer26th January 2026
- Performer26th January 2026
- Reformer26th January 2026
Tokenisation3 notes
- Byte Pair Encoding1st November 2026
- SentencePiece1st November 2026
- Tokenisation Overview1st November 2026
Architecture vs Computing Power26th October 2026
Audio3rd October 2026
Embeddings1st November 2026
What is a CUDA kernel?27th January 2026