Research

Ongoing research projects and notes that evolve over time. Unlike blog posts, these get edited and extended as I learn more.

Recently updated

Bayesian Data Analysis Statistics1st November 2026
Bioinformatics Biology1st November 2026
Byte Pair Encoding AI / Tokenisation1st November 2026
Causal Attention AI / Attention1st November 2026
Chain Rule Maths1st November 2026

AI16 notes
- Attention3 notes
  - Causal Attention1st November 2026
  - Flash Attention27th January 2026
  - Self Attention1st November 2026
- Long Context6 notes
  - Big Bird26th January 2026
  - How transformer-based language models got longer context windows2nd February 2026
  - Linformer26th January 2026
  - Longformer26th January 2026
  - Performer26th January 2026
  - Reformer26th January 2026
- Tokenisation3 notes
  - Byte Pair Encoding1st November 2026
  - SentencePiece1st November 2026
  - Tokenisation Overview1st November 2026
- Architecture vs Computing Power26th October 2026
- Audio3rd October 2026
- Embeddings1st November 2026
- What is a CUDA kernel?27th January 2026
Biology1 note
- Bioinformatics1st November 2026
Economics1 note
- Microeconomics for Managers: Chapter 21st November 2026
Machine Learning12 notes
- Decision Optimisation4 notes
  - Continuous Outcomes1st November 2026
  - Drift1st November 2026
  - Dynamic Decisions1st November 2026
  - Profit Curves1st November 2026
- Interpretability3 notes
  - Feature Importance1st November 2026
  - Partial Dependence and ALE1st November 2026
  - Population Stability Index1st November 2026
- Classification Metrics1st November 2026
- Gain, Lift and Deciles1st November 2026
- Gradient Descent1st November 2026
- Imbalanced Data1st November 2026
- Random Forests1st November 2026
Maths6 notes
- Chain Rule1st November 2026
- Partial Derivatives1st November 2026
- Product Rule1st November 2026
- Quotient Rule1st November 2026
- Solving Second Degree Equations1st November 2026
- The Trapezium Rule1st November 2026
Statistics6 notes
- Bayesian Data Analysis1st November 2026
- Descriptive Statistics1st November 2026
- Hypothesis Testing1st November 2026
- Linear Regression1st November 2026
- Logistic Regression1st November 2026
- Probability1st November 2026
Tools7 notes
- Geospatial2 notes
  - GeoPandas and Projections1st November 2026
  - Joins and Proximity1st November 2026
- Image Processing1st November 2026
- Matplotlib1st November 2026
- Programming Cheatsheet1st November 2026
- PyTorch1st November 2026
- Scrapy1st November 2026
Reading List1st November 2026