Blog

The Doob–Meyer Decomposition: Separating Signal from Noise

stochastic-processes · time-series · probability-theory

Drift and noise are not identifiable objects without assumptions. The Doob–Meyer decomposition explains exactly what can—and cannot—be separated in stochastic systems, and why martingales are the correct lens for trend extraction.

Spectral Pollution in Kernel DMD: Why More Modes ≠ More Truth

koopman · numerical-analysis · dynamical-systems · ml-theory

In kernel DMD and Koopman analysis, many extracted modes are not features of the dynamics but artifacts of finite-rank projection. Increasing model capacity often amplifies spectral pollution rather than revealing structure.

How Language Generation Works: From Tokens to Transformers

nlp · transformers · deep-learning · language-models

A conceptual map of generation: subword tokenization → learned embeddings → attention-based next-token prediction. Concrete diagrams show what each stage buys you and what it assumes.

The Magic of Morphing Math: A Deep Dive into Normalizing Flows

generative-models · deep-learning · math · normalizing-flows

Normalizing flows turn density estimation into calculus: invertible transforms + Jacobians give exact log-likelihoods. This post builds the change-of-variables view and why architectures like RealNVP make it tractable.

Why Eigenvalues Lie: Pseudospectra for Non-Normal Operators

math · linear-algebra · numerical-analysis

In non-normal problems, eigenvalues are not stable summaries: tiny perturbations can move them drastically. Pseudospectra replace point eigenvalues with uncertainty-aware regions—crucial for DMD/Koopman-style analysis.