education
What I cannot create, I do not understand. — Richard Feynman, American theoretical physicist
Most of what I know about my own research, I did not learn from reading the paper. I learned it from watching the algorithm do something I did not expect, and then working backwards to figure out why. Indeed, a figure in a paper is a single frozen moment of a process, and it is in interacting with that process (changing an input, stepping through a decision, breaking an assumption on purpose) that a reader builds the intuition the paper was trying to transfer in the first place. This page collects interactive explainers for the concepts behind my research, each one a small simulation that lets you poke at an idea until it stops being abstract. Fundamentally, I believe that good visualization is a form of argument, and that the best way to understand a theory of learning is to watch it learn.
Each card opens its own simulation, written in the register of the papers it draws from and linked to the original work - please reach out if something is unclear or if you would like to see a concept covered!
Cobweb: Concept Formation as Information Gain
concepts/
- instances, concepts, and the taxonomy that links them
- the four operators: insert, create, merge, and split
- prediction by best-first search over pointwise mutual information
- central tendency and frequency (Hayes-Roth & Hayes-Roth, 1977)
- exemplar similarity over prototype distance (Medin & Schaffer, 1978)
- the prototype-to-exemplar transition (Smith & Minda, 1998)
- applications to retrieval and topic modeling
TRELLIS: A Unified Account of Concepts and Chunks
concepts/
- concepts versus chunks: generalization and composition
- content and context instances for every element
- two intertwined taxonomies in place of a grammar
- greedy parsing with a recognition gate
- generation, recall thresholds, and errors of commission
- errors of omission and commission as evaluation
Diffusion Models and Concept Formation
concepts/
- noisy marginals as kernel densities, and noise level as depth
- modes, score ascent, and Tweedie prototypes
- parent pooling and the law of total variance
- recovering a mode-path taxonomy bottom-up
- distinctiveness and the basic level
- matching diffusion modes to Cobweb concepts