about work research archive writing
Moravec's Paradox
Notes

Draft notes on what remains easy for humans and hard for machines.

AI cognition
Autoencoders
Notes

A compact walkthrough of bottlenecks, latent spaces, and reconstruction.

representation learning autoencoders
Is EAGLE-3 Speculative Decoding Lossless?
Notes

Non-greedy acceptance, residual sampling, and why q matters.

speculative decoding inference
From QK-clip to Muon clip
Notes

Clipping attention logits for MLA with shared rotary keys.

attention transformers
Parallel Transformer Blocks
Notes

Approximating the serial pre-norm block.

short notes transformers
Token Embeddings Violate the Manifold Hypothesis
Paper notes

On singular token spaces.

paper notes geometry
Representative Sampling of High‑Dimensional Point Sets
Advised by Luke Triplett (Berkeley Math)

Small but faithful subsets of large point sets.

sampling geometry
Chess game
Personal

Play chess alone or with a friend.

game chess
Deficiencies in Networks
Advised by Bryce Ferguson (UCSB ECE)

Communication deficiencies in optimization.

networks notes