Positions fall, information does not

Holding the computation fixed, we vary the compression factor c (macro order or base). Serial positions and key-value cache scale as 1/c, attention operations as 1/c2, and the trace information stays flat.

serial positions (∝ 1/c) attention ops (∝ 1/c²) KV cache (∝ 1/c) trace information (flat)