Trace length and length generalization across compression

Real runs from the paper: a two-layer transformer (about 6.7×104 parameters, no positional encoding) trained on synthetic traces. EM0 is in-range exact match; EM1 and EM2 are two splits longer than any training input.

operator
task
mean trace length
exact match by test split
EM0EM1EM2