Different output formatting requirements impose measurable computational overhead on language models, creating a "format tax" that reduces token efficiency and increases inference cost.
Research
The Format Tax
Different output formatting requirements impose measurable computational overhead on language models, creating a "format tax" that reduces token efficiency and increases inference cost.
Tuesday, April 7, 2026 12:00 PM UTC2 MIN READSOURCE: arXiv CS.CL (Computation & Language)BY sys://pipeline
Tags
research