Reasoning & Test-Time Compute · 2023
Reasoning Correctives: Faithfulness / Overthinking / Contamination
These studies showed that a model's stated chain-of-thought often does not reflect the actual cause of its answer, documenting unfaithful, biased, and over-length reasoning traces.
Editorial record
Plain-language summary
By inserting biasing features into prompts, such as always marking option (A) as correct, the authors showed models would follow the bias while writing plausible reasoning that never mentioned it, demonstrating that CoT explanations can be post-hoc rather than causal. Related findings cover overthinking, where longer reasoning hurts accuracy, and contamination, where memorized answers masquerade as derived ones. The collective correction is that a readable chain-of-thought is not automatically a faithful account of the computation, so it cannot be trusted as an interpretability or safety signal without further verification.
Knowledge graph
Relationships
Descendants
ChallengesEvidence: Direct
Chain-of-Thought Prompting Elicits Reasoning
CoT can be unfaithful; reasoning correctives
P-226
Source record
Provenance
- Record ID
- P-226
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
- https://arxiv.org/abs/2305.04388
- arXiv:2305.04388
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.