Public correction notes can close a feedback loop
By DX Research Group · · User support and feedback
A correction note connects a reported misunderstanding, the changed behavior and the evidence readers can check.
A useful correction note lets a reader update an earlier belief. “Improved reliability” rarely supplies enough information. We propose a public format that identifies the affected behavior, describes the correction, and states what has been checked without exposing the account or conversation that revealed it.
DXAP's release notes provide concrete examples of this kind of scope. The October 3 entries describe candle-statistics requests accepting string-encoded symbol arrays some models produce. They also distinguish routine unverified-integrity warnings from actual missing or invalid candles, which still make affected measurements unavailable. These are specific behavior changes readers can reason about.
The same page says entries marked Upcoming await deployment. A public note should preserve that status distinction: a proposed fix, a deployed change, and a reproduced successful outcome describe different evidence. Version and date help readers place the correction in the agent behavior they observed.
Write the smallest correction that changes understanding
Consider a hypothetical report that a read-only chat answer seemed to imply a settings change had already taken effect. A useful draft correction might say: “The explanation now identifies the pending proposal and directs the owner to review it. Existing settings apply until the proposal is approved and saved.” That sentence should appear only after the change it describes is verified.
The chat guide supplies the underlying semantics: chat itself neither places a trade nor approves a settings change; proposals require review and approval, followed by a saved-settings check. The hypothetical correction clarifies that documented boundary. It is neither a report of a current defect nor a commitment to a new release.
The note could link a sanitized fixture showing the ambiguous original wording and expected corrected interpretation. Remove account details, private messages and unnecessary market positions. The reader needs enough context to understand the failure mechanism, rather than a transcript of the person who reported it.
Close the loop with a check readers can perform
We would give each correction one verification question. For the hypothetical proposal wording, ask whether a reader can correctly identify the active settings and the remaining approval action. For a numerical lookup correction, identify the window or input-format case that now works. A correction that changes explanatory wording can be tested without claiming an improvement in forecasting.
Public corrections also need continuity. If an earlier article overstated an intervention's evidence, amend that article and link the dated correction near the affected claim. A separate release note cannot reliably reach every reader of the original page. Preserve the original scope and explain what changed in its interpretation.
Our controls paper companion demonstrates why that precision matters: published harness interventions measure particular trace outcomes, and some comparisons lack per-arm counts. A correction about those findings should address the supported measure and denominator, rather than imply a return gain.
The proposed feedback loop ends when the affected explanation or behavior is corrected, its check is recorded, and the relevant public surface carries the update. It creates an inspectable history of improvement. Whether the change improves market decisions or trading economics remains an empirical question for a separately defined study.