Carry a tested fix back into onboarding and documentation

By DX Research Group · · User support and feedback

A proposed transfer test checks whether a resolved support issue stays resolved for the next owner.

A repair can work in the original support conversation and still fail the next owner. The first owner received a patient explanation, follow-up questions and the benefit of an engineer's diagnosis. Onboarding and documentation need to carry the useful part of that resolution without depending on the same personal help. We propose a transfer test before calling the learning loop complete.

DXAP's creation guide distinguishes writing a limit in strategy text from configuring the actual policy field. It also separates saving a draft card from launching the agent. These distinctions are suitable targets for support-derived documentation changes because they connect a user's understanding to a visible setup action.

Take an illustrative resolved issue: an owner believed saving the draft started scheduled evaluations. Support established that the draft was saved and the separate launch action remained pending. A tested fix might improve the label or explanation at that step. The documentation task is to help a new owner infer the same state before opening a ticket.

Extract the dependency, then place the explanation

We would first identify the smallest fact that resolved the issue: saving preserves the draft; starting launches it. Then identify where a new owner makes the relevant decision. A long troubleshooting article may contain the fact but arrive too late. Place the explanation next to the save or launch choice, with a deeper guide available for the surrounding steps.

Bind the proposed wording to the tested behavior and product version. If a release changes the button or flow, the onboarding explanation needs review. This dependency can be recorded as a small mapping between the tested fixture, the affected instruction and the visible control. It gives documentation maintenance a concrete trigger.

The chat guide reinforces the same boundary for builder chat: a draft change still requires the separate launch action. Updating only the creation guide would leave another entry point where the misunderstanding could recur. The transfer review should follow the affected concept across its relevant surfaces, while preserving each surface's actual behavior.

Test with people who missed the original conversation

Recruit participants unfamiliar with the incident. Show them either the previous explanation or the proposed wording in an otherwise equivalent synthetic flow. Ask them to save a draft and identify whether the agent will now run. Then give them a new draft whose launch state differs and ask which action remains necessary.

The first question tests the repaired scene. The second tests transfer of the distinction. Count correct state identification, unnecessary actions and requests for help separately. An owner who remembers a button label but still thinks every saved edit launches an agent has learned the wrong general rule.

After a tested wording change is released, compare recurring reports only among owners exposed to that version and relevant step. Retain affected-flow exposure as the denominator. A drop in tickets during lower onboarding traffic provides little evidence about the repair's effect.

Our proposed closure record would link the behavioral fixture, revised explanation, comprehension test and eventual exposure window. Support then contributes something reusable: the fact that resolved a real misunderstanding, placed where future owners need it and tested without the original conversation doing the teaching.

Sources

Related field notes