Define the sample.
Record the instrument, contract, dates, session, timezone, source and exclusions. Consecutive observations help prevent a collection of memorable charts from becoming the whole argument.
Define the rule and the comparison.
Write the exact event and what would count as failure. Specify what you compare it with. Record every revision so that a rule discovered after inspecting the data is not presented as a prior prediction.
Account for execution.
Include fees, spread, slippage assumptions and plausible fills. A chart touching a limit is not proof that an order would have filled.
Keep evaluation separate.
Use later or otherwise untouched observations to evaluate the idea. A sample used repeatedly to choose rules no longer provides independent confirmation simply because it is renamed.
State what remains unknown.
A small sample, missing records or sensitive assumptions limit the claim. A descriptive relationship does not establish causation or a dependable future return.
Read the methodology ↗