MKT.10:4.2 - Make each observation interpretable
Define the observation unit, eligible population, period, source and counting rule. For a response rate, say who had an opportunity to respond and what response counts. Distinguish unique people, organisations, opportunities and events. Several purchases by one organisation need not be several independent observations; a missing report is not necessarily a failed result.
Match the measure to the claimed outcome. A recorded form submission can establish that a request was submitted. It cannot by itself establish informed choice, successful work or a favourable experience. Obtain additional observations when the decision or a claim you need to support warrants the effort. Where a customer reports an experience, preserve the question, timing, scale and respondent; an ordinal rating does not automatically support arithmetic differences, monetary conversion or comparison with another questionnaire.
Check how the data are produced. A new reminder may change who answers a survey, a new interface may change what gets logged, and better records may increase the apparent number of problems. Account for these changes before interpreting a trend. Retain consequential uncertainty about missing observations and selective follow-up.
Agree how much observation is needed and how to obtain it without defeating the intervention or its receiving service. Use existing adequate records; seek a limited observation when its value for the decision or the claim under examination justifies the burden. MKT.12 supplies a focused inquiry where the unresolved issue is what the customer’s work or answer means.