MKT.10:4 - Solution
MKT.10:4.1 - State the decision or claim and the answer needed
For a choice, name the available alternatives. Examples include an invitation unchanged or with added help, a switch to another channel, lower volume or ending the intervention. For a claim about effect, state the intervention and the alternative against which its effect is claimed. For additional expense or work, identify the alternative that sets the baseline. In each case, name the result or quantity at issue and who will use the answer. An increase in replies can answer a question about response volume while remaining insufficient for an expansion justified by better customer performance.
Specify whose activity, outcome or expenditure is at issue, what counts and which period the answer covers. For a practical choice, include consequences that could rule out an action. Include different participants when their outcomes differ: the purchaser can save effort while the user acquires extra work. MKT.6 supplies the agreed result; MKT.5 supplies the intended experience conditions. Neither supplies an observed effect by itself.
Determine the kind of answer required. “How many trials were completed?” is descriptive. “Which customers are likely to request help?” is predictive. “How many additional useful completions would this invitation produce compared with the current invitation?” is causal. These questions can use related data but require different grounds. A descriptive answer may be enough to stop an infeasible service even when its causal benefit remains unresolved.
For a claim about effect, specify the magnitude or precision the claim requires before interpreting a favourable fluctuation. For a practical choice, judge a difference against the value of the result, the intervention’s burden and the consequences of a mistaken decision. Use a local threshold only when it is justified.
MKT.10:4.2 - Make each observation interpretable
Define the observation unit, eligible population, period, source and counting rule. For a response rate, say who had an opportunity to respond and what response counts. Distinguish unique people, organisations, opportunities and events. Several purchases by one organisation need not be several independent observations; a missing report is not necessarily a failed result.
Match the measure to the claimed outcome. A recorded form submission can establish that a request was submitted. It cannot by itself establish informed choice, successful work or a favourable experience. Obtain additional observations when the decision or a claim you need to support warrants the effort. Where a customer reports an experience, preserve the question, timing, scale and respondent; an ordinal rating does not automatically support arithmetic differences, monetary conversion or comparison with another questionnaire.
Check how the data are produced. A new reminder may change who answers a survey, a new interface may change what gets logged, and better records may increase the apparent number of problems. Account for these changes before interpreting a trend. Retain consequential uncertainty about missing observations and selective follow-up.
Agree how much observation is needed and how to obtain it without defeating the intervention or its receiving service. Use existing adequate records; seek a limited observation when its value for the decision or the claim under examination justifies the burden. MKT.12 supplies a focused inquiry where the unresolved issue is what the customer’s work or answer means.
MKT.10:4.3 - Construct the causal contrast and its credible comparison
When contribution means a causal effect, define the intervention and comparison as ways of acting, including intensity, timing, support and consequential variants. Specify the target population, outcome and horizon. An offer of help and actual use of that help are different interventions. An invitation sent to one team may also affect another team through shared staff or shared information.
Use FPF C.28.CM, Construct and Challenge a Causal Model to explain why the contrast could change the outcome and what else could produce the observations. Recover common causes, selection, intermediate results and feedback that change the inference. A journey diagram or chronological sequence is not a causal model merely because arrows connect its events.
Then obtain an identification answer through Identify an Intervention Effect from Available Data (MMP.15) when this requires specialist analysis. The request names the contrast and available data, including how participants entered them. The supplier returns which effect the data can identify, under which assumptions, or a useful bound or reason it remains unidentified. More accurate fitting cannot repair an effect the data do not identify.
Select a feasible comparison suited to the question. Random allocation can make groups comparable for the effect of the assigned intervention if allocation, follow-up and interference conditions are adequate. If participants choose whether to take up the offer, estimating the effect of uptake requires a basis that addresses their selection. Observational comparisons require defensible assumptions about relevant differences, usable variation and measurement. A before-and-after comparison requires a reason that other changes do not explain the result. Asking for “a control group” without these conditions supplies no causal answer.
Design the comparison with its operators. Avoid allocating a promise the service cannot fulfil or depriving people of an existing commitment. Arrange follow-up, exception handling and a stopping decision if the work becomes infeasible. If the credible comparison is unavailable, return the supported descriptive result and the unresolved causal question. A bounded action under uncertainty can still be chosen explicitly.
MKT.10:4.4 - Estimate the supported effect and challenge its use
Give the identified question and qualified observations to an adequate estimation method. Retain the estimated magnitude, uncertainty and consequential assumptions. Statistical precision addresses variability under the method; it does not remove selection, measurement error, missing follow-up or a wrong causal model.
Check the conclusions that matter for the decision. Could plausible missing outcomes reverse it? Does a result disappear when an unsupported comparison is removed? Does an average conceal a group for whom the intervention is impractical or harmful? A subgroup claim needs adequate grounds; dividing the same small dataset repeatedly does not create them.
Keep discovery and confirmation distinct when many messages, channels or outcomes were examined. A selected favourable result may justify a new bounded comparison rather than immediate expansion. If a decision permits repeated inspection, agree how the resulting uncertainty will be handled with the analyst instead of repeatedly stopping at the first attractive number.
Before applying the result elsewhere, compare the new population, baseline service, intervention and support conditions. A trial with spare specialist capacity may not describe a larger programme that queues every customer. Establish whether the earlier estimate applies under those conditions, or obtain a new comparison. A precise result for the wrong use remains an inadequate answer.
MKT.10:4.5 - Compare the whole contribution with its burden
Use Account for Customer and Product Economics Over Time (MA.8) when the question needs a dated account of work, costs, receipts or payments. If the question is how much was paid to the agency in November, total the corresponding payments in that period. An adequate existing record can answer it. If the question is how much additional expense the campaign caused, compare its costs with those under the relevant alternative for the same period. For a future choice, distinguish sunk costs from payments and obligations the choice can change. Include acquisition, preparation, delivery, adaptation, support and recovery where they affect the answer.
A customer’s purchase value is not automatically incremental profit. For an incremental profit claim, ask what revenue and expense would differ under the alternatives, which contributions would have happened anyway, and whether later work has been included. Avoid counting the same additional outcome under several channels or counting both its estimated monetary benefit and the same benefit inside a customer-value total.
An uncertain causal effect and an uncertain margin produce an uncertain economic conclusion. Use credible ranges when a point estimate would conceal material uncertainty. For a choice that depends on the size of the effect, show where the preferred action changes. The largest expected contribution can still be infeasible because of cash timing, scarce staff or obligations to current customers. MKT.11 supplies actual delivery conditions; its missing capacity is not repaired by a favourable average return.
Use nonmonetary consequences in their own terms where no adequate conversion exists. A client’s ability to complete important work, burden and experience can affect the decision without a fabricated price. When a choice requires a trade-off, state whose objectives it serves and what the decision maker accepts.
MKT.10:4.6 - Return the conclusion and its conditions for use
Return the answer the evidence supports and its limits, whether it concerns an observation, a dated amount or an effect. For a practical choice, identify the alternatives, the relevant burden and the decision they support. State any remaining uncertainty and how it limits the claim or affects the choice to continue, change, run a smaller comparison, defer expansion or stop.
MKT.3 can change the invitation; MKT.5 or MKT.6 can change the proposed contribution; MKT.11 can change the supply arrangement; MKT.13 can bound deployment of the commercial model. When an action is needed, identify it and who can take it.
Reopen the answer when the intervention, population, measurement, service capacity, economic conditions or a material causal assumption changes. Keep the original result with its scope; a later disappointing outcome does not justify rewriting what the earlier comparison observed.