Jump to text
On this page
Copy and source
Published source confirmed at last check

Source changed 2026-11-18 21:11:39 UTC · snapshot created 2026-11-18 21:12:35 UTC · last check 2026-11-18 22:45:10 UTC

RMP.5 - Analyze and Criticize the Research Claim under Its Method

Status: Stable

Type: Research Method Practice practitioner method pattern

RMP.5:1 - Problem Frame

Use this pattern to establish what claim a body of research material, an analysis or an emerging interpretation supports. Start from the proposed claim or the question the analysis is developing. Trace a consequential connection from the material through the analysis to the claim and examine which criticisms affect its support.

A simulation may reproduce a reported curve while its relation to field failures remains untested. Several valid downstream readings may establish a pattern while leaving its cause unresolved. In each case, identify the result obtained and the evidence needed for the stronger interpretation.

The ClaimCandidate states the bounded answer. Its CriticismRecord identifies the examinations performed, their bearing on the answer and any remaining uncertainty. An annotated analysis, an existing notebook or a concise qualified answer can carry both.

Use an adequate supplied analysis within its scope. For inherited material, establish the origin, method and limits needed for the present claim. The resulting answer can support a current use, narrow an earlier claim or identify the point open to challenge.

Use a qualified disciplinary method directly for a routine calculation, qualification or interpretation with adequate criteria. If an inference still needs a source, design premise or criterion, identify it and the affected claim. Access permissions and decisions about action have their own grounds. Use RMP.6 if a remaining credibility question warrants comparing ways to address it.

RMP.5:2 - Problem

An association can be misread as a cause, or repeated readings as independent cases. A theme may be reported as a prevalence estimate, archival silence as proof that an event never happened, or a calculation as validation of a model for a new use. Each stronger conclusion needs a connection that the reported result alone may leave open.

Additional analysis is worthwhile when it can clarify the inference at issue. An adequate result can be reused. If a required comparison is missing, more detail about the surviving material may support a narrower claim while leaving that comparison open.

Identify the analytical choices and contrary material that bear on the claim. Judge exploratory, interpretive and source-critical work using criteria appropriate to the method employed.

RMP.5:3 - Forces

ForceTension
A useful answerThe strongest requested claim may exceed the evidence while a narrower conclusion answers part or all of the question.
Method fitFamiliar analytical tools are accessible, while unlike questions require different forms of criticism.
Discovery and commitmentA relation noticed during analysis can justify a new question. A claim of advance commitment depends on what was recorded or otherwise established before the relevant results were known.
ReuseExisting analysis can answer the question, while a changed input, assumption or use may invalidate part of it.
Contrary materialA coherent account is easier to communicate, while discordant cases and plausible rivals can change its scope.
InspectabilityAnother critic needs the consequential reasoning, while indiscriminate recording can obscure it or expose protected material.
CompletionThe available evidence can justify ending with a bounded or unresolved answer. A further examination may be worthwhile if its attainable results could change that answer or its use.

RMP.5:4 - Solution

Identify the claim, the material and the method it relies on. Use an adequate existing analysis or perform the analysis the question requires. Examine the assumptions, contrary evidence or alternative interpretations that could affect its support. Return the bounded answer, the criticisms examined and any remaining limits.

RMP.5:4.1 - Recover the claim and one consequential connection

Specify the phenomenon, cases, population, setting, period or corpus that the claim concerns, the proposed relation and the conditions for its use. Distinguish description, interpretation, comparison, causal explanation and prediction when they require different evidence. If the claim emerged during analysis, identify when and how.

Trace the connection needed to judge the claim.

ConnectionWhat to recover
Material to observation or source claimWhich records, specimens, encounters, documents or computations are available, what they represent, and their selection, transformation, loss and access limits.
Observation or source to analysisThe method and units used, the assumptions, consequential choices or departures, and when those choices were made relative to seeing the results.
Analysis to proposed answerThe reasoning that makes the result bear on the exact claim, including the comparison or interpretation and the scope it can support.

Use the relevant RMP.3 plans and RMP.4 records when they supply part of that connection. A plan can establish an intention. Use evidence of conduct for a claim about what occurred, identifying later testimony or reconstruction as such. A missing record or unperformed comparison limits the inferences that depend on it.

Retain an existing analysis that answers the question for the relevant material, method, assumptions and use. If a premise has changed or a live criticism exposes a gap, reconsider the portion that depends on it. A new filename or the age of an otherwise applicable analysis supplies no such change by itself.

RMP.5:4.2 - Use the analysis that fits the question

Choose an analysis justified for the subject, material and inference. Use the criteria and assumptions appropriate to that discipline. The following examples show why a criticism that matters to one claim may be irrelevant to another.

Research usePractical analytical moveCriticism that can change the answer
Quantitative or experimental estimateIdentify the target quantity, units of sampling or assignment and comparison. Report the estimated magnitude and its justified uncertainty, including relevant exclusions, multiple comparisons and choices made before or after seeing results.Dependence, missing data, measurement and analytical choices can change the estimate or its interpretation. A significance label alone gives neither an estimate of effect size nor grounds for attributing a cause.
Observational or field accountRelate observations to the sites, periods, selection and measurement conditions. State the pattern established.Examine confounding, seasonality, selection and any missing comparison when attributing a cause. Repeated measurements of one site can describe variation at that site. Inference across independent sites needs evidence from those units.
Qualitative or reflexive interpretationDevelop the interpretation under the selected approach and theoretical commitments. Connect it to the research material, the researcher’s contribution and relevant discordant cases.A theme may omit a different account or extend beyond what its extracts support. In reflexive thematic analysis, judge the interpretation by its coherence with the approach and its grounding in the material.
Historical or source-critical accountExamine the dating, authenticity, provenance and purpose of the sources, their dependence and the sequence of events in question.Copies may share one source. An archive’s survival and access conditions can explain a silence. A document may establish when a change occurred while leaving its cause open. Check material that could support a contrary chronology.
Computational or model claimIdentify the target, derivation or implementation, data, environment, fitted quantities and relevant assumptions. Interpret the output for the stated target.Reproducing an output can support a claim about the implemented calculation. Calibration, verification, sensitivity and validation for a field use each examine a different connection.
Mixed inquiryAnalyze each component using its appropriate method and specify the relation claimed between the results.Check dependence, meanings, targets and disagreements before combining results. Preserve a disagreement that changes what the components jointly support.

Apply the kind of criticism the claim needs. A descriptive estimate can answer a descriptive question. In a qualitative inquiry, establish the sampling, saturation or reliability criterion from the approach and question where it is relevant. Historical claims can be examined through surviving evidence. If a disciplinary criterion is still needed, identify the claim it limits and a competent source where one is available.

RMP.5:4.3 - Criticize the consequential inference

Start with a threat that could affect the answer. Include other threats on which the claim depends. For each examination that matters, establish the following.

  1. which claim or inference could fail;
  2. which observations, alternative analysis or source comparison could distinguish the possible answers or their degree of support,
  3. what was actually examined and what was found;
  4. whether the finding sustains or changes the answer, its scope or its uncertainty.

Compare plausible rivals and defensible analytical choices, including contrary material, relevant exclusions and missing evidence. If a threat has not been examined, say which inference remains uncertain. Failure to obtain a record is evidence about the search or access. A conclusion about the proposed event needs grounds linking that absence to the event.

If an analysis chosen after seeing results reveals a relation, report the discovery, its connection to the original question and its present support. Record what was known when the choice was made so a critic can distinguish exploration from an advance commitment.

For a sensitivity analysis, identify the choices examined and their effects. Limit robustness claims to the scope the comparison supports. If a variant changes the target quantity or question, identify the separate claim each result answers.

RMP.5:4.4 - State the answer the examination supports

Give the answer warranted for the stated question and use. The following outcomes distinguish what the examination established.

  • support the bounded claim to the extent established by the material and Method;
  • narrow or qualify the claim because a condition, rival or limitation matters;
  • defeat the proposed claim or one of its necessary premises;
  • leave the named claim unresolved while preserving what is known.

State which part of the requested claim the answer supports. Downstream measurements may establish a descriptive pattern after a causal comparison is lost. A computational result can stand even when its proposed field interpretation has been rejected.

Interpret an estimate and its uncertainty interval under the method that produced them. An interval that includes zero can be compatible with zero and with nonzero effects. To assess practical sufficiency or equivalence, apply the relevant threshold or margin and the comparison rule.

Return the answer and the examinations on which it relies. A remaining limitation may justify a different conclusion or a proposal for further study. Time and resources affect what can be examined, not the strength of the available evidence.

RMP.5:4.5 - Retain the account needed for criticism and use

Keep the material, consequential choices, actual examinations, results and limitations accessible to the extent the use requires. A concise answer with its basis, a qualified notebook entry or a reference to the relevant calculation may suffice.

Provide the source, analytical choice or reason on which later reliance depends, within the permitted access conditions. A reconstruction can support claims about an earlier choice and its timing to the extent surviving evidence warrants them. Identify it as a reconstruction and state which conclusions remain open.

Apply the conditions protecting participants, confidentiality and rights. An authorized critic may examine material unavailable in a public summary. State which conclusion each can support and whether a qualified result from the authorized inspection answers the public reader’s question.

RMP.5:4.6 - Finish or return the specific missing premise

Finding about the present useUseful continuation
The analysis and its criticism already answer the bounded questionReturn that answer and its material qualification.
The research question or proposed receiving use has changedRecover the changed question with RMP.1 or compatible supplied inputs.
A needed comparison is unavailable or a premise of the selected design is defeatedState the consequence for the proposed conclusion. If the task requires a different design, use RMP.2. A justified decision to conduct no new study can finish the inquiry.
A specified operation cannot supply the intended contrastState the resulting limit. Use RMP.3 to revise the operation when a workable specification is needed, keeping any change of research question explicit.
The examination needs a connection to material or a transformation that has not been recoveredUse an adequate existing record or inspection. Where the history still needs work, use RMP.4 to establish what survives, what can be reconstructed and the limit on the conclusion.
A needed disciplinary result, criterion or permission is still missingIdentify the dependent question. Obtain the contribution from a qualified or authorized source when it is needed and available, or state the remaining limit.
A remaining credibility question could change use of the claimUse an existing qualified answer when available. Use RMP.6 if it is worthwhile to compare ways of examining the remaining threat.

A research finding can change the grounds for an engineering, policy or management decision. When the task also calls for that decision, apply its criteria and identify or exercise the relevant authority.

RMP.5:4.7 - What changes in practice

The practitioner can show why a conclusion follows, what criticism was considered, and what that examination confirmed, changed or left open. This can be a complete answer to the present question.

RMP.5:5 - Archetypal Grounding

The teaching cases use stipulated events, measurements and conditions.

RMP.5:5.1 - The seal model runs, but the field claim is still open

In a Pump-P4 analysis, investigators calibrate a model on accelerated-test observations. A run using the retained code, data and environment reproduces the reported degradation curve. The proposed field conclusion is that the maintenance interval can be extended.

The run supports the computational result under the stated inputs. Extending the field interval would also require evidence that the accelerated and field conditions preserve the mechanism relevant to that use. No qualified comparison establishes that relation in this case. Report the reproduced curve, its domain of calculation and the unresolved field-use claim.

If a qualifying parameter analysis shows that plausible material values reverse the comparison, include that sensitivity in the answer. Rerunning the same inputs examines computational repeatability. Use RMP.6 when a further sensitivity or field-validation question would affect use enough to warrant investigation. The present model result can stand, and the applicable authority makes any decision about the maintenance interval.

RMP.5:5.2 - Downstream salinity without the reference reach

The team’s RMP.3 specification calls for paired reference and downstream readings during the same thaw. Its RMP.4 trace supports the downstream readings, documents the missed reference visit and identifies no comparable reference measurement from that event. The thaw has ended.

Use the qualified measurements to describe downstream change, keeping repeated readings tied to site and time. Without the reference observations, the planned paired comparison is unavailable. The downstream series alone leaves the proposed outfall and the relevant hydrological alternatives unresolved as causes.

Return the observed pattern and the unresolved attribution. A qualified reference observation already made during that thaw, if found, could support the original comparison. Later authorized matched observations can address a new period using the conditions they actually cover.

RMP.5:5.3 - A directive date and an earlier practice

A historical claim says the practice first began after Directive-D and was caused by it. Authenticated records establish when the directive was issued. The earlier workshop series is inaccessible. Its catalogue identifies material to seek, but the evidence available here leaves the possible earlier practice open.

An authenticated earlier ledger then establishes that the practice occurred before issuance. This defeats the proposed chronology of its first occurrence. The cause of that earlier practice and any effect of the directive on later adoption remain separate questions.

RMP.5:5.4 - A situated theme is not a workforce percentage

A reflexive thematic analysis examines a small set of maintenance-team interviews under an explicit interpretive approach. A proposed theme presents record keeping as a means of blame. The supporting extracts describe defensive documentation, while another account treats the same records as useful protection during shift handover.

Examine how the investigator developed the theme and how their position shaped the reading. Include the discordant account. Here the extracts support a tension between blame and practical protection. State that interpretation and its grounds in the existing annotated material.

The interpretation concerns these accounts. Estimating a workforce percentage would need a suitable sampling and measurement design. Attributing change to a training programme would need a credible causal comparison. Coder agreement addresses neither question by itself.

RMP.5:5.5 - Repeated measurements and an uncertain contrast

Eight independent specimens are each measured three times under a supplied measurement method. The 24 readings can describe within-specimen variation. Use the eight specimens as the independent experimental units and account for the repeated readings in the analysis.

Suppose the estimated contrast is 2 scale units, with an uncertainty interval from −1 to 5 scale units. Report that estimate and interval with the comparison and methodological assumptions. If the supplied equivalence rule requires the entire interval to lie within (−6, 6) scale units, it meets the rule. It fails the same rule with a margin of (−2, 2). Without an applicable margin or practical threshold, these results alone leave equivalence and practical sufficiency open.

RMP.5:6 - Bias-Annotation

Recurring biasEffect on the answerCorrective move
Desired-conclusion biasSupportive material determines the story while contrary material disappears.Follow the consequential inference and retain examinations that narrow or defeat it.
Technique prestigeA familiar statistic, code run or interview format is treated as universal assurance.Recover the selected Method and the claim its result can support.
Retrospective certaintyAn exploratory choice is described as though it preceded seeing the material.Preserve its actual timing and the claim’s resulting qualification.
Record-volume biasVolume is taken as assurance of inspectability or support.Identify which material the inference depends on and whether the intended reader can use it or a qualified examination of it.
Closure pressureAn unresolved claim is presented as settled or used to prescribe another study.Give the bounded answer. Consider further acquisition when it could improve the answer enough to justify the work.

RMP.5:7 - Conformance Checklist

Use the questions below to assess the claim under the applicable research method.

  • The proposed or emerging claim and a consequential connection to actual material can be identified.
  • The target, relation, scope and use distinguish the descriptive, interpretive, causal or predictive claim actually made.
  • Supplied analysis is reused when its material, Method, assumptions and use remain adequate.
  • The account identifies consequential analytical choices, when they were made and any departure from the plan that affects the claim.
  • The analysis addresses the units, dependence, missing evidence, source relations and uncertainty on which its conclusion depends.
  • The conclusion accounts for relevant contrary material and defensible alternatives, including any that leave it unchanged.
  • The account distinguishes inability to inspect a record from an observed absence in a source that was examined. When absence is used as evidence against a claim, the expected recording, survival and coverage have grounds.
  • The result states the supported scope of the claim, any premise defeated and the remaining uncertainty.
  • The criticism account describes examinations actually made and retains the limits needed for the receiving use.
  • If a premise fails, the account identifies the affected claim. Where further work needs a correction or clarification, it identifies what would supply it (§4.6).
  • Proposed credibility testing has grounds in its attainable contribution and the cost of obtaining it.
  • When the finding informs an action, the applicable criteria, protections, access conditions and decision authority remain identifiable.

RMP.5:8 - Common Anti-Patterns and How to Avoid Them

Anti-patternWhy it failsPractical correction
“The graph proves the explanation”The observations can support a pattern while leaving its cause open.State what the comparison establishes and the further grounds for the proposed explanation, or the limit that remains.
“More readings give more independent cases”Repeated measurements can share the same underlying unit and dependence.Recover the unit and the justified uncertainty model.
“The model reruns, so it is valid in the field”Execution and model-to-world adequacy are different relations.Preserve the computational result and examine the proposed use separately.
“The archive is silent, so it did not happen”Source purpose, selection, loss or access conditions can explain a silence.Identify which records were examined and whether the event would be expected to leave an accessible record in that set.
“Every qualitative analysis needs coder agreement”The criterion can contradict the selected qualitative approach.Use its justified account of interpretation, researcher contribution and criticism.
“A limitation means the whole analysis failed”A bounded finding may answer the question.State the supported result and identify any further question on which the receiving work depends.

RMP.5:9 - Consequences

A reader can use the supported descriptive or computational result while limiting an unsupported extension. Existing suitable analysis can supply the answer directly, with enough of its basis to permit the examination required.

Judging the method and inference takes professional work. When a requested conclusion cannot be established, give the reason and any narrower finding the evidence supports. A specific evidential limit can itself answer the question. A separate decision may use that answer under its own criteria.

RMP.5:10 - Rationale

Analysis transforms or interprets material. Inference relates the analytical result to a claim. A correct calculation can therefore be used to draw an unwarranted conclusion. Examining that connection can improve the answer with the data already available.

Choose criticisms that can expose error in the particular inference. A sampling unit matters to an experimental estimate, a source’s dependence matters to historical attribution, and an investigator’s interpretation matters to a reflexive theme. Each method can be criticized on grounds appropriate to its use.

A bounded answer can complete the present work. Consider further testing when its attainable findings and cost justify a separate investigation.

RMP.5:11 - SoTA-Echoing

How can researchers relate an analytical result to a claim and examine the inference under the method that produced it?

The 2026 SCORE analytical-robustness study examines defensible reanalyses of the same data in social and behavioural research. The findings give grounds to identify analytical choices that affect a result. A quantitative threshold for another use needs justification in its own setting.

Braun and Clarke’s 2024 RTARG discussion and their author guidance explain how methodological coherence and the researcher’s interpretive contribution bear on reflexive thematic analysis. Apply those criteria to the approach they address.

The American Historical Association’s professional standards ground careful use of sources, inspectable interpretation and engagement with contrary evidence. They support distinguishing what an inspected record establishes from an inference about events on which the surviving archive is silent.

The National Academies’ 2019 account distinguishes computational reproducibility from replicability with new data. A successful rerun supports a claim about the computation under the conditions tested. A claim about transfer to the field needs evidence for that use.

Reconsider an analytical conclusion if new methodological evidence, changed material or a new intended use affects its grounds. Obtain a disciplinary measurement rule, causal evidence or permission from the source that supplies that particular contribution when needed.

RMP.5:12 - Relations

  • Use RMP.3 to examine or develop operational choices when their relation to the research question needs work. A suitable existing protocol can supply those choices.

  • Use RMP.4 when conduct, transformations, loss or access need to be documented or recovered. Inspectable material permits an examination. Whether the claim follows depends on that examination and its findings.

  • Use a compatible question and design already available, or RMP.1 and RMP.2 where the question changes or the selected design needs reconsideration.

  • Use RMP.6 when a remaining credibility question warrants comparing available responses. A new test requires a useful attainable result and a feasible arrangement.

  • Use FPF F.1 to find or select a source, F.0.1 to recover a source-local meaning that matters, and A.10 when the evidence for a claim or its provenance needs clarification or reproducible tracing. Use an adequate source result directly.

  • Apply the disciplinary methods and criteria relevant to the inference. Use existing access and protection conditions. An action or change in those conditions needs the corresponding authority.

  • A bounded RMP.5 answer may finish the inquiry. Use RMP.7 if that answer is needed for a compatible corpus synthesis, or RMP.8 when revisiting a broader claim or returning a change to its receiving use.

RMP.5:End

Referenced in the corpus

48 literal mentions in other sections. Read their context to establish the relation.