CliniGA CRO

CliniGA CRO Blog

Separating simulated-use findings from clinical evidence

Do not equate successful tasks in a simulated setting with demonstrated clinical outcomes.

Representative research photograph: Separating simulated-use findings from clinical evidence
Photo: EU2016 NL from The Netherlands · License: CC BY 2.0 · Cropped and resized.
Published
Updated

Simulated use can reveal how a device is handled and where users struggle with particular tasks. Successful performance in a simulated environment does not, by itself, establish the same clinical outcome in real patients. State precisely which question the study answers.

Define the assessment

Describe the features the setting represents and those it does not. User profile, time pressure, distractions and the physical state of the device all influence interpretation. If task performance is linked to a clinical endpoint, identify the separate evidence supporting that link rather than assuming it from an apparently realistic simulation.

Worked example

For example, every user completes an application-device task on a mannequin. Real use may involve pain, communication difficulties and unexpected movement. The team reports the simulation as evidence about understanding and completing the steps, rather than claiming clinical success. Unrepresented factors become explicit questions for further evidence generation.

Practical checks

  • Define the users, tasks and environmental conditions represented by the simulation in advance.
  • Record attempts with observer assistance separately from tasks completed without help.
  • Match conclusions to measured tasks and explain which clinical influences were not represented.

Decision and limitations

A useful report supports design decisions while showing the limits of its evidence. A positive simulated-use result should not automatically be treated as eliminating the need for clinical investigation. Evaluate what additional evidence the device risks and intended claims require through the appropriate clinical and regulatory assessment.

Frequently asked questions

Is simulation weak or irrelevant evidence?
No. It can answer specific use questions well, provided conclusions do not extend beyond those questions.
Does observer assistance count as success?
That depends on the study definition; separating assisted and unassisted completion makes interpretation more transparent.

Sources

  1. MDCG 2024-3 — Clinical investigation plan
  2. MDCG 2024-5 — Investigator brochure