previous arrow
Featured title

FEATURED

case study

Case study title

Assess safe and effective use of pediatric medical injection kit

Challenge
Our client's challenge

The manufacturer asked us to determine if nurses could prepare an injection device and reconstitute the drug for a clinical trial.

We executed every stage of the project from protocol writing to recruitment of a hard-to-recruit population (clinical trial pediatric nurses) to writing the validation report.

Approach
Our approach

The validation study included HCP training, done by our on-staff RN to demonstrate techniques, a 24-hour decay, and a 60-min validation session, during which participants had to prepare and administer two doses of the kit.

Approach
Our insights

We evaluated and updated their risk assessment (uFMEA), aligning with previously submitted documents, while identifying new risks and user paths for the redesigned equipment.

next arrow

Human factors research

Applying human factors best practices to product development is much more than a validation study. Yes, we have the expertise to plan, manage, and execute your human factors validation study… but creating safer and more efficient, effective, and engaging experiences for your customers starts much earlier than that and so do we. 

1720

pharmaceutical companies have trusted us with their UX and human factors research

35+

senior team members
with advanced degrees or equivalent experience in human factors

25+

FDA or CE mark (EU) submissions supported each year

100+

exploratory, formative, or summative HF research engagements each year

Our human factors research informs the development and commercialization of safe and effective medical devices.

Human factors includes both cognitive usability and physical ergonomics aspects of human-product interaction. ​Cognitive usability refers to memory, attention, perception, decision making, detection, situation awareness, automaticity, compatibility, etc. Physical ergonomics refers to coordination, strength, posture, motor schema, dexterity, force, reach, etc. We work to identify where these aspects break down when your users use your product and how to resolve these issues.​

Testing early and often allows you to guide your design using input, making for fewer surprises at the end. In most cases, it is important to test with representative users, even if the system is not fully developed.​

What do we measure?

Understand

  • End user needs
  • Context of use
  • Human factors plan inputs

Plan

  • The right questions to ask
  • The best methods to answer your questions
  • The key milestones to achieve success

Execute

  • Field research to learn
  • Formative user research to inform the design
  • Human factors validation of safe and effective use

We often assume users will behave the way we expect them to behave. Unfortunately for us, humans are unpredictable … attempts to model behavior typically predict fewer than 10% of actions, and what people say they do is often vastly different from what they actually do. Therefore, we need to see behavior.  Putting a product in front of a human and giving them a chance to use it – to behave – yields insights that cannot be predicted or hypothesized without testing. Lesson: User testing and iteration matters.

While exploratory and formative human factors research can be conducted with an eye towards achieving a competitive advantage and imperative in ensuring you have a product that is ready for validation or limiting surprises when you get to validation, a summative human factors study must be conducted to fulfill the FDA regulatory requirement of demonstrating that a medical or drug delivery device can be used safely and effectively before going to market.

We also help manufacturers navigate FDA guidance documents related to the application of human factors engineering to the development of medical and drug-delivery devices, help respond to direct feedback from FDA (e.g., support a response/action/change to FDA feedback on a protocol or report), and determine the best research approach taking all constraints into consideration. We are in a unique position to leverage learnings across various submissions/interactions with the FDA (without compromising confidentiality).

Unlike clinical trials, our research is typically conducted in a lab setting that reflects real-world use through simulated scenarios. We observe users as they complete critical tasks with the device(s) and determine (for example) the root cause of any observed use-related issues. We also provide design recommendations to overcome those areas where risk can be mitigated, as well as, help get your product to the point where data show the residual risk is as low as reasonably practicable (ALARP). Human factors research is completed in a relatively short amount of time, with data collection typically requiring between 1-2 weeks, compared to months or years for a clinical trial.

How do we measure?

If you’re unfamiliar with typical human factors research methods, find examples below of what each method is, what it measures, when to use it, and outcomes. 

Read more about our simulated research labs where we conduct in-lab and remote testing encompassing all stages of the product development lifecycle.

Understand the unmet needs of your customers to design the right product or service.

Get feedback early and often to course correct while it’s still easy to do so.

Assess current state to focus future development efforts or to document achievement of objectives.

Ethnography

Explore user behavior through naturalistic observation to better understand operational context of use and uncover workflows. Ethnographic research methods gather in-situ observations to develop a deeper understanding of user behaviors and processes as they interact with a product, system, or service.

When is it used?

Ethnographic methods are used in the early stages of product development.

Types of deliverables:

Detailed research findings with actionable recommendations of where to focus future development efforts.

Research questions answered:
  • Rich, in-depth understanding of context of use, perceptions, motivations and thought processes driving user behaviors and workflows.
  • Identification of inefficiencies in processes, tools, and designs to pinpoint areas of improvement.
  • Understanding of unmet needs to inform the design of the right product or service.
  • Identification of unexpected issues that may not be encountered in recall-based methods.
  • Visibility into in-the-moment behaviors that can be forgotten or overlooked by users, such as habitual or obscured behaviors, in recall-based methods.
  • Behavioral observation offering insights about the experience of the product, removing opinion and reporting bias.
Contextual inquiry

Take a deep dive into use scenarios to capture rich, in-the-moment data through direct observation of users’ behaviors in their natural environment. Contextual inquiry is an ethnographic method employing direct observation coupled with in-depth interviews to gain a holistic understanding of user practices and behaviors.

When is it used?

Contextual inquiry is conducted in the early stages of product development.

Research questions answered:
  • Rich, in-depth understanding of users’ context of use and environment.
  • Identification of regularly employed tasks, workflows and tools to help define requirements for a product as well as identify inefficiencies in those areas.
  • Understanding of perceptions, motivations and thought processes driving user behaviors and workflows to identify what is important and critical to users.
  • Visibility into in-the-moment behaviors that can be forgotten or overlooked by users, such as habitual or obscured behaviors, in recall-based methods.
  • Identification of unexpected issues that may not be encountered in recall-based methods and unmet needs to inform the design of the right product or service.
Diary studies

An ethnographic method, diary studies are used to document the evolution of an experience over an extended period of time to identify opportunities for enhancement. Diary studies unveil the attitudes of users as they engage with products and services and log their activities as they occur.

When is it used?

Diary studies are typically conducted in the early stages of product development.

Research questions answered:
  • Rich, in-depth understanding of users’ context of use and environment over a period of time.
  • Identification of regularly employed tasks, workflows, and tools to help define requirements for a product as well as identify inefficiencies in those areas.
  • Understanding of intricacies of tasks and workflows that are unveiled over time and with continued use.
  • Understanding of perceptions, motivations and thought processes driving user behaviors and workflows to identify what is important and critical to users.
  • Visibility into in-the-moment behaviors that can be forgotten or overlooked by users, such as habitual or obscured behaviors, in recall-based methods.
  • Identification of unexpected issues that may not be encountered in recall-based methods and unmet needs to inform the design of the right product or service.
Time & motion studies

Assess the effects of system design on use-related processes by quantifying the impact of process improvements. Time and motion metrics are collected to examine how tasks are done, track the time it takes to complete sub-tasks within a larger task and inform the balance of sub-tasks.

When is it used?

Time and motion studies are conducted in the early stages of product development.

Research questions answered:
  • Definition of a process that allows time-efficient task completion while honoring the needs of users performing the tasks.
  • Identification of inefficiencies and opportunities to create a more effective process.
  • Development of predictions of how long tasks should take to perform and balancing of sub-tasks.
  • Tracking of the time it takes to complete each sub-task in a larger task to help with predictions of how long the overall task should take to perform. In addition, it can be used to balance sub-tasks—if you have one sub-task that takes five minutes and another sub-task that takes ten minutes, you would need two people performing the ten-minute sub-task to keep up with one person working on the five-minute sub-task.
Formative usability testing

Progress product design rapidly with insights gleaned from small-scale iterative usability testing and prepare for future validation. Formative usability testing identifies what works well and what does not in an interface or product and why issues occur.

When is it used?

Formative usability testing is conducted iteratively throughout the early stages of product development on stimuli from sketches to prototypes, and the instructions for use (IFU) and packaging as part of the product system (IFU design, iterative testing of IFUs, packaging, differentiation studies, etc.).

Research questions answered:
  • Discovery of usability issues and understanding of why they occur to inform design decisions.
  • Early and continuous feedback to allow development teams to improve initial designs and create well-crafted experiences.
  • Behavioral observation offering insights about the experience of the product, removing opinion and reporting bias.
  • Reduction of the risk of product failure in the market.
Heuristic evaluations

Focus future research and create a foundation for comparative analyses with an assessment of the extent to which a design complies with or violates heuristics. Heuristic evaluations measure a design against predetermined, recognized usability principles.

When is it used?

Heuristic evaluations are conducted in the early to middle stages of product development.

Research questions answered::
  • Identification of usability issues and indication of heuristic violations with actionable solution recommendations.
  • Development of a usability baseline for comparative analyses.
Benchmarking

Understand how the usability of your product compares to predicate or similar products by conducting benchmarking studies. Benchmarking measures a product’s user experience in comparison to a preceding version of the product, competitors, industry standards, or determined goals.

When is it used?

Benchmarking is performed at the end of the product development lifecycle on a fully developed design.

Research questions answered:
  • Health assessment of the core product experience.
  • Establishment of the product’s baseline usability by which to measure future iterations.
  • Measurement of improvements and documentation of objectives and key results (OKR) to track changes over time.
  • Insight into a product’s standing in the market to assess competitive advantages, disadvantages and opportunities.
  • Prioritization of improvements to inform the product roadmap.
Human factors validation testing

Validate that your medical device can be used safely and effectively by its intended users, for its intended uses in its intended use environments. Human factors validation testing focuses on evaluating the critical tasks as defined by a product’s use-related risk analysis. A human factors validation test is a specific type of summative usability test.

When is it used?

Human factors validation testing is conducted at the end of product development on a fully functioning product.

Research questions answered:
  • Assessment if a device is safe and effective for use with any remaining risk as residual.
Longitudinal Studies

Understand how behaviors and use are shaped over time. Longitudinal studies can start at many different points, from the initial unboxing of a product to evaluating a design concept, and understand how users change, adapt or improve use over time. These studies can be iterative in nature and typically involve interviewing the same users over weeks or months.

When is it used?

Longitudinal studies are used throughout the entire product or design lifecycle.

Research questions answered:
  • Rich, in-depth understanding of users’ context of use and environment over a period of time.
  • Changes in user attitudes and/or understanding with experience and exposure
  • A glimpse into understanding how a novice becomes an expert

What is our output?

Our human factors reporting reflects your needs. We frequently work with manufacturers in the heavily regulated healthcare space with strict guidance on research reports. We also produce data-driven design recommendations in a variety of fidelities and formats from task flows and journey maps to 8-section HFE/UE reports .  

For medical device manufacturers, industry standards and regulatory guidance demand validation of safe and effective use through application of human factors engineering and usability engineering (HFE/UE). We have been applying HFE/UE to medical device development longer than the FDA has been regulating it! Our research is conducted according to the guidelines found in IEC 62366-1, TR 62366-2, FDA Guidance on applying HFE/UE to medical device development, AAMI HE75, and other standards wherever appropriate. 

ANSI/AAMI/IEC 62366-1; TR 62366-2

62366-1 specifies a process for a manufacturer to analyze, specify, develop and evaluate the usability of a medical device as it relates to safety. 62366-2 provides guidance for those implementing the process described in 62366-1.

FDA Guidance on applying HFE/UE

FDA guidance on applying human factors and usability engineering to medical devices intended to maximize the likelihood that new medical devices will be safe and effective for the intended users, uses and use environments.

ANSI/AAMI HE75

Human factors engineering – Design of medical devices. Covers general HFE principles, specific HFE principles geared towards certain UI attributes, and special applications of HFE (e.g., software UI, mobile medical devices, hand tools).

 

Human factors research insights

BLOG

CASE STUDIES

4 make-or-break considerations for health IoT ecosystems

All too often, medical device manufacturers roll out Internet of Things (IoT) devices that struggle to satisfy users and be adopted at scale. That’s in part because health IoT doesn’t exist in a void. Each device fits into a broader ecosystem that includes other...

read more

CASE STUDIES

previous arrow
Assess feasibility of multi-fixed dose device for the treatment of Type 2 diabetes
Assess feasibility of multi-fixed dose device for the treatment of Type 2 diabetes

A pharmaceutical manufacturer was interested in obtaining empirical data and user feedback regarding the usability of a medication delivery system, including the devices, labeling, and IFU.

Assess usability of large volume autoinjector platform concept
Assess usability of large volume autoinjector platform concept

A pharmaceutical manufacturer was interested in collecting data to inform the development of a large-volume autoinjector and its accompanying IFU and labeling.

Conduct global ethnography of hospital laboratory workflows
Conduct global ethnography of hospital laboratory workflows

A healthcare company wanted to identify existing workflows of their laboratory equipment across global markets and determine opportunities for usability improvement.

Assess safety and usability of an autoinjector
Assess safety and usability of an autoinjector

A pharmaceutical manufacturer required a validation study to determine if an autoinjector and its related materials were safe and effective.

Apply mixed methods approach to explore user experiences and market trends in remote healthcare
Apply mixed methods approach to explore user experiences and market trends in remote healthcare

A wearable technology company wanted to understand the current telehealth landscape in hopes of identifying unexpected insights about the future of telehealth, particularly in the age of COVID-19.

Evaluating the usability of a digital therapy app designed to treat mental health disorders such as depression
Evaluating the usability of a digital therapy app designed to treat mental health disorders such as depression

A pharmaceutical company asked us to test the design preferences and usability of a mobile application designed as a 6-week treatment programme to help patients manage their depression

Evaluating the usability of a haematology analyser to improve Lab technician workflows
Evaluating the usability of a haematology analyser to improve Lab technician workflows

A medical device manufacturer asked us to evaluate the use of their haematology analysers in different settings and identify opportunities for improvement.

Improve usability of home monitoring system for patients with implanted pacemakers and defibrillators
Improve usability of home monitoring system for patients with implanted pacemakers and defibrillators

A medical device manufacturer asked us to evaluate the usability of a home monitoring device for individuals with pacemakers and defibrillators and explore ways to improve the product according to user needs and preferences.

Refine iterative design process to improve pharmaceutical instructions for use (IFU)
Refine iterative design process to improve pharmaceutical instructions for use (IFU)

A pharmaceutical company needed to evaluate the effectiveness of their instructions for use for a new product.

Refine iterative design process to improve pharmaceutical instructions for use (IFU)
Refine iterative design process to improve pharmaceutical instructions for use (IFU)

A pharmaceutical company needed to evaluate the effectiveness of their instructions for use for a new product.

Explore improvements and opportunities for next-gen injection device development
Explore improvements and opportunities for next-gen injection device development

A pharmaceutical manufacturer was exploring next generation improvements for currently available medication to treat osteoarthritis in the knee.

Assess usability of connected medical system app with pediatric population
Assess usability of connected medical system app with pediatric population

A pharmaceutical manufacturer wanted to use an existing connected system mobile app with a pediatric population.

Gauge acceptability of new drug formulation and device
Gauge acceptability of new drug formulation and device

A pharmaceutical manufacturer was simultaneously developing a liquid formulation for a drug (currently only available as a pill), as well as a new delivery device to administer this liquid formulation.

Assess usability of HCP portal and provide recommendations for new mobile app integration
Assess usability of HCP portal and provide recommendations for new mobile app integration

A pharmaceutical manufacturer wanted to improve the usability and usefulness of an existing HCP portal for a desktop and design a new mobile app version of the portal.

Evaluate utilization of mobile health record app
Evaluate utilization of mobile health record app

An innovative healthcare solutions company sought to test the usability of their electronic health record (EHR) mobile application.

Improve usability and messaging of news website and mobile app
Improve usability and messaging of news website and mobile app

A global biotechnology company wanted to assess the usefulness and usability of its informational website designed for clinicians.

Assess connected medical system usability and integration
Assess connected medical system usability and integration

A pharmaceutical manufacturer is developing an updated version of an existing, in-market system to help patients with medication adherence. As a connected medical system, both the existing product and new product have an accompanying mobile application.

Evaluate risk of redesigned surgical equipment
Evaluate risk of redesigned surgical equipment

A medical manufacturer had US-approved surgical equipment, but the current design was not working for some international markets.

Human factors training course designed for FDA
Human factors training course designed for FDA

The FDA reached out to the Human Factors and Ergonomics Society (HFES) to assemble a team of experts to provide a training course for the Division of Medication Error Prevention and Analysis (DMEPA) from the Center for Drug Evaluation and Research (CDER).

Human factors training course designed for medical device team
Human factors training course designed for medical device team

A global medical device manufacturer wanted to promote internal awareness of and appreciation for best practices in the application of human factors engineering to medical device development.

Assess safe and effective surgical mesh implantation procedure and packaging
Assess safe and effective surgical mesh implantation procedure and packaging

A manufacturer of surgical products had developed a new surgical mesh that provided various advancements in clinical outcomes, but also came with necessary adjustments to implantation procedure.

Identify customer journey for connected wearable medication delivery system
Identify customer journey for connected wearable medication delivery system

A pharmaceutical manufacturer sought to explore the ideal customer journey for a new connected wearable medication delivery system.

Assess safe and effective use of pediatric medical injection kit
Assess safe and effective use of pediatric medical injection kit

A pharmaceutical company required a validation study to determine if the preparation and administration of an injection kit requiring the reconstitution of a pediatric medication was safe and effective.

Refine packaging design to mitigate clinical workflow risk
Refine packaging design to mitigate clinical workflow risk

A manufacturer of surgical and delivery devices needed to better understand use cases around the deployment of their crash cart products in typical clinical environments.

Improve usability and safety of wearable pump for Type 2 Diabetes patients
Improve usability and safety of wearable pump for Type 2 Diabetes patients

A medical device manufacturer sought to evaluate the usability and safety of the patch pump and training with potential patients and healthcare providers.

Identify risks of pharmacy package design
Identify risks of pharmacy package design

A pharmaceutical manufacturer wanted to eliminate selection errors due to similar packaging.

Design research program for new drug delivery system
Design research program for new drug delivery system

This multi-study program of research used a combination of early iterative design studies and later formative studies to refine all elements of the drug delivery system.

Understand diabetes patient use and management with connected devices
Understand diabetes patient use and management with connected devices

A pharmaceutical company sought to understand how people with diabetes use technology to manage their disease.

Evaluate design of new infusion pump carrying accessory
Evaluate design of new infusion pump carrying accessory

A pharmaceutical manufacturer sought to improve the design and usability of a currently available pump carrying accessory.

Identify infusion pump training requirements for new user population
Identify infusion pump training requirements for new user population

A pharmaceutical company planned to make an existing infusion pump available to a new patient population.

next arrow