Skip to main content
European Digital Innovation Hubs Network

Field testing methodology in healthcare

Field testing methodology in healthcare banner
Field testing methodology in healthcare
Published at 04 December 2024 | Sweden

General details


Services provided
Test before invest
Technologies
Artificial Intelligence & Decision support
Sectors
Health care

Challenges

In the healthcare sector, the adoption of new technologies and innovations can be challenging due to the critical nature of patient care and the need for rigorous validation of any new processes or tools. Field testing, therefore, plays a crucial role in mitigating risks by providing a structured and safe environment where technologies can be evaluated under real-world conditions. Field testing is essential not only for ensuring the efficacy and safety of innovations but also for generating documented insights that inform future decision-making. Field testing empowers healthcare providers and innovators to collaborate closely, ensuring that both supply and demand sides benefit from the process, ultimately leading to more tailored and impactful solutions.

EDIH Health Data Sweden identified several challenges that the healthcare sector faces in relation to field testing:

  • A need for comprehensive and structured field testing in a safe and secure setting.

  • The necessity of thorough documentation of results and data collection for future reference.

  • SMEs often struggle to engage with testing processes, while personnel may be uncertain about how to implement such a process effectively.

  • The need to foster interaction and generate new insights between SMEs and PSOs, from both the supply and demand sides.

Solutions

The Field test methodology consists of a structured 3-step process, templets for planning and documentation as well as a checklist for support.

Field Testing MethodologyStep 1 Preparation: Plan and set the framework for the tests to be performed. What should be tested, how should it be tested and who should test? Success factors for the test to contribute to the desired result with wide distribution are that clear plans, such as test, communication plan and risk analysis are drawn up, as well as broad participation and support among those concerned.

Step 2 Implementation: During implementation, the planned test is performed. The test plan helps you keep track of purpose and goals, time, activities and resources, as well as what needs to be verified. The test leader uses a status report to communicate the test's progress. Key events, both positive and negative, are documented. Together they contribute to the story and to describe the progress of the test and the result at the end. Key events should be timed to make clear when in time they occurred, e.g. early, or at the end.

Step 3 Finish: The last phase marks the end of the test and the summation of the test results. The final report compiles the results of the test in their entirety. The final report must be descriptive and in itself give the reader an understanding of the purpose and implementation of the test, regardless of whether he participated in the test or not. The final report constitutes a public document and must be able to be used for the purpose of dissemination and scaling.

The investment needed is dependent on the purpose, size and length of the test. The methodology of Field test can be integrated in to any process such as benchmarking, needs analysis or procurement. Therefore, the rational for investment isn't decided by the test itself, but by the purpose of it. The PSO can fund the test as a whole, but costs can also be handled by each party. However, limitation in scope and time frame is key. A test is a test.

Results and Benefits

The documented results of the field test serve as a crucial foundation for informed decision-making. These results can guide key decisions, such as selecting the appropriate technology for a specific area, initiating a procurement process, or exploring alternative approaches. By providing concrete evidence of performance and outcomes, the documentation empowers decision-makers to choose solutions that best meet their needs.

  • Furthermore, these results can be leveraged for broader dissemination to other stakeholders, extending the impact beyond the immediate testing environment. Sharing insights and findings helps to inform and inspire others, encouraging the adoption of successful practices and technologies across similar organisations or sectors.

  • The dissemination of proven or newly developed digital solutions and technologies within the testing organisation itself is another significant benefit. This process not only accelerates the adoption of these innovations but also promotes a culture of continuous improvement and technological advancement.

  • The documented results play a vital role in enhancing staff knowledge and confidence in utilising data and digital tools, particularly within the health sector. By engaging with the test outcomes, staff members gain practical experience and a deeper understanding of how to effectively apply these tools in their daily work, ultimately leading to better service delivery and outcomes.

  • The field test has the potential to broaden perspectives on the use of technology for both PSOs and SMEs. By exploring the technology's capabilities in a real-world context, both parties can gain new insights into its application, uncovering innovative ways to leverage the technology for greater impact and efficiency. This collaborative learning process fosters a deeper appreciation of the technology's potential and encourages more strategic and creative use of digital solutions.

Perceived social/economic impact

Carrying out field testing brings a set of benefits, such as:

  • Innovations that better meet users' needs:

    Field testing provides a real-world environment to evaluate how innovations perform under actual conditions, offering invaluable insights into user behavior and preferences. By directly observing how end-users interact with a product or service, developers can fine-tune features to better meet their needs.

  • Streamlining and increased efficiency through increased dissemination of digital technology:

    Conducting field tests helps organisations identify opportunities to streamline operations by integrating digital technologies. By experimenting with these technologies in a controlled setting, organisations can assess their impact on efficiency, from reducing manual tasks to optimising workflows. The insights gained from field testing can drive the wider dissemination and adoption of digital tools, leading to more efficient processes, reduced operational costs, and improved overall performance.

  • Building trust in technology and empowering users with confidence:

    Field testing plays a crucial role in building trust in new technologies by demonstrating their reliability, security, and effectiveness in real-world scenarios. When users see firsthand how the technology functions and delivers on its promises, their confidence in using it grows. Additionally, field testing offers the opportunity to provide training and support, helping users become more familiar with the technology. As a result, they feel more empowered and competent, which leads to greater engagement and more successful implementation of the technology in their daily activities.

Measurable data

  • 4 digital services have been tested.

  • 24 tests have been conducted.

  • Tested digital services have scaled to new areas and use within the public sector organisations.

  • More units and departments within a PSO have started using services that have already been procured.

  • Streamlining of existing work processes.

Lessons learned

  • Clearly describe the purpose and context of the test: Articulate the objectives and the broader context in which the test is being conducted, ensuring that all stakeholders are aligned, expectations are managed, and the test is designed to yield meaningful and relevant results.

  • Ensure strong anchoring with an appointed project owner who has a clear mandate: The success of the test relies heavily on having a dedicated project owner who is clearly designated and empowered with the authority to oversee the test.

  • Limit the scope and time frame: A test is a test: Keep the scope and time frame of the test tightly controlled. The very nature of a test is to explore a specific hypothesis or solution within defined boundaries. By limiting the scope, the test remains manageable, allowing for a focused evaluation without the risk of overextending resources or diluting the findings.

  • Adjust risk tolerance based on the amount of available information: Remember that a larger risk can be taken with more information on the table, and a smaller risk when the information is limited.

  • Stakeholder Commitment: SME and PSO Participation with Their Own Resources and Funding: Is important that both SMEs and PSOs commit their own resources and funding, fostering a sense of ownership and ensures that both parties are fully engaged and motivated to achieve successful outcomes.

  • Experimental thinking does not mean lack of structures or boundaries for the test: Even in experimental settings, a clear framework and set parameters are necessary to ensure that the test is conducted systematically and yields actionable insights.

  • Achieve consensus among all parties on the purpose and scope of the test: Before the test begins, it is essential that all involved parties reach a mutual agreement on the test's purpose and scope. This consensus is critical to ensuring that everyone is working towards the same objectives, reducing the risk of of misunderstandings or misaligned expectations.

Need support?

Consult our catalogue to locate the Eupopean Digital Innovation Hub nearest to you and accelerate your company's digital transformation.

Find my nearest EDIH