{"id":8198,"date":"2026-03-18T02:22:34","date_gmt":"2026-03-17T17:22:34","guid":{"rendered":"https:\/\/uism.co.jp\/?p=6426"},"modified":"2026-04-13T14:00:51","modified_gmt":"2026-04-13T05:00:51","slug":"sample-size-and-test-environment-requirements-for-pmda-hfe-submission-a-practical-guide-for-validation-studies-in-japan-2","status":"publish","type":"post","link":"https:\/\/uism.co.jp\/en\/blog\/sample-size-and-test-environment-requirements-for-pmda-hfe-submission-a-practical-guide-for-validation-studies-in-japan-2\/","title":{"rendered":"Sample Size and Test Environment Requirements for PMDA\u00a0HFE\u00a0Submission: A Practical Guide for\u00a0Validation Studies in Japan\u00a0"},"content":{"rendered":"\n

PMDA\u2019s overall HFE mindset is aligned with international regulatory frameworks, but expectations in certain areas can differ. In particular, PMDA takes a distinct approach to topics such as sample size determination and test environment considerations. This guide outlines key points based on the implementation of JIS T 62366-1:2022 and current PMDA expectations. <\/p>\n\n\n\n

Sample Size<\/strong> <\/span><\/h2>\n\n\n\n

PMDA does not specify a minimum sample size requirement<\/strong>.<\/strong>  Unlike regulatory frameworks that mandate specific participant counts (e.g., “15 per user group”), Japan’s approach centers on rational justification rather than numerical compliance.  <\/p>\n\n\n\n

Evaluation Criteria <\/span><\/h3>\n\n\n\n

PMDA evaluates sample size adequacy across three dimensions: <\/p>\n\n\n\n

\n

1. User Representativeness<\/strong> <\/h4>\n\n\n\n
    \n
  • Appropriate representation of intended user types (physicians\/nurses\/patients\/general users) <\/li>\n\n\n\n
  • Adequate distribution across experience levels (novice vs. experienced users) <\/li>\n\n\n\n
  • Alignment with actual use environments (hospital vs. home use settings) <\/li>\n<\/ul>\n<\/div>\n\n\n\n
    \n

    2. Coverage of Hazard-Related Use Scenarios<\/strong> <\/h4>\n\n\n\n
      \n
    • Comprehensive testing of critical use errors identified through JIS T 14971 risk analysis <\/li>\n\n\n\n
    • Evaluation of operational and decision-making scenarios where errors could manifest <\/li>\n<\/ul>\n<\/div>\n\n\n\n
      \n

      3. Rational Justification<\/strong> <\/h4>\n\n\n\n
        \n
      • Logical explanation for why the selected sample size is adequate <\/li>\n\n\n\n
      • Consistency with existing knowledge, prior evaluations, or post-market data <\/li>\n<\/ul>\n<\/div>\n\n\n\n

        Conditions Supporting Smaller Sample Sizes <\/span><\/h3>\n\n\n\n

        Reduced sample sizes may be justified when the following conditions are met: <\/p>\n\n\n\n

          \n
        • Limited number of hazard-related use scenarios <\/li>\n\n\n\n
        • Simple operational sequences with minimal decision branches <\/li>\n\n\n\n
        • Comprehensive formative evaluation resulting in substantial design improvements <\/li>\n\n\n\n
        • Availability of supporting evidence from existing products, overseas validation data, or post-market surveillance <\/li>\n<\/ul>\n\n\n\n

          Conditions Requiring Larger Samples <\/span><\/h3>\n\n\n\n

          Certain device characteristics need either larger sample size or enhanced rational justification.  <\/p>\n\n\n\n

            \n
          • Software as a Medical Device (SaMD):<\/strong> Particularly when dependent on user judgment or data input interpretation <\/li>\n\n\n\n
          • Consumer\/patient-use devices:<\/strong> Non-professional user populations with variable skill levels <\/li>\n<\/ul>\n\n\n\n
              \n
            • Diagnostic or treatment-critical devices:<\/strong> Use errors that directly impact clinical decision-making <\/li>\n<\/ul>\n\n\n\n
                \n
              • Class III\/IV devices:<\/strong> Strict scrutiny on scenario selection rationale and residual risk acceptability <\/li>\n<\/ul>\n\n\n\n

                Documentation <\/span><\/h3>\n\n\n\n

                PMDA frequently identifies the following documentation deficiencies: <\/p>\n\n\n\n

                  \n
                • Arbitrary participant numbers without justification <\/li>\n\n\n\n
                • Failure to demonstrate user representativeness <\/li>\n\n\n\n
                • Inadequate scenario coverage <\/li>\n<\/ul>\n\n\n\n
                  \n

                  <\/path><\/svg><\/span><\/span> Example of Sample Size Rationale:<\/strong> 
                  This summative evaluation was conducted under conditions where anticipated use errors would manifest, targeting hazard-related use scenarios. The operations and decisions being evaluated are limited; therefore, it was determined that verification of use errors is achievable with a small number of participants.<\/em> <\/p>\n<\/div>\n\n\n\n

                  Test Environment Requirements<\/strong> <\/span><\/h2>\n\n\n\n

                  Access to medical facilities for external usability testing in Japan is limited, and dedicated usability laboratories are relatively rare. As a result, conference room settings with appropriate simulation elements are commonly used<\/strong> <\/strong>and generally accepted by PMDA. The agency does not require high-fidelity clinical simulation environments. <\/p>\n\n\n\n

                  What matters most is whether the evaluation environment allows researchers to realistically determine<\/strong> <\/strong>whether use errors may occur within hazard-related use scenarios.<\/strong> <\/p>\n\n\n\n

                  Evaluation Criteria <\/span><\/h3>\n\n\n\n

                  The primary criterion is whether the environment allows potential use errors to manifest under realistic conditions. PMDA evaluates whether: <\/p>\n\n\n\n

                    \n
                  • The evaluation focuses primarily on interface interaction and decision-making<\/strong>, where environmental dependency is relatively low. 
                    (e.g., button operation, screen transitions, understanding displayed information, recognizing alerts or warnings)<\/em> <\/li>\n\n\n\n
                  • Critical elements necessary for hazard-related scenarios are adequately reproduced.<\/strong> 
                    (e.g., operation flow, timing of information presentation, display conditions that could lead to misinterpretation or incorrect decisions)<\/em> <\/li>\n\n\n\n
                  • The study setup avoids over-idealized conditions that could mask potential use errors.<\/strong> 
                    (e.g., an excessively quiet environment, displays or controls positioned or emphasized in ways that make them easier to perceive or operate than in real use)<\/em> <\/li>\n<\/ul>\n\n\n\n

                    Use Environment Attribute Considerations <\/span><\/h3>\n\n\n\n

                    According to JIS T 62366-1 Section 3.2, the simulated use environment should reproduce attributes that could influence user performance. These may include: <\/p>\n\n\n\n

                      \n
                    • Physical Attributes:<\/strong> Hygiene requirements, lighting, ambient noise, temperature. <\/li>\n\n\n\n
                    • Social Attributes:<\/strong> Team vs. individual use, organizational chaos vs. order, stress levels, work duration. <\/li>\n<\/ul>\n\n\n\n

                      The goal is to simulate attributes that directly affect the potential for use errors, rather than achieving complete environmental fidelity. <\/strong> <\/p>\n\n\n\n

                      \"Sketch
                      Sketch of actual setting<\/em>\u00a0<\/figcaption><\/figure>\n\n\n\n

                      Documentation <\/span><\/h3>\n\n\n\n

                      PMDA frequently identifies the following documentation deficiencies: <\/p>\n\n\n\n

                        \n
                      • Absence of environment justification <\/li>\n\n\n\n
                      • Over-idealized conditions without acknowledgment <\/li>\n\n\n\n
                      • Missing critical environmental factors <\/li>\n<\/ul>\n\n\n\n
                        \n

                        <\/path><\/svg><\/span><\/span> Example of Test Environment Rationale:<\/strong> 
                        This summative evaluation was conducted to reproduce conditions where use errors in hazard-related use scenarios would manifest. Although a conference room was used, operational procedures, information presentation, and decision conditions were configured to be equivalent to the actual use environment.<\/em> <\/p>\n<\/div>\n\n\n\n

                        Conclusion <\/span><\/h2>\n\n\n\n

                        PMDA\u2019s approach to sample size and test environment requirements places strong emphasis on well-reasoned justification. Successful submissions clearly explain how study design decisions align with the device\u2019s risk profile and integrate with JIS T 14971 risk management documentation, demonstrating that the chosen validation approach is appropriate for the device and its intended use context and provides sufficient evidence that potential use errors have been adequately evaluated.  <\/p>\n\n\n\n

                        Uism offers end-to-end support for planning, conducting, and interpreting usability studies in Japan. Whether you are looking to validate your device with local users, strengthen your global HFE\/UE documentation, or gain a deeper understanding of how your product is used in the Japanese context, we help bridge the gap between global standards and local regulatory expectations. Let\u2019s connect! <\/p>\n\n\n\n

                        *This guide is based on JIS T 62366-1:2022 requirements and current PMDA regulatory expectations as of 2024-2025. Manufacturers should engage qualified regulatory consultants for device-specific guidance.<\/em>\u00a0<\/span><\/p>\n\n\n\n

                        <\/p>\n","protected":false},"excerpt":{"rendered":"

                        PMDA HFE submission in Japan: learn sample size justification, test environment requirements, and practical validation study points for medical device usability.<\/p>\n","protected":false},"author":29,"featured_media":6424,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_locale":"en_US","_original_post":"https:\/\/uism.co.jp\/?p=6422","footnotes":"","wp-seo-meta-description":"Practical guide to PMDA HFE validation in Japan covering sample size justification, usability testing environments, and key expectations under JIS T 62366-1 for regulatory submission success","wp-seo-meta-robots":[]},"categories":[175],"tags":[165,268,403,404,405,406,407,408,409,410],"class_list":{"0":"post-8198","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-medical-healthcare","8":"tag-ux-research","9":"tag-human-factors-engineering","10":"tag-jis-t-62366-1","11":"tag-medical-devices-japan","12":"tag-pmda-hfe","13":"tag-regulatory-submission","14":"tag-risk-management","15":"tag-sample-size-justification","16":"tag-test-environment-design","17":"tag-usability-testing","18":"en-US","19":"c-entry"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/posts\/8198","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/comments?post=8198"}],"version-history":[{"count":3,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/posts\/8198\/revisions"}],"predecessor-version":[{"id":9368,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/posts\/8198\/revisions\/9368"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/media\/6424"}],"wp:attachment":[{"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/media?parent=8198"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/categories?post=8198"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/uism.co.jp\/wp-json\/wp\/v2\/tags?post=8198"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}