Automated vs. Manual Testing

Link to Automated vs. Manual Testing copied to clipboard

Process flow chart diagram from Start Testing on Test Run Overview

  • Automated: Issues are logged automatically. Tests run automatically against Deque's accessibility rules engine axe-core. It employs a premier JavaScript library developed and supported by Deque that leverages more than 20 years of accessibility experience. Automated tests can be set to run against specific impact levels and standards, such as WCAG 2.1 Level A/AA, WCAG 2.0 Level A/AA, or the Air Carrier Access Act (ACAA). Rule violations generate issues logged into appropriate corresponding checkpoint tests, with the ability to edit them according to your unique requirements. For more information, see Automated Testing Overview.

  • IGT: You have the ability to import issues generated in the axe DevTools extension (requires Pro subscription). Issues generated using the Intelligent Guided Tests in the extension appear under the IGT category in axe Auditor.

  • Manual: Issues are logged manually by testers who follow recommended testing methodologies for each checkpoint. Issue entry includes the ability to record detailed notes, source code, and upload screenshots. You are able to specify the scope of what is to be tested (a whole page, page area, component, or specific content), as well as which elements will be targeted or ignored (forms, video, audio, CAPTCHA, or flashing content). Similarly, the issues logged can not only be associated with various checkpoints, but also issue types, and impact severity levels you specify.

    Note: Your organization's unique implementation of axe Auditor may have a customized set of manual testing checkpoints, rules, and/or related methodologies that are based on specific accessibility testing and quality assurance requirements. These may be limited to a specific industry, country, and/or region; and may focus on particular laws, guidelines, and/or standards such as WCAG 2.1, WCAG 2.0, WAI-ARIA, ATAG, ADA,Section 508, CVAA or UAAG. The portions of this documentation related to manual testing are somewhat generic and may not be appropriate if this is the case. Consult your leadership for documentation tailored to your organization's unique manual testing requirements.