Passing and Failing (Assigning Checkpoint Results)

Link to Passing and Failing (Assigning Checkpoint Results) copied to clipboard

Assigning checkpoint testing results for a page under test is done on the individual checkpoint screen with the use of the No Result, Pass, Fail, and N/A buttons that appear at the top, right of the body area of the screen. Individual Checkpoint screen

Individual checkpoint screens are accessed during the manual testing of a specific "page under test" that is a part of a particular test run. Marking a result for a checkpoint test serves as completion of the checkpoint for that page only, and each individual checkpoint must have a result in order for manual testing for the page to be considered complete. Similarly, after results are assigned for all checkpoint tests for all pages that have been added to a test case run, the test run status is 'complete'.

Important Related Topic: Before you begin assigning results, it is important for you to have a good understanding of the concepts involved with testing results and their implications on completion status and checkpoint navigation.

To update status for a checkpoint, navigate to the Test Unit Overview (Checkpoints Tests for Page(Component): <Page/Component Name>) screen and select a checkpoint. The status can be updated by activating the appropriate button for status. Various statuses are described below:

  • No Result: By default, the No Result button is selected for all checkpoints.
  • Pass: Marked with a green check mark ✔ icon (for example, to indicate the page meets MUST requirements). When there is at least one accessibility issue (not a violation), a checkpoint cannot be passed.
  • Fail: Marked with a red X icon. You must first add an accessibility issue to fail the test. For more information, see Adding an Issue (Checkpoint-Specific).
  • N/A: Selecting the Not Applicable result gives a status of "Done" and displays a popup window with an optional field in which you can enter and save reason(s) the checkpoint does not apply to the page under test.