Sc1 2 2 Video Element

Please note, this is a draft

Description

This test checks captions in video elements with a track element. So, this one test the quality of the given captions. Note that instead of a pass or fail, we could also return a graded rating scheme. This can be the case if for example emotions are captured, and only one emotion is forgotten. We could return a 90% pass?

“BITV-Test, a German web-based accessibility evaluation tool which in its latest revision is a WCAG 2.0 test in all but name, takes a different approach. Its checkpoints that have graded rating scheme that offers five grades: from a clear “pass” (100%) via intermediate steps to a clear “fail” (0%). “ http://www.bitvtest.de/infothek/artikel/lesen/talking-head-captions.html

Background

Assumptions

Test properties

Property Value
Success Criterion 1.2.2
Test mode SemiAuto
Test environment DOM and CSS + media API
Test subject DOM document fragment
User expertise and skills No prior knowledge
User profile For manual tests only: any additional requirements, such as language skills, use of AT etc.

Test procedure

Selector

Test mode: automatic

video element containing a track attribute

Step 1

Test mode: automatic

Track element contains kind attribute with value captions

If the step returns true, go to step 3 with the value of src

Step 2

Test mode: automatic

Track element contains kind attribute with value subtitles

Note: success criterion doesn’t take into account language changes. So it is valid to have spoken text in language 1, subtitles in language 2 and page content in language 3. We prefer captions as they include non-spoken text as well

Step 3

Test mode: automatic

src contains file

Outcome Failed
Testcase SC 1.2.2 video
Error no caption file provided with the video

Step 4

Test mode: automatic

File content contains time codes and text

Outcome Failed
Testcase SC 1.2.2 video
Error empty caption file provided with the video

Step 5

Test mode: automatic

file contains valid time and text combinations

Outcome Failed
Testcase SC 1.2.2 video
Error no valid caption data provided with the video

Step 6

Test mode: automatic

For each spoken audio fragment a timecode and text exists

Outcome Failed
Testcase SC 1.2.2 video
Error Not all dialogs are covered in the captions

Step 7

Test mode: automatic

For each spoken audio fragment the content of the spoken text has the same meaning as the caption text

Outcome Failed
Testcase SC 1.2.2 video
Error The text of the captions doesn’t correspond to the spoken text

Step 8

Test mode: automatic

Check to see is a speaker is presented in a fixed frame with unchanging background (‘talking head’ video).

For each frame check if the image is similar to the other frames.

Outcome Passed
Testcase SC 1.2.2 video

NOTE: not sure if we should add this step, but if this step can be done fully automatic with frame scanning, we can skip additional manual steps.

Step 9

Test mode: manual

Check for each sound if it is important and has a timecode and descriptive text

Outcome Failed
Testcase SC 1.2.2 video
Error Important sound not explained in the caption
Pointer video-id and timecode

Step 10

Test mode: manual

Check for each background fragment if it is important and has a captioned text

Outcome Failed
Testcase SC 1.2.2 video
Error Location not explained in the caption
Pointer videoid and timecode

Step 11

Test mode: manual

Check for each speaker fragment if it has a captioned identification

Outcome Failed
Testcase SC 1.2.2 video
Error Speaker not identified in the captions

Step 12

Test mode: manual

Check for each emotion if it is important and has a captioned text

Outcome Failed
Testcase SC 1.2.2 video
Error Emotion not explained in the caption
Outcome Passed
Testcase SC 1.2.2 video