Video Transcript
Quality of closed captioning
The availability and quality of closed captioning are equally important for viewers who are Deaf or hard of hearing, since poorly captioned programming can also be inaccessible. Errors in captioning can make the content incomprehensible. These can range from errors that omit details or deviate from the verbatim, to those that lose the main meaning of what is being said, or present nonsense. Moreover, it can be disruptive if there is too much of a lag between what is spoken onscreen and the closed captioning. High quality captions are those that can be accurately compared to the experience of a hearing viewer.
Television broadcasters are required to abide by mandatory quality standards when providing closed captioning. These differ depending on the language of the content and whether the content is pre-recorded or live.
For pre-recorded programs, traditional broadcasters must reach a captioning accuracy rate of 100% (i.e., verbatim, including spelling).
Closed captioning of live English-language programming must reach an accuracy rate of 98 based on the NER point system, which must be assessed by a certified NER evaluator,footnote 1 as set out in Broadcasting Regulatory Policy 2019-308. The NER measures the accuracy of captions by comparing the caption viewer’s experience with that of the hearing viewer. The NER model is based on (1) the Number of words, (2) Edition errors, where a difference arises from a choice made by the captioner to paraphrase the verbatim speech, and (3) Recognition errors, where the captioner, or the software used by the captioner, delivers a caption word that is wrong, misspelled, or garbled. NER evaluation begins with the preparation of a verbatim transcript and a caption transcript for ten minutes of live-captioned content in a television program. The NER evaluator then scores captions by comparing the two transcripts and assigning an “error” type – with its score deduction – to any differences.
Conversely, as set out in Broadcasting Regulatory Policy 2011-741-1, closed captioning of live French language programming must reach an accuracy rate of 85% using a specific formula.footnote 2
The accuracy rate and measurement models for English- and French-language live programming were based on proposals by working groups composed of representatives of associations and advocacy groups for people who are Deaf or hard of hearing, closed captioning providers and broadcasters.
In addition to the accuracy rates set out above, licensees are required to adhere to other mandatory quality standards in regard to lag time, on-screen positioning, speed, and captioning format.
In light of the above, the Commission seeks comments on the following:
Q5 . Keeping in mind the nature of pre-recorded content, why would 100% accuracy rate not be appropriate for English- and French-language pre-recorded programs?
Q6 . How should captioning accuracy be measured for live programs?
(a) What should be the captioning accuracy rate for live programs?
(b) Does there need to be a different captioning accuracy rate for English- and French-language live programs?
Q7 . Should there be standards related to quality measures other than accuracy, such as lag time, on-screen positioning, speed and captioning format for pre-recorded and live programs?
Footnotes
Footnote 1
The Canadian Broadcast Standards Council oversees the certification process for NER evaluators in Canada. Canada is the only country that currently uses the NER model in its regulation of closed captioning.
Return to footnote 1 referrer
Footnote 2
The formula is as follows: % of accuracy = [number of words in the audio – number of suppressed words (words present in the audio but absent from the captions) – number of substituted words (words in the audio replaced with other words in the captions) – number of inserted words (words present in the captions but absent from the audio) x 100] ÷ number of words in the audio.
Return to footnote 2 referrer