{"id":3207,"date":"2025-07-17T14:32:14","date_gmt":"2025-07-17T06:32:14","guid":{"rendered":"http:\/\/cslds.org\/v5\/?p=3207"},"modified":"2026-08-19T14:23:46","modified_gmt":"2026-08-19T06:23:46","slug":"real-time-captioning-trial-scheme","status":"publish","type":"post","link":"https:\/\/cslds.org\/v5\/real-time-captioning-trial-scheme\/","title":{"rendered":"Real-time Captioning Trial Scheme"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large is-resized\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"449\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/title_eng-1-1024x449.png\" alt=\"\" class=\"wp-image-3236\" style=\"width:1024px;height:auto\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/title_eng-1-1024x449.png 1024w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/title_eng-1-300x132.png 300w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/title_eng-1-768x337.png 768w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/title_eng-1-18x8.png 18w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/title_eng-1.png 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Real-time Captioning Trial Scheme<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Objective<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By using different kinds of real-time captioning tools in the market, we aim to enhance the learning accessibility of students with different types of Special Education Needs (SEN), and reduce their barriers to classroom participation.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What is real-time captioning?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Real-time captions is a synchronous textual representation of the audio within media , which is generated by the engine through automatic speech recognition. This kind of system can enhance information accessibility of people with hearing impairment or people who experience difficulties in perceiving speech information in class, no matter in a face-to-face lecture or an online lesson.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Why captions?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the academic year 2020-21, with the support of TDLEG, The Centre for Sign Linguistics &amp; Deaf Studies (CSLDS) has conducted a 1-year pilot project to investigate whether real-time captioning is beneficial to students with special education needs. Six students with different kinds of special needs participated in the trial of real-time captioning in the lessons they chose and gave feedback on the service provided after trials. According to the feedback received, all of them found the system helpful in enhancing learning accessibility in class though the captions produced were not 100% correct. The results showed that not only students with hearing impairment (especially those with mild to moderate hearing loss), but also students with other types of SEN such as students with attention deficit benefitted from the real-time captioning service in the lecture. Students replied that they would like to continue using this service in the future and recommend other students with similar special educational needs to try using the system in the lessons.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Benefits of real-time captions:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Enable students to track back information which they have missed in the real time learning process.<\/li>\n\n\n\n<li>Improved classroom engagement due to reduced information loss during the lessons, resulting in better online and offline classroom experience.<\/li>\n\n\n\n<li>Improved information retention and better concentration of students in class when both visual (captions) and oral mode of instructions are provided.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Limitations of real-time captions:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Accuracy of real-time captions done by stenographers can reach almost 100% accuracy, but it is costly and hard to find service providers locally.<\/li>\n\n\n\n<li>Real-time captions provided in the service are generated through automatic speech recognition, which is much cheaper, but no 100% accuracy can be expected.<\/li>\n\n\n\n<li>Mainly acts as a supporting tool for deaf and hard-of-hearing students. However, other supporting services including sign language interpretation and note-taking service are still necessary for students with severe to profound hearing impairment, to reduce information loss in the classrooms.<\/li>\n\n\n\n<li>Each real-time captioning tool\/ mobile application has its limitations (e.g. language use, display method, control system, etc.)<\/li>\n<\/ul>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>How to get captioning support for your lessons?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There are different methods of captioning used for lessons with different modes of delivery: face-to-face or online lessons (ZOOM).<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>1) Online lessons<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Auto-captioning as a built-in function can be found in most of the online meeting applications such as Google Meet, Microsoft Teams, and ZOOM and the operation is simple. As ZOOM is a popular online teaching system. The procedure to switch on the auto-captioning function of ZOOM is shown in the short video below.<\/p>\n\n\n\n<figure class=\"wp-block-video\"><video height=\"768\" style=\"aspect-ratio: 1364 \/ 768;\" width=\"1364\" controls src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/ZoomDemoVideo.mp4\"><\/video><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Once the function is on, all participants in the ZOOM meeting room (i.e. students) can see the captions generated automatically from the system.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong><strong>2) Face-to-face lessons<\/strong><\/strong><\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">With some funding support this year, The Centre for Sign Linguistics and Deaf Studies will continue to provide real-time captioning to students with special education needs in order to alleviate their difficulties in class. The Centre continues to have a close contact with the Office of Student Affairs. In case students would like to receive real-time auto-captioning, they can contact the Centre or the Office of Student Affairs. We will meet with the students to understand the learning situation or difficulties first. With the consent of the course teacher, we make arrangements for the students to have a trial of the system in class. The students can borrow our wireless microphone (see Figure 1) and tablet for the captioning support if necessary. The use of wireless microphone is to make sure that the speech of course teachers received is intelligible enough, to increase the accuracy of the captions.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">The wireless microphone will be kept by the student his\/herself. He or she is responsible to pass the microphone to the course teacher every lesson. Course teachers can simply wear the wireless microphone in the lectures for sound input. On the other hand, the students have to connect the receiver of the microphone to their electronic device (e.g. mobile phone or tablet). Teachers\u2019 speech will be transcribed to written text and generated through the system for the students. The students can further contact the Office of Student Affairs for long-term usage if they are satisfied with the quality of the captions.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure data-wp-context=\"{&quot;galleryId&quot;:&quot;6aef6cfc31558&quot;}\" data-wp-interactive=\"core\/gallery\" class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6aef6cfc31b32&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6aef6cfc31b32\" class=\"wp-block-image size-large wp-lightbox-container\"><img decoding=\"async\" width=\"1024\" height=\"810\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on--pointerdown=\"actions.preloadImage\" data-wp-on--pointerenter=\"actions.preloadImageWithDelay\" data-wp-on--pointerleave=\"actions.cancelPreload\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" data-id=\"3210\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/mic-1024x810.png\" alt=\"\" class=\"wp-image-3210\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/mic-1024x810.png 1024w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/mic-300x237.png 300w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/mic-768x607.png 768w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/mic-15x12.png 15w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/mic.png 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\tdata-wp-bind--aria-label=\"state.thisImage.triggerButtonAriaLabel\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.thisImage.buttonRight\"\n\t\t\tdata-wp-style--top=\"state.thisImage.buttonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n<\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Fig. 1 Wireless Microphone Set<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-2 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"724\" data-id=\"6981\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_2_en-1024x724.jpg\" alt=\"\" class=\"wp-image-6981\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_2_en-1024x724.jpg 1024w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_2_en-300x212.jpg 300w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_2_en-768x543.jpg 768w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_2_en-18x12.jpg 18w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_2_en.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Fig 2 Process of Applying and Using Real-time Captioning Service<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">A set of microphone with two transmitters is recommended to use in class. One transmitter is to pick up the speech of the course instructor during the lecture and the other one can be passed among students when there are Q&amp;A sessions or group discussions.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"724\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_3_en-1024x724.jpg\" alt=\"\" class=\"wp-image-6980\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_3_en-1024x724.jpg 1024w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_3_en-300x212.jpg 300w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_3_en-768x543.jpg 768w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_3_en-18x12.jpg 18w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2026\/08\/captioning_3_en.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Fig 3 Example Scenario of Using Two Transmitters<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">In face-to-face lessons, the setting is different from online lessons. There are many different auto-captioning applications in the market that students can choose to use as the tool for auto-captioning. Here is the information some of the applications we suggested to use:<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-border-color has-ast-global-color-0-border-color\" style=\"border-width:1px\"><tbody><tr><td><\/td><td><strong>Name of Applicaiton<\/strong><\/td><td><strong>Name of Applicaiton Language Available (Only major languages used in lecture are listed)<\/strong><\/td><td><strong>Details<\/strong><\/td><\/tr><tr><td>1<\/td><td>Group Transcribe<br><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" class=\"wp-image-3213\" style=\"width: 150px;\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/grouptranscribe.jpg\" alt=\"\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/grouptranscribe.jpg 200w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/grouptranscribe-150x150.jpg 150w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/grouptranscribe-12x12.jpg 12w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td><td>Cantonese, Putonghua, English and other languages<\/td><td><ul><li>A mobile application<\/li><li>Only available in iOS<\/li><li>Allow multiple speakers<\/li><li>Need to create a new section for every 30 mins<\/li><\/ul><\/td><\/tr><tr><td>2<\/td><td>Otter.ai<br><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"114\" class=\"wp-image-3215\" style=\"width: 150px;\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/otter.png\" alt=\"\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/otter.png 200w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/otter-16x12.png 16w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td><td>English only<\/td><td><ul><li>A mobile application \/ Web-based (<a href=\"https:\/\/otter.ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/otter.ai\/<\/a>)<\/li><li>Free version has a limitation of usage for each account (Limits: 40 mins\/section; 600 mins\/month)<\/li><\/ul><\/td><\/tr><tr><td>3<\/td><td>Live Transcribe<br><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"153\" class=\"wp-image-3214\" style=\"width: 150px;\" src=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/livetranscribe.jpg\" alt=\"\" srcset=\"https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/livetranscribe.jpg 200w, https:\/\/cslds.org\/v5\/wp-content\/uploads\/2025\/07\/livetranscribe-12x12.jpg 12w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/><\/td><td>Cantonese, Putonghua, English and other<\/td><td><ul><li>A mobile application<\/li><li>Only available in Android<\/li><li>NOT able to save the transcript<\/li><\/ul><\/td><\/tr><tr><td>4<\/td><td>Voice Input for iOS<\/td><td>Cantonese, Putonghua, English and other<\/td><td><ul><li>Only available in iOS<\/li><\/ul><\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Table 1 List of Real-time Auto-captioning Applications<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Application Method<\/strong><\/p>\n\n\n\n<div>\n   <iframe class=\"captioning-iframe\" src=\"https:\/\/cloud.itsc.cuhk.edu.hk\/mycuform\/view.php?id=1438718\" style=\"width: 100%; height: 600px; border: none;\"><\/iframe>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">For more information, please contact us. (Email:&nbsp;<a href=\"mailto:cslds@arts.cuhk.edu.hk\">cslds@arts.cuhk.edu.hk<\/a>&nbsp;Phone: 3943 4178)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We utilizes different kinds of real-time captioning tools in the market to enhance the learning accessibility of students with different types of Special Education Needs (SEN), and reduce their barriers to classroom participation.<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"template-content-canvas.php","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"footnotes":""},"categories":[48],"tags":[],"table_tags":[],"class_list":["post-3207","post","type-post","status-publish","format-standard","hentry","category-online-resources"],"blocksy_meta":[],"acf":[],"_links":{"self":[{"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/posts\/3207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/comments?post=3207"}],"version-history":[{"count":20,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/posts\/3207\/revisions"}],"predecessor-version":[{"id":6990,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/posts\/3207\/revisions\/6990"}],"wp:attachment":[{"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/media?parent=3207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/categories?post=3207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/tags?post=3207"},{"taxonomy":"table_tags","embeddable":true,"href":"https:\/\/cslds.org\/v5\/wp-json\/wp\/v2\/table_tags?post=3207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}