Closed haptioning: A demonstration of using mid-air haptics for improving accessibility of audio-visual content beyond closed captions and audio description
Authors: D. Hajas; D. Pittera; M. Obrist
Published: Proceedings of the International Conference on Human Haptic Sensing and Touch Enabled Computer Applications (EuroHaptics 2020). Springer (2020)
Abstract
Closed captions and audio description became the de facto method of creating accessible audio-visual content for people with hearing and visual impairments respectively. However, in some cases it is not possible to adequately convey all relevant information through the existing channels of creative content and its assistive alternative. For example, in educational videos, a continuous narration of a scientific concept, illustrated via animated content may not afford the use of audio description to detail the visual scene. Thus, in this demonstration, we propose to use ultrasonic mid-air haptic technology for including ``closed haptions’’ with a three minute long video. Our video illustrates the concept of Single-Stroke and Multi-Stroke Dynamic Tactile Pointers – a novel method of rendering tactile shapes in mid-air. Recent research has shown that using a Multi-Stroke Dynamic Tactile Pointer instead of Spatiotemporal Modulation, to render geometric forms in mid-air, increases the ability of users to identify shapes by approximately 30%. This is a significant finding with implications in tactile icon design for various user interfaces, and accessibility of teaching geometry for visually impaired students in secluded regions. Besides the closed haptioning of our video, attendees will be tasked with determining the order of five tactile geometric shapes in mid-air, presented in random order, using three different methods of rendering.
Media
-
📝
A new channel of access to educational multimedia
Captions and audio description are powerful tools for making films and educational videos more inclusive. But sometimes, words alone can’t capture what’s happening on screen. Imagine trying to describe the swirling motion of an animation or the sharp outline of a geometric shape—much of the richness gets lost.
-
🎧
Accessible multimedia through closed haptions
Tune in to discover how mid-air haptics are revolutionising accessibility beyond traditional closed captions and audio descriptions. We delve into the innovative Dynamic Tactile Pointer technology, exploring how it significantly enhances the recognition of tactile shapes and introduces the concept of "closed haptions" for richer sensory content.
-
🎬
Seminar Presentation: Sonification World Chat (SWC) WOrkshop Series
In this video, Daniel Hajas gives an overview of his PhD research portfolio at the fourth workshop of the Sonification WOrld Chat workshop series. At the time of this presentation, Daniel is researching tangible user interfaces and actuators. His research is targeting the use of tactile experiences for purposes of provoking personal responses, which are known to be relevant in science communication, such as interest or enjoyment.