Ubitone – Portable Life Support and Communication Devices for Individuals with Visual and Hearing Impairments

Eitaro Yamatsuta
CEO, Ubitone Corporation

What is Ubitone?

We are developing a new portable life support-communication device called “Ubitone” and peripheral hardware devices for individuals with visual and hearing impairments.  The Ubitone Glove, which resembles a glove, is a handheld device that connects to the Ubitone app on a smartphone via Bluetooth. By placing the smartphone in your pocket, you have full freedom to use both hands. This communication method utilizes a 6-dot Braille system adapted for finger communication, and it currently uses vibration from an eccentric actuator for transmitting information from the app to the fingers, with input from an accelerometer for tracking finger movements. This digitalization provides two-way information transfer without the assistance of an interpreter or caregiver by converting speech and messages into finger Braille, such as talking to the person in front of you, chatting with a friend, accessing news, the internet, weather updates, text reading and more. By removing communication and information access barriers for individuals with visual and hearing impairments, we aim to create a world where they can live their daily lives in the same way as everyone else, contributing to the realization of the “Leave No One Behind” society as envisioned in the SDGs.

Improving the Product Based on User Feedback

Founded in 2020, Ubitone, as a company, upholds the belief of “Creating a better world through the power of design and technology.” The founder of the company, upon learning about the challenges faced by individuals who are deaf-blind during a visit to a non-profit organization, felt the desire to contribute as an engineer. This marked the beginning of Ubitone’s development, with many problems and requests gathered from the deaf-blind community, leading to the creation of prototypes based on their input. In the early stages of the development, we took a lot of detours, not knowing much about the method of communication called finger Braille. However, the more we listened to people’s stories, the more issues became apparent, such as the absence of Braille block in certain locations or dangerous spots, as well as the distinct information inequality gap brought to the forefront by the COVID-19 pandemic. Without the development of Ubitone, these issues might have gone unnoticed. By continuously updating the device based on user feedback, we have been able to enhance its performance. Although the process of creating prototypes, conducting evaluations, and implementing improvements is time-consuming and labor-intensive, the satisfaction of our users when they see the results of these updates is always a rewarding moment.
One of the challenges we faced during development was designing a device that could efficiently convey Braille tactile signs. Finger Braille requires a unique touch sensation, and replicating it presented difficulties. Even when developers thought the device was working correctly, users often felt that the fine vibrations were noisy and caused significant stress when trying to interpret the messages accurately. Currently, there are still several challenges, such as the design of a mechanism to accurately convey the user’s Braille signs, which we are striving to overcome through repeated testing. The shape of the Ubitone Glove has also undergone numerous iterations to provide a comfortable fit for the users. Since the device is portable, there are constraints related to size and weight on the electronic circuit board. To make the device waterproof and durable for use in various environments, we focused on exploring lightweight and sturdy materials with a compact design. The design of the app screen was also developed with the goal of allowing intuitive operation even with closed eyes. Many of these issues were only apparent when users had a chance to test the product in real-life situations.

Expanding Horizons with Enhanced Features – The Ubitone App

The Ubitone app will continue to implement various features based on the opinions and feedback from individuals with visual and hearing impairments. Our development journey began with the implementation of a dialogue mode, in response to the desire of blind and deaf individuals to communicate with their families. Using voice recognition AI, we were able to facilitate communication between those who are unfamiliar with Braille and those individuals who are visually and hearing impaired, which brought immense joy to the community. This led to the emergence of a chat feature, as the desire for communication with distant or multiple individuals grew. While the initial concept was to improve interpersonal communication, features like a news function that can be enjoyed alone have also been highly appreciated. Additionally, our development, initially exclusive to Android, now extends to iPhone, and we are considering the creation of a book-reading feature for greater accessibility.
Numerous features have already been realized, but our app is poised to become a hub for accessing information from smartphones. By collaborating with devices like thermometers, walking aids, and compact Braille displays, we aim to enhance users’ quality of life (QOL). Furthermore, as society becomes smarter, we anticipate that Ubitone will provide access to public transportation and store information, allowing individuals with visual and hearing impairments the freedom to go out and move around independently. With the advancement of smart homes, we can assist in controlling household appliances, making life more convenient for them.

Development for Global Expansion

The development of Ubitone is aimed at global expansion. By making our devices and app compatible with other languages, we can extend our support to individuals who are blind and deaf worldwide. While some of these individuals in the United States have used our app, it became apparent that communication methods are different from those in Japan, and it seemed difficult for them to read Japanese finger Braille. To establish a global standard, we are exploring new methods of information transmission. As devices continue to evolve, we expect to add even more features and create customizable devices to meet users’ needs. Our vision includes extending support beyond the blind and deaf community, encompassing various disabilities, as we work towards providing comprehensive assistance through the integration of multiple functions. We believe that as assistive technology proliferates and advances, society as a whole will become more equitable and inclusive. In such a world, everyone will be able to unleash their abilities and live happily. We are committed to continuously improving our products, listening to everyone’s feedback, and striving to bring a day when blind and deaf individuals can use our products with pleasure as soon as possible.

Note:
Finger Braille is a method where interpreters directly tap the fingers of deafblind individuals instead of using keys on a Braille typewriter. This unique method, developed in Japan, allows for precise and rapid communication without the need for special tools.
From “What is Deaf blindness,”
Japan Deafblind Association, http://www.jdba.or.jp/deafblind/top.html

Edited and published by the Japanese Society for Rehabilitation of Persons with Disabilities. Published on June 25th, 2023.

menu