Text app aids communication between hospital staff and patients with hearing difficulties

Addenbrooke’s Hospital, Cambridge, has carried out tests of a speech app as a way of helping its medical team communicate with people who are deaf or have hearing loss, when mouths are covered due to coronavirus.

 

A free speech to text app, called Live Transcribe and Sound Notifications, is said to help team members to more easily follow and understand what someone is saying when both parties are wearing face coverings and protective PPE.

Face coverings have been mandatory in the healthcare sector since the beginning of the pandemic, causing huge issues for those who rely on seeing the mouth for seeing lip patterns and facial expressions when lip reading or using sign language.

To address this issue, the clinical engineering team at Cambridge University Hospitals NHS Trust had started to develop prototype clear masks. However, they remained keen to explore alternative solutions that may have been quicker to implement, when they were recommended the app.

42 Technology came up with a suggested solution of using a transcription app on a low-cost Android smartphone or Android smartwatch. The phone could be worn either on the user’s lapel or kept visible on the forearm using a sports arm strap. Alternatively, the recommended smartwatch which featured a larger screen could be used or enhanced with a Bluetooth microphone for use in noisier environments.

Live Transcribe text appThe app, which is free to download, automatically transcribes text in near-real time, and can be enlarged on the screen so it’s easily read, and custom words, such as specialist medical terms, can be added into the dictionary if required. Google’s app development were also contacted to verify that conversations processed on their servers are not recorded or stored.

Richard Prudence, an electronics engineer at 42 Technology who worked with Addenbrooke’s Hospital on the project, said that the company’s proposed solution would allow an Android phone or other device to be worn by the speaker or the deaf person as an alternative to clear face masks or asking someone to remove their mask.

“We thought the transcription app worked well, particularly in healthcare settings. But it could equally be used by anyone needing an alternative to lip reading now that face coverings are compulsory for all indoor settings and on public transport. The Google app uses existing off-the-shelf technology and was fast and easy to set up compared with some other apps we trialled as part of this project.”

In the UK, there are an estimated 12 million adults who are deaf or have significant hearing loss and for many of whom the almost universal use of face coverings during the pandemic is having devastating consequences on their daily lives.

At the start of the pandemic, several charities including Deaf Action launched campaigns calling for transparent, ‘window’ masks to be made available across all healthcare settings, including social care and support, as well as to the general public. The US Food and Drug Administration (FDA) approved the first fully transparent surgical mask in August 2020; and in September the UK government announced that 250,000 of them would be delivered to frontline NHS and social care workers.deaf