New technology to greatly improve video communication tested during dive to Titanic wreck

Deep-sea test on Titanic wreck: new technology to greatly improve video communication
The submersible is ready for the dive to the Titanic on the early morning of July 14, 2022. Credit history: Alex Waibel, Kit

The COVID-19 pandemic has enormously boosted the popularity of video communication—but occasionally weak transmission top quality, dropouts, and relationship failures during conferences or conference phone calls tax the participants’ persistence. Scientists at Karlsruhe Institute of Technological innovation (Kit) and Carnegie Mellon University (CMU) have formulated a system for transmitting online video conferences over really lower bandwidth connections, enabling these types of transmissions even underneath excessive problems. It was tested all through a dive to the wreck of the Titanic, which lies at a depth of almost 4,000 meters in the North Atlantic.

“Transmitting details from a depth of 4 kilometers as a result of salt water without having any reduction is particularly tricky,” says Professor Alex Waibel, who conducts research on speech translation at Package and CMU. Natural ailments allow sonar transmission from the submersible to the mother ship at sea-area amount only, since radio communication does not work in salt water. The scientists have produced artificial methods to convert online video facts into textual content. The sound recording is 1st converted to textual content in the submersible and then transmitted to the area by sonar sound pulses, in which the online video is reconstructed from the text. “The video then functions a synthetic voice that is mapped to the voice of the individual who is talking, so that it appears like the voice of that particular person. In addition, the movie synthesis is controlled in these types of a way that the lips of the speaker move in sync with the sound,” describes Waibel, who has been executing investigate in speech recognition, speech processing, and speech translation for a long time. “In the upcoming, this will aid distant connect in spoken language,” says Waibel. On the other hand, it is also appropriate for synthesizing videos in a diverse language or for lip-syncing videos.

Deep-sea test on Titanic wreck: new technology to greatly improve video communication
The submersible for the dive to the Titanic on its start and recovery system. Credit score: Alex Waibel, Package

The technological innovation analyzed by Waibel on the wreck of the Titanic builds on many years of groundbreaking function in speech translation. Waibel’s developments consist of the Lecture Translator in use at Package to routinely document the lecturer’s speech in lectures and translate the speech indicators concurrently into written English text. This indicates that pupils can stick to the lecture on their laptop, smartphone, or tablet.

AI outperforms people in speech recognition

Offered by
Karlsruhe Institute of Know-how

New know-how to enormously improve online video communication tested through dive to Titanic wreck (2022, July 26)
retrieved 31 July 2022
from video-titanic.html

This document is matter to copyright. Aside from any fair working for the objective of personal review or investigation, no
part could be reproduced with no the published permission. The content material is offered for details needs only.