SofTeCode Blogs

One Place for all Tech News and Support

Samsung uses AI for its devices

12 min read
Samsung AI

image by samsung Newsroom

0
(0)

Now is the age of home entertainment. The concept of the fashionable ‘home’ goes way beyond being merely a residential space; it’s become an area for relaxation, for recreation, and for quality time with others. In the middle of this alteration is that the near-three-dimensional content experiences granted by today’s ultra-large, ultra-high-definition, ultra-fine pixel TVs. Of course, top-quality audio provides the final touch to such experiences.

With its 2020 QLED 8K TVs and AI sound technologies, Samsung has raised the bar for TV audio experiences. Object Tracking Sound+ uses AI-based software to match the movement of audio with movement on-screen; active Amplifier (AVA) tracks the user’s audio environment; and Q-Symphony creates a more realistic, three-dimensional sound.

Samsung Newsroom sat down with the sound developers of Samsung Electronics’ Visual Display Business to find out more about their extensive capabilities and therefore the journey to fostering innovation in sound.

Object Tracking Sound+: Reading the space for More Realistic Audio Experiences

Action movies with amazing sound arrangements provide the foremost realistic experiences when experienced in movie theaters. this is often because movie theaters have multi-channel speakers with 3D sound placed on most the walls (including the ceiling), also as around the screen. Compared with a two-channel sound that features speakers only on the left- and right-hand sides, the multi-channel speakers during a movie deliver a more refined sense of realism. So how can this realism be recreated within the home? Samsung’s sound developers came up with Object Tracking Sound+ technology, during which sound follows movement onscreen through six speakers built into the TV.

Thanks to this technology, a video’s audio follow the action on-screen in real-time. When a car moves from the left to the right-hand side of the screen, so will the sound it makes; and when an important object drops from the highest to rock bottom of the screen, so will the audio.

Now is the age of home entertainment. The concept of the fashionable ‘home’ goes way beyond being merely a residential space; it’s become an area for relaxation, for recreation, and for quality time with others. In the middle of this alteration is that the near-three-dimensional content experiences granted by today’s ultra-large, ultra-high-definition, ultra-fine pixel TVs. Of course, top-quality audio provides the final touch to such experiences.

With its 2020 QLED 8K TVs and AI sound technologies, Samsung has raised the bar for TV audio experiences. Object Tracking Sound+ uses AI-based software to match the movement of audio with movement on-screen; active Amplifier (AVA) tracks the user’s audio environment; and Q-Symphony creates a more realistic, three-dimensional sound.

Samsung Newsroom sat down with the sound developers of Samsung Electronics’ Visual Display Business to find out more about their extensive capabilities and therefore the journey to fostering innovation in sound.

Object Tracking Sound+: Reading the space for More Realistic Audio Experiences

Action movies with amazing sound arrangements provide the foremost realistic experiences when experienced in movie theaters. this is often because movie theaters have multi-channel speakers with 3D sound placed on most the walls (including the ceiling), also as around the screen. Compared with a two-channel sound that features speakers only on the left- and right-hand sides, the multi-channel speakers during a movie deliver a more refined sense of realism. So how can this realism be recreated within the home? Samsung’s sound developers came up with Object Tracking Sound+ technology, during which sound follows movement onscreen through six speakers built into the TV.

Thanks to this technology, a video’s audio follow the action on-screen in real-time. When a car moves from the left to the right-hand side of the screen, so will the sound it makes; and when an important object drops from the highest to rock bottom of the screen, so will the audio.

When developing the 2020 QLED 8K TVs, Samsung’s TV developers increased the amount of QLED TV speakers from two to 6 so as to understand sound which will mimic the action. “By placing two speakers on all sides of the screen, also as on the highest and bottom, we enabled the dissemination of sound altogether directions from a complete of six speakers,” explained Jongbae Kim. “The distance between the 2 main speakers has been widened the maximum amount as possible, and therefore the additional speakers are installed so as to maximize sound across all axes to be as three-dimensional as possible. for instance, we placed speakers on the top of the screen to enable the movement of sound during a vertical direction for a more immersive sound experience.” Additionally, Kim highlighted how, despite the complex nature of a TV structure that has six embedded speakers, the team managed to stay the planning of the TV slim and minimal.

In order to make sure audio will follow on-screen movements accurately, it’s important to know the first intentions of content creators. “The role of a sound engineer is to extend the consistency between the action onscreen and its accompanying audio track when mixing. the situation information of sound during a piece of video content, including sound panning information, is subsequently audio-signaled into the audio channel by the sound engineer – something we must be ready to track so as to breed the situation and movement of a content’s audio accurately,” noted Jongbae Kim. “Our Object Tracking Sound+ technology analyzes the situation information contained in these audio signals as originally placed during mixing. this suggests the TV can then effectively distribute the sound amongst its six speakers by distinguishing between sound orientations and whether or not the audio source is on-screen, off-screen, close-up or distant.”

AVA: Intelligent Noise Detection to reinforce Voice Clarity

When that crucial scene within the show you’re watching is overwhelmed by mixer sound or a crucial breaking report is obscured by loud thunder, the act of reaching for the remote to regulate the TV’s volume can come too late. this is often why the team developed their AVA technology, which recognizes exterior noises and increases the number of voices in content accordingly if surrounding conditions become too loud.

The way it works is intelligent. The TV’s sound sensor, attached to rock bottom middle of the TV, takes in audio from the content onscreen also as its surrounding environs. AI technology then compares the quantity levels of the 2 sorts of sound, and if external sounds are found to be louder than that of the TV’s content, it’ll selectively raise the TV’s volume. “The system doesn’t have one set definition of noise,” explained Sunmin Kim. “It considers any and every one element that disturbs the enjoyment of content as noise. When exterior sounds persist above a particular decibel level, that’s when the system registers it as ‘noise’.”

However, AVA technology doesn’t just raise the quantity of the TV when it recognizes a louder environment, as this is able to only contribute to a boisterous room experience. “The system harnesses AI to stay effect and background audio levels consistent and to only raise the quantity of voice audio,” highlighted Sunmin Kim. “Our research showed us that the bulk of the content is dialogue-heavy, so we believe that enhancing the delivery of dialogue would be most beneficial to assist comprehension.”

Q-Symphony: Creating a Multi-Dimensional Soundscape

One of the key elements to achieving a sensible sound during content playback on a TV is three-dimensionality, which encompasses both horizontal and vertical audio characteristics. Until recently, these perspectives had been being developed separately by the TV and Soundbar teams. However, with the inclusion of top speakers on Samsung’s 2020 QLED 8K TVs, the team developed an all-inclusive solution that utilizes the capabilities of both the TV and therefore the soundbar in perfect harmony. Q-Symphony may be a feature that plays audio using both the TV speakers and therefore the soundbar at an equivalent time, and as an industry-first achievement, the Q-Symphony technology was even recognized with a better of Innovation Award at CES 2020.

Now is the age of home entertainment. The concept of the fashionable ‘home’ goes way beyond being merely a residential space; it’s become an area for relaxation, for recreation, and for quality time with others. In the middle of this alteration is that the near-three-dimensional content experiences granted by today’s ultra-large, ultra-high-definition, ultra-fine pixel TVs. Of course, top-quality audio provides the final touch to such experiences.

With its 2020 QLED 8K TVs and AI sound technologies, Samsung has raised the bar for TV audio experiences. Object Tracking Sound+ uses AI-based software to match the movement of audio with movement on-screen; active Amplifier (AVA) tracks the user’s audio environment; and Q-Symphony creates a more realistic, three-dimensional sound.

Samsung Newsroom sat down with the sound developers of Samsung Electronics’ Visual Display Business to find out more about their extensive capabilities and therefore the journey to fostering innovation in sound.

Object Tracking Sound+: Reading the space for More Realistic Audio Experiences

Action movies with amazing sound arrangements provide the foremost realistic experiences when experienced in movie theaters. this is often because movie theaters have multi-channel speakers with 3D sound placed on most the walls (including the ceiling), also as around the screen. Compared with a two-channel sound that features speakers only on the left- and right-hand sides, the multi-channel speakers during a movie deliver a more refined sense of realism. So how can this realism be recreated within the home? Samsung’s sound developers came up with Object Tracking Sound+ technology, during which sound follows movement onscreen through six speakers built into the TV.

Thanks to this technology, a video’s audio follow the action on-screen in real-time. When a car moves from the left to the right-hand side of the screen, so will the sound it makes; and when an important object drops from the highest to rock bottom of the screen, so will the audio.

When developing the 2020 QLED 8K TVs, Samsung’s TV developers increased the amount of QLED TV speakers from two to 6 so as to understand sound which will mimic the action. “By placing two speakers on all sides of the screen, also as on the highest and bottom, we enabled the dissemination of sound altogether directions from a complete of six speakers,” explained Jongbae Kim. “The distance between the 2 main speakers has been widened the maximum amount as possible, and therefore the additional speakers are installed so as to maximize sound across all axes to be as three-dimensional as possible. for instance, we placed speakers on the top of the screen to enable the movement of sound during a vertical direction for a more immersive sound experience.” Additionally, Kim highlighted how, despite the complex nature of a TV structure that has six embedded speakers, the team managed to stay the planning of the TV slim and minimal.

In order to make sure audio will follow on-screen movements accurately, it’s important to know the first intentions of content creators. “The role of a sound engineer is to extend the consistency between the action onscreen and its accompanying audio track when mixing. the situation information of sound during a piece of video content, including sound panning information, is subsequently audio-signaled into the audio channel by the sound engineer – something we must be ready to track so as to breed the situation and movement of a content’s audio accurately,” noted Jongbae Kim. “Our Object Tracking Sound+ technology analyzes the situation information contained in these audio signals as originally placed during mixing. this suggests the TV can then effectively distribute the sound amongst its six speakers by distinguishing between sound orientations and whether or not the audio source is on-screen, off-screen, close-up or distant.”

AVA: Intelligent Noise Detection to reinforce Voice Clarity

When that crucial scene within the show you’re watching is overwhelmed by mixer sound or a crucial breaking report is obscured by loud thunder, the act of reaching for the remote to regulate the TV’s volume can come too late. this is often why the team developed their AVA technology, which recognizes exterior noises and increases the quantity of voices in content accordingly if surrounding conditions become too loud.
The way it works is intelligent. The TV’s sound sensor, attached to rock bottom middle of the TV, takes in audio from the content onscreen also as its surrounding environs. AI technology then compares the quantity levels of the 2 sorts of sound, and if external sounds are found to be louder than that of the TV’s content, it’ll selectively raise the TV’s volume. “The system doesn’t have one set definition of noise,” explained Sunmin Kim. “It considers any and every one elements that disturb enjoyment of content as noise. When exterior sounds persist above a particular decibel level, that’s when the system registers it as ‘noise’.”

However, AVA technology doesn’t just raise the quantity of the TV when it recognizes a louder environment, as this is able to only contribute to a boisterous room experience. “The system harnesses AI to stay effect and background audio levels consistent and to only raise the quantity of voice audio,” highlighted Sunmin Kim. “Our research showed us that the bulk of content is dialogue-heavy, so we believe that enhancing the delivery of dialogue would be most beneficial to assist comprehension.”

Q-Symphony: Creating a Multi-Dimensional Soundscape

One of key elements to achieving a sensible sound during content playback on a TV is three-dimensionality, which encompasses both horizontal and vertical audio characteristics. Until recently, these perspectives had been being developed separately by the TV and Soundbar teams. However, with the inclusion of top speakers on Samsung’s 2020 QLED 8K TVs, the team developed an all-inclusive solution that utilizes the capabilities of both the TV and therefore the soundbar in perfect harmony. Q-Symphony may be a feature that plays audio using both the TV speakers and therefore the soundbar at an equivalent time, and as an industry-first achievement, the Q-Symphony technology was even recognized with a better of Innovation Award at CES 2020.
“The core of Q-symphony, which manages sound playback harmoniously using speakers with different characteristics, is technology that follows the sound playback rules which are determined beforehand and exchanges the required information between the TV and therefore the soundbar, when connected. This approach allows for a superior reproduced sound experience,” explained Yoonjae Lee. “A key element of the technology may be a special algorithm that we created which divides and harmonizes sounds seamlessly between the TV’s speakers and soundbar.”

During development, challenge arose regarding the standard of dialogue reproduction. When both the soundbar and therefore the TV speakers played dialogue simultaneously, the sound quality was noticeably diminished. However, the sound development team were ready to resolve this issue by separating the most sound track, including dialogue, from the whole signal and assigning the various tracks to the TV speakers and soundbar respectively. “In the 2020 QLED 8K TV range, the voice signal is extracted and faraway from the sound being reproduced by the TV’s embedded speakers, which are then assigned to play ambient sound signals like sound effects,” explained Lee. “The soundbar then reproduces the most sound involving any dialogue. With this technology, Q-Symphony harnesses the benefits of both TV speakers and therefore the soundbar so as to deliver the simplest , and most harmonious, sound experience to users.”

Working Together to Develop the right Sound Experience

The sound development team agreed that realizing the addition of speakers, the new placement of speakers and therefore the AI harmonization with the soundbar on the 2020 QLED 8K TV range was possible due to close coordination with a spread of other teams. “When developing new TVs, all areas got to be in sync with their innovations,” noted Youngtae Kim. “We came together in suggesting various solutions to beat each and each technological hurdle with an open mind.”
The sound development team has always been and always are going to be dedicated to developing the simplest possible audio experiences for users. also as working with Samsung’s Audio Lab-based within the U.S. for the longer-term audio technology, the team also works with Samsung Research’s R&D Centers, universities and start-up experts round the world. “We want to cause sound experiences that are as natural and as real as possible,” explained Youngtae Kim. “To achieve this, we’ll still exerting to know the end-to-end process of the sound and realize sounds in our TVs.”

Samsung’s sound innovation also helps to understand its vision of ‘Screens Everywhere’. “In the longer term , we’ll bolster the utilization of AI in order that users don’t even got to use a foreign control to seek out the right audio balance when enjoying their favorite content,” said Sunmin Kim. “As time goes by, TV installation environments, lifestyles and age groups are going to be diversified. we would like users to enjoy the sound of their content as intended, no matter content type or listening environment.”

How useful was this post?

Click on a star to rate it!

Average rating 0 / 5. Vote count: 0

No votes so far! Be the first to rate this post.

Give your views

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Search

Social Love – Follow US