CN112346694B

CN112346694B - Display device

Info

Publication number: CN112346694B
Application number: CN201910729605.7A
Authority: CN
Inventors: 姜元恩; 王海盈; 李德浩
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2019-08-08
Filing date: 2019-08-08
Publication date: 2023-03-21
Anticipated expiration: 2039-08-08
Also published as: CN112346694A

Abstract

The application provides a display device, through set up first processing module and second processing module in display device, can decode the video content and obtain the sound signal that has the multichannel correspondence at the decoder, can output the sound signal that all sound channels correspond to the speaker and broadcast to not be restricted to the I2S output interface of the main chip of display device, can all output the sound signal that more sound channels in the video content correspond to the speaker and broadcast. Therefore, the playing effect of the sound signal of the display device is improved, and the watching experience of watching the video content played by the display device by a user is improved.

Description

Display device

Technical Field

The present application relates to electronic technologies, and in particular, to a display device.

Background

With the continuous progress and demand of electronic technology, users are pursuing more and more realistic and shocking audio-visual experience when watching movies and television programs and listening to music using display devices such as mobile phones, tablet computers, televisions, and the like. Therefore, more and more video contents provide sound signals corresponding to more directions and types of sound channels, immersion is brought to users, and the audio-visual experience of the users is improved. Wherein all the different sound signals included in the video content need to be played through speakers separately provided at specific locations in the display device.

In the prior art, taking a display device as a television as an example, in most of the televisions, a left speaker and a right speaker are respectively arranged only on the left side and the right side of a user viewing direction according to a left channel and a right channel, and are used for respectively playing a left channel sound signal and a right channel sound signal. Meanwhile, a decoder in the television is used for decoding the acquired video content to obtain a sound signal in the video content. Because the decoder is usually built in the main chip of the television, the main chip usually includes only two or three I2S output interfaces, and the sound signal output by the main chip through each I2S interface can be played by two speakers at most after being amplified by AMP. And the decoder is further caused to decode the video content, and at most, the decoder can only output sound signals through the three paths of I2S interfaces and provide sound signals for 6 loudspeakers at most. Although the television can be satisfied with the basic playback of video content such as 2.0 channels and 2.1 channels, the television cannot be satisfied with the playback of video content having more channels, for example, 5.1.2 channels and 7.1.2 channels.

Therefore, how to enable the display device to play video content with more channels is a technical problem that needs to be solved in the art.

Disclosure of Invention

The application provides a display device, can all export the sound signal that more sound channels correspond in the video content to the speaker and play to improve display device's sound signal's broadcast effect, and the user watches the video content's that display device plays watching experience.

The application provides a display device, including:

a decoder, a first processing module, a second processing module, a plurality of power Amplifiers (AMPs), and a plurality of speakers corresponding to the AMPs; wherein the decoder is connected with the first processing module; the first processing module and the second processing module are connected through a first connecting line supporting a first protocol, and the first connecting line is used for transmitting multiple paths of sound signals; the second processing module is further connected with the plurality of speakers through the plurality of AMPs, respectively;

the decoder is used for decoding video content to be played to obtain an original sound signal and sending the original sound signal to the first processing module, wherein the original sound signal comprises a plurality of paths of sound signals;

the first processing module is used for performing first processing on the original sound signal to obtain a plurality of paths of intermediate sound signals and sending the plurality of paths of intermediate sound signals to the second processing module through the first connecting line;

and the second processing module is used for performing second processing on the multi-channel middle sound signals to obtain multi-channel to-be-played sound signals corresponding to the plurality of loudspeakers, and respectively sending the multi-channel to-be-played sound signals to the corresponding AMPs for amplification processing, and then playing the multi-channel to-be-played sound signals through the corresponding loudspeakers.

In an embodiment of the present application, the first protocol is a universal serial bus USB protocol.

In an embodiment of the present application, the first processing module is disposed inside a main chip of the display device.

In an embodiment of the present application, the second processing module is disposed inside a main chip of the display device.

In an embodiment of the present application, the plurality of speakers are disposed below the display screen, and the plurality of speakers include: the loudspeaker comprises a front left loudspeaker arranged at the left lower part of the display screen, a front right loudspeaker arranged at the right lower part of the display screen, a top left loudspeaker arranged at the left upper part of the display screen, a top right loudspeaker arranged at the right upper part of the display screen, a middle loudspeaker arranged under the display screen, a surrounding left loudspeaker arranged at the left part of the display screen, a surrounding right loudspeaker arranged at the right part of the display screen and a woofer arranged at the middle part of the display screen.

In an embodiment of the application, the first processing performed by the first processing module on the original sound signal includes: and when the original sound signal comprises a plurality of paths of sound signals and the number of the plurality of loudspeakers is less than that of the plurality of loudspeakers, filling the original sound signal according to the corresponding relation between the original sound signal comprising the plurality of paths of sound signals and the plurality of loudspeakers to obtain a plurality of paths of intermediate sound signals corresponding to the plurality of loudspeakers.

In an embodiment of the present application, the first processing performed on the original sound signal by the first processing module includes: when the number of the plurality of paths of sound signals in the original sound signal is smaller than the number of the plurality of loudspeakers, performing protocol conversion on the original sound signal according to the first protocol to obtain a plurality of paths of intermediate sound signals supporting the first protocol;

the second processing of the multi-path intermediate signal by the second processing module comprises: and analyzing the multi-channel middle sound signals according to the first protocol to obtain multi-channel sound signals to be played, which can be played by a loudspeaker.

In an embodiment of the present application, the first processing performed on the original sound signal by the first processing module includes: when the number of the multi-path sound signals in the original sound signals is smaller than the number of the plurality of loudspeakers, marking the multi-path intermediate sound signals according to the corresponding relation between the multi-path intermediate sound signals in the original sound signals and the plurality of loudspeakers;

the second processing of the multi-path intermediate signal by the second processing module comprises: and obtaining the multi-channel sound signals to be played corresponding to the plurality of loudspeakers according to the marks of the multi-channel middle sound signals.

In an embodiment of the present application, the first processing module is located in a hardware abstraction HAL layer of an operating system of the display device.

In an embodiment of the present application, the second processing module is located in a hardware abstraction HAL layer of an operating system of the display device.

In summary, the present application provides a display device, in which a first processing module and a second processing module are disposed in the display device, so that after a decoder decodes a video content to obtain a sound signal corresponding to multiple channels, the sound signal corresponding to all channels can be output to a speaker for playing, and thus the display device is not limited by an I2S output interface of a main chip of the display device, and can output sound signals corresponding to more channels in the video content to the speaker for playing. Therefore, the playing effect of the sound signal of the display device is improved, and the watching experience of watching the video content played by the display device by a user is also improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.

FIG. 1 is a schematic diagram of a display device according to the prior art;

FIG. 2 is a schematic diagram of a display device according to an embodiment of the prior art;

FIG. 3 is a diagram illustrating an embodiment of a structure of a display device in the prior art;

FIG. 4 is a schematic structural diagram of an embodiment of a display device provided in the present application;

fig. 5 is a schematic structural diagram of an embodiment of a display device provided in the present application;

fig. 6 is a schematic structural diagram of an embodiment of a display device provided in the present application;

FIG. 7 is a schematic structural diagram of an embodiment of a display device provided in the present application;

FIG. 8 is a schematic structural diagram of an embodiment of a display device provided in the present application;

fig. 9 is a schematic structural diagram of an embodiment of a display device provided in the present application;

FIG. 10 is a schematic structural diagram of an embodiment of a display device provided in the present application;

fig. 11 is a schematic structural diagram of an embodiment of a display device provided in the present application;

fig. 12 is a schematic diagram of a software structure of a display device provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Before formally describing the display device provided by the present application, a description will be given of an application side scenario of the display device provided by the present application and problems in the prior art with reference to fig. 1 and 2.

Fig. 1 is a schematic application diagram of a display device in the prior art, and in the scenario shown in fig. 1, taking the display device as a television 1 as an example, the television 1 includes: display screen, left speaker and right speaker. Wherein, left channel speaker and right channel speaker set up in the inside display screen below of TV set 1, and simultaneously, the sound signal that TV set 1 can play includes: a left channel sound signal and a right channel sound signal. Therefore, the television 1 is internally provided with a left channel speaker and a channel speaker at the same height in the left and right directions of the user, respectively, with the viewing direction of the user as the center.

In one specific configuration of the television set 1, a main chip in the television set 1 may be used to control the television and the display screen and speakers of the television set 1. For example, fig. 2 is a schematic structural diagram of an embodiment of a display device in the prior art, and an example shown in fig. 2 shows an internal structure of the television 1 shown in fig. 1. Wherein, the main chip can also be called as TV owner chip again, includes: a Central Processing Unit (CPU), a System On Chip (SOC), etc. for performing display control and playing control on the television 1. The main chip in the television 1 may be configured to obtain video content to be played and decode the video content to obtain a display signal and an audio signal to be played. In the first aspect, the main chip may process the display signal to be played and then send the processed signal to the display screen for displaying, and in the second aspect, the main chip may further process the audio signal to be played and then send the processed signal to a power Amplifier (AMP) for amplification, and then send the amplified signal to a speaker for playing by the AMP, so that the television 1 may play the display signal and the audio signal on the display screen by the speaker, thereby playing the video content.

More specifically, the decoder for decoding the video content is usually disposed in a main chip inside the television 1, and the main chip is connected to the AMP via an Inter-IC Sound (I2S) bus, so that the main chip can output the audio signal to the I2S bus via an I2S interface disposed on the main chip and send the audio signal to the AMP for processing via the I2S bus. For example, in the example shown in fig. 2, the main chip outputs the two paths of sound signals obtained by the decoder as left-channel sound signals and right-channel sound signals, the main chip outputs the two paths of sound signals to AMP1 and AMP2 through two I2S interfaces, and then AMP1 and AMP2 amplify and differentiate the left-channel sound signals and the right-channel sound signals, so as to obtain amplified and differentiated left-channel sound signals and differentiated right-channel sound signals, and send the amplified and differentiated left-channel sound signals and differentiated right-channel sound signals to corresponding left speakers and right speakers for playing.

Meanwhile, with the continuous development of digital signal processing technology, after sound signals in video content are subjected to lossless compression and other processing, the sound signals can be presented in a multi-channel mode surrounding a user to the maximum extent, and the user is strongly immersed. For example, some High-Fidelity (High-Fi) sound signals can provide sound signals corresponding to multiple channels, such as stereo, quasi-stereo, four-channel surround, 5.1 channels, etc., and the sound signals need to be played at different positions through different sounds to combine to realize surround feeling and immersion feeling of the multiple channels of sound signals.

However, in the conventional display device including the television set 1 shown in fig. 1 and 2, the main chip generally includes only two or three I2S output interfaces due to the limitation of the I2S bus output by the main chip, and the sound signal output by the main chip through each I2S interface is amplified by AMP and then played by at most two speakers. For example, fig. 3 is a schematic diagram of an embodiment of a structure of a display device in the prior art. After the decoder in the main chip decodes the video content to obtain the sound signals to be played, the main chip can only output the sound signals to 3 AMPs at most through three paths of I2S interfaces, and the 3 AMPs can provide the sound signals for 6 loudspeakers at most. Although it is satisfactory to play video contents of 2.0 channels and 2.1 channels of audio signals, it is not satisfactory to play video contents of audio signals having more channels, for example, 5.1.2 channels and 7.1.2 channels.

Therefore, in the above display device, even if the audio signals obtained by decoding the video content by the decoder in the main chip include audio signals corresponding to a plurality of channels, the main chip can only send the audio signals corresponding to a maximum of 6 channels to the corresponding AMP via the 3-way I2S bus, amplify the audio signals, and play the audio signals by the speakers corresponding to 6 channels. When the video content includes sound signals corresponding to more channels, the user can only expand the display device by means of external sound boxes and the like, and then the playing effect of the sound signals corresponding to more channels can be achieved through the expanded equipment. Therefore, when the video content includes the sound signals corresponding to more sound channels, the display device provided in the prior art cannot directly achieve the optimal playing effect of the sound signals in the video content, and reduces the viewing experience of the user for viewing the video content played by the display device.

Based on this, the application provides a display device to improve the display effect of the display device to the sound signal including the multichannel, and then improve the viewing experience of the user viewing the video content played by the display device.

The technical solution of the present application will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

Fig. 4 is a schematic structural diagram of an embodiment of a display device provided in the present application, where the display device may be used to implement playing of video content, where the video content at least includes: the display signal and the sound signal. Specifically, the display device shown in fig. 3 includes: the device comprises a decoder, a first processing module, a second processing module, a plurality of power Amplifiers (AMPs) and a plurality of loudspeakers connected with the AMPs.

The decoder is used for decoding the video content to be played to obtain an original sound signal in the video content. Alternatively, the decoder may be disposed in a main chip of the display device, and the main chip may be a chip for performing display control and sound playing control in the display device, for example: when the display device is a television, the main chip is a television main chip. The main chip can be used for decoding the video content to be played by the decoder after the video content to be played by the display device is acquired. For example, the main chip may obtain a video file to be played through the internet, or obtain video content to be played through a cable television network, and the method for obtaining the video content by the main chip is not limited in the present application. The decoder decodes the video content to obtain an original sound signal, and the original sound signal comprises sound signals corresponding to a plurality of sound channels. For example: the original sound signals may include sound signals corresponding to a plurality of sound channels, such as 2.0 sound channels (which may be used to represent 2 channels in total for the left and right), 2.1 sound channels (which may be used to represent 2 channels in total for the left and right, and 1 subwoofer sound channel), 3.0 sound channels (which may be used to represent 3 channels in total for the left, right, and center, and 1 subwoofer sound channel), 3.1 sound channels (which may be used to represent 5 channels in total for the left front, right front, left rear, right rear, and center, and 1 subwoofer sound channel), or 5.1.2 sound channels (which may be used to represent 5 channels in total for the left front, right front, left rear, right rear, and center, 1 subwoofer sound channel, and 2 channels in total for the left surround and right surround sound channels), and a plurality of the sound signals may be referred to as multi-track audio signals.

In the embodiment shown in fig. 4, it is exemplified that the display apparatus includes N speakers, and the display apparatus includes N AMPs corresponding to the N speakers. The N AMPs may be in a one-to-one correspondence with the N speakers. The decoder is sequentially connected with the first processing module and the second processing module, the second processing module is respectively connected with the N AMPs, and each AMP is connected with one or two loudspeakers. For example, the second processing module is connected to the speaker (1) through the AMP (1), the second processing module is connected to the speaker (2) \ 8230through the AMP (2), and the second processing module is connected to the speaker N through the AMPN.

In particular, in the present embodiment, since the decoder is generally provided in the main chip, a plurality of sound signals included in the sound signal obtained by decoding the video content by the decoder need to be transmitted to the AMP through different I2S buses, but the number of I2S output interfaces on the main chip is limited. Therefore, in this embodiment, the decoder sends the audio signal obtained by decoding the video content to the first processing module for processing, and then the audio signal is sent to the second processing module by the first processing module, and the audio signal is sent to the corresponding AMP by the second processing module through the plurality of I2S output interfaces, and finally the AMP is sent to the corresponding speaker for playing. The first processing module and the second processing module are connected through a first connecting line supporting a first protocol, and the first connecting line can be used for transmitting multi-path sound signals between the first processing module and the second processing module.

Alternatively, in a practical application, the first protocol may be a Universal Serial Bus (USB) protocol, and the first connection line may be a USB connection line. The main chip is provided with the USB output interface, so that a sound signal obtained by decoding the video content by a decoder in the main chip can be sent to the USB connecting line through the USB output interface by the first processing module and then sent to the second processing module. Correspondingly, the second processing module is also provided with a USB input interface which is connected with the USB output interface of the first processing module through a USB connecting line. It should be noted that, in the present application, the first protocol supported by the first connection line is not limited, and the first connection line may also use a connection line corresponding to another output interface on the main chip.

In the embodiment shown in fig. 4, after the decoder decodes the video content to obtain an original sound signal, the original sound signal is sent to the first processing module, where the original sound signal includes at least two sound signals. And then, after the first processing module carries out first processing on the original sound signals to obtain N paths of intermediate sound signals corresponding to the N loudspeakers, the N paths of intermediate sound signals are sent to the second processing module through the first connecting line. And after the second processing module carries out second processing on the N paths of intermediate sound signals, N paths of sound signals to be played corresponding to the N AMPs are obtained. And then, after the second processing module respectively sends the N paths of sound signals to be played to the corresponding AMPs for amplification processing, finally, one or two speakers connected with each AMP are used for playing.

Optionally, the first processing performed on the original sound signal by the first processing module includes: and carrying out protocol conversion on the original sound signal in the original sound signal to obtain N paths of intermediate sound signals which can support transmission on a first connecting line between the first processing module and the second processing module. For example, assume that the first connection line is a USB connection line, and the first protocol supported by the first connection line is a USB protocol. Because the voice signal acquired by the main chip is used for playing, the data itself does not support the USB protocol and cannot be transmitted over the USB connection line, the first processing module needs to perform data encapsulation and other processing on the voice signal based on the USB protocol, for example, add an address field, a check field and other processing specified by the USB protocol, and obtain an intermediate signal that can be directly transmitted through the USB connection line, so that the first processing module can send the intermediate signal to the second processing module through the USB connection line. In this embodiment, the N intermediate sound signals sent by the first processing module to the second processing module through the USB connection line may be packaged into one file to be sent, or the first processing module sends N intermediate signals after protocol conversion to the second processing module through the USB connection line simultaneously in parallel, and the second processing module performs subsequent processing on the N received intermediate signals.

Correspondingly, the second processing module in this embodiment also supports the USB protocol, and the second processing performed by the second processing module on the intermediate sound signal includes: the N paths of intermediate signals sent by the first processing module are received based on the USB connecting line, and the N paths of intermediate signals are analyzed based on the USB protocol to obtain N paths of signals to be played. In a specific implementation, the first processing module includes a USB output interface, the second processing module includes a USB input interface, and the USB output interface of the first processing module and the USB input interface of the second processing module are connected by a USB connection line.

Optionally, the first processing performed on the original sound signal by the first processing module further includes: and according to the corresponding relation between the N paths of intermediate sound signals and the N loudspeakers, carrying out identification processing on the N paths of intermediate sound signals. The first processing module can establish the corresponding relation between the intermediate sound signal and the loudspeaker in a mode of adding data in the N paths of intermediate sound signals in a specific mode. For example, in the example shown in fig. 3, the first processing module adds a specific bit in the (1) th intermediate sound signal of the N intermediate sound signals to "01" to establish a correspondence relationship of the sound signal to the speaker (1), adds a specific bit in the (2) th intermediate sound signal of the N intermediate sound signals to "02" to establish a correspondence relationship of the sound signal to the speaker (2), and the like.

Correspondingly, the second processing of the intermediate sound signal by the second processing module further comprises: and distributing the N paths of intermediate signals, determining the corresponding relation between the N paths of intermediate signals and the N loudspeakers, analyzing the N paths of intermediate signals to obtain N paths of signals to be played, and sending the N paths of signals to be played to the corresponding N loudspeakers respectively according to the corresponding relation. For example, the second processing module may determine that the path (1) intermediate sound signal corresponds to the speaker (1) according to "01" of a specific bit in the path (1), determine that the path (2) intermediate sound signal corresponds to the speaker (2) according to "02" of a specific bit in the path (2), and so on. The (1) th path of sound signal to be played, which is obtained from the (1) th path of intermediate sound signal, is sent to the AMP (1) for amplification, and then is played by the loudspeaker (1); and sending the (2) th to-be-played sound signal obtained from the (2) th intermediate sound signal to AMP (2), amplifying, and then playing by a loudspeaker (2) and the like.

Optionally, the first processing performed on the original sound signal by the first processing module further includes: at least two paths of sound signals in the original sound signals are expanded to obtain N paths of intermediate sound signals. Wherein, because this embodiment provides N speakers, N sound signals are played respectively. If the original sound signal of the video content acquired by the main chip comprises M paths of sound signals, and M is less than N, the first processing module may further expand the M paths of sound signals in the original sound signal sent by the main chip according to the setting of the speakers, and fill the original sound signal according to the corresponding relationship between the M paths of sound signals and the N speakers, so that the filled original sound signal comprises N paths of intermediate sound signals. The expansion mode comprises the following steps: weighting the different sound signals according to the speaker settings, etc. Illustratively, in the embodiment shown in fig. 4, the N speakers provided in the display device include: the left loudspeaker (1), the right loudspeaker (2) and the subwoofer (3), wherein M sound signals in the original sound signals obtained after the decoder decodes the video content comprise: a left channel sound signal and a right channel sound signal. At this time, in order to enable all of the 3 speakers provided in the display device to play, the first processing module may obtain the subwoofer sound signal from the left channel sound signal and the right channel sound signal. For example, the first processing module filters out high frequency parts of the left channel sound signal and the right channel sound signal, and then synthesizes parts of the two sound signals with frequencies below 200kHz to obtain the subwoofer signal. Finally, the first processing module obtains N paths of sound signals corresponding to the N loudspeakers according to the M paths of sound signals through extension and filling.

In summary, the display device provided in this embodiment can realize that the display device itself plays a multi-channel sound signal through the speakers corresponding to the multiple different channels provided in the display device. For example, playing of a subwoofer sound signal, in addition to a left and right channel sound signal, and the like are realized. In addition, in the display device of this embodiment, by setting the first processing module and the second processing module, when the original sound signal obtained after the decoder decodes the video content includes multiple sound signals, more sound signals are output to the speaker for playing. The first processing module can enable the intermediate sound signal output by the main chip to be transmitted to the second processing module through a USB connecting line, and then the intermediate sound signal is sent to the corresponding loudspeaker by the second processing module to be played. Therefore, the defect that in the prior art, the main chip can only output the sound signals to the loudspeaker through the two I2S buses is overcome, and the loudspeaker can only play the sound signals corresponding to a few sound channels is overcome.

In addition, when the first connection line between the first processing module and the second processing module in the display device provided by the present application is a USB connection line, taking a 7.1.2 channel audio signal as an example, 10 channels of audio signals are all represented by 16bit,48k sampling rate of normal sound quality, so that the total data volume of the 10 channels of audio signals is 7.68Mbps, and only a small part is used compared with the 480Mbps transmission speed that can be supported by USB2.0, so the USB between the first processing module and the second processing module can also be used for transmitting other data. When the first processing module uses the USB interface on the main chip, the original transmission service of the USB interface on the main chip is less influenced.

Therefore, the display device provided by the embodiment can improve the playing effect of the sound signal obtained by decoding the video content by the decoder, and further improve the viewing experience of the user viewing the video content played by the display device.

More specifically, on the basis of the above-mentioned embodiment shown in fig. 4, the first processing module provided by the present application may be a separate processing module in the display device, or may be built in a main chip of the display device; the second processing module provided in this embodiment may be an independent processing module in the display device, or may be built in a main chip of the display device.

For example, fig. 5 is a schematic structural diagram of an embodiment of a display device provided in the present application, and as shown in fig. 5, in the display device, a first processing module is built outside a main chip, and a decoder disposed in the main chip is connected to the first processing module. The decoder of the main chip can be used for decoding the video content to obtain the sound signal, and the first processing module is arranged behind the decoder and used for performing first processing on the sound signal output by the decoder. For the first processing performed by the first processing module and the second processing performed by the second processing module, reference may be made to the embodiment shown in fig. 4, which is not described again. Meanwhile, the main chip as shown in fig. 5 is also used for display control. The main chip is connected with a display screen of the display device and used for processing an original display signal in video content and then sending the processed original display signal to the display screen for displaying.

Fig. 6 is a schematic structural diagram of an embodiment of a display device provided in the present application, and in the example shown in fig. 6, a first processing module may be built in a main chip and connected to a decoder in the main chip; and the second processing module may be disposed outside the main chip, and the main chip is connected to the second processing module through the first processing module. The decoder in the main chip may be configured to decode the video content to obtain the sound signal, and the first processing module may be disposed behind the decoder in the main chip, and the first processing module in the main chip performs the first processing on the original sound signal and then sends the original sound signal to the second processing module for processing.

Fig. 7 is a schematic structural diagram of an embodiment of a display device provided in the present application, and in the example shown in fig. 7, both the first processing module and the second processing module may be built in a main chip, and then the decoder, the first processing module, and the second processing module in the main chip are connected in sequence. Therefore, the main chip can send the N channels of sound signals to be played to the corresponding N speakers for playing through the plurality of I2S interfaces of the second processing module.

Further, in the above-described embodiments shown in fig. 4 to 7, one AMP is connected to one speaker as an example, and in other specific implementations, if the AMP in the display apparatus is a digital AMP, one AMP may also be connected to two speakers, and the AMP may also amplify and differentially process the sound signal. For example, fig. 8 is a schematic structural diagram of an embodiment of the display device provided in the present application, and in the example shown in fig. 8, the display device includes N AMPs, and each AMP is connected to two speakers. Exemplarily, the second processing module may send one path of sound signals to be played to the AMP (1) through the I2S (1) interface, and the AMP (1) performs differential processing on the one path of signals to be played to obtain a differential left channel sound signal and a differential right channel sound signal, and then sends the signals to the speaker (1).

Further, the present application also provides a specific arrangement manner of speakers corresponding to a plurality of channels in a display device, and the following describes the arrangement manner and a processing manner of sound signals by the display device under the arrangement manner with reference to the accompanying drawings.

Fig. 9 is a schematic structural diagram of an embodiment of a display device provided in the present application, and in the example shown in fig. 5, taking a television as an example, the display device includes 9 speakers numbered in sequence from (1) to (9), and can realize playing of 8 sound channels in total of 9 sound signals.

The FR (front right) front right loudspeaker is arranged at the left lower part FR (front right) of the display screen and is used for playing an FR sound signal corresponding to an FR sound channel; (2) an FL (front left) front left loudspeaker arranged at the lower right part of the display screen and used for playing an FL sound signal corresponding to an FL sound channel; (3) an FTL (front top left) top left loudspeaker arranged at the upper left part of the display screen is used for playing FTL sound signals corresponding to FTL sound channels; (4) a top right loudspeaker arranged at the upper right part of the display screen for FTR (front top right) and used for playing FTR sound signals corresponding to FTR sound channels; (5) and (6) a Center speaker (front Center) arranged right below the display screen, wherein the two speakers are used for playing two paths of Center sound signals corresponding to the Center sound channel; (7) for SL (surround left) arranged at the left part of the display screen, the surround left loudspeaker is used for playing SL sound signals corresponding to SL sound channels; (8) an SR (surround right) surround right loudspeaker arranged at the right part of the display screen and used for playing an SR sound signal corresponding to an SR sound channel; (9) the SW (subwoofer) woofer is arranged in the middle of the display screen and is used for playing SW sound signals corresponding to the SW sound channels.

Further, fig. 10 is a schematic structural diagram of an embodiment of the display device provided in the present application, and fig. 10 provides a specific implementation manner of the display device shown in fig. 9.

As shown in fig. 10, a decoder of the display device is configured to decode video content to obtain an original sound signal in the video content, meanwhile, the display device of this embodiment is provided with 9 speakers (1) - (9), and in order to transmit the sound signals obtained by the decoder to the corresponding 9 speakers respectively for playing, as shown in fig. 10, a first processing module and a second processing module are sequentially disposed between the decoder and the 9 speakers.

When the main chip controls 9 speakers to play 9 paths of sound signals, original sound signals in the obtained video content are sent to the first processing module, wherein the original sound signals comprise multiple paths of sound signals. And then, after the first processing module performs first processing on the original sound signal to obtain 9 paths of intermediate sound signals, the 9 paths of intermediate sound signals are sent to the second processing module, and after the second processing module performs second processing on the 9 paths of intermediate sound signals, 9 paths of sound signals to be played corresponding to 9 loudspeakers are obtained. And then, the second processing module sends the 9 paths of sound signals to be played to corresponding AMPs respectively for amplification, and finally, the sound signals are played by corresponding speakers.

Wherein, the first processing module at least comprises the following steps of: 1. and converting the original sound signal into data supporting the USB protocol so as to be transmitted to the second processing module through the USB. 2. And expanding the multiple sound signals in the original sound signal into 9 sound signals. 3. The 9-way sound signal is labeled.

Correspondingly, the second processing, performed by the second processing module, on the 9 intermediate signals sent by the first processing module and received through the USB includes at least: 1. and resolving the received 9 paths of intermediate signals through the USB protocol. 2. And determining the corresponding relation between each path of sound signal and 9 loudspeakers according to the marks of the 9 paths of sound signals.

The first and second treatments performed by the first and second treatment modules can be compared in detail in tables 1 and 2.

TABLE 1

2.0

FR

FL

2.1

FR

FL

SW

3.0

FR

FL

Center

3.1

FR

FL

Center

SW

4.0

FR

FL

SR

SL

4.1

FR

FL

SR

SL

SW

5.1

FR

FL

Center

SR

SL

SW

2.0.2

FR

FL

FTR

FTL

3.1.2

FR

FL

Center

FTR

FTL

SW

5.1.2

FR

FL

Center

SR

SL

FTR

FTL

SW

TABLE 2

Specifically, as shown in table 1, multiple paths of sound signals that may be included in the original sound signal sent by the main chip to the first processing module are shown. For example, as for the original sound signal 5.1.2, it includes 9 sound signals of 8 channels of FR, FL, center, SR, SL, FTR, FTL, and SW, and the 9 sound signals correspond to sound signals that can be played by the display apparatus through 9 speakers. Therefore, the first processing module can perform protocol conversion and corresponding relationship establishment on the 8 paths of sound signals, and then send the 8 paths of sound signals to the second processing module. The original audio signal 3.1 includes only 4 audio signals of FR, FL, SW, and Center, and the 3 audio signals correspond to the FR speaker, FL speaker, SW speaker, and Center speaker of the display device, but other speakers of the display device do not have audio signals that can be directly played, so the first processing module needs to expand the 3 audio signals to obtain 8 audio signals, and then send the 8 audio signals to the second processing module.

Specifically, the process of expanding the 3 channels of sound signals by the first processing module may be referred to as "re-encoding" in table 2, where the parameters a, b, c, d, e, and w may be used to set different values to obtain 8 channels of sound signals with different playing effects. Wherein, the value range of the parameters can be (-1, 1).

For example, as shown in table 2, when the first processing module receives that the original sound signal transmitted by the master chip is 3.1, including 4 sound signals including FR, FL, SW and Center, and the first processing module obtains 8 intermediate signals from the 4 sound signals, the FR and FL pass-through are taken as the intermediate signals that can be directly transmitted to the FR speaker and the FL speaker, and the intermediate signal transmitted to the Center speaker can be calculated by f _ Center = a · FR + b · FL + c · Center. Wherein, a is used for weighting the sound signal corresponding to the FR speaker, b is used for weighting the sound signal corresponding to the FL speaker, and c is used for weighting the sound signal corresponding to the Center speaker. Finally, the weighted sound signal f _ Center is obtained as the sound signal actually sent to the Center speaker. Wherein, a, b and c can be set as the values between (-1, 1) according to the needs, thereby adjusting the sound signal of the Center loudspeaker.

Based on the same reasoning, the intermediate signal sent to the SR speaker can be calculated by f _ SR = d · SR + e · SL, where d and e are used to process the sound signals of the SR speaker and the SL speaker, respectively, to obtain a weighted sound signal f _ SR as the sound signal actually sent to the SR speaker. The intermediate signal sent to the SL speaker may be calculated by f _ SL = d · SR + e · SL, where d and e are used to process the sound signals of the SR speaker and the SL speaker, respectively, resulting in a weighted sound signal f _ SL as the sound signal actually sent to the SL speaker. The intermediate signal sent to the FTR speaker can be calculated by f _ FTR = a · FR + b · FL + d · SR + e · SL, where a, b, d, and e are used to process the sound signals of the FR speaker, FL speaker, SR speaker, and SL speaker, respectively, to obtain a weighted sound signal f _ FTR as the sound signal actually sent to the FTR speaker. The intermediate signal sent to the FTL speaker can be calculated by f _ FTL = a · FR + b · FL + d · SR + e · SL, where a, b, d, and e are used to process the sound signals of the FR speaker, FL speaker, SR speaker, and SL speaker, respectively, to obtain a weighted sound signal f _ FTL as the sound signal actually sent to the FTL speaker. The intermediate signal sent to the SW speaker can be calculated by f _ SW = sum (w · lowPass (all CH)), where all the sound signals are weighted by multiplying w after passing through a low pass filter of lowPass to filter out high frequency components, and the weighted f _ SW is obtained as the sound signal actually sent to the SW speaker finally.

For another example, if the original audio signal received by the first processing module is 5.1.2, although it includes 8 audio signals of FR, FL, center, SR, SL, FTR, FTL, and SW, the first processing module can also determine that a =0, b =0, c =1; f _ SR = d · SR + e · SL, d =1, e =0; f _ SR = d · SR + e · SL, d =0, e =1; f _ FTR = a · FR + b · FL + d · SR + e · SL, a =0, b =0, d =1, e =0; in f _ FTL = a · FR + b · FL + d · SR + e · SL, a =0, b =0, d =0, e =1, the audio signal is subjected to the re-encoding process, and then transmitted to the second processing module.

Meanwhile, when the first processing module marks the correspondence relationship of the sound signals, the marks "01" - "08" may be added to the sound signals corresponding to each channel according to the correspondence relationship between the marks "01" - "08" and the channels in table 2. And when the second processing module distributes the sound signals, the corresponding sound signals are sent to the corresponding AMPs and the corresponding loudspeakers to be played according to the marks of the sound signals by the first processing module.

Alternatively, in the example shown in fig. 6, a separate AMP is connected to each speaker as an exemplary illustration, and in a specific implementation, the amplification of the sound signals corresponding to two speakers may be implemented by one AMP. For example, fig. 11 is a schematic structural diagram of an embodiment of the display device provided in the present application, and in the example shown in fig. 11, the FR speaker (1) and the FL speaker (2) may be connected through one AMP (1), and the AMP may amplify both the sound signal corresponding to the FR speaker and the sound signal corresponding to the FL speaker, and may be used for performing differential processing on the sound signals. Similarly, the FTL speaker (3) and the FTR speaker (4) may be connected by one AMP (2), the Center speaker (5) and the Center speaker (6) may be connected by one AMP (3), and the SL speaker (7) and the SR speaker (8) may be connected by one AMP (4).

Optionally, the first processing module and the second processing module provided by the present application may be a processor in an entity in a main chip of the display device, such as a CPU, a GPU, and the like; alternatively, when the first and second processing modules are disposed on the main chip, the first and second processing modules may also be implemented by hardware abstraction layer (HAL layer) code in the main chip of the display apparatus. When the first processing module is implemented through a software code in the main chip, the first processing module and the second processing module are connected through a first connecting line, and the equivalent of the first processing module is connected with the main chip through the first connecting line and the second processing module, and the logic relationship is that the main chip processes the original sound signal through the first processing module to obtain a plurality of paths of intermediate signals, and sends the plurality of paths of intermediate signals to the second processing module through the first connecting line through an interface corresponding to the first connecting line on the main chip.

Fig. 12 is a schematic diagram of a software structure of a display device provided in the present application, and as shown in fig. 12, taking an example of loading an Android system in the display device, the Android system loaded in the display device includes: java, native, kernel and Hardware. Note that the structure of each layer for realizing the Multi-Channel sound signal playing function of the present application is MTC (Multi-Channel). The present application acquires a plurality of sound signals to be played from a framework layer Audio _ HAL corresponding to Media Player through a Hardware Abstraction Layer (HAL) code on the basis of an application Media Player for playing video contents in a Java layer of a display device.

In a specific implementation, the method can be implemented by decoding a library function in the android system through software, for example, the MTC _ Lib shown in the figure can create a multi-channel output thread by calling AudioTrack native to the android system. While "MTC _ S" in Native layer in the android system can be understood as a service, the output of a multi-channel supported sound signal can be notified to the AudioFlinger through get _ channels () function, and the multi-channel sound signal can be output to a speaker (Local Audio Hardware) in Hardware layer for playing through MTC _ Core in Kernel layer.

In addition, in the embodiment shown in fig. 12, the Kernel layer may also be connected with an application program (MTC _ a) of the Java layer through an Interface (MTC _ Interface), so that the application program MTC _ a may obtain parameters in the Kernel layer and control the Kernel layer.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display device, comprising:

the second processing module is used for performing second processing on the multi-channel intermediate sound signals to obtain multi-channel sound signals to be played corresponding to the plurality of loudspeakers, and sending the multi-channel sound signals to be played to the corresponding AMPs respectively for amplification processing, and then playing the multi-channel sound signals by the corresponding loudspeakers;

the first processing of the original sound signal by the first processing module comprises:

the first processing module performs recoding processing on the original sound signal, packs the multi-channel intermediate sound signal into a file and sends the file to the second processing module through the first connecting line;

wherein the re-encoding process includes: according to f _ Center = a · FR + b · FL + c · Center; f _ SR = d · SR + e · SL; f _ SR = d · SR + e · SL; f _ FTR = a · FR + b · FL + d · SR + e · SL; f _ FTL = a · FR + b · FL + d · SR + e · SL, re-encoding the original sound signal, the parameters a, b, c, d, and e are used to weight the sound signals of the FR speaker, FL speaker, center speaker, SR speaker, and SL speaker, respectively, and the value range of the parameter is (-1,1).

2. The display device according to claim 1,

the first protocol is a Universal Serial Bus (USB) protocol.

3. The display device according to claim 2,

the first processing module is arranged inside a main chip of the display device.

4. The display device according to claim 2,

the second processing module is arranged inside a main chip of the display device.

5. The display device according to any one of claims 1 to 4, wherein the plurality of speakers are provided below the display screen, the plurality of speakers including:

the loudspeaker comprises a front left loudspeaker arranged at the left lower part of the display screen, a front right loudspeaker arranged at the right lower part of the display screen, a top left loudspeaker arranged at the left upper part of the display screen, a top right loudspeaker arranged at the right upper part of the display screen, a middle loudspeaker arranged under the display screen, a surrounding left loudspeaker arranged at the left part of the display screen, a surrounding right loudspeaker arranged at the right part of the display screen and a woofer arranged at the middle part of the display screen.

6. The display device according to any one of claims 1 to 4,

and when the original sound signal comprises a plurality of paths of sound signals and the number of the plurality of loudspeakers is less than that of the plurality of loudspeakers, filling the original sound signal according to the corresponding relation between the original sound signal comprising the plurality of paths of sound signals and the plurality of loudspeakers to obtain a plurality of paths of intermediate sound signals corresponding to the plurality of loudspeakers.

7. The display device according to any one of claims 1 to 4,

when the number of the plurality of paths of sound signals in the original sound signals is smaller than the number of the plurality of loudspeakers, carrying out protocol conversion on the original sound signals according to the first protocol to obtain a plurality of paths of intermediate sound signals supporting the first protocol;

the second processing of the multi-path intermediate signal by the second processing module comprises:

and analyzing the multi-channel middle sound signals according to the first protocol to obtain multi-channel sound signals to be played, which can be played by a loudspeaker.

8. The display device according to any one of claims 1 to 4,

when the original sound signal comprises a plurality of paths of sound signals, the number of the paths of intermediate sound signals is smaller than that of the plurality of loudspeakers, and the plurality of paths of intermediate sound signals are marked according to the corresponding relation between the plurality of paths of intermediate sound signals and the plurality of loudspeakers;

the second processing of the multi-channel intermediate signals by the second processing module comprises:

and obtaining the multi-channel sound signals to be played corresponding to the plurality of loudspeakers according to the marks of the multi-channel middle sound signals.

9. The display device according to claim 1 or 3,

the first processing module is located at a hardware abstraction HAL layer of an operating system of the display device.

10. The display device according to claim 1 or 4,

the second processing module is located at a hardware abstraction HAL layer of an operating system of the display device.