WO2022088899A1 - Display device, communication method between display device and external loudspeaker, and audio output method for external loudspeaker - Google Patents

Abstract

Provided in some embodiments of the present application are a display device, a communication method between the display device and an external loudspeaker, and an audio output method for the external loudspeaker. The display device comprises a display and a controller. The controller is configured to: determine whether the display device has established a first communication connection with a first device after the external loudspeaker is successfully connected to the display device, wherein one connection mode between the external loudspeaker and the display device comprises the first communication connection; control the external loudspeaker and the first device to operate in different frequency bands if the display device has established the first communication connection with the first device; and control the external loudspeaker to communicate with the display device according to a default frequency band if the display device does not establish the first communication connection with the first device.

Description

Display device, communication method between display device and external audio, and audio output method of external audio

This application is required to be submitted on December 10, 2020, the application number is 202011455154.1, and the application name is "display device and communication method between display device and wireless speaker"; submitted on October 27, 2020, the application number is 202011166647.3, The priority of the Chinese patent application entitled "Display Device, External Audio Device, and Method for Audio Output of External Audio Device", the entire content of which is incorporated herein by reference.

technical field

The present application relates to a display device, and in particular, to a display device, a communication method between the display device and an external audio, and an audio output method for the external audio.

Background technique

With the continuous advancement of electronic technology, the needs of users are also constantly increasing. When users use display devices such as mobile phones, tablet computers and TVs to watch movies, TV programs and listen to music, they are increasingly pursuing more realistic and shocking. Audiovisual experience. Therefore, more and more video content provides sound signals corresponding to more directions and more types of channels, which brings a sense of immersion to the user and improves the user's audio-visual experience. Among them, all the different sound signals included in the video content need to be played through speakers set at specific positions in the scene. The display device can realize the surround effect of the sound field through external speakers, such as an external subwoofer and an external rear surround sound for the display device.

SUMMARY OF THE INVENTION

Some embodiments of the present application provide a display device, the display is used to display a user interface; the first controller is configured to: send a first command including a first parameter to an external audio device, the first parameter is used for all The external audio equipment is configured with an audio data pool, and the audio data pool stores the received audio data; after the pairing is successful, the first controller can control the external audio equipment to output audio data; otherwise, control the user interface to display the first audio data. A prompt message, the first prompt message jumps to the pairing setting interface after receiving the confirmation operation.

Some embodiments of the present application provide an external audio device, including: a second controller configured to: receive a first instruction including a first parameter sent by a display device, where the first parameter is used to configure an audio data pool, and the The audio data pool stores the received audio data; when the data length in the audio data pool is greater than the first threshold configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length, and Play the audio data after frame loss; otherwise, send a second instruction to the display device.

Some embodiments of the present application provide a method for outputting audio from an external audio device. The method includes: sending a first command including a first parameter to the external audio device, where the first parameter is used for the external audio device to configure audio data The audio data pool stores the received audio data; after the pairing is successful, the external audio equipment can be controlled to output the audio data; otherwise, the first prompt message is displayed, and the first prompt message jumps to the pairing after receiving the confirmation operation Set interface.

Some embodiments of the present application provide a method for outputting audio from an external audio device, the method comprising: receiving a first instruction including a first parameter sent by a display device, where the first parameter is used to configure an audio data pool, the audio The data pool stores the received audio data; when the data length in the audio data pool is greater than the first threshold configured by the first parameter, control the audio data to actively drop frames to shorten the data length, and play the audio data after the dropped frames; Otherwise, send a second instruction to the display device.

In some embodiments, the present application provides a display device, the display device includes: a display; a controller, the controller is configured to: after the external audio and the display device are successfully connected, determine whether the display device is connected to the first device Whether a first communication connection is established, wherein one of the connection methods between the external audio and the display device includes the first communication connection; if the display device and the first device establish a first communication connection, The external audio and the first device are controlled to work in different frequency bands; if the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to the default frequency band.

Some embodiments of the present application provide a display device, the display device includes: a display; a controller, where the controller is configured to: after the external audio and the display device are successfully connected, determine whether the external audio and the display device exist If there is a connection record between the external audio and the display device, control the external audio to communicate with the display device according to the frequency band in the connection record; if there is no connection between the external audio and the display device Record, determine whether the display device and the first device have established a first communication connection, wherein, one of the connection methods between the external audio and the display device includes the first communication connection; if the display device and the first device A first communication connection is established, and the external audio and the first device are controlled to work in different frequency bands; if the display device does not establish a first communication connection with the first device, the external audio is controlled to work with the display according to the default frequency band devices to communicate.

Some embodiments of the present application provide a display device, the display device includes: a display; a controller, where the controller is configured to: after the first device and the display device are successfully connected, determine whether the display device and the first device are established If the first communication connection is established between the display device and the first device, the external audio and the first device are controlled to work in different frequency bands, wherein the connection between the external audio and the display device is one of the One includes the first communication connection; if the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to the default frequency band.

The present application provides a method for audio output from an external audio device. The method includes: after the external audio and the display device are successfully connected, determining whether the display device and the first device have established a first communication connection, wherein the external audio is connected to the display device. One of the connection modes between the display devices includes the first communication connection; if the display device and the first device establish a first communication connection, control the external audio and the first device to work in different frequency bands; If the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to a default frequency band.

Some embodiments of the present application provide a display device including: a display, a communicator, an audio output interface, and a controller. Wherein, the display is configured to display an audio playback screen; the communicator is configured to establish a wireless connection with a sound playback device; the audio output interface is configured to play audio signals. The controller is configured to perform the following program steps: obtaining control instructions for playing audio; in response to the control instructions, decoding the played audio to obtain multi-channel data; separating from the multi-channel data Surround sound data and power amplified sound data; send the power amplified sound data to an audio output interface, and send the surround sound data to the sound playback device through the communicator.

Some embodiments of the present application provide a method for audio output from an external audio device, including: obtaining a control instruction for playing audio; in response to the control instruction, decoding the played audio to obtain multi-channel data; The surround sound data and the power amplifier sound data are separated from the multi-channel data; the power amplifier sound data is sent to the audio output interface, and the surround sound data is sent to the sound playback device through the communicator.

Some embodiments of the present application provide a display device, including: a display; a user interface for receiving an instruction input by a user; a controller for executing: in response to the input instruction to display an interface including a device list menu entry, on the display displaying the interface; in response to inputting an instruction to select the entry of the device list menu, generate a device list menu, and display the device list menu on the display, the device list menu including the configured sound list item and the unconfigured sound list item; and, when the configured audio list item is selected, displaying the configured audio item corresponding to the configured audio list item on the display, wherein the configured audio item includes the audio name and the connection status; selecting the selected audio item in response to the input According to the instruction of the configured audio item, a detailed page of the configured audio is displayed on the display, and the detailed page of the configured audio includes a name setting item, an unconfigured item and a disconnected link item.

Some embodiments of the present application provide a display device, including: a display; a user interface for receiving an instruction input by a user; a controller for executing: in response to the input instruction to display an interface including a device list menu entry, on the display displaying the interface; in response to inputting an instruction to select the entry of the device list menu, generate a device list menu, and display the device list menu on the display, the device list menu including the configured sound list item and the unconfigured sound list item; In response to inputting an instruction to select the unconfigured sound list item, displaying an unconfigured sound item corresponding to the unconfigured sound list item on the display, wherein the unconfigured sound item includes sound identification, sound status and reminder items; responding Upon inputting an instruction to select the unconfigured audio item, a detailed page of the unconfigured audio is displayed on the display, and the unconfigured audio detail page includes the audio channel configuration item, the name setting item and the confirmation item.

Some embodiments of the present application provide a communication method between a display device and an external speaker, including: after the external speaker and the display device are successfully connected, judging whether a first communication connection is established between the display device and the first device, wherein the external speaker One of the connection methods with the display device includes the first communication connection; if the display device and the first device establish a first communication connection, control the external audio and the first device to work in different frequency bands ; if the display device does not establish a first communication connection with the first device, control the external audio to communicate with the display device according to the default frequency band.

Description of drawings

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present application;

FIG. 2 is a block diagram of a hardware configuration of a display device 200 according to one or more embodiments of the present application;

FIG. 3 is a block diagram of the hardware configuration of the control device 100 according to one or more embodiments of the present application;

FIG. 4 is a schematic diagram of software configuration in a display device 200 according to one or more embodiments of the present application;

FIG. 5 is a schematic diagram showing an icon control interface of an application in a display device 200 according to one or more embodiments of the present application;

6 is an arrangement diagram of a display device and a sound playback device according to one or more embodiments of the present application;

7 is a schematic flowchart of an audio output method according to one or more embodiments of the present application;

8 is a schematic flowchart of configuring a playback channel based on a WiFi network according to one or more embodiments of the present application;

9 is a schematic flowchart of a configuration playback channel based on a Bluetooth connection according to one or more embodiments of the present application;

10-14 are schematic diagrams of user interfaces according to one or more embodiments of the present application;

15 is a schematic diagram of communication between a display device and an external audio according to one or more embodiments of the present application;

16 is a schematic diagram of an audio data pool configuration interaction according to one or more embodiments of the present application.

Detailed ways

In order to make the objectives, implementations and advantages of the present application clearer, the exemplary embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the exemplary embodiments described It is only a part of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments described in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the appended claims of this application. Furthermore, although the disclosures in this application have been presented in terms of illustrative example or instances, it should be understood that various aspects of this disclosure may also constitute a complete embodiment in isolation. It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described below, rather than intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to one or more embodiments of the present application. As shown in FIG. 1 , a user can operate the display device 200 through a mobile terminal 300 and the control device 100 . The control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and wireless or other wired ways to control the display device 200 . The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function. The display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The display device 200 may additionally provide a computer-supported Internet TV function in addition to the broadcast receiving TV function.

FIG. 2 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 . The communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key or an alternative module.

FIG. 3 is a block diagram showing a hardware configuration of the display apparatus 200 according to an exemplary embodiment. As shown in FIG. 3 , the display device 200 includes a tuner 210 , a communicator 220 , a detector 230 , an external device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a user interface 280 . at least one. The controller includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner-demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect external environment or external interaction signals. The controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250, through various software control programs stored in memory, controls the operation of the display device and responds to user operations. The controller 250 controls the overall operation of the display apparatus 200 . A user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. The commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner.

FIG. 4 is a schematic diagram of software configuration in the display device 200 according to one or more embodiments of the present application. As shown in FIG. 4 , the system is divided into four layers. Layer"), the Application Framework layer (referred to as the "framework layer"), the Android runtime (Android runtime) and the system library layer (referred to as the "system runtime layer"), and the kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive etc.

FIG. 5 is a schematic diagram showing an icon control interface of an application in a display device 200 according to one or more embodiments of the present application. As shown in FIG. 5 , the application layer includes at least one application that can display a corresponding icon control on the display. , such as: live TV application icon control, video on demand application icon control, media center application icon control, application center icon control, game application icon control, etc. Live TV app that can provide live TV from different sources. Video-on-demand application that can provide video from different storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. A media center application that can provide a variety of multimedia content playback applications. The application center can provide storage of various applications.

<Wireless Surround Sound Solution>

Hereinafter, the entire content of the Chinese patent application of the inventor of the present application, dated July 3, 2020, application number 202010630873.6, titled "A display device and audio output method" is cited in this application. Based on the above-mentioned display device 200 , the user can perform interactive operations through settings such as the control device 100 to play media resources, so as to display the playback screen on the display 275 and output sound through the audio output interface 285 . The media assets include video media assets and audio media assets. Typically, both video media assets and audio media assets contain audio data. For example, after the user chooses to play any video media asset, the controller 250 may call a decoder or run a decoding program to decode the media asset data, and obtain video data and audio data respectively. Then by calling the display 275 and the audio output interface 285 respectively, the video data and the audio data are played into pictures and sounds.

In order to output the audio data as a specific sound, a speaker 286 and an external audio output terminal 287 can be connected to the audio output interface 285 . Usually, the display device 200 has a built-in speaker 286, and the external audio output terminal 287 can be connected to an external audio device, so as to convert the electrical signal of the audio data into a specific sound signal. The user can also connect an external sound playing device 500 according to the needs of playing. In order to obtain a better surround sound effect and reduce equipment costs, in some embodiments of the present application, the sound playback device 500 is connected to the display device 200 through the communicator 220 to assist the display device 200 to construct surround sound. For WiFi speakers, Bluetooth speakers, and speakers based on other wireless transmission methods, due to the flexibility of their wireless connections, their locations can be arbitrarily set in the vicinity of the display device 200 . For example, the sound playback device 500 can be set on the left side, right side, left rear, right rear, etc. of the viewing user, so as to generate sound signals at these set orientations, thereby restoring the stereo effect. In addition, the same or different connection manners may be used between the plurality of sound playback apparatuses 500 and the display device 200.

In the embodiment of the present application, since the external sound playback device 500 is used to assist in forming a surround sound effect, when the audio is actually played, the original speaker 286 on the display device 200 still maintains audio output, and the external sound playback device 500 also maintains audio output. Keep audio output. In this way, as shown in FIG. 6 , through the speaker 286 located in front of the user and the sound playback device 500 located behind the user, surround sound can be formed in multiple directions around the user. Therefore, compared with the sound processing software algorithm in the related art, it is possible to Better restore the surround sound effect.

In order to form sound playback effects in multiple directions, some embodiments of the present application provide an audio output method, as shown in FIG. 7 , the audio output method includes the following steps:

S1: Get the control command for playing audio. In practical applications, the control instruction for playing audio can be manually input by the user, that is, when the user selects any media asset to play on the video or audio media asset interface, the display device 200 needs to convert the media asset data into a specific video or audio. to play. Therefore, the control instruction for playing audio may be the control instruction input when the user selects any media asset and starts playing. For example, the user performs an interactive operation through the control device 100, and controls the movement of the focus cursor on the media asset details page, moves the cursor to the icon of "movie A", and presses the "OK" key on the control device 100, then Execute the playback of the "movie A" media asset, that is, input a control command for playing audio.

S2: In response to the control instruction, decode the played audio to obtain multi-channel data. After acquiring the control instruction for playing audio, the controller 250 of the display device 200 may perform decoding on the audio to be played in response to the control instruction, thereby decoding the media asset data into multi-channel data. Wherein, the multi-channel data may be source data contained in the media resource data, for example, the media resource itself is a surround sound source; it may also be regenerated data based on the media resource data combined with a specific stereo restoration algorithm, For example, when the media itself is not a surround sound source, the audio is simulated as surround sound through the built-in stereo restoration algorithm.

S3: Separate surround sound data and power amplifier sound data from the multi-channel data. After the multi-channel data is obtained by decoding, each channel in the multi-channel data may be separated, and then sent to different speakers 286 and the sound playback device 500 for playback. In the embodiment of the present application, in order to cooperate with the external sound playback device 500, the data of each channel can be divided into two categories, one is the power amplifier sound data played by the built-in speaker 286 of the display device 200, and the other is played by the external sound Surround sound data played by device 500 . The separated channel data can be played by the speakers 286 or the sound playback device 500 respectively, so the number of separated channel data should be consistent with the number of the speakers 286 and the sound playback device 500 . For example, two power amplifier sound data, left channel data and right channel data, and two surround sound data, left surround channel data and right surround channel data, may be separated from the multi-channel data, respectively. After the multi-channel data is separated, the controller 250 can also process the separated surround sound data and power amplifier sound data by calling different sound effect processing programs, including processing processes such as sound quality adjustment, volume adjustment, playback synchronization adjustment, etc. , to make the restored stereo sound better.

S4: Send the power amplifier sound data to an audio output interface, and send the surround sound data to the sound playback device through the communicator. After the multi-channel data is separated, the separated channel data may be sent separately. That is, the audio data of the power amplifier can be sent to the audio output interface for playback through the built-in speaker 286 . At the same time, the surround sound data is sent to the communicator 220 , and the surround sound data is sent to the sound playback device 500 through the communicator 220 to be played by the sound playback device 500 .

It can be seen that, in the above embodiment, the display device 200 can decode the media asset data into multi-channel data when playing audio, and separate the power-amplified sound data and the surround-sound data from the multi-channel data, and finally The data is sent to the audio output interface and output at the speaker 286 , and the surround sound data is sent to the sound playback device 500 through the communicator 220 and output at the sound playback device 500 . It can be seen that the display device 200 can generate surround sound behind the user through the external sound playback device 500, and transmit the surround sound data through the communicator 220, so that it is possible to restore a relatively high level of sound without the need to deploy professional surround sound equipment. Good surround sound effect.

In some embodiments, the sound playback apparatus 500 may establish a connection with the display device 200 through a WiFi network, and transmit corresponding channel data through the WiFi network. That is, the communicator 220 includes a WiFi module 221. As shown in FIG. 8 , the audio output method further includes the following steps:

S501: Send a TCP broadcast to the wireless local area network where the display device is located through the WiFi module;

S502: Receive a broadcast response from the sound playback device for the TCP broadcast feedback;

S503: Extract the IP address from the broadcast response;

S504: Configure a playback channel for the sound playback device according to the IP address. Among them, Transmission Control Protocol (TCP, Transmission Control Protocol) is a connection-oriented, reliable, byte stream-based transport layer communication protocol, which can adapt to the layered protocol hierarchy supporting multi-network applications. In order to realize that the display device 200 is externally connected to the sound playing device 500 , in this embodiment, the controller 250 may send a TCP broadcast to the wireless local area network where the display device 200 is located through the WiFi module 221 . The sent TCP broadcast may include an identifier for indicating the establishment of a connection with the sound playback apparatus 500, so that the sound playback apparatus 500 can feed back a broadcast response to the TCP broadcast.

In the above-mentioned embodiment, the sound equipment based on the WiFi network can be placed around the viewing area of the user, so as to generate sound in directions such as side and rear. By using the WiFi network, the separated surround sound data can be sent to the sound playback device 500 for playback, so as to obtain a better surround sound effect. Therefore, the above-mentioned embodiment can utilize the idle audio equipment in the home without re-wiring to realize the stereo effect of the surround sound like a theater sound, thereby improving the user experience.

In some embodiments of the present application, the connection between the display device 200 and the sound playback apparatus 500 may also be realized by means of a Bluetooth connection. That is, the communicator 220 includes a Bluetooth module 222. As shown in FIG. 9, the audio output method further includes the following steps:

S601: Search for the pairable sound playback device through the Bluetooth module;

S602: Pair a Bluetooth connection with at least one of the sound playback devices;

S603: Acquire name information of the paired sound playback device;

S604: Configure a playback channel for the sound playback device according to the name information.

It can be seen that, in the above-mentioned embodiment, the connection between the display device 200 and the sound playing apparatus 500 can be realized by means of a Bluetooth connection. As a wireless connection method, Bluetooth connection can realize data transmission within a certain range, and for the sound playback device 500 based on Bluetooth connection, since a general protocol is used, there is no need to create an application in the sound playback device 500 separately. Therefore, most configuration requirements of the display device 200 can be met. It should be noted that, in order to realize that the display device 200 is externally connected to the sound playback apparatus 500, other wireless connection methods, such as zigbee, radio frequency network, etc., may also be used.

In some embodiments of the present application, in order to obtain a better sound playback effect, the audio quality may also be processed before the surround sound data and the power amplified sound data are sent to the sound playback device 500 and the speaker 286 . That is, the display device 200 further includes an audio processor 280, and the audio output method further includes: sending the multi-channel data to the audio processor 280 to perform sound effect processing; or sending the surround sound data and the power amplifier sound data to The audio processor 280 performs sound effect processing. Among them, the sound quality processing performed on the audio is sound-related processing performed on the audio data. In practical applications, after decoding the played audio to obtain multi-channel data, the multi-channel data may be sent to the audio processor 280, so that the audio processor 280 performs unified sound quality processing on the multi-channel data. In the case of unified sound effect processing, the processing efficiency is high, high-quality audio data can be obtained quickly, and the overall sound quality of the processed sound can be kept consistent. Alternatively, after the surround sound data and the power amplified sound data are separated from the multi-channel data, the surround sound data and the power amplified sound data may be respectively sent to the audio processor 280 to perform sound effect processing for each channel. For the case of performing sound effect processing separately, it can implement different sound effect adaptation processing for different channels, so as to obtain a better surround sound effect.

When transmitting data through WiFi network and Bluetooth connection, there will inevitably be a certain data transmission delay, which will cause the sound from the sound playback device 500 to be out of sync with the sound from the speaker 286 of the display device 200, affecting user experience. For example, it can be determined through real-time measurement or statistical analysis that when the display device 200 is connected to the Bluetooth speaker, a delay of 0.5s occurs, that is, the audio played through the Bluetooth speaker lags 0.5s relative to the display screen, making the picture and sound out of sync. However, the sound output by the built-in speaker 286 of the display device 200 is kept in sync with the picture, that is, there is an asynchrony between the sound output by the speaker 286 and the sound output by the Bluetooth speaker, and the audio played through the Bluetooth speaker is 0.5s later than the audio output by the speaker 286 .

<External audio configuration>

Hereinafter, the entire content of the Chinese patent application of the inventor of the present application dated July 23, 2020, application number 202010718390.1, titled “A method for configuring an external audio for a display device and a display device” is cited in the present application. When the user needs to set the external audio of the display device, in response to an instruction input by the user using the control device to display an interface including the device list menu entry, the display device can provide the display with a user interface 400, the user interface 400 including the device list menu entry . 10-14 are schematic diagrams of user interfaces according to one or more embodiments of the present application. In some embodiments, as shown in FIG. 10 , the user interface includes a device list menu entry 41 . The user interface 400 also includes a selector 42 indicating that the device list menu entry is selected.

It should also be noted that the selector is used to indicate that any of the items has been selected, such as the focus object. The item may be selected or controlled by controlling the movement of the display focus object in the display device 200 according to the user's input through the control apparatus 100 . For example, the user can select and control the application items by controlling the movement of the focus object between the application items through the arrow keys on the control device 100 . When the selector is located on the device list menu entry, the user can press the "OK" button through the control device, the user inputs an instruction to select the device list menu entry, and the device list menu is displayed on the display; in some embodiments, the device list menu As shown in FIG. 11 , the device list menu 43 includes a configured sound list item 431 and an unconfigured sound list item 432 . When the selector is on the configured audio list item 431, the display interface also displays the configured audio items 4311-4312 corresponding to the configured audio list item 431, and the configured audio items 4311-4312 are all set with audio names 43111 and connection status 43121, the connection status can be indicated by color, if the speaker is connected to the display device, the connection status is displayed in green, if the speaker is not connected with the display device, the connection status is displayed in red. Wherein, the sound can be a wifi sound.

When the user selects a configured audio item connected to the display device, a detail page of the configured audio is displayed on the display. The details page of the configured sound includes a name setting item, an unconfigured item, and a disconnected link item. Continue as shown in Figure 11, select the configured audio item 4311 corresponding to the audio name of the left surround, the page jumps to Figure 12, Figure 12 shows the details page 44 of the configured audio, the user selects the name setting item 441 through the control device, To modify the name of the current speaker, the cancel configuration item 442 can also be selected to delete all configuration information of the speaker, and the disconnect item 443 can be selected to interrupt the connection between the speaker and the display device. The configuration information includes sound channels and/or sound names.

When the user selects a configured audio item that is not connected to the display device, the detailed page of the configured audio is no longer displayed on the display, but the configuration information of the audio is directly deleted. Continue as shown in Figure 11, select the configured audio item 4312 corresponding to the right surround, the page will not jump, but directly delete the configuration information of the audio. As shown in FIG. 13, when the selector is located on the unconfigured sound list item 432, the display interface also displays unconfigured sound items 4321-4323 corresponding to the unconfigured sound list item 432. The unconfigured sound items 4321-4323 4323 are all provided with sound identification 43211, sound status 43212 and reminder item 43213, wherein the sound identification can be a MAC address or UUID (Universally Unique Identifier), the sound status indicates the position of the current selector, and the sound status indicates the position of the current selector. When the status is displayed in green, it means that the current selector is on the unconfigured audio item corresponding to the audio status displayed in green.

When the user selects the reminder item 43213 through the controller, the corresponding sound performs an action at this time, and the action includes sound or sound and light flashing. In addition to the above-mentioned actions in this embodiment of the present application, any sound that can distinguish the sound from other sounds Actions are possible.

When the unconfigured audio item is selected, the page jumps to the details page of the unconfigured audio. In some embodiments, as shown in FIG. 14 , the details page 45 of the unconfigured sound shown in FIG. 14 includes a configuration sound channel item 451 , a name setting item 452 , and a determination item 453 . When the confirmation item 453 is selected, the sound configuration information is sent to the corresponding sound, and the sound is adjusted according to the configuration information. It should be noted that, the operation of selecting an unconfigured audio item in this embodiment of the present application may be for the user to move the selector to the arrow item on the right side of the reminder item by using the control device, and press the "OK" button. In addition, any other operation of selecting an unconfigured audio item is within the protection scope of the present application.

<Display device and external audio communication>

In some embodiments, a communication method between a display device and an external speaker is introduced by taking an external subwoofer of the display device as an example. FIG. 15 is a schematic diagram of communication between a display device and an external audio according to one or more embodiments of the present application. Referring to FIG. 15 ,

The display device can be provided with a controller, a WiFi module, a left speaker, a right speaker, and a bass channel data transmission module, wherein an I2S bus can be connected between the controller and the left speaker, right speaker, and bass channel data transmission module, respectively. An I2C bus can also be connected between the controller and the bass channel data sending module. In some embodiments, the audio data of the media asset played on the display device may include left channel data, right channel data, and bass channel data. After the controller parses the audio data of the media asset into left channel data, right channel data and bass channel data, it can send the left channel data to the left speaker through the I2S bus, and send the right channel data to the I2S bus. The right speaker sends the bass channel data to the bass channel data sending module through the I2S bus. The left speaker can sound after receiving the data of the left channel, the right speaker can sound after receiving the data of the right channel, and the bass channel data sending module can send the bass channel data to the subwoofer after receiving the data of the bass channel The subwoofer is provided with a bass channel data receiving module, which can receive the bass channel data sent by the bass channel data sending module, and the subwoofer emits sound according to the received bass channel data.

In some embodiments, the controller can send a control command, such as a frequency adjustment command, to the bass channel data sending module through the I2C bus, and the bass channel data sending module adjusts the frequency of the signal sent according to the frequency adjustment command to avoid mutual communication with the WiFi module. interference.

In some embodiments, the bass channel data transmission module may include a WiFi signal transmission unit, the WiFi signal transmission unit may transmit a 5.2G WiFi signal or a 5.8G WiFi signal, and may adjust the frequency of the transmitted signal according to the frequency adjustment instruction of the controller .

In some embodiments, the bass channel data sending module may further include a Bluetooth connection unit, and the external audio also includes a Bluetooth module matched with it. The command interaction between the display device and the external audio is carried out through Bluetooth communication, such as volume +, volume -, etc., and audio data is transmitted through wireless communication (such as 5G WiFi).

In some embodiments, in addition to the 5G WiFi connection with the subwoofer, the display device can also perform 5G WiFi connection with other devices through the WiFi module. In addition to the subwoofer, the device capable of 5G WiFi connection with the display device may be referred to as the first a device. Some routers may support the functionality of a 5G WiFi connection, and the first device may include a router.

In some embodiments, the router can send 2.4G WiFi signals and 5G WiFi signals at the same time to form a 2.4G WiFi network and a 5G WiFi network. Devices that can receive the 2.4G WiFi signal can choose to join the 2.4G WiFi network and can receive The device that receives the 5G WiFi signal can choose to access the 5G WiFi network, and the device that can receive the 2.4G WiFi signal and the 5G WiFi signal at the same time can choose to access one of the WiFi networks. For example, the display device can receive the 2.4G WiFi signal and the 5G WiFi signal at the same time, and can select a WiFi network for access according to network performance such as network signal strength and network delay.

In some embodiments, the 5G WiFi signal sent by the router may be 5.2G WiFi or 5.8G WiFi, which may be determined by the user's pre-configuration of the router.

In some embodiments, when the display device is powered on for the first time, a boot-up guide may be displayed, and the boot-up guide may include multiple interfaces, one of which may be a WiFi connection interface, and the other interface may be a subwoofer pairing interface. On the WiFi connection interface, the user can select a WiFi searched by the display device to connect, or the user can skip this interface and temporarily do not connect to the WiFi. The user can confirm the pairing of the subwoofer on the subwoofer pairing interface, and connect the subwoofer channel data sending module and the subwoofer channel data receiving module. The user can also skip this interface and temporarily do not perform subwoofer pairing.

In some embodiments, if the user does not perform subwoofer pairing on the boot-up guide interface, the subwoofer pairing can also be performed on the setting interface of the display device, wherein the user can call up the settings on the display device by pressing the menu key on the remote control. interface.

In some embodiments, if the user does not perform WiFi connection on the booting guide interface, the user can also perform WiFi connection on the setting interface of the display device, wherein the user can call up the setting interface on the display device by pressing the menu key on the remote control.

In some embodiments, after the display device has been connected to a WiFi network, the user may also call up a setting interface on the display device, and re-select a WiFi network for access. For example, when the display device can search for the WiFi signals of two routers, if the network quality of the currently connected WiFi network is not good, the user can switch WiFi on the setting interface to enable the display device to access the WiFi network of another router. to improve network quality.

In some embodiments, when the display device is not powered on for the first time, if the display device was connected to WiFi before it was powered off, the WiFi connected before the shutdown is automatically reconnected. For example, the display device can record the information of each connected WiFi in a file under a preset path, and the file can be stored in the memory of the display device for easy query, so that it can be automatically reconnected according to the file after booting. One time connected WiFi. For example, the display device may also record the user operation information in a file under a preset path. The user operation information includes the WiFi connection instruction input by the user and other instructions input by the user, such as volume increase and decrease instructions, screen color effect instructions, etc., where , the WiFi connection instruction can be an instruction for the user to switch WiFi. After the display device is turned on, the display device can be set according to the user's operation information. For example, according to the WiFi switching instruction to connect to the WiFi connected before the shutdown, the display device can be set according to the volume addition and subtraction instructions. The volume of the display device is the volume before shutdown. According to the screen color effect instruction, set the screen color effect of the display device to the screen color effect before shutdown. The screen color effect can include display effects such as bright, standard, and soft.

In some embodiments, when the display device is not powered on for the first time, if the display device has been connected to an external audio before shutting down, the external audio connected before the shutdown is automatically reconnected. For example, the display device can record the information of the external audio connected each time in a file under a preset path, and the file can be stored in the memory of the display device for easy query, so that it can be automatically reconnected according to the file after booting The last connected external speaker.

In some embodiments, taking the external speaker as a subwoofer and the first device as a router as an example, according to the characteristics of the above-mentioned display device connecting to a WiFi network, a method for controlling the frequency adjustment of a subwoofer includes steps S110-S130.

Step S110: After the external audio and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the external audio and the display device includes the first communication connection. a communication connection.

In some embodiments, the subwoofer and the display device may establish a first communication connection and a second communication connection, wherein the second communication connection may be a Bluetooth connection, and the first communication connection may be a 5G WiFi connection. The subwoofer can be paired with the display device through a Bluetooth connection. After the pairing is completed, the subwoofer channel data sent by the display device can be received through the 5G WiFi connection.

In some embodiments, since the WiFi connection between the display device and the router may also be a 5G WiFi connection, in order to avoid mutual interference between the subwoofer and the router, after the external audio and the display device are successfully connected, the display device can determine the display device and the router. Whether a 5G WiFi connection is established.

In some embodiments, the display device can obtain network connection information by detecting the currently connected WiFi network, and the network connection information includes information such as the frequency of the WiFi network accessed by the display device, the obtained IP address, the network connection speed, and the like. If the frequency of the WiFi network is between 4.9Ghz and 5.9GHz, it means that the connection between the display device and the router is 5G WiFi. If the frequency of the WiFi network is between 2.4Ghz and 2.5GHz, it means that the connection between the display device and the router is 2.4G WiFi. connect. More specifically, if the frequency of the WiFi network is between 5180MHz and 5320MHz, it indicates that the display device and the router are connected by 5.2G WiFi. If the frequency of the WiFi network is between 5745MHz and 5825MHz, it indicates that the connection between the display device and the router is For 5.8G WiFi connection.

In some embodiments, if the display device detects that the WiFi network is not currently connected, it may jump to step S130.

Step S120: If the display device has established a first communication connection with the first device, control the external audio and the first device to work in different frequency bands.

In some embodiments, if the display device detects that a 5G WiFi connection is established with the router, in order to avoid mutual interference between the subwoofer and the router, the external speaker and the router can be controlled to work in different frequency bands.

In some embodiments, the method for the display device to control the external audio and the router to work in different frequency bands includes steps S1201-S1203.

Step S1201: Determine whether the frequency of the first communication connection between the display device and the first device is greater than or equal to a preset frequency, where the preset frequency is greater than or equal to the lowest frequency of the first frequency band.

In some embodiments, the preset frequency may be 5745Hz. If the frequency of the WiFi signal of the router acquired by the display device is greater than or equal to 5745Hz, it indicates that the frequency band used for communication between the display device and the router is the 5.8G WiFi frequency band. If the frequency is less than 5745Hz, it indicates that the frequency band for communication between the display device and the router is 5.2GHz.

Step S1202: If the frequency of the first communication connection between the display device and the first device is greater than or equal to the first frequency, control the communication frequency band between the external speaker and the display device to be the second frequency band.

In some embodiments, the first frequency band may be a 5.8G WiFi frequency band, and the second frequency band may be a 5.2G WiFi frequency band.

In some embodiments, if the frequency of the WiFi signal of the router acquired by the display device is greater than or equal to 5745Hz, it indicates that the frequency band of the communication between the display device and the router is the 5.8G WiFi frequency band. 5.2G WiFi frequency band for communication.

In some embodiments, the display device may send a frequency adjustment instruction to the bass channel data sending module, where the frequency adjustment instruction may be an i2c command, and the frequency adjustment instruction may be configured to change the transmission of the bass channel data sending module. The frequency of the WiFi signal, after the bass channel data sending module receives the frequency adjustment command through the I2C bus, in response to the frequency adjustment command, the WiFi signal sending module adjusts the frequency band of the transmitted signal to the 5.2G frequency band.

Step S1203: If the frequency of the first communication connection between the display device and the first device is lower than the first frequency, control the communication frequency band between the external speaker and the display device to be the first frequency band.

In some embodiments, if the frequency of the WiFi signal of the router obtained by the display device is less than 5745Hz, it indicates that the frequency band of the communication between the display device and the router is the 5.2G WiFi frequency band. WiFi band for communication.

In some embodiments, the display device may send a frequency adjustment instruction to the bass channel data sending module, where the frequency adjustment instruction may be an i2c command, and the frequency adjustment instruction may be configured to change the transmission of the bass channel data sending module. The frequency of the WiFi signal, so that after the bass channel data transmission module receives the frequency adjustment command through the I2C bus, in response to the frequency adjustment command, the WiFi signal transmission module adjusts the frequency band of the transmitted signal to the 5.8G frequency band.

Step S130: If the display device does not establish a first communication connection with the first device, control the external audio to communicate with the display device according to the default frequency band.

In some embodiments, if the display device establishes a communication connection with the router, but the communication connection is not a 5G WiFi connection, eg, the communication connection is a 2.4G WiFi connection, the communication between the display device and the router will not affect the display device The communication with the external speaker causes interference. At this time, the WiFi signal transmitter module can be controlled to transmit the 5G WiFi signal of the default frequency band, so that the external speaker can communicate with the display device according to the default frequency band.

In some embodiments, the 5G WiFi signal of the default frequency band transmitted by the WiFi signal transmitting module may be a 5.2G WiFi signal.

In some embodiments, if the display device does not have a router to establish a communication connection, the router will not interfere with the communication between the display device and the external speaker. At this time, the WiFi signal transmitter module can be controlled to transmit 5G WiFi signals in the default frequency band. Causes the external speakers to communicate with the display device in the default frequency band.

In some embodiments, after the display device is connected to the external speaker, the user may connect the display device that is not connected to the router to a router, or switch the router to which the display device is connected, or change the router settings to reconnect the display device to the router. When the WiFi network environment may change, the controller of the display device can control the working frequency band of the external speaker according to the following method to avoid interference between the external speaker and the router. The method may include steps S210-S250.

Step S210: Receive an instruction input by the user to connect the first device and the display device.

In some embodiments, after the display device has not established a connection with the router, the user can open a setting interface on the display device, and select a WiFi network established by the router to access in the setting interface, and the instruction for accessing the WiFi network can be the connection Describe the instructions of the first device and the display device.

In some embodiments, after the display device has established a connection with the router, the user may open a setting interface on the display device, disconnect the WiFi network established by the currently connected router in the setting interface, and then re-select a WiFi network for access, The instruction to access the WiFi network may be an instruction to connect the first device and the display device.

In some embodiments, after the display device has established a connection with the router, the user can open a setting interface on the display device, and directly re-select a WiFi network for access on the setting interface, and the instruction for accessing the WiFi network may be to connect the Instructions for the first device and the display device.

Step S220: In response to the instruction for connecting the first device and the display device, establish a communication connection between the first device and the display device.

In some embodiments, after the display device determines that the user inputs an instruction to connect the first device and the display device, the first device and the display device can be connected to communicate with each other.

Step S230: Determine whether the communication connection established between the display device and the first device is the first communication connection.

Step S240: If the communication connection established between the display device and the first device is the first communication connection, control the external audio and the first device to operate in different frequency bands.

In some embodiments, the method for the display device to control the external audio and the first device to operate in different frequency bands can be referred to above, and details are not repeated here.

Step S250: If the communication connection established between the display device and the first device is not the first communication connection, control the frequency of the external audio to maintain the frequency band before the connection between the first device and the display device.

In some embodiments, if the communication connection established between the display device and the first device is not the first communication connection, the display device can control the frequency band of the bass channel data sending module to transmit the WiFi signal to remain unchanged, so that the external audio The frequency remains in the frequency band before the first device is connected to the display device.

In some embodiments, a method for controlling the frequency adjustment of an external sound includes steps S310-S350.

Step S310: After the connection between the external audio and the display device is successful, determine whether there is a connection record between the external audio and the display device.

In some embodiments, after the Bluetooth connection between the subwoofer and the display device is successful, the display device can query the files under the preset path to obtain the connection record between the subwoofer and the display device. , the display device has not been connected to the subwoofer, the file does not exist, or the content of the file is empty, so that the display device can determine whether there is a connection record between the subwoofer and the display device.

Step S320: If there is a connection record between the external audio and the display device, control the external audio to communicate with the display device according to the frequency band in the connection record.

In some embodiments, if the display device finds the connection record between the subwoofer and the display device, the frequency band when the subwoofer and the display device were last connected can be obtained from the connection record, and an I2C command can be sent to the subwoofer channel data sending module , so that the bass channel data sending module adjusts the frequency band of the WiFi signal to the frequency band when it was connected to the subwoofer last time, so that the subwoofer works at the frequency when it communicated with the display device last time.

Step S330: If there is no connection record between the external audio and the display device, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the external audio and the display device includes all the first communication connection.

In some embodiments, if the display device cannot query the connection record between the subwoofer and the display device, it can be determined whether the current display device has established a 5G WiFi connection with the router.

Step S340: If the display device has established a first communication connection with the first device, control the external audio and the first device to work in different frequency bands.

In some embodiments, if the display device establishes the first communication connection with the router, the method for the display device to control the subwoofer and the first device to work in different frequency bands can refer to the above text, and details are not repeated here.

Step S350: If the display device has not established a first communication connection with the first device, control the external audio to communicate with the display device according to the default frequency band.

In some embodiments, if the display device establishes a communication connection with the router, but the communication connection is not a 5G WiFi connection, eg, the communication connection is a 2.4G WiFi connection, the communication between the display device and the router will not affect the display device The communication with the external speaker causes interference. At this time, the WiFi signal transmitter module can be controlled to transmit the 5G WiFi signal of the default frequency band, so that the external speaker can communicate with the display device according to the default frequency band.

In some embodiments, the 5G WiFi signal of the default frequency band transmitted by the WiFi signal transmitting module may be a 5.2G WiFi signal.

In some embodiments, if the display device does not have a router to establish a communication connection, the router will not interfere with the communication between the display device and the external audio. Causes the external speakers to communicate with the display device in the default frequency band.

In some embodiments, a method for controlling an external audio frequency adjustment includes steps S410-S430.

Step S410: After the first device and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection.

In some embodiments, after the display device is powered on, the display device can automatically establish a connection with the last connected router, or when the user manually switches or reconnects the router, the display device can establish a connection with the router specified by the user. The display device can determine whether the received WiFi signal from the router is a 5G WiFi signal after establishing a connection with the router. If the WiFi signal from the router is a 5G WiFi signal, it indicates that a 5G WiFi connection has been established with the router.

Step S420: If the display device and the first device have established a first communication connection, control the external audio and the first device to work in different frequency bands, wherein one of the connection methods between the external audio and the display device includes all the first communication connection.

In some embodiments, if a 5G WiFi connection is established between the display device and the router, the method for controlling the subwoofer and the first device to work in different frequency bands can refer to the above content, and details are not repeated here.

Step S430: If the display device does not establish a first communication connection with the first device, control the external audio to communicate with the display device according to the default frequency band.

In some embodiments, if the display device establishes a communication connection with the router, but the communication connection is not a 5G WiFi connection, eg, the communication connection is a 2.4G WiFi connection, the communication between the display device and the router will not affect the display device The communication with the external speaker causes interference. At this time, the WiFi signal transmitter module can be controlled to transmit the 5G WiFi signal of the default frequency band, so that the external speaker can communicate with the display device according to the default frequency band.

In some embodiments, the 5G WiFi signal of the default frequency band transmitted by the WiFi signal transmitting module may be a 5.2G WiFi signal.

In some embodiments, if the display device does not have a router to establish a communication connection, the router will not interfere with the communication between the display device and the external audio. Causes the external speakers to communicate with the display device in the default frequency band.

It can be seen from the above-mentioned embodiments that in the embodiment of the present application, after the display device is successfully connected to the external audio or the first device, it is determined whether the display device and the first device are in the first communication connection, and if so, the external audio and the first device are controlled. Work in a different frequency band, if not, control the external audio to communicate with the display device according to the default frequency band or keep it in the current frequency band to communicate with the display device, so that when the external audio and the first device are both connected to the display device When the external audio and the first device have different working frequency bands, they will not interfere with each other, which solves the problem of popping sound caused by the interference of the external audio, and improves the sound effect of the display device.

<External audio equipment plays audio data>

In some embodiments, two audio devices are connected to a display device as an example to introduce how to solve the problem of asynchronous audio data played by different external audio devices. FIG. 16 is an audio data pool configuration interaction according to one or more embodiments of the present application. schematic diagram. The second controller of the external audio device receives the first instruction including the first parameter sent by the display device, and configures its audio data pool according to the first parameter, and the audio data pool can store the audio data sent by the display device.

In some embodiments, the external audio equipment includes a first external audio equipment and a second external audio equipment, for example, the audio left and the audio right in FIG. 16 can be implemented. After the external audio device and the display device establish a local area network communication, the first controller of the display device sends the first command including the first parameter to the audio left through TCP/UDP; The audio data pool configuration information contained in the first parameter is obtained by parsing the first parameter of the The high threshold H; the second threshold can be implemented as the low threshold L in the figure; the second controller of the audio left configures its audio data pool according to the audio data pool configuration information obtained by parsing, including configuring the total length of the audio data pool T, high Threshold H, low threshold L.

In some embodiments, the first controller of the display device may further establish a binding relationship with the external audio device according to the audio data pool configuration information included in the first parameter. For example, when an external audio device is paired with a display device for the first time, if the display device has saved the reference audio data pool configuration information of other external audio devices, it will call the reference audio data pool configuration information and send it to the first pairing device. If the display device does not save the reference audio data pool configuration information of any other external audio device, the preset default audio data pool configuration information will be sent; when the external audio device is repeatedly connected again, it will be sent The audio data pool configuration information for its most recent upload to the display device has been saved.

In some embodiments, the external audio device receives audio data from the display device and stores it in the audio data pool. When the data length in the audio data pool is greater than or equal to the low threshold L, that is, the second threshold, the second controller controls Audio left starts the audio output function, that is, plays the stored audio data.

In some embodiments, when the data length in the audio data pool is greater than the first threshold configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length, and plays the audio data after the frame loss; otherwise, A second instruction is sent to the display device. The second controller of the external audio equipment re-calculates the data length in the audio data pool after receiving and playing audio data each time, that is, the data length N in the current data pool, based on N and the low threshold L and high threshold. The relationship of H is logically optimized to reduce audio delay.

Specifically, when the length of the data in the audio data pool of the external audio device is less than or equal to the first threshold configured by the first parameter, the second controller sends a second instruction to the display device, which specifically includes that the length of the data in the audio data pool is less than or equal to the first threshold configured by the first parameter. When it is equal to the first threshold and is greater than or equal to the second threshold configured by the first parameter, the second controller sends a second instruction including the second parameter to the display device, where the second parameter includes the first parameter that is reduced according to the preset gradient. A threshold, a second threshold.

The first controller of the display device receives a second instruction including a second parameter sent from the external audio device, and the second parameter is used by the first controller to update the first parameter for reducing the audio delay, and then the first control The device sends the first command including the updated first parameter to the paired external audio device. For example, the second controller detects that the data length N in its audio data pool is between the low threshold L and the high threshold H, indicating that the audio data transmission of the current communication network is relatively stable, and the amount of audio data to be consumed by the external audio equipment is large. , its audio playback delay is high, and the second controller reduces the low threshold L and the high threshold H; for example, it can be implemented to reduce the threshold with a preset gradient data length of 10ms each time the detection is performed to reduce the audio playback delay;

Then the second controller sends a second instruction including a second parameter to the display device, where the second parameter includes the audio data pool configuration information such as the reduced and updated high threshold H, low threshold L, etc.; A controller receives the second instruction sent from the external audio equipment, and updates the previously stored first parameter according to the second parameter contained therein;

The first controller of the display device stores the updated first parameter on the display device side, and sends it to other paired external audio devices through the first command, for example, through the network, broadcast, unicast, TCP link, etc. to update the latest parameters. The audio data pool configuration information of the external audio equipment is sent to all connected external audio equipment;

After the external audio device receives the first instruction, according to the updated high threshold H and low threshold L obtained by analyzing the updated first parameter, the parameters of the audio data pool are adjusted in real time to further correct the audio data playback delay. To a certain extent, it can realize the optimization and synchronous playback of audio data playback of all paired external audio devices.

In some embodiments, when the data length in the audio data pool is greater than the first threshold configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length, and plays the audio data after the frame drop. For example, when the second controller detects that the data length N in its audio data pool is greater than the high threshold H, it indicates that the amount of audio data to be consumed in the audio data pool has exceeded expectations, and the device has a serious delay in playing audio; the second controller will start Active frame dropping technology, that is, actively dropping audio frames to reduce audio delay.

In some embodiments, when PCM audio data is converted into sound output, the volume is mainly determined by the size of the audio data. When the display device transmits a frame of audio data to the audio device, the audio device determines each bit of the frame of audio data by determining Whether the data is lower than the preset threshold for frame dropping. Taking 16-bit deep PCM audio data as an example, the maximum value of the data is 256, and the preset threshold is set to 26. If the data of a certain frame is lower than 26, it can be considered that it is difficult for the user to perceive when the audio data of this frame is output. Audio delay can be reduced without affecting user experience.

In some embodiments, the second controller traverses the audio data in the audio data pool with the data length of 5ms as a reference unit, and after finding the audio data segment that meets the frame loss condition, actively discards it, so as to reduce the number of audio data in the audio data pool. amount of audio data.

In some embodiments, when the length of the data in the audio data pool of the external audio device is less than or equal to the first threshold configured by the first parameter, the second controller sends a second instruction to the display device, and further includes that the length of the data in the audio data pool is less than or equal to the first threshold configured by the first parameter. When there are two thresholds, the second controller sends a second instruction including a third parameter to the display device, and the third parameter is used to indicate that the network connection state is unqualified.

The first controller of the display device receives a second instruction including a third parameter sent from the audio device, and the third parameter is used to indicate that the network connection state is unqualified; the first controller controls the user interface to display the second prompt message, the The second prompt message jumps to the network setting interface after receiving the confirmation operation. For example, the second controller detects that the data length N in its audio data pool is smaller than the low threshold L, indicating that the current communication network transmission audio data volume is not enough to meet the data consumption and playback speed of the current external speaker device, the audio device will generate noise, and the second controller will generate noise. The controller feeds back a second instruction including a third parameter to the display device, where the third parameter indicates that the current network connection state is unqualified.

The first controller of the display device receives a second instruction including a third parameter sent from the audio device, where the third parameter is used to represent that the network connection state is unqualified. After the user receives the second prompt message and performs a confirmation operation on it, the first controller controls the user interface to jump to the network connection setting interface to correct the network state. In some embodiments, after the pairing of the display device and the external audio device fails, the first controller controls the user interface to display first prompt information, and the first prompt information jumps to the pairing setting interface after receiving the confirmation operation.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments have been chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the embodiments and various modified embodiments suitable for specific use considerations.

Claims (11)

1. A display device comprising:

   monitor;

   A controller that is configured to:

   After the external audio and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the external audio and the display device includes the first communication connection ;

   If a first communication connection is established between the display device and the first device, controlling the external audio and the first device to work in different frequency bands;

   If the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to a default frequency band.
2. The display device according to claim 1, wherein the controlling the external audio and the first device to work in different frequency bands, comprising:

   determining whether the frequency of the first communication connection between the display device and the first device is greater than or equal to a preset frequency, wherein the preset frequency is greater than or equal to the lowest frequency of the first frequency band;

   If the frequency of the first communication connection between the display device and the first device is greater than or equal to the first frequency, control the communication frequency band between the external speaker and the display device to be the second frequency band;

   If the frequency of the first communication connection between the display device and the first device is lower than the first frequency, the frequency band for controlling the communication between the external speaker and the display device is the first frequency band.
3. The display device according to claim 2, further comprising a bass channel data sending module, the bass channel data sending module is connected to the controller, and the bass channel data sending module is connected to the external Audio communication connection;

   The communication frequency band for controlling the external audio and the display device is the second frequency band, including:

   A frequency adjustment instruction is sent to the external audio, so that the bass channel data sending module adjusts the frequency band of the signal sent to the external audio to the second frequency band according to the frequency adjustment instruction.
4. The display device of claim 1, wherein the controller is further configured to:

   receiving an instruction to connect the first device and the display device input by the user;

   establishing a communication connection between the first device and the display device in response to the instruction for connecting the first device and the display device;

   determining whether the communication connection established between the display device and the first device is the first communication connection;

   If the communication connection established between the display device and the first device is the first communication connection, controlling the external audio and the first device to work in different frequency bands;

   If the communication connection established between the display device and the first device is not the first communication connection, the frequency of controlling the external audio is kept in the frequency band before the first device and the display device are connected.
5. The display device according to claim 1, wherein the connection method between the external audio and the display device further comprises a second communication connection, and after the external audio and the display device are successfully connected, it is determined that the display device is connected to the first communication connection. Whether a device has established a first communication connection includes: after the external audio is successfully connected to the display device through the second communication connection, judging whether the display device and the first device have established the first communication connection.
6. The display device according to claim 5, wherein the first communication connection comprises a 5G WiFi connection, and the second communication connection comprises a Bluetooth connection.
7. A display device comprising:

   monitor;

   A controller that is configured to:

   After the external audio and the display device are successfully connected, determine whether there is a connection record between the external audio and the display device;

   If there is a connection record between the external audio and the display device, control the external audio to communicate with the display device according to the frequency band in the connection record;

   If there is no connection record between the external audio and the display device, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the external audio and the display device includes the first communication connection. communication connection;

   If a first communication connection is established between the display device and the first device, controlling the external audio and the first device to work in different frequency bands;

   If the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to a default frequency band.
8. The display device of claim 7, the controller further configured to:

   receiving an instruction to connect the first device and the display device input by the user;

   establishing a communication connection between the first device and the display device in response to the instruction for connecting the first device and the display device;

   determining whether the communication connection established between the display device and the first device is the first communication connection;

   If the communication connection established between the display device and the first device is the first communication connection, controlling the external audio and the first device to work in different frequency bands;

   If the communication connection established between the display device and the first device is not the first communication connection, the frequency of controlling the external audio is kept in the frequency band before the first device and the display device are connected.
9. A display device comprising:

   monitor;

   A controller that is configured to:

   After the first device and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection;

   If a first communication connection is established between the display device and the first device, the external audio and the first device are controlled to work in different frequency bands, wherein one of the connection methods between the external audio and the display device includes the first communication connection;

   If the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to a default frequency band.
10. A communication method between a display device and an external sound, comprising:

    After the external audio and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the external audio and the display device includes the first communication connection ;

    If a first communication connection is established between the display device and the first device, controlling the external audio and the first device to work in different frequency bands;

    If the display device does not establish a first communication connection with the first device, the external audio is controlled to communicate with the display device according to a default frequency band.
11. A method for audio output from an external audio device, the method comprising:

    Receive a first instruction that includes a first parameter sent by the display device, where the first parameter is used to configure an audio data pool, and the audio data pool stores the received audio data;

    When the data length in the audio data pool is greater than the first threshold configured by the first parameter, control the audio data to actively drop frames to shorten the data length, and play the audio data after the frame loss; otherwise, send a second instruction to the display equipment.

Images