WO2022001424A1 - Display device - Google Patents

Abstract

Provided in the embodiments of the present application is a display device. The display device comprises a display and a controller, and the controller is configured to: determine whether the display device has established a first communication connection with the first device once a wireless loudspeaker is successfully connected to the display device, wherein one of connection modes between the wireless loudspeaker and the display device comprises the first communication connection; if the display device has established the first communication connection with the first device, then the wireless loudspeaker and the first device are controlled to operate in different frequency bands; and if the display device does not establish the first communication connection with the first device, then the wireless loudspeaker ins controlled to communicate with the display device according to a default frequency band.

Description

a display device

This application claims the priority of the Chinese patent application with the application number 202010630873.6 and the title of "A Display Device and Audio Playing Method", which was submitted to the China Patent Office on July 3, 2020; the application claims the priority on December 10, 2020 The priority of the Chinese patent application filed with the Chinese Patent Office with application number 202011455154.1 and titled "Display Device and Communication Method between Display Device and Wireless Speaker", the entire contents of which are incorporated herein by reference.

technical field

The present application relates to the field of display technology, and in particular, to a display device.

Background technique

TV is an important display device in people's home life and has a large market demand. The audio and video effect of TV is an important reference index for people to buy TV. Traditional TV is equipped with left speaker and right speaker. The left speaker is used to realize the sound of the left channel, and the right speaker is used to realize the sound of the right channel. In order to improve the audio and video effects of TVs, some TVs can be connected to wireless speakers, send the audio data of the bass channel to the wireless speakers, and realize the sound of the bass channel through the wireless speakers, thereby expanding the sound range of the TV.

SUMMARY OF THE INVENTION

The application provides a display device, the display device includes:

monitor;

A controller that is configured to:

After the wireless speaker and the display device are successfully connected, it is determined whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the wireless speaker and the display device includes the first communication connection ;

If the display device establishes a first communication connection with the first device, controlling the wireless speaker and the first device to work in different frequency bands;

If the display device does not establish a first communication connection with the first device, the wireless speaker is controlled to communicate with the display device according to a default frequency band.

Description of drawings

In order to illustrate the technical solutions of the present application more clearly, the accompanying drawings that need to be used in the embodiments will be briefly introduced below. Other drawings can also be obtained from these drawings.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control apparatus according to some embodiments;

FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 3 exemplarily shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

FIG. 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments;

FIG. 5 exemplarily shows a schematic diagram of the connection between a display device and a wireless speaker according to some embodiments;

FIG. 6 exemplarily shows a schematic flowchart of a communication method between a display device and a wireless speaker according to some embodiments;

FIG. 7 exemplarily shows a schematic flowchart of a method for a display device to control a wireless speaker and a router to work in different frequency bands according to some embodiments;

FIG. 8 exemplarily shows a schematic flowchart of a communication method between a display device and a wireless speaker according to some embodiments;

FIG. 9 exemplarily shows a schematic flowchart of a communication method between a display device and a wireless speaker according to some embodiments;

FIG. 10 exemplarily shows a schematic flowchart of a communication method between a display device and a wireless speaker according to some embodiments;

11 is a layout diagram of a display device and a sound playback device in an embodiment of the application;

12 is a schematic flowchart of an audio playback method in an embodiment of the present application;

13 is a schematic flowchart of a configuration playback channel based on a WiFi network in an embodiment of the present application;

14 is a schematic flowchart of a configuration playback channel based on a Bluetooth connection in an embodiment of the application;

15 is a schematic flowchart of audio synchronization processing in an embodiment of the application;

FIG. 16 is a schematic flowchart of sending surround sound data according to orientation information in an embodiment of the present application.

detailed description

In order to make the purpose and implementation of the present application clearer, the exemplary embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only the Some embodiments are claimed, but not all embodiments.

It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described below, rather than intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.

The terms "first", "second", "third", etc. in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit specific Sequential or sequential, unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprising" and "having", and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that incorporates a series of components is not necessarily limited to all components explicitly listed, but may include no explicit other components listed or inherent to these products or devices.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.

FIG. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .

In some embodiments, the control device 100 may be a remote control, and the communication between the remote control and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display is controlled wirelessly or wiredly. device 200. The user can control the display device 200 by inputting user instructions through at least one of keys on the remote control, voice input, and control panel input.

In some embodiments, the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a laptop computer, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used to communicate data.

In some embodiments, the display device 200 can also be controlled in a manner other than the control apparatus 100 and the smart device 300. For example, the module for acquiring voice commands configured inside the display device 200 can directly receive the user's voice command for control. , the user's voice command control can also be received through the voice control device provided outside the display device 200 .

In some embodiments, the display device 200 is also in data communication with the server 400 . The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

In some embodiments, the software steps executed by one step execution body can be migrated to another step execution body that is in data communication with it for execution as required. Exemplarily, the software steps executed by the server may be migrated to be executed on the display device with which it is in data communication as required, and vice versa.

FIG. 3 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 3 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 260 , and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .

In some embodiments, the communication interface 130 is used for external communication, including at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a button, or an alternative module.

FIG. 2 is a block diagram showing a hardware configuration of a display device 200 according to an exemplary embodiment.

In some embodiments, display device 200 includes tuner 210, communicator 220, detector 230, external device interface 240, controller 250, display 275, audio output interface 285, memory 260, power supply, user interface at least one of.

In some embodiments the controller includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output.

In some embodiments, the display 275 includes a display screen component for presenting a picture, and a driving component for driving the image display, for receiving the image signal output from the controller, for displaying the video content, the image content and the menu manipulation interface Components and user-manipulated UI interfaces, etc.

In some embodiments, the display 275 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or cable broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 400 through the communicator 220 .

In some embodiments, the detector 230 is used to collect signals from the external environment or interaction with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB), Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.

In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.

In some embodiments, the controller 250, through various software control programs stored on the memory 260, controls the operation of the display device and responds to user operations. The controller 250 controls the overall operation of the display apparatus 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any of the selectable objects, such as hyperlinks, icons, or other operable controls. The operations related to the selected object include: displaying operations connected to hyperlinked pages, documents, images, etc., or executing operations of programs corresponding to the icons.

In some embodiments, the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory, RAM), ROM (Read- Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.

CPU processor. It is used to execute the operating system and application program instructions stored in the memory, and to execute various application programs, data and contents according to various interactive instructions received from external input, so as to finally display and play various audio and video contents. CPU processor, which can include multiple processors. For example, it includes a main processor and one or more sub-processors.

In some embodiments, the graphics processor is used to generate various graphic objects, such as at least one of icons, operation menus, and user input instructions to display graphics. The graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes; it also includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for rendering. displayed on the display.

In some embodiments, the video processor is used to decompress, decode, scale, reduce noise, convert frame rate, convert resolution, and synthesize images according to the standard codec protocol of the received external video signal. At least one of the processes can obtain a signal that is directly displayed or played on the displayable device 200 .

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. The image synthesizing module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator according to the user's input or itself, and the zoomed video image, so as to generate an image signal that can be displayed. The frame rate conversion module is used to convert the input video frame rate. The display formatting module is used to convert the received frame rate into the video output signal, and change the signal to conform to the display format signal, such as outputting the RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, perform decompression and decoding according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing. , to get a sound signal that can be played in the loudspeaker.

In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. The commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. at least one of the visual interface elements.

In some embodiments, the user interface 280 is an interface that can be used to receive control input (eg, physical buttons on the display device body, or others).

In some embodiments, the system of the display device may include a kernel (Kernel), a command parser (shell), a file system and an application program. Together, the kernel, shell, and file system make up the basic operating system structures that allow users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. An application is compiled into machine code after startup, forming a process.

Referring to FIG. 4 , in some embodiments, the system is divided into four layers, from top to bottom, they are an application layer (referred to as “application layer”), an application framework layer (referred to as “framework layer”) ”), the Android runtime and the system library layer (referred to as the “system runtime layer”), and the kernel layer.

In some embodiments, at least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, or a clock program that comes with the operating system; they may also be developed by third-party developers. s application. During specific implementation, the application package in the application layer is not limited to the above examples.

The framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action. The application program can access the resources in the system and obtain the services of the system during execution through the API interface.

As shown in FIG. 4 , the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: an activity manager (Activity Manager) uses Interacts with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers on the user interface and desktop widgets.

In some embodiments, the activity manager is used to manage the life cycle of the various applications and general navigation rollback functions, such as controlling the exit, opening, rollback, etc. of the application. The window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (such as reducing the display window, shaking display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensors, etc.), and power drives, etc.

The hardware or software architecture in some embodiments may be based on the introduction in the foregoing embodiments, and may be based on other similar hardware or software architectures in some embodiments, and the technical solutions of the present application may be implemented.

first:

In some embodiments, the display device can be connected to a wireless speaker to improve the audio playback effect. In order to ensure the speed of audio data transmission to the wireless speaker, the display device can transmit audio data to the wireless speaker through 5G WiFi. When it is also connected to 5G WiFi, the wireless speaker and the router will interfere with each other, affecting the audio playback effect.

In order to solve the above technical problem, the embodiment of the present application ensures the audio playback effect of the wireless speaker by setting the frequency band of the wireless speaker of the display device to be inconsistent with the frequency band of the router.

In some embodiments, in order to achieve a better user experience, the left and right channel sounds are sent by the display device, and the other channel of data is used as the bass to be sent out by the wireless speakers connected to the display device. A wireless speaker specifically emits bass data, and such a wireless speaker can be a subwoofer.

Referring to FIG. 5 , it is a schematic diagram of a connection between a display device and a wireless speaker according to some embodiments. As shown in Figure 5, the wireless speaker can be a subwoofer, and the display device can be provided with a controller, a WiFi module, a left speaker, a right speaker, and a bass channel data transmission module. An I2S bus can be connected between the channel data sending modules, and an I2C bus can also be connected between the controller and the bass channel data sending module.

In some embodiments, the audio data of the media asset played on the display device may include left channel data, right channel data, and bass channel data. After the controller parses the audio data of the media asset into left channel data, right channel data and bass channel data, it can send the left channel data to the left speaker through the I2S bus, and send the right channel data to the I2S bus. The right speaker sends the bass channel data to the bass channel data sending module through the I2S bus. The left speaker can sound after receiving the data of the left channel, the right speaker can sound after receiving the data of the right channel, and the bass channel data sending module can send the bass channel data to the subwoofer after receiving the data of the bass channel The subwoofer is provided with a bass channel data receiving module, which can receive the bass channel data sent by the bass channel data sending module, and the subwoofer emits sound according to the received bass channel data.

In some embodiments, the controller can send a control command, such as a frequency adjustment command, to the bass channel data sending module through the I2C bus, and the bass channel data sending module adjusts the frequency of the signal sent according to the frequency adjustment command to avoid mutual communication with the WiFi module. interference.

In some embodiments, the bass channel data transmission module may include a WiFi signal transmission unit, the WiFi signal transmission unit may transmit a 5.2G WiFi signal or a 5.8G WiFi signal, and may adjust the frequency of the transmitted signal according to the frequency adjustment instruction of the controller .

In some embodiments, the bass channel data sending module may further include a Bluetooth connection unit, and the wireless speaker also includes a corresponding Bluetooth module. The command interaction between the display device and the wireless speaker is through Bluetooth communication, such as volume +, volume -, etc., and audio data is transmitted through wireless communication (such as 5G WiFi).

In some embodiments, in addition to the 5G WiFi connection with the subwoofer, the display device can also perform 5G WiFi connection with other devices through the WiFi module. In addition to the subwoofer, the device capable of 5G WiFi connection with the display device may be referred to as the first a device. Some routers may support the functionality of a 5G WiFi connection, and the first device may include a router.

In some embodiments, the router can send 2.4G WiFi signals and 5G WiFi signals at the same time to form a 2.4G WiFi network and a 5G WiFi network. Devices that can receive the 2.4G WiFi signal can choose to join the 2.4G WiFi network and can receive The device that receives the 5G WiFi signal can choose to access the 5G WiFi network, and the device that can receive the 2.4G WiFi signal and the 5G WiFi signal at the same time can choose to access one of the WiFi networks. For example, the display device can receive the 2.4G WiFi signal and the 5G WiFi signal at the same time, and can select a WiFi network for access according to network performance such as network signal strength and network delay.

In some embodiments, the 5G WiFi signal sent by the router may be 5.2G WiFi or 5.8G WiFi, which may be determined by the user's pre-configuration of the router.

In some embodiments, when the display device is powered on for the first time, a boot-up guide may be displayed, and the boot-up guide may include multiple interfaces, one of which may be a WiFi connection interface, and the other interface may be a subwoofer pairing interface. On the WiFi connection interface, the user can select a WiFi searched by the display device to connect, or the user can skip this interface and temporarily do not connect to the WiFi. The user can confirm the pairing of the subwoofer on the subwoofer pairing interface, and connect the subwoofer channel data sending module and the subwoofer channel data receiving module. The user can also skip this interface and temporarily do not perform subwoofer pairing.

In some embodiments, if the user does not perform subwoofer pairing on the boot-up guide interface, the subwoofer pairing can also be performed on the setting interface of the display device, wherein the user can call up the settings on the display device by pressing the menu key on the remote control. interface.

In some embodiments, if the user does not perform WiFi connection on the boot-up guide interface, the user can also perform WiFi connection on the setting interface of the display device, wherein the user can call up the setting interface on the display device by pressing the menu key on the remote control.

In some embodiments, after the display device has been connected to a WiFi network, the user may also call up a setting interface on the display device, and re-select a WiFi network for access. For example, when the display device can search for the WiFi signals of two routers, if the network quality of the currently connected WiFi network is not good, the user can switch WiFi on the setting interface to enable the display device to access the WiFi network of another router. to improve network quality.

In some embodiments, when the display device is not powered on for the first time, if the display device was connected to WiFi before it was powered off, the WiFi connected before the shutdown is automatically reconnected. For example, the display device can record the information of each connected WiFi in a file under a preset path, and the file can be stored in the memory of the display device for easy query, so that it can be automatically reconnected according to the file after booting. One time connected WiFi. For example, the display device may also record the user operation information in a file under a preset path. The user operation information includes the WiFi connection instruction input by the user and other instructions input by the user, such as volume increase and decrease instructions, screen color effect instructions, etc., where , the WiFi connection instruction can be an instruction for the user to switch WiFi. After the display device is turned on, the display device can be set according to the user's operation information. For example, according to the WiFi switching instruction to connect to the WiFi connected before the shutdown, the display device can be set according to the volume addition and subtraction instructions. The volume of the display device is the volume before shutdown. According to the screen color effect instruction, set the screen color effect of the display device to the screen color effect before shutdown. The screen color effect can include display effects such as bright, standard, and soft.

In some embodiments, when the display device is not powered on for the first time, if the display device has been connected to a wireless speaker before it is powered off, the wireless speaker connected before the shutdown is automatically reconnected. For example, the display device can record the information of each connected wireless speaker in a file under a preset path, and the file can be stored in the memory of the display device for easy query, so that it can be automatically reconnected according to the file after booting The last connected wireless speaker.

In some embodiments, taking the wireless speaker as a subwoofer and the first device as a router as an example, according to the above-mentioned characteristics of the display device accessing the WiFi network, a method for controlling the frequency of the subwoofer can be seen in FIG. 6 , including steps S110- S130.

Step S110: After the wireless speaker and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the wireless speaker and the display device includes the first communication connection. a communication connection.

In some embodiments, the subwoofer and the display device may establish a first communication connection and a second communication connection, wherein the second communication connection may be a Bluetooth connection, and the first communication connection may be a 5G WiFi connection. The subwoofer can be paired with the display device through a Bluetooth connection. After the pairing is completed, the subwoofer channel data sent by the display device can be received through the 5G WiFi connection.

In some embodiments, since the WiFi connection between the display device and the router may also be a 5G WiFi connection, in order to avoid mutual interference between the subwoofer and the router, after the wireless speaker and the display device are successfully connected, the display device can determine the display device and the router. Whether a 5G WiFi connection is established.

In some embodiments, the display device can obtain network connection information by detecting the currently connected WiFi network, and the network connection information includes information such as the frequency of the WiFi network accessed by the display device, the obtained IP address, the network connection speed, and the like. If the frequency of the WiFi network is between 4.9Ghz and 5.9GHz, it means that the connection between the display device and the router is 5G WiFi. If the frequency of the WiFi network is between 2.4Ghz and 2.5GHz, it means that the connection between the display device and the router is 2.4G WiFi. connect. , More specifically, if the frequency of the WiFi network is between 5180MHz and 5320MHz, it indicates that the display device and the router are connected by 5.2G WiFi. If the frequency of the WiFi network is between 5745MHz and 5825MHz, it indicates that the display device and the router are connected between 5.8G WiFi connection between.

In some embodiments, if the display device detects that the WiFi network is not currently connected, it may jump to step S130.

Step S120: If the display device has established a first communication connection with the first device, control the wireless speaker and the first device to work in different frequency bands.

In some embodiments, if the display device detects that a 5G WiFi connection is established with the router, in order to avoid mutual interference between the subwoofer and the router, the wireless speaker and the router can be controlled to work in different frequency bands.

In some embodiments, the method for the display device to control the wireless speaker and the router to work in different frequency bands can be seen in FIG. 7, including steps S1201-S1203.

Step S1201: Determine whether the frequency of the first communication connection between the display device and the first device is greater than or equal to a preset frequency, where the preset frequency is greater than or equal to the lowest frequency of the first frequency band.

In some embodiments, the preset frequency may be 5745Hz. If the frequency of the WiFi signal of the router acquired by the display device is greater than or equal to 5745Hz, it indicates that the frequency band used for communication between the display device and the router is the 5.8G WiFi frequency band. If the frequency is less than 5745Hz, it indicates that the frequency band for communication between the display device and the router is 5.2GHz.

Step S1202: If the frequency of the first communication connection between the display device and the first device is greater than or equal to the first frequency, control the communication frequency band between the wireless speaker and the display device to be the second frequency band.

In some embodiments, the first frequency band may be a 5.8G WiFi frequency band, and the second frequency band may be a 5.2G WiFi frequency band.

In some embodiments, if the frequency of the WiFi signal of the router acquired by the display device is greater than or equal to 5745Hz, it indicates that the frequency band of the communication between the display device and the router is the 5.8G WiFi frequency band. 5.2G WiFi frequency band for communication.

In some embodiments, the display device may send a frequency adjustment instruction to the bass channel data sending module, where the frequency adjustment instruction may be an i2c command, and the frequency adjustment instruction may be configured to change the transmission of the bass channel data sending module. The frequency of the WiFi signal, after the bass channel data sending module receives the frequency adjustment command through the I2C bus, in response to the frequency adjustment command, the WiFi signal sending module adjusts the frequency band of the transmitted signal to the 5.2G frequency band.

Step S1203: If the frequency of the first communication connection between the display device and the first device is lower than the first frequency, control the communication frequency band between the wireless speaker and the display device to be the first frequency band.

In some embodiments, if the frequency of the WiFi signal of the router obtained by the display device is less than 5745Hz, it indicates that the frequency band of the communication between the display device and the router is the 5.2G WiFi frequency band. At this time, the wireless speaker and the display device can be controlled at 5.8G WiFi band for communication.

In some embodiments, the display device may send a frequency adjustment instruction to the bass channel data sending module, where the frequency adjustment instruction may be an i2c command, and the frequency adjustment instruction may be configured to change the transmission of the bass channel data sending module. The frequency of the WiFi signal, so that after the bass channel data transmission module receives the frequency adjustment command through the I2C bus, in response to the frequency adjustment command, the WiFi signal transmission module adjusts the frequency band of the transmitted signal to the 5.8G frequency band.

Step S130: If the display device does not establish a first communication connection with the first device, control the wireless speaker to communicate with the display device according to a default frequency band.

In some embodiments, if the display device establishes a communication connection with the router, but the communication connection is not a 5G WiFi connection, eg, the communication connection is a 2.4G WiFi connection, the communication between the display device and the router will not affect the display device The communication with the wireless speaker causes interference. At this time, the WiFi signal transmitter module can be controlled to transmit the 5G WiFi signal of the default frequency band, so that the wireless speaker can communicate with the display device according to the default frequency band.

In some embodiments, the 5G WiFi signal of the default frequency band transmitted by the WiFi signal transmitting module may be a 5.2G WiFi signal.

In some embodiments, if the display device does not have a router to establish a communication connection, the router will not interfere with the communication between the display device and the wireless speaker. At this time, the WiFi signal transmitting module can be controlled to transmit 5G WiFi signals in the default frequency band. Causes the wireless speaker to communicate with the display device on the default frequency band.

In some embodiments, after the display device is connected to the wireless speaker, the user may connect the display device that is not connected to the router to a router, or switch the router to which the display device is connected, or change the router settings to reconnect the display device to the router. When the WiFi network environment may change, the controller of the display device can control the working frequency band of the wireless speaker according to the method shown in Figure 8 to avoid interference between the wireless speaker and the router.

Referring to FIG. 8 , it is a schematic flowchart of a method for controlling a wireless speaker to adjust frequency according to some embodiments. As shown in FIG. 8 , the method may include steps S210 - S250 .

Step S210: Receive an instruction input by the user to connect the first device and the display device.

In some embodiments, after the display device has not established a connection with the router, the user can open a setting interface on the display device, and select a WiFi network established by the router to access in the setting interface, and the instruction for accessing the WiFi network can be the connection Describe the instructions of the first device and the display device.

In some embodiments, after the display device has established a connection with the router, the user can open a setting interface on the display device, disconnect the WiFi network established by the currently connected router in the setting interface, and then re-select a WiFi network for access, The instruction to access the WiFi network may be an instruction to connect the first device and the display device.

In some embodiments, after the display device has established a connection with the router, the user can open a setting interface on the display device, and directly re-select a WiFi network for access on the setting interface, and the instruction for accessing the WiFi network may be to connect the Instructions for the first device and the display device.

Step S220: In response to the instruction for connecting the first device and the display device, establish a communication connection between the first device and the display device.

In some embodiments, after the display device determines that the user inputs an instruction to connect the first device and the display device, the first device and the display device may be connected to communicate with each other.

Step S230: Determine whether the communication connection established between the display device and the first device is the first communication connection.

Step S240: If the communication connection established between the display device and the first device is the first communication connection, control the wireless speaker and the first device to operate in different frequency bands.

In some embodiments, the method for the display device to control the wireless speaker and the first device to work in different frequency bands can be seen in FIG. 8 , and details are not repeated here.

Step S250: If the communication connection established between the display device and the first device is not the first communication connection, control the frequency of the wireless speaker to maintain the frequency band before the connection between the first device and the display device.

In some embodiments, if the communication connection established between the display device and the first device is not the first communication connection, the display device can control the frequency band of the bass channel data sending module to transmit the WiFi signal to remain unchanged, so that the wireless speaker The frequency remains in the frequency band before the first device is connected to the display device.

In some embodiments, a method for controlling a wireless speaker to adjust the frequency can be seen in FIG. 9 , including steps S310-S350.

Step S310: After the wireless speaker is successfully connected with the display device, determine whether there is a connection record between the wireless speaker and the display device.

In some embodiments, after the Bluetooth connection between the subwoofer and the display device is successful, the display device can query the files under the preset path to obtain the connection record between the subwoofer and the display device. , the display device has not been connected to the subwoofer, the file does not exist, or the content of the file is empty, so that the display device can determine whether there is a connection record between the subwoofer and the display device.

Step S320: If there is a connection record between the wireless speaker and the display device, control the wireless speaker to communicate with the display device according to the frequency band in the connection record.

In some embodiments, if the display device finds the connection record between the subwoofer and the display device, the frequency band when the subwoofer and the display device were last connected can be obtained from the connection record, and an I2C command can be sent to the subwoofer channel data sending module , so that the bass channel data sending module adjusts the frequency band of the WiFi signal to the frequency band when it was connected to the subwoofer last time, so that the subwoofer works at the frequency when it communicated with the display device last time.

Step S330: If there is no connection record between the wireless speaker and the display device, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the wireless speaker and the display device includes all the first communication connection.

In some embodiments, if the display device cannot query the connection record between the subwoofer and the display device, it can be determined whether the current display device has established a 5G WiFi connection with the router.

Step S340: If the display device has established a first communication connection with the first device, control the wireless speaker and the first device to work in different frequency bands.

In some embodiments, if a first communication connection is established between the display device and the router, the method for the display device to control the subwoofer and the first device to work in different frequency bands can be referred to FIG. 8 , which will not be repeated here.

Step S350: If the display device does not establish a first communication connection with the first device, control the wireless speaker to communicate with the display device according to the default frequency band.

In some embodiments, if the display device establishes a communication connection with the router, but the communication connection is not a 5G WiFi connection, eg, the communication connection is a 2.4G WiFi connection, the communication between the display device and the router will not affect the display device The communication with the wireless speaker causes interference. At this time, the WiFi signal transmitter module can be controlled to transmit the 5G WiFi signal of the default frequency band, so that the wireless speaker can communicate with the display device according to the default frequency band.

In some embodiments, the 5G WiFi signal of the default frequency band transmitted by the WiFi signal transmitting module may be a 5.2G WiFi signal.

In some embodiments, if the display device does not have a router to establish a communication connection, the router will not interfere with the communication between the display device and the wireless speaker. At this time, the WiFi signal transmitting module can be controlled to transmit 5G WiFi signals in the default frequency band. Causes the wireless speaker to communicate with the display device on the default frequency band.

In some embodiments, a method for controlling a wireless speaker to adjust the frequency can be seen in FIG. 10, including steps S410-S430.

Step S410: After the first device and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection.

In some embodiments, after the display device is powered on, the display device can automatically establish a connection with the last connected router, or when the user manually switches the router or reconnects the router, the display device can establish a connection with the router specified by the user. The display device can determine whether the received WiFi signal from the router is a 5G WiFi signal after establishing a connection with the router. If the WiFi signal from the router is a 5G WiFi signal, it indicates that a 5G WiFi connection has been established with the router.

Step S420: If the display device and the first device have established a first communication connection, control the wireless speaker and the first device to work in different frequency bands, wherein one of the connection methods between the wireless speaker and the display device includes all the first communication connection.

In some embodiments, if a 5G WiFi connection is established between the display device and the router, the method for controlling the subwoofer and the first device to work in different frequency bands can be seen in FIG. 8 , which will not be repeated here.

Step S430: If the display device does not establish a first communication connection with the first device, control the wireless speaker to communicate with the display device according to the default frequency band.

In some embodiments, if the display device establishes a communication connection with the router, but the communication connection is not a 5G WiFi connection, eg, the communication connection is a 2.4G WiFi connection, the communication between the display device and the router will not affect the display device The communication with the wireless speaker causes interference. At this time, the WiFi signal transmitter module can be controlled to transmit the 5G WiFi signal of the default frequency band, so that the wireless speaker can communicate with the display device according to the default frequency band.

In some embodiments, the 5G WiFi signal of the default frequency band transmitted by the WiFi signal transmitting module may be a 5.2G WiFi signal.

In some embodiments, if the display device does not have a router to establish a communication connection, the router will not interfere with the communication between the display device and the wireless speaker. At this time, the WiFi signal transmitting module can be controlled to transmit 5G WiFi signals in the default frequency band. Causes the wireless speaker to communicate with the display device on the default frequency band.

It can be seen from the above embodiments that in the embodiment of the present application, after the display device is successfully connected to the wireless speaker or the first device, it is determined whether the display device and the first device are the first communication connection, and if so, the wireless speaker and the first device are controlled. Work in different frequency bands, if not, control the wireless speaker to communicate with the display device according to the default frequency band or maintain communication with the display device in the current frequency band, so that when the wireless speaker and the first device are connected to the display device When the wireless speaker and the first device have different working frequency bands, they will not interfere with each other, which solves the problem of popping sound caused by the interference of the wireless speaker, and improves the sound effect of the display device.

Second aspect:

Based on the above-mentioned display device 200 , the user can perform interactive operations through settings such as the control device 100 to play media resources, so as to display the playback screen on the display 275 and output sound through the audio output interface 285 . The media assets include video media assets and audio media assets. Typically, both video media assets and audio media assets contain audio data. For example, after the user chooses to play any video media asset, the controller 250 may call a decoder or run a decoding program to decode the media asset data, and obtain video data and audio data respectively. Then by calling the display 275 and the audio output interface 285 respectively, the video data and the audio data are played into pictures and sounds.

Similarly, after the user chooses to play any audio media asset, the controller 250 may only call the audio-related hardware and execute the audio-related program, so as to decode the audio media asset and obtain audio data. The audio data is then sent to the audio output interface 285 to be output as sound. While outputting sound, the display device 200 may turn off the display 275 or present a music playing picture on the display 275 according to rules set by different operating systems.

In order to output the audio data as a specific sound, a speaker 286 and an external audio output terminal 287 can be connected to the audio output interface 285 . Usually, the display device 200 has a built-in speaker 286, and the external audio output terminal 287 can be connected to an external audio device, so as to convert the electrical signal of the audio data into a specific sound signal.

The user can also connect an external sound playing device 500 according to the needs of playing. For example, wired speakers, WiFi speakers, Bluetooth speakers, and speakers based on other wireless transmission methods. Therefore, the external audio playback device 500 can be connected to the display device 200 through the WiFi module 221 and the Bluetooth module 222 in the communicator 220 , and can also be connected to the display device 200 through the external audio output terminal 287 on the audio output interface 285 , so as to output sound.

The audio playback method provided by the present application is applicable to the audio playback apparatus 500 connected in the above two connection manners. However, in order to obtain a better surround sound effect and reduce equipment costs, in some embodiments of the present application, the sound playback device 500 is connected to the display device 200 through the communicator 220 to assist the display device 200 to construct surround sound.

For WiFi speakers, Bluetooth speakers, and speakers based on other wireless transmission methods, due to the flexibility of their wireless connections, their locations can be arbitrarily set in the vicinity of the display device 200 . For example, the sound playback device 500 can be set on the left side, right side, left rear, right rear, etc. of the viewing user, so as to generate sound signals at these set orientations, thereby restoring the stereo effect.

A plurality of sound playback apparatuses 500 may also be set according to the number of external device connections supported by the display device 200 and the specific wireless connection manner. Obviously, the greater the number of sound playback apparatuses 500 provided, the better the stereo effect that can be presented together, but the correspondingly higher requirements for the ability to process audio signals. Therefore, in practical applications, it is not necessary to provide an excessive number of sound playback apparatuses 500 . For example, a sound playing device 500 may be provided at the left rear and the right rear of the user, respectively.

In addition, the same connection manner may be adopted between the plurality of sound playback apparatuses 500 and the display device 200 . For example, both the two sound playing apparatuses 500 are connected by Bluetooth or both are connected by WiFi; different connection modes may also be used between the plurality of sound playing apparatuses 500 and the display device 200 . For example, one sound playing device 500 uses a Bluetooth connection, and another sound playing device 500 uses a WiFi connection. Since different connection methods process audio signals differently, the corresponding playback effects are also different. Therefore, in practical applications, multiple sound playback devices 500 should adopt the same connection method, thereby reducing the amount of data processing of the display device 200. At the same time, it also helps to maintain the synchronization of the sound played among the plurality of sound playing devices 500 .

In the embodiment of the present application, since the external sound playback device 500 is used to assist in forming a surround sound effect, when the audio is actually played, the original speaker 286 on the display device 200 still maintains audio output, and the external sound playback device 500 also maintains audio output. Keep audio output. In this way, as shown in FIG. 11, through the speaker 286 located in front of the user and the sound playback device 500 located behind the user, surround sound can be formed in multiple directions around the user, so compared with the traditional sound processing software algorithm, it can be better to restore the surround sound effect.

In order to form sound playback effects in multiple directions, some embodiments of the present application provide an audio playback method. As shown in FIG. 12 , the audio playback method includes the following steps:

S1: Get the control command for playing audio.

In practical applications, the control instruction for playing audio can be manually input by the user, that is, when the user selects any media asset to play on the video or audio media asset interface, the display device 200 needs to convert the media asset data into a specific video or audio. to play. Therefore, the control instruction for playing audio may be the control instruction input when the user selects any media asset and starts playing. For example, the user performs an interactive operation through the control device 100, and controls the movement of the focus cursor on the media asset details page, moves the cursor to the icon of "movie A", and presses the "OK" key on the control device 100, then Execute the playback of the "movie A" media asset, that is, input a control command for playing audio.

Users can also input control instructions for audio playback through a special audio (video) playback application, such as the “music player” built into the operating system; or control instructions for audio playback through third-party applications downloaded by the user. , such as "XX Music" and so on. Usually, in a specific application program, the user plays the media asset by clicking the "play/pause" control on the play interface, and inputs a control instruction for playing the audio.

The control instruction for playing audio can also be automatically input by the display device 200 when the audio signal needs to be output. For example, according to the interaction strategy of the built-in operating system of the display device 200, corresponding sound effects will be matched when the user performs certain operations. Therefore, in some embodiments, when the display device 200 needs to cooperate with an interactive operation to perform corresponding sound effects, a control instruction for playing audio may be input by monitoring the control instruction.

For example, during the booting process of the display device 200, when the booting program runs until the booting animation is displayed, the booting prompt music needs to be played together. At this time, while controlling the display device 200 to play the boot animation, a call instruction will be sent to the audio related module to call the audio related module to play the boot prompt music. Therefore, when it is detected that the call instruction is sent to the audio related module, it is determined that the input has been Control commands for playing audio.

In addition, for some applications, such as short video applications, game applications, etc., due to the set interaction mode, video or audio signals are automatically played when the application is opened. Therefore, for this type of application, it can be determined that a control instruction for playing audio is input when this type of application is opened.

S2: In response to the control instruction, decode the played audio to obtain multi-channel data.

After acquiring the control instruction for playing audio, the controller 250 of the display device 200 may perform decoding on the audio to be played in response to the control instruction, thereby decoding the media asset data into multi-channel data. Wherein, the multi-channel data may be source data contained in the media resource data, for example, the media resource itself is a surround sound source; it may also be regenerated data based on the media resource data combined with a specific stereo restoration algorithm, For example, when the media itself is not a surround sound source, the audio is simulated as surround sound through the built-in stereo restoration algorithm.

In order to decode the audio, in a specific application process, the controller 250 may acquire specific media asset file data after receiving the control instruction, and decode the media asset data by calling a Decoder (decoder). During the decoding process, the decoder may determine the number of channels included in the decoded multi-channel data according to the number of speakers 286 built in the current display device 200 and the number of external sound playback devices 500. For example, when the display device 200 has two built-in speakers 286 and two sound playback devices 500 are connected to the display device 200 at the same time, the decoder can decode the four-channel data from the media data to pass the speakers 286 and the sound playback device respectively. 500 to play.

At the same time, according to the positional relationship between the speaker 286 and the sound playback device 500 set relative to the viewing user, the channel data corresponding to the set position can also be parsed during the decoding process. For example, the speakers 286 of the display device 200 are usually arranged on both sides of the display device 200, and when the user is viewing the display device 200, they are usually located directly opposite the display 275 of the display device 200, at this time, the two speakers 286 on the display device 200 are located at the front left and front right of the user, respectively. In order to obtain a better surround sound effect, the two sound playback apparatuses 500 externally connected to the display device 200 may be arranged at the left rear and the right rear of the user. Therefore, during the decoding process, the left channel data, the right channel data, the left surround channel data and the right surround channel data can be separately parsed from the media asset data through the decoder.

S3: Separate surround sound data and power amplifier sound data from the multi-channel data.

After the multi-channel data is obtained by decoding, each channel in the multi-channel data may be separated, and then sent to different speakers 286 and the sound playback device 500 for playback. In the embodiment of the present application, in order to cooperate with the external sound playback device 500, the data of each channel can be divided into two categories, one is the power amplifier sound data played by the built-in speaker 286 of the display device 200, and the other is played by the external sound Surround sound data played by device 500 .

The separated channel data can be played by the speakers 286 or the sound playback device 500 respectively, so the number of separated channel data should be consistent with the number of the speakers 286 and the sound playback device 500 . For example, two power amplifier sound data, left channel data and right channel data, and two surround sound data, left surround channel data and right surround channel data, may be separated from the multi-channel data, respectively.

After the multi-channel data is separated, the controller 250 can also process the separated surround sound data and power amplifier sound data by calling different sound effect processing programs, including processing processes such as sound quality adjustment, volume adjustment, playback synchronization adjustment, etc. , to make the restored stereo sound better.

S4: Send the power amplifier sound data to an audio output interface, and send the surround sound data to the sound playback device through the communicator.

After the multi-channel data is separated, the separated channel data may be sent separately. That is, the audio data of the power amplifier can be sent to the audio output interface for playback through the built-in speaker 286 . At the same time, the surround sound data is sent to the communicator 220 , and the surround sound data is sent to the sound playback device 500 through the communicator 220 to be played by the sound playback device 500 .

It can be seen that, in the above embodiment, the display device 200 can decode the media asset data into multi-channel data when playing audio, and separate the power-amplified sound data and the surround-sound data from the multi-channel data, and finally The data is sent to the audio output interface and output at the speaker 286 , and the surround sound data is sent to the sound playback device 500 through the communicator 220 and output at the sound playback device 500 . It can be seen that the display device 200 can generate surround sound behind the user through the external sound playback device 500, and transmit the surround sound data through the communicator 220, so that it is possible to restore a relatively high level of sound without the need to deploy professional surround sound equipment. Good surround sound effect.

In some embodiments, the sound playback apparatus 500 may establish a connection with the display device 200 through a WiFi network, and transmit corresponding channel data through the WiFi network. That is, the communicator 220 includes a WiFi module 221. As shown in FIG. 13, the audio playback method further includes the following steps:

S501: Send a TCP broadcast to the wireless local area network where the display device is located through the WiFi module;

S502: Receive a broadcast response from the sound playback device for the TCP broadcast feedback;

S503: Extract the IP address from the broadcast response;

S504: Configure a playback channel for the sound playback device according to the IP address.

Among them, Transmission Control Protocol (TCP, Transmission Control Protocol) is a connection-oriented, reliable, byte stream-based transport layer communication protocol, which can adapt to the layered protocol hierarchy supporting multi-network applications. In order to realize that the display device 200 is externally connected to the sound playing device 500 , in this embodiment, the controller 250 may send a TCP broadcast to the wireless local area network where the display device 200 is located through the WiFi module 221 . The sent TCP broadcast may include an identifier for indicating the establishment of a connection with the sound playback apparatus 500, so that the sound playback apparatus 500 can feed back a broadcast response to the TCP broadcast.

The controller 250 can receive the broadcast response fed back by the sound playback device 500, extract the IP address of the corresponding sound playback device 500 from the received broadcast response, and finally use the IP address as an identification mark to configure the playback for the corresponding sound playback device 500. The channel is to set which channel the user of the sound playback device 500 corresponding to the IP address plays the sound.

For example, the display device 200 and two WiFi speakers are connected to the same router at the same time, that is, the display device 200 and the WiFi speakers are in the same home LAN. The display device 200 first searches in the home local area network to find out the WiFi audio device. Then, by sending the TCP broadcast, after the WiFi speaker receives the TCP broadcast, it feeds back the broadcast response, and notifies the display device 200 of the corresponding IP address information. Then, the display device 200 configures the playback channel of the WiFi speaker by establishing a connection with the answered WiFi speaker.

Configuring playback channels for the sound playback device 500 may be done manually by the user. For example, after setting a sound playback device 500 at the left rear of the viewing area, when the sound playback device 500 is connected to the display device 200, the user manually sets the playback channel of the sound playback device 500 to the left surround channel .

The playback channel may also be automatically configured by the display device 200 for the connected sound playback apparatus 500 . For example, after the wireless network connection is established, the display device 200 can send a test tone to the connected sound playback apparatus 500, and receive the test sound sound signal played by the sound playback apparatus 500 through multiple built-in or externally connected microphone devices. Combined with multiple test tones of different volumes and calculation results of signals detected by multiple microphone devices, the orientation of the sound playback device 500 is determined, and a playback channel is configured for the sound playback device 500 according to the determined orientation.

Obviously, the display device 200 can establish a wireless connection with a plurality of sound playback apparatuses 500 on the same network through a WiFi network, and configure playback channels for each sound playback apparatus 500 according to the setting position thereof. The IP address corresponding to each sound playback device 500 can be used as a mark to distinguish each channel, that is, when the surround sound data is sent to the sound playback device 500 , the data is sent according to the IP address of each sound playback device 500 .

In order to enable the sound playback apparatus 500 to communicate with the display device 200, in some embodiments of the present application, after the step of configuring the playback channel for the sound playback apparatus according to the IP address, the method further The method includes: establishing a communication connection with the sound playing device according to the IP address; and sending a configuration file to the sound playing device.

Wherein, the configuration file includes an application program that can be installed on the sound playback device. That is, in practical applications, the sound playing apparatus 500 needs to create an application separately, so that the data of the display device 200 and the sound playing apparatus 500 can be transmitted according to the TCP protocol through the created application. That is, the display device 200 can communicate through the TCP protocol to notify the data format information transmitted by the sound playback device 500, so that the sound playback device 500 can parse the data according to the defined data format, thereby playing the channel data.

It can be seen that, in this embodiment, the display device 200 sends the configuration file to the sound playback apparatus 500, so that the sound playback apparatus 500 can directly obtain the installation file of the application program from the configuration file, thereby creating an application on the sound playback apparatus 500 without the need for Data transfer between the display device 200 and the sound playback apparatus 500 can be realized by additional configuration of the sound playback apparatus 500 .

After the wireless network connection is established, the controller 250 of the display device 200 can extract the surround sound data under the playback channel from the multi-channel data, and send the surround sound data to the sound playback device 500 with the IP address as the destination.

In the above-mentioned embodiment, the sound equipment based on the WiFi network can be placed around the viewing area of the user, so as to generate sound in directions such as side and rear. By using the WiFi network, the separated surround sound data can be sent to the sound playback device 500 for playback, so as to obtain a better surround sound effect. Therefore, the above-mentioned embodiment can utilize the idle audio equipment in the home without re-wiring to realize the stereo effect of the surround sound like a theater sound, thereby improving the user experience.

In some embodiments of the present application, the connection between the display device 200 and the sound playback apparatus 500 may also be realized by means of a Bluetooth connection. That is, the communicator 220 includes a Bluetooth module 222. As shown in FIG. 14, the audio playback method further includes the following steps:

S601: Search for the pairable sound playback device through the Bluetooth module;

S602: Pair a Bluetooth connection with at least one of the sound playback devices;

S603: Acquire name information of the paired sound playback device;

S604: Configure a playback channel for the sound playback device according to the name information.

In order to realize the Bluetooth connection between the display device 200 and the sound playback apparatus 500 . The display device 200 can search for pairable sound playback apparatuses 500 within a certain range through the Bluetooth module 222, and pair with at least one sound playback apparatus 500 through the Bluetooth pairing method.

For the paired sound playback device 500, the controller 250 may also extract the name information, so that the user can identify the sound playback device 500 when the channel data is subsequently transmitted. The name information may be a device name customized by the user during the pairing process, or identification information determined by reading the device information, such as the MAC address of the device.

If during the pairing process, the searched device names of the pairable sound playback apparatus 500 are the same, they can be distinguished by modifying the name information. For example, if the custom device names of the two paired sound playback apparatuses 500 are both "Bluetooth speaker", a distinguishing mark may be added to the device name, and the names of the two sound playback apparatuses 500 are respectively modified to "Bluetooth speaker 01" " and "Bluetooth Speaker 02".

After acquiring the name information of the paired sound playback device 500 , the display device 200 uses the name information as a mark to configure a playback channel for each sound playback device 500 . Similarly, different playback channels can be configured according to the setting position of the sound playback device 500 . For example, the playback channel is configured as the right surround channel for the sound playback device 500 provided on the right rear side of the user.

Similarly, for the sound playback device 500 configured with playback channels, the surround sound data under the playback channel can be extracted from the multi-channel data; and the surround sound data can be sent to the corresponding sound playback device according to the name information. For example, the extracted right surround channel data is sent to the sound playback device 500 configured as the right surround channel.

It can be seen that, in the above-mentioned embodiment, the connection between the display device 200 and the sound playing apparatus 500 can be realized by means of a Bluetooth connection. As a wireless connection method, Bluetooth connection can realize data transmission within a certain range, and for the sound playback device 500 based on Bluetooth connection, since a general protocol is used, there is no need to create an application in the sound playback device 500 separately. Therefore, most configuration requirements of the display device 200 can be met.

It should be noted that, in order to realize that the display device 200 is externally connected to the sound playback apparatus 500, other wireless connection methods, such as zigbee, radio frequency network, etc., may also be used.

In addition, after a conventional WiFi speaker or a Bluetooth speaker is connected to the display device 200, when playing audio, the built-in speaker 286 of the display device 200 will be turned off, and only the WiFi speaker or the Bluetooth speaker will output sound. In the embodiment of the present application, although the display device 200 is connected to an external sound playback device 500, in order to obtain a surround sound effect, the speaker 286 is not turned off when playing audio, but the speaker 286 and the sound playback device 500 are kept outputting sound at the same time. .

In order to distinguish between the above two usage situations, it is ensured that the display device 200 and the sound playback device 500 are used correctly. Before the display device 200 establishes a connection with the sound playback apparatus 500 , the user may be prompted for the purpose of the connected sound playback apparatus 500 through an operation page. For example, when the sound playback device 500 is connected, a prompt interface will pop up, and the prompt interface includes controls for two purposes for the user to choose, such as "connecting audio" and "forming surround sound". If the user selects "access to sound", the built-in speaker 286 of the display device 200 is turned off according to the traditional sound playback mode; if the user selects "form surround sound", the speaker 286 is turned off according to the sound output method in the above-mentioned embodiment. The sound is output simultaneously with the sound playback device 500 .

In some embodiments of the present application, in order to obtain a better sound playback effect, the audio quality may also be processed before the surround sound data and the power amplified sound data are sent to the sound playback device 500 and the speaker 286 . That is, the display device 200 further includes an audio processor 280, and the audio playback method further includes: sending the multi-channel data to the audio processor 280 to perform sound effect processing; or sending the surround sound data and the power amplifier sound data to the The audio processor 280 performs sound effect processing.

Among them, the sound quality processing performed on the audio is sound related processing performed on the audio data, including sound effects processing such as PEQ, GEQ, ATMOS, and DTS. In practical applications, after decoding the played audio to obtain multi-channel data, the multi-channel data may be sent to the audio processor 280, so that the audio processor 280 performs unified sound quality processing on the multi-channel data. In the case of unified sound effect processing, the processing efficiency is high, high-quality audio data can be obtained quickly, and the overall sound quality of the processed sound can be kept consistent.

Alternatively, after the surround sound data and the power amplified sound data are separated from the multi-channel data, the surround sound data and the power amplified sound data may be respectively sent to the audio processor 280 to perform sound effect processing for each channel. For the case of performing sound effect processing separately, it can implement different sound effect adaptation processing for different channels, so as to obtain a better surround sound effect.

When transmitting data through WiFi network and Bluetooth connection, there will inevitably be a certain data transmission delay, which will cause the sound from the sound playback device 500 to be out of sync with the sound from the speaker 286 of the display device 200, affecting user experience. For example, it can be determined through real-time measurement or statistical analysis that when the display device 200 is connected to the Bluetooth speaker, a delay of 0.5s occurs, that is, the audio played through the Bluetooth speaker lags 0.5s relative to the display screen, making the picture and sound out of sync. However, the sound output by the built-in speaker 286 of the display device 200 is kept in sync with the picture, that is, there is an asynchrony between the sound output by the speaker 286 and the sound output by the Bluetooth speaker, and the audio played through the Bluetooth speaker is 0.5s later than the audio output by the speaker 286 .

To this end, in some embodiments, the display device 200 further includes a synchronization module. As shown in FIG. 15 , the step of separating the surround sound data and the power amplifier sound data from the multi-channel data further includes:

S701: Send the surround sound data and the power amplifier sound data to the synchronization module to perform buffer processing;

S702: control the synchronization module to form the buffered audio data into a data stream;

S703: Adjust the sending timing of the data stream to maintain synchronization between the audio output interface and the sound played by the sound playback device.

After the surround sound data and the power amplifier sound data are separated from the multi-channel data, the separated surround sound data and the power amplifier sound data may be sent to the synchronization module to perform buffer processing. The controller 250 can acquire the playback delay time of each sound playback device 500 in real time, and control the synchronization module to form a data stream according to the playback delay time, and send the formed data stream with a specific transmission timing, so as to relieve the sound playback device 500 and the speaker. 286 playback sound is out of sync.

For example, in order to improve the above-mentioned asynchronous problem that the audio played through the Bluetooth speaker is 0.5s later than the audio output by the speaker 286, after separating the surround sound data and the power amplifier sound data from the multi-channel data, the surround sound data and the power amplifier sound data can be separated first. The audio data is sent to the synchronization module, where it is buffered and a data stream is formed. The controller 250 then controls the transmission timing of the two data streams, and sends the power amplifier sound data to the audio output interface 285 with a delay of 0.5s, or sends the surround sound data to the Bluetooth speaker 0.5s in advance, so as to improve the communication between the speaker 286 and the Bluetooth speaker. out of sync problem.

In some embodiments of the present application, surround sound data may also be sent to the sound playback apparatus 500 according to the setting position of the sound playback apparatus 500 , that is, as shown in FIG. 16 , the surround sound data may be sent through the communicator The steps to the sound playback device also include:

S801: Obtain orientation information of the sound playback device relative to the display device;

S802: Set the playback channel of the sound playback device according to the orientation information;

S803: Send the surround sound data corresponding to the playback channel to the sound playback device.

In order to obtain the surround sound effect, the orientation information of the sound playback device 500 relative to the display device 200 can be acquired in real time, and the playback channel of the sound playback device 500 can be set according to the acquired orientation information, so as to convert the surround sound data corresponding to the playback channel Sent to the sound playback device 500 .

In practical applications, the sound playback device 500 may be moved to change its original setting position, for example, the positions of the two sound playback devices 500 located at the left rear and the right rear may be interchanged in some cases. Therefore, by acquiring the orientation information of the sound playback device 500 in real time, the orientation of the sound playback device 500 can be determined, so as to send the corresponding surround sound data to the sound playback device 500, so that the sound playback device 500 at different positions can play the corresponding channel. Surround sound, to alleviate the influence of playback quality due to changing the position of the sound playback device 500 .

In this embodiment, in order to obtain the orientation information of the sound playback device 500 relative to the display device 200 , the test sound can also be played by controlling the sound playback device 500 , and the sound signals can be detected by multiple microphones built in the display device 200 . The change in volume of the sound signal detected by each microphone is used to determine the orientation.

It is also possible to capture images of the usage environment through a device such as a camera built in or external to the display device 200 , and identify the location of the sound playback device 500 by analyzing the features in the captured images. For example, a bluetooth speaker connected to the display device 200 is usually provided with a power indicator, and the position of the sound playback device 500 can be identified by detecting an image corresponding to the indicator in the captured image.

In some embodiments of the present application, it is also possible to adjust the volume of each sound playback device 500 according to the orientation information of the sound playback device 500, so that the volume of the sound output by each sound playback device 500 and the speaker 286 is consistent or kept at a specific level proportional relationship in order to present a better surround sound effect to the user.

For example, after acquiring the orientation information of the sound playback device 500, the volume of the sound playback device 500 that is relatively far from the display device 200 can be turned up, and the volume of the sound playback device 500 that is relatively close to the display device 200 can be turned down , the volume of the built-in speaker 286 of the display device 200 can also be adjusted adaptively, so that the volume heard by the user in all directions tends to be consistent.

Based on the audio playback method provided by the foregoing embodiments, some embodiments of the present application further provide a display device 200 , including: a display 275 , a communicator 220 , an audio output interface 285 , and a controller 250 . The display 275 is configured to display an audio playback screen and various control interfaces; the communicator 220 is configured to establish a wireless connection with a sound playback device; and the audio output interface 285 is configured to play audio signals.

As shown in Figure 12, the controller 250 is configured to perform the following procedural steps:

S1: Get the control command for playing audio;

S2: in response to the control instruction, decode the played audio to obtain multi-channel data;

S3: separate surround sound data and power amplifier sound data from the multi-channel data;

S4: Send the power amplifier sound data to an audio output interface, and send the surround sound data to the sound playback device through the communicator.

As can be seen from the above technical solutions, the present application provides a display device 200 and an audio playback method, which can decode the played audio to obtain multi-channel data after obtaining a control instruction for playing the audio. The surround sound data and the power-amplified sound data are separated from the multi-channel data, so that the power-amplified sound data is sent to the audio output interface 285 , and the surround sound data is sent to the sound playback device 500 through the communicator 220 . The method can use the sound playback device 500 such as a WiFi speaker or a Bluetooth speaker to cooperate with the audio output interface 285 of the display device 200 to play audio in multiple directions, respectively. Good surround sound effect.

Since the above embodiments are all cited and combined with other modes for description, different embodiments all have the same parts, and the same and similar parts among the various embodiments in this specification can be referred to each other. It will not be elaborated here.

It should be noted that, in this specification, relational terms such as "first" and "second" etc. are only used to distinguish one entity or operation from another entity or operation, and are not necessarily required or implied Any such actual relationship or ordering exists between these entities or operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a circuit structure, article or device comprising a list of elements includes not only those elements, but also not expressly listed Other elements, or elements inherent to such a circuit structure, article, or device are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the circuit structure, article, or device that includes the element.

Other embodiments of the present application will readily suggest themselves to those skilled in the art upon consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of this application and include common knowledge or common technical means in the technical field not disclosed in this application . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the application being indicated by the content of the claims.

The above embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims (10)

1. A display device, comprising:

   monitor;

   A controller that is configured to:

   After the wireless speaker and the display device are successfully connected, it is determined whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the wireless speaker and the display device includes the first communication connection ;

   If the display device establishes a first communication connection with the first device, controlling the wireless speaker and the first device to work in different frequency bands;

   If the display device does not establish a first communication connection with the first device, the wireless speaker is controlled to communicate with the display device according to a default frequency band.
2. The display device according to claim 1, wherein the controlling the wireless speaker and the first device to work in different frequency bands, comprising:

   determining whether the frequency of the first communication connection between the display device and the first device is greater than or equal to a preset frequency, wherein the preset frequency is greater than or equal to the lowest frequency of the first frequency band;

   If the frequency of the first communication connection between the display device and the first device is greater than or equal to the first frequency, control the communication frequency band between the wireless speaker and the display device to be the second frequency band;

   If the frequency of the first communication connection between the display device and the first device is lower than the first frequency, control the communication frequency band between the wireless speaker and the display device to be the first frequency band.
3. The display device according to claim 2, wherein the display device further comprises a bass channel data sending module, the bass channel data sending module is connected to the controller, and the bass channel data sending module communicating with the wireless speaker;

   The communication frequency band for controlling the wireless speaker and the display device is the second frequency band, including:

   Send a frequency adjustment instruction to the wireless speaker, so that the bass channel data sending module adjusts the frequency band of the signal sent to the wireless speaker to the second frequency band according to the frequency adjustment instruction.
4. The display device of claim 1, wherein the controller is further configured to:

   receiving an instruction to connect the first device and the display device input by the user;

   In response to the instruction for connecting the first device and the display device, establishing a communication connection between the first device and the display device;

   determining whether the communication connection established between the display device and the first device is the first communication connection;

   If the communication connection established between the display device and the first device is the first communication connection, controlling the wireless speaker and the first device to work in different frequency bands;

   If the communication connection established between the display device and the first device is not the first communication connection, the frequency of the wireless speaker is controlled to remain in the frequency band before the first device and the display device are connected.
5. The display device according to claim 1, wherein the connection method between the wireless speaker and the display device further comprises a second communication connection, and after the wireless speaker and the display device are successfully connected, it is determined that the display device is connected to the first communication connection. Whether a device has established a first communication connection includes: after the wireless speaker is successfully connected to the display device through the second communication connection, judging whether the display device and the first device have established the first communication connection.
6. The display device according to claim 5, wherein the first communication connection includes a 5G WiFi connection, and the second communication connection includes a Bluetooth connection.
7. A display device, comprising:

   monitor;

   A controller that is configured to:

   After the wireless speaker and the display device are successfully connected, determine whether there is a connection record between the wireless speaker and the display device;

   If there is a connection record between the wireless speaker and the display device, control the wireless speaker to communicate with the display device according to the frequency band in the connection record;

   If there is no connection record between the wireless speaker and the display device, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the wireless speaker and the display device includes the first communication connection. communication connection;

   If the display device establishes a first communication connection with the first device, controlling the wireless speaker and the first device to work in different frequency bands;

   If the display device does not establish a first communication connection with the first device, the wireless speaker is controlled to communicate with the display device according to a default frequency band.
8. The display device of claim 7, wherein the controller is further configured to:

   receiving an instruction to connect the first device and the display device input by the user;

   establishing a communication connection between the first device and the display device in response to the instruction for connecting the first device and the display device;

   determining whether the communication connection established between the display device and the first device is the first communication connection;

   If the communication connection established between the display device and the first device is the first communication connection, controlling the wireless speaker and the first device to work in different frequency bands;

   If the communication connection established between the display device and the first device is not the first communication connection, the frequency of the wireless speaker is controlled to remain in the frequency band before the first device and the display device are connected.
9. A display device, comprising:

   monitor;

   A controller that is configured to:

   After the first device and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection;

   If a first communication connection is established between the display device and the first device, the wireless speaker and the first device are controlled to work in different frequency bands, wherein one of the connection methods between the wireless speaker and the display device includes the first communication connection;

   If the display device does not establish a first communication connection with the first device, the wireless speaker is controlled to communicate with the display device according to a default frequency band.
10. A communication method between a display device and a wireless speaker, comprising:

    After the wireless speaker and the display device are successfully connected, determine whether the display device and the first device have established a first communication connection, wherein one of the connection methods between the wireless speaker and the display device includes the first communication connection ;

    If the display device establishes a first communication connection with the first device, controlling the wireless speaker and the first device to work in different frequency bands;

    If the display device does not establish a first communication connection with the first device, the wireless speaker is controlled to communicate with the display device according to a default frequency band.

Images