CN114501158A

CN114501158A - Display device, external sound equipment and audio output method of external sound equipment

Info

Publication number: CN114501158A
Application number: CN202011166647.3A
Authority: CN
Inventors: 孙永瑞; 张安祺; 黄玖法
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-10-27
Filing date: 2020-10-27
Publication date: 2022-05-13
Anticipated expiration: 2040-10-27
Also published as: CN114501158B

Abstract

The present application relates to the field of communications technologies, and in particular, to a display device, an external audio device, and a method for outputting audio from the external audio device. The problem that audio data are high in playing delay time of WIFI sound equipment after being transmitted through a network and different WIFI sound equipment are unsynchronized in playing of left and right surround sound can be solved to a certain extent. The external sound equipment includes: a second controller configured to: receiving a first instruction which is sent by a display device and contains a first parameter, wherein the first parameter is used for configuring an audio data pool, and the audio data pool stores received audio data; when the data length in the audio data pool is greater than a first threshold value configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length and plays the audio data after frame dropping; otherwise, sending a second instruction to the display equipment.

Description

Display device, external sound equipment and audio output method of external sound equipment

Technical Field

The present application relates to the field of communications technologies, and in particular, to a display device, an external audio device, and a method for outputting audio from the external audio device.

Background

With the development of wireless audio technology, wireless audio equipment has made great progress in response time, transmission rate and convenience, and thus is increasingly present in home audio and video systems.

Wi-Fi is often written as "WiFi" or "Wifi" wireless local area network technology based on the IEEE 802.11 standard. The IEEE 802.11 devices have been installed in many products on the market, such as: smart televisions, audio equipment, personal computers, game consoles, MP3 players, smart phones, tablet computers, printers, laptops, and other peripheral devices that can be wirelessly networked.

However, audio data is transmitted from the television side to the audio device side, and data processing, network transmission and peripheral network influence are required, and it takes a certain time for each frame of audio data to reach the audio device, so that a user subjectively feels that the sound production of the WIFI audio device lags behind a television picture, and the left surround sound and the right surround sound of a television playing film source are output on two WIFI audio devices and sometimes play asynchronously.

Disclosure of Invention

In order to solve the problems that the playing time delay of audio data is high after the audio data is transmitted through a network and the left and right surround sounds played by different WIFI sound equipment are not synchronous, the application provides a display device, an external sound equipment and an audio output method of the external sound equipment.

The embodiment of the application is realized as follows:

a first aspect of an embodiment of the present application provides a display device, including: a display for displaying a user interface; a first controller configured to: sending a first instruction containing a first parameter to an external sound device, wherein the first parameter is used for configuring an audio data pool by the external sound device, and the audio data pool stores received audio data; after the pairing is successful, the first controller can control the external sound equipment to output audio data; otherwise, controlling the user interface to display first prompt information, and skipping to a pairing setting interface after the first prompt information receives the confirmation operation.

A second aspect of the embodiments of the present application provides an external sound device, including: a second controller configured to: receiving a first instruction which is sent by a display device and contains a first parameter, wherein the first parameter is used for configuring an audio data pool, and the audio data pool stores received audio data; when the data length in the audio data pool is greater than a first threshold value configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length and plays the audio data after frame dropping; otherwise, sending a second instruction to the display equipment.

A third aspect of the embodiments of the present application provides a method for outputting an audio signal from an external audio device, where the method includes: sending a first instruction containing a first parameter to an external sound device, wherein the first parameter is used for configuring an audio data pool by the external sound device, and the audio data pool stores received audio data; after the pairing is successful, the external sound equipment can be controlled to output audio data; and otherwise, displaying first prompt information, and skipping to a pairing setting interface after the first prompt information receives the confirmation operation.

A fourth aspect of the embodiments of the present application provides a method for outputting audio from an external audio device, where the method includes: receiving a first instruction which is sent by a display device and contains a first parameter, wherein the first parameter is used for configuring an audio data pool, and the audio data pool stores received audio data; when the data length in the audio data pool is larger than a first threshold value configured by the first parameter, controlling the audio data to actively drop frames to shorten the data length, and playing the audio data after frame dropping; otherwise, sending a second instruction to the display equipment.

The beneficial effect of this application: by constructing the first instruction, the unified configuration of binding the external sound equipment and the audio data pool can be realized; further, the dynamic configuration of the audio data pool can be realized by constructing the first parameter and the second parameter; further, by constructing a second instruction, receiving audio playing delay feedback can be realized; further, by constructing the third parameter, the first prompt message and the second prompt message, the audio playing delay correction reminding can be realized, the audio playing delay of the external sound equipment can be dynamically adjusted according to the network quality between the display equipment and the external sound equipment, and the asynchronous playing among a plurality of external sound equipment is reduced.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and those skilled in the art can obtain other drawings without inventive labor.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;

fig. 2 is a block diagram exemplarily showing a hardware configuration of a display device 200 according to an embodiment;

fig. 3 is a block diagram exemplarily showing a hardware configuration of the control apparatus 100 according to the embodiment;

fig. 4 is a diagram exemplarily showing a functional configuration of the display device 200 according to the embodiment;

fig. 5a schematically shows a software configuration in the display device 200 according to an embodiment;

fig. 5b schematically shows a configuration of an application in the display device 200 according to an embodiment;

FIG. 6 is a schematic diagram illustrating a user interface of a display device according to an embodiment of the present application;

FIG. 7A is a schematic diagram illustrating a user interface of an external audio device to which a display device has been paired according to an embodiment of the present application;

FIG. 7B is a schematic diagram illustrating an unpaired audio device user interface according to an embodiment of the present application;

FIG. 7C is a schematic diagram illustrating an unpaired audio device user interface according to an embodiment of the present application;

FIG. 8A is a schematic diagram illustrating a user interface with a unqualified network connection status between a display device and an external audio device according to an embodiment of the present application;

FIG. 8B is a schematic diagram illustrating a user interface with a unqualified network connection status between a display device and an external audio device according to an embodiment of the present application;

fig. 9 is a schematic diagram illustrating that a display device outputs audio data to an external audio device for playing according to an embodiment of the present application;

FIG. 10 is a schematic diagram illustrating audio data output by a display device according to an embodiment of the present application;

FIG. 11 is a diagram illustrating audio data pool configuration interactions according to an embodiment of the present application;

fig. 12 shows an interaction diagram of audio data pool configuration optimization according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," as well as any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module" as used herein refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.

Reference throughout this specification to "embodiments," "some embodiments," "one embodiment," or "an embodiment," etc., means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, appearances of the phrases "in various embodiments," "in some embodiments," "in at least one other embodiment," or "in an embodiment" or the like throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Thus, the particular features, structures, or characteristics shown or described in connection with one embodiment may be combined, in whole or in part, with the features, structures, or characteristics of one or more other embodiments, without limitation. Such modifications and variations are intended to be included within the scope of the present application.

The term "remote control" as used in this application refers to a component of an electronic device, such as the display device disclosed in this application, that is typically wirelessly controllable over a short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.

The control device 100 may control the display device 200 in a wireless or other wired manner by using a remote controller, including infrared protocol communication, bluetooth protocol communication, other short-distance communication manners, and the like. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the display device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, the display device 200 includes a controller 210, a tuning demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

A display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting a picture, and a driving assembly for driving the display of an image. The video content may be displayed from broadcast television content, or may be broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.

The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).

The display apparatus 200 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communication interface 230. And an infrared receiver, an interface device for receiving an infrared control signal for controlling the apparatus 100 (e.g., an infrared remote controller, etc.).

The detector 240 is a signal used by the display device 200 to collect an external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, and parameters such as parameter changes can be adaptively displayed by collecting the ambient light.

The image collector 241, such as a camera or a video camera, may be used to collect external environment scenes, collect attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize user gestures, so as to implement a function of interaction with the user.

In some other exemplary embodiments, the detector 240, a temperature sensor, etc. may be provided, for example, by sensing the ambient temperature, and the display device 200 may adaptively adjust the display color temperature of the image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In other exemplary embodiments, the detector 240, and a sound collector, such as a microphone, may be used to receive a user's voice, a voice signal including a control instruction from the user to control the display device 200, or collect an ambient sound for identifying an ambient scene type, and the display device 200 may adapt to the ambient noise.

The input/output interface 250 controls data transmission between the display device 200 of the controller 210 and other external devices. Such as receiving video and audio signals or command instructions from an external device.

Input/output interface 250 may include, but is not limited to, the following: any one or more of a high definition multimedia interface HDMI interface 251, analog or data high definition component input interface 253, composite video input interface 252, USB input interface 254, RGB ports (not shown), etc.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned plurality of interfaces.

The tuning demodulator 220 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, frequency mixing, resonance, and the like, and demodulates the television audio and video signals carried in the television channel frequency selected by the user and the EPG data signals from a plurality of wireless or wired broadcast television signals.

The tuner demodulator 220 is responsive to the user-selected television signal frequency and the television signal carried by the frequency, as selected by the user and controlled by the controller 210.

The tuner-demodulator 220 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation mode can be digital modulation or analog modulation. Depending on the type of television signal received, both analog and digital signals are possible.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the input/output interface 250.

The video processor 260-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain an audio signal that can be played in the speaker.

In other exemplary embodiments, video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with the controller 210 in one or more chips.

An audio output 272, which receives the sound signal output from the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and the external sound output terminal 274 that can be output to the generation device of the external device, in addition to the speaker 272 carried by the display device 200 itself, such as: an external sound interface or an earphone interface and the like.

The power supply provides power supply support for the display device 200 from the power input from the external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply interface installed outside the display device 200 to provide an external power supply in the display device 200.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210 according to the user input, and the display device 200 responds to the user input.

In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The controller 210 controls the operation of the display apparatus 200 and responds to the user's operation through various software control programs stored in the memory 290.

As shown in fig. 2, the controller 210 includes a RAM213 and a ROM214, and a graphic processor 216, a CPU processor 212, a communication interface 218, such as: a first interface 218-1 through an nth interface 218-n, and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the display apparatus 200 starts power-on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM, copies the operating system stored in the memory 290 to the RAM213, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM213, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.

The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command for selecting a UI object displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

Wherein the basic module is a bottom layer software module for signal communication among the various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A block diagram of the configuration of the control apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 3. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control apparatus 100 is configured to control the display apparatus 200, and may receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive by the display apparatus 200 to mediate interaction between the user and the display apparatus 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications for controlling the display apparatus 200 according to user demands.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similar to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.

In some embodiments, a display device may be connected to the external audio device 600 through the communication interface 130.

For example, the display device may establish a communication network connection with the router 500 through the WIFI chip; the external audio device 600 is connected to the router 500 via a communication network, so that the display device is connected to the external audio device 600 via communication.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a camera, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200. It should be noted that the camera provided in the present application may be implemented as a camera externally connected to the display device, and may also be implemented as an image collector 241 built in the display device.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

A schematic diagram of a functional configuration of the display device 200 according to an exemplary embodiment is exemplarily shown in fig. 4. As shown in fig. 4, the memory 290 is used to store an operating system, an application program, contents, user data, and the like, and performs system operations for driving the display device 200 and various operations in response to a user under the control of the controller 210. The memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically configured to store an operating program for driving the controller 210 in the display device 200, and to store various application programs installed in the display device 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data such as the audio/video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuning demodulator 220, the input/output interface of the detector 240, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The example memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module, and so forth. The controller 210 performs functions such as: broadcast television signal reception demodulation function, television channel selection control function, volume selection control function, image control function, display control function, audio control function, external instruction recognition function, communication control function, optical signal reception function, power control function, software control platform supporting various functions, browser function, and other applications.

A block diagram of a configuration of a software system in a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 5 a.

As shown in fig. 5a, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary for data processing performed between application programs and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display screen, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controllable process management, including runtime applications and the like.

The event transmission system 2914, which may be implemented within the operating system 2911 or within the application program 2912, in some embodiments, on the one hand, within the operating system 2911 and on the other hand, within the application program 2912, is configured to listen for various user input events, and to refer to handlers that perform one or more predefined operations in response to the identification of various types of events or sub-events, depending on the various events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control device 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting gestures through gesture recognition, inputting sub-events through remote control key commands of the control equipment and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout manager 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, and other various execution operations related to the layout of the interface.

As shown in fig. 5b, the application layer 2912 contains various applications that may also be executed at the display device 200. The application may include, but is not limited to, one or more applications such as: live television applications, video-on-demand applications, media center applications, application centers, gaming applications, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

The embodiment of the application can be applied to various types of display equipment and external sound equipment (including but not limited to connectable network equipment, smart televisions, mobile terminals, tablet computers, set top boxes, wired external sound equipment, wireless external sound equipment and the like). The following explains a display device, a connectable network device, an external sound device, and a method for outputting audio by the external sound device, taking a user interface for outputting audio data to the WIFI external sound device by the smart television as an example.

FIG. 6 shows a schematic diagram of a user interface of a display device according to an embodiment of the present application.

The display device provided by the application comprises a display and a first controller. The display is used for displaying a user interface, the user interface after the display device is started is shown in fig. 6, and when the display device is not matched with the external sound box device in a detection and pairing mode, the network icon of the top status bar does not display the external sound box device.

In some embodiments, the user interface may also present interactive elements, which may include, for example, television home page controls, search controls, message button controls, mailbox controls, browser controls, favorites controls, signal bar controls, etc., and by moving focus on the display screen using a controller such as a remote control, different applications, function buttons may be selected.

To improve the convenience and the image of the UI of the television, in some embodiments, the first controller of the display device in the embodiments of the present application controls the UI of the television in response to the operation of the interactive element. For example, a user clicks the network connection icon through a controller such as a remote controller, so that a network setting interface can be activated, and the UI of the network setting interface is displayed on the top of the global UI, thereby controlling the enlargement of the UI of the application component mapped by the interactive elements or full-screen operation and display.

In some embodiments, the interactive element may also be operated by a sensor, which may be, but is not limited to, an acoustic input sensor, such as a display device configured microphone, which may detect voice commands including indications of the desired interactive element. For example, a user may identify a desired interactive element, such as an external sound device setting control, using "open sound device pairing settings" or any other suitable identification, and may also describe a desired action to be performed in relation to the desired interactive element. The first controller may recognize the voice command and submit data characterizing the interaction to the UI or its processing component or engine.

Fig. 7A is a schematic diagram illustrating a user interface of an external audio device to which a display device is paired according to an embodiment of the present application.

When the display device is connected to the external audio device, its top status bar will display the icon of the connected external audio device, as shown in the figure. The display device provided by the application comprises a display and a first controller. The first controller is configured to send a first instruction containing a first parameter to the external sound equipment, wherein the first parameter is used for configuring an audio data pool by the external sound equipment, and the audio data pool stores received audio data; after the pairing is successful, the first controller can control the external sound equipment to output audio data; otherwise, controlling the user interface to display first prompt information, skipping to a pairing setting interface after the first prompt information receives the confirmation operation, and explaining a specific process that the smart television outputs audio data to the WIFI external sound equipment.

Fig. 9 is a schematic diagram illustrating that a display device outputs audio data to an external audio device for playing according to an embodiment of the present application.

In some embodiments, when there is audio data to be played in the display device, a film source or APP (Application) played by the display device generates PCM (Pulse Code Modulation) audio data, and the PCM audio data is first transmitted to the SOC chip via the AudioTrack and the audiomaker. For another example, when the set-top box transmits Physic physical audio data to the display device, the Physic physical audio data is directly transmitted to the SOC chip. Then, the SOC chip decodes the Physic physical audio, and the SOC chip mixes the decoded audio data with the PCM audio data to obtain audio data after mixing, namely the audio data to be played finally; and the audio data to be played is processed and transmitted by modules such as Tinyals, Audio record, HiAPK, Audio track, Audio Flinger and the like so as to finally transmit the audio data after audio mixing to external sound equipment for playing.

In some embodiments, the display device automatically starts the first AudioTrack when the Android operating system loaded on the display device starts. The first AudioTrack is used for receiving the audio data transmitted by the audio data control module. The audio data control module can be implemented in a software form or a hardware form, and corresponds to an application program running in the display device, and is used for outputting audio data to be played to the first AudioTrack.

In some embodiments, the audio data may be audio data generated by any application in the display device, for example, audio data generated by a video player while playing a video media file or an audio player while playing an audio media file. The audio data may be either mute data or non-mute data. The mute data herein is not limited to the case where the user adjusts the playback volume of the application program to 0, and further, the volume of the audio data output by the application program is 0.

FIG. 10 is a schematic diagram illustrating audio data output of a display device according to an embodiment of the present application.

The external sound equipment provided by the application comprises a second controller, wherein the second controller is configured to receive a first instruction which is sent by display equipment and contains a first parameter, the first parameter is used for configuring an audio data pool, and the audio data pool stores received audio data.

The method comprises the steps that a display device, namely a TV end firstly sends audio data to a router for constructing a communication network, and the audio data are forwarded to an audio data pool of an external sound device through the router; a second controller of the external sound equipment controls an audio sound system to acquire audio data to be played from the audio data pool so as to realize the sounding of a loudspeaker component of the external sound equipment; and the second controller carries out instant configuration on the audio data pool by receiving a first instruction containing a first parameter so as to realize the playing of the audio data.

In some embodiments, the external audio devices include a first external audio device, a second external audio device; after the pairing is successful, the first controller can control the external sound equipment to output audio data, and the method comprises the steps that the first controller controls the first audio data to be forwarded to the first external sound equipment by the router and controls the second audio data to be forwarded to the second external sound equipment by the router.

For example, a first controller of the display device forwards first audio data of a left surround channel of a television to one WIFI sound paired with the television through a router, and forwards second audio data of a right surround channel to another WIFI sound paired with the television through a router, where the two WIFI sounds are a first external sound device and a second external sound device;

and the second controllers of the plurality of external sound equipment simultaneously receive the first instructions sent by the display equipment to configure the audio data pools thereof, and respectively receive the audio data forwarded by the router, so that the audio data can be synchronously played by different sounds. The display equipment television continuously sends a first instruction containing a first parameter to the external sound equipment in a matched connection mode through a network or in a broadcasting mode, a unicast mode, a TCP (transmission control protocol) link mode and the like, so that different sound equipment can synchronously configure audio data pools, synchronous playing of audio data is realized, and the problem that different external sound equipment cannot synchronously play audio data can be solved to a certain extent.

FIG. 11 shows a schematic diagram of audio data pool configuration interaction according to an embodiment of the present application.

And a second controller of the external sound equipment receives a first instruction containing a first parameter sent by the display equipment, and configures an audio data pool of the external sound equipment according to the first parameter, wherein the audio data pool can store audio data sent by the display equipment.

In some embodiments, the external audio devices include a first external audio device and a second external audio device, such as may be implemented as audio left and audio right in fig. 11.

After the external sound equipment establishes local area network communication with the television, a first controller of the television sends a first instruction containing a first parameter to the left side of the sound equipment through TCP/UDP;

the second controller on the left side of the audio receives the first instruction, and analyzes the first parameter contained in the first instruction to obtain the configuration information of the audio data pool contained in the first parameter, where the configuration information may include: the method comprises the steps of obtaining the total length T of an audio data pool, a first threshold value and a second threshold value; wherein the first threshold may be implemented as a high threshold H in the figure; the second threshold may be implemented as a low threshold L in the figure;

the second controller on the left side of the audio system configures the audio data pool according to the audio data pool configuration information obtained by parsing, including configuring the total length T of the audio data pool, the high threshold H, and the low threshold L, as shown in fig. 11.

In some embodiments, the first controller of the display device may further establish a binding relationship with the external sound device according to the audio data pool configuration information included in the first parameter.

For example, when the external sound equipment is paired to the display equipment for the first time, if the display equipment stores the configuration information of the reference audio data pool of other external sound equipment, the configuration information of the reference audio data pool is called to be sent to the external sound equipment paired for the first time;

if the configuration information of the reference audio data pool of any other external sound equipment is not stored in the display equipment, sending preset default configuration information of the audio data pool;

and when the external sound equipment is subsequently accessed repeatedly again, sending the audio data pool configuration information which is stored and uploaded to the display equipment for the last time.

In some embodiments, the external audio device receives audio data from the television terminal and stores the audio data in an audio data pool, and when the length of data in the audio data pool is greater than or equal to a low threshold L, i.e. a second threshold, the second controller controls the audio device to start an audio output function, i.e. play the stored audio data.

In some embodiments, when the data length in the audio data pool is greater than a first threshold value configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length, and plays the audio data after frame dropping; otherwise, sending a second instruction to the display equipment.

After receiving and playing the audio data each time, the second controller of the external audio device recalculates the data length in the audio data pool, that is, the data length N in the current data pool, and performs logic optimization based on the relationship between N and the low threshold L and the high threshold H to reduce the audio delay, which will be described in detail with respect to the logic optimization section below.

In some embodiments, when the length of data in the audio data pool of the external audio device is less than or equal to a first threshold configured by the first parameter, the second controller sends a second instruction to the display device, specifically, when the length of data in the audio data pool is less than or equal to the first threshold and is greater than or equal to a second threshold configured by the first parameter, the second controller sends a second instruction including a second parameter to the display device, where the second parameter includes the first threshold and the second threshold that are decreased according to a preset gradient.

The first controller of the display device receives a second instruction containing a second parameter sent by the external sound equipment, the second parameter is used for updating the first parameter used for reducing the audio delay by the first controller, and then the first controller sends the first instruction containing the updated first parameter to the paired external sound equipment.

For example, the second controller detects that the data length N in the audio data pool is between the low threshold L and the high threshold H, which indicates that the audio data transmission of the current communication network is stable, the amount of the audio data to be consumed by the external audio equipment is large, the audio playing delay is high, and the second controller reduces the low threshold L and the high threshold H; for example, it can be implemented to reduce the threshold value by a preset gradient data size length of 10ms each time the detection is performed to reduce the audio playing delay;

then the second controller sends a second instruction containing a second parameter to the display device, wherein the second parameter comprises the reduced and updated audio data pool configuration information such as the high threshold value H, the low threshold value L and the like;

a first controller of the display equipment receives a second instruction sent by the external sound equipment, and updates a first parameter which is stored before according to a second parameter contained in the second instruction;

the first controller of the display device stores the updated first parameter in the television end and sends the updated first parameter to other paired external sound devices through a first instruction, for example, the latest configuration information of the audio data pool of the external sound devices is sent to all the accessed external sound devices through a network in the modes of broadcasting, unicasting, TCP linking and the like;

after receiving the first instruction, the external audio device adjusts the parameters of the audio data pool in real time according to the updated high threshold H and low threshold L obtained by analyzing the updated first parameter, so as to further correct the audio data playing delay state, and to a certain extent, the external audio device can optimize and synchronously play the audio data of all paired external audio devices, as shown in fig. 11.

In some embodiments, when the data length in the audio data pool is greater than the first threshold value of the first parameter configuration, the second controller controls the audio data to actively drop frames to shorten the data length, and plays the audio data after frame dropping.

For example, when the second controller detects that the data length N in the audio data pool is greater than the high threshold H, it indicates that the amount of audio data to be consumed in the audio data pool has exceeded the expectation, and the delay of playing audio by the device is serious; the second controller will initiate an active frame dropping technique, i.e. an active audio frame dropping technique to reduce audio delay.

In some embodiments, when the PCM audio data is converted into sound for output, the volume is mainly determined by the size of the audio data, and when a frame of audio data transmitted by the television arrives at the audio device, the audio device drops the frame by determining whether each bit of the frame of audio data is lower than a preset threshold. Taking 16-bit depth PCM audio data as an example, the maximum value of the data is 256, the preset threshold is set to 26, if a certain frame of data is lower than 26, it can be considered that the frame of audio data is difficult to perceive by a user when being output, and after the frame of audio data is removed, audio delay can be reduced without affecting user experience.

In some embodiments, the second controller traverses the audio data in the audio data pool with the data length of 5ms as a reference unit, and actively discards the audio data after finding the audio data segment meeting the frame loss condition, so as to reduce the amount of the audio data in the audio data pool.

In some embodiments, when the length of data in the audio data pool of the external audio device is less than or equal to a first threshold configured by the first parameter, the second controller sends a second instruction to the display device, and the method further includes sending, by the second controller, a second instruction including a third parameter to the display device when the length of data in the audio data pool is less than a second threshold, where the third parameter is used to indicate that the network connection state is not qualified.

A first controller of the display equipment receives a second instruction which is sent by sound equipment and contains a third parameter, wherein the third parameter is used for representing that the network connection state is unqualified; and the first controller controls the user interface to display second prompt information, and the second prompt information jumps to the network setting interface after receiving the confirmation operation.

For example, the second controller detects that the data length N in the audio data pool is smaller than the low threshold L, which indicates that the amount of audio data transmitted by the current communication network is not enough to meet the data consumption playing speed of the current external sound box device, the sound box device generates noise, and the second controller feeds back a second instruction containing a third parameter to the television, where the third parameter represents that the current network connection state is unqualified.

The first controller of the display device receives a second instruction containing a third parameter sent by the sound device, where the third parameter is used to indicate that the network connection status is not qualified, and the user interface is as shown in fig. 8A.

After the user receives the second prompt message and performs the confirmation operation on the second prompt message, the first controller controls the user interface to jump to the network connection setting interface to correct the network state, as shown in fig. 8B.

In some embodiments, after the display device and the external audio device are unsuccessfully paired, the first controller controls the user interface to display first prompt information, and the first prompt information jumps to the pairing setting interface after receiving the confirmation operation, as shown in fig. 7A and 7B.

Based on the above description of the scheme for transmitting audio data to the external audio equipment by the display equipment, the application also provides a method for outputting audio of the external audio equipment at the display equipment end, and the method comprises the following steps: sending a first instruction containing a first parameter to an external sound device, wherein the first parameter is used for configuring an audio data pool by the external sound device, and the audio data pool stores received audio data; after the pairing is successful, the external sound equipment can be controlled to output audio data; and otherwise, displaying first prompt information, and skipping to a pairing setting interface after the first prompt information receives the confirmation operation. The specific operations and steps of the audio output method of the external sound equipment have been described in detail in the above implementation scheme of the display equipment, and are not described herein again.

In some embodiments, after pairing is successful: receiving a second instruction which is sent by sound equipment and contains a second parameter, wherein the second parameter is used for updating the first parameter for reducing the audio time delay; and sending a first instruction containing the updated first parameter to the paired external sound equipment. The specific operations and steps of the audio output method of the external sound equipment have been described in detail in the above implementation scheme of the display equipment, and are not described herein again.

In some embodiments, after pairing is successful: receiving a second instruction containing a third parameter sent by sound equipment, wherein the third parameter is used for representing that the network connection state is unqualified; and displaying second prompt information, wherein the second prompt information jumps to a network setting interface after receiving the confirmation operation. The specific operations and steps of the audio output method of the external sound equipment have been described in detail in the above implementation scheme of the display equipment, and are not described herein again.

In some embodiments, the external audio device comprises a first external audio device, a second external audio device; after pairing successfully, the external sound equipment can be controlled to output audio data, including: and controlling the first audio data to be forwarded to the first external sound equipment by the router and controlling the second audio data to be forwarded to the second external sound equipment by the router. The specific operations and steps of the audio output method of the external sound equipment have been described in detail in the above implementation scheme of the display equipment, and are not described herein again.

Based on the above explanation that the display device sends the audio data to the external sound equipment playing scheme, the application also provides a method for outputting the audio of the external sound equipment at the external sound equipment end, and the method comprises the following steps: receiving a first instruction which is sent by a display device and contains a first parameter, wherein the first parameter is used for configuring an audio data pool, and the audio data pool stores received audio data; when the data length in the audio data pool is larger than a first threshold value configured by the first parameter, controlling the audio data to actively drop frames to shorten the data length, and playing the audio data after frame dropping; otherwise, sending a second instruction to the display equipment. The specific operations and steps of the audio output method of the external audio equipment have been described in detail in the above implementation schemes of the external audio equipment, and are not described herein again.

In some embodiments, when the length of data in the audio data pool is less than or equal to the first threshold configured by the first parameter, sending a second instruction to a display device, specifically includes: and when the length of the data in the audio data pool is less than or equal to the first threshold and is greater than or equal to a second threshold configured by the first parameter, sending a second instruction containing a second parameter to the display device, wherein the second parameter comprises the first threshold and the second threshold which are reduced according to a preset gradient. The specific operations and steps of the audio output method of the external audio equipment have been described in detail in the above implementation schemes of the external audio equipment, and are not described herein again.

In some embodiments, when the length of data in the audio data pool is less than or equal to the first threshold configured by the first parameter, sending a second instruction to a display device, specifically includes: and when the data length in the audio data pool is smaller than the second threshold value, sending a second instruction containing a third parameter to the sound equipment, wherein the third parameter is used for representing that the network connection state is unqualified. The specific operations and steps of the audio output method of the external audio equipment have been described in detail in the above implementation schemes of the external audio equipment, and are not described herein again.

The method has the advantages that the first instruction is constructed, so that the unified configuration of binding the external sound equipment and the audio data pool can be realized; further, the dynamic configuration of the audio data pool can be realized by constructing the first parameter and the second parameter; further, by constructing a second instruction, the audio playing delay feedback can be received; further, by constructing the third parameter, the first prompt message and the second prompt message, the audio playing delay correction reminding can be realized, the audio playing delay of the external sound equipment can be dynamically adjusted according to the network quality between the display equipment and the external sound equipment, and the asynchronous playing among a plurality of external sound equipment is reduced.

Moreover, those skilled in the art will appreciate that aspects of the present application may be illustrated and described in terms of several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereon. Accordingly, various aspects of the present application may be embodied entirely in hardware, entirely in software (including firmware, resident software, micro-code, etc.) or in a combination of hardware and software. The above hardware or software may be referred to as "data blocks", "controllers", "engines", "units", "components", or "systems". Furthermore, aspects of the present application may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.

The computer storage medium may comprise a propagated data signal with the computer program code embodied therewith, for example, on baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, etc., or any suitable combination. A computer storage medium may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code located on a computer storage medium may be propagated over any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or any combination of the preceding.

Computer program code required for the operation of various portions of the present application may be written in any one or more programming languages, including an object oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C + +, C #, VB.NET, Python, and the like, a conventional programming language such as C, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, a dynamic programming language such as Python, Ruby, and Groovy, or other programming languages, and the like. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any network format, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service, such as a software as a service (SaaS).

Additionally, the order in which elements and sequences of the processes described herein are processed, the use of alphanumeric characters, or the use of other designations, is not intended to limit the order of the processes and methods described herein, unless explicitly claimed. While various presently contemplated embodiments of the invention have been discussed in the foregoing disclosure by way of example, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements that are within the spirit and scope of the embodiments herein. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described system on an existing server or mobile device.

Similarly, it should be noted that in the preceding description of embodiments of the application, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the embodiments. This method of disclosure, however, is not intended to require more features than are expressly recited in the claims. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.

The entire contents of each patent, patent application publication, and other material cited in this application, such as articles, books, specifications, publications, documents, and the like, are hereby incorporated by reference into this application. Except where the application is filed in a manner inconsistent or contrary to the present disclosure, and except where the claim is filed in its broadest scope (whether present or later appended to the application) as well. It is noted that the descriptions, definitions and/or use of terms in this application shall control if they are inconsistent or contrary to the statements and/or uses of the present application in the material attached to this application.

Claims

1. A display device, comprising:

a display for displaying a user interface;

a first controller configured to:

sending a first instruction containing a first parameter to an external sound device, wherein the first parameter is used for configuring an audio data pool by the external sound device, and the audio data pool stores received audio data;

after the pairing is successful, the first controller can control the external sound equipment to output audio data; otherwise, controlling the user interface to display first prompt information, and skipping to a pairing setting interface after the first prompt information receives the confirmation operation.

2. The display device of claim 1, wherein upon successful pairing, the first controller is further configured to:

receiving a second instruction which is sent by the external sound equipment and contains a second parameter, wherein the second parameter is used for updating the first parameter used for reducing the audio delay by the first controller;

and sending a first instruction containing the updated first parameter to the paired external sound equipment.

3. The display device of claim 1, wherein upon successful pairing, the first controller is further configured to:

receiving a second instruction which is sent by the external sound equipment and contains a third parameter, wherein the third parameter is used for representing that the network connection state is unqualified;

and controlling the user interface to display second prompt information, wherein the second prompt information jumps to a network setting interface after receiving the confirmation operation.

4. The display device of claim 1, wherein the external audio device comprises a first external audio device, a second external audio device;

after the pairing is successful, the first controller can control the external sound equipment to output audio data, and the method comprises the following steps:

and controlling the first audio data to be forwarded to the first external sound equipment by the router and controlling the second audio data to be forwarded to the second external sound equipment by the router.

5. An external sound equipment, characterized by comprising:

a second controller configured to:

receiving a first instruction which is sent by a display device and contains a first parameter, wherein the first parameter is used for configuring an audio data pool, and the audio data pool stores received audio data;

when the data length in the audio data pool is greater than a first threshold value configured by the first parameter, the second controller controls the audio data to actively drop frames to shorten the data length and plays the audio data after frame dropping; otherwise, sending a second instruction to the display equipment.

6. The audio playback device of claim 5, wherein when the length of data in the audio data pool is less than or equal to the first threshold of the first parameter configuration, the second controller sends a second instruction to the display device, specifically including:

and when the length of the data in the audio data pool is less than or equal to the first threshold and is greater than or equal to a second threshold configured by the first parameter, the second controller sends a second instruction containing a second parameter to the display device, wherein the second parameter comprises the first threshold and the second threshold which are reduced according to a preset gradient.

7. The audio playback device of claim 6, wherein when the length of data in the audio data pool is less than or equal to the first threshold of the first parameter configuration, the second controller sends a second instruction to the display device, specifically including:

and when the data length in the audio data pool is smaller than the second threshold value, the second controller sends a second instruction containing a third parameter to the display equipment, wherein the third parameter is used for representing that the network connection state is unqualified.

8. A method for audio output of an external audio device, the method comprising:

after the pairing is successful, the external sound equipment can be controlled to output audio data; and otherwise, displaying first prompt information, and skipping to a pairing setting interface after the first prompt information receives the confirmation operation.

9. The method for audio output by an external audio device of claim 8, wherein after pairing is successful:

receiving a second instruction containing a second parameter sent by external sound equipment, wherein the second parameter is used for updating the first parameter for reducing the audio delay;

10. A method for audio output of an external audio device, the method comprising:

when the data length in the audio data pool is larger than a first threshold value configured by the first parameter, controlling the audio data to actively drop frames to shorten the data length, and playing the audio data after frame dropping; otherwise, sending a second instruction to the display equipment.