CN117836754A

CN117836754A - Audio control method and display device

Info

Publication number: CN117836754A
Application number: CN202280057202.2A
Authority: CN
Inventors: 郭增杰; 魏建德; 张辉娟
Original assignee: Qingdao Hisense Media Network Technology Co Ltd
Current assignee: Qingdao Hisense Media Network Technology Co Ltd
Priority date: 2021-09-07
Filing date: 2022-04-28
Publication date: 2024-04-05
Also published as: WO2023035630A1

Abstract

The application discloses an audio control method and display equipment, when an audio player starts to play audio data, an audio input channel linked with the audio player is created; displaying a device list, wherein the device list comprises device information of currently available radio devices; when receiving a selected operation on first target radio equipment in the equipment list, establishing a butting relation between the audio input channel and a first audio output channel corresponding to the first target radio equipment to form a first audio transmission channel; and sending the audio data to the first target radio equipment through the first audio transmission channel so as to enable the first target radio equipment to play the received audio data.

Description

Audio control method and display device

Cross Reference to Related Applications

The present application claims priority from the chinese patent application No. 202111074290.0 filed on day 2021, 9 and 14, and 202111041988.2 filed on day 2021, 9 and 7, the entire contents of which are incorporated herein by reference.

Technical Field

The present disclosure relates to the field of display devices, and in particular, to an audio control method and a display device.

Background

The display device can play audio resources through the audio players, and in some scenes, the display device can simultaneously operate a plurality of audio players started by a plurality of users respectively, namely multi-channel audio can be generated, but the display device only supports to output single-channel audio, or the multi-channel audio is output after being mixed, but the power amplifier can finally play mixed audio instead of original audio; or, only one audio is output, and the other audio is stopped from being output and played, so that the same audio resource can be shared in the multi-person scene, namely, only one person in the multi-person scene can hear the audio resource of interest, and the other persons can only passively hear the audio resource.

Disclosure of Invention

The embodiment of the application provides a display device, which comprises: a display for displaying a user interface; the communicator is used for being in communication connection with the radio receiving equipment; a controller for performing: creating an audio input channel linked with an audio player when the audio player starts playing audio data; controlling a display to display a device list, wherein the device list comprises device information of currently available radio devices; when receiving a selected operation on first target radio equipment in the equipment list, establishing a butting relation between the audio input channel and a first audio output channel corresponding to the first target radio equipment to form a first audio transmission channel; and sending the audio data to the first target radio equipment through the first audio transmission channel so that the first target radio equipment plays the received audio data.

The embodiment of the application provides an audio control method, which comprises the following steps: creating an audio input channel linked with an audio player in response to the audio player initiating playing of audio data; displaying a device list, wherein the device list comprises device information of currently available radio devices; establishing a butting relation between the audio input channel and a first audio output channel corresponding to first target radio equipment in the equipment list to form a first audio transmission channel in response to receiving a selected operation on the first target radio equipment in the equipment list; and sending the audio data to the first target radio equipment through the first audio transmission channel so that the first target radio equipment plays the received audio data.

The embodiment of the application also provides a display device, which comprises: at least one audio player for outputting audio signals; a controller, coupled to the at least one audio player, configured to execute instructions to cause the display device to perform: inputting the decoded audio signal to an SOC chip, and starting the function of a first DRC module built in the SOC chip in response to the fact that a currently-started target audio player is an analog power amplifier; matching a target gain value according to a preset association relation between the first DRC module and a volume adjusting module in the target audio player and a target volume input by a user; and controlling the first DRC module to carry out DRC processing on the audio signal according to the target gain value, and sending the processed audio signal to the target audio player so that the target audio player outputs the audio signal matched with the target gain value and the target volume.

Drawings

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

fig. 5 illustrates a schematic diagram of an audio transmission architecture;

FIG. 6 illustrates a UI diagram of a display device displaying a list of devices on a playback interface of an audio player;

FIG. 7 (a) illustrates a window layout of a display device displaying an audio player;

FIG. 7 (b) schematically illustrates a UI diagram of the radio A of FIG. 7 (a) when disconnected;

FIG. 7 (c) schematically illustrates another UI diagram of the radio A of FIG. 7 (a) when disconnected;

FIG. 7 (d) illustrates a UI diagram when the radio A resumes connection;

FIG. 8 illustrates a flow chart of a method of audio playback;

FIG. 9 illustrates a schematic diagram of audio signal processing logic architecture one;

FIG. 10 is a schematic diagram illustrating a second modified audio signal processing logic architecture;

Fig. 11 is a flowchart exemplarily showing an audio signal output control method.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet, computer, notebook, AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. For example, software steps executed by the server may migrate to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode according to a standard codec protocol of an input signal, and at least one of noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5APPs; native applications (Native APPs);

The application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

The above embodiments introduce the content of the hardware/software architecture, the functional implementation, etc. of the display device. In some embodiments, the display device may be connected to a sound receiving device, in addition to a speaker built in the display device or an external power amplifier connected through HDMI, bluetooth, or the like, that is, the sound receiving device is equivalent to a broadcast source using the display device as an audio signal, and after receiving the audio signal, the sound receiving device plays the audio signal by using a hardware resource related to the sound receiving device, so as to facilitate the user to listen to the audio signal. The radio equipment refers to equipment with the capability of receiving and playing audio data, and the radio equipment comprises, but is not limited to, a radio, a smart phone, a tablet personal computer, an earphone and the like.

In some embodiments, the display device and the radio receiving device may be both connected to a wireless network, for example, after the radio receiving device and the display device access the same wifi network, the display device and the radio receiving device may establish an effective communication connection, so that the display device end sends audio data to the radio receiving device through the network.

In some embodiments, the audio data may originate from a storage medium, for example, a local disk of the display device accessed by a user, or a mobile storage device connected through a USB interface, where the mobile storage device includes, but is not limited to, a USB disk, a mobile hard disk, a card reader, etc., and opens an audio file, then a default media player (which may implement an audio player function) of the display device may be started, or data of a music player to play the audio file may be temporarily created; or, the display device may be provided with an application for listening to audio, for example, an audio stream qAPP such as KG music and XMLY, that is, audio data is derived from audio resources provided by such an application platform, and after the user clicks and plays the audio resources of interest in the APP page, the display device may use an audio player function provided by the application to complete playing of the audio resources.

In some embodiments, the audio player may read an audio file stored in the storage medium, or obtain an audio resource within the application, and then decode the original data of the audio file or the audio resource to obtain audio data.

In some embodiments, the audio player may also play controls for audio including, but not limited to, volume, speed, sound effects, play progress (e.g., pause, seek, forward, reverse), song switching, play mode (single-song-loop, random play, sequential play), and the like. In some embodiments of the present application, audio playback information is displayed in an interface of a music player, including but not limited to audio listings, audio names, speaker names, subtitles, audio durations, playback progress bars, pause/play controls, audio switch controls, background images, and the like.

The audio player and the radio receiving equipment are different concepts, and the audio player is a software program for playing audio and is similar to an application; the radio equipment is entity hardware for receiving and playing the audio data broadcasted by the display equipment, which is equivalent to a receiver and a loudspeaker. Through the interactive operation of the user on the audio player, the display device can generate a control instruction which accords with the operation intention of the user and send the control instruction to the radio receiving device so as to enable the radio receiving device to adjust the played audio.

Conventional audio output channels of a display device include, but are not limited to, speakers (Speaker), ARC (Audio Return Channel, audio feedback channel), bluetooth (Bluetooth) channels, etc., these types of audio output channels cannot be parallel, a user needs to select a channel in an audio output page to output and play audio, that is, different audio players share the same audio output channel, the display device only supports outputting one audio, which results in that a play conflict often exists between multiple audio players, or audio data of multiple audio players are mixed and then output, or only one audio player is allowed to be in a play state at the same time, but no way can meet the requirements of supporting multiple output and each user hearing respective audio in a multiple-person scene.

In some embodiments, referring to fig. 5, the audio output architecture provided includes a player set, an audio channel management service process, and a sound receiving device set, where the player set and the audio channel management service process are both running in a display device, the player set includes M audio players that have been started to play audio data, the sound receiving device set includes N sound receiving devices that are connected to the display device and are currently available, M and N are integers, and the M value and the N value may be equal or unequal. Wherein the collection of sound receiving devices is a collection of end (i.e., player end) entity devices, and the collection of players is a collection of front-end audio players. The display equipment and the radio equipment set are in the same local area network, the audio channel management service process is started together with the startup of the display equipment, the player set and the audio channel management service process belong to inter-process communication, and the audio channel management service process and the radio equipment set belong to inter-equipment communication in the same local area network.

In some embodiments, the player set includes M audio players that have been started to play audio data, and the display device may create and simultaneously display M windows, where each window corresponds to a user interface for displaying one audio player. For example, if m=1, then the single window is displayed full screen; if m=2, two windows are arranged side by side or side by side; for another example, if m=4, four windows may be arranged in a matrix of 2×2, and the setting of the preset layout is not particularly limited. When the player set is newly added or subtracted, that is, the M value is changed, the display device end can adaptively match and adjust the window layout according to the M value.

In some embodiments, the audio channel management service process may include an audio channel management module and a radio device management module, and by matching the two modules, the audio input/output channels are docked, so as to build an audio transmission channel corresponding to each audio player.

In some embodiments, the audio channel management module may create a corresponding audio input channel for each audio player in the set of players by means such as presets or dynamic creation. The audio channel management module is also used for managing audio data input channels, for example, each audio player is newly added in the player set, the audio channel management module can additionally establish a corresponding audio input channel, and the establishment of the audio input channel is not influenced by audio output and a radio equipment end; each time one audio player is reduced in the player set, the audio channel management module deletes the corresponding audio input channel, so that the audio player and the audio input channel keep a one-to-one relationship.

In some embodiments, communication between the audio player and the audio channel management module may be in the form of domain socket (domain-by-domain socket).

In some embodiments, the radio device management module may create a corresponding audio output channel for each radio device in the radio device set that accesses the same lan, by means such as presetting or dynamic creation, where the radio device and the audio output channel maintain a one-to-one relationship.

In some embodiments, a device discovery port and an output channel port may be pre-agreed between the display device and the radio device, the device discovery port may employ UDP (User Datagram Protocol ), and the output channel port may employ TCP (Transmission Control Protocol ). When the radio equipment is started, broadcasting equipment information of the radio equipment to an equipment discovery port, wherein the equipment information is not limited to the information required by equipment ID, version number, MAC address and the like; when the device discovery port acquires the device information of the radio receiving device, namely monitors that a new radio receiving device is accessed into a network where the display device is located, then sends a connection request to the radio receiving device, wherein the connection request carries related information of the display device for establishing an audio output channel, including but not limited to an IP address, an output channel port number, a version number and the like; after receiving the connection request, the radio equipment establishes socket connection with the radio equipment management module according to the information carried in the request, the socket connection is equivalent to an audio output channel, and when receiving a connection success message fed back by the radio equipment, the display equipment can acquire that the audio output channel is successfully created and record that the audio output channel takes effect.

In some embodiments, reconnection after disconnection of the existing socket connection is supported, that is, the radio equipment re-broadcasts equipment information to the equipment discovery port, and then the radio equipment management module re-sends a connection request, so that a new socket connection is established, that is, the connection is equivalent to an audio output channel with the radio equipment mapping adjusted.

In some embodiments, the audio channel management service process may further create and maintain a device list, where the device list includes device information of currently available radio receiving devices, where the currently available radio receiving devices are radio receiving devices that have been connected to a network where the display device is located and have successfully established socket connection with the radio receiving device management module, and when the display device receives a connection success message fed back by the radio receiving device, the device information of the radio receiving device is newly added in the device list, so that synchronous update of the device list along with the radio receiving device set is achieved. The display device can know which radio devices can play audio data currently by querying the device list.

In some embodiments, after the socket connection is successful, the device information of a piece of radio receiving device is newly added in the device list, and in other scenarios, the radio receiving device may exit the radio receiving device set, for example, the user shuts down the radio receiving device, or the radio receiving device disconnects from the network, so that the radio receiving device is unavailable due to the failure to normally receive the audio data.

In some embodiments, it may be determined whether the radio receiving device is available, for example, through a heartbeat detection mechanism. In some embodiments of the present application, the display device periodically sends a heartbeat packet to the radio receiving device, and if a response message of the radio receiving device can be received within a timeout period, the display device considers that the radio receiving device is available; if the heartbeat response of the radio equipment is overtime, which indicates that the radio equipment may have the abnormality of shutdown, power failure, network failure and the like, the display equipment considers that the radio equipment is not available, and the equipment information of the radio equipment is deleted from the equipment list. And by monitoring the new addition or deletion of the equipment in the radio equipment set, the equipment list is synchronously updated, so that the instantaneity and the accuracy of the equipment list are ensured.

In some embodiments, one audio input channel can be in butt joint with a plurality of audio output channels, so that synchronous playing of certain audio data in a plurality of radio terminals is realized; likewise, a plurality of audio input channels can be also connected with the same audio output channel in a butt joint manner, so that the effect of outputting the mixed audio data of multiple channels is realized; of course, the audio input and output channels can also be in one-to-one butt joint, so that each audio data is distributed to independent radio equipment. By flexibly butting the audio input channels and the audio output channels, diversified audio transmission channels can be built, and audio data can be sent to corresponding radio equipment through the audio transmission channels. The method also supports the establishment of butt joint or disconnection of the butt joint of the audio input and output channels at any time, so that the audio transmission channel is adjusted and transformed to adapt to the listening requirements in different application scenes.

Only the audio input and output channels reach the butting relation, when an effective audio transmission channel is formed, the user can actually hear the audio data transmitted by the audio transmission channel, but the function of the audio player end is not affected if the audio input and output channels are not in butting, namely, the user can still normally operate the audio player, and only the sound of the audio data played by the audio player cannot be heard. And the audio input channel is in butt joint with the target audio output channel, sound is produced by the sound receiving equipment corresponding to the target audio output channel, and other sound receiving equipment in the sound receiving equipment set is not affected by the sound receiving equipment.

In some embodiments, the interface layout between the audio input and output channels may be determined by the user in a UI interrogation manner at the display device end. After the audio player is started, an audio input channel is created for the audio player, a device list is displayed on a display interface, referring to the example of fig. 6, the display prompts a user to select a radio receiving device used for playing the audio data from the device list, and meanwhile, the device list, a confirmation control, a cancel control and other information such as the device name/ID of the currently available radio receiving device can be displayed in the device list, so that the user can quickly identify the radio receiving device, each radio receiving device option is provided with a corresponding selection control, and when the selection control is triggered, the corresponding radio receiving device is recorded to be selected. In some embodiments of the present application, a full selection control may also be set and displayed, so that a user can quickly select all the radio devices in the device list by one key, thereby facilitating the operation of the user.

In some embodiments, a user may select one or more audio receiving devices from the device list as an end power amplifier for receiving and playing audio data, for convenience of distinction, designate the audio receiving device designated by the user for the first time as a first target audio receiving device, where the number of the first target audio receiving devices does not exceed the upper limit of the device list, and then click a confirmation control, that is, confirm the user's own option, establish a docking relationship between the audio input channel and the first audio output channel corresponding to the first target audio receiving device, so as to establish an audio transmission path.

Taking fig. 5 as an example, the player set includes 5 audio players, namely an audio player 1, an audio player 2, an audio player 3, an audio player 4 and an audio player 5; the sound receiving equipment set comprises 4 sound receiving equipment, namely sound receiving equipment 1, sound receiving equipment 2, sound receiving equipment 3 and sound receiving equipment 4. An audio channel management service process is linked between the two sets.

Referring to the example of fig. 5, where the audio player 3 starts playing audio data 3, the display device creates an audio input channel 3 corresponding to the audio player 3, the user selects playing audio data 3 by the radio device 2 in the device list, the radio device 2 corresponds to the audio output channel 2, and then the display device establishes a one-to-one butting relationship between the audio input channel 3 and the audio output channel 2, thereby setting up an audio transmission path as the audio player 3→the audio input channel 3→the audio output channel 2→the radio device 2, so that the audio data 3 is finally sent to the radio device 2 through the path, and the audio data 3 is played by the radio device 2.

Referring to the example of fig. 5, in which the audio player 4 plays the audio data 4, the display device creates the audio input channel 4 corresponding to the audio player 4, the user selects the audio data 4 to be played simultaneously by the sound receiving device 3 and the sound receiving device 4 in the device list, the sound receiving device 3 corresponds to the audio output channel 3, the sound receiving device 4 corresponds to the audio output channel 4, a docking relationship between the audio input channel 4 and the audio output channel 3 and the audio output channel 4 respectively is established, and the docking relationship is one-to-many, so that two audio transmission paths are established, namely, the audio player 4→the audio input channel 4→the audio output channel 3→the sound receiving device 3, and the audio player 4→the audio input channel 4→the audio output channel 4→the sound receiving device 4, so that the audio data 4 is played synchronously by the sound receiving device 3 and the sound receiving device 4.

In some embodiments, referring to the example of fig. 6, the user may also click the cancel control directly, or the user may click the confirm control without selecting the audio receiving device from the list of devices (i.e., the null selection), both of which result in zero number of first target audio receiving devices, the audio data need not be transmitted to any audio receiving device, and the audio input channels of the audio data do not have a docking relationship, so the audio input channels may discard the received audio data directly.

In some embodiments, after the list of devices is displayed, the user may not perform any operation for a long time, neither select the radio receiving device and trigger the confirmation control, nor trigger the cancel control, i.e. there is a timeout without a response, so that a timeout may be set, and when the list of devices is displayed, a timer is started, and if the timer reaches the timeout, the display device does not always receive the user's operation of selecting any radio receiving device in the list of devices, it is determined that the user does not designate the first target radio receiving device, and the audio input channel of the audio data does not have a docked audio output channel, so that the audio input channel may directly discard the received audio data.

In some embodiments, before the display device displays the device list, detecting whether the device list is an empty list, and if the device list is a non-empty list, controlling the display to display the device list; otherwise, if the device list is an empty list, that is, the sound receiving device set is an empty set, and before the description, no sound receiving device available for playing audio data is shown, the display does not display the device list, but prompts the user that no sound receiving device is available currently, and the audio input channel directly discards the received audio data, so that the audio data is not transmitted and played.

Referring to the example of fig. 5, where the audio player 5 plays the audio data 5, the display device creates an audio input channel 5 corresponding to the audio player 5, and if it is detected that the user's selection operation on any one of the audio receiving devices in the device list is not received within the timeout period, or the device list is an empty list, and the first target audio receiving device is zero, the processing manner of the display device is that the audio player 5→the audio input channel 5 discards the audio data 5.

In some embodiments, the multiple audio input channels may establish a docking relationship with the same target audio output channel, that is, belong to a many-to-one docking relationship, but one audio output channel only supports outputting a single channel of audio, so that several channels of audio data transmitted in the multiple audio input channels may be first subjected to audio mixing processing to obtain mixed audio data, and then the mixed audio data is transmitted to the target audio output channel, and further the mixed audio data is transmitted to the radio equipment corresponding to the target audio output channel.

Referring to the example of fig. 5, in creating an audio output channel, the sound reception device management module may set the mixing module in synchronization with a previous link of the audio output channel. For example, the audio player 1 plays the audio data 1, the audio player 2 plays the audio data 2, the display device creates the audio input channel 1 corresponding to the audio player 1, and creates the audio input channel 2 corresponding to the audio player 2, the user designates that the audio player 1 plays the audio data 1 and the audio data 2, the audio player 1 corresponds to the audio output channel 1, and then the docking relationship between the audio input channel 1 and the audio input channel 2 and the audio output channel 1 respectively is established, which belongs to the many-to-one docking relationship; the audio input channel 1 firstly transmits the audio data 1 to the audio mixing module, meanwhile, the audio input channel 2 firstly transmits the audio data 2 to the audio mixing module, the audio mixing module carries out audio mixing processing on the audio data 1 and the audio data 2 to obtain audio mixing data, and then the audio mixing data are transmitted to the audio output channel 1, namely, the built audio transmission path is as follows: audio player 1/audio player 2→audio input channel 1/audio input channel 2→mixing module→audio output channel 1→sound receiving device 1, thereby playing the mixed data of audio data 1 and audio data 2 by the sound receiving device 1. Therefore, in the front end link of the audio mixing module, the audio data 1 and the audio data 2 are independently transmitted, and after being processed by the audio mixing module, the two paths of audio data are mixed into one path and share the same audio output channel 1.

Referring to the example of fig. 5, for the one-to-one or one-to-many butt joint relationship, there is no problem that multiple paths of audios share the same audio output channel, that is, only one path of audio data is input to the audio mixing module, taking the audio data 3 in fig. 5 as an example, the audio input channel 3 transmits the audio data 3 to the audio mixing module, the audio mixing module detects that only one path of audio data 3 is input, no audio mixing process is performed, and the audio data 3 is directly transmitted to the audio output channel 2.

In some embodiments, referring to the example of fig. 5, the audio channel management module may further include a control submodule based on a domain socket service, where the control submodule is configured to implement communication interaction between the audio player and the audio channel management service process, for example, the control submodule is configured to receive a play control instruction sent by the audio player, a command to dock or switch a radio device, a command to obtain a device list, and a command to obtain a request from the device list, and send a device list, a message notification, and so on to the audio player.

In some embodiments, taking the audio player 4 in fig. 5 as an example, after the audio player 4 is started, a first message carrying the own player ID is sent to the control submodule, and the control submodule receives the first message, so that it can be known that the audio player 4 has joined in the player set, and then an audio input channel 4 corresponding to the audio player 4 is newly built; the audio player 4 sends a device list acquisition request to the control submodule, and the control submodule responds to the device list acquisition request to call a current device list in the audio channel management service process and sends the device list to the audio player 4; after receiving the device list, the audio player 4 displays the device list on an upper layer UI of an interface, generates and sends a docking control instruction to the control submodule according to the operation of a user on the device list, wherein the docking control instruction can carry the device information of the radio receiving device 3 and the radio receiving device 4; the control sub-module receives the docking control instruction, analyzes and learns that the user selects the audio receiving equipment 3 and the audio receiving equipment 4 to play the audio data 4, and the process establishes the docking relation between the audio input channel 4 and the audio output channel 3 and the audio output channel 4 respectively.

In some embodiments, the audio player, after sending the device list acquisition request to the control submodule, the control submodule may query the process as to whether the device list is an empty list. And if the device list is a non-empty list, transmitting the device list to the audio player. If the device list is an empty list, the control sub-module can send a message that no device is available to the audio player; when the audio player receives the unavailable equipment information, the audio player can know that the equipment list is an empty list, and the equipment list is not displayed, so that the user is prompted that no available radio equipment is currently available.

In some embodiments, referring to the example of fig. 6, in some embodiments of the present application, a switch control is provided on the audio player interface, where the switch control is used to support a user to switch the radio device at any time according to usage intent during the audio player playing the audio resource. It should be noted that, the operation of the user to switch the radio receiving device is not limited to triggering the switch control, and may be, for example, a voice input switch device instruction, or through a preset shortcut operation (for example, clicking an associated key specified on the remote controller when displaying the audio player interface), or the like.

In some embodiments, taking the audio player 3 in fig. 5 as an example, when the audio player 3 receives an operation instruction of switching devices of a user, considering that an update (new or pruned device) may occur in a device list, sending a device list obtaining request to the control submodule again, and when receiving a current latest device list sent by the control submodule, displaying the device list, where the user selects to which one or more of the radio receiving devices need to be switched from the latest device list, for example, the user selects to switch to the newly added radio receiving device 5, that is, designates the radio receiving device 5 as a second target radio receiving device to be switched (in order to distinguish from the first target radio receiving device, the application names the radio receiving device after being switched as the second target radio receiving device), then the audio player 3 generates and sends a switching control instruction to the control submodule, where the switching control instruction may carry device information of the id+the radio receiving device 5 of the audio player 3; when the control submodule receives and analyzes the switching control instruction, the process breaks the butt joint relation originally constructed by the audio player 3, namely breaks the butt joint of the audio input channel 3 and the audio output channel 2, and establishes the butt joint relation of the audio input channel 3 and the audio output channel 5 corresponding to the audio receiving device 5, thereby cutting off the old audio transmission channel of the audio data 3, constructing a new audio transmission channel, and realizing that the playing end of the audio data 3 is switched from the audio receiving device 3 to the audio receiving device 5.

In some embodiments, if a user closes a certain audio player, i.e. the audio player exits the player set, the audio transmission path set up for the audio player does not have to be maintained, thereby releasing a part of the process resources.

In some embodiments, taking the audio player 1 in fig. 5 as an example, if a close instruction to the audio player 1 is received, the audio player 1 sends a disconnection control instruction carrying an ID of the audio player 1 to the control submodule; after receiving the disconnection control instruction, the control submodule disconnects all the butting relations to which the audio input channel 1 belongs, in the example of fig. 5, the process disconnects the butting of the audio input channel 1 and the audio output channel 1, deletes the audio input channel 1, and at the moment, the audio output channel 1 is converted into the butting of the audio input channel 2 only, that is, the audio receiving device 1 does not play the audio data 1 and the audio data 2 any more, but switches to play the audio data 2 only.

In some embodiments, referring to the example of fig. 6, the play status of each available sound receiving device may be further noted in the device list, for example, the play status of the sound receiving device 1 is "mix play", the play status of the sound receiving device 2 is "on play", the "on play" indicates that the sound receiving device is currently playing one path of audio data (not mix), and the play status of the sound receiving device 3 and the sound receiving device 4 is "not play", where the "not play" indicates that the sound receiving device is not currently playing any audio data. By marking the play status of each sound receiving device in the device list, a reference factor for docking/switching the sound receiving device can be provided for the user, for example, the user may prefer to select the sound receiving device in the "un-played" state, and avoid selecting the sound receiving device in the "mixed play" state.

In some embodiments, the playing state of each available sound receiving device is recorded and managed by the audio channel management service process according to the docking layout, and referring to the example of fig. 5, the audio output channel 1 is docked to the audio input channel 1 and the audio input channel 2 at the same time, so that the sound receiving device 1 is necessarily in a "mixed playing" state, and for example, the audio output channel 2 is docked to the audio input channel 3 only, so that the sound receiving device 2 is in an "on-play" state. After requesting to acquire the device list from the control submodule, the audio player includes device information and current playing state of the radio device in the device list fed back by the control submodule.

For a certain path of audio data, a user selects a sound receiving device to be docked or switched from the device list, and if the sound receiving device has the problems of power failure, shutdown or abnormal network connection and the like in the process of playing the path of audio data, the sound receiving device is unavailable due to the disconnection of the network connection and cannot receive and play the audio data sent by the display device.

In some embodiments, for example, a heartbeat detection manner may be adopted to monitor the connection state of the sound receiving device a, and if the connection of the sound receiving device a to the network is detected to be disconnected, the device information and the play state of the sound receiving device a are deleted in the device list, so that the display device end cannot be docked/switched to the sound receiving device a through the device list. For the audio output channel a correspondingly constructed for the audio receiving device a, in some embodiments of the present application, the audio output channel a is directly deleted by the audio receiving device management module, so that the docking relationship of the audio output channel a in the process is also all relieved, and thus, under the condition that the audio receiving device a works abnormally, each audio transmission channel leading to the audio receiving device a is cut off, and the audio data originally played by the audio receiving device a can be discarded by the corresponding audio input channel.

In some embodiments, referring to the UI example of fig. 7 (a), assuming that the display device has currently started two audio players, audio player a and audio player B, respectively, the windows of the two audio players are arranged in a same row, in some embodiments of the present application, the currently docked sound receiving device name is displayed at a designated location in each window, for example, the upper left corner of the window of audio player a in fig. 7 (a) shows "sound receiving device a is playing", and audio player B has not docked any sound receiving device, then no sound receiving device name is displayed.

In some embodiments, after deleting the device information and the playing state of the radio device a in the device list and deleting the audio output channel a, the control sub-module may send a device disconnection message to the audio player a, and when the audio player a receives the device disconnection message, referring to the example of fig. 7 (b), in the window of the audio player a, the user may be prompted to check that the radio device a is currently unavailable, and please check that the radio device a is currently unavailable, while the upper left corner of the window of the audio player a cancels the display of "the radio device a is playing". After the user checks the prompt information in the window, the user can know that the radio equipment A is abnormal, can conduct fault investigation on the radio equipment A, and reestablishes socket connection with the terminal equipment.

In some embodiments, when the audio player a receives the device off-line message, referring to the example of fig. 7 (c), the user is prompted in the window of the audio player a, for example in the form of a first prompt pop, that the audio reception device a is not currently available, and asked if the user switches to playing audio data a by other available audio reception devices. Fig. 7 (c) further includes a cancel control and a switch control in the first prompt pop, where if the cancel control in the first prompt pop is triggered by the user, the first prompt pop may be closed, the audio player a does not switch the docking object, the audio data a is discarded by the audio input channel a, and the audio data a is not played; if the user triggers the switching control in the first prompt popup, the first prompt popup can be closed, the audio player A requests to the control submodule to acquire the latest equipment list again, and the equipment list is displayed in the window of the audio player A, so that the user selects a docking object to be switched to from the equipment list, namely, other available radio equipment plays the audio data A.

In some embodiments, after the radio equipment a is disconnected, the user may troubleshoot the radio equipment a and resume the socket connection with the display device, that is, reconstruct and trigger the audio output channel a to take effect, so that the audio channel management service process may increase the equipment information of the radio equipment a in the equipment list when the socket connection is detected to be successful, and the play state of the radio equipment a is recorded as "not played" in the equipment list because the radio equipment a is not yet docked with any audio player after being reconnected.

In some embodiments, since the radio device a is mapped to the audio player a before disconnection, after the radio device a is successfully reconnected, the control sub-module may send a device regression message to the audio player a, where the device regression message is used to indicate that the radio device a has been reconnected and is available; when the audio player a receives the device return message, referring to the example of fig. 7 (d), for example, in the form of a second prompt pop-up window, the user is prompted in the window of the audio player a that the audio receiving device a has been restored to be available, and is asked whether to switch back to playing the audio data a by the audio receiving device a, i.e. is equivalent to asking the user whether to restore the audio receiving device a to the docking and playing state before disconnection. The second prompt popup illustrated in fig. 7 (d) further includes a cancel control and a confirm control, and if the cancel control in the second prompt popup is triggered by the user, the second prompt popup may be closed, the audio player a maintains the current playing status, the audio input channel a is not in butt joint with the audio output channel a, and the radio device a does not receive and play the audio data a; if the user triggers the confirmation control in the second prompt popup window, the second prompt popup window can be closed, and the audio channel management service process establishes a butting relation between the audio input channel A and the audio output channel A, so that an audio transmission path from the audio player A to the radio equipment A is established, and after the radio equipment A is disconnected and reconnected, the audio data A is restored to be continuously received and played by the radio equipment A.

It should be noted that, according to various factors such as an actual audio playing scene, availability of radio equipment, listening requirements of users, and the like, on the basis of the audio transmission architecture illustrated in fig. 5, the audio transmission method in the operation scene of the multi-channel audio player can be flexibly modified, improved and expanded to obtain more diversified and feasible UI and program schemes, which are not limited to the embodiments provided in the specification of the present application. In addition, the UI provided in the present application is only schematic for describing the solution, and does not represent the actual product design, and the interaction, operation flow and display effect of the UI should be based on the actual application and design.

The foregoing embodiments describe transmission and playing schemes of audio data in a multi-channel audio player operating scene from the perspective of an underlying architecture. In other embodiments, fig. 8 provides an audio playing method, from the perspective of a controller of a display device, describing output and playing control of audio data, where the controller is configured to execute a method at least including the following program steps:

in step S01, when the audio player starts playing audio data, an audio input channel linked with the audio player is created.

Step S02, displaying a device list, where the device list includes device information of currently available radio receiving devices.

Step S03, when receiving the selection operation of the first target radio equipment in the equipment list, establishing a butting relation between the audio input channel and a first audio output channel corresponding to the first target radio equipment to form a first audio transmission channel.

Step S04, sending the audio data to the first target radio receiving device through the first audio transmission channel, so that the first target radio receiving device plays the received audio data.

Through the steps S01-S04, each audio player can be allocated with a designated sound receiving device, and through setting up a butt joint channel for audio input and output between the audio player and the sound receiving device, audio data can be smoothly transmitted into the sound receiving device, so that the audio data are converted into sound by the sound receiving device to be played.

In some embodiments of the present application, the method further comprises: disconnecting the butting relation between the audio input channel and the first audio output channel when an operation instruction of switching equipment of a user is received; establishing a butting relation between the audio input channel and a second audio output channel corresponding to the second target radio equipment according to the second target radio equipment to which the operation instruction is switched, and forming a second audio transmission channel; and sending the audio data to the second target radio equipment through the second audio transmission channel so as to enable the second target radio equipment to play the received audio data. The embodiment further enables switching of the radio receiving device linked to the audio player according to a change in user demand for the listening device.

In some embodiments of the present application, the method further comprises: acquiring equipment information of radio equipment when the radio equipment is accessed to a network where the display equipment is located; constructing an audio output channel corresponding to the sound receiving equipment, and sending a connection request carrying audio output channel information to the sound receiving equipment; and when receiving a connection success message fed back by the radio receiving equipment, recording that the audio output channel is effective, and adding equipment information of the radio receiving equipment into the equipment list. The embodiment further provides a scheme of connecting the radio receiving equipment with the display equipment, constructing an audio output channel, and synchronously updating and managing the equipment list when the new radio receiving equipment is accessed, so as to ensure that the equipment list displayed to the user at the display equipment end is updated and accurate in real time.

In some embodiments of the present application, the method further comprises: if the equipment list is detected to be an empty list, the equipment list is not displayed, and a display is controlled to display information for prompting that no available radio equipment is currently available; and controlling the audio input channel to discard the audio data. The embodiment further determines whether the display device end needs to display the device list according to whether the device list is empty, and if no radio device is available, the audio input channel directly discards the audio data, and the audio data cannot be played in a sounding manner.

In some embodiments of the present application, after starting the bluetooth scanning function, the method further comprises: after the equipment list is displayed, if the selected operation of any radio equipment in the equipment list is not received within the timeout time, the audio input channel is controlled to discard the audio data. If the condition that the radio receiving equipment is not selected after the timeout exists, the audio player does not have the mapped radio receiving equipment, the audio input channel has no butt-joint audio output channel, and the audio input channel directly discards the audio data.

In some embodiments of the present application, the method further comprises: and when a closing instruction of the audio player is received, disconnecting the established butting relation between the audio input channel and one or more audio output channels, and deleting the audio input channels. The embodiment further provides that when the audio player is turned off and the playing of the audio data is exited, all the butting relations of the audio input channels linked by the audio player are released, and the audio input channels are deleted together, so that all the audio transmission channels of the audio data are canceled, and the audio data is stopped from being transmitted and played.

In some embodiments of the present application, the method further comprises: when a plurality of audio input channels and the same target audio output channel are in butt joint, audio data transmitted in the plurality of audio input channels are subjected to audio mixing processing to obtain audio mixing data; and transmitting the mixed sound data to the target audio output channel, and further transmitting the mixed sound data to radio equipment corresponding to the target audio output channel. The embodiment further provides that when the many-to-one butting relationship exists, multiple paths of audio data are required to be mixed into one stream and then output and played.

In some embodiments of the present application, the method further comprises: deleting the device information of the first/second target radio receiving device in the device list when the first/second target radio receiving device is detected to be disconnected from the network; deleting the first/second audio output channels and controlling the audio input channels to discard the audio data; prompting a user via a display that the first/second target audio reception device is not currently available and asking the user if to switch to playing the audio data by other available audio reception devices. The embodiment further provides that if the audio receiving device suddenly breaks the network when playing the audio data, the device list is synchronously updated, all audio transmission channels to the audio receiving device are cut off, the user is prompted by the UI at the display device end that the audio receiving device is not available, the user can choose not to continue to listen to the audio data played by the audio receiving device, or other available audio receiving devices can be switched to play the audio data.

In some embodiments of the present application, the method further comprises: when the first/second target radio equipment is detected to be accessed to the network again after the network is disconnected, acquiring equipment information of the first/second target radio equipment again; transmitting a reconnection request carrying the information of the first/second audio output channel to the first/second target radio equipment according to the reconstructed first/second audio output channel; triggering the first/second audio output channel to take effect when receiving a connection success message fed back by the first/second target radio equipment, and adding equipment information of the first/second target radio equipment into the equipment list; prompting a user via a display that the first/second target sound receiving device is currently available and asking the user whether to switch back to playing the audio data by the first/second target sound receiving device. The embodiment further provides that after the radio reception device is disconnected from the network and reconnected, the audio output channel is reconstructed, the device list is synchronously updated, and the radio reception device which is unavailable before the UI prompt of the device end is displayed is available, so that the user can select to keep the current playing state, or the available radio reception device can be restored to play the audio data continuously.

Specific implementation details and technical effects of the controller execution method can be referred to and verified with the scheme based on the audio transmission architecture and the UI example, so that the description is omitted. Through the audio transmission architecture provided by the application, the audio playing capability of the display device is expanded, multipath audio synchronous playing can be realized, each path of audio data can be distributed to one or more designated radio devices according to the listening demands of different users, each user can listen to respective audio according to the listening demands of the users in a multi-user scene, and user experience is improved.

In some embodiments, fig. 9 illustrates architecture one of audio signal processing logic, including but not limited to an audio decoder, an SOC chip, and at least one connected and available audio player (i.e., audio player 1-audio player n), which may be a speaker built in a display device or a power amplifier device connected through a designated interface, such as a sound box, an earphone, etc., wherein interfaces for connecting audio signal output channels are, for example, AMP, HP, and SPDIF interfaces, or HDMI interfaces, etc. After being decoded by an audio decoder, the audio data is converted into an audio signal in a PCM (Pulse Code Modulation ) format and is input into an SOC chip; the SOC chip inquires a currently-started target audio player and outputs an audio signal to the target audio player, and the target audio player outputs and plays the audio signal through a channel of the target audio player.

In some embodiments, each audio output channel may be independently controlled, including volume control, sound effect control, silence mode on-off control, DRC control, and the like.

In some embodiments, the SOC chip supports DRC functions, and for convenience of distinction, the SOC chip may be provided with DRC modules, named as first DRC modules, and is configured to implement DRC functions of the SOC chip, i.e., adjust signal gain according to the intensity/amplitude of the current audio signal, for example, if the intensity/amplitude of the current signal is too large, to avoid failure or even burnout caused by long-time high-power operation of the audio player, the intensity/amplitude of the audio signal may be compressed, so that the audio signal exhibits a certain attenuation; if the current signal strength/amplitude is too small, the DRC function can reduce the attenuation amplitude of the audio signal or not, so as to realize the dynamic range control of the audio signal. DRCs can attenuate or at most not attenuate an audio signal, but do not reverse enhance the audio signal.

In some embodiments, each audio player includes a volume adjustment module, where the volume adjustment module is configured to obtain a volume gain according to a target volume input by a user, and further adjust an output volume of the audio player to the target volume to implement volume control.

In some embodiments, each audio player has a respective power amplifier type, such as an analog type power amplifier that does not support DRC functionality or a digital type power amplifier that has DRC functionality. The digital power amplifier is also internally provided with a DRC module, which is named as a second DRC module for distinguishing, and configures and realizes the DRC function of the digital power amplifier. The volume adjusting module and the second DRC module are both positioned in an output channel of the digital power amplifier, the second DRC module is positioned at the tail end of the output channel, and after the audio signal traverses other links of the preamble, the end links are used for DRC control, so that the digital power amplifier finally outputs proper audio signals.

In some embodiments, if the audio player is a digital power amplifier, the DRC function of the audio player is preferentially turned on and used, so that the DRC function of the SOC chip is kept in a turned-off state, and at this time, the SOC chip mainly plays a role in receiving the decoded audio signal and transmitting the audio signal to the target audio player; if the audio player is an analog power amplifier, the DRC function is not supported, and the DRC function of the SOC chip is started and used.

In some embodiments, the display device is provided with an Audio Output (Audio Output) page, in which an Audio player that is currently connected and available is displayed, from which a user can select at least one as a target Audio player, and the target Audio player can Output and play an Audio signal after being enabled; or the audio player with the highest current priority can be automatically started to output audio according to the preset priority without the specification of the user. It should be noted that, when the display device has a plurality of available audio players, the manner of selecting the target audio player is not limited to the embodiments described in the present application.

If the target audio player belongs to the analog power amplifier, the function of the first DRC module in the SOC chip needs to be started, and as can be seen from the example of fig. 9, after the first DRC module adjusts the audio signal according to the current volume, the gain link affecting the signal output, which is the volume adjusting module, is further included in the subsequent target audio player, which may cause that the finally output audio signal is inconsistent with the DRC-adjusted audio signal. For example, after the SOC chip performs DRC adjustment and compresses the amplitude of the audio signal, if the user turns down the volume at this time, the audio signal is attenuated secondarily, and the audio signal is attenuated excessively, so that the user cannot hear the audio content, and the user hearing experience is poor.

In view of the above technical problems, in some embodiments, referring to architecture two of the audio signal processing logic provided in fig. 10, mapping association between the first DRC module and the volume adjustment module in the SOC chip is preset, which is equivalent to uniformly binding output control functions of two audio signals, namely DRC and power amplifier of the SOC chip, at a software level (without involving hardware transfer), and no gain link affecting signal output exists after binding, and only the target audio player needs to directly output the audio signal. Through the preset association relation between the first DRC module and the volume adjusting module, the DRC and the volume gain of the SOC chip can be mutually constrained and linked, for example, when a user increases the volume, the SOC chip properly compresses the amplitude of an audio signal through the DRC function; if the user turns down the volume, the SOC chip can reduce the DRC attenuation amplitude of the audio signal, even not attenuate the DRC attenuation amplitude, and realize the complementation of the DRC gain and the volume gain of the SOC chip, thereby protecting the power amplifier equipment, avoiding the damage of the power amplifier equipment caused by overlarge output power/volume, properly increasing the signal amplitude when the volume is lower, improving the output effect of the audio signal and providing better hearing for the user.

In some embodiments, it is assumed that the number of audio players currently connected and available to the display device is n, where there are m audio players being analog type power amplifiers, and n-m audio players being digital type power amplifiers, m being less than or equal to n. The n-m digital power amplifier supports the DRC function, namely the second DRC module is provided, and the function execution of the first DRC module of the SOC chip is not activated when the audio signal is output, so that the preset association relation between the first DRC module and the volume adjusting module in the digital power amplifier is not required to be set; the m analog power amplifiers do not support the DRC function, and the first DRC module of the SOC chip needs to be activated, so that preset association relations between the m analog power amplifiers and the first DRC module are established in advance, and the m preset association relations are obtained.

In some embodiments, if one target audio player is started in the n available audio players, after the audio signals are decoded, the power amplifier type of the target audio player is detected, if the audio signals are digital power amplifiers, the decoded audio signals are transmitted to the target audio player through the SOC chip and are output after being processed by links such as a volume adjusting module and a second DRC module in the target audio player.

If the target is an analog type power amplifier, according to the equipment ID of the target audio player, searching a target preset association relation corresponding to the equipment ID from m preset association relations, and matching a target gain value adopted when the first DRC module performs DRC processing on the audio signal according to the target preset association relation and a target volume input by a user, namely, the target gain value is used for representing DRC gain made on the audio signal for adapting to the target volume, and the attenuation amplitude of the DRC module on the audio signal is represented by gain. After the first DRC module carries out DRC processing on the audio signal according to the matched target gain value, the audio signal is sent to a target audio player, and a volume adjusting module in the target audio player adjusts the audio signal to a target volume, so that the target audio player finally outputs the audio signal matched with the target gain value and the target volume.

In some embodiments, if the user selects a plurality (more than one) of target audio players from n available audio players, for example, selects a sound and an earphone, the power amplifier types of the target audio players are detected respectively, and a signal output mode of each target audio player is determined according to the power amplifier types, and the signal output control of each target audio player is independent.

The DRC and the volume are two processing links in the audio signal output process, when the target audio player is an analog type power amplifier, the two links are in an associated binding and linked relation on the software function level, through the relation, the DRC gain of the SOC chip is matched and restrained according to the volume, but the two links are relatively independent on the actual hardware processing level, the SOC chip carries out DRC processing on the audio signal according to a target gain value, and the target audio player carries out volume adjustment on the audio signal according to the target volume, namely, the parameters and processing logic used by the two links are different, so that the output control of different indexes of the audio signal is realized. The method and the device ensure the safety of the analog power amplifier and improve the output and playing effects of the audio signals through the similar 'opposite unification' relationship between the DRC and the volume, thereby providing better hearing experience for users.

Based on the architecture two shown in fig. 10, fig. 11 shows an audio signal output control method, the execution of which is controlled by the controller 250, the method comprising the following processes:

step S10, after the decoded audio signal is input to the SOC chip, the power amplifier type of the currently-enabled target audio player is detected.

And step S20, judging whether the power amplifier type is an analog power amplifier. If the power amplifier is an analog power amplifier, executing the mode I described in the step S30 to the step S60; if the digital power amplifier is adopted, the mode two described in the step S70 to the step S90 is executed.

Step S30, turning on the function of the first DRC module built in the SOC chip.

Step S40, matching the target gain value according to the preset association relation between the first DRC module and the volume adjusting module in the target audio player and the target volume input by the user.

In step S40, a gain threshold specified by the preset association relationship is obtained, a difference between the gain threshold and the target volume is calculated, and the difference is used as a target gain value, i.e. a target gain value=gain threshold-target volume, so that when the volume is increased (i.e. the target volume is increased) by a user, the target gain value is relatively reduced, i.e. the first DRC module carries out appropriate attenuation on the audio signal, so as to avoid damage caused by overlarge output power of the target audio player; if the user turns down the volume (i.e., the target volume decreases), the target gain value is relatively increased, i.e., the first DRC module decreases the amplitude of attenuation or does not attenuate the audio signal, so as to avoid the audio signal being too small to hear clearly.

According to the embodiment, specific threshold constraint is provided between the DRC gain and the volume gain of the SOC chip, when a preset association relation of each analog power amplifier is created, a gain threshold adapted to the analog power amplifier can be specified in the preset association relation, so that the sum of the volume and the DRC gain is always equal to the gain threshold, and the DRC gain of the SOC chip can be adaptively matched according to the target volume and the gain threshold.

In some embodiments, the gain threshold S is less than or equal to a preset upper gain value S _max The method comprises the steps of carrying out a first treatment on the surface of the Wherein the gain upper limit value=volume _max +DRCgain _max ，volume _max Indicating the maximum output that the target audio player can outputVolume, DRCgain _max The and volume obtained for the first DRC module _max Matching gain values. The embodiment further defines a gain threshold value which is smaller than or equal to the upper gain limit value, for example, in the display device debugging stage, when the audio player outputs the maximum volume, the gain is adapted to volume based on the audio player not being burnt and the audio signal output effect angle _max As DRCgain _max Volume then _max And DRCgain _max The sum is the upper limit value of the gain, and the power amplifier equipment can be ensured to have no burning risk as long as the gain threshold value does not exceed the upper limit value, so that the use safety and the signal output effect of the audio player are both considered.

In some embodiments, the gain upper limit S is obtained _max After that, the gain threshold S may be set, in some embodiments of the present application, s=k×s _max Wherein k is an adjustable coefficient, 0 < k is less than or equal to 1, and the gain threshold S is adjusted by setting the adjustable coefficient k. In other alternatives, the gain threshold s=gain upper limit S may be set by default _max The gain threshold is a fixed value in this setting mode.

In step S50, the first DRC module is controlled to DRC-process the audio signal according to the target gain value, and to transmit the processed audio signal to the target audio player.

Step S60, controlling the target audio player to adjust the audio signal to the target volume, and outputting the audio signal matched with the target gain value and the target volume.

Step S70, turning on the function of the second DRC module built in the target audio player, so that the function of the first DRC module is kept in a turned-off state.

Step S80, the SOC chip is controlled to send the audio signal to the target audio player.

Step S90, the target audio player is controlled to sequentially perform volume and DRC processing on the audio signal, and output the processed audio signal.

In some embodiments, when the number of target audio players is plural, for example, including digital audio and analog headphones, i.e., a multi-amplifier hybrid scene, the analog headphones output audio signals according to mode one, and the digital audio outputs audio signals according to mode two, so as to adaptively match the audio signal output modes according to the type of power amplifier.

The above embodiment is suitable for a scenario where the target audio player outputs sound, if the user switches the target audio player to a mute mode, for the mode one, the operation of the first DRC module is not affected, the volume adjusting module performs mute processing, that is, reduces the output power of the analog power amplifier, when the power of the audio signal output by the analog power amplifier is lower than a certain level, the playing effect of zero volume (silence) is presented, when the user releases the mute mode of the analog power amplifier, according to the target volume input by the user (if the user does not adjust the volume, the current volume is taken), the volume and the signal amplitude when the audio signal is output are adaptively adjusted, and the sound output of the audio signal is recovered.

In some embodiments, if the user switches the mute mode in the second mode, the second DRC module at the end is also not affected, and the volume adjusting module performs the mute processing, so that the power of the audio signal after the mute processing is reduced to be small enough to trigger the second DRC module to compress the audio signal, that is, the second DRC module may not attenuate the audio signal any more, and finally, the playing effect of zero volume (silence) is presented, and after the mute mode is released, the audio output of the digital power amplifier is controlled according to the second mode, so as to restore the audio output of the audio signal.

It should be noted that, according to the actual audio output and playing scene requirement, the actual operation of the user, the type and number of power amplification of the audio player, and other factors, the audio signal processing logic architecture and the specific implementation manner are modified or expanded based on the audio signal output control logic illustrated in the foregoing embodiments, which is not limited to the embodiments of the present application. In addition, the present application mainly describes "DRC signal amplitude" and "volume" in the audio signal output index, and is not particularly limited in other aspects such as sound effects, channels, and the like.

In some embodiments, the present invention further provides a computer readable nonvolatile storage medium, where a program may be stored, where the program may include program steps of the audio transmission and playback method according to the embodiments of the present application when the program is executed. The computer storage medium may be a magnetic disk, an optical disk, a ROM, or a RAM.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

A display device, comprising:

a display for displaying a user interface and an image;

a communicator for communication connection with an external device, the external device comprising one or more sound receiving devices;

a controller, coupled to the display and the communicator, configured to execute instructions to cause the display device to perform:

responding to the audio player of the display device to start audio data playing, and creating an audio input channel linked with the audio player;

controlling the display to display a list of devices, the list of devices including device information of at least one radio receiving device connected to the communicator and currently available;

responding to the receiving of the selected operation of the first target radio equipment in the equipment list, establishing a butting relation between the audio input channel and a first audio output channel corresponding to the first target radio equipment, and forming a first audio transmission channel;

and sending the audio data to the first target radio equipment through the first audio transmission channel so that the first target radio equipment plays the received audio data.
The display device of claim 1, the controller further configured to execute instructions to cause the display device to perform:

Responding to the received operation instruction of switching the radio equipment by a user, and disconnecting the butting relation between the audio input channel and the first audio output channel;

establishing a butting relation between the audio input channel and a second audio output channel corresponding to the second target radio equipment according to the second target radio equipment to which the operation instruction is switched, and forming a second audio transmission channel;

and sending the audio data to the second target radio equipment through the second audio transmission channel so as to enable the second target radio equipment to play the received audio data.
The display device of claim 1 or 2, the controller further configured to execute instructions to cause the display device to perform:

responding to the monitoring of access radio equipment in a network where display equipment is located, and acquiring equipment information of the radio equipment;

constructing an audio output channel corresponding to the sound receiving equipment, and sending a connection request carrying audio output channel information to the sound receiving equipment;

and in response to receiving a connection success message fed back by the radio receiving device, recording that the audio output channel is effective, and adding device information of the radio receiving device in the device list.
The display device of claim 1, the controller further configured to execute instructions to cause the display device to perform:

in response to the detected empty list of the equipment list, not displaying the equipment list, and displaying information for prompting that no radio equipment is currently available;

and controlling the audio input channel to discard the audio data.
The display device of claim 1, the controller further configured to execute instructions to cause the display device to perform:

after the Bluetooth scanning function is started, after the device list is displayed, the audio input channel is controlled to discard the audio data in response to the fact that the selected operation of any radio device in the device list is not received all the time within the timeout period.
The display device of claim 1, the controller further configured to execute instructions to cause the display device to perform:

and in response to receiving a closing instruction to the audio player, disconnecting the established butting relation between the audio input channel and one or more audio output channels, and deleting the audio input channels.
The display device of claim 1 or 2, the controller further configured to execute instructions to cause the display device to perform:

When a butt joint relation is established between a plurality of audio input channels and the same target audio output channel, audio data transmitted in the plurality of audio input channels are subjected to audio mixing processing, and audio mixing data are obtained;

and transmitting the mixed sound data to the target audio output channel, and further transmitting the mixed sound data to radio equipment corresponding to the target audio output channel.
The display device of claim 3, the controller further configured to execute instructions to cause the display device to perform:

deleting device information of the first target radio receiving device in the device list in response to detecting that the first target radio receiving device is disconnected from the network;

deleting the first audio output channel and controlling the audio input channel to discard the audio data;

prompting a user through a display that the first target radio receiving device is not currently available, and asking the user whether to switch to playing the audio data by other available radio receiving devices.
The display device of claim 8, the controller further configured to execute instructions to cause the display device to perform:

responding to the detection that the first target radio equipment is accessed to a network again after the network is disconnected, and acquiring equipment information of the first target radio equipment again;

According to the reconstructed first audio output channel, a reconnection request carrying first audio output channel information is sent to the first target radio equipment;

in response to receiving a connection success message fed back by the first target radio equipment, triggering the first audio output channel to take effect, and adding equipment information of the first target radio equipment into the equipment list;

prompting a user at a display that the first target sound receiving device is currently available and asking the user whether to switch back to playing the audio data by the first target sound receiving device.
An audio control method, comprising:

creating an audio input channel linked with an audio player in response to the audio player initiating playing of audio data;

displaying a device list, wherein the device list comprises device information of currently available radio devices;

establishing a butting relation between the audio input channel and a first audio output channel corresponding to first target radio equipment in the equipment list to form a first audio transmission channel in response to receiving a selected operation on the first target radio equipment in the equipment list;

and sending the audio data to the first target radio equipment through the first audio transmission channel so that the first target radio equipment plays the received audio data.
A display device, comprising:

at least one audio player for outputting audio signals;

a controller for performing:

after the decoded audio signal is input to the SOC chip, responding to the fact that the currently-started target audio player belongs to an analog power amplifier, and starting the function of a first DRC module built in the SOC chip;

matching a target gain value according to a preset association relation between the first DRC module and a volume adjusting module in the target audio player and a target volume input by a user;

and controlling the first DRC module to carry out DRC processing on the audio signal according to the target gain value, and sending the processed audio signal to the target audio player so that the target audio player outputs the audio signal matched with the target gain value and the target volume.
The display device of claim 11, the controller to match the target gain value as follows:

acquiring a gain threshold value designated by the preset association relation;

and calculating a difference value between the gain threshold value and the target volume, and taking the difference value as the target gain value.
The display device according to claim 12, wherein the gain threshold value is less than or equal to a preset gain upper limit value; wherein the gain upper limit value=volume _max +DRCgain _max ，volume _max Indicating the maximum volume that the target audio player can output, DRCgain _max The and volume obtained for the first DRC module _max Matching gain values.
The display device of claim 11, the controller further to perform:

in response to detecting that the target audio player belongs to a digital power amplifier, starting a function of a second DRC module built in the target audio player, and keeping the function of the first DRC module in a closed state; wherein the volume adjustment module and the second DRC module are both located within an output channel of the target audio player, and the second DRC module is located at an end of the output channel;

the SOC chip is controlled to send the audio signal to the target audio player;

and controlling the target audio player to sequentially perform volume and DRC processing on the audio signals and outputting the processed audio signals.
The display device of claim 14, the controller further to perform:

in response to detecting that the number of the target audio players is greater than 1, respectively controlling each target audio player to output an audio signal according to the power amplifier type to which each target audio player belongs; the power amplifier type comprises an analog power amplifier and a digital power amplifier.
An audio control method, comprising:

after the decoded audio signal is input to the SOC chip, responding to the fact that the currently-started target audio player belongs to an analog power amplifier, and starting the function of a first DRC module built in the SOC chip;

matching a target gain value according to a preset association relation between the first DRC module and a volume adjusting module in the target audio player and a target volume input by a user;

and controlling the first DRC module to carry out DRC processing on the audio signal according to the target gain value, and sending the processed audio signal to the target audio player so that the target audio player outputs the audio signal matched with the target gain value and the target volume.
The method of claim 16, the matching a target gain value employed by the first DRC module to process an audio signal comprising:

acquiring a gain threshold value designated by the preset association relation;

and calculating a difference value between the gain threshold value and the target volume, and taking the difference value as the target gain value.
The method of claim 17, the gain threshold being less than or equal to a preset upper gain limit; wherein the gain upper limit value=volume _max +DRCgain _max ，volume _max Indicating the maximum volume that the target audio player can output, DRCgain _max The and volume obtained for the first DRC module _max Matching gain values.
The method of claim 16, the method further comprising:

in response to detecting that the target audio player belongs to a digital power amplifier, starting a function of a second DRC module built in the target audio player, and keeping the function of the first DRC module in a closed state; wherein the volume adjustment module and the second DRC module are both located within an output channel of the target audio player, and the second DRC module is located at an end of the output channel;

the SOC chip is controlled to send the audio signal to the target audio player;

and controlling the target audio player to sequentially perform volume and DRC processing on the audio signals and outputting the processed audio signals.
The method of claim 19, the method further comprising:

in response to detecting that the number of the target audio players is greater than 1, respectively controlling each target audio player to output an audio signal according to the power amplifier type to which each target audio player belongs; the power amplifier type comprises an analog power amplifier and a digital power amplifier.