WO2023035630A1 - 一种音频控制方法及显示设备 - Google Patents

一种音频控制方法及显示设备 Download PDF

Info

Publication number
WO2023035630A1
WO2023035630A1 PCT/CN2022/089923 CN2022089923W WO2023035630A1 WO 2023035630 A1 WO2023035630 A1 WO 2023035630A1 CN 2022089923 W CN2022089923 W CN 2022089923W WO 2023035630 A1 WO2023035630 A1 WO 2023035630A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
target
player
display device
volume
Prior art date
Application number
PCT/CN2022/089923
Other languages
English (en)
French (fr)
Inventor
郭增杰
魏建德
张辉娟
Original Assignee
青岛海信传媒网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202111041988.2A external-priority patent/CN113687811A/zh
Priority claimed from CN202111074290.0A external-priority patent/CN113794928B/zh
Application filed by 青岛海信传媒网络技术有限公司 filed Critical 青岛海信传媒网络技术有限公司
Priority to CN202280057202.2A priority Critical patent/CN117836754A/zh
Publication of WO2023035630A1 publication Critical patent/WO2023035630A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output

Definitions

  • the present application relates to the field of display devices, in particular to an audio control method and a display device.
  • the display device can play audio resources through the audio player.
  • the display device may run multiple audio players started by multiple users at the same time, which may generate multiple channels of audio, but the display device only supports the output of a single channel of audio.
  • the display device may output multiple channels of audio after mixing, but it will cause the power amplifier to finally play the mixed audio instead of the original audio; or, only one of the audio channels is output, and the other channels of audio are stopped and output. This results in that only the same audio resource can be shared in a multi-person scene, that is, only one person in a multi-person scene can hear the audio resource he is interested in, and others can only listen passively.
  • the embodiment of the present application provides a display device, including: a display, used to display a user interface; a communicator, used to communicate with a radio device; a controller, used to execute: when the audio player starts to play audio data, create and The audio input channel that the audio player is linked to; control the display to display the device list, and the device list includes the device information of the currently available radio equipment; after receiving the selection of the first target radio device in the device list During operation, a docking relationship between the audio input channel and the first audio output channel corresponding to the first target radio device is established to form a first audio transmission path; the audio data is sent to all audio channels through the first audio transmission path. The first target sound receiving device, so that the first target sound receiving device plays the received audio data.
  • An embodiment of the present application provides an audio control method, including: creating an audio input channel linked to the audio player in response to the audio player starting to play audio data; displaying a device list, the device list including currently available The device information of the sound receiving device; in response to receiving the selection operation of the first target sound receiving device in the device list, establishing the docking between the audio input channel and the first audio output channel corresponding to the first target sound receiving device relationship, forming a first audio transmission path; sending the audio data to the first target audio receiving device through the first audio transmission path, so that the first target audio receiving device plays the received audio data.
  • the embodiment of the present application also provides a display device, including: at least one audio player for outputting audio signals; a controller connected to the at least one audio player and configured to run instructions so that the display device Execution: input the decoded audio signal to the SOC chip, and respond to the currently enabled target audio player as an analog power amplifier, then open the function of the first DRC module built into the SOC chip; according to the first DRC module and the The preset association relationship of the volume adjustment module in the target audio player, and the target volume input by the user, match the target gain value; control the first DRC module to perform DRC processing on the audio signal according to the target gain value, and process the The final audio signal is sent to the target audio player, so that the target audio player outputs an audio signal matching the target gain value and the target volume.
  • Fig. 1 exemplarily shows a usage scenario of a display device according to some embodiments
  • Fig. 2 exemplarily shows a hardware configuration block diagram of the control device 100 according to some embodiments
  • FIG. 3 exemplarily shows a block diagram of a hardware configuration of a display device 200 according to some embodiments
  • FIG. 4 exemplarily shows a software configuration diagram in a display device 200 according to some embodiments
  • Fig. 5 exemplarily shows a schematic diagram of an audio transmission architecture
  • Fig. 6 exemplarily shows a UI schematic diagram of displaying a device list on a playback interface of an audio player
  • Fig. 7 (a) exemplarily shows a window layout of a display device displaying an audio player
  • Fig. 7(b) exemplarily shows a UI schematic diagram when the radio device A in Fig. 7(a) is disconnected from the network;
  • Fig. 7(c) exemplarily shows another UI schematic diagram when the radio device A in Fig. 7(a) is disconnected from the network;
  • Fig. 7(d) exemplarily shows a schematic diagram of a UI when the radio device A resumes connection
  • Fig. 8 exemplarily shows a flow chart of an audio playback method
  • FIG. 9 exemplarily shows a schematic diagram of an audio signal processing logic architecture 1
  • FIG. 10 exemplarily shows a schematic diagram of an improved audio signal processing logic architecture II
  • Fig. 11 exemplarily shows a flow chart of the audio signal output control method.
  • Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment.
  • the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .
  • control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly.
  • Device 200 The user can control the display device 200 by inputting user instructions through at least one of buttons on the remote control, voice input, and control panel input.
  • the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an AR/VR device, and the like.
  • the smart device 300 can also be used to control the display device 200 .
  • the display device 200 is controlled using an application program running on the smart device.
  • the smart device 300 and the display device may also be used for data communication.
  • the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300.
  • the module for obtaining voice commands configured inside the display device 200 can directly receive the user's voice command control
  • the user's voice command control can also be received through the voice control device provided outside the display device 200 .
  • the display device 200 also performs data communication with the server 400 .
  • the display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the server 400 may be one cluster, or multiple clusters, and may include one or more types of servers.
  • the software steps executed by one step execution body can be migrated to another step execution body for data communication with it for execution as required.
  • the software steps executed by the server can be migrated to be executed on the display device in data communication with it as required, and vice versa.
  • Fig. 2 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
  • the control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
  • the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
  • the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button or an alternative module.
  • FIG. 3 shows a block diagram of a hardware configuration of a display device 200 according to an exemplary embodiment.
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface. at least one.
  • the controller includes a CPU, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
  • the display 260 includes a display screen component for presenting images, and a drive component for driving image display, for receiving image signals output from the controller, and displaying video content, image content, and menu manipulation interface. Components and user manipulation of the UI interface, etc.
  • the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
  • the tuner-demodulator 210 receives broadcast TV signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or cable broadcast TV signals.
  • the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.
  • the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
  • the display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220 .
  • the detector 230 is used to collect signals of the external environment or interaction with the outside.
  • the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.
  • the external device interface 240 may include, but is not limited to, the following: high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.
  • HDMI high-definition multimedia interface
  • component analog or data high-definition component input interface
  • CVBS composite video input interface
  • USB input interface USB
  • Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.
  • the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box wait.
  • the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory.
  • the controller 250 controls the overall operations of the display device 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
  • the object may be any one of selectable objects, such as hyperlinks, icons, or other operable controls. Operations related to the selected object include: displaying hyperlink pages, documents, images, etc., or executing the program corresponding to the icon.
  • the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processing unit (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read- Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.
  • CPU Central Processing Unit
  • video processor video processor
  • audio processor audio processor
  • graphics processing unit Graphics Processing Unit, GPU
  • RAM Random Access Memory
  • ROM Read- Only Memory
  • CPU processor It is used to execute the operating system and application program instructions stored in the memory, and to execute various application programs, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video content.
  • a CPU processor may include multiple processors. For example, including a main processor and one or more sub-processors.
  • the graphics processor is configured to generate various graphic objects, such as at least one of icons, operation menus, and user input instruction display graphics.
  • the graphics processor includes an arithmetic unit, which performs calculations by receiving various interactive instructions input by users, and displays various objects according to display attributes; it also includes a renderer, which renders various objects obtained based on the arithmetic unit, and the above-mentioned rendered objects are used to be displayed on the display.
  • the video processor is used to receive an external video signal and perform video decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. At least one of the processing can obtain a signal that can be directly displayed or played on the display device 200 .
  • the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used for demultiplexing the input audio and video data streams.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image compositing module such as an image compositor, is used to superimpose and mix the graphic generator with the zoomed video image according to the GUI signal input by the user or generated by itself, so as to generate an image signal available for display.
  • the frame rate conversion module is used for converting the input video frame rate.
  • the display formatting module is used to convert the received frame rate to the video output signal, and change the signal to conform to the display format signal, such as outputting RGB data signal.
  • the audio processor is used to receive an external audio signal, perform decompression and decoding according to the standard codec protocol of the input signal, and perform at least one of processing such as noise reduction, digital-to-analog conversion, and amplification processing , to obtain a sound signal that can be played on a loudspeaker.
  • the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • "user interface” is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the conversion between the internal form of information and the form acceptable to the user.
  • the commonly used form of user interface is the graphical user interface (Graphic User Interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. At least one of the view's interface elements.
  • GUI graphical User Interface
  • the user interface 280 is an interface that can be used to receive control input (such as: physical buttons on the display device body, or others).
  • the system of the display device may include a kernel (Kernel), a command parser (shell), a file system and application programs.
  • kernel Kernel
  • shell command parser
  • file system and application programs.
  • the kernel, shell, and file system make up the basic operating system structure, and they allow users to manage files, run programs, and use the system.
  • the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signal and inter-process communication (IPC).
  • IPC inter-process communication
  • the Shell and user applications are loaded.
  • the application is started, it is compiled into machine code to form a process.
  • the system of the display device is divided into three layers, which are application layer, middleware layer and hardware layer from top to bottom.
  • the application layer mainly includes common applications on TV, and application framework (Application Framework), among which, commonly used applications are mainly applications developed based on the browser browser, such as: HTML5APPs; and native applications (Native APPs);
  • Application Framework is a complete program model that has all the basic functions required by standard application software, such as: file access, data exchange..., and the user interfaces of these functions (toolbar, status bar, menu, etc.) , dialog).
  • Native APPs can support online or offline, message push or local resource access.
  • the middleware layer includes middleware such as various TV protocols, multimedia protocols, and system components.
  • Middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so as to achieve the purpose of resource sharing and function sharing.
  • the hardware layer mainly includes the HAL interface, hardware and drivers.
  • the HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip.
  • Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
  • radio equipment refers to equipment capable of receiving and playing audio data, including but not limited to radios, smart phones, tablet computers, earphones, etc.
  • both the display device and the radio device can be connected to the wireless network.
  • the display device and the radio device can establish an effective communication connection, so that the display device can communicate with the wireless network through the network.
  • the radio device sends audio data.
  • the audio data may come from a storage medium.
  • a user accesses a local disk of a display device, or accesses a mobile storage device connected through a USB interface.
  • the mobile storage device includes but is not limited to a USB flash drive, a mobile hard disk, a reader Card player, etc., and open an audio file, you can start the default media player of the display device (which can realize the audio player function), or temporarily create a music player to play the data of the audio file; or, the display device can be Apps for listening to audio are installed, such as KG Music, XMLY and other audio streaming qAPPs, that is, the audio data comes from the audio resources provided by such application platforms. After the user clicks to play the audio resources of interest on the APP page, the display device can use the application The provided audio player function completes the playback of audio resources.
  • the audio player can read the audio files stored in the storage medium, or obtain the audio resources in the application, and then decode the original data of the audio files or audio resources to obtain audio data.
  • the audio player can also control audio playback, including but not limited to volume, speed, sound effects, playback progress (such as pause, seek, forward, backward), song switching, playback mode (single cycle, Random play, sequential play) and other aspects of adjustment and control.
  • audio playback information is displayed in the interface of the music player, and the audio playback information includes but not limited to audio list, audio name, speaker name, subtitle, audio duration, playback progress bar, pause/play control , audio toggle controls, background images, and other audio-related content.
  • the audio player and radio equipment described in this application are different concepts.
  • the audio player is a software program for audio playback, similar to an application; the radio equipment is physical hardware for receiving and playing the audio data broadcast by the display device , which is equivalent to receiver + speaker.
  • the display device can generate a control instruction that meets the user's operation intention, and send the control instruction to the audio receiving device, so that the audio receiving device can adjust the played audio.
  • the conventional audio output channels of the display device include but are not limited to speakers (Speaker), ARC (Audio Return Channel, audio return channel) and Bluetooth (Bluetooth) channels, etc. These types of audio output channels cannot be paralleled. Select a channel on the output page to output and play audio, that is, different audio players share the same audio output channel, and the display device only supports one audio output, which often causes playback conflicts among multiple audio players. Either mix the audio data of multiple audio players and then output them, or allow only one audio player to be in the playing state at the same time, but no matter what the method is, it cannot meet the needs of multiple people. Listen to their audio needs.
  • the audio output architecture provided with reference to FIG. 5 includes a player set, an audio channel management service process, and a collection of radio devices, wherein the player set and the audio channel management service process are all run in the display device, and the player set It includes M audio players that have started to play audio data.
  • the collection of radio devices includes N currently available radio devices connected to the display device. Both M and N are integers, and the values of M and N can be equal or different.
  • the collection of radio devices is a collection of terminal (ie playback) physical devices
  • the collection of players is a collection of front-end audio players.
  • the display device and the collection of radio devices are in the same local area network.
  • the audio channel management service process is started together with the display device.
  • the process between the player collection and the audio channel management service process belongs to inter-process communication. Communication between devices belonging to the same LAN.
  • the player set includes M audio players that have started to play audio data
  • the display device can create and display M windows at the same time, and each window corresponds to displaying a user interface of an audio player.
  • the setting of the preset layout is not specifically limited.
  • the display device can adaptively match and adjust the window layout according to the M value.
  • the audio channel management service process may include an audio channel management module and a radio device management module. Through the cooperation between these two modules, the connection of audio input and output channels is realized, thereby building the corresponding audio channel for each audio player. Audio transmission path.
  • the audio channel management module can create a corresponding audio input channel for each audio player in the player set through methods such as preset or dynamic creation.
  • the audio channel management module is also used to manage audio data input channels. For example, each time an audio player is added in the player collection, the audio channel management module can create a corresponding audio input channel. The establishment of the audio input channel is not affected by The impact of audio output and radio equipment; every time an audio player is reduced in the player set, the audio channel management module will delete the corresponding audio input channel, so that the audio player and audio input channel maintain a one-to-one relationship.
  • communication forms such as domain socket (domain socket) can be used between the audio player and the audio channel management module.
  • the radio device management module can create a corresponding audio output channel for each radio device connected to the same local area network in the radio device set through methods such as preset or dynamic creation, and the radio device and the audio output channel maintain One-to-one relationship.
  • the device discovery port and the output channel port can be pre-agreed between the display device and the radio device, the device discovery port can adopt UDP (User Datagram Protocol, User Datagram Protocol), and the output channel port can adopt TCP (Transmission Control Protocol, Transmission Control Protocol).
  • UDP User Datagram Protocol
  • TCP Transmission Control Protocol
  • the radio device When the radio device is powered on, it broadcasts the device information of the radio device itself to the device discovery port.
  • the device information is not limited to the required information such as device ID, version number, and MAC address; when the device discovery port obtains the device information of the radio device, that is Listen to a new radio device connected to the network where the display device is located, and then send a connection request to the radio device.
  • the connection request carries information about the audio output channel established by the display device, including but not limited to IP address, output channel port number , version number, etc.; after receiving the connection request, the radio device establishes a socket connection with the radio device management module according to the information carried in the request.
  • the socket connection is equivalent to the audio output channel, and the display device receives the connection success message fed back by the radio device , you can know that the audio output channel has been successfully created, and the recording of the audio output channel will take effect.
  • the radio device also supports reconnection after the existing socket connection is disconnected, that is, the radio device re-broadcasts device information to the device discovery port, and then the radio device management module resends the connection request, thereby establishing a new socket connection, namely It is equivalent to adjusting the audio output channel mapped by the radio device.
  • the audio channel management service process can also create and maintain a device list, which includes device information of currently available radio devices, and the currently available radio devices refer to currently connected display devices
  • the radio device that is in the network and has successfully established a socket connection with the radio device management module, when the display device receives the connection success message fed back by the radio device, will add the device information of the radio device to the device list, so as to realize the accompanying device list
  • the collection of radio equipment is updated synchronously.
  • the display device can learn which radio devices can currently play audio data by querying the device list.
  • a device information of the radio device will be added in the device list.
  • the radio device may exit the collection of radio devices.
  • the network connection is turned on, causing the radio device to be unavailable due to the inability to receive audio data normally.
  • a heartbeat detection mechanism may be used to determine whether the radio device is available.
  • the display device periodically sends a heartbeat packet to the radio device, and if the response message from the radio device can be received within the timeout period, the display device considers the radio device to be available; if the heartbeat response of the radio device times out , indicating that the radio device may have abnormalities such as shutdown, power failure, and network disconnection, and the display device considers the radio device to be unavailable, and will delete the device information of the radio device from the device list.
  • the device list is updated synchronously to ensure the real-time and accuracy of the device list.
  • one audio input channel can be connected to multiple audio output channels, so that a certain audio data can be played synchronously on multiple radio terminals; similarly, multiple audio input channels can also be connected to the same audio output channel, so as to realize The output effect of multi-channel audio data mixing; of course, the audio input and output channels can also be connected one-to-one, so that each audio data is allocated to an independent radio device.
  • the audio input and output channels can also be connected one-to-one, so that each audio data is allocated to an independent radio device.
  • This application also supports the establishment or disconnection of audio input and output channels at any time, so as to adjust and transform the audio transmission path to meet the listening requirements in different application scenarios.
  • the audio input and output channels Only when the audio input and output channels reach a docking relationship and form an effective audio transmission path, the user can truly hear the audio data transmitted by this audio transmission path, but if the audio input and output channels are not connected, the function of the audio player will not be affected , that is, the user can still operate the audio player normally, but cannot hear the sound of the audio data played by the audio player.
  • the audio receiving device corresponding to the target audio output channel will sound the audio data, while other receiving devices in the audio receiving device set will not be affected by this.
  • the interface layout between the audio input and output channels can be decided by the user by means of UI inquiry on the display device side. After the audio player starts, create an audio input channel for it, and display the device list on the display interface. Referring to the example in Figure 6, the display prompts the user to select a radio device for playing the audio data from the device list, and simultaneously displays the device list. List, confirmation control and cancel control.
  • the device list can include information such as the device name/ID of the currently available radio device, so that users can quickly identify the radio device.
  • Each radio device option sets the corresponding selection control, which is recorded when the selection control is triggered. The corresponding radio device is selected.
  • a select all control can also be set and displayed, so that the user can quickly select all the radio devices in the device list with one key, which is convenient for the user to operate.
  • the user can select one or more sound receiving devices from the device list as the terminal power amplifier for receiving and playing audio data.
  • the number of a target radio device does not exceed the upper limit of the device list, and then the user clicks the confirmation control to confirm his option, and then establishes the docking relationship between the audio input channel and the first audio output channel corresponding to the first target radio device, thereby establishing into an audio transmission path.
  • the player set includes 5 audio players, namely audio player 1, audio player 2, audio player 3, audio player 4 and audio player 5;
  • the radio device set includes 4 There are four radio devices, namely radio device 1, radio device 2, radio device 3 and radio device 4.
  • the audio channel management service process is linked between the two collections.
  • FIG. 5 With reference to the example of Fig. 5, wherein audio player 4 plays audio data 4, display device creates the audio input channel 4 corresponding to audio player 4, and the user selects in the equipment list to play audio data simultaneously by radio equipment 3 and radio equipment 4 4.
  • the radio device 3 corresponds to the audio output channel 3
  • the radio device 4 corresponds to the audio output channel 4. Then, the docking relationship between the audio input channel 4 and the audio output channel 3 and the audio output channel 4 is established, which belongs to a one-to-many docking relationship.
  • the user may also directly click the cancel control, or the user may click the confirmation control without selecting the radio device from the device list (ie, empty selection), both of which cause the first If the number of target radio devices is zero, this channel of audio data does not need to be transmitted to any radio device. There is no docking relationship between the audio input channels of this channel of audio data, so the audio input channel can directly discard the received audio data.
  • the user may not perform any operation for a long time, neither selects the radio device and triggers the confirmation control, nor triggers the cancel control, that is, there is a timeout and no response, so a timeout can be set Time, start timing when the device list is displayed, if the timing time reaches the timeout time, the display device has not received the user's selected operation on any radio device in the device list, it is determined that the user has not designated the first target radio device, this The audio input channel of audio data has no docking audio output channel, so the audio input channel can directly discard the received audio data.
  • the display device first detects whether the device list is an empty list before displaying the device list, and if the device list is a non-empty list, then controls the display to display the device list; otherwise, if the device list is an empty list, the radio device The set is an empty set, indicating that there is no radio device available for playing audio data before, the display will not display the device list, but will prompt the user that there is no radio device available at present, and the audio input channel will directly discard the received audio data without transmitting and play this audio data.
  • audio player 5 plays audio data 5
  • display device creates the audio input channel 5 corresponding to audio player 5
  • detection timeout period does not receive the user to any radio equipment in the device list If the operation is selected, or the device list is an empty list and the first target radio device is zero, then the processing method of the display device is audio player 5 ⁇ audio input channel 5 ⁇ audio input channel 5 discards audio data 5 .
  • multiple audio input channels can establish a docking relationship with the same target audio output channel, that is, they belong to a many-to-one docking relationship, but an audio output channel only supports the output of a single audio channel, so multiple audio channels can be connected first.
  • the several channels of audio data transmitted in the input channel are mixed to obtain the mixed data, and then the mixed data is transmitted to the target audio output channel, and then the mixed data is sent to the radio device corresponding to the target audio output channel.
  • the radio device management module can synchronously set the audio mixing module in the previous link of the audio output channel.
  • audio player 1 plays audio data 1
  • audio player 2 plays audio data 2
  • the display device creates audio input channel 1 corresponding to audio player 1
  • audio input channel 2 corresponding to audio player 2
  • the user It is specified that audio data 1 and audio data 2 will be played by radio device 1, and radio device 1 corresponds to audio output channel 1, then the docking relationship between audio input channel 1 and audio input channel 2 and audio output channel 1 is established, which belongs to many-to-one docking relationship
  • audio input channel 1 first transmits audio data 1 to the mixing module
  • audio input channel 2 first transmits audio data 2 to the mixing module
  • the mixing module performs mixing processing on audio data 1 and audio data 2 to obtain Mix the data, and then send the mixed data to the audio output channel 1, that is, the audio transmission path built is: audio player 1/audio player 2 ⁇ audio input channel 1/audio input channel 2 ⁇ mixing module ⁇ audio Output channel 1
  • the audio channel management module can also include a control submodule based on domain socket service, and the control submodule is used to realize the communication interaction between the audio player and the audio channel management service process, such as control
  • the sub-module is used to receive instructions from the audio player for playback control, docking or switching radio equipment, device list acquisition requests, etc., and send device lists, message notifications, etc. to the audio player.
  • the audio player 4 in FIG. 5 is taken as an example for illustration.
  • the audio player 4 After the audio player 4 is started, it sends the first message carrying its own player ID to the control submodule, and the control submodule receives the first message. message, you can know that the audio player 4 has joined the player set, and then create an audio input channel 4 corresponding to the audio player 4; the audio player 4 sends a device list acquisition request to the control sub-module, and the control sub-module responds to the device list Get the request, call the current device list in the audio channel management service process, and send the device list to the audio player 4; after the audio player 4 receives the device list, it will display the device list on the upper UI of the interface, and target the device according to the user The operation of the list generates and sends a docking control command to the control sub-module.
  • the docking control command can carry the device information of the radio device 3 and the radio device 4; the control sub-module receives the docking control command, analyzes and learns that the user has selected the radio device 3 and the radio device 4 play the audio data 4, then the process establishes the docking relationship between the audio input channel 4 and the audio output channel 3 and the audio output channel 4 respectively.
  • the control submodule may query the process whether the device list is an empty list. If the device list is non-empty, send the device list to the audio player. If the device list is an empty list, the control submodule can send a no-available-device message to the audio player; when the audio player receives the no-available-device message, it can know that the device list is an empty list, and will not display the device list to prompt the user There are currently no radios available.
  • a switching control is set on the audio player interface, and the switching control is used to support the user to switch at any time according to the usage intention during the audio player playing audio resources.
  • Radio equipment It should be noted that the user's operation of switching the radio device is not limited to triggering the switching control, for example, it may be a voice input command to switch the device, or through a preset shortcut operation (for example, when the audio player interface is displayed, click the specified associated button on the remote control button), etc.
  • the audio player 3 when the audio player 3 receives an operation instruction from the user to switch devices, it considers that the device list may be updated (equipment is added or deleted), and then again Send a device list acquisition request to the control submodule, and when receiving the current recent device list sent by the control submodule, display the device list, and the user selects which radio device or devices to switch to from the latest device list, such as the user Select to switch to the newly-added radio equipment 5, that is, specify the radio equipment 5 as the second target radio equipment to switch to (in order to distinguish it from the first target radio equipment, this application names the radio equipment after switching as the second target radio equipment equipment), then the audio player 3 generates and sends a switching control command to the control submodule, and the switching control command can carry the device information of the ID+radio device 5 of the audio player 3; when the control submodule receives and parses the switching control command, Disconnect the docking relationship originally built by the audio player 3 by the process, that is,
  • the audio transmission path established for the audio player does not need to be maintained, thereby releasing part of the process resources.
  • the audio player 1 if an instruction to close the audio player 1 is received, the audio player 1 sends a message carrying the ID of the audio player 1 to the control submodule. Connect the control command; after the control sub-module receives the disconnect control command, the process will disconnect all the docking relationships of the audio input channel 1.
  • the audio input channel 1 is only connected to one audio output channel, and the process will be disconnected. Open the connection between audio input channel 1 and audio output channel 1, and delete audio input channel 1.
  • audio output channel 1 is transformed into only connected to audio input channel 2, that is, audio device 1 will no longer play audio data 1 and audio data 2 , and switch to play only audio data 2.
  • the playback status of each currently available audio receiving device can also be marked in the device list, for example, the playback status of the audio receiving device 1 is "mixed playback", and the playback status of the audio receiving device 2 is "On Broadcasting", “On Broadcasting” means that the radio device is currently playing a channel of audio data (not mixing), the playback status of radio device 3 and radio device 4 is "not broadcast", “not broadcast” means that the radio device is not currently playing any audio data.
  • marking the playback status of each radio device in the device list users can be provided with reference factors for docking/switching radio devices. For example, users may be more inclined to choose a radio device in the "unbroadcast” state and avoid choosing "mixed playback". state of the radio equipment.
  • the playback status of each available radio device is recorded and managed by the audio channel management service process according to the docking layout.
  • the audio output channel 1 is simultaneously connected to the audio input channel 1 and the audio Input channel 2, so the radio device 1 must be in the "mixing playback” state, and for example, the audio output channel 2 is only connected to the audio input channel 3, so the radio device 2 is in the "on-air” state.
  • the device list fed back by the control submodule includes device information and current playback status of the radio device.
  • the user will select the radio device to be docked or switched from the device list.
  • the radio device if the radio device encounters problems such as power failure, shutdown, or abnormal network connection, It will cause the radio device to be unavailable due to disconnection from the network, and unable to receive and play the audio data sent by the display device.
  • methods such as heartbeat detection can be used to monitor the connection status of the radio device A. If it is detected that the radio device A is disconnected from the network, the device information and playback status of the radio device A will be deleted in the device list, so that It shows that the device cannot be docked/switched to radio device A through the device list.
  • the radio device management module directly deletes the audio output channel A, so that the docking relationship to which the audio output channel A belongs is also completely released during the process, so that in the When the radio device A is working abnormally, each audio transmission path leading to the radio device A is cut off, and the audio data originally played by the radio device A will be discarded by the corresponding audio input channel.
  • the display device has currently started two audio players, which are audio player A and audio player B respectively, and the windows of the two audio players are arranged side by side.
  • the name of the currently docked audio device is displayed at a designated position in each window, for example, the upper left corner of the window of the audio player A in Figure 7 (a) displays "the audio device A is playing ", if audio player B has not been connected to any radio device, no radio device name will be displayed.
  • the control submodule can send a device disconnection message to the audio player A, and the audio player A receives
  • the window of the audio player A can prompt the user that the radio device A is currently unavailable, please check the radio device A, and the upper left corner of the window of the audio player A cancels the display of " Radio A is playing.”
  • the user can know that the radio device A is abnormal, and can troubleshoot the radio device A, and re-establish the socket connection with the terminal device.
  • the first prompt pop-up window in the example of Figure 7(c) also includes a cancel control and a switch control.
  • the first prompt pop-up window can be closed, and audio player A does not switch docking Object, the audio data A is discarded by the audio input channel A, and the audio data A is not played; if the user triggers the switching control in the first prompt pop-up window, the first prompt pop-up window can be closed, and the audio player A directs the control sub-module Request to obtain the latest device list again, and display the device list in the window of audio player A, so that the user can select the docking object to be switched to from the device list, that is, the audio data A will be played by other available radio devices .
  • the user may troubleshoot the radio device A, and restore the socket connection with the display device, that is, rebuild and trigger the audio output channel A to take effect, then the audio channel management service
  • the process detects that the socket connection is successful, it will add the device information of the radio device A to the device list. Since the radio device A has not been connected to any audio player after reconnection, the playback status of the radio device A is recorded in the device list at this time. "Not aired".
  • the control submodule can send a device return message to the audio player A, and the device return message uses When indicating that the radio device A has been re-connected and available; when the audio player A receives the device return message, refer to the example of FIG.
  • the user's radio device A has been restored, and asking the user whether to switch back to the radio device A to play the audio data A is equivalent to asking the user whether to restore the radio device A to the docking and playing state before the network disconnection.
  • the second prompt pop-up window in the example of Figure 7(d) also includes a cancel control and a confirmation control.
  • the second prompt pop-up window can be closed, and audio player A maintains the current playback In the current situation, the audio input channel A is not connected to the audio output channel A, and the audio device A does not receive or play audio data A; if the user triggers the confirmation control in the second prompt pop-up window, the second prompt pop-up window can be closed, and the audio channel
  • the management service process establishes the docking relationship between the audio input channel A and the audio output channel A, so as to build an audio transmission path from the audio player A to the radio device A, so that after the radio device A is disconnected and reconnected, it can be restored to the audio device A. Continue to receive and play audio data A.
  • the multi-channel audio player operation scenario can be flexibly adjusted according to various factors such as the actual audio playback scenario, the availability of radio equipment, and the user's listening needs.
  • the audio transmission method is adaptively modified, improved and expanded to obtain more diverse and feasible UI and program solutions, not limited to the embodiments provided in the specification of this application.
  • the UI provided in this application is only an illustration for the convenience of describing the solution, and does not represent the actual product design. The interaction, operation process and display effect of the UI should be based on the actual application and design.
  • FIG. 8 provides an audio playback method, which describes the output and playback control of audio data from the perspective of the controller of the display device.
  • the method configured and executed by the controller includes at least the following program steps:
  • Step S01 when the audio player starts to play audio data, create an audio input channel linked with the audio player.
  • step S02 a device list is displayed, and the device list includes device information of currently available sound receiving devices.
  • Step S03 when receiving a selection operation on the first target sound receiving device in the device list, establish a docking relationship between the audio input channel and the first audio output channel corresponding to the first target sound receiving device, forming a first Audio transmission path.
  • Step S04 sending the audio data to the first target sound receiving device through the first audio transmission path, so that the first target sound receiving device plays the received audio data.
  • steps S01 to S04 it is possible to assign a designated radio device to each audio player, and by building an audio input and output connection channel between the audio player and the radio device, the audio data can be smoothly transmitted to the radio device , so that the audio data is converted into sound by the radio equipment for playback.
  • the method further includes: disconnecting the docking relationship between the audio input channel and the first audio output channel when receiving an operation instruction from the user to switch devices; instructing according to the operation instruction
  • the second target audio receiving device that is switched to establishes a docking relationship between the audio input channel and the second audio output channel corresponding to the second target audio receiving device to form a second audio transmission path; Send the second audio transmission path to the second target audio receiving device, so that the second target audio receiving device plays the received audio data.
  • This embodiment further implements switching of the audio receiving device linked to the audio player according to the change of the user's demand for the audio listening device.
  • the method further includes: when it is detected that a radio device is connected to the network where the display device is located, acquiring device information of the radio device; constructing an audio output channel corresponding to the radio device, And send a connection request carrying audio output channel information to the radio device; when receiving the connection success message fed back by the radio device, record that the audio output channel is effective, and add the radio in the device list Device information for the device.
  • This embodiment further provides a connection between the radio device and the display device, a solution for constructing an audio output channel, and synchronously updating and managing the device list when a new radio device is connected, so as to ensure that the device list displayed to the user by the display device is real-time and up-to-date and accurate.
  • the method further includes: if it is detected that the device list is an empty list, then not displaying the device list, controlling the display to display information for prompting that there is currently no available radio device; controlling the Audio input channels discard the audio data.
  • This embodiment further determines whether the display device needs to display the device list according to whether the device list is empty. If there is no available sound receiving device, the audio input channel directly discards the audio data, and the audio data will not be played with sound.
  • the method further includes: after displaying the device list, if no operation for selecting any radio device in the device list has been received within the timeout period , controlling the audio input channel to discard the audio data. If the radio device is not selected after timeout, the audio player does not have a mapped radio device, and the audio input channel has no connected audio output channel, and the audio input channel simply discards the audio data.
  • the method further includes: disconnecting the established docking relationship between the audio input channel and one or more audio output channels when receiving a shutdown instruction for the audio player, and Delete the audio input channel.
  • This embodiment further provides that when the audio player is closed and the playback of audio data is exited, all the docking relationships to which the audio input channel linked by the audio player belongs are released, and the audio input channel is deleted together, thereby canceling the audio channel of this channel. All audio transmission channels of data, audio data is stopped and played.
  • the method further includes: when a docking relationship is established between multiple audio input channels and the same target audio output channel, performing audio mixing processing on the audio data transmitted in the multiple audio input channels to obtain the mixed audio data; transmitting the audio mixing data to the target audio output channel, and then sending the audio mixing data to the audio receiving device corresponding to the target audio output channel.
  • This embodiment further provides that when there is a many-to-one pairing relationship, multiple channels of audio data need to be mixed into one stream for output and playback.
  • the method further includes: when detecting that the first/second target radio device is disconnected from the network, deleting the first/second target radio device from the device list device information; delete the first/second audio output channel, and control the audio input channel to discard the audio data; prompt the user through the display that the first/second target audio receiving device is currently unavailable, and ask the user Whether to switch to play the audio data by other available radio devices.
  • This embodiment further provides that if the radio device is suddenly disconnected from the network when playing audio data, the device list will be updated synchronously, and all audio transmission paths leading to the radio device will be cut off, and the UI on the display device terminal will prompt the user that the radio device is unavailable. Choose not to continue to listen to the audio data played by the radio device, or switch to other available radio devices to play audio data.
  • the method further includes: when it is detected that the first/second target radio device reconnects to the network after being disconnected from the network, acquiring the information of the first/second target radio device again Device information; according to the reconstructed first/second audio output channel, send a reconnection request carrying the first/second audio output channel information to the first/second target audio receiving device; upon receiving the first/second audio output channel
  • a connection success message is fed back by the first/second target radio device, the first/second audio output channel is triggered to take effect, and the device information of the first/second target radio device is added to the device list; by The display prompts the user that the first/second target sound receiving device is currently available, and asks the user whether to switch to the first/second target sound receiving device to play the audio data again.
  • This embodiment further provides that after the radio device is disconnected and reconnected, and the audio output channel is rebuilt, the device list is updated synchronously, and the radio device that was unavailable before the UI prompt on the display device is now available, and the user can choose to keep the current playback status, or The audio data can also be continued to be played by the available radio equipment.
  • the audio playback capability of the display device is expanded, multiple channels of audio can be played synchronously, and each channel of audio data can be distributed to one or more designated receivers according to the listening needs of different users
  • the device can enable each user to listen to their own audio according to their own listening needs in a multi-person scene, improving user experience.
  • FIG. 9 shows an audio signal processing logic architecture one, which includes but is not limited to an audio decoder, an SOC chip, and at least one connected and available audio player (ie, audio player 1- Audio player n), the audio player can be a built-in speaker of the display device or a power amplifier device connected through a specified interface, such as a stereo, earphone, etc., where the interface used to connect the audio signal output channel is, for example, an AMP interface, an HP interface and SPDIF interface, or HDMI interface, etc.
  • the audio data After the audio data is decoded by the audio decoder, it is converted into an audio signal in PCM (Pulse Code Modulation) format and input to the SOC chip; the SOC chip queries the currently enabled target audio player, and outputs the audio signal to the target audio Player, the target audio player outputs and plays audio signals through its own channel.
  • PCM Packe Code Modulation
  • each audio output channel can be independently controlled, including volume control, sound effect control, silent mode on/off control, and DRC control.
  • the SOC chip supports the DRC function.
  • the SOC chip can have a built-in DRC module.
  • the first DRC module which configures and implements the DRC function of the SOC chip, that is, according to the strength/amplitude of the current audio signal, Adjust the signal gain.
  • the audio signal strength/amplitude can be compressed to attenuate the audio signal to a certain extent ; If the current signal strength/amplitude is too small, the DRC function can reduce the attenuation of the audio signal or not attenuate, so as to realize the dynamic range control of the audio signal. DRC can only attenuate or at most not attenuate the audio signal, but not reversely enhance the audio signal.
  • each audio player includes a volume adjustment module, and the volume adjustment module is used to obtain a volume gain according to the target volume input by the user, and then adjust the output volume of the audio player to the target volume to achieve volume control .
  • each audio player has its own power amplifier type, such as an analog power amplifier or a digital power amplifier.
  • the analog power amplifier does not support the DRC function, and the digital power amplifier has the DRC function.
  • the digital power amplifier also has a built-in DRC module, which is named the second DRC module to configure and realize the DRC function of the digital power amplifier for easy distinction.
  • Both the volume adjustment module and the second DRC module are located in the output channel of the digital power amplifier, and the second DRC module is located at the end of the output channel. After the audio signal traverses other links in the preorder, the DRC control is performed by the end link, so that the digital power amplifier Finally output a suitable audio signal.
  • the DRC function of the audio player itself is preferentially turned on and used to keep the DRC function of the SOC chip off.
  • the SOC chip mainly plays the role of receiving the decoded Audio signal, and transmit the audio signal to the target audio player; if the audio player is an analog power amplifier, it does not support the DRC function, you need to enable and use the DRC function of the SOC chip.
  • the display device is provided with an audio output (Audio Output) page, which displays currently connected and available audio players, from which the user can select at least one as the target audio player, and the target audio player is selected Audio signals can be output and played after being enabled; or the audio player with the highest current priority can be automatically enabled to output audio according to the preset priority without user specification.
  • Audio output Audio Output
  • the manner of selecting the target audio player is not limited to the description in the embodiment of the present application.
  • the target audio player is an analog power amplifier, it is necessary to enable the function of the first DRC module in the SOC chip. From the example in Figure 9, it can be seen that after the first DRC module adjusts the audio signal according to the current volume, due to the subsequent target
  • the audio player also has a volume adjustment module, which is a gain link that affects signal output, which may cause the final output audio signal to be inconsistent with the audio signal adjusted by the DRC.
  • the SOC chip performs DRC adjustment to compress the amplitude of the audio signal. If the user turns down the volume at this time, the audio signal will be attenuated twice, and the transitional attenuation of the audio signal will cause the user to be unable to hear the audio content clearly, and the user's hearing experience will be poor. .
  • the output control functions of the two audio signals, volume are bound uniformly at the software level (no hardware transfer is involved). After the binding, there is no other gain link that affects the signal output. The target audio player only needs to output the audio signal directly.
  • the DRC of the SOC chip and the volume gain adjustment can be mutually restrained and linked.
  • the SOC chip can reduce the DRC attenuation of the audio signal or even not attenuate, realizing the complementarity between the DRC gain of the SOC chip and the volume gain, which can protect the power amplifier device and prevent the power amplifier device from being affected by the output power/volume If it is too large and damaged, it can also appropriately increase the signal amplitude when the volume is low, improve the output effect of the audio signal, and provide users with a better sense of hearing.
  • the number of audio players currently connected and available to the display device is n, wherein m audio players are analog power amplifiers, and n-m audio players are digital power amplifiers, and m is less than or equal to n .
  • n-m digital power amplifiers support the DRC function, that is, it has a second DRC module, and does not activate the function execution of the first DRC module of the SOC chip when outputting audio signals, so there is no need to set the first DRC module and the volume adjustment module in the digital power amplifier m analog power amplifiers do not support the DRC function, and the first DRC module of the SOC chip needs to be activated, so the preset association relationship between the m analog power amplifiers and the first DRC module is established in advance, that is, m preset associations.
  • the power amplifier type of the target audio player is detected, and if it is a digital power amplifier, the decoded audio
  • the signal is transmitted to the target audio player through the SOC chip, and is output after being processed by the volume adjustment module and the second DRC module in the target audio player.
  • the target audio player search for the target preset relationship corresponding to the device ID from the m preset relationships, and according to the target preset relationship and the target volume input by the user , to match the target gain value used when the first DRC module performs DRC processing on the audio signal, that is, the target gain value is used to represent the DRC gain for the audio signal for adapting the target volume, and the DRC module for the audio signal
  • the unit of the DRC gain can be converted into dB (decibel).
  • the DRC module does not enhance the audio signal, but attenuates or does not attenuate, the decibel of the DRC gain The value is non-positive, for example, if the DRC gain is -5dB, the audio signal can be attenuated by 5dB.
  • the audio signal is sent to the target audio player, and the volume adjustment module in the target audio player then adjusts the audio signal to the target volume, so that the target audio The player finally outputs an audio signal matching the target gain value and target volume.
  • n available audio players such as selecting stereos and earphones
  • detect the power amplifier types of these target audio players respectively, and Type determines the signal output mode of each target audio player, and the signal output control of each target audio player is independent.
  • DRC and “Volume” are two processing links in the audio signal output process.
  • these two links are in a relationship of association and linkage at the software function level. Through this This relationship realizes matching and constraining the DRC gain of the SOC chip according to the volume, but at the actual hardware processing level, these two links are relatively independent.
  • the SOC chip performs DRC processing on the audio signal according to the target gain value, and the target audio The player adjusts the volume of the audio signal according to the target volume, that is, the parameters and processing logic used in the two links are different, so as to realize the output control of different indicators of the audio signal.
  • This application uses the similar "unity of opposites" relationship between the two links of "DRC” and “volume”, which not only ensures the safety of the analog power amplifier, but also improves the output and playback effect of the audio signal, thereby providing users with better auditory experience.
  • FIG. 11 shows an audio signal output control method, the execution of the method is controlled by the controller 250, and the method includes the following processing:
  • Step S10 after the decoded audio signal is input to the SOC chip, detect the power amplifier type of the target audio player currently enabled.
  • Step S20 judging whether the power amplifier type is an analog power amplifier. If it is an analog power amplifier, execute mode 1 described in steps S30 to S60; if it is a digital power amplifier, execute mode 2 described in steps S70 to S90.
  • Step S30 enabling the function of the first DRC module built in the SOC chip.
  • Step S40 matching the target gain value according to the preset association relationship between the first DRC module and the volume adjustment module in the target audio player, and the target volume input by the user.
  • the target gain value is relatively reduced, that is, the first DRC module properly attenuates the audio signal to avoid damage to the target audio player due to excessive output power; if the user turns down the volume (that is, when the target volume decreases), the target gain value increases relatively, that is, the first DRC module reduces the attenuation range of the audio signal or does not attenuate it, so as to avoid the audio signal being too small to hear clearly.
  • This embodiment provides a specific threshold constraint between the DRC gain of the SOC chip and the volume gain adjustment.
  • the preset association relationship can be specified to be suitable for the analog type.
  • the gain threshold of the power amplifier so that the sum of the volume and the DRC gain is always equal to the gain threshold, so that the DRC gain of the SOC chip can be adaptively matched according to the target volume and gain threshold.
  • the gain threshold is further defined. The gain threshold is less than or equal to the gain upper limit.
  • the audio player when the audio player outputs the maximum volume, based on the audio player will not be burned and the audio signal output effect Angle, obtain a better gain value adapted to volume max as DRCgain max , then the sum of volume max and DRCgain max is the gain upper limit value, as long as the gain threshold does not exceed the upper limit value, it can ensure that the power amplifier equipment does not burn out risk, so as to take into account the use safety of the audio player and the signal output effect.
  • the gain threshold S can be set.
  • Step S50 controlling the first DRC module to perform DRC processing on the audio signal according to the target gain value, and sending the processed audio signal to the target audio player.
  • Step S60 controlling the target audio player to adjust the audio signal to a target volume, and output an audio signal matching the target gain value and the target volume.
  • step S70 the function of the second DRC module built in the target audio player is enabled, and the function of the first DRC module remains disabled.
  • Step S80 controlling the SOC chip to send the audio signal to the target audio player.
  • Step S90 controlling the target audio player to sequentially perform volume and DRC processing on the audio signal, and output the processed audio signal.
  • the analog earphones when the number of target audio players is multiple, such as including digital audio and analog earphones, that is, a multi-power amplifier hybrid scene, the analog earphones output audio signals according to mode 1, and the digital audio devices output audio signals according to mode 1. Two output audio signals, so as to adaptively match the audio signal output mode according to the power amplifier type.
  • the foregoing embodiments are applicable to the scene where the target audio player has sound output. If the user switches the target audio player to the mute mode, for mode 1, the work of the first DRC module is not affected, and the volume adjustment module performs the mute processing, that is, reduces The output power of the analog power amplifier, when the power of the final output audio signal of the analog power amplifier is lower than a certain level, it will show the playback effect of zero volume (no sound).
  • the user releases the mute mode of the analog power amplifier follow the above mode , according to the target volume input by the user (if the user does not adjust the volume, the current volume is taken), adaptively adjust the volume and signal amplitude of the audio signal output, and restore the audio output of the audio signal.
  • the work of the second DRC module at the end is also not affected, and the mute processing is performed by the volume adjustment module. Since the power of the audio signal is reduced to a small amount after the mute processing, It is not enough to trigger the second DRC module to compress the audio signal, that is, the second DRC module does not need to attenuate the audio signal, and finally presents a playback effect with a volume of zero (no sound). After the mute mode is released, follow the above Mode 2 controls the audio output of the digital power amplifier and restores the audio output of the audio signal.
  • the audio signal processing Modifications or extensions of the logical architecture and specific implementation methods are not limited to those described in the embodiments of the present application.
  • this application mainly describes the "DRC signal amplitude" and “volume” in the audio signal output indicators, and does not specifically limit other aspects such as sound effects and channels.
  • the present invention also provides a computer-readable non-volatile storage medium, which can store a program, and when the program is executed, it can include the audio transmission and playback method involved in the embodiment of the present application. program steps.
  • the computer storage medium may be a magnetic disk, an optical disk, a ROM or a RAM, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Circuits Of Receivers In General (AREA)

Abstract

本申请公开一种音频控制方法及显示设备，在音频播放器启动播放音频数据时，创建与所述音频播放器相链接的音频输入通道；显示设备列表，所述设备列表中包括当前可用的收音设备的设备信息；在接收到对所述设备列表中第一目标收音设备的选定操作时，建立所述音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，形成第一音频传输通路；将音频数据通过所述第一音频传输通路发送给所述第一目标收音设备，以使第一目标收音设备播放接收到的音频数据。

Description

一种音频控制方法及显示设备
相关申请的交叉引用
本申请要求在2021年9月14日提交的、申请号为202111074290.0，在2021年9月7日提交的、申请号为202111041988.2的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示设备领域，尤其涉及一种音频控制方法及显示设备。
背景技术
显示设备可以通过音频播放器去播放音频资源，在一些场景中，显示设备可能同时运行多个用户分别启动的多个音频播放器，即可能产生多路音频，但显示设备仅支持输出单路音频，显示设备或将多路音频进行混音后输出，但会导致功放最终播放的是混音音频，而不再是原始音频；又或者，仅输出其中一路音频，其他路音频均被停止输出及播放，这就导致多人场景内只能共享同一音频资源，即多人场景中仅有一人听到自己感兴趣的音频资源，其他人只能被动收听。
发明内容
本申请实施方式提供一种显示设备，包括：显示器，用于显示用户界面；通信器，用于与收音设备通信连接；控制器，用于执行：在音频播放器启动播放音频数据时，创建与所述音频播放器相链接的音频输入通道；控制显示器显示设备列表，所述设备列表中包括当前可用的收音设备的设备信息；在接收到对所述设备列表中第一目标收音设备的选定操作时，建立所述音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，形成第一音频传输通路；将所述音频数据通过所述第一音频传输通路发送给所述第一目标收音设备，以使第一目标收音设备播放接收到的所述音频数据。
本申请实施方式提供一种音频控制方法，包括：响应于音频播放器启动播放音频数据时，创建与所述音频播放器相链接的音频输入通道；显示设备列表，所述设备列表中包括当前可用的收音设备的设备信息；响应于接收到对所述设备列表中第一目标收音设备的选定操作时，建立所述音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，形成第一音频传输通路；将所述音频数据通过所述第一音频传输通路发送给所述第一目标收音设备，以使第一目标收音设备播放接收到的所述音频数据。
本申请实施方式还提供一种显示设备，包括：至少一种音频播放器，用于输出音频信号；控制器，与所述至少一种音频播放器连接，配置为运行指令以使得所述显示设备执行：将解码后的音频信号输入至SOC芯片，响应当前启用的目标音频播放器为模拟型功放，则开启所述SOC芯片内置的第一DRC模块的功能；根据所述第一DRC模块与所述目标音频播放器中音量调节模块的预设关联关系，以及用户输入的目标音量，匹配目标增益值；控制所述第一DRC模块按照所述目标增益值对音频信号进行DRC处理，并将处理后的音频信号发送给所述目标音频播放器，以使所述目标音频播放器输出与所述目标增益值和所述目标音量匹配的音频信号。
附图说明
图1示例性示出了根据一些实施例的显示设备的使用场景；
图2示例性示出了根据一些实施例的控制装置100的硬件配置框图；
图3示例性示出了根据一些实施例的显示设备200的硬件配置框图；
图4示例性示出了根据一些实施例的显示设备200中软件配置图；
图5示例性示出了一种音频传输架构的示意图；
图6示例性示出了显示设备在音频播放器的播放界面上显示设备列表的UI示意图；
图7(a)示例性示出了一种显示设备显示音频播放器的窗口布局；
图7(b)示例性示出了图7(a)中收音设备A断网时的一种UI示意图；
图7(c)示例性示出了图7(a)中收音设备A断网时的另一种UI示意图；
图7(d)示例性示出了收音设备A恢复连接时的一种UI示意图；
图8示例性示出了一种音频播放方法的流程图；
图9示例性示出了音频信号处理逻辑架构一的示意图；
图10示例性示出了改进后的音频信号处理逻辑架构二的示意图；
图11示例性示出了音频信号输出控制方法的流程图。
具体实施方式
为使本申请的目的和实施方式更加清楚，下面将结合本申请示例性实施例中的附图，对本申请示例性实施方式进行清楚、完整地描述，显然，描述的示例性实施例仅是本申请一部分实施例，而不是全部的实施例。
需要说明的是，本申请中对于术语的简要说明，仅是为了方便理解接下来描述的实施方式，而不是意图限定本申请的实施方式。除非另有说明，这些术语应当按照其普通和通常的含义理解。
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体，而不必然意味着限定特定的顺序或先后次序，除非另外注明。应该理解这样使用的用语在适当情况下可以互换。
图1为根据实施例中显示设备的使用场景的示意图。如图1所示，显示设备200还与服务器400进行数据通信，用户可通过智能设备300或控制装置100操作显示设备200。
在一些实施例中，控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信，及其他短距离通信方式中的至少一种，通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等至少一种输入用户指令，来控制显示设备200。
在一些实施例中，智能设备300可以包括移动终端、平板电脑、计算机、笔记本电脑，AR/VR设备等中的任意一种。
在一些实施例中，也可以使用智能设备300以控制显示设备200。例如，使用在智能设备上运行的应用程序控制显示设备200。
在一些实施例中，也可以使用智能设备300和显示设备进行数据的通信。
在一些实施例中，显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制，例如，可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制，也可以通过显示设备200设备外部设置的语音控制装置来接收用户的语音指令控制。
在一些实施例中，显示设备200还与服务器400进行数据通信。可允许显示设备 200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。服务器400可以是一个集群，也可以是多个集群，可以包括一类或多类服务器。
在一些实施例中，一个步骤执行主体执行的软件步骤可以随需求迁移到与之进行数据通信的另一步骤执行主体上进行执行。示例性的，服务器执行的软件步骤可以随需求迁移到与之数据通信的显示设备上执行，反之亦然。
图2示例性示出了根据示例性实施例中控制装置100的配置框图。如图2所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起用用户与显示设备200之间交互中介作用。
在一些实施例中，通信接口130用于和外部通信，包含WIFI芯片，蓝牙模块，NFC或可替代模块中的至少一种。
在一些实施例中，用户输入/输出接口140包含麦克风，触摸板，传感器，按键或可替代模块中的至少一种。
图3示出了根据示例性实施例中显示设备200的硬件配置框图。
在一些实施例中，显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。
在一些实施例中控制器包括中央处理器，视频处理器，音频处理器，图形处理器，RAM，ROM，用于输入/输出的第一接口至第n接口。
在一些实施例中，显示器260包括用于呈现画面的显示屏组件，以及驱动图像显示的驱动组件，用于接收源自控制器输出的图像信号，进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
在一些实施例中，显示器260可为液晶显示器、OLED显示器、以及投影显示器中的至少一种，还可以为一种投影装置和投影屏幕。
在一些实施例中，调谐解调器210通过有线或无线接收方式接收广播电视信号，以及从多个无线或有线广播电视信号中解调出音视频信号，如以及EPG数据信号。
在一些实施例中，通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如：通信器可以包括Wifi模块，蓝牙模块，有线以太网模块等其他网络通信协议芯片或近场通信协议芯片，以及红外接收器中的至少一种。显示设备200可以通过通信器220与控制装置100或服务器400建立控制信号和数据信号的发送和接收。
在一些实施例中，检测器230用于采集外部环境或与外部交互的信号。例如，检测器230包括光接收器，用于采集环境光线强度的传感器；或者，检测器230包括图像采集器，如摄像头，可以用于采集外部环境场景、用户的属性或用户交互手势，再或者，检测器230包括声音采集器，如麦克风等，用于接收外部声音。
在一些实施例中，外部装置接口240可以包括但不限于如下：高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。
在一些实施例中，控制器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在控制器250所在的主体设备的外置设备中，如外置机顶盒等。
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如：响应于接收到用于选择在显示器260上显示UI对象的用户命令，控制器250便可以执行与由用户命令选择的对象有关的操作。
在一些实施例中，所述对象可以是可选对象中的任何一个，例如超链接、图标或其他可操作的控件。与所选择的对象有关操作有：显示连接到超链接页面、文档、图像等操作，或者执行与所述图标相对应程序的操作。
在一些实施例中控制器包括中央处理器(Central Processing Unit，CPU)，视频处理器，音频处理器，图形处理器(Graphics Processing Unit，GPU)，RAM Random Access Memory，RAM)，ROM(Read-Only Memory，ROM)，用于输入/输出的第一接口至第n接口，通信总线(Bus)等中的至少一种。
CPU处理器。用于执行存储在存储器中操作系统和应用程序指令，以及根据接收外部输入的各种交互指令，来执行各种应用程序、数据和内容，以便最终显示和播放各种音视频内容。CPU处理器，可以包括多个处理器。如，包括一个主处理器以及一个或多个子处理器。
在一些实施例中，图形处理器，用于产生各种图形对象，如：图标、操作菜单、以及用户输入指令显示图形等中的至少一种。图形处理器包括运算器，通过接收用户输入各种交互指令进行运算，根据显示属性显示各种对象；还包括渲染器，对基于运算器得到的各种对象，进行渲染，上述渲染后的对象用于显示在显示器上。
在一些实施例中，视频处理器，用于将接收外部视频信号，根据输入信号的标准编解码协议，进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频处理中的至少一种，可得到直接可显示设备200上显示或播放的信号。
在一些实施例中，视频处理器，包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等中的至少一种。其中，解复用模块，用于对输入音视频数据流进行解复用处理。视频解码模块，用于对解复用后的视频信号进行处理，包括解码和缩放处理等。图像合成模块，如图像合成器，其用于将图形生成器根据用户输入或自身生成的GUI信号，与缩放处理后视频图像进行叠加混合处理，以生成可供显示的图像信号。帧率转换模块，用于对转换输入视频帧率。显示格式化模块，用于将接收帧率转换后视频输出信号，改变信号以符合显示格式的信号，如输出RGB数据信号。
在一些实施例中，音频处理器，用于接收外部的音频信号，根据输入信号的标准编解码协议，进行解压缩和解码，以及降噪、数模转换、和放大处理等处理中的至少一种，得到可以在扬声器中播放的声音信号。
在一些实施例中，用户可在显示器260上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。
在一些实施例中，“用户界面”，是应用程序或操作系统与用户之间进行交互和信息交换的介质接口，它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(Graphic User Interface，GUI)，是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素，其中控件可以包括图标、按钮、菜单、选项卡、文本框、 对话框、状态栏、导航栏、Widget等可视的界面元素中的至少一种。
在一些实施例中，用户接口280，为可用于接收控制输入的接口(如：显示设备本体上的实体按键，或其他等)。
在一些实施例中，显示设备的系统可以包括内核(Kernel)、命令解析器(shell)、文件系统和应用程序。内核、shell和文件系统一起组成了基本的操作系统结构，它们让用户可以管理文件、运行程序并使用系统。上电后，内核启动，激活内核空间，抽象硬件、初始化硬件参数等，运行并维护虚拟内存、调度器、信号及进程间通信(IPC)。内核启动后，再加载Shell和用户应用程序。应用程序在启动后被编译成机器码，形成一个进程。
如图4所示，将显示设备的系统分为三层，从上至下分别为应用层、中间件层和硬件层。
应用层主要包含电视上的常用应用，以及应用框架(Application Framework)，其中，常用应用主要是基于浏览器Browser开发的应用，例如：HTML5APPs；以及原生应用(Native APPs)；
应用框架(Application Framework)是一个完整的程序模型，具备标准应用软件所需的一切基本功能，例如：文件存取、资料交换...，以及这些功能的使用接口(工具栏、状态列、菜单、对话框)。
原生应用(Native APPs)可以支持在线或离线，消息推送或本地资源访问。
中间件层包括各种电视协议、多媒体协议以及系统组件等中间件。中间件可以使用系统软件所提供的基础服务(功能)，衔接网络上应用系统的各个部分或不同的应用，能够达到资源共享、功能共享的目的。
硬件层主要包括HAL接口、硬件以及驱动，其中，HAL接口为所有电视芯片对接的统一接口，具体逻辑由各个芯片来实现。驱动主要包含：音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器，温度传感器，压力传感器等)、以及电源驱动等。
以上实施例介绍了显示设备的硬件/软件架构以及功能实现等内容。在一些实施例中，显示设备除具有自身内置的扬声器或通过HDMI、蓝牙等形式连接的外部功放外，还可连接收音设备，即相当于将显示设备作为音频信号的广播源，收音设备在接收音频信号后，利用自身相关的硬件资源去播放音频信号，从而便于用户收听。其中，收音设备是指具备接收及播放音频数据能力的设备，包括但不限于收音机、智能手机、平板电脑、耳机等。
在一些实施例中，显示设备和收音设备均可连接无线网络，例如当收音设备与显示设备接入同一wifi网络后，显示设备与收音设备可以建立有效的通信连接，实现显示设备端通过网络向收音设备发送音频数据。
在一些实施例中，所述音频数据可以来源于存储介质，例如用户访问显示设备的本地磁盘，或者访问通过USB接口连接的移动存储设备，移动存储设备包括但不限于U盘、移动硬盘、读卡器等，并打开一音频文件，则可启动显示设备默认的媒体播放器(可实现音频播放器功能)，又或者临时创建一音乐播放器去播放音频文件的数据；又或者，显示设备可安装有收听音频的应用，例如KG音乐、XMLY等音频流qAPP，即音频数据来源于这类应用平台提供的音频资源，用户在APP页面中点击播放感兴趣的音频资源后，显示设备可使用应用提供的音频播放器功能，完成对音频资源的播放。
在一些实施例中，音频播放器可以读取存储介质中已存的音频文件，或者获取应 用内的音频资源，然后对音频文件或音频资源的原始数据进行解码，得到音频数据。
在一些实施例中，音频播放器还可对音频进行播放控制，包括但不限于音量、倍速、音效、播放进度(例如暂停、seek、前进、后退)、歌曲切换、播放模式(单曲循环、随机播放、顺序播放)等方面的调节和控制。在本申请一些实施例中，在音乐播放器的界面中显示音频播放信息，音频播放信息包括但不限于音频列表、音频名称、发音者姓名、字幕、音频时长、播放进度条、暂停/播放控件、音频切换控件、背景图像等与音频有关的内容。
本申请所述的音频播放器与收音设备是不同的概念，音频播放器为音频播放的软件程序，类似于一个应用；而收音设备则是实体硬件，用于接收并播放显示设备广播的音频数据，相当于接收器+扬声器。通过用户对音频播放器的交互操作，显示设备可生成符合用户操作意图的控制指令，并将控制指令发送给收音设备，以使收音设备对播放的音频进行调节。
显示设备常规的音频输出通道包括但不限于扬声器(Speaker)、ARC(Audio Return Channel，音频回传通道)和蓝牙(Bluetooth)通道等，这些类型的音频输出通道之间不能并行，用户需要在音频输出页面中择一通道来输出及播放音频，也就是说，不同的音频播放器共享同一音频输出通道，显示设备仅支持输出一路音频，这就导致多个音频播放器之间往往存在播放冲突，或将多个音频播放器的音频数据进行混音后再输出，或者同一时刻仅允许一个音频播放器处于播放状态，而无论何种方式都无法满足多人场景下支持多路输出、各用户各听各自音频的需求。
在一些实施例中，参照图5提供的音频输出架构，包括播放器集合、音频通道管理服务进程和收音设备集合，其中播放器集合和音频通道管理服务进程皆运行于显示设备内，播放器集合包括M个已启动播放音频数据的音频播放器，收音设备集合包括N个与显示设备连接、当前可用的收音设备，M和N皆为整数，M值与N值可相等或不等。其中，收音设备集合是末端(即播放端)实体设备的集合，播放器集合是前端音频播放器的集合。显示设备与收音设备集合处于同一局域网中，音频通道管理服务进程随显示设备开机一并启动，播放器集合与音频通道管理服务进程之间属于进程间通讯，音频通道管理服务进程与收音设备集合之间属于同一局域网内设备间通讯。
在一些实施例中，播放器集合包括M个已启动播放音频数据的音频播放器，则显示设备可创建并同时显示M个窗口，每个窗口对应显示一个音频播放器的用户界面，在本申请一些实施例中，可以按照预设布局显示M个窗口，所述预设布局是根据不同窗口数量预设的每个窗口的尺寸及在界面上的位置分布。例如，若M＝1，则单窗口全屏显示；若M＝2，则将两个窗口并排或并列排布；又例如，若M＝4，可以按照2*2矩阵形式排布四个窗口，预设布局的设置不作具体限定。当播放器集合发生新增或删减，即M值发生改变时，显示设备端可根据M值自适应匹配及调整窗口布局。
在一些实施例中，音频通道管理服务进程可包括音频通道管理模块和收音设备管理模块，通过这两个模块间的配合，实现音频输入输出通道的对接，从而搭建出每个音频播放器对应的音频传输通路。
在一些实施例中，音频通道管理模块可通过如预置或动态创建等方式，为播放器集合中的每个音频播放器创建对应的音频输入通道。音频通道管理模块还用于对音频数据输入通道进行管理，例如播放器集合中每新增一个音频播放器，音频通道管理模块可另行创建一个对应的音频输入通道，该音频输入通道的建立不受音频输出及收音设备端的影响；播放器集合中每减少一个音频播放器，音频通道管理模块就删减对应 的音频输入通道，从而使音频播放器与音频输入通道保持一对一关系。
在一些实施例中，音频播放器与音频通道管理模块之间可采用如domain socket(域套接字)等通讯形式。
在一些实施例中，收音设备管理模块可通过如预置或动态创建等方式，为收音设备集合中的每个接入同一局域网的收音设备创建对应的音频输出通道，收音设备与音频输出通道保持一对一关系。
在一些实施例中，显示设备与收音设备之间可以预先约定设备发现端口和输出通道端口，设备发现端口可采用UDP(User Datagram Protocol，用户数据报协议)，输出通道端口可采用TCP(Transmission Control Protocol，传输控制协议)。收音设备开机完成时，向设备发现端口广播收音设备自身的设备信息，所述设备信息不限于设备ID、版本号、MAC地址等所需信息；设备发现端口获取到收音设备的设备信息时，即监听到显示设备所处网络中接入了新的收音设备，然后向收音设备发送连接请求，连接请求中携带有显示设备建立音频输出通道的相关信息，包括但不限于IP地址、输出通道端口号、版本号等；收音设备在接收到连接请求后，根据请求中携带的信息，与收音设备管理模块建立socket连接，该socket连接相当于音频输出通道，显示设备接收到收音设备反馈的连接成功消息时，即可获知音频输出通道创建成功，记录音频输出通道生效。
在一些实施例中，还支持对现有socket连接进行断开后重连，即收音设备重新向设备发现端口广播设备信息，然后收音设备管理模块重新发送连接请求，从而建立新的socket连接，即相当于调整了收音设备映射的音频输出通道。
在一些实施例中，音频通道管理服务进程还可创建并维护一设备列表，所述设备列表中包括当前可用的收音设备的设备信息，所述当前可用的收音设备是指当前已接入显示设备所处网络，并且已与收音设备管理模块成功建立socket连接的收音设备，显示设备接收到收音设备反馈的连接成功消息时，在设备列表中新增该收音设备的设备信息，从而实现设备列表随同收音设备集合而同步更新。显示设备通过查询设备列表，即可获知当前可由哪些收音设备播放音频数据。
在一些实施例中，socket连接成功后，设备列表中会新增一项收音设备的设备信息，在其他场景中，收音设备有可能退出收音设备集合，例如用户将收音设备关机，或者收音设备断开网络连接，导致收音设备因无法正常接收音频数据而不可用。
在一些实施例中，例如可通过心跳检测机制，来确定收音设备是否可用。在本申请一些实施例中，显示设备周期性地向收音设备发送心跳包，若能在超时时间内接收到收音设备的应答消息，则显示设备认为收音设备是可用的；若收音设备心跳应答超时，说明收音设备可能存在关机、断电、断网等异常，则显示设备认为收音设备不可用，会将该收音设备的设备信息从设备列表中删除。通过监听收音设备集合中设备的新增或删减，同步更新设备列表，保证设备列表的实时性和准确性。
在一些实施例中，一个音频输入通道可与多个音频输出通道对接，实现某一音频数据在多个收音终端同步播放；同样地，多个音频输入通道也可对接于同一音频输出通道，实现多路音频数据混音后输出的效果；当然音频输入、输出通道也可是一对一对接，实现为每种音频数据分配给独立的收音设备。通过对音频输入、输出通道的灵活对接，可以搭建出多样化的音频传输通路，并通过音频传输通路将音频数据发送给相应的收音设备。本申请还支持对音频输入、输出通道随时建立对接或断开对接，从而对音频传输通路进行调整和变换，以适配应不同应用场景中的听音需求。
只有音频输入、输出通道达成对接关系，形成一条有效的音频传输通路时，用户才能真实听见这条音频传输通路所传输的音频数据，但音频输入、输出通道未对接则不影响音频播放器端的功能，即用户仍然能对音频播放器进行正常操作，只是无法听见该音频播放器播放的音频数据的声音。音频输入通道与哪一目标音频输出通道对接，则由该目标音频输出通道对应的收音设备对音频数据做出发声，而收音设备集合中其他的收音设备不受此任何影响。
在一些实施例中，可采用在显示设备端以UI询问的方式，由用户决策音频输入、输出通道之间的对接布局。音频播放器启动后，为其创建音频输入通道，并在显示界面上显示设备列表，参照图6的示例，显示器提示用户从设备列表中选择用以播放该音频数据的收音设备，并同时显示设备列表、确认控件和取消控件，设备列表中可包括当前可用的收音设备的设备名称/ID等信息，以便用户快速识别收音设备，每个收音设备选项设置对应的选择控件，选择控件被触发时记录对应的收音设备被选定。在本申请一些实施例中，还可设置并显示全选控件，使用户能一键快速选中设备列表中的全部收音设备，便于用户操作。
在一些实施例中，用户可从设备列表中选择一个或多个收音设备，作为接收并播放音频数据的末端功放，为便于区分，将用户初次指定的收音设备命名为第一目标收音设备，第一目标收音设备的数量不超过设备列表的上限，然后用户点击确认控件，即确认自己的选项，则建立音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，从而搭建成一条音频传输通路。
以图5为例，播放器集合中包括5个音频播放器，分别为音频播放器1、音频播放器2、音频播放器3、音频播放器4和音频播放器5；收音设备集合中包括4个收音设备，分别为收音设备1、收音设备2、收音设备3和收音设备4。音频通道管理服务进程链接于两个集合之间。
参照图5的示例，其中音频播放器3启动播放音频数据3，显示设备创建与音频播放器3对应的音频输入通道3，用户在设备列表中选定由收音设备2播放音频数据3，收音设备2对应于音频输出通道2，则显示设备建立音频输入通道3与音频输出通道2的一对一对接关系，从而搭建出一条音频传输通路为音频播放器3→音频输入通道3→音频输出通道2→收音设备2，从而将音频数据3通过该通路最终发送到收音设备2，由收音设备2播放音频数据3。
参照图5的示例，其中音频播放器4播放音频数据4，显示设备创建与音频播放器4对应的音频输入通道4，用户在设备列表中选定由收音设备3和收音设备4同时播放音频数据4，收音设备3对应于音频输出通道3，收音设备4对应于音频输出通道4，则建立音频输入通道4分别与音频输出通道3和音频输出通道4的对接关系，属于一对多对接关系，从而搭建出两条音频传输通路，分别为音频播放器4→音频输入通道4→音频输出通道3→收音设备3，以及音频播放器4→音频输入通道4→音频输出通道4→收音设备4，从而由收音设备3和收音设备4同步播放音频数据4。
在一些实施例中，参照图6的示例，用户也可直接点击取消控件，或者用户可能未从设备列表中选择收音设备(即空选)就点击了确认控件，这两种情况都导致第一目标收音设备的数量为零，则这一路音频数据无需传输给任何收音设备，这路音频数据的音频输入通道不存在对接关系，因此音频输入通道可直接将接收到的音频数据丢弃。
在一些实施例中，显示设备列表后，用户可能长时间未进行任何操作，既未选择 收音设备并触发确认控件，也未触发取消控件，即存在超时无响应的情况，由此可设置一超时时间，在显示设备列表时启动计时，若计时时间达到超时时间，显示设备始终未接收到用户对设备列表中任意一个收音设备的选定操作，则判定为用户未指定第一目标收音设备，这路音频数据的音频输入通道无对接的音频输出通道，因此音频输入通道可直接将接收到的音频数据丢弃。
在一些实施例中，显示设备在显示设备列表之前，先检测设备列表是否为空列表，若设备列表为非空列表，则控制显示器显示设备列表；反之，若设备列表为空列表，即收音设备集合为空集，说明前无可用于播放音频数据的收音设备，则显示器不显示设备列表，而是提示用户当前无可用的收音设备，以及音频输入通道直接将接收到的音频数据丢弃，不传输和播放这路音频数据。
参照图5的示例，其中音频播放器5播放音频数据5，显示设备创建与音频播放器5对应的音频输入通道5，若检测到超时时间内未接收到用户对设备列表中任意一个收音设备的选定操作，或者设备列表为空列表等第一目标收音设备为零的情况，则显示设备的处理方式为音频播放器5→音频输入通道5→音频输入通道5丢弃音频数据5。
在一些实施例中，多个音频输入通道可与同一个目标音频输出通道建立对接关系，即属于多对一对接关系，但一个音频输出通道仅支持输出单路音频，因此可以先对多个音频输入通道中传输的几路音频数据进行混音处理，得到混音数据，然后将混音数据传输给目标音频输出通道，进而将混音数据发送给目标音频输出通道对应的收音设备。
参照图5的示例，在创建音频输出通道时，收音设备管理模块可在音频输出通道的前一环节同步设置混音模块。例如，音频播放器1播放音频数据1，音频播放器2播放音频数据2，显示设备创建与音频播放器1对应的音频输入通道1，以及创建与音频播放器2对应的音频输入通道2，用户指定由收音设备1播放音频数据1和音频数据2，收音设备1对应于音频输出通道1，则建立音频输入通道1和音频输入通道2分别与音频输出通道1的对接关系，属于多对一对接关系；音频输入通道1先将音频数据1传输给混音模块，同时音频输入通道2先将音频数据2传输给混音模块，混音模块将音频数据1和音频数据2做混音处理，得到混音数据，然后将混音数据发送给音频输出通道1，即搭建出的音频传输通路为：音频播放器1/音频播放器2→音频输入通道1/音频输入通道2→混音模块→音频输出通道1→收音设备1，从而由收音设备1播放音频数据1和音频数据2的混音数据。由此可见，混音模块前端环节中，音频数据1和音频数据2是独立传输的，而经过混音模块处理后，两路音频数据被混合为一路，并共享同一个音频输出通道1。
参照图5的示例，对于一对一或一对多的对接关系，不存在多路音频共享同一音频输出通道的问题，即仅有一路音频数据输入至混音模块中，以图5中音频数据3为例，音频输入通道3将音频数据3传输到混音模块中，混音模块检测到仅有一路音频数据3输入，则不进行混音处理，并将音频数据3直接传输给音频输出通道2，这种逻辑状态下混音模块仅起到传输音频数据的作用，只有多对一对接关系生成时才会触发混音模块执行混音处理。
在一些实施例中，参照图5的示例，音频通道管理模块还可包括基于domain socket服务的控制子模块，控制子模块用于实现音频播放器与音频通道管理服务进程间的通讯交互，例如控制子模块用于接收音频播放器发送的播放控制指令、对接或切换收音 设备指令、设备列表获取请求等指令，以及向音频播放器发送设备列表、消息通知等。
在一些实施例中，以图5中的音频播放器4为例进行说明，音频播放器4启动后，向控制子模块发送携带有自身播放器ID的第一消息，控制子模块接收到第一消息，即可获知音频播放器4已加入播放器集合，则新建音频播放器4对应的音频输入通道4；音频播放器4再向控制子模块发送设备列表获取请求，控制子模块响应于设备列表获取请求，调取音频通道管理服务进程中当前的设备列表，并将设备列表发送给音频播放器4；音频播放器4接收到设备列表后，在界面上层UI显示设备列表，并根据用户针对设备列表的操作，生成并向控制子模块发送对接控制指令，对接控制指令中可携带有收音设备3和收音设备4的设备信息；控制子模块接收该对接控制指令，解析获知用户已选定收音设备3和收音设备4播放音频数据4，则进程建立音频输入通道4分别与音频输出通道3和音频输出通道4的对接关系。
在一些实施例中，音频播放器在向控制子模块发送设备列表获取请求之后，控制子模块可以向进程查询设备列表是否为空列表。若设备列表为非空列表，则将设备列表发送给音频播放器。若设备列表为空列表，则控制子模块可向音频播放器发送无可用设备消息；音频播放器接收到无可用设备消息时，即可获知设备列表为空列表，则不显示设备列表，提示用户当前无可用的收音设备。
在一些实施例中，参照图6的示例，在本申请一些实施例中，在音频播放器界面上设置切换控件，切换控件用于在音频播放器播放音频资源期间，支持用户随时根据使用意愿切换收音设备。需要说明的是，用户切换收音设备的操作不限于触发切换控件，例如可以是语音输入切换设备指令、或通过预设的快捷操作(例如在显示音频播放器界面时，点击遥控器上指定的关联按键)等。
在一些实施例中，以图5中的音频播放器3为例，音频播放器3接收到用户切换设备的操作指令时，考虑到设备列表可能发生更新(设备新增或删减)，则再次向控制子模块发送设备列表获取请求，以及在接收到控制子模块发送的当前最近的设备列表时，显示该设备列表，用户从最新的设备列表中选择需要切换到哪个或哪些收音设备，例如用户选择切换到新增的收音设备5，即指定收音设备5作为切换到的第二目标收音设备(为便与第一目标收音设备进行区分，本申请将切换后的收音设备命名为第二目标收音设备)，则音频播放器3生成并向控制子模块发送切换控制指令，切换控制指令中可携带有音频播放器3的ID+收音设备5的设备信息；控制子模块接收并解析切换控制指令时，由进程断开音频播放器3原构建的对接关系，即断开音频输入通道3与音频输出通道2的对接，并建立音频输入通道3与收音设备5对应的音频输出通道5的对接关系，从而切断音频数据3的旧音频传输通路，并构建新音频传输通路，实现音频数据3的播放端由收音设备3切换为收音设备5。
在一些实施例中，若用户关闭某音频播放器，即该音频播放器退出播放器集合，则为该音频播放器搭建的音频传输通路也不必继续维持，从而释放掉一部分进程资源。
在一些实施例中，以图5中的音频播放器1为例，若接收到对音频播放器1的关闭指令，则音频播放器1向控制子模块发送携带有音频播放器1的ID的断接控制指令；控制子模块接收到断接控制指令后，进程会断开音频输入通道1所属的全部对接关系，在图5的示例中音频输入通道1仅与一个音频输出通道对接，则进程断开音频输入通道1与音频输出通道1的对接，并删除音频输入通道1，此时音频输出通道1变换为仅对接于音频输入通道2，即收音设备1不再播放音频数据1和音频数据2的混音数据，而切换为仅播放音频数据2。
在一些实施例中，参照图6的示例，设备列表中还可标注当前每个可用的收音设备的播放状态，例如收音设备1的播放状态为“混音播放”，收音设备2的播放状态为“在播”，“在播”表示收音设备当前正在播放一路音频数据(非混音)，收音设备3和收音设备4的播放状态为“未播”，“未播”表示收音设备当前未播放任何音频数据。通过在设备列表中标注每个收音设备的播放状态，可以为用户提供对接/切换收音设备的参考因素，例如用户可能更倾向于选择“未播”状态的收音设备，规避选择“混音播放”状态的收音设备。
在一些实施例中，每个可用的收音设备的播放状态，均由音频通道管理服务进程根据对接布局进行记录和管理，参照图5的示例，音频输出通道1同时对接于音频输入通道1和音频输入通道2，因此收音设备1必然处于“混音播放”状态，又例如，音频输出通道2仅对接于音频输入通道3，因此收音设备2处于“在播”状态。音频播放器在向控制子模块请求获取设备列表后，控制子模块反馈的设备列表中包括收音设备的设备信息和当前播放状态。
针对某路音频数据，用户会从设备列表中选定要对接或切换的收音设备，在该收音设备播放这路音频数据的过程中，若收音设备出现断电、关机或网络连接异常等问题，会导致该收音设备因断开网络连接而不可用，无法接收及播放显示设备发送的音频数据。
在一些实施例中，可采用比如心跳检测等方式，监听收音设备A的连接状态，若检测到收音设备A断开网络连接，则在设备列表中删除收音设备A的设备信息及播放状态，使得显示设备端无法通过设备列表对接/切换为收音设备A。针对为收音设备A对应构建的音频输出通道A，在本申请一些实施例中，收音设备管理模块直接删除音频输出通道A，这样进程中音频输出通道A所属的对接关系也全部被解除，从而在收音设备A工作异常的情况下切断通向收音设备A的各个音频传输通路，收音设备A原播放的音频数据会被相应的音频输入通道丢弃。
在一些实施例中，参照图7(a)的UI示例，假设显示设备当前已启动两个音频播放器，分别为音频播放器A和音频播放器B，两个音频播放器的窗口是同行排布的，在本申请一些实施例中，在每个窗口中的指定位置显示当前对接的收音设备名称，例如图7(a)中音频播放器A的窗口左上角显示“收音设备A正在播放中”，音频播放器B尚未对接任何收音设备，则无收音设备名称显示。
在一些实施例中，在设备列表中删除收音设备A的设备信息及播放状态，以及删除音频输出通道A之后，控制子模块可向音频播放器A发送设备断网消息，音频播放器A接收到设备断网消息时，参照图7(b)的示例，在音频播放器A的窗口可提示用户收音设备A当前不可用，请检查收音设备A，同时音频播放器A的窗口左上角取消显示“收音设备A正在播放中”。用户查看到窗口中的该提示信息后，即可获知收音设备A出现异常，可以对收音设备A进行故障排查，并重新建立与终端设备的socket连接。
在一些实施例中，音频播放器A接收到设备断网消息时，参照图7(c)的示例，例如以第一提示弹窗形式，在音频播放器A的窗口中提示用户收音设备A当前不可用，以及询问用户是否切换为由其他可用的收音设备播放音频数据A。图7(c)示例的第一提示弹窗中还包括取消控件和切换控件，用户若触发第一提示弹窗中的取消控件，则可关闭第一提示弹窗，音频播放器A不切换对接对象，音频数据A被音频输入通道A丢弃，音频数据A无播放出声；若用户触发第一提示弹窗中的切换控件，则可关闭 第一提示弹窗，音频播放器A向控制子模块再次请求获取最新的设备列表，并在音频播放器A的窗口中显示该设备列表，以便用户从设备列表中选择所要切换到的对接对象，即由其他可用的收音设备将音频数据A播放出声。
在一些实施例中，在收音设备A断网后，用户可能对收音设备A进行故障排查，并重新恢复与显示设备的socket连接，即重新构建及触发音频输出通道A生效，则音频通道管理服务进程会在检测到socket连接成功时，在设备列表中增加收音设备A的设备信息，由于收音设备A重连后尚未对接任何音频播放器，因此此时设备列表中记录收音设备A的播放状态为“未播”。
在一些实施例中，由于收音设备A断网前映射于音频播放器A，因此在收音设备A重连成功后，控制子模块可向音频播放器A发送设备回归消息，所述设备回归消息用于指示收音设备A已重新接入并可用；音频播放器A接收到设备回归消息时，参照图7(d)的示例，例如以第二提示弹窗形式，在音频播放器A的窗口中提示用户收音设备A已恢复可用，以及询问用户是否重新切换回由收音设备A播放音频数据A，即相当于询问用户是否将收音设备A恢复为断网前的对接及播放状态。图7(d)示例的第二提示弹窗中还包括取消控件和确认控件，用户若触发第二提示弹窗中的取消控件，则可关闭第二提示弹窗，音频播放器A维持当前播放现状，音频输入通道A与音频输出通道A不对接，收音设备A不接收、不播放音频数据A；用户若触发第二提示弹窗中的确认控件，则可关闭第二提示弹窗，音频通道管理服务进程建立音频输入通道A与音频输出通道A的对接关系，从而搭建从音频播放器A至收音设备A的音频传输通路，实现在收音设备A断网重连后，恢复到由收音设备A继续接收及播放音频数据A。
需要说明的是，可根据实际音频播放场景、收音设备的可用性、用户听音需求等多方面因素，在图5示例的音频传输架构的基础上，灵活地对多路音频播放器运行场景下的音频传输方法进行适应性变型、改进和扩展，得到更多样化的、可行的UI和程序方案，而不仅限于本申请说明书提供的实施例。另外，本申请提供的UI仅是为便于描述方案而作出的示意，不代表实际产品设计，UI的交互、操作流程及显示效果应以实际应用和设计为准。
前述各实施例是从底层架构的角度，描述多路音频播放器运行场景下音频数据的传输及播放方案。在其他实施方式中，图8提供一种音频播放方法，是从显示设备的控制器角度，描述对音频数据的输出及播放控制，所述控制器被配置执行的方法至少包括如下程序步骤：
步骤S01，在音频播放器启动播放音频数据时，创建与所述音频播放器相链接的音频输入通道。
步骤S02，显示设备列表，所述设备列表中包括当前可用的收音设备的设备信息。
步骤S03，在接收到对所述设备列表中第一目标收音设备的选定操作时，建立所述音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，形成第一音频传输通路。
步骤S04，将所述音频数据通过所述第一音频传输通路发送给所述第一目标收音设备，以使第一目标收音设备播放接收到的所述音频数据。
通过步骤S01～步骤S04，可以实现为每个音频播放器分配指定的收音设备，通过在音频播放器和收音设备之间搭建音频输入、输出的对接通道，使音频数据能顺利传输到收音设备内，从而由收音设备将音频数据转化为声音进行播放。
在本申请一些实施例中，所述方法还包括：在接收到用户切换设备的操作指令时，断开所述音频输入通道与所述第一音频输出通道的对接关系；根据所述操作指令指示被切换到的第二目标收音设备，建立所述音频输入通道与所述第二目标收音设备对应的第二音频输出通道间的对接关系，形成第二音频传输通路；将所述音频数据通过所述第二音频传输通路发送给所述第二目标收音设备，以使第二目标收音设备播放接收到的所述音频数据。该实施例进一步实现根据用户对听音设备的需求变换，来切换音频播放器所链接的收音设备。
在本申请一些实施例中，所述方法还包括：在监听到显示设备所处网络中接入收音设备时，获取所述收音设备的设备信息；构建与所述收音设备对应的音频输出通道，并向所述收音设备发送携带有音频输出通道信息的连接请求；在接收到所述收音设备反馈的连接成功消息时，记录所述音频输出通道生效，以及在所述设备列表中增加所述收音设备的设备信息。该实施例进一步提供收音设备与显示设备的连接，构建音频输出通道的方案，以及在接入新收音设备时，同步更新和管理设备列表，以保证显示设备端显示给用户的设备列表是实时最新的和准确的。
在本申请一些实施例中，所述方法还包括：若检测到所述设备列表为空列表，则不显示所述设备列表，控制显示器显示用于提示当前无可用收音设备的信息；控制所述音频输入通道丢弃所述音频数据。该实施例进一步根据设备列表是否为空，来确定显示设备端是否需要显示设备列表，若无可用的收音设备，音频输入通道直接丢弃音频数据，音频数据不会被有声播放。
在本申请一些实施例中，在启动蓝牙扫描功能之后，所述方法还包括：在显示设备列表之后，若在超时时间内始终未接收到对所述设备列表中任意一个收音设备的选定操作，控制所述音频输入通道丢弃所述音频数据。若存在超时未选定收音设备的情况，则音频播放器不存在映射的收音设备，音频输入通道无对接的音频输出通道，音频输入通道直接丢弃音频数据即可。
在本申请一些实施例中，所述方法还包括：在接收到对所述音频播放器的关闭指令时，断开所述音频输入通道与一个或多个音频输出通道已建立的对接关系，并删除所述音频输入通道。该实施例进一步提供在关闭音频播放器，退出音频数据的播放时，该音频播放器链接的音频输入通道所属的全部对接关系均被解除，并且音频输入通道一并被删除，从而撤销该路音频数据的所有音频传输通路，音频数据被停止传输及播放。
在本申请一些实施例中，所述方法还包括：在多个音频输入通道与同一个目标音频输出通道建立对接关系时，对多个音频输入通道中传输的音频数据进行混音处理，得到混音数据；将所述混音数据传输至所述目标音频输出通道，进而将所述混音数据发送给所述目标音频输出通道对应的收音设备。该实施例进一步提供存在多对一对接关系时，需要将多路音频数据混音成一股后进行输出及播放。
在本申请一些实施例中，所述方法还包括：在检测到所述第一/第二目标收音设备断开网络连接时，在所述设备列表中删除所述第一/第二目标收音设备的设备信息；删除所述第一/第二音频输出通道，并控制所述音频输入通道丢弃所述音频数据；通过显示器提示用户所述第一/第二目标收音设备当前不可用，以及询问用户是否切换为由其他可用的收音设备播放所述音频数据。该实施例进一步提供收音设备在播放音频数据时若突然断网，则同步更新设备列表，以及切断通向该收音设备的全部音频传输通路，以及显示设备端UI提示用户收音设备不可用，用户可选择不再继续收听该收音设备所 播放的音频数据，或者也可切换其他可用收音设备去播放音频数据。
在本申请一些实施例中，所述方法还包括：在检测到所述第一/第二目标收音设备于断网后再次接入网络时，再次获取所述第一/第二目标收音设备的设备信息；根据重新构建的第一/第二音频输出通道，向所述第一/第二目标收音设备发送携带有第一/第二音频输出通道信息的重连请求；在接收到所述第一/第二目标收音设备反馈的连接成功消息时，触发所述第一/第二音频输出通道生效，以及在所述设备列表中增加所述第一/第二目标收音设备的设备信息；通过显示器提示用户所述第一/第二目标收音设备当前可用，以及询问用户是否重新切换为由所述第一/第二目标收音设备播放所述音频数据。该实施例进一步提供在收音设备断网重连，重新构建音频输出通道后，同步更新设备列表，以及显示设备端UI提示之前不可用的收音设备现已可用，用户可选择保持当前播放现状，或者也可由恢复可用的收音设备继续播放音频数据。
控制器执行方法的具体实施细节及具备的技术效果，可与前述基于音频传输架构和UI示例的方案进行相互参照和印证，因此不再赘述。通过本申请提供的音频传输架构，扩展了显示设备的音频播放能力，能实现多路音频同步播放，并可根据不同用户的听音需求，将每路音频数据分发给一个或多个指定的收音设备，能实现多人场景中各用户根据自身听音需求各听各自的音频，提升用户体验。
在一些实施例中，图9示出了音频信号处理逻辑的架构一，架构一中包括但不限于音频解码器、SOC芯片和至少一个已连接并可用的音频播放器(即音频播放器1～音频播放器n)，音频播放器可以是显示设备内置的扬声器或者通过指定接口连接的功放设备，例如是音响、耳机等，其中用于连接音频信号输出通道的接口比如是AMP接口、HP接口和SPDIF接口，或者是HDMI接口等。音频数据经过音频解码器解码后，转换为PCM(Pulse Code Modulation，脉冲编码调制)格式的音频信号并输入至进入SOC芯片；SOC芯片查询当前启用的目标音频播放器，并输出音频信号给目标音频播放器，目标音频播放器通过自身的通道输出并播放音频信号。
在一些实施例中，每路音频输出通道可以进行独立控制，包括音量控制、音效控制、静音模式启闭控制和DRC控制等。
在一些实施例中，SOC芯片支持DRC功能，SOC芯片可内置DRC模块，为便于区分，命名为第一DRC模块，配置并实现SOC芯片的DRC功能，即根据当前音频信号的强度/幅值，调节信号增益，例如若当前信号强度/幅值过大，为避免音频播放器长时间高功率运行导致故障甚至烧毁，可以对音频信号的强度/幅值进行压缩，使音频信号呈现一定程度的衰减；若当前信号强度/幅值过小，DRC功能可降低音频信号的衰减幅度或不衰减，实现音频信号的动态范围控制。DRC仅能对音频信号进行衰减或至多不衰减，而不会对音频信号进行反向增强。
在一些实施例中，每个音频播放器包括音量调节模块，音量调节模块用于根据用户输入的目标音量，获取音量增益，进而将音频播放器的输出音量调整至所述目标音量，实现音量控制。
在一些实施例中，每个音频播放器具有各自的功放类型，比如为模拟型功放或数字型功放，模拟型功放不支持DRC功能，数字型功放具备DRC功能。数字型功放同样内置有DRC模块，为便于区分，命名为第二DRC模块，配置并实现数字型功放的DRC功能。音量调节模块和第二DRC模块均位于数字型功放的输出通道内，并且第二DRC模块位于输出通道的末端，音频信号遍历前序其他环节后，由末端环节进行DRC控制，从而使数字型功放最终输出合适的音频信号。
在一些实施例中，若音频播放器为数字型功放，则优先开启并使用音频播放器自身具备的DRC功能，使SOC芯片的DRC功能保持关闭状态，此时SOC芯片主要起到接收解码后的音频信号，并将音频信号传输给目标音频播放器的作用；若音频播放器为模拟型功放，则不支持DRC功能，则需开启并使用SOC芯片的DRC功能。
在一些实施例中，显示设备设置有音频输出(Audio Output)页面，该页面中显示有当前已连接并可用的音频播放器，用户可从中选择至少一个作为目标音频播放器，目标音频播放器被启用后即可输出并播放音频信号；或者也可无需用户指定，而是按照预设的优先级，自动启用当前优先级最高的音频播放器输出音频。需要说明的是，当显示设备具有多个可用的音频播放器时，选取目标音频播放器的方式不限于本申请实施例所述。
若目标音频播放器属于模拟型功放，则需要开启SOC芯片中第一DRC模块的功能，由图9的示例可知，在第一DRC模块根据当前音量对音频信号进行调节后，由于后序的目标音频播放器中还具有音量调节模块这一影响信号输出的增益环节，可能导致最终输出的音频信号与DRC调节后的音频信号不一致。例如，SOC芯片执行DRC调节，压缩音频信号的幅度后，若此时用户调低音量，则音频信号会被二次衰减，而音频信号过渡衰减会导致用户无法听清音频内容，用户听觉体验差。
考虑上述技术问题，在一些实施例中，参照图10提供的音频信号处理逻辑的架构二，预先设置SOC芯片中第一DRC模块与音量调节模块的映射关联，相当于将SOC芯片的DRC和功放音量这两个音频信号的输出控制功能在软件层面进行统一绑定(不涉及硬件转移)，绑定后续则不存在其他影响信号输出的增益环节，目标音频播放器只需直接输出音频信号。通过第一DRC模块和音量调节模块的预设关联关系，使SOC芯片的DRC与音量增益调节能够相互约束并联动，例如用户将音量调大，则SOC芯片通过DRC功能将音频信号的幅度进行适当压缩；若用户将音量调小，则SOC芯片可降低对音频信号的DRC衰减幅度甚至不衰减，实现SOC芯片的DRC增益与音量增益互补，既可以保护功放设备，避免功放设备因输出功率/音量过大而损坏，还能在音量较低时适当增大信号幅值，提升音频信号的输出效果，给用户提供更好的听感。
在一些实施例中，假设显示设备当前已连接并可用的音频播放器数量为n，其中有m个音频播放器为模拟型功放，另外n-m个音频播放器为数字型功放，m小于或等于n。n-m个数字型功放支持DRC功能，即具有第二DRC模块，在输出音频信号时不激活SOC芯片的第一DRC模块的功能执行，因此无需设置第一DRC模块与数字型功放中的音量调节模块的预设关联关系；m个模拟型功放均不支持DRC功能，需要激活SOC芯片的第一DRC模块，因此预先对m个模拟型功放分别建立与第一DRC模块的预设关联关系，即得到m个预设关联关系。
在一些实施例中，若n个可用的音频播放器中已启用一个目标音频播放器，在音频信号解码后，检测该目标音频播放器的功放类型，若为数字型功放，则解码后的音频信号经SOC芯片传输给目标音频播放器，并经过目标音频播放器内的音量调节模块、第二DRC模块等环节处理后被输出。
若为模拟型功放，根据目标音频播放器的设备ID，从m个预设关联关系中，查找与该设备ID对应的目标预设关联关系，并根据目标预设关联关系和用户输入的目标音量，来匹配第一DRC模块对音频信号进行DRC处理时所采用的目标增益值，即所述目标增益值用于表征为适配目标音量而对音频信号作出的DRC增益，DRC模块对音频信号的衰减幅度是通过增益体现的，在本申请一些实施例中，可将DRC增益的单位 折算为dB(分贝)，由于DRC模块不会增强音频信号，而是衰减或不衰减，因此DRC增益的分贝值为非正数，例如若DRC增益为-5dB，则可将音频信号衰减5dB。第一DRC模块按照匹配到的目标增益值对音频信号进行DRC处理后，将音频信号发送给目标音频播放器，目标音频播放器中的音量调节模块再将音频信号调至目标音量，使得目标音频播放器最终输出与目标增益值和目标音量匹配的音频信号。
在一些实施例中，若用户从n个可用的音频播放器中选择多个(超过一个)目标音频播放器，例如选择音响和耳机，则分别检测这些目标音频播放器的功放类型，并根据功放类型，决策每一目标音频播放器的信号输出模式，每个目标音频播放器的信号输出控制都是独立的。
“DRC”和“音量”是音频信号输出过程中的两个处理环节，当目标音频播放器为模拟型功放时，这两个环节在软件功能层面上处于关联绑定且联动的关系，通过这种关系，实现根据音量对SOC芯片的DRC增益进行匹配和约束，但在实际硬件处理层面，这两个环节又是相对独立的，SOC芯片是根据目标增益值对音频信号进行DRC处理，目标音频播放器是根据目标音量对音频信号进行音量调节，即两个环节使用的参数及处理逻辑不同，实现对音频信号不同指标的输出控制。本申请通过“DRC”和“音量”两个环节间这种类似“对立统一”的关系，既保证模拟型功放的安全性，并改善了音频信号的输出和播放效果，从而为用户提供更好的听觉体验。
基于图10所示的架构二，图11示出一种音频信号输出控制方法，所述方法的执行受控于控制器250，所述方法包括如下处理：
步骤S10，在解码后的音频信号输入至SOC芯片之后，检测当前启用的目标音频播放器的功放类型。
步骤S20，判断所述功放类型是否为模拟型功放。若为模拟型功放，则执行步骤S30～步骤S60所述的模式一；若为数字型功放，则执行步骤S70～步骤S90所述的模式二。
步骤S30，开启SOC芯片内置的第一DRC模块的功能。
步骤S40，根据第一DRC模块与目标音频播放器中音量调节模块的预设关联关系，以及用户输入的目标音量，匹配目标增益值。
在步骤S40中，获取所述预设关联关系指定的增益阈值，计算增益阈值与目标音量的差值，并将该差值作为目标增益值，即目标增益值＝增益阈值-目标音量，这样在用户调高音量(即目标音量增大)时，目标增益值相对减小，即第一DRC模块对音频信号进行适当衰减，以避免目标音频播放器输出功率过大而损坏；若用户调低音量(即目标音量减小)时，目标增益值相对增大，即第一DRC模块降低对音频信号的衰减幅度或不衰减，以避免音频信号过小而听不清楚。
该实施例通过对SOC芯片的DRC增益与音量增益调节之间提供具体的阈值约束，在创建每个模拟型功放的预设关联关系时，预设关联关系中都可指定有适配于模拟型功放的增益阈值，以使音量与DRC增益之和始终等于增益阈值，从而实现根据目标音量和增益阈值，自适应匹配SOC芯片的DRC增益。
在一些实施例中，增益阈值S小于或等于预设的增益上限值S max；其中，所述增益上限值＝volume max+DRCgain max，volume max表示目标音频播放器能够输出的最大音量，DRCgain max为第一DRC模块获取的与volume max匹配的增益值。该实施例中进一步限定了增益阈值，该增益阈值小于或等于增益上限值，例如在显示设备调试阶段，在音频播放器输出最大音量时，基于音频播放器不会被烧毁以及音频信号输出效果角度， 获取适配于volume max的较佳的增益值作为DRCgain max，则volume max与DRCgain max之和即为增益上限值，只要增益阈值不超过该上限值，即可保证功放设备无烧毁风险，从而兼顾音频播放器的使用安全性和信号输出效果。
在一些实施例中，在获取到增益上限值S max后，即可设置增益阈值S，在本申请一些实施例中，S＝k*S max，其中k为可调系数，0＜k≤1，通过设置可调系数k来调整增益阈值S。在其他可选方案中，也可默认设置增益阈值S＝增益上限值S max，该设置方式下增益阈值为固定值。
步骤S50，控制第一DRC模块按照目标增益值对音频信号进行DRC处理，并将处理后的音频信号发送给目标音频播放器。
步骤S60，控制目标音频播放器将音频信号调至目标音量，并输出与所述目标增益值和所述目标音量匹配的音频信号。
步骤S70，开启目标音频播放器内置的第二DRC模块的功能，使第一DRC模块的功能保持关闭状态。
步骤S80，控制SOC芯片将音频信号发送给目标音频播放器。
步骤S90，控制目标音频播放器对音频信号依次进行音量及DRC处理，并输出处理后的音频信号。
在一些实施例中，当目标音频播放器数量为多个时，例如包括数字型音响和模拟型耳机，即多功放混合型场景，则模拟型耳机按照模式一输出音频信号，数字型音响按照模式二输出音频信号，从而根据功放类型自适应匹配音频信号输出模式。
上述实施例适用于目标音频播放器有声输出的场景，若用户将目标音频播放器切换为静音模式，对于模式一，第一DRC模块的工作不受影响，由音量调节模块执行静音处理，即降低模拟型功放的输出功率，当模拟型功放最终输出音频信号的功率低于一定程度，则呈现出音量为零(无声)的播放效果，当用户解除模拟型功放的静音模式后，按照前述模式一，根据用户输入的目标音量(若用户未调节音量，则取当前音量)，自适应调节音频信号输出时的音量及信号幅度，恢复音频信号的有声输出。
在一些实施例中，若用户在模式二下切换静音模式，末端的第二DRC模块的工作同样不受影响，由音量调节模块执行静音处理，由于静音处理后音频信号的功率降至很小，已不足以触发第二DRC模块对音频信号进行压缩，即第二DRC模块可无需再对音频信号进行衰减，最终呈现出音量为零(无声)的播放效果，在静音模式被解除后，按照前述模式二控制数字型功放的音频输出，恢复音频信号的有声输出。
需要说明的是，根据实际音频输出及播放的场景要求、用户实际操作、音频播放器的功放类型及数量等因素，在前述各实施例示例的音频信号输出控制逻辑的基础上，对音频信号处理逻辑架构及具体实现方式进行变型或扩展，不限于本申请实施例所述。另外，本申请主要描述了音频信号输出指标中的“DRC信号幅度”和“音量”，对于如音效、声道等其他方面不作具体限定。
在一些实施例中，本发明还提供一种计算机可读的非易失性存储介质，该计算机存储介质可存储有程序，该程序执行时可包括本申请实施例涉及的音频传输及播放方法的程序步骤。其中，计算机存储介质可为磁碟、光盘、ROM或RAM等。
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的 各种不同的变形的实施方式。

Claims (20)

  1. 一种显示设备，包括：
    显示器，用于显示用户界面和图像；
    通信器，用于与外部设备通信连接，所述外部设备包括一个或多个收音设备；
    控制器，与所述显示器和通信器连接，配置为运行指令以使得所述显示设备执行：
    响应所述显示设备的音频播放器启动音频数据播放，创建与所述音频播放器相链接的音频输入通道；
    控制所述显示器显示设备列表，所述设备列表包括与所述通信器连接的且当前可用的至少一个收音设备的设备信息；
    响应于接收对所述设备列表中第一目标收音设备的选定操作，建立所述音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，形成第一音频传输通路；
    将所述音频数据通过所述第一音频传输通路发送给所述第一目标收音设备，以使第一目标收音设备播放接收到的所述音频数据。
  2. 根据权利要求1所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于接收到用户切换收音设备的操作指令，断开所述音频输入通道与所述第一音频输出通道的对接关系；
    根据所述操作指令指示被切换到的第二目标收音设备，建立所述音频输入通道与所述第二目标收音设备对应的第二音频输出通道间的对接关系，形成第二音频传输通路；
    将所述音频数据通过所述第二音频传输通路发送给所述第二目标收音设备，以使第二目标收音设备播放接收到的所述音频数据。
  3. 根据权利要求1或2所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于监听到显示设备所处网络中接入收音设备，获取所述收音设备的设备信息；
    构建与所述收音设备对应的音频输出通道，并向所述收音设备发送携带有音频输出通道信息的连接请求；
    响应于接收到所述收音设备反馈的连接成功消息，记录所述音频输出通道生效，以及在所述设备列表中增加所述收音设备的设备信息。
  4. 根据权利要求1所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于检测到的所述设备列表为空列表，则不显示所述设备列表，显示用于提示当前无可用收音设备的信息；
    控制所述音频输入通道丢弃所述音频数据。
  5. 根据权利要求1所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    在启动蓝牙扫描功能之后，在显示设备列表之后，响应于超时时间内始终未接收到对所述设备列表中任意一个收音设备的选定操作，控制所述音频输入通道丢弃所述音频数据。
  6. 根据权利要求1所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于接收到对所述音频播放器的关闭指令，断开所述音频输入通道与一个或多个音频输出通道已建立的对接关系，并删除所述音频输入通道。
  7. 根据权利要求1或2所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于多个音频输入通道与同一个目标音频输出通道建立对接关系时，对多个音频输入通道中传输的音频数据进行混音处理，得到混音数据；
    将所述混音数据传输至所述目标音频输出通道，进而将所述混音数据发送给所述目标音频输出通道对应的收音设备。
  8. 根据权利要求3所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于检测到所述第一目标收音设备断开网络连接，在所述设备列表中删除所述第一目标收音设备的设备信息；
    删除所述第一音频输出通道，并控制所述音频输入通道丢弃所述音频数据；
    通过显示器提示用户所述第一目标收音设备当前不可用，以及询问用户是否切换为由其他可用的收音设备播放所述音频数据。
  9. 根据权利要求8所述的显示设备，所述控制器还配置为运行指令以使得所述显示设备执行：
    响应于检测到所述第一目标收音设备于断网后再次接入网络，再次获取所述第一目标收音设备的设备信息；
    根据重新构建的第一音频输出通道，向所述第一目标收音设备发送携带有第一音频输出通道信息的重连请求；
    响应于接收到所述第一目标收音设备反馈的连接成功消息，触发所述第一音频输出通道生效，以及在所述设备列表中增加所述第一目标收音设备的设备信息；
    在显示器提示用户所述第一目标收音设备当前可用，以及询问用户是否重新切换为由所述第一目标收音设备播放所述音频数据。
  10. 一种音频控制方法，包括：
    响应于音频播放器启动播放音频数据时，创建与所述音频播放器相链接的音频输入通道；
    显示设备列表，所述设备列表中包括当前可用的收音设备的设备信息；
    响应于接收到对所述设备列表中第一目标收音设备的选定操作时，建立所述音频输入通道与第一目标收音设备对应的第一音频输出通道间的对接关系，形成第一音频传输通路；
    将所述音频数据通过所述第一音频传输通路发送给所述第一目标收音设备，以使第一目标收音设备播放接收到的所述音频数据。
  11. 一种显示设备，包括：
    至少一种音频播放器，用于输出音频信号；
    控制器，用于执行：
    在解码后的音频信号输入至SOC芯片之后，响应于检测到当前启用的目标音频播放器属于模拟型功放，则开启所述SOC芯片内置的第一DRC模块的功能；
    根据所述第一DRC模块与所述目标音频播放器中音量调节模块的预设关联关系，以及用户输入的目标音量，匹配目标增益值；
    控制所述第一DRC模块按照所述目标增益值对音频信号进行DRC处理，并将处 理后的音频信号发送给所述目标音频播放器，以使所述目标音频播放器输出与所述目标增益值和所述目标音量匹配的音频信号。
  12. 根据权利要求11所述的显示设备，所述控制器按照如下方式匹配所述目标增益值：
    获取所述预设关联关系指定的增益阈值；
    计算所述增益阈值与所述目标音量的差值，并将所述差值作为所述目标增益值。
  13. 根据权利要求12所述的显示设备，其特征在于，所述增益阈值小于或等于预设的增益上限值；其中，所述增益上限值＝volume max+DRCgain max，volume max表示所述目标音频播放器能够输出的最大音量，DRCgain max为第一DRC模块获取的与volume max匹配的增益值。
  14. 根据权利要求11所述的显示设备，所述控制器还用于执行：
    响应于检测到所述目标音频播放器属于数字型功放，则开启所述目标音频播放器内置的第二DRC模块的功能，使所述第一DRC模块的功能保持关闭状态；其中，所述音量调节模块和所述第二DRC模块均位于所述目标音频播放器的输出通道内，且所述第二DRC模块位于所述输出通道的末端；
    控制SOC芯片将音频信号发送给所述目标音频播放器；
    控制所述目标音频播放器对音频信号依次进行音量及DRC处理，并输出处理后的音频信号。
  15. 根据权利要求14所述的显示设备，所述控制器还用于执行：
    响应于检测到所述目标音频播放器的数量大于1，则根据每个目标音频播放器所属的功放类型，分别控制每个目标音频播放器输出音频信号；其中，所述功放类型包括模拟型功放和数字型功放。
  16. 一种音频控制方法，包括：
    在解码后的音频信号输入至SOC芯片之后，响应于检测到当前启用的目标音频播放器属于模拟型功放，则开启所述SOC芯片内置的第一DRC模块的功能；
    根据所述第一DRC模块与所述目标音频播放器中音量调节模块的预设关联关系，以及用户输入的目标音量，匹配目标增益值；
    控制所述第一DRC模块按照所述目标增益值对音频信号进行DRC处理，并将处理后的音频信号发送给所述目标音频播放器，以使所述目标音频播放器输出与所述目标增益值和所述目标音量匹配的音频信号。
  17. 根据权利要求16所述的方法，所述匹配所述第一DRC模块处理音频信号所采用的目标增益值，包括：
    获取所述预设关联关系指定的增益阈值；
    计算所述增益阈值与所述目标音量的差值，并将所述差值作为所述目标增益值。
  18. 根据权利要求17所述的方法，所述增益阈值小于或等于预设的增益上限值；其中，所述增益上限值＝volume max+DRCgain max，volume max表示所述目标音频播放器能够输出的最大音量，DRCgain max为第一DRC模块获取的与volume max匹配的增益值。
  19. 根据权利要求16所述的方法，所述方法还包括：
    响应于检测到所述目标音频播放器属于数字型功放，则开启所述目标音频播放器内置的第二DRC模块的功能，使所述第一DRC模块的功能保持关闭状态；其中，所述音量调节模块和所述第二DRC模块均位于所述目标音频播放器的输出通道内，且所述第二DRC模块位于所述输出通道的末端；
    控制SOC芯片将音频信号发送给所述目标音频播放器；
    控制所述目标音频播放器对音频信号依次进行音量及DRC处理，并输出处理后的音频信号。
  20. 根据权利要求19所述的方法，所述方法还包括：
    响应于检测到所述目标音频播放器的数量大于1，则根据每个目标音频播放器所属的功放类型，分别控制每个目标音频播放器输出音频信号；其中，所述功放类型包括模拟型功放和数字型功放。
PCT/CN2022/089923 2021-09-07 2022-04-28 一种音频控制方法及显示设备 WO2023035630A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202280057202.2A CN117836754A (zh) 2021-09-07 2022-04-28 一种音频控制方法及显示设备

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111041988.2A CN113687811A (zh) 2021-09-07 2021-09-07 一种音频信号输出控制方法及显示设备
CN202111041988.2 2021-09-07
CN202111074290.0 2021-09-14
CN202111074290.0A CN113794928B (zh) 2021-09-14 2021-09-14 一种音频播放方法及显示设备

Publications (1)

Publication Number Publication Date
WO2023035630A1 true WO2023035630A1 (zh) 2023-03-16

Family

ID=85507209

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/089923 WO2023035630A1 (zh) 2021-09-07 2022-04-28 一种音频控制方法及显示设备

Country Status (2)

Country Link
CN (1) CN117836754A (zh)
WO (1) WO2023035630A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105099384A (zh) * 2015-07-01 2015-11-25 深圳天珑无线科技有限公司 提升移动终端外放音量的方法及移动终端
US20170078824A1 (en) * 2015-09-11 2017-03-16 Samsung Electronics Co., Ltd. Electronic apparatus, audio system and audio output method
CN108063874A (zh) * 2017-12-26 2018-05-22 上海展扬通信技术有限公司 一种信息处理方法、装置、终端以及计算机可读存储介质
CN108268119A (zh) * 2016-12-30 2018-07-10 三星电子株式会社 操作片上系统的方法、片上系统和电子系统
CN208257952U (zh) * 2018-06-26 2018-12-18 冠捷显示科技（厦门）有限公司 一种声音增益自动均衡调节的电视
CN109857364A (zh) * 2019-01-28 2019-06-07 Oppo广东移动通信有限公司 音频播放方法及装置、存储介质、通信终端
CN113687811A (zh) * 2021-09-07 2021-11-23 青岛海信传媒网络技术有限公司 一种音频信号输出控制方法及显示设备
CN113794928A (zh) * 2021-09-14 2021-12-14 青岛海信传媒网络技术有限公司 一种音频播放方法及显示设备

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105099384A (zh) * 2015-07-01 2015-11-25 深圳天珑无线科技有限公司 提升移动终端外放音量的方法及移动终端
US20170078824A1 (en) * 2015-09-11 2017-03-16 Samsung Electronics Co., Ltd. Electronic apparatus, audio system and audio output method
CN108268119A (zh) * 2016-12-30 2018-07-10 三星电子株式会社 操作片上系统的方法、片上系统和电子系统
CN108063874A (zh) * 2017-12-26 2018-05-22 上海展扬通信技术有限公司 一种信息处理方法、装置、终端以及计算机可读存储介质
CN208257952U (zh) * 2018-06-26 2018-12-18 冠捷显示科技（厦门）有限公司 一种声音增益自动均衡调节的电视
CN109857364A (zh) * 2019-01-28 2019-06-07 Oppo广东移动通信有限公司 音频播放方法及装置、存储介质、通信终端
CN113687811A (zh) * 2021-09-07 2021-11-23 青岛海信传媒网络技术有限公司 一种音频信号输出控制方法及显示设备
CN113794928A (zh) * 2021-09-14 2021-12-14 青岛海信传媒网络技术有限公司 一种音频播放方法及显示设备

Also Published As

Publication number Publication date
CN117836754A (zh) 2024-04-05

Similar Documents

Publication Publication Date Title
US8230012B2 (en) Internet video conferencing on a home television
US10932210B2 (en) Content output device and control method thereof
CN113794928B (zh) 一种音频播放方法及显示设备
KR20110054609A (ko) 블루투스 디바이스의 원격 제어 방법 및 장치
EP3343352B1 (en) Method, apparatus and device for instructing operations on terminal device
CN112272417B (zh) 一种双蓝牙音响回连方法及显示设备
US9509947B2 (en) Method and apparatus for transmitting file during video call in electronic device
US20230138804A1 (en) Enhanced video call method and system, and electronic device
US20100201876A1 (en) Multimedia management device, system, and method
WO2022078065A1 (zh) 显示设备资源播放方法及显示设备
CN115454367A (zh) 一种显示设备及显示设备控制方法
CN112637957A (zh) 显示设备及显示设备与无线音箱的通信方法
CN112507329A (zh) 安全防护方法及装置
WO2023035630A1 (zh) 一种音频控制方法及显示设备
WO2023202131A1 (zh) 设备互联方法、装置、电子设备及存储介质
CN114615536B (zh) 显示设备及音效处理方法
CN113687811A (zh) 一种音频信号输出控制方法及显示设备
WO2018096849A1 (ja) 情報処理装置、情報処理方法、及びプログラム
CN114615529A (zh) 显示设备、外接设备及音频播放方法
WO2022088899A1 (zh) 显示设备、显示设备与外接音响的通信方法及外接音响音频输出方法
WO2024001535A1 (zh) 一种显示设备、播放设备、控制设备和数据传输方法
WO2022001424A1 (zh) 一种显示设备
WO2024060750A1 (zh) 蓝牙切换方法和装置、蓝牙连接方法和装置及电子设备
WO2022100252A1 (zh) 一种显示设备
US11900007B2 (en) Display apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22866108

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280057202.2

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE