WO2021135068A1

WO2021135068A1 - Selection control method for sound output device, and display device

Info

Publication number: WO2021135068A1
Application number: PCT/CN2020/094098
Authority: WO
Inventors: 李现旗
Original assignee: 海信视像科技股份有限公司
Priority date: 2020-01-03
Filing date: 2020-06-03
Publication date: 2021-07-08
Also published as: CN111208969A

Abstract

The present application provides a selection control method for a sound output device. Said method and a display device both comprise: in response to receiving a device selection instruction inputted by a user on a setting interface, setting a sound output device indicated by the device selection instruction as a working device, and displaying, on the setting interface, a device option of the sound output device as a selected state. By means of the method and the display device provided in the present embodiment, a user can directly switch a target sound output device by means of a setting interface of a sound output device, having simple and convenient operation and good user experience.

Description

Method for selecting and controlling sound output equipment and display equipment

This application requires that it be submitted to the Chinese Patent Office on January 3, 2020, the application number is CN202010006943.0, and the application name is "a method for selecting and controlling a sound output device and a display device"; the entire content is incorporated into this application by reference .

Technical field

This application relates to the technical field of sound control, and in particular to a method for selecting and controlling a sound output device and a display device.

Background technique

The operating system of a display device (such as a smart TV) is usually an Andriod system. As shown in Figure 1, multiple service layers are usually set in the Andriod system, including an APP (Application, application sequence) layer, a Java layer, and a local layer.

Currently, an AudioPolicy (audio policy) module is set in the local layer of the Android system, which can establish a connection with a sound output device (such as a speaker, a headset, a power amplifier, a wired headset, a USB headset, etc.) and control its output sound. However, when the user needs to select one of the multiple sound output devices connected to the display device as the target sound output device, the remaining external access devices can only be removed from the display device, and the target cannot be selected through the user interface Sound output device. For example, when the display device is connected with earphones and speakers at the same time, when the user wants to output sound through the speaker alone, the speaker can only output sound by unplugging the earphone from the display device.

Summary of the invention

The present application provides a method for selecting and controlling a sound output device and a display device, so as to solve the problem that the existing display device cannot select the target sound output device through the user interface.

In the first aspect, this embodiment provides a display device, including:

monitor;

The external device interface and the audio output interface are configured to connect to a sound output device to output audio data to the sound output device;

The Bluetooth communication module is configured to connect to the sound output device through the Bluetooth protocol to output audio data to the sound output device;

The user interface is configured to receive instructions input by the user;

The controller is configured as:

In response to the first input instruction, display a setting interface of the sound output device, where at least two sound output device options are displayed;

In response to the second input instruction, the selected sound output device is displayed in the selected state in the setting interface, and audio data is output to the selected sound output device.

In a second aspect, this embodiment provides a display device, including:

monitor;

The user interface is configured to receive instructions input by the user;

The controller is configured as:

When it is detected that the first sound output device is connected, in response to the first input instruction, display a setting interface of the sound output mode, and at least two mode options are displayed in the setting interface;

In response to the first input instruction, causing the selected first sound output mode to be displayed as a selected state in the setting interface, and setting the output mode of audio data to the first sound output mode;

Wherein, in the first sound output mode, both the first sound output device and the second sound output device output audio data.

Description of the drawings

In order to explain the implementation of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, for those of ordinary skill in the art, without creative labor, Other drawings can also be obtained from these drawings.

Figure 1 is a schematic diagram of the existing Andriod system configuration;

FIG. 2 exemplarily shows a schematic diagram of an operation scenario between the display device and the control device according to the embodiment;

FIG. 3 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the embodiment;

FIG. 4 exemplarily shows the first schematic diagram of the user interface of the display device 200 according to the embodiment;

FIG. 5 exemplarily shows the second schematic diagram of the user interface of the display device 200 according to the embodiment;

FIG. 6 exemplarily shows the third schematic diagram of the user interface of the display device 200 according to the embodiment;

FIG. 7 exemplarily shows a block diagram of the hardware configuration of the control device 100 according to the embodiment;

FIG. 8 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to the embodiment;

Fig. 9a exemplarily shows a schematic diagram of the software configuration in the display device 200 according to the embodiment;

FIG. 9b exemplarily shows a schematic diagram of the configuration of the application program in the display device 200 according to the embodiment;

FIG. 10 exemplarily shows the first structural configuration diagram of the Andriod system according to the embodiment;

FIG. 11 exemplarily shows the second structural configuration diagram of the Andriod system according to the embodiment;

FIG. 12 exemplarily shows the first schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 13 exemplarily shows the second schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 14 exemplarily shows the third schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 15 exemplarily shows the fourth schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 16 exemplarily shows the fifth schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 17 exemplarily shows the sixth schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 18 exemplarily shows the seventh schematic diagram of the configuration process of the customer service module according to the embodiment;

FIG. 19 exemplarily shows the eighth schematic diagram of the configuration process of the customer service module according to the embodiment;

Fig. 20 exemplarily shows the ninth schematic diagram of the configuration process of the customer service module according to the embodiment.

Detailed ways

The following will clearly and completely describe the implementation of the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

In order to make the purpose, implementation, and advantages of the exemplary embodiments of the present application clearer, the implementation manners in the exemplary embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously The described exemplary embodiments are only a part of the embodiments of the present application, rather than all of the embodiments.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application. In addition, although the disclosure in this application is introduced in accordance with one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete implementation.

It should be understood that the terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or Priority. It should be understood that the terms used in this way can be interchanged under appropriate circumstances, for example, they can be implemented in an order other than those given in the illustrations or descriptions of the embodiments of the present application.

In addition, the terms "including" and "having" and any variations of them are intended to cover but not exclusively include. For example, a product or device including a series of components need not be limited to those clearly listed, but may include Other components not clearly listed or inherent to these products or equipment.

The term "module" used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.

The term "remote control" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect to electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

Fig. 2 exemplarily shows a schematic diagram of an operation scenario between the display device and the control device according to the embodiment. As shown in FIG. 2, the user can operate the display device 200 through the control device 100.

Wherein, the control device 100 may be a remote control 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 through wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.

The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like. For example, an application program running on a smart device is used to control the display device 200. The application can provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

For example, the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control instruction protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 2, the display device 200 also performs data communication with the server 300 through multiple communication methods. The display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200. For example, the display device 200 can receive software program updates or access a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 300 may be a group or multiple groups, and may be one or more types of servers. The server 300 provides other network service content such as video-on-demand and advertising services.

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

In addition to providing the broadcast receiving TV function, the display device 200 may additionally provide a smart network TV function with a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and so on.

FIG. 3 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 3, the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio Processor 260-2, display 280, audio input interface 272, power supply.

The tuner and demodulator 220 receives broadcast and TV signals through wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the TV channel selected by the user from multiple wireless or cable broadcast and TV signals The audio and video signals carried in the frequency, and additional information (such as EPG data signals).

The tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.

The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.

In some other exemplary embodiments, the tuner and demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the input/output interface 250.

The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.

The display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230. For example, the communicator may receive the control signal of the remote controller 100 according to the control of the controller.

The detector 240 is a component used by the display device 200 to collect signals from the external environment or interact with the outside. The detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect attributes of users or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.

In some other exemplary embodiments, the detector 240 may further include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. In some embodiments, when the temperature is relatively high, the color temperature of the displayed image of the display device 200 can be adjusted to be relatively cool; when the temperature is relatively low, the color temperature of the displayed image of the display device 200 can be adjusted to be relatively warm.

In some other exemplary embodiments, the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.

The external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.

Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.

The controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.

As shown in FIG. 3, the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a bus.

ROM213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start the operating system. After the operating system is started up, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.

The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display 280.

The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode and other states.

The communication interface may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.

The controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

The memory 290 includes storing various software modules used to drive and control the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Among them, the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.

For example: the voice recognition module includes a voice parsing module and a voice command database module. The display control module is a module for controlling the display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.

At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, and the like.

The user input interface is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user. In some embodiments, the control device (for example, a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the user input interface to the controller Or, the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal displayed or played directly on the display 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be the same as the source The video stream is related, and the output frame rate can be related to the update rate of the display screen. The input has the usual format, such as the frame insertion method.

The display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.

The display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images and a menu control interface. The display 280 includes a display screen component for presenting a picture and a driving component for driving image display. The displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the interface of an external device. The display 220 simultaneously displays a user manipulation interface UI generated in the display device 200 and used for controlling the display device 200.

And, depending on the type of the display 280, it also includes a driving component for driving the display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

In a specific example, the display 280 is configured to display a sound setting interface based on user input. For example, in the sound setting interface shown in FIG. 4, there are menu options for the sound output device (for example, speakers) and menu options for the sound output mode (for example, earphone mode).

When the menu option of the sound output device is selected based on the user input, the setting interface of the sound output device is displayed. There are at least two device options displayed in the setting interface, for example, the built-in speaker of the display device (that is, the audio output interface), the Bluetooth device connected through the Bluetooth communication module, and the HDMI terminal (the HDMI terminal is also the audio return channel ARC terminal ) The connected power amplifier device, the earphone connected through the earphone output terminal or the earphone connected through the USB terminal, etc.

And the device option corresponding to the sound output device available for the display device 200 is highlighted (for example, high-brightness display); the device option corresponding to the sound output device that is not available for the display device 200 is non-highlighted (for example, low-brightness display) or not displayed . And, the highlighted option may be selected by the selector based on user input, and conversely, the non-highlighted option may not be selected by the selector based on user input. Among them, the selector can be moved based on user input to indicate that the menu option is selected.

Here, the usable sound output device refers to the sound output device that is successfully connected to the display device through the external device interface or the audio output interface or the Bluetooth communication module and can output audio data. The unavailable sound output device refers to: the external device interface or Audio output interface or Bluetooth communication module, a sound output device that is not connected with the display device or is not successfully connected or cannot output audio data.

For example, in the setting interface of the sound output device shown in Figure 5, the menu options include Speaker, ARC device, Bluetooth device, and both the speaker and Bluetooth device options are highlighted, and the ARC device option is highlighted, or, The ARC device option is not displayed. In addition, based on user input, the Bluetooth device option is displayed as a selected state, that is, the Bluetooth device is the working device for the current sound output, and the audio data currently processed by the audio processor is output to the Bluetooth device.

When the menu option of the sound output mode is selected based on the user input, the setting interface of the sound output mode is displayed. There are at least two mode options displayed in the setting interface, such as earphone only mode, earphone and speaker mode.

For example, in the setting interface of the headset mode shown in FIG. 6, the menu options include the headset only mode (Headphone Only), the headset and the speaker mode (Headphone With Speaker), and both of these mode options are displayed with high brightness. Also, based on user input, the headset and speaker mode options are displayed as selected, that is, the headset and speaker mode is the current sound output working mode, and the audio data currently processed by the audio processor is output to the headset and selected as shown in Figure 5 Bluetooth device.

Here, if the earphone is an unavailable sound output device, the earphone mode option in the sound setting interface shown in Figure 4 can be dimmed or not displayed; if the earphone is an available sound output device, the sound shown in Figure 4 The headset mode option in the setting interface can be highlighted.

The audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.

The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210. The audio output interface may include a speaker 272 or output to an external audio output terminal 274 of the generator of an external device, such as : External audio terminal or headphone output terminal, etc.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the controller 210 in one or more chips.

The power supply is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface that provides an external power supply in the display device 200.

FIG. 7 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in FIG. 7, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and play an intermediary role in the interaction between the user and the display device 200. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1, the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing an application for controlling the display device 200. For example, the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 100B or other smart electronic devices by installing applications to realize the function of the physical keys of the control device 100.

The controller 110 includes a processor 112, a RAM 113 and a ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as communication and cooperation between internal components, and external and internal data processing functions.

The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the received user input signal is sent to the display device 200. The communicator 130 may include at least one of communication modules such as a WIFI module 131, a Bluetooth module 132, and an NFC module 133.

The user input/output interface 140, wherein the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal and the digital signal into a corresponding instruction signal, which is sent to the display device 200.

The output interface includes an interface for sending the received user instruction to the display device 200. In some embodiments, it may be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and then sent to the display device 200 via the infrared sending module. For another example, in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The control device 100 is configured with a communicator 130, such as: WIFI, Bluetooth, NFC and other modules, which can encode user input instructions through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.

The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. Can battery and related control circuit.

FIG. 8 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 8, the memory 290 is used to store an operating system, application programs, content, user data, etc., under the control of the controller 210, execute system operation of driving the display device 200 and respond to various operations of the user. The memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically used to store the operating program that drives the controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and various application-related programs. Graphical user interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.

The memory 290 is specifically used to store driver programs and related data such as the video processor 260-1 and the audio processor 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, the detector 240, and the input/output interface.

In some embodiments, the memory 290 may store software and/or programs. The software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs. In some embodiments, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or application access control To control or manage system resources.

For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, and an optical receiver Module 2909, power control module 2910, operating system 2911, and other application programs 2912, browser module, etc. The controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.

Fig. 9a exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.

As shown in Figure 9a, the operating system 2911 includes operating software for processing various basic system services and for implementing hardware-related tasks, acting as a medium for data processing between application programs and hardware components.

In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.

The communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects that display the user interface for access by various applications, and can realize user operability.

The control application 2911-4 is used to control process management, including runtime applications, etc.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application 2912 at the same time. It is used to monitor various user input events, and will respond to the recognition results of various events or sub-events according to various events. A processing program that implements one or more sets of predefined operations.

Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.

The event recognition module 2914-1 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute their corresponding one or more sets of processing procedures .

The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.). Such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices. For example, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of key pressing, up/down/left/right/, confirm key, and key press. And the operations of non-physical buttons, such as moving, pressing, and releasing.

The interface layout management module 2913, which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size or position, level, etc. of the interface are related to the various execution operations of the interface layout.

As shown in FIG. 9b, the application layer 2912 includes various application programs that can be executed on the display device 200. The application program may include, but is not limited to, one or more application programs, such as: live TV application, video on demand application, media center application, application center, game application, etc.

Live TV applications can provide live TV through different sources. For example, a live TV application can provide a TV signal using input from cable TV, wireless broadcasting, satellite services, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200.

Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.

Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.

Application center, can provide storage of various applications. The application program may be a game, an application program, or some other application program that is related to a computer system or other equipment but can be run on a smart TV. The application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.

The controller 210 of the display device 200 provided in this embodiment is equipped with an Android system to support the operation of various applications on the display device 200 and control the work of various hardware.

10 and 11, the Andriod system shown in this embodiment is configured with an application layer, a Java layer, and a local layer. The Java layer and the local layer pass through JNI (JAVA Native Interface, JAVA local interface) or HIDL (Hardware Interface Definition). Language, hardware interface definition language) and other communication interface communication.

In the Android system, an audio policy service (AudioPolicyService) is usually configured on the local layer to manage the audio output policy of the display device 200, and a large part of the management work of the AudioPolicyService is completed in the AudioPolicyManager, including volume management, audio policy (Strategy) management, input and output device management. Based on this, this embodiment also sets a customized CustomerService (customer service module) in the AudioPolicyService. The CustomerService inherits the AudioPolicyManager class and completes its implementation when the AudioPolicyManager is initialized.

In the Andriod system shown in Figure 10, the Customeservice inherits the AudioPolicyManager, so that the method of the parent class can be overridden in the Customeservice to realize the customization of functions. Customeservice communicates with the JNI shared library through the binder upwards, and the JNI shared library upwards encapsulates the application layer calls of the JAVA static library.

In the Andriod system shown in Figure 11, unlike Figure 10, the Android system provided in Figure 11 uses HIDL to implement communication between the application layer and the local layer.

Through the JNI interface or the HIDL interface, system applications and third-party applications at the application layer can conveniently and quickly call customer service modules to achieve control and selection of sound output devices. In addition, the application of the application layer realizes the real-time update of the state of the sound output device by registering the callback function in the customer service module.

Referring to FIG. 12, in this embodiment, after the display device 200 is turned on (including AC power-on and STR power-on), the customer service module is specifically configured to execute the following content.

First, in response to receiving a broadcast indicating that the display device 200 is booted up (BootUpComplete) and a broadcast indicating that the display 280 is turned on (ScreenOn), the connection status and sound output mode of all sound output devices connected to the display device 200 are updated. The sound output mode is determined according to the setting before the display device 200 is shut down.

Specifically, the customer service module can determine the connection status of the sound output device through the global variable mAvailableOutput Devices of AudioPolicyManager, which records all output peripherals connected to the current local layer (that is, all external sound output devices connected to the display device, Such as headphones, etc.).

Second, determine the current sound output mode of the display device 200.

It should be noted that, in this embodiment, the sound output mode includes a headphone-less mode, a headphone-only mode, and a headphone and speaker mode. In the earphoneless mode, the connection between the earphone and the display device 200 is disconnected, and when the earphone is inserted into the display device 200, the display 280 will display the options of the earphone mode. In the earphone only mode, only earphones can be used as the sound output device of the display device 200. In the earphone and speaker mode, both the earphone and the speaker can be used as the sound output device of the display device 200.

Subsequently, the working device is determined according to the current sound output mode of the display device.

Specifically, if the current sound output mode is the headphoneless mode, when the earphone is not connected, the speaker is set as the working device, and when the earphone is connected, the speaker and the earphone are both set as the working device. If the current sound output mode is earphone only mode, set the speaker as a working device when the earphone is not connected, and set the earphone as a working device when the earphone is connected. If the current sound output mode is earphone and speaker mode, when the earphone is not connected, set the speaker as the working device, and when the earphone is connected, set the speaker and earphone as the working device together.

In this embodiment, the customer service module sets the working device by changing the global variable mAudiosink. For example, when the customer service module sets the speaker as the working device, set mAudiosink to Speaker; when the headset is set as the working device, set mAudiosink to Headphone; when the headset and speaker are both set as the working device, set mAudiosink to Headphone+ Speaker.

Finally, the device status, working status and sound output mode of all sound output devices are displayed in the setting interface of the sound output device.

Based on the display device displaying the setting interface of the sound output device, this embodiment provides a method for selecting a sound output device. Please refer to FIG. 13, the method is applied to the customer service module, and specifically includes the following steps S1301 and S1302.

Step S1301, in response to receiving the device selection instruction input by the user on the setting interface, the customer service module sets the sound output device indicated by the device selection instruction as a working device, and displays the device option of the sound output device as a selected state on the setting interface .

In step S1302, the customer service module sets other sound output devices as non-working devices, and displays the device options of other sound output devices as unselected on the setting interface.

In addition, when the sound output device is newly connected to or removed from the display device 200, the customer service module changes the device state of the sound output device through the following operations. When the device is connected, the option is highlighted and can be selected, and when the device is disconnected, the option is not available. select.

In some embodiments, as shown in FIG. 14, the customer service module calls setDeviceConnectionState (device connection state setting interface) to change the state of the connected or removed sound output device.

Specifically, after detecting that a device is connected or removed, the customer service module first determines whether the device is a sound output device. If it is, it is determined whether the device status of the sound output device is connected or disconnected. If the device status is connected, call setDeviceConnectionState in AudioPolicyManager through addOutputDevice (device addition interface) to change the device status. If the device status is disconnected, call setDeviceConnectionState in AudioPolicyManager through rmOutputDevice (device removal interface) to change the status of the device.

In an example, referring to Figure 15, addOutputDevice (device addition interface) is configured to perform the following operations.

First, it is judged whether the connected sound output device is a valid sound output device; if it is not, the operation ends; if it is, it is further judged whether it is a headset. If it is earphone, set the current sound output mode to earphone only mode; if the sound output device is not earphone, when the sound output mode is earphone only mode, change the sound output mode to earphone and speaker mode.

Second, determine the current sound output mode of the display device 200.

Subsequently, the working equipment is set according to the sound output mode. Specifically, if the current sound output mode is the headsetless mode, the working device will be set according to the transmission parameters (such as Device); if the current sound output mode is the headset only mode, the headset will be set as the working device; if the current sound If the output mode is earphone and speaker mode, set the earphone and speaker as the working device at the same time.

Finally, according to the sound output device currently working, the setting interface is displayed.

In another example, referring to Figure 16, rmOutputDevice (device removal interface) is configured to perform the following operations.

First, determine whether the removed sound output device is a valid sound output device. If it is not a valid device, the operation ends. If it is a valid device, determine whether the device is a headset. If it is a headset, the display device 200 is set to a headsetless mode.

Then, determine the current sound output mode of the display device.

Finally, according to the current sound output mode, select a new working device. Specifically, if the current sound output mode is the earphone only mode, the earphone is set as the working device. If the current sound output mode is the headphone-less mode, or the headphone and speaker mode, select a new working device according to call the chooseDeviceBy Priority in the customer service module (select the device interface according to the priority).

In a specific example, see Figure 17, chooseDeviceByPriority is configured to perform the following operations. It should be noted that the priority of the sound output device is determined according to the pre-configuration, which is not limited in this embodiment.

First, determine all currently valid sound output devices of the display device 200.

Second, determine whether there is a Bluetooth device among all valid sound output devices. If so, set the Bluetooth device as a working device. If not, go to the next step.

Then, determine whether there is an ARC device among all the effective sound output devices. If there is an ARC device, set the ARC device as a working device. If not, set the speaker as a working device.

In addition, the customer service module is also equipped with setHeadphoneMode (set the sound output mode interface), which is used to switch the working mode of the headset according to user instructions.

In an example, as shown in FIG. 18, setHeadphoneMode determines the type of sound output mode selected by the user in response to receiving the sound output mode selection instruction input by the user on the setting interface. If the sound output mode is the earphone only mode, set the earphone as a working device, and call the updateAudioOutput interface to change the sound output mode of the display device 200. If the sound output mode is the earphone and speaker mode, the speaker is set as a working device, and the updateAudioOutput interface is called to change the sound output mode of the display device 200.

Specifically, as shown in Figure 19, the updateAudioOutput interface first calls add OutputDevice to detect whether the global variable mAudiosink has changed. If mAudiosink has not changed, it means that the sound output device has not been changed and the program ends. If a change in the global variable mAudiosink is detected, first, check the status of the Bluetooth device, check the output devices of all strategies, and update the status and output ports of all devices. Then, call getDeviceForStrategy in the customer service module (get the device interface according to the strategy) to determine the working device. Finally, control to open the working device and report the message to the application layer.

Among them, please refer to FIG. 20, getDeviceForStrategy (get device interface according to the strategy) is configured to determine whether the sound output mode is set to the headphone and speaker mode. If it is, do not set the headset as the output device, for example, set mAudioSink&=~Headphone. If not, do not change the setting, for example, set mAudioSink=mAudioSink.

With the display device provided in this embodiment above, the user can directly switch the target sound output device through the setting interface of the sound output device, and set the working mode of the device, which is easy to operate and has a better user experience. In addition, the display device can display the device status, working status, and working mode of all sound output devices in the setting interface, so that the user can intuitively understand the status of these sound output devices.

For the purpose of illustration and description, the foregoing embodiments are provided, and are not intended to exhaustively list or limit the application. Each element or feature of a specific embodiment is generally not limited to the specific embodiment, but can be used or interchanged in the selected embodiment even if it is not specifically shown or described under applicable circumstances. Many form modifications are also possible, and such modifications are not considered to deviate from the scope of the appended claims of the present application, and all such modifications are covered within the scope of the appended claims of the present application.

Claims

A display device is characterized in that it comprises:

monitor;

The external device interface and the audio output interface are configured to connect to a sound output device to output audio data to the sound output device;

The Bluetooth communication module is configured to connect to the sound output device through the Bluetooth protocol to output audio data to the sound output device;

The user interface is configured to receive instructions input by the user;

The controller is configured as:

In response to the first input instruction, display a setting interface of the sound output device, where at least two sound output device options are displayed;

In response to the second input instruction, the selected sound output device is displayed in the selected state in the setting interface, and audio data is output to the selected sound output device.
The display device according to claim 1, wherein the controller is further configured to:

When it is detected that the external device interface and the audio output interface are connected to the sound output device, and/or, when it is detected that the sound output device is connected through the Bluetooth communication module, the connected sound output device is highlighted in the setting interface ；

When the sound output device disconnected from the external device interface and the audio output interface is detected, and/or the sound output device disconnected through the Bluetooth communication module is detected, the non-highlighted disconnection is displayed in the setting interface. Turn on the connected sound output device.
The display device according to claim 1, wherein the controller is further configured to:

When it is detected that the external device interface and the audio output interface are connected to a sound output device, and/or it is detected that the sound output device is connected through the Bluetooth communication module, the connected sound output device is displayed in the setting interface;

When the sound output device disconnected from the external device interface and the audio output interface is detected, and/or the sound output device disconnected through the Bluetooth communication module is detected, the disconnection is no longer displayed in the setting interface. Turn on the connected sound output device.
A display device is characterized in that it comprises:

monitor;

The external device interface and the audio output interface are configured to connect to a sound output device to output audio data to the sound output device;

The Bluetooth communication module is configured to connect to the sound output device through the Bluetooth protocol to output audio data to the sound output device;

The user interface is configured to receive instructions input by the user;

The controller is configured as:

When it is detected that the first sound output device is connected, in response to the first input instruction, display a setting interface of the sound output mode, and at least two mode options are displayed in the setting interface;

In response to the first input instruction, causing the selected first sound output mode to be displayed as a selected state in the setting interface, and setting the output mode of audio data to the first sound output mode;

Wherein, in the first sound output mode, both the first sound output device and the second sound output device output audio data.
The display device according to claim 3, wherein the controller is further configured to:

In response to the second input instruction, causing the selected second sound output mode to be displayed in the selected state in the setting interface, and setting the output mode of audio data to the second sound output mode;

Wherein, in the second sound output mode, only the first sound output device outputs audio data.
The display device according to claim 4 or 5, wherein the first sound output device is a headset, and the second sound input device is a currently connected sound output device other than the headset.
A method for selecting and controlling a sound output device, which is characterized in that it comprises:

In response to the first input instruction, display a setting interface of the sound output device, where at least two sound output device options are displayed;

In response to the second input instruction, the selected sound output device is displayed in the selected state in the setting interface, and audio data is output to the selected sound output device.
The method according to claim 7, wherein the method further comprises:

When it is detected that the external device interface and the audio output interface are connected to the sound output device, and/or, when it is detected that the sound output device is connected through the Bluetooth communication module, the connected sound output device is highlighted in the setting interface ；

When the sound output device disconnected from the external device interface and the audio output interface is detected, and/or the sound output device disconnected through the Bluetooth communication module is detected, the non-highlighted disconnection is displayed in the setting interface. Turn on the connected sound output device.
The method according to claim 7, wherein the method further comprises:

When it is detected that the external device interface and the audio output interface are connected to the sound output device, and/or the connection of the sound output device through the Bluetooth communication module is detected, the connected sound output device is displayed in the setting interface;

When the sound output device disconnected from the external device interface and the audio output interface is detected, and/or the sound output device disconnected through the Bluetooth communication module is detected, the disconnection is no longer displayed in the setting interface. Turn on the connected sound output device.
A method for selecting and controlling a sound output device, characterized in that it is applied to a display device, and the method includes:

When it is detected that the first sound output device is connected, in response to the first input instruction, display a setting interface of the sound output mode, and at least two mode options are displayed in the setting interface;

In response to the first input instruction, causing the selected first sound output mode to be displayed as a selected state in the setting interface, and setting the output mode of audio data to the first sound output mode;

Wherein, in the first sound output mode, both the first sound output device and the second sound output device output audio data.
The method according to claim 10, wherein the method further comprises:

In response to the second input instruction, causing the selected second sound output mode to be displayed as a selected state in the setting interface, and setting the output mode of audio data to the second sound output mode;

Wherein, in the second sound output mode, only the first sound output device outputs audio data.
The method according to claim 10 or 11, wherein the first sound output device is a headset, and the second sound input device is a currently connected sound output device other than the headset.