WO2020187050A1 - 一种显示设备 - Google Patents
一种显示设备 Download PDFInfo
- Publication number
- WO2020187050A1 WO2020187050A1 PCT/CN2020/078061 CN2020078061W WO2020187050A1 WO 2020187050 A1 WO2020187050 A1 WO 2020187050A1 CN 2020078061 W CN2020078061 W CN 2020078061W WO 2020187050 A1 WO2020187050 A1 WO 2020187050A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- module
- display device
- environmental sound
- control
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4418—Suspend and resume; Hibernate and awake
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
Definitions
- This application relates to the field of display technology, and in particular to a display device.
- the display device can perform various interactive functions related to the voice control instructions input by the user.
- the voice control command input by the user can be input through the built-in microphone on the display device.
- the current display device has two states: standby mode and running mode.
- all or most of the services of the display device are turned on in the operating mode, such as the service that the built-in microphone on the display device collects the user's voice, the service that processes the user's voice, etc., which can control the voice input by the user. Identify and respond.
- the display device when the display device is in standby mode, all or most of the services are turned off. At the same time, some services need to be turned on by continuous power-on, such as the service that the microphone collects the user's voice, the service that processes the user's voice, etc., to be able to Recognizing and responding to the voice control command input by the user, for example, the user inputs a voice wake-up command to wake the display device from the standby mode to the operating mode, which will cause the display device in the standby mode to have a higher standby power consumption.
- some services need to be turned on by continuous power-on, such as the service that the microphone collects the user's voice, the service that processes the user's voice, etc., to be able to Recognizing and responding to the voice control command input by the user, for example, the user inputs a voice wake-up command to wake the display device from the standby mode to the operating mode, which will cause the display device in the standby mode to have a higher standby power consumption.
- the embodiment of the present application provides a display device for controlling the standby power consumption of the display device in a standby mode.
- the display device includes an environmental sound detection module, a microphone module, and a chip processing module;
- the environmental sound detection module is used to detect the size of the environmental sound of the environment where the display device is in the standby mode, and according to the size of the environmental sound Control the microphone module and the chip processing module to turn on or off;
- the microphone module is used to collect voice data input by the user;
- the chip processing module is used to identify and respond to the voice wake-up input by the user from the voice data collected by the microphone module Instructions to wake up the display device and enter the operating mode.
- the environmental sound detection module is specifically configured to control the microphone module and the chip processing module to turn off when the magnitude of the environmental sound is not within a preset range; when it is determined that the magnitude of the environmental sound is within the preset range, control the microphone The module and chip processing module are turned on.
- the environmental sound detection module is turned off.
- the chip processing module is further configured to detect the duration of its turn-on, and control the environmental sound detection module to turn on or off according to the duration of its turn-on.
- the chip processing module is specifically configured to control the environmental sound detection module to turn on when it is determined that the duration of its activation exceeds a set duration; when it is determined that the duration of its activation does not exceed the set duration, control the ambient sound The detection module is closed.
- the display device further includes a SOC module, which is used to send a state that the display device enters a standby mode or an operating mode to the chip processing module.
- a SOC module which is used to send a state that the display device enters a standby mode or an operating mode to the chip processing module.
- the chip processing module is further configured to control the environmental sound detection module to turn on when receiving the state that the display device enters the standby mode sent by the SOC module; When the device enters the operating mode state, the environmental sound detection module is controlled to close.
- Fig. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device
- Fig. 2 exemplarily shows a configuration block diagram of the control device in Fig. 1;
- Fig. 3 exemplarily shows a configuration block diagram of the display device in Fig. 1;
- FIG. 4 exemplarily shows another configuration block diagram of the display device in FIG. 1;
- FIG. 5 exemplarily shows another configuration block diagram of the display device in FIG. 1;
- Fig. 6 exemplarily shows a block diagram of the circuit configuration of each module in Fig. 5.
- first, second, third, etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms . These terms can only be used to distinguish one element, component, region, layer or section from another element, component, region, layer or section. Unless the context clearly indicates, terms such as “first”, “second” and other numbers used herein do not imply a sequence or order. Therefore, without departing from the teachings of the exemplary embodiments, the first element, first component, first region, first layer or first portion discussed below may be referred to as a second element, second component, second Area, second layer or second part.
- spatially relative terms such as “internal”, “external”, “below”, “below”, “lower”, “above”, “upper”, etc. may be used in this text. Used to describe the relationship between one element or feature shown in the figure and another or more elements or features.
- spatial relative terms may also be intended to cover different orientations of the device in use or operation. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features will be reoriented “above” the other elements or features. Therefore, the exemplary term “under” can include two relative orientations of upper and lower. The device can be oriented in other ways (rotated by 90 degrees or other directions), thereby explaining the spatial relative descriptors used herein.
- Fig. 1 exemplarily shows a schematic diagram of an operation scene between the display device and the control device.
- the control device 100 and the display device 20 can communicate in a wired or wireless manner.
- control device 100 is configured to control the display device 20, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 20 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 20 effect.
- the user operates the channel control key on the control device 100, and the display device 20 responds to the channel control operation.
- the control device 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., to control the display device 20 through wireless or other wired methods.
- the user can control the display device 20 by inputting user instructions through keys on the remote control, voice input, control panel input, etc.
- the user can control the display device by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch machine keys, etc. on the remote control 20 Function.
- the control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc.
- a smart device such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc.
- an application program running on a smart device is used to control the display device 20.
- the application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
- UI intuitive user interface
- the mobile terminal 100B can install a software application with the display device 20, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication.
- the mobile terminal 100B can establish a control instruction protocol with the display device 20, and by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B, the functions of the physical keys arranged in the remote control 100A can be realized.
- the audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 20 to realize the synchronous display function.
- the display device 20 may provide a broadcast receiving function and a network TV function of a computer support function.
- Exemplary display devices include digital TV, Internet TV, Internet Protocol TV (IPTV), and so on.
- the display device 20 may be a liquid crystal display, an organic light emitting display, or a projection device.
- the specific display device type, size and resolution are not limited.
- the display device 20 also performs data communication with the server 300 through multiple communication methods.
- the display device 20 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks.
- the server 300 can provide various contents and interactions to the display device 20.
- the display device 20 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library.
- EPG electronic program guide
- the server 300 can be one group or multiple groups, and can be one type or multiple types of servers.
- the server 300 provides other network service content such as video on demand and advertising services.
- control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
- the controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a communication interface, and a communication bus.
- RAM random access memory
- ROM read only memory
- the controller 110 is used to control the operation and operation of the control device 100, as well as the communication cooperation between internal components, and external and internal data processing functions.
- the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 20.
- the memory 120 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller 110.
- the memory 120 can store various control signal instructions input by the user.
- the communicator 130 realizes communication of control signals and data signals with the display device 20 under the control of the controller 110.
- the control device 100 sends a control signal (such as a touch signal or a button signal) to the display device 20 via the communicator 130, and the control device 100 can receive the signal sent by the display device 20 via the communicator 130.
- the communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132.
- the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and then sent to the display device 20 via the infrared sending module.
- the user input instruction needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 20 by the radio frequency sending terminal.
- the user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 20 to the control device through voice, touch, gesture, press, etc. 100.
- the output interface 150 outputs a user instruction received by the user input interface 140 to the display device 20, or outputs an image or voice signal received by the display device 20.
- the output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs a sound, a display 154 that outputs an image, and the like.
- the remote controller 100A can receive output signals such as audio, video, or data from the output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as vibration on the vibration interface 152. form.
- the power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110.
- the form can be battery and related control circuit.
- Fig. 3 exemplarily shows a configuration block diagram of the display device.
- the display device 200 may include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, Audio processor 280, audio input interface 285, and power supply 290.
- the tuner and demodulator 210 which receives broadcast television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals
- modulation and demodulation processing such as amplification, mixing and resonance
- the audio and video signals carried in the frequency of the channel, and additional information such as EPG data.
- the tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.
- the tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.
- different broadcasting formats of TV signals such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting
- modulation types it can be digital modulation or analog Modulation method
- received TV signals, analog signals and digital signals can be demodulated.
- the tuner demodulator 210 may also be in an external device, such as an external set-top box.
- the set-top box outputs a television signal after modulation and demodulation, and inputs it to the display device 200 through the external device interface 240.
- the communicator 220 is a component used to communicate with external devices or external servers according to various communication protocol types.
- the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220.
- the communicator 220 may include a WIFI (Wireless Fidelity) module 221, a Bluetooth communication protocol module 222, a wired Ethernet communication protocol module 223 and other network communication protocol modules or near field communication protocol modules, so that the communicator 220 can be under the control of the controller 250
- the control signal of the control device 100 is received, and the control signal is implemented as a WIFI signal, a Bluetooth signal, a radio frequency signal, etc.
- the detector 230 is a component of the display device 200 for collecting external environmental signals or signals interacting with the outside.
- the detector 230 may include a sound collector 231, such as a microphone, which may be used to receive a user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, may collect environmental sound for identifying the type of environmental scene, so that The display device 200 adjusts its audio output according to the environmental sound, so that the display device 200 can adapt to the environmental noise.
- the detector 230 may also include an image collector 232, such as a camera, a camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect The attributes of the user or interactive gestures with the user to achieve the function of interaction between the display device and the user.
- an image collector 232 such as a camera, a camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect The attributes of the user or interactive gestures with the user to achieve the function of interaction between the display device and the user.
- the detector 230 may also include a light receiver, which is used to collect the ambient light intensity to adapt to changes in display parameters of the display device 200.
- the detector 230 may also include a temperature sensor.
- the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the color temperature of the displayed image of the display device 200 can be adjusted to be relatively cool; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be relatively warm.
- the external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and external devices.
- the external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving image data), audio signals (such as music data), and additional information ( For example, EPG data) and other data.
- the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, and a component (Component) Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
- HDMI high-definition multimedia interface
- CVBS composite video blanking synchronization
- USB universal serial bus
- Component Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
- the controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
- various software control programs such as an operating system and various application programs
- the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a processor 254, a communication interface 255, and a communication bus 256.
- RAM random access memory
- ROM read only memory
- processor 253, processor 254, and communication interface 255 are connected through a communication bus 256.
- ROM 252 used to store various system startup instructions. For example, when a power-on signal is received, the power of the display device 200 starts to start, and the processor 254 runs the system start instruction in the ROM 252, and copies the operating system stored in the memory 260 to the RAM 251 to start the operating system. After the operating system is started, the processor 254 copies various application programs in the memory 260 to the RAM 251, and then starts various application programs.
- the graphics processor 253 is used to generate various graphics objects, such as icons, operating menus, and user input instructions to display graphics.
- the graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to the display attributes; and includes a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform operations.
- the rendered result is displayed on the display 275.
- the processor 254 such as a CPU, is configured to execute operating system and application program instructions stored in the memory 260. And according to the received user input instructions, to execute various applications, data and content processing, so as to finally display and play various audio and video content.
- the processor 254 may include multiple processors. Multiple processors may include one main processor and multiple or one sub-processor.
- the main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, to display screen operations in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.
- the communication interface 255 may include the first interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.
- the controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a graphical user interface GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
- the object can be any one of the selectable objects, such as a hyperlink or an icon.
- the operation related to the selected object such as the operation of connecting to a hyperlink page, document, image, etc., or an operation of executing a program corresponding to the object.
- the user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.
- the memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200.
- the memory 260 may include volatile and/or nonvolatile memory.
- the term “storage unit” includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.
- the memory 260 is specifically used to store operating programs that drive the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from external devices by the user; and to store configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.
- the memory 260 is specifically used to store the drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc. , External data (such as audio and video data) received from the external device interface or user data (such as button information, voice information, touch information, etc.) received from the user interface.
- External data such as audio and video data
- user data such as button information, voice information, touch information, etc.
- the memory 260 specifically stores software and/or programs used to represent an operating system (OS). These software and/or programs may include, for example: kernel, middleware, application programming interface (API), and/or application.
- OS operating system
- these software and/or programs may include, for example: kernel, middleware, application programming interface (API), and/or application.
- the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API (Application Programming Interface), or application program); at the same time, the kernel can provide an interface to allow middleware, API Or the application program accesses the controller to control or manage system resources.
- OS operating system
- these software and/or programs may include, for example: kernel, middleware, application programming interface (API), and/or application.
- the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API (Application Programming Interface), or application program); at the same time, the kernel can provide an interface to allow middleware, API Or the application program accesses the controller to control
- various software modules stored in the memory 260 may include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
- the basic module is the underlying software module used to process the signals received by each hardware element in the display device and send the processed signals to the upper application module.
- the detection module is a management module used to collect various information from various detectors or user interfaces, and perform digital-to-analog conversion, analysis and management of the collected information.
- the communication module is a module used to communicate control signals and data signals with external devices.
- the display control module is a module for controlling the display to display image content, and can be used to play multimedia image content and GUI interface information.
- the browser module is a module used to access the web server by performing web browsing operations.
- the service module is a module used to provide various services and various applications.
- the user interface 265 receives various user interactions. Specifically, it is used to send the input signal of the user to the controller 250, or to transmit the output signal from the controller 250 to the user.
- the remote control 100A may send input signals such as a power switch signal, a channel selection signal, and a volume adjustment signal input by the user to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 through the controller 250 and display the received output signal or output the received output signal as audio or vibration.
- the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI.
- GUI graphical user interface
- the user interface 265 may receive a user input command for controlling the position of the selector in the GUI to select different objects or items.
- the user may input a user command by inputting a specific voice or gesture, and the user interface 265 recognizes the voice or gesture through a sensor to receive the user input command.
- the video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
- the video signal displayed or played directly on the display 275.
- the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
- the demultiplexing module is used to demultiplex the input audio and video data stream, such as MPEG-2 (based on the compression standard of digital storage media moving images and voice), and then the demultiplexing module will demultiplex it. Multiplexed into video signals and audio signals, etc.
- MPEG-2 based on the compression standard of digital storage media moving images and voice
- the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
- An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.
- the frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is implemented in a frame-insertion mode.
- the display formatting module is used to change the signal output by the frame rate conversion module into a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.
- the display 275 is used to receive the image signal input from the video processor 270 and display video content, images, and a menu control interface.
- the video content may be the video content in the broadcast signal received from the tuner and demodulator 210, or the video content input from the communicator 220 or the external device interface 240.
- the display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used for controlling the display device 200.
- the display 275 may include a display screen component for presenting a picture and a driving component for driving image display.
- the display 275 may also include a projection device and a projection screen.
- the audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing.
- the audio signal to be played is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing.
- the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.
- AAC Advanced Audio Coding
- HE-AAC High Efficiency AAC
- the audio output interface 285 is used to receive audio signals output by the audio processor 280 under the control of the controller 250.
- the audio output interface 285 may include a speaker 286 or an external audio output terminal 287 output to an external device, such as a headphone output terminal.
- the video processor 270 may include one or more chips.
- the audio processor 280 may also include one or more chips.
- the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.
- the power supply 290 is used for supplying power to the display device 200 with power input from an external power supply under the control of the controller 250.
- the power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.
- Fig. 4 exemplarily shows another configuration block diagram of the display device.
- the display device 200' may include a power board 21, a main board 23, and a microphone module 25. These components can correspond to some components in FIG. 3 to a certain extent.
- the power board 21 is used to supply power to components such as the main board 23 and the microphone module 25.
- the power supply board 21 may correspond to the power supply 290 in FIG. 3.
- the main board 23 is used to process various signals in the display device. For example, processing and responding to the sound signal collected by the microphone module 25, such as converting the sound signal into a voice control command; the radio frequency signal input from the tuner demodulator 210, the digital signal input from HDMI 241 and USB 244, and the component interface 243
- the input component signal and other signals input from the external device interface 240 undergo format conversion processing to generate a unified signal that can be recognized by the display 275, such as a low-voltage differential signal; the audio signal input from the external device interface 240 undergoes volume control and sound effect processing Then output to the audio output interface 285.
- the motherboard 23 may include components such as the external device interface 240, the controller 250, the video processor 270, the audio processor 280, the audio output interface 285, the memory 260, and various integrated circuits in FIG. 3.
- the controller 250 on the main board 23 may be implemented as a SOC (System on Chip) module 23a and an MCU (Micro Control Unit, Micro Control Unit) module 23b.
- SOC System on Chip
- MCU Micro Control Unit, Micro Control Unit
- the SOC module 23a and the MCU module 23b can be integrated together or separated.
- the MCU module 23b in the embodiment of the present application is a chip processing module.
- the microphone module 25 is used to collect the user's voice or collect environmental sounds for identifying environmental scenes.
- the microphone module 25 can collect the user's voice, so that the main board 23 can convert the sound into voice control instructions to realize various functions of controlling the display device 200'; the microphone module 25 can also collect environmental sounds, so that the main board 23 can follow The environmental sound adjusts the output audio of the audio output interface to implement the display device 200' to adapt to environmental noise.
- the microphone module 205 may correspond to the detector 230 in FIG. 3.
- the display device 200 can be controlled without operating the control device 100.
- the display device 200 may directly collect the voice uttered by the user through the sound collector 231 in FIG. 3 or the microphone module 25 in FIG. 4, and then convert the voice into a voice control instruction to perform a function corresponding to the voice control instruction.
- voice wake-up function when a display device in standby mode receives a voice control instruction containing a wake-up word from a user, the display device is awakened from standby mode and enters operating mode.
- the microphone module 25 and the MCU module 23b are always powered on (in the on state), and the SOC module 23a remains powered off (in the off state); In the running mode, the microphone module 25, the MCU module 23b, and the SOC module 23a are all kept powered on (in an on state).
- the microphone module 25 collects the user's voice data including the wake-up words, and transmits the voice data to the MCU module 23b; the MCU module 23b receives the voice data, and recognizes it after local recognition processing The sound data contains a wake-up word, and then the MCU module 23b determines the voice wake-up instruction to wake up the display device according to the recognition result, and triggers the SOC module 23a to enter the working state, so that the display device is awakened from the standby mode to enter the operating mode.
- Another example is the screen capture function: when the display device in the running mode receives a voice control instruction for screenshots sent by the user, it will perform screenshot processing on the current screen of the display device.
- the microphone module 25 collects the user's voice data containing keywords related to screenshots, and transmits the voice data to the MCU module 23b; the MCU module 23b transmits the voice data to the SOC module 23a
- the SOC module 23a informs the voice and semantic server to perform voice recognition and result conversion on the voice data, and returns the recognition result according to the voice and semantic server, and determines the recognition result as a voice control instruction for taking a screenshot of the current screen displayed by the display device, And then execute the current screen screenshot processing.
- most or all system services of the display device in the standby mode are in a closed state.
- the relevant components of the media output function of the display device in the standby mode are in the off state, for example, the audio output of the display device is off and the screen is off.
- the display device is in a low power consumption working state, and the power consumed at this time is the standby power consumption.
- Most or all of the system services in the display device in the running mode are in an on state, and it can work normally.
- the relevant components of the media output function of the display device in the running mode are in the on state, the audio output is in the on state, and the screen is in the on state.
- the standby mode and operating mode of the display device can be switched mutually.
- the display device in the running mode when the user operates the power button on the control device or shuts down through voice control, the display device in the running mode enters the standby mode.
- the display device in the standby mode when the user operates the power button on the control device or turns on the device through voice control, the display device in the standby mode enters the operating mode.
- the display device with voice wake-up function, in standby mode, the microphone module used to collect user voice data and the MCU module used to process user voice data containing wake-up words need to be It can work only when it is powered on, which makes the standby power consumption of the display device in the standby mode larger.
- Fig. 5 exemplarily shows another configuration block diagram of the display device.
- the display device 200" may include a power board 21, a main board 23, a microphone module 25, and an environmental sound detection module 27. These components may correspond to some components in FIG. 3 to a certain extent.
- FIG. 4 The difference from FIG. 4 is that an environmental sound detection module 27 is added in FIG. 5.
- the environmental sound detection module 27 is used to detect the size of the environmental sound, and control the turning on or off of the microphone module 25 and the MCU module 23b according to the size of the environmental sound.
- the environmental sound detection module 27 may correspond to the detector 230 in FIG. 3.
- the microphone module 25 and the environmental sound detection module 27 in FIG. 5 are integrated and connected to the main board 23, but they can also be connected to the main board 23 separately, which is not specifically limited.
- the specific functions of each module will be described in detail below.
- the SOC module 23a is used to notify the MCU module 23b of the state of the display device entering the standby mode or the operating mode, so that the MCU module 23b controls the environmental sound detection module 27 to be turned on or off.
- the MCU module 23b is used to control the turning on or off of the environmental sound detection module 27, and at the same time to recognize the voice data input by the user, and when it recognizes that the voice data input by the user is a voice wake-up instruction, it triggers the SOC module 23a to control the display device by The standby mode enters the running mode.
- the microphone module 25 is used to collect voice data input by the user and transmit the voice data to the MCU module 23b. For example, voice data containing wake words.
- the environmental sound detection module 27 is used to detect the size of the environmental sound, and control the microphone module 25 and the MCU module 23b to turn on or off according to the size of the environmental sound, so as to control the standby function of the display device with the voice wake-up function in the standby mode Consumption.
- the environmental sound detection module 27 when the display device is in the standby mode, the environmental sound detection module 27 is kept powered on, that is, in the on state, the microphone module 25 and the MCU module 23b can meet the requirements of the environmental sound detection module 27.
- the SOC module 23a is kept powered off (that is, in the on state) or powered off (that is, in the off state), and the SOC module 23a is kept off, that is, in the off state.
- the MCU module controls the environmental sound detection module to turn on by powering on.
- the MCU module and the microphone module are first controlled to turn off by power off. Secondly, it can collect the external environmental sound; detect the size of the environmental sound; and determine whether the size of the environmental sound is within the preset range, so as to control the opening or closing of the microphone module and the MCU module through power-on or power-off.
- the environmental sound detection module determines that the size of the environmental sound is not within the preset range, it means that the user is currently in an environmental sound scene where the user may not need to watch the display device, that is, the probability of the user waking up the display device in standby mode in this scene is almost 0, so there is no need for the microphone module and MCU module to work continuously in this scenario, so the environmental sound detection module keeps the microphone module and MCU module off by powering off, which can greatly reduce the standby caused by the microphone module and MCU module being powered on all the time Power consumption.
- the environmental sound detection module determines that the size of the environmental sound is within the preset range, it means that the user is currently in an environmental sound scene where the user may need to watch the display device, that is, the user has a higher probability of waking up the display device in standby mode in this scene Therefore, in this scenario, the microphone module and the MCU module need to be continuously detected. Therefore, the environmental sound detection module controls the microphone module and the MCU module to turn on by powering on to detect whether the user issues a voice wake-up command to wake up the display device and enter the operating mode.
- the preset range can be set based on experience or experiment.
- the preset range is 40-70 decibels, such as 45 decibels, 55 decibels, 65 decibels, and so on.
- the environment in this range is more suitable, such as the state of family eating dinner together or after dinner.
- the user has a higher probability of needing to wake up the display device in standby mode; the environment is quieter when it is below 40 decibels, such as sleeping at night or during the day Unmanned, in this environment, the user may not wake up the display device in standby mode; when the environment is more than 70 decibels, the environment is noisy, such as inviting friends to a party during the day, the probability of the user waking up the display device in standby mode in this environment is very small .
- the power consumption caused by the power-on of the environmental sound detection module is much less than the power consumption caused by the power-on of the microphone module and the MCU module.
- the microphone module and the MCU module are intermittently controlled to be turned on or off at the same time, so that the display device in standby mode can be controlled Part of the standby power consumption.
- the environmental sound detection module 27 can periodically maintain the power on (that is, the on state) or the power off (that is, the on state) according to whether the predefined conditions are met. Off state), the microphone module 25 and the MCU module 23b can alternately remain powered on (i.e. in the on state) or powered off (i.e. in the off state) according to whether the setting conditions of the environmental sound detection module 27 are met, and the SOC module 23a remains powered down (ie in the off state).
- the MCU module controls the environmental sound detection module to turn on by powering on.
- the MCU module and the microphone module are first controlled to turn off by power off. Secondly, the environmental sound detection module starts timing, and controls whether it is turned on or off according to whether the timing duration exceeds the set duration.
- the timing duration of the environmental sound detection module exceeds the set duration, it controls itself to be turned off by power off, and keeps the microphone module and MCU module turned off. This can greatly reduce the standby power consumption caused by the microphone module and MCU module being powered on all the time.
- the timing duration of the ambient sound detection module when the timing duration of the ambient sound detection module does not exceed the set duration, keep itself turned on; at the same time, it can collect ambient sound from the outside; detect the size of the ambient sound; and determine whether the size of the ambient sound is within the preset range to pass the Control the microphone module and MCU module to turn on or off in a power-off or power-off mode. In this way, the standby power consumption caused by the microphone module and MCU module being continuously powered on can be further reduced.
- the environmental sound detection module controls the turning on or off of the microphone module and the MCU module according to whether the size of the environmental sound is within a preset range.
- the specific implementation manner can refer to the first embodiment.
- the set duration may be the duration of the environmental sound detection module being turned on once, for example, the set duration may be 60 minutes.
- the setting time can be set according to experience and experiments.
- the environmental sound detection module is periodically controlled to turn on or off, and the microphone module and the MCU module are further periodically controlled to turn on or off at the same time. Therefore, it is also possible to control part of the standby power consumption of the display device in the standby mode.
- the microphone module 25, the MCU module 23b, and the environmental sound detection module 27 can alternate according to whether the preset conditions are met.
- the SOC module 23a remains powered off (i.e. in the on state) or off state (i.e. in the off state) while the SOC module 23a remains powered off (i.e. in the off state).
- the differences from the first and second embodiments include the following two aspects.
- the environmental sound detection module judges that the environmental sound is within the preset range
- the microphone module and the MCU module are controlled to be turned on through the power-on method, in order to further reduce the fact that the microphone module and the MCU module remain powered on and have not been detected for a long time
- the MCU module and the microphone module are turned on, and the MCU module is made to start timing.
- the timing duration exceeds the set duration, it means that the user may not need to watch the ambient sound of the display device.
- the probability of the user waking up the display device in standby mode is very small, that is to say, the user has no further operation, such as no sound Voice, so that there is no need for the microphone module and MCU module to work continuously in this scenario, so the MCU module controls the environmental sound detection module to turn on by power-on, and at the same time, after the environmental sound detection module is turned on, it controls the MCU module and the microphone module to turn off by power-off.
- the standby power consumption caused by the microphone module and the MCU module being powered on for a long time without detecting the user's voice can be further reduced.
- timing duration does not exceed the set duration, it means that you are currently in a scene where the user may need to watch the ambient sound of the display device, that is, in this scenario, the user has a higher probability of needing to wake up the display device in standby mode, so a microphone module and MCU are required in this scenario
- the module continues to detect work, so keep the microphone module and MCU module turned on, and keep the environmental sound detection module turned off, so that the microphone module is continuously preparing to collect the voice input by the user.
- the MCU module continues to recognize the voice input by the user, and recognizes the voice input by the user. When it is a voice wake-up command, the SOC module is triggered to control the display device to enter the running mode from the standby mode.
- the set duration may be the duration of keeping the microphone module and the MCU module turned on when it is determined that the environmental sound is within the preset range.
- the set duration may be 15 minutes.
- the setting time can be set according to experience and experiments.
- the environmental sound detection module judges that the size of the environmental sound is within the preset range, the environmental sound detection module controls the microphone module and MCU module to turn on by powering on to detect whether the user issues a voice wake-up command to wake up the display device and enter operation mode.
- the environmental sound detection module is controlled to be turned off through a power-off method, so as to reduce the standby power consumption caused by the continuous power-on of the environmental sound detection module.
- the environmental sound detection module when the environmental sound detection module detects that the size of the environmental sound is within the preset range, it further controls the simultaneous microphone module and the MCU module by determining whether the microphone module and the MCU module are turned on for longer than the set time. Turn it on or off, thereby also being able to control part of the standby power consumption of the display device in the standby mode.
- Embodiment 1 On the basis of the above-mentioned Embodiment 1, Embodiment 2 and Embodiment 3, when the display device is in operation mode, the microphone module 25, MCU module 23b, and SOC module 23a are all kept powered on (that is, in the on state), and the ambient sound The detection module 27 remains powered off (ie, in the off state).
- the SOC module notifies the MCU module of the state of the display device entering the operating mode:
- the MCU module controls the environmental sound detection module to turn off through the power-off method, so that the microphone module is continuously preparing to collect the voice input by the user.
- the MCU module continuously receives the voice input by the user and transmits the voice to the SOC module for the SOC module to recognize the voice.
- Voice control instructions corresponding to the voice and perform functions corresponding to the voice control instructions.
- the MCU module, the microphone module, and the ambient sound detection module can be powered on or off by triggering at high and low levels, and then turned on or off.
- Fig. 6 exemplarily shows a block diagram of the circuit configuration of each module in Fig. 5.
- VCC check is the power supply of the environmental sound detection module, which is always high when the device is in standby mode/on mode
- VCC MIC is the power supply of the microphone module, and it is always high when the device is in standby mode/on mode.
- Level VCC MCU is the power supply of the MCU module, and it is always high when the display device is in standby mode/on mode.
- the MCU module when the display device enters the standby mode, can control the output of CTRCL 2 to output a high level, and it can control the transistor Q1 to turn on, so that the input of the CTRL 4 input of the logic module is low. Processing, output high level from the CTRL3 output terminal of the logic module; when the CTRL3 output terminal outputs high level, it can control the transistor Q2 to turn on, thereby controlling the first switch module to turn on, so finally control the environmental sound detection module to power on.
- the environmental sound detection module can control the output of CTRL 1 to output a high level.
- the module and microphone module are powered off. That is, in standby mode: the ambient sound detection module is powered on and turned on, and the MCU module and microphone module are powered off and turned off.
- the environmental sound detection module when the environmental sound detection module detects that the size of the environmental sound is within the preset range in the standby mode, the environmental sound detection module can control the CTRL1 output terminal to output a low level, which can control the transistor Q3 to turn off, thereby controlling the transistors respectively Q4 and Q5 are turned on, and the second switch module and the third switch module are further controlled to be turned on, so the MCU module and the microphone module are finally controlled to be powered on.
- the MCU module can control the output of CTRCL2 to output a low level, which can control the transistor Q1 to turn off, so that the input of the CTRL4 input of the logic module is high, and after processing by the logic module, the output of the CTRL3 of the logic module outputs a low level;
- the CTRL3 output terminal outputs a low level, it can control the transistor Q2 to be turned off, so that the first switch module is turned off, so the environmental sound detection module is finally controlled to be powered off. That is, when the environmental sound detection module detects that the environmental sound is within the preset range in the standby mode: the MCU module and the microphone module are powered on and turned on, and the environmental sound detection module is powered off and turned off.
- the MCU module when the MCU module timing duration exceeds the set duration in the standby mode, the MCU module can control the CTRCL2 output terminal to output a high level, further control the CTRL3 output terminal to output a high level, and finally control the environmental sound detection module to power on.
- the environmental sound detection module can control the CTRL1 output terminal to output a high level, and finally control the MCU module and the microphone module to power off. That is, when the MCU module timing duration in standby mode exceeds the preset duration: the environmental sound detection module is powered on and turned on, and the MCU module and microphone module are powered off and turned off.
- the environmental sound detection module can control the CTRL1 output terminal to output a low level, and finally control the MCU module and the microphone module to power on.
- the MCU module can control the output of CTRCL2 to output low level, further control the output of CTRL3 to output low level, and finally control the power off of the environmental sound detection module. That is, in running mode: MCU module and microphone module are powered on and turned on, and ambient sound detection module is powered off and turned off.
- the first switch module, the second switch module, and the third switch module can be implemented as including a MOS transistor and a load resistor, and the logic module can be implemented as a form of a data selector with a function of choosing one from two.
- FIG. 6 only exemplarily shows the circuit configuration form of each module in the display device. As the circuit configuration form of the preferred embodiment in this application, there is no specific limitation in actual application.
- the display can be controlled. Standby power consumption of the device.
- intermittently controlling the microphone module and MCU module to be turned on or off at the same time compared with keeping the microphone module and MCU module turned on, can greatly reduce the display device in standby mode Standby power consumption.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本申请公开了一种显示设备。该显示设备包括环境音检测模块、麦克风模块和芯片处理模块;所述环境音检测模块,用于检测处于待机模式下的显示设备所在环境的环境音的大小,并根据环境音的大小控制麦克风模块和芯片处理模块开启或关闭;所述麦克风模块,用于采集用户输入的语音数据;所述芯片处理模块,用于从麦克风模块采集的语音数据中,识别和响应用户输入的语音唤醒指令,以将所述显示设备唤醒而进入运行模式。
Description
相关申请的交叉引用
本专利申请要求于2019年3月15日提交的、申请号为2019101993353、发明名称为“一种显示设备”的中国专利申请的优先权,该申请的全文以引用的方式并入本文中。
本申请涉及显示技术领域,尤其涉及一种显示设备。
为了满足用户个性化需求以及提高用户体验,显示设备可执行与用户输入的语音控制指令相关的各种交互功能。用户输入的语音控制指令,可以通过显示设备上内置的麦克风输入。
当前显示设备具有待机模式和运行模式两种状态。
通常,显示设备在运行模式下,全部或大多数服务均处于开启状态,如显示设备上内置的麦克风采集用户语音的服务、对用户语音进行处理的服务等,其能够对用户输入的语音控制指令进行识别和响应。
然而,显示设备在待机模式下,全部或大多数服务均处于关闭状态,同时需要通过持续上电的方式开启部分服务,如麦克风采集用户语音的服务、对用户语音进行处理的服务等,以能够对用户输入的语音控制指令进行识别和响应,如用户输入语音唤醒指令以使显示设备从待机模式唤醒为运行模式,这样会导致待机模式下的显示设备的待机功耗较大。
发明内容
本申请实施例提供一种显示设备,用以控制处于待机模式的显示设备的待机功耗。其中,所述显示设备包括环境音检测模块、麦克风模块和芯片处理模块;所述环境音检测模块,用于检测处于待机模式下的显示设备所在环境的环境音的大小,并根据环境音的大小控制麦克风模块和芯片处理模块开启或关闭;所述麦克风模块,用于采集用户输 入的语音数据;所述芯片处理模块,用于从麦克风模块采集的语音数据中,识别和响应用户输入的语音唤醒指令,以将所述显示设备唤醒而进入运行模式。
可选的,所述环境音检测模块,具体用于判断环境音的大小未在预设范围内时,控制麦克风模块和芯片处理模块关闭;判断环境音的大小在预设范围内时,控制麦克风模块和芯片处理模块开启。
可选的,在所述麦克风模块和所述芯片处理模块开启的同时,所述环境音检测模块关闭。
可选的,在所述芯片处理模块开启后,所述芯片处理模块,还用于检测自身开启的时长,并根据自身开启的时长控制所述环境音检测模块开启或关闭。
可选的,所述芯片处理模块,具体用于判断自身开启的时长超过设定时长时,控制所述环境音检测模块开启;判断自身开启的时长未超过设定时长时,控制所述环境音检测模块关闭。
可选的,所述显示设备还包括SOC模块,用于向所述芯片处理模块发送显示设备进入待机模式或运行模式的状态。
可选的,所述芯片处理模块,还用于在接收到所述SOC模块发送的显示设备进入待机模式的状态时,控制所述环境音检测模块开启;在接收到所述SOC模块发送的显示设备进入运行模式的状态时,控制所述环境音检测模块关闭。
图1中示例性示出了显示设备与控制装置之间操作场景的示意图;
图2中示例性示出了图1中控制装置的配置框图;
图3中示例性示出了图1中显示设备的配置框图;
图4中示例性示出了图1中显示设备的另一种配置框图;
图5中示例性示出了图1中显示设备的又一种配置框图;
图6中示例性示出了图5中各模块的电路配置框图。
提供示例性实施例以使本公开是透彻的且将本公开的范围完全传达给本领域技术人 员。为了透彻理解本公开实施例,阐述了许多具体细节,例如具体组件,具体设备和具体方法的示例。对本领域技术人员显而易见的是,不需要采用具体细节,示例性实施例可以以许多不同的形式来体现,并且都不应被解释为限制本公开的范围。在一些示例性实施例中,公知过程、公知的设备结构和公知技术并未详细描述。
在本申请使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本申请。在本文中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。术语“包括”、“包含”和“具有”或者其任何其他变体,意在涵盖非排他性的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地包括对于这些过程、方法、产品或设备固有的其他步骤或单元。除非明确标识为执行顺序,否则本文描述的方法步骤、过程和操作不应被解释为必须以所讨论或图示的特定顺序执行。还应理解可以采用附加步骤或替代步骤。
尽管本文可以使用术语第一,第二,第三等来描述各种元件、组件、区域、层和/或部分,但是这些元件、组件、区域、层和/或部分不应受这些术语的限制。这些术语仅可用于区分一元件、组件、区域、层或部分与另一元件、组件、区域、层或部分。除非上下文明确指出,否则本文中使用的诸如“第一”、“第二”和其他数字之类的术语并不暗示顺序或次序。因此,在不脱离示例性实施例的教导的情况下,下面讨论的第一元件,第一组件,第一区域,第一层或第一部分可以被称为第二元件,第二组件,第二区域,第二层或第二部分。
为了方便起见,在本文中可以使用空间相对术语,例如“内部”、“外部”、“之下”、“下方”、“下部”、“上方”、“上部”等。用于描述图中所示的一个元件或特征与另一个或多个元件或特征的关系。空间相对术语除了附图中描绘的方位之外,还可以意图涵盖使用或操作中的设备的不同方位。例如,如果附图中的装置被翻转,则被描述为在其他元件或特征“之下”或“下方”的元件将被重新定向在其他元件或特征“之上”。因此,示例性术语“在...下”可以包括上和下两个相对方位。可以其他方式(旋转90度或其他方向)为设备定向,由此解释本文所用的空间相对描述语。
下面结合说明书附图对本申请实施例进行详细描述。
图1中示例性示出了显示设备与控制装置之间操作场景的示意图。如图1所示,控制装置100和显示设备20之间可以有线或无线方式进行通信。
其中,控制装置100被配置为控制显示设备20,其可接收用户输入的操作指令,且将操作指令转换为显示设备20可识别和响应的指令,起着用户与显示设备20之间交互的中介作用。例如:用户通过操作控制装置100上频道控制键,显示设备20响应频道控制的操作。
控制装置100可以是遥控器100A,包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,通过无线或其他有线方式来控制显示设备20。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备20。如:用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令,来实现控制显示设备20的功能。
控制装置100也可以是智能设备,如移动终端100B、平板电脑、计算机、笔记本电脑等。例如,使用在智能设备上运行的应用程序控制显示设备20。该应用程序通过配置可以在与智能设备关联的屏幕上,通过直观的用户界面(UI)为用户提供各种控制。
示例性的,移动终端100B可与显示设备20安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作的和数据通信的目的。如:可以使移动终端100B与显示设备20建立控制指令协议,通过操作移动终端100B上提供的用户界面的各种功能键或虚拟按钮,来实现如遥控器100A布置的实体按键的功能。也可以将移动终端100B上显示的音视频内容传输到显示设备20上,实现同步显示功能。
显示设备20可提供广播接收功能和计算机支持功能的网络电视功能。显示设备示例性的包括,数字电视、网络电视、互联网协议电视(IPTV)等。
显示设备20,可以是液晶显示器、有机发光显示器、投影设备。具体显示设备类型、尺寸大小和分辨率等不作限定。
显示设备20还与服务器300通过多种通信方式进行数据通信。这里可允许显示设备20通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器300可以向显示设备20提供各种内容和互动。示例性的,显示设备20可以发送和接收信息,例如:接收电子节目指南(EPG)数据、接收软件程序更新、或访问远程储存的数字媒体库。服务器300可以一组,也可以多组,可以一类或多类服务器。通过服务器300提供视频点播和广告服务等其他网络服务内容。
图2中示例性示出了控制装置100的配置框图。如图2所示,控制装置100包括控制器110、存储器120、通信器130、用户输入接口140、输出接口150、供电电源160。
控制器110包括随机存取存储器(RAM)111、只读存储器(ROM)112、处理器113、通信接口以及通信总线。控制器110用于控制控制装置100的运行和操作,以及内部各部件之间的通信协作、外部和内部的数据处理功能。
示例性的,当检测到用户按压在遥控器100A上布置的按键的交互或触摸在遥控器100A上布置的触摸面板的交互时,控制器110可控制产生与检测到的交互相应的信号,并将该信号发送到显示设备20。
存储器120,用于在控制器110的控制下存储驱动和控制控制装置100的各种运行程序、数据和应用。存储器120,可以存储用户输入的各类控制信号指令。
通信器130在控制器110的控制下,实现与显示设备20之间控制信号和数据信号的通信。如:控制装置100经由通信器130将控制信号(例如触摸信号或按钮信号)发送至显示设备20上,控制装置100可经由通信器130接收由显示设备20发送的信号。通信器130可以包括红外信号接口131和射频信号接口132。例如:红外信号接口时,需要将用户输入指令按照红外控制协议转化为红外控制信号,经红外发送模块进行发送至显示设备20。再如:射频信号接口时,需将用户输入指令转化为数字信号,然后按照射频控制信号调制协议进行调制后,由射频发送端子发送至显示设备20。
用户输入接口140,可包括麦克风141、触摸板142、传感器143、按键144等中至少一者,从而用户可以通过语音、触摸、手势、按压等将关于控制显示设备20的用户指令输入到控制装置100。
输出接口150,通过将用户输入接口140接收的用户指令输出至显示设备20,或者,输出由显示设备20接收的图像或语音信号。这里,输出接口150可以包括LED接口151、产生振动的振动接口152、输出声音的声音输出接口153和输出图像的显示器154等。例如,遥控器100A可从输出接口150接收音频、视频或数据等输出信号,并且将输出信号在显示器154上显示为图像形式、在声音输出接口153输出为音频形式或在振动接口152输出为振动形式。
供电电源160,用于在控制器110的控制下为控制装置100各元件提供运行电力支持。形式可以为电池及相关控制电路。
图3中示例性示出了显示设备的配置框图。如图3所示,显示设备200中可以包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、存储器260、用户接口265、视频处理器270、显示器275、音频处理器280、音频输入接口285、供 电电源290。
调谐解调器210,通过有线或无线方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,用于从多个无线或有线广播电视信号中解调出用户所选择的电视频道的频率中所携带的音视频信号,以及诸如EPG数据的附加信息。
调谐解调器210,可根据用户选择,以及由控制器250控制,响应用户选择的电视频道的频率以及该频率所携带的电视信号。
调谐解调器210,根据电视信号的广播制式不同,可以接收信号的途径有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播等;以及根据调制类型不同,可以数字调制方式或模拟调制方式;以及根据接收电视信号的种类不同,可以解调模拟信号和数字信号。
在其他一些示例性实施例中,调谐解调器210也可在外部设备中,如外部机顶盒等。这样,机顶盒通过调制解调后输出电视信号,经过外部装置接口240输入至显示设备200中。
通信器220,是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如显示设备200可将内容数据发送至经由通信器220连接的外部设备,或者,从经由通信器220连接的外部设备浏览和下载内容数据。通信器220可以包括WIFI(Wireless Fidelity)模块221、蓝牙通信协议模块222、有线以太网通信协议模块223等网络通信协议模块或近场通信协议模块,从而通信器220可在控制器250的控制下接收控制装置100的控制信号,并将控制信号实现为WIFI信号、蓝牙信号、射频信号等。
检测器230,是显示设备200用于采集外部环境信号或与外部交互的信号的组件。检测器230可以包括声音采集器231,如麦克风,可以用于接收用户的声音,如用户控制显示设备200的控制指令的语音信号;或者,可以采集用于识别环境场景类型的环境声音,以使显示设备200根据环境声音调整自身的音频输出,实现显示设备200可以自适应环境噪声。
在其他一些示例性实施例中,检测器230,还可以包括图像采集器232,如相机、摄像头等,可以用于采集外部环境场景,以自适应变化显示设备200的显示参数;以及用于采集用户的属性或与用户交互手势,以实现显示设备与用户之间互动的功能。
在其他一些示例性实施例中,检测器230,还可以包括光接收器,用于采集环境光线强度,以自适应显示设备200的显示参数变化等。
在其他一些示例性实施例中,检测器230,还可以包括温度传感器,如通过感测环境温度,显示设备200可自适应调整图像的显示色温。示例性的,当处于温度偏高的环境,可调整显示设备200显示图像色温偏冷色调;当处于温度偏低的环境,可以调整显示设备200显示图像色温偏暖色调。
外部装置接口240,是提供控制器250控制显示设备200与外部设备间数据传输的组件。外部装置接口240可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等外部设备连接,可接收外部设备的诸如视频信号(例如运动图像数据)、音频信号(例如音乐数据)、附加信息(例如EPG数据)等数据。
其中,外部装置接口240可以包括:高清多媒体接口(HDMI)端子241、复合视频消隐同步(CVBS)端子242、模拟或数字分量端子243、通用串行总线(USB)端子244、组件(Component)端子(图中未示出)、红绿蓝(RGB)端子(图中未示出)等任一个或多个。
控制器250,通过运行存储在存储器260上的各种软件控制程序(如操作系统和各种应用程序),来控制显示设备200的工作和响应用户的操作。
如图3所示,控制器250包括随机存取存储器(RAM)251、只读存储器(ROM)252、图形处理器253、处理器254、通信接口255、以及通信总线256。其中,RAM 251、ROM 252以及图形处理器253、处理器254和通信接口255通过通信总线256相连接。
ROM 252,用于存储各种系统启动指令。例如,在接收到开机信号时,显示设备200电源开始启动,处理器254运行ROM 252中的系统启动指令,将存储在存储器260的操作系统拷贝至RAM 251中,以启动操作系统。当操作系统启动完成后,处理器254再将存储器260中各种应用程序拷贝至RAM 251中,然后,启动各种应用程序。
图形处理器253,用于产生各种图形对象,如图标、操作菜单、以及用户输入指令显示图形等。图形处理器253可以包括运算器,用于通过接收用户输入各种交互指令进行运算,进而根据显示属性显示各种对象;以及包括渲染器,用于产生基于运算器得到的各种对象,将进行渲染的结果显示在显示器275上。
处理器254,例如CPU,用于执行存储在存储器260中的操作系统和应用程序指令。以及根据接收的用户输入指令,来执行各种应用程序、数据和内容的处理,以便最终显示和播放各种音视频内容。
在一些示例性实施例中,处理器254,可以包括多个处理器。多个处理器可包括一 个主处理器以及多个或一个子处理器。主处理器,用于在显示设备预加载模式中执行显示设备200的一些初始化操作,和/或,在正常模式下显示画面的操作。多个或一个子处理器,用于执行在显示设备待机模式等状态下的一种操作。
通信接口255,可包括第一接口到第n接口。这些接口可以是经由网络被连接到外部设备的网络接口。
控制器250可以控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器275上显示的图形用户界面GUI对象的用户输入命令,控制器250便可以执行与由用户输入命令选择的对象有关的操作。
其中,该对象可以是可选对象中的任何一个,例如超链接或图标。该与所选择的对象有关的操作,例如连接到超链接页面、文档、图像等操作,或者执行与对象相对应的程序的操作。该用于选择GUI对象的用户输入命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。
存储器260,用于存储驱动和控制显示设备200运行的各种类型的数据、软件程序或应用程序。存储器260可以包括易失性和/或非易失性存储器。而术语“存储单元”包括存储器260、控制器250的RAM 251和ROM 252、或显示设备200中的存储卡。
在一些实施例中,存储器260具体用于存储驱动显示设备200中控制器250的运行程序;存储显示设备200内置的和用户从外部设备下载的各种应用程序;存储用于配置由显示器275提供的各种GUI、与GUI相关的各种对象及用于选择GUI对象的选择器的视觉效果图像等数据。
在一些实施例中,存储器260具体用于存储调谐解调器210、通信器220、检测器230、外部装置接口240、视频处理器270、显示器275、音频处理器280等的驱动程序和相关数据,从外部装置接口接收的外部数据(例如音视频数据)或用户接口接收的用户数据(例如按键信息、语音信息、触摸信息等)。
在一些实施例中,存储器260具体存储用于表示操作系统(OS)的软件和/或程序,这些软件和/或程序可包括,例如:内核、中间件、应用编程接口(API)和/或应用程序。示例性的,内核可控制或管理系统资源,以及其它程序所实施的功能(如所述中间件、API(Application Programming Interface)或应用程序);同时,内核可以提供接口,以允许中间件、API或应用程序访问控制器,以实现控制或管理系统资源。
例如:存储器260中存储的各种软件模块,可以包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等。这里,基础模块是用于对显示设备中各个硬件元件接收的信号进行信号处理、并向上层应用模块发送处理后信号的底层软件模块。检测模块是用于从各种检测器或用户接口中收集各种信息,并对收集到的信息进行数模转换以及分析管理的管理模块。通信模块是用于与外部设备之间进行控制信号和数据信号通信的模块。显示控制模块是用于控制显示器进行显示图像内容的模块,可以用于播放多媒体图像内容和GUI界面信息。浏览器模块是用于通过执行web浏览操作访问web服务器的模块。服务模块是用于提供各种服务以及各类应用程序的模块。
用户接口265,接收各种用户交互。具体的,用于将用户的输入信号发送给控制器250,或者,将来自控制器250的输出信号传送给用户。示例性的,遥控器100A可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户接口265,再由用户接口265转送至控制器250;或者,遥控器100A可接收经控制器250处理从用户接口265输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。
在一些实施例中,用户可在显示器275上显示的图形用户界面(GUI)输入用户命令,则用户接口265通过GUI接收用户输入命令。确切的说,用户接口265可接收用于控制选择器在GUI中的位置以选择不同的对象或项目的用户输入命令。
在另一些实施例中,用户可通过输入特定的声音或手势进行输入用户命令,则用户接口265通过传感器识别出声音或手势,来接收用户输入命令。视频处理器270,用于接收外部的视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理,可得到直接在显示器275上显示或播放的视频信号。
示例性的,视频处理器270,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等。
其中,解复用模块,用于对输入音视频数据流,例如MPEG-2(基于数字存储媒体运动图像和语音的压缩标准)流,进行解复用处理,则解复用模块将其进行解复用成视频信号和音频信号等。
视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示的图像信号。
帧率转换模块,用于对输入视频的帧率进行转换,如将输入的60Hz视频的帧率转换为120Hz或240Hz的帧率,通常的格式采用如插帧方式实现。
显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示器显示格式的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。
显示器275,用于接收源自视频处理器270输入的图像信号,并显示视频内容、图像以及菜单操控界面。视频内容,可以是来自调谐解调器210接收的广播信号中的视频内容,也可以是来自通信器220或外部装置接口240输入的视频内容。显示器275,同时显示在显示设备200中产生且用于控制显示设备200的用户操控界面UI。
以及,显示器275可以包括用于呈现画面的显示屏组件以及驱动图像显示的驱动组件。可选地,若显示器275为一种投影显示器,还可以包括一种投影装置和投影屏幕。
音频处理器280,用于接收外部的音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等音频数据处理,得到可以在扬声器286中播放的音频信号。
示例性的,音频处理器280可以支持各种音频格式。例如MPEG-2、MPEG-4、高级音频编码(AAC)、高效AAC(HE-AAC)等格式。
音频输出接口285,用于在控制器250的控制下接收音频处理器280输出的音频信号,音频输出接口285可包括扬声器286,或输出至外接设备的外接音响输出端子287,如耳机输出端子。
在其他一些示例性实施例中,视频处理器270可以包括一个或多个芯片组成。音频处理器280,也可以包括一个或多个芯片组成。
在其他一些示例性实施例中,视频处理器270和音频处理器280,可以分别为单独的芯片,也可以与控制器250一起集成在一个或多个芯片中。
供电电源290,用于在控制器250的控制下,将外部电源输入的电力为显示设备200供电。供电电源290可以是安装在显示设备200内部的内置电源电路,也可以是安装在显示设备200外部的电源。
图4示例性示出了显示设备的另一种配置框图。如图4所示,显示设备200’可以包 括电源板21、主板23、麦克风模块25。这些组件在一定程度上可以对应于图3中部分组件。
其中,电源板21,用于为主板23、麦克风模块25等组件供电。电源板21可以对应于图3中的供电电源290。
主板23,用于对显示设备中的各种信号进行处理。例如,处理及响应麦克风模块25采集的声音信号,如将该声音信号转换为语音控制指令;将从诸如调谐解调器210输入的射频信号、HDMI 241和USB 244输入的数字信号、分量接口243输入的分量信号等外部装置接口240输入的信号经过格式变换处理,以产生统一的、可由显示器275识别的信号,如低压差分信号;将从外部装置接口240输入的音频信号经音量控制、音效处理后输出至音频输出接口285。
主板23,可以包括图3中的外部装置接口240、控制器250、视频处理器270、音频处理器280、音频输出接口285、存储器260等组件以及各种集成电路。其中,主板23上的控制器250可被实施为SOC(System on Chip,系统级芯片)模块23a、MCU(Micro Control Unit,微控制单元)模块23b。SOC模块23a和MCU模块23b可以集成在一起,也可以分开。本申请实施例中的MCU模块23b是一种芯片处理模块。
麦克风模块25,用于采集用户的声音或采集识别环境场景的环境音。例如,麦克风模块25可以采集用户的声音,从而主板23可以将该声音转换成语音控制指令,以实现控制显示设备200’的各种功能;麦克风模块25还可以采集环境音,从而主板23可以根据该环境音调整音频输出接口的输出音频,以实现显示设备200’自适应环境噪声。麦克风模块205可以对应于图3中的检测器230。
基于上述图3中显示设备200和图4中显示设备200’的配置框图,无需操作控制装置100也可以实现控制显示设备200。具体的,显示设备200可以直接通过图3中声音采集器231或图4中麦克风模块25采集用户发出的语音,进而将该语音转换成语音控制指令,以执行语音控制指令对应的功能。
例如,语音唤醒功能:当处于待机模式下的显示设备接收到用户发出的包含唤醒词的语音控制指令时,该显示设备便从待机模式中被唤醒而进入运行模式。
具体的,如图4所示,在显示设备处于待机模式下,麦克风模块25和MCU模块23b一直保持上电(处于开启状态),而SOC模块23a保持掉电(处于关闭状态);在显示设备处于运行模式下,麦克风模块25、MCU模块23b和SOC模块23a均保持上电(处 于开启状态)。
在此基础上,处于待机模式下的显示设备,麦克风模块25采集用户发出包含唤醒词的声音数据,并将声音数据传输至MCU模块23b;MCU模块23b接收该声音数据,经本地识别处理后识别出该声音数据中包含唤醒词,然后MCU模块23b根据该识别结果确定为唤醒显示设备的语音唤醒指令,并触发SOC模块23a进入工作状态,从而实现显示设备由待机模式被唤醒以进入运行模式。
又如,画面截图功能:当处于运行模式下的显示设备接收到用户发出的截图的语音控制指令时,其便对显示设备当前画面进行截图处理。
具体的,处于运行模式下的显示设备,麦克风模块25采集用户发出包含与截图相关关键词的声音数据,并将声音数据传输至MCU模块23b;MCU模块23b再将该声音数据传输至SOC模块23a;SOC模块23a通知语音和语义服务器对该声音数据进行语音识别和结果转换,并根据语音和语义服务器返回识别结果,将该识别结果确定为对显示设备显示的当前画面进行截图的语音控制指令,进而执行当前画面截图处理。
需要说明的是,待机模式下的显示设备中的大部分系统服务或全部系统服务处于关闭状态。例如待机模式下的显示设备中媒体输出功能的相关部件处于关闭状态,比如显示设备的音频输出为关闭状态,屏幕为不亮状态。且待机模式下,显示设备处于低功耗的工作状态,此时消耗的功率即为待机功耗。运行模式下的显示设备中的大部分系统服务或全部系统服务处于开启状态,其可正常工作。例如运行模式下的显示设备中媒体输出功能的相关部件处于开启状态,其音频输出为开启状态,屏幕为点亮状态。
显示设备的待机模式和运行模式可以相互切换。对于处于运行模式的显示设备,当用户操作控制装置上的电源键或者通过语音控制进行关机时,处于运行模式的显示设备进入待机模式。对于处于待机模式的显示设备,当用户操作控制装置上的电源键或通过语音控制进行开机时,处于待机模式的显示设备进入运行模式。
然而,基于图4中显示设备的配置框图,具有语音唤醒功能的显示设备,在待机模式下,用于采集用户声音数据的麦克风模块和用于处理包含唤醒词的用户声音数据的MCU模块需要一直保持上电才能工作,这使得待机模式下的显示设备的待机功耗较大。
图5中示例性示出了显示设备的又一种配置框图。如图5所示,显示设备200”可以包括电源板21、主板23、麦克风模块25、环境音检测模块27。这些组件在一定程度上可以对应于图3中部分组件。
与图4不同的是,图5中增加了环境音检测模块27。
环境音检测模块27,用于检测环境音的大小,并根据环境音的大小控制麦克风模块25和MCU模块23b的开启或关闭。环境音检测模块27可以对应于图3中的检测器230。
这里,图5中麦克风模块25和环境音检测模块27集成在一起与主板23连接,但也可以分开单独与主板23连接,具体不作限定。
图5所示的显示设备,尤其是该显示设备具有语音唤醒功能时,可以控制其待机模式下的待机功耗。各模块的具体功能将在下面做详细描述。
SOC模块23a,用于将显示设备进入待机模式或运行模式的状态通知MCU模块23b,以使MCU模块23b控制环境音检测模块27开启或关闭。
MCU模块23b,用于控制环境音检测模块27的开启或关闭,同时用于识别用户输入的语音数据,并在识别出用户输入的语音数据为语音唤醒指令时,触发SOC模块23a控制显示设备由待机模式进入运行模式。
麦克风模块25,用于采集用户输入的语音数据,并将该语音数据传输至MCU模块23b。例如包含唤醒词的语音数据。
环境音检测模块27,用于检测环境音的大小,并根据环境音的大小控制麦克风模块25和MCU模块23b的开启或关闭,从而能够控制具有语音唤醒功能的显示设备处于待机模式下的待机功耗。
在实施例一中,如图5所示,在显示设备处于待机模式下,环境音检测模块27保持上电,即处于开启状态,麦克风模块25和MCU模块23b可以根据是否满足环境音检测模块27的设定条件而交替性的保持上电(即处于开启状态)或掉电(即处于关闭状态),以及SOC模块23a保持掉电,即处于关闭状态。
具体的,具有语音唤醒功能的显示设备,SOC模块将显示设备进入待机模式的状态通知MCU模块后:
MCU模块通过上电方式控制环境音检测模块开启。
环境音检测模块开启后,首先通过断电方式控制MCU模块及麦克风模块关闭。其次可以采集外界的环境音;检测环境音的大小;并判断环境音大小是否在预设范围内,以通过上电或断电方式控制麦克风模块和MCU模块的开启或关闭。
可选的,环境音检测模块判断环境音大小未在预设范围内时,表示当前处于用户可能无需观看显示设备的环境音场景,即该场景下用户将待机模式的显示设备唤醒的概率几乎为0,从而该场景下无需麦克风模块和MCU模块持续工作,所以环境音检测模块通过断电方式保持麦克风模块和MCU模块关闭,这样可以大大降低由于麦克风模块和MCU模块一直上电而带来的待机功耗。
可选的,环境音检测模块判断环境音大小在预设范围内时,表示当前处于用户可能需要观看显示设备的环境音场景,即该场景下用户有较大概率需要将待机模式的显示设备唤醒,从而该场景下需要麦克风模块和MCU模块持续检测工作,所以环境音检测模块通过上电方式控制麦克风模块和MCU模块开启,以检测用户是否发出语音唤醒指令而唤醒显示设备进入运行模式。
这里,预设范围可以根据经验或试验设定,示例性的,预设范围为40~70分贝,例如45分贝、55分贝、65分贝等。该范围内环境较适宜,如家人一起吃晚饭时或晚饭之后的状态,此环境场景下用户有较大概率需要将待机模式的显示设备唤醒;40分贝以下时环境较安静,如夜晚睡觉或白天无人状态,此环境场景下用户可能不会将待机模式的显示设备唤醒;70分贝以上时环境较吵闹,如白天邀请朋友聚会状态,此环境下用户将待机模式的显示设备唤醒的概率很小。
此外,需要注意的是,环境音检测模块上电引起的功耗远小于麦克风模块和MCU模块上电引起的功耗。
在该实施例中,根据环境音检测模块检测的环境音大小是否在预设范围内,来间歇性的控制麦克风模块和MCU模块二者同时开启或关闭,从而能够控制处于待机模式下的显示设备的部分待机功耗。
在实施例二中,如图5所示,在显示设备处于待机模式下,环境音检测模块27可以根据是否满足预定义条件而周期性保持上电(即处于开启状态)或掉电(即处于关闭状态),麦克风模块25和MCU模块23b可以根据是否满足环境音检测模块27的设定条件而交替性的保持上电(即处于开启状态)或掉电(即处于关闭状态),以及SOC模块23a保持掉电(即处于关闭状态)。
与实施例一不同的是,SOC模块将显示设备进入待机模式的状态通知MCU模块后:
MCU模块通过上电方式控制环境音检测模块开启。
环境音检测模块开启后,首先通过断电方式控制MCU模块及麦克风模块关闭。其次环境音检测模块启动计时,并根据计时时长是否超过设定时长,来控制自身的开启或关闭。
可选的,环境音检测模块计时时长超过设定时长时,通过断电方式控制自身关闭,并保持麦克风模块和MCU模块关闭。这样可以大大降低由于麦克风模块和MCU模块一直上电而带来的待机功耗。
可选的,环境音检测模块计时时长未超过设定时长时,保持自身开启;同时可以采集外界的环境音;检测环境音的大小;并判断环境音大小是否在预设范围内,以通过上电或断电方式控制麦克风模块和MCU模块的开启或关闭。这样,能够进一步降低由于麦克风模块和MCU模块一直上电而带来的待机功耗。
这里,环境音检测模块根据环境音大小是否在预设范围内,来控制麦克风模块和MCU模块的开启或关闭,具体实现方式可以参照上述实施例一。
这里,设定时长可以是环境音检测模块开启一次的持续时长,例如设定时长可以是60分钟。且设定时长可以根据经验和实验设定。
在该实施例中,根据环境音检测模块开启的时长是否超过设定时长,来周期性的控制环境音检测模块的开启或关闭,进一步周期性控制麦克风模块和MCU模块二者同时开启或关闭,从而也能够控制处于待机模式下的显示设备的部分待机功耗。
在实施例三中,如图5所示,在显示设备处于待机模式下,麦克风模块25和MCU模块23b,以及环境音检测模块27,三者之间可以根据是否满足预先设定的条件而交替性的保持上电(即处于开启状态)或掉电(即处于关闭状态),而SOC模块23a保持掉电(即处于关闭状态)。
与实施例一和实施例二不同之处包括以下两个方面。
一方面,在环境音检测模块判断环境音大小在预设范围内时,通过上电方式控制麦克风模块和MCU模块开启之后,为了进一步降低由于麦克风模块和MCU模块保持上电而又长时间未检测到用户发出的语音唤醒指令导致的待机功耗,在上述实施例基础上,开启MCU模块和麦克风模块的同时,令MCU模块启动计时。
若计时时长超过设定时长,表示当前处于用户可能无需观看显示设备的环境音场景,即该场景下用户将待机模式的显示设备唤醒的概率很小,也就是说用户没有进一步操作,例如没有发出语音,从而该场景下无需麦克风模块和MCU模块持续工作,所 以MCU模块通过上电方式控制环境音检测模块开启,同时环境音检测模块开启后通过断电方式控制MCU模块及麦克风模块关闭。从而可以进一步降低由于麦克风模块和MCU模块长时间上电而未检测到用户语音所带来的待机功耗。
若计时时长未超过设定时长,表示当前处于用户可能需要观看显示设备的环境音场景,即该场景下用户有较大概率需要将待机模式的显示设备唤醒,从而该场景下需要麦克风模块和MCU模块持续检测工作,所以保持开启麦克风模块和MCU模块,以及保持关闭环境音检测模块,使得麦克风模块持续准备采集用户输入的语音,MCU模块持续识别用户输入的语音,并在识别出用户输入的语音为语音唤醒指令时触发SOC模块控制显示设备由待机模式进入运行模式。
这里,设定时长可以是判断一次环境音大小在预设范围内时保持打开麦克风模块和MCU模块的持续时长,例如设定时长可以是15分钟。且设定时长可以根据经验和实验设定。
另一方面,在环境音检测模块判断环境音大小在预设范围内时,环境音检测模块通过上电方式控制麦克风模块和MCU模块开启,以检测用户是否发出语音唤醒指令而唤醒显示设备进入运行模式。同时,MCU模块开启后通过断电方式控制环境音检测模块关闭,这样降低由于环境音检测模块的持续上电而进一步带来的待机功耗。
在该实施例中,在环境音检测模块检测出环境音的大小在预设范围内时,进一步通过判断麦克风模块和MCU模块的开启时长是否超过设定时长,来进一步控制麦克风模块和MCU模块同时开启或关闭,从而也能够控制处于待机模式下的显示设备的部分待机功耗。
在上述实施例一、实施例二和实施例三的基础上,在显示设备处于运行模式下,麦克风模块25、MCU模块23b和SOC模块23a均保持上电(即处于开启状态),而环境音检测模块27保持掉电(即处于关闭状态)。
具体的,当处于待机模式的显示设备通过语音唤醒功能被唤醒而进入运行模式时,SOC模块将显示设备进入运行模式的状态通知MCU模块后:
MCU模块通过断电方式控制环境音检测模块关闭,从而使得麦克风模块持续准备采集用户输入的语音,MCU模块持续接收用户输入的语音,并将该语音传输至SOC模块,以供SOC模块识别出该语音对应的语音控制指令、并执行与语音控制指令对应的功能。
在一个示例中,MCU模块、麦克风模块和环境音检测模块之间,可以通过高低 电平的触发来实现上电或断电,进而实现开启或关闭。
图6中示例性示出了图5中各模块的电路配置框图。如图6所示,VCC
check为环境音检测模块的电源,显示设备待机模式/开机模式时一直为高电平;VCC
MIC为麦克风模块的电源,显示设备待机模式/开机模式时一直为高电平;VCC
MCU为MCU模块的电源,显示设备待机模式/开机模式时一直为高电平。
在一个示例中,显示设备进入待机模式时,MCU模块可以控制CTRCL 2输出端输出高电平,其可以控制三极管Q1导通,从而逻辑模块的CTRL 4输入端输入为低电平,经逻辑模块处理,从逻辑模块的CTRL3输出端输出高电平;CTRL 3输出端输出高电平时,其可以控制三极管Q2导通,从而控制第一开关模块导通,所以最终控制环境音检测模块上电。环境音检测模块可以控制CTRL 1输出端输出高电平,其可以控制三极管Q3导通,从而分别控制三极管Q4和Q5截止,进一步控制第二开关模块和第三开关模块断开,所以最终控制MCU模块和麦克风模块断电。即待机模式时:环境音检测模块上电而开启,MCU模块和麦克风模块断电而关闭。
在一个示例中,当待机模式下环境音检测模块检测到环境音大小在预设范围内时,环境音检测模块可以控制CTRL1输出端输出低电平,其可以控制三极管Q3截止,从而分别控制三极管Q4和Q5导通,进一步控制第二开关模块和第三开关模块导通,所以最终控制MCU模块和麦克风模块上电。MCU模块可以控制CTRCL2输出端输出低电平,其可以控制三极管Q1截止,从而逻辑模块的CTRL 4输入端输入为高电平,经逻辑模块处理,从逻辑模块的CTRL3输出端输出低电平;CTRL3输出端输出低电平时,其可以控制三极管Q2截止,从而第一开关模块断开,所以最终控制环境音检测模块断电。即待机模式下环境音检测模块检测到环境音大小在预设范围内时:MCU模块和麦克风模块上电而开启,环境音检测模块断电而关闭。
在一个示例中,当待机模式下MCU模块计时时长超过设定时长时,MCU模块可以控制CTRCL2输出端输出高电平,进一步控制CTRL3输出端输出高电平,最终控制环境音检测模块上电。环境音检测模块可以控制CTRL1输出端输出高电平,最终控制MCU模块和麦克风模块断电。即待机模式下MCU模块计时时长超过预设时长时:环境音检测模块上电而开启,MCU模块和麦克风模块断电而关闭。
在一个示例中,显示设备进入运行模式时,环境音检测模块可以控制CTRL1输出端输出低电平,最终控制MCU模块和麦克风模块上电。MCU模块可以控制CTRCL2输出端输出低电平,进一步控制CTRL3输出端输出低电平,最终控制环境音检测模块 断电。即运行模式时:MCU模块和麦克风模块上电而开启,环境音检测模块断电而关闭。
图6中,第一开关模块、第二开关模块和第三开关模块可被实施为包括MOS管和负载电阻,逻辑模块可被实施为具有二选一功能的数据选择器的形式。另外,图6仅是示例性的示出了显示设备中各模块的电路配置形式,作为本申请中的优选实施例的电路配置形式,实际应用中不作具体限定。
在上述示出的实施例中,通过在显示设备中引入“环境音检测模块”,并且,通过对处于待机模式下的显示设备中各个模块的开启或关闭进行间歇性的控制,从而能够控制显示设备的待机功耗。特别是对处于待机模式下的显示设备,间歇性的控制麦克风模块和MCU模块二者同时开启或关闭,与一直保持麦克风模块和MCU模块的开启相比,可以大大降低处于待机模式下的显示设备的待机功耗。
出于说明和描述的目的,提供了前述实施例,而非旨在穷举或限制本公开。具体实施例的各个元件或特征通常不限于该具体实施例,而是在适用情况下即使未具体示出或描述也可在所选实施例中使用或互换。同样也可以许多形式变型,这种变型不被认为是脱离本公开,而且所有这样的修改被涵盖在本公开的范围内。
Claims (7)
- 一种显示设备,其特征在于,包括:麦克风模块,用于采集用户输入的语音数据;芯片处理模块,用于从所述麦克风模块采集的语音数据中,识别和响应所述用户输入的语音唤醒指令,以将所述显示设备唤醒而进入运行模式;环境音检测模块,用于检测处于待机模式下的所述显示设备所在环境的环境音的大小,并根据所述环境音的大小控制所述麦克风模块和所述芯片处理模块开启或关闭。
- 如权利要求1所述的显示设备,其特征在于,所述环境音检测模块具体用于,判断所述环境音的大小未在预设范围内时,控制所述麦克风模块和所述芯片处理模块关闭;判断所述环境音的大小在预设范围内时,控制所述麦克风模块和所述芯片处理模块开启。
- 如权利要求2所述的显示设备,其特征在于,在所述麦克风模块和所述芯片处理模块开启的同时,所述环境音检测模块关闭。
- 如权利要求2所述的显示设备,其特征在于,在所述芯片处理模块开启后,所述芯片处理模块还用于,检测自身开启的时长,并根据自身开启的时长控制所述环境音检测模块开启或关闭。
- 如权利要求4所述的显示设备,其特征在于,所述芯片处理模块具体用于,判断自身开启的时长超过设定时长时,控制所述环境音检测模块开启;判断自身开启的时长未超过设定时长时,控制所述环境音检测模块关闭。
- 如权利要求1所述的显示设备,其特征在于,还包括:SOC模块,用于向所述芯片处理模块发送所述显示设备进入所述待机模式或所述运行模式的状态。
- 如权利要求6所述的显示设备,其特征在于,所述芯片处理模块还用于,在接收到所述SOC模块发送的所述显示设备进入所述待机模式的状态时,控制所述环境音检测模块开启;在接收到所述SOC模块发送的显示设备进入所述运行模式的状态时,控制所述环境音检测模块关闭。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910199335.3 | 2019-03-15 | ||
| CN201910199335.3A CN111698544A (zh) | 2019-03-15 | 2019-03-15 | 一种显示设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020187050A1 true WO2020187050A1 (zh) | 2020-09-24 |
Family
ID=72475455
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2020/078061 Ceased WO2020187050A1 (zh) | 2019-03-15 | 2020-03-05 | 一种显示设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111698544A (zh) |
| WO (1) | WO2020187050A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4525429A4 (en) * | 2022-05-23 | 2025-06-25 | LG Electronics Inc. | Display device |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112492393A (zh) * | 2020-11-25 | 2021-03-12 | 海信视像科技股份有限公司 | 一种mic开关关联节能模式的实现方法及显示设备 |
| CN113742003B (zh) * | 2021-09-15 | 2023-08-22 | 深圳市朗强科技有限公司 | 一种基于fpga芯片的程序代码执行方法及设备 |
| JP7669895B2 (ja) * | 2021-09-27 | 2025-04-30 | セイコーエプソン株式会社 | プロジェクターの制御方法、及び、プロジェクションシステム |
| CN117130462B (zh) * | 2023-03-20 | 2024-07-26 | 荣耀终端有限公司 | 一种设备控制方法及电子设备 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009122598A (ja) * | 2007-11-19 | 2009-06-04 | Pioneer Electronic Corp | 電子機器、電子機器の制御方法、音声認識装置、音声認識方法及び音声認識プログラム |
| US20140278443A1 (en) * | 2012-10-30 | 2014-09-18 | Motorola Mobility Llc | Voice Control User Interface with Progressive Command Engagement |
| CN104820556A (zh) * | 2015-05-06 | 2015-08-05 | 广州视源电子科技股份有限公司 | 唤醒语音助手的方法及装置 |
| CN105094816A (zh) * | 2015-07-09 | 2015-11-25 | 北京君正集成电路股份有限公司 | 一种降低智能设备功耗的方法及智能设备 |
| CN107528971A (zh) * | 2017-08-10 | 2017-12-29 | 珠海市魅族科技有限公司 | 语音唤醒方法及装置、计算机装置及可读存储介质 |
| CN109218899A (zh) * | 2018-08-29 | 2019-01-15 | 出门问问信息科技有限公司 | 一种语音交互场景的识别方法、装置及智能音箱 |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103021411A (zh) * | 2012-11-27 | 2013-04-03 | 威盛电子股份有限公司 | 语音控制装置和语音控制方法 |
-
2019
- 2019-03-15 CN CN201910199335.3A patent/CN111698544A/zh active Pending
-
2020
- 2020-03-05 WO PCT/CN2020/078061 patent/WO2020187050A1/zh not_active Ceased
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009122598A (ja) * | 2007-11-19 | 2009-06-04 | Pioneer Electronic Corp | 電子機器、電子機器の制御方法、音声認識装置、音声認識方法及び音声認識プログラム |
| US20140278443A1 (en) * | 2012-10-30 | 2014-09-18 | Motorola Mobility Llc | Voice Control User Interface with Progressive Command Engagement |
| CN104820556A (zh) * | 2015-05-06 | 2015-08-05 | 广州视源电子科技股份有限公司 | 唤醒语音助手的方法及装置 |
| CN105094816A (zh) * | 2015-07-09 | 2015-11-25 | 北京君正集成电路股份有限公司 | 一种降低智能设备功耗的方法及智能设备 |
| CN107528971A (zh) * | 2017-08-10 | 2017-12-29 | 珠海市魅族科技有限公司 | 语音唤醒方法及装置、计算机装置及可读存储介质 |
| CN109218899A (zh) * | 2018-08-29 | 2019-01-15 | 出门问问信息科技有限公司 | 一种语音交互场景的识别方法、装置及智能音箱 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4525429A4 (en) * | 2022-05-23 | 2025-06-25 | LG Electronics Inc. | Display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111698544A (zh) | 2020-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113747232B (zh) | 一种移动终端向显示设备推送媒体文件的方法及显示设备 | |
| CN111200746B (zh) | 显示设备处于待机状态时被唤醒的方法及显示设备 | |
| CN111343489B (zh) | 一种显示设备及播放终端中音乐的方法 | |
| WO2020244266A1 (zh) | 智能电视的远程控制方法、移动终端和智能电视 | |
| CN112153447B (zh) | 一种显示设备及音画同步控制方法 | |
| CN111479145A (zh) | 显示设备及电视节目的推送方法 | |
| US11550527B2 (en) | Media file processing method for display device and display device | |
| WO2021189708A1 (zh) | 一种显示设备开启屏幕保护的方法及显示设备 | |
| WO2022073392A1 (zh) | 图像显示方法及显示设备 | |
| CN111698544A (zh) | 一种显示设备 | |
| CN113938724A (zh) | 显示设备及录屏分享方法 | |
| CN112272331B (zh) | 一种节目频道列表快速展示的方法及显示设备 | |
| CN112788378B (zh) | 显示设备与内容显示方法 | |
| US12056418B2 (en) | Content-based voice output method and display apparatus | |
| CN113438553A (zh) | 一种显示设备被唤醒方法及显示设备 | |
| WO2022021669A1 (zh) | 一种控制智能图像模式切换的方法及显示设备 | |
| CN111954059A (zh) | 屏保的展示方法及显示设备 | |
| WO2021196432A1 (zh) | 一种控件对应的内容的显示方法及显示设备 | |
| CN112004127B (zh) | 一种信号状态显示方法及显示设备 | |
| CN112786036B (zh) | 显示设备与内容显示方法 | |
| CN111988646B (zh) | 一种应用程序的用户界面显示方法和显示设备 | |
| CN112162809B (zh) | 显示设备及用户收藏显示方法 | |
| CN111831377A (zh) | 一种显示方法、显示设备及服务器 | |
| WO2021227232A1 (zh) | 一种语言选项和国家选项的显示方法及显示设备 | |
| WO2020248699A1 (zh) | 一种声音处理法及显示设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20772838 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20772838 Country of ref document: EP Kind code of ref document: A1 |