WO2023142680A1 - Display device and standby method - Google Patents

Display device and standby method Download PDF

Info

Publication number
WO2023142680A1
WO2023142680A1 PCT/CN2022/136026 CN2022136026W WO2023142680A1 WO 2023142680 A1 WO2023142680 A1 WO 2023142680A1 CN 2022136026 W CN2022136026 W CN 2022136026W WO 2023142680 A1 WO2023142680 A1 WO 2023142680A1
Authority
WO
WIPO (PCT)
Prior art keywords
voice
display device
wake
display
state
Prior art date
Application number
PCT/CN2022/136026
Other languages
French (fr)
Chinese (zh)
Inventor
李现旗
赵春亭
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202210105112.8A external-priority patent/CN116567785A/en
Priority claimed from CN202210122071.3A external-priority patent/CN116614663A/en
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2023142680A1 publication Critical patent/WO2023142680A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/418External card to be used in combination with the client device, e.g. for conditional access

Definitions

  • Fig. 12 shows a flow chart of background power-off after the display device turns off the display
  • Fig. 28 shows a schematic diagram of a user interface of a display device
  • Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment.
  • the display device 200 can communicate with the server 300 through the Internet, and the user can operate the display device 200 through the control device 100 .
  • control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly.
  • Device 200 The user can control the display device 200 by inputting at least one control command such as buttons on the remote control, voice input, and control panel input.
  • the display device 200 After the display device 200 receives the standby instruction, in response to the standby instruction, it first terminates power supply to the display to turn off the display. Specifically, the display device 200 receives and identifies the "standby" key value through the window management service, and the window management service generates a corresponding power button event "standby” based on the "standby” key value, and stores the power button event "standby” The power management service is notified, and based on this "standby” event, the power management service first removes power to the display to turn off the display.
  • the display device 200 responds to the standby instruction and turns off the display, the display will no longer generate power consumption, so that the overall power consumption of the display device 200 can be quickly reduced to save energy.
  • the display device 200 is changed from the power-on state to the standby state, which is actually to adjust the operation mode of each module in the display device 200 from the power-on operation mode to the power-off sleep mode.
  • the display device 200 gradually powers off the main chip based on the running status of the application in each thread after receiving the standby command. , you can refer to the flow chart shown in Figure 8, the specific process is as follows:
  • the voice chip recognizes the wake-up word in the voice data through the first wake-up service.
  • the first wake-up service calls the wake-up word library to obtain all specified wake-up words, or wake-up words exclusive to the standby state.
  • all specified wake-up words refer to specified words that can realize the wake-up function when the display device 200 is in the standby state and in the working state, such as words such as "hey” and "hi”.
  • the wake-up word exclusive to the standby state refers to a specified word that can realize the wake-up function when the display device 200 is in the standby state, such as "wake up”. , the wake-up function cannot be realized, that is, the display device 200 in the working state does not respond to the wake-up word exclusively in the standby state.
  • the voice command is determined The corresponding category is "first category", that is, the display needs to be turned on.
  • the keyword "audio 2" in the instruction information by comparing various class words, it is determined that the matching class word is "audio”, and further based on the mapping relationship between "audio” and “second class”, it is determined that the voice
  • the category corresponding to the instruction is "the second category", that is, the display does not need to be turned on.
  • Chip instruction that is, the instruction to restart the main chip from power failure
  • the response speed of the display device 200 is improved due to the time spent in the restart process of the main chip.
  • the display device 200 is in the standby state, that is, the display is off, the main chip is powered off, the voice chip is powered on, and the voice chip performs the first wake-up service.
  • the standby state that is, the display is off
  • the main chip is powered off
  • the voice chip is powered on
  • the voice chip performs the first wake-up service.
  • the power supply hardware interface layer is notified of the current boot state (startup).
  • Device identification includes a device identifier (diskid) and a universally unique identifier (uuid).
  • each external storage device corresponds to a unique device identifier
  • each external storage device also corresponds to a unique universal unique identification code.
  • the device identifier and the universal unique identification code can be used in two different aspects. Identify the only external storage device.
  • the device identifier In order to more accurately determine whether the device identifier indicates that there is an external storage device connected to the display device, in the embodiment of the present disclosure, it is judged whether the device identifier is empty, and if the device identifier is not empty, it is judged whether the universal unique identification code is empty ; If the UUID is not empty, it is determined that the device identifier indicates that there is an external storage device connected to the display device. In this way, it can be more accurately determined whether the device identifier indicates that there is an external storage device connected to the display device through the two identifiers of the device identifier and the UUID.
  • FIG. 32 shows a schematic diagram of a user interface of another display device according to some embodiments
  • FIG. 32 shows a state control of a power saving switch.
  • the user can adjust the state control of the power saving switch through the control device, so that the state of the power saving switch is on or off.
  • the state of the power saving switch in FIG. 32 is off, the user can move the focus to the state control of the power saving switch through the control device, and press the confirmation key on the control device, or press the right button to switch the power saving switch.
  • Status is On.
  • FIG. 33 which exemplarily shows a schematic diagram of a user interface of another display device according to some embodiments. In FIG. 33 , the state of the power saving switch is on.
  • the external storage device is converted into a built-in storage device, which saves the original built-in storage space of the display device; There may be a problem of stuck or crashing, so that users can start and use the application very smoothly, improve the real-time operation, and bring great convenience to users when using display devices.

Abstract

Provided are a display device and a standby method. When a display device is adjusted from an on state to a standby state, a main chip is turned off, and a voice chip remains on, so as to execute a first wake-up task by means of the voice chip, i.e. identifying a wake-up instruction sent by a user by means of the voice chip, and in response to an identified wake-up instruction, instructing the main chip to be powered on and start up. A far-field voice control function is ensured in a standby state, and the power consumption by a main chip is prevented. Additionally, when a display device is awakened from a standby state by means of a wake-up instruction of a user, the main chip further executes a voice service to identify a voice instruction category, and whether to a display needs to be turned on is accurately controlled on the basis of the voice instruction category, so that the display is only turned on when necessary, and consequently power consumption after standby is enabled is accurately controlled.

Description

一种显示设备及待机方法A display device and standby method
相关申请的交叉引用Cross References to Related Applications
本公开要求在2022年01月28日提交、申请号为202210105112.8;在2022年02月09日提交申请号为202210122071.3的中国专利申请的优先权,其全部内容通过引用结合在本公开中。This disclosure claims the priority of the Chinese patent application with application number 202210105112.8 submitted on January 28, 2022; and the Chinese patent application with application number 202210122071.3 submitted on February 09, 2022, the entire contents of which are incorporated in this disclosure by reference.
技术领域technical field
本公开涉及智能显示设备技术领域,尤其涉及一种显示设备及待机方法。The present disclosure relates to the technical field of intelligent display devices, and in particular, to a display device and a standby method.
背景技术Background technique
显示设备是指能够输出具体显示画面的终端设备,可以是智能电视、移动终端、智能广告屏、投影仪等终端设备。随着智能技术的发展,各种人工智能(Artificial Intelligence,AI)技术应运而生,其中,语音控制技术是成熟度较高。显示设备被配置为带有远场语音控制功能,即用户可以在距显示设备一定范围内,通过向显示设备发送语音指令,以控制显示设备执行相应的任务。以此,可以有效简化用户控制显示设备的操作,提高用户对显示设备的控制体验。A display device refers to a terminal device capable of outputting specific display images, which may be terminal devices such as smart TVs, mobile terminals, smart advertising screens, and projectors. With the development of intelligent technology, various artificial intelligence (AI) technologies have emerged, among which voice control technology is relatively mature. The display device is configured with a far-field voice control function, that is, the user can control the display device to perform corresponding tasks by sending voice instructions to the display device within a certain range from the display device. In this way, the user's operation of controlling the display device can be effectively simplified, and the user's experience of controlling the display device can be improved.
为了降低显示设备的功耗,可以将显示设备调整为待机状态。但是,显示设备的待机状态是指将显示设备中的各个部件均断电,以避免产生功耗。基于上述远场语音控制功能的实现过程,各个部件均断电将无法实现远场语音控制功能。In order to reduce the power consumption of the display device, the display device can be adjusted to a standby state. However, the standby state of the display device means that all components in the display device are powered off to avoid power consumption. Based on the implementation process of the far-field voice control function described above, the far-field voice control function cannot be realized if all components are powered off.
发明内容Contents of the invention
本公开提供了一种显示设备,包括:显示器,用于显示图像和/或用户界面;The present disclosure provides a display device, including: a display for displaying an image and/or a user interface;
控制器,与显示器连接,控制器被配置为:在显示器为被配置为开启状态的情况下,接收待机指令;响应于待机指令,关闭显示器;将主芯片断电,并保持语音芯片通电,以将显示设备调整为待机状态,其中,在待机状态下,语音芯片用于执行第一唤醒服务,第一唤醒服务是指识别用户发送的唤醒指令,并响应于唤醒指令指示主芯片上电启动,唤醒指令是指包含唤醒词的语音数据。The controller is connected to the display, and the controller is configured to: when the display is configured to be turned on, receive a standby command; respond to the standby command, turn off the display; power off the main chip, and keep the voice chip powered on, to Adjusting the display device to a standby state, wherein, in the standby state, the voice chip is used to perform a first wake-up service, the first wake-up service refers to recognizing a wake-up command sent by the user, and instructing the main chip to power on and start in response to the wake-up command, The wake-up command refers to voice data including a wake-up word.
本公开还提供了一种用于显示设备的待机方法,方法包括:在显示设备的显示器被配置为开启状态的情况下,接收待机指令;响应于待机指令,关闭显示器;将主芯片断电,并保持语音芯片通电,以将显示设备调整为待机状态,其中,在待机状态下,语音芯片用于执行第一唤醒服务,第一唤醒服务是指识别用户发送的唤醒指令,并响应于唤醒指令指示主芯片上电启动,唤醒指令是指包含唤醒词的语音数据。The present disclosure also provides a standby method for a display device, the method includes: when the display of the display device is configured to be in an on state, receiving a standby command; in response to the standby command, turning off the display; powering off the main chip, And keep the voice chip powered on to adjust the display device to the standby state, wherein, in the standby state, the voice chip is used to perform the first wake-up service, the first wake-up service refers to recognizing the wake-up command sent by the user, and responding to the wake-up command Instruct the main chip to power on and start. The wake-up command refers to the voice data containing the wake-up word.
附图说明Description of drawings
图1示出了一种显示设备的使用场景;FIG. 1 shows a usage scenario of a display device;
图2示出了一种控制装置的硬件配置框图;Fig. 2 shows a hardware configuration block diagram of a control device;
图3示出了一种控制装置的硬件配置框图;Fig. 3 shows a hardware configuration block diagram of a control device;
图4示出了一种显示设备的硬件配置图;FIG. 4 shows a hardware configuration diagram of a display device;
图5示出了一种显示设备的软件配置图;Fig. 5 shows a software configuration diagram of a display device;
图6示出了一种用户通过远场语音控制功能控制显示设备的交互示意图;FIG. 6 shows a schematic diagram of interaction of a user controlling a display device through a far-field voice control function;
图7示出了一种待机方法的流程示意图;Fig. 7 shows a schematic flow chart of a standby method;
图8示出了一种显示设备的待机流程中主芯片基于各应用程序运行状态断电的流程示意图;FIG. 8 shows a schematic diagram of a main chip power-off process based on the running status of each application program in the standby process of a display device;
图9示出了一种显示设备的待机流程中主芯片断电的流程示意图;FIG. 9 shows a schematic flow diagram of power-off of the main chip in the standby process of the display device;
图10示出了一种用户通过遥控器向显示设备发送待机指令的交互示意图;Fig. 10 shows a schematic diagram of an interaction in which a user sends a standby instruction to a display device through a remote controller;
图11示出了一种显示设备响应于待机指令关闭显示器的示意图;FIG. 11 shows a schematic diagram of a display device turning off a display in response to a standby instruction;
图12示出了一种显示设备关闭显示器之后的后台断电流程图;Fig. 12 shows a flow chart of background power-off after the display device turns off the display;
图13示出了一种在待机状态下的显示设备通过远场语音控制功能唤醒的流程示意图;FIG. 13 shows a schematic flow chart of waking up a display device in a standby state through a far-field voice control function;
图14示出了一种识别唤醒指令的流程示意图;Fig. 14 shows a schematic flow chart of identifying a wake-up instruction;
图15示出了一种标识不同类型的语音指令的流程示意图;Fig. 15 shows a schematic flow chart of identifying different types of voice commands;
图16示出了一种基于第一标识,设置窗口状态的流程示意图;Fig. 16 shows a schematic flow chart of setting the window status based on the first identifier;
图17示出了一种基于第二标识,设置窗口状态的流程示意图;Fig. 17 shows a schematic flow chart of setting the window status based on the second identifier;
图18示出了一种用户通过远场语音控制功能语音唤醒显示设备的交互示意图;Fig. 18 shows a schematic diagram of interaction of a user waking up a display device by voice through a far-field voice control function;
图19示出了一种显示设备在后台执行唤醒服务的流程示意图;FIG. 19 shows a schematic flow diagram of a display device performing a wake-up service in the background;
图20示出了一种显示设备在后台采用回声消除技术处理语音数据的流程示意图;FIG. 20 shows a schematic flow chart of processing voice data by a display device using echo cancellation technology in the background;
图21示出了一种显示设备在后台识别语音指令的类型,以控制显示器开启或者关闭的流程示意图;Fig. 21 shows a schematic flow diagram of a type of display device recognizing voice commands in the background to control the display to be turned on or off;
图22示出了一种显示设备基于第二标识,保持关闭显示器的示意图;Fig. 22 shows a schematic diagram of a display device keeping the display turned off based on the second identification;
图23示出了一种显示设备基于第一标识,开启显示器的示意图;FIG. 23 shows a schematic diagram of a display device turning on a display based on a first identification;
图24示出了一种实现假待机的方法的流程图;Fig. 24 shows a flow chart of a method for realizing false standby;
图25示出了一种显示设备的用户界面示意图;Fig. 25 shows a schematic diagram of a user interface of a display device;
图26示出了一种显示设备的用户界面示意图;Fig. 26 shows a schematic diagram of a user interface of a display device;
图27示出了一种显示设备的用户界面示意图;Fig. 27 shows a schematic diagram of a user interface of a display device;
图28示出了一种显示设备的用户界面示意图;Fig. 28 shows a schematic diagram of a user interface of a display device;
图29示出了一种显示设备的用户界面示意图;Fig. 29 shows a schematic diagram of a user interface of a display device;
图30示出了一种显示设备的用户界面示意图;FIG. 30 shows a schematic diagram of a user interface of a display device;
图31示出了一种显示设备的用户界面示意图;Fig. 31 shows a schematic diagram of a user interface of a display device;
图32示出了一种显示设备的用户界面示意图;Fig. 32 shows a schematic diagram of a user interface of a display device;
图33示出了一种显示设备的用户界面示意图。Fig. 33 shows a schematic diagram of a user interface of a display device.
具体实施方式Detailed ways
下面将详细地对实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下实施例中描述的实施方式并不代表与本公开相一致的所有实施方式。仅是与权利要求书中所详述的、本公开的一些方面相一致的系统和方法的示例。The embodiments will be described in detail hereinafter, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following examples do not represent all implementations consistent with this disclosure. These are merely examples of systems and methods consistent with aspects of the disclosure as recited in the claims.
需要说明的是,本公开中对于术语的简要说明,仅是为了方便理解接下来描述的实施方式,而不是意图限定本公开的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of terms in the present disclosure is only for the convenience of understanding the implementations described below, and is not intended to limit the implementations of the present disclosure. These terms are to be understood according to their ordinary and usual meaning unless otherwise stated.
图1为根据实施例中显示设备的使用场景的示意图。如图1所示,显示设备200可以与服务器300进行互联网通信,用户可通过控制装置100操作显示设备200。Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1 , the display device 200 can communicate with the server 300 through the Internet, and the user can operate the display device 200 through the control device 100 .
在一些实施例中,控制装置100可以是遥控器,遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信,及其他短距离通信方式中的至少一种,通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等至少一种输入控制指令,来控制显示设备200。In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly. Device 200. The user can control the display device 200 by inputting at least one control command such as buttons on the remote control, voice input, and control panel input.
在一些实施例中,控制装置100也可以是移动终端,例如手机等,移动终端与显示设备200的通信包括互联网协议通信或蓝牙协议通信,及其他短距离通信、长距离通信方式中的至少一种。用户可以通过移动终端上按键、语音输入、控制面板输入等至少一种输入 用户指令,来控制显示设备200。图2示例性示出了以遥控器为例的控制装置100的配置框图。如图2所示,控制装置100包括控制器、通信接口、用户输入/输出接口、存储器、供电电源。In some embodiments, the control device 100 can also be a mobile terminal, such as a mobile phone, etc. The communication between the mobile terminal and the display device 200 includes Internet protocol communication or Bluetooth protocol communication, and at least one of other short-distance communication and long-distance communication methods. kind. The user can control the display device 200 by inputting at least one user instruction such as buttons on the mobile terminal, voice input, and control panel input. FIG. 2 schematically shows a configuration block diagram of the control device 100 taking a remote controller as an example. As shown in FIG. 2 , the control device 100 includes a controller, a communication interface, a user input/output interface, a memory, and a power supply.
图3示例性示出了以移动终端为例的控制装置100的配置框图。如图3所示,控制装置100包括射频(radio frequency,RF)电路、存储器、显示单元、摄像头、传感器、音频电路、无线保真(Wireless Fidelity,Wi-Fi)电路、处理器、蓝牙电路、以及电源等部件中的至少一个。FIG. 3 exemplarily shows a configuration block diagram of the control device 100 taking a mobile terminal as an example. As shown in FIG. 3 , the control device 100 includes a radio frequency (radio frequency, RF) circuit, a memory, a display unit, a camera, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, Wi-Fi) circuit, a processor, a bluetooth circuit, And at least one of components such as power supply.
图4示出了根据示例性实施例中显示设备200的硬件配置框图。FIG. 4 shows a block diagram of a hardware configuration of a display device 200 according to an exemplary embodiment.
在一些实施例中,显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。In some embodiments, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface. at least one.
在一些实施例中,通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如:通信器可以包括Wi-Fi模块,蓝牙模块,有线以太网模块等其他网络通信协议芯片或近场通信协议芯片,以及红外接收器中的至少一种。显示设备200可以通过通信器220与控制装置100或服务器300建立控制信号和数据信号的发送和接收。In some embodiments, the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 300 through the communicator 220 .
在一些实施例中,外部装置接口240可以包括但不限于如下:高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。In some embodiments, the external device interface 240 may include, but is not limited to, the following: high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.
在一些实施例中,控制器250和调谐解调器210可以位于不同的分体设备中,即调谐解调器210也可在控制器250所在的主体设备的外置设备中,如外置机顶盒等。In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box wait.
在一些实施例中,控制器250,通过存储在存储器上中各种软件控制程序,来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器260上显示UI对象的用户命令,控制器250便可以执行与由用户命令选择的对象有关的操作。In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operations of the display device 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
在一些实施例中,用户可在显示器260上显示的图形用户界面(GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
参见图5,在一些实施例中,将系统分为四层,从上至下分别为应用程序(Applications)层(简称“应用层”),应用程序框架(Application Framework)层(简称“框架层”),安卓运行时(Android runtime)和系统库层(简称“系统运行库层”),以及内核层。Referring to Fig. 5, in some embodiments, the system is divided into four layers, from top to bottom are applications (Applications) layer (referred to as "application layer"), application framework (Application Framework) layer (referred to as "framework layer") "), Android runtime (Android runtime) and system library layer (referred to as "system runtime layer"), and the kernel layer.
在一些实施例中,应用程序层中运行有至少一个应用程序,这些应用程序可以是操作系统自带的窗口(Window)程序、系统设置程序或时钟程序等;也可以是第三方开发者所开发的应用程序。在具体实施时,应用程序层中的应用程序包不限于以上举例。In some embodiments, there is at least one application program running in the application program layer, and these application programs can be window (Window) program, system setting program or clock program etc. that come with the operating system; they can also be developed by third-party developers. s application. During specific implementation, the application program packages in the application program layer are not limited to the above examples.
框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心,这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口,可在执行中访问系统中的资源和取得系统的服务。The framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to make the applications in the application layer take actions. Through the API interface, the application program can access the resources in the system and obtain the services of the system during execution.
如图5所示,本公开实施例中应用程序框架层包括管理器(Managers),内容提供者(Content Provider)等,其中管理器包括以下模块中的至少一个:活动管理器(Activity Manager)用与和系统中正在运行的所有活动进行交互;位置管理器(Location Manager)用于给系统服务或应用提供了系统位置服务的访问;文件包管理器(Package Manager)用于检索当前安装在设备上的应用程序包相关的各种信息;通知管理器(Notification Manager)用于控制通知消息的显示和清除;窗口管理器(Window Manager)用于管理用户界面上的图标、窗口、工具栏、壁纸和桌面部件。As shown in Figure 5, the application framework layer in the embodiment of the disclosure includes managers (Managers), content providers (Content Provider) etc., wherein the manager includes at least one of the following modules: activity manager (Activity Manager) Interact with all activities running in the system; the Location Manager is used to provide system services or applications with access to the system location service; the Package Manager is used to retrieve the information currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers and Desktop widgets.
为了便于用户对显示设备的控制,为显示设备配置远场语音控制功能,其中,远场语音控制功能通过语音芯片和主芯片共同实现。显示设备通过语音芯片和主芯片实现远场语音控制功能的过程,可以参考图6所示的用户与显示设备的交互示意图。显示设备处于开 机状态时,即显示设备中的各个部件均处于全功能状态,可以正常运行。显示设备通过语音芯片执行语音数据采集服务,语音芯片通过语音数据采集服务调用麦克风的硬件接口,以通过麦克风采集用户发送的语音数据,如“嘿”。语音芯片将采集到的语音数据“嘿”直接传输至主芯片,由主芯片对该语音数据进行处理。主芯片在主进程中启动远场语音控制应用(简称语音应用),并通过语音应用首先调用唤醒服务对接收到的语音数据“嘿”进行识别和响应。在本公开中,将语音应用在开机状态下所调用的唤醒服务称为第二唤醒服务。语音应用通过调用第二唤醒服务识别该语音数据“嘿”中的唤醒词,并在识别到唤醒词“嘿”之后,启动语音服务。语音芯片继续通过语音数据采集服务调用麦克风采集用户发送的语音数据,如“播放音频1”。语音芯片将采集到的语音数据“播放音频1”直接传输至主芯片,由主芯片对该语音数据进行处理。主芯片通过语音应用调用语音服务对接收到的语音数据“播放音频1”进行识别和响应。语音应用通过调用语音服务识别到语音数据包含指示信息“播放音频1”,则调用响应的服务,例如音频播放服务,以调用麦克风的硬件接口,播放“音频1”对应的音频数据。可见,远场语音控制功能的实现,基于显示设备中主芯片处于开机状态,即主芯片通电运行。为了降低显示设备的功耗,将显示设备调整为待机状态时,如果直接将主芯片断电,在待机状态下,用户将无法实现远场语音控制功能,即用户无法通过唤醒指令唤醒显示设备响应后续的语音指令。由此,为了保证在待机状态下,远场语音控制功能可以供用户正常使用,必须保持主芯片通电运行,处于工作模式。可见,在这种待机状态下,现有显示设备中的主芯片仍然会产生功耗。In order to facilitate the user's control of the display device, a far-field voice control function is configured for the display device, wherein the far-field voice control function is jointly realized by the voice chip and the main chip. For the process that the display device implements the far-field voice control function through the voice chip and the main chip, you can refer to the schematic diagram of interaction between the user and the display device shown in FIG. 6 . When the display device is turned on, it means that all components in the display device are fully functional and can operate normally. The display device executes the voice data collection service through the voice chip, and the voice chip calls the hardware interface of the microphone through the voice data collection service, so as to collect the voice data sent by the user through the microphone, such as "Hey". The voice chip directly transmits the collected voice data "Hey" to the main chip, and the main chip processes the voice data. The main chip starts the far-field voice control application (referred to as the voice application) in the main process, and first calls the wake-up service through the voice application to recognize and respond to the received voice data "Hey". In this disclosure, the wake-up service invoked by the voice application in the power-on state is referred to as the second wake-up service. The voice application recognizes the wake-up word in the voice data "hey" by calling the second wake-up service, and starts the voice service after recognizing the wake-up word "hey". The voice chip continues to use the voice data collection service to call the microphone to collect the voice data sent by the user, such as "play audio 1". The voice chip directly transmits the collected voice data "play audio 1" to the main chip, and the main chip processes the voice data. The main chip calls the voice service through the voice application to recognize and respond to the received voice data "play audio 1". The voice application recognizes that the voice data contains the indication information "play audio 1" by calling the voice service, and then calls the corresponding service, such as the audio playback service, to call the hardware interface of the microphone to play the audio data corresponding to "audio 1". It can be seen that the realization of the far-field voice control function is based on the fact that the main chip in the display device is in the power-on state, that is, the main chip is powered on and running. In order to reduce the power consumption of the display device, when the display device is adjusted to the standby state, if the main chip is directly powered off, the user will not be able to realize the far-field voice control function in the standby state, that is, the user cannot wake up the display device through a wake-up command to respond Follow up voice commands. Therefore, in order to ensure that the far-field voice control function can be used normally by the user in the standby state, the main chip must be kept powered on and in the working mode. It can be seen that in this standby state, the main chip in the existing display device still generates power consumption.
为了避免显示设备在待机状态下由主芯片产生的功耗,本公开实施例提供了一种待机方法,如图7所示的流程示意图,具体流程如下:In order to avoid the power consumption generated by the main chip of the display device in the standby state, an embodiment of the present disclosure provides a standby method, as shown in the flow diagram shown in FIG. 7 , and the specific flow is as follows:
S701、接收待机指令。S701. Receive a standby instruction.
显示设备200处于开机状态,即显示设备200的显示器开启,处于开启状态,用于在窗口内显示图像和/或用户界面。并且显示设备200内各个部件(包括主芯片、语音芯片等)均处于通电运行的工作状态。The display device 200 is in the power-on state, that is, the display of the display device 200 is turned on and in the turned-on state for displaying images and/or user interfaces in the window. And each component (including the main chip, the voice chip, etc.) in the display device 200 is in the working state of power-on operation.
在一种实现方式中,用户通过控制装置100,例如遥控器、手机等,向显示设备200发送待机指令。示例地,用户通过按压遥控器上的“待机”按键,向显示设备200发送包含“待机”键值的指令,显示设备200通过识别所接收到的指令中包含“待机”键值,确定所接收到的指令为待机指令。In an implementation manner, the user sends a standby instruction to the display device 200 through the control device 100 , such as a remote controller or a mobile phone. For example, the user sends an instruction containing the key value of "standby" to the display device 200 by pressing the "standby" button on the remote control, and the display device 200 determines that the received instruction contains the key value of "standby". The received command is a standby command.
在一种实现方式中,用户利用显示设备200提供的远场语音控制功能,通过发送语音指令,控制显示设备200进入待机状态。示例地,显示设备200通过语音芯片采集用户发送的语音数据,例如“嘿”,并将该语音数据传输至主芯片,由主芯片通过唤醒服务识别该语音数据包含唤醒词“嘿”,确定该语音数据为一个唤醒指令,并响应于该唤醒指令,启动语音服务。语音芯片继续采集用户发送的语音数据,例如“待机”,并将该语音数据传输至主芯片,由主芯片通过语音服务识别该语音数据包含的指示信息“待机”,确定该语音数据是一个待机指令。In one implementation manner, the user uses the far-field voice control function provided by the display device 200 to control the display device 200 to enter the standby state by sending a voice command. For example, the display device 200 collects the voice data sent by the user through the voice chip, such as "hey", and transmits the voice data to the main chip, and the main chip recognizes that the voice data contains the wake-up word "hey" through the wake-up service, and determines the The voice data is a wake-up command, and the voice service is started in response to the wake-up command. The voice chip continues to collect the voice data sent by the user, such as "standby", and transmits the voice data to the main chip, and the main chip recognizes the indication information "standby" contained in the voice data through the voice service, and determines that the voice data is a standby instruction.
S702、响应于待机指令,关闭显示器。S702. Turn off the display in response to the standby instruction.
显示设备200接收到待机指令之后,响应于该待机指令,首先终止对显示器的供电,以关闭显示器。具体地,显示设备200通过窗口管理服务接收并识别“待机”键值,由窗口管理服务基于该“待机”键值,生成对应的电源按键事件“待机”,并将该电源按键事件“待机”通知到电源管理服务,由电源管理服务基于该“待机”事件,首先断开对显示器的供电,以关闭显示器。After the display device 200 receives the standby instruction, in response to the standby instruction, it first terminates power supply to the display to turn off the display. Specifically, the display device 200 receives and identifies the "standby" key value through the window management service, and the window management service generates a corresponding power button event "standby" based on the "standby" key value, and stores the power button event "standby" The power management service is notified, and based on this "standby" event, the power management service first removes power to the display to turn off the display.
由此,当显示设备200接收到待机指令之后,立即关闭显示器,以令用户可以直观感受到显示器从亮屏快速变更为息屏,使得用户体验到显示设备200对待机指令响应的高效性,提高用户的使用体验感。Thus, when the display device 200 receives the standby command, it immediately turns off the display, so that the user can intuitively experience the rapid change of the display from the bright screen to the off screen, so that the user can experience the high efficiency of the display device 200 in responding to the standby command and improve the efficiency of the display device 200. User experience.
而且,显示设备200响应于待机指令,关闭显示器之后,该显示器将不再产生功耗,从而可以快速降低显示设备200的整体功耗,节约能源。Moreover, after the display device 200 responds to the standby instruction and turns off the display, the display will no longer generate power consumption, so that the overall power consumption of the display device 200 can be quickly reduced to save energy.
S703、将主芯片断电,并保持语音芯片通电,以将显示设备调整为待机状态。S703. Power off the main chip, and keep the voice chip powered on, so as to adjust the display device to a standby state.
在本实施例中,显示设备200的待机状态,是指显示设备200的主芯片断电、保持语 音芯片通电的状态。对主芯片断电的过程在显示器关闭之后进行,用户无法感知到主芯片的断电过程,从而不会感知到主芯片断电的过程所产生的相应耗时,从用户角度可以有效提高显示设备200对待机指令的响应速度。同时,在本实施例中,为了保证显示设备200在待机状态下,仍然可以为用户提供远场语音控制功能,将语音芯片配置为在待机状态下,不仅执行原有的语音数据采集服务,还执行唤醒服务,为了区分,在本实施例中,将语音芯片在待机状态下执行的唤醒服务称为第一唤醒服务。在显示设备200处于待机状态时,语音芯片通过语音数据采集服务调用麦克风的硬件接口,以通过麦克风采集用户发送的语音数据,并进一步通过调用第一唤醒服务识别该语音数据中是否包含唤醒词,以在识别到唤醒词之后,确定该语音数据为一个唤醒指令,并响应于该唤醒指令,指示主芯片上电启动,以在主芯片上电启动之后,继续由主芯片执行第二唤醒服务和语音服务。由此,在待机状态下,可以通过保持语音芯片通电,以保证语音芯片的语音数据采集服务和第一唤醒服务的正常运行,将主芯片从待机状态下唤醒,以继续执行语音服务,从而保证远场语音控制功能的正常运行。并且,在待机状态下,可以将主芯片断电,以避免由主芯片产生功耗。In this embodiment, the standby state of the display device 200 refers to a state in which the main chip of the display device 200 is powered off and the voice chip is kept powered on. The process of powering off the main chip is carried out after the display is turned off. Users cannot perceive the power-off process of the main chip, so they will not perceive the corresponding time-consuming process of power-off of the main chip. From the perspective of users, the display device can be effectively improved. 200 Response speed to standby commands. At the same time, in this embodiment, in order to ensure that the display device 200 can still provide users with far-field voice control functions in the standby state, the voice chip is configured to not only execute the original voice data collection service but also To perform the wake-up service, in order to distinguish, in this embodiment, the wake-up service performed by the voice chip in the standby state is called the first wake-up service. When the display device 200 is in the standby state, the voice chip calls the hardware interface of the microphone through the voice data collection service to collect the voice data sent by the user through the microphone, and further identifies whether the voice data contains a wake-up word by calling the first wake-up service, After recognizing the wake-up word, determine that the voice data is a wake-up instruction, and in response to the wake-up instruction, instruct the main chip to be powered on and start, so that after the main chip is powered on and started, the main chip continues to perform the second wake-up service and voice service. Thus, in the standby state, the voice chip can be powered on to ensure the normal operation of the voice data collection service and the first wake-up service of the voice chip, and the main chip can be woken up from the standby state to continue to perform the voice service, thereby ensuring Proper operation of the far-field voice control function. Moreover, in the standby state, the main chip can be powered off to avoid power consumption by the main chip.
在本实施例中,显示设备200由开机状态变更为待机状态,实际上是将显示设备200中各模块由通电运行的工作模式调整为断电的休眠模式。为了避免显示设备200响应于待机指令,直接将各模块断电,导致数据的不稳定性,显示设备200在接收到待机指令之后,基于各线程中应用的运行状态,对主芯片进行逐步断电,可以参考图8所示的流程图,具体流程如下:In this embodiment, the display device 200 is changed from the power-on state to the standby state, which is actually to adjust the operation mode of each module in the display device 200 from the power-on operation mode to the power-off sleep mode. In order to prevent the display device 200 from directly powering off each module in response to the standby command, resulting in data instability, the display device 200 gradually powers off the main chip based on the running status of the application in each thread after receiving the standby command. , you can refer to the flow chart shown in Figure 8, the specific process is as follows:
S801、判断是否存在带有锁标志的目标应用程序,锁标志用于指示相应的应用程序处于运行状态。S801. Determine whether there is a target application program with a lock flag, where the lock flag is used to indicate that the corresponding application program is in a running state.
S802、如果存在目标应用程序,则等待目标应用程序运行完毕,并在目标应用程序运行完毕后,消除锁标志,将主芯片断电。S802. If there is a target application program, wait for the target application program to finish running, and after the target application program finishes running, remove the lock flag, and power off the main chip.
S803、如果不存在目标应用程序,则将主芯片断电。S803. If there is no target application program, power off the main chip.
主芯片处于通电运行的工作状态时,其对应的主进程中会运行与各应用程序。例如,以数据记录应用程序为例,显示设备200在播放视频1时,在主进程中启动数据记录应用程序,以记录视频1的播放信息,如播放参数、播放进度等。又如,以更新应用程序为例,显示设备200在更新操作系统的版本、应用程序的版本时,在主进程中启动更新应用程序,以下载系统、应用程序的最新版本,并将旧版本替换为该最新版本。When the main chip is in the working state of being powered on, various application programs will run in its corresponding main process. For example, taking the data recording application as an example, when the display device 200 is playing the video 1, the data recording application is started in the main process to record the playing information of the video 1, such as playing parameters and playing progress. As another example, taking the update application program as an example, when the display device 200 updates the version of the operating system and the version of the application program, it starts the update application program in the main process to download the latest version of the system and application program, and replace the old version for this latest version.
如果显示设备200响应于待机指令,直接将主芯片断电,即直接终止主进程,也即直接终止各正在运行的应用程序,将导致各应用程序无法完成对应的任务,出现数据不完整、程序错乱等问题。示例地,以响应于待机指令,直接终止数据记录应用程序为例,将导致记录的播放信息不完整。如果再次开机播放视频1,并选择从上次播放位置开始播放,由于记录的播放信息不完整,将无法准确定位至待机时真正的播放位置,例如记录的播放位置是真正的播放位置的前n秒,则将重复播放该n秒对应的视频数据,导致用户重复观看视频1,降低用户的体验感。或者,以响应于待机指令,直接终止更新应用程序为例,将导致系统、应用程序的更新不完整。当再次开机时,由于存在两个版本的操作系统和应用程序(旧版本以及更新不完整的新版本),显示设备200将需要时间判断使用哪一个版本,如果判定使用新版本,则由于该新版本不完整,则无法正常运行,从而影响用户的体验感。而且,此时数据库中将同时存在对应两个版本的数据,占用额外的存储空间,如果在开机后重新更新版本,将重复下载该新版本对应的数据,不仅进一步占用额外的存储空间,而且,重复下载的版本数据容易出现混乱的问题,影响系统、应用程序的正常运行。If the display device 200 responds to the standby command and directly powers off the main chip, that is, directly terminates the main process, that is, directly terminates each running application program, it will cause each application program to fail to complete the corresponding task, resulting in incomplete data, program confusion etc. Exemplarily, taking the example of directly terminating the data recording application program in response to the standby instruction, the recorded playback information will be incomplete. If you start to play video 1 again and choose to play from the last playback position, because the recorded playback information is incomplete, you will not be able to accurately locate the real playback position during standby. For example, the recorded playback position is the first n of the real playback position. seconds, the video data corresponding to the n seconds will be played repeatedly, causing the user to watch video 1 repeatedly, reducing the user experience. Or, taking the example of directly terminating the updating of the application program in response to the standby instruction, it will result in incomplete updating of the system and the application program. When starting up again, since there are two versions of the operating system and application programs (the old version and the new version with incomplete update), the display device 200 will need time to judge which version to use. If it is determined to use the new version, then due to the new If the version is incomplete, it cannot run normally, thus affecting the user experience. Moreover, at this time, there will be data corresponding to two versions in the database at the same time, occupying additional storage space. If the version is updated again after booting, the data corresponding to the new version will be downloaded repeatedly, which will not only further occupy additional storage space, but also, Repeatedly downloaded version data is prone to confusion, affecting the normal operation of the system and applications.
为了避免上述问题,显示设备200响应于待机指令,将主芯片断电之前,首先判断是否存在正在运行的目标应用程序。在本实施例中,可以通过锁标志来标识目标应用程序,锁标志用于指示对应的应用程序处于运行状态,禁止断电。主芯片通过识别锁标志,可以确定正在运行的目标应用程序。示例地,各应用程序在主进程中启动之后,向电源管理服务申请电源锁,以携带锁标志,用于指示该应用程序处于运行状态,禁止断电,避免显示设备200响应于待机指令,直接终止该目标应用程序。例如,数据记录应用程序在主进程 中启动之后,向内核层申请电源锁,以生成锁标志,该锁标志指示数据记录应用程序处于运行状态,禁止断电。又如,更新应用程序在主进程中启动之后,向内核层申请电源锁,以生成锁标志,该锁标志指示更新应用程序处于运行状态,禁止断电。In order to avoid the above problems, the display device 200 first determines whether there is a running target application program before powering off the main chip in response to the standby command. In this embodiment, the target application program may be identified by a lock flag, and the lock flag is used to indicate that the corresponding application program is in a running state, and power off is prohibited. The main chip can determine the running target application program by identifying the lock flag. Exemplarily, after each application is started in the main process, it applies to the power management service for a power lock to carry a lock flag, which is used to indicate that the application is in the running state, prohibiting power off, and preventing the display device 200 from responding to the standby command, directly Terminate the target application. For example, after the data recording application is started in the main process, it applies to the kernel layer for a power lock to generate a lock flag, which indicates that the data recording application is running and power off is prohibited. In another example, after the update application is started in the main process, it applies to the kernel layer for a power lock to generate a lock flag, which indicates that the update application is in a running state, and power off is prohibited.
显示设备200在关闭显示器之后,生成显示器对应的状态信息,如关闭状态,并将该状态信息通知到内核层中的各个内核模块,以通知各个模块显示器已经断电,显示器的硬件接口不可调用。主芯片通过识别主进程中是否存在目标应用程序(带有锁标志的应用程序)。如果存在目标应用程序,则标记该目标应用程序,并将主芯片由工作状态调整为空闲状态,以等待这些目标线程运行完毕。在本实施例中,主芯片的空闲状态是指,主芯片通电运行,但是,该通电运行是一种低功耗运行模式,即关闭一部分功能,例如网络连接功能、音频播放功能、画面显示功能等,保留目标应用程序对应的功能,例如数据读写功能等,即仅执行当前正在运行的目标应用程序,不再响应新的指令(关机指令、开机指令除外)。由此,可以避免用户此时再发起的其它指令影响主芯片的断电过程,进而避免影响显示设备200的待机流程。各目标应用程序继续运行,并在运行完毕之后,进行解锁,即向内核层申请清除电源锁,以消除目标应用程序上的锁标志。主芯片可以通过周期性检查所标记的目标应用程序是否带有锁标志,以检查目标应用程序是否运行完毕。或者,目标应用程序在运行完毕之后,通知运行完毕的结果。例如,数据记录应用程序在将当前正在播放的视频1的播放信息记录完成之后,消除锁标志,以指示数据记录应用程序运行完毕。又如,更新应用程序将当前正在更新的系统、应用程序更新完成之后,消除锁标志,以指示更新应用程序运行完毕。After the display is turned off, the display device 200 generates state information corresponding to the display, such as the off state, and notifies the state information to each kernel module in the kernel layer, so as to notify each module that the display has been powered off, and the hardware interface of the display cannot be called. The main chip recognizes whether there is a target application program (application program with a lock flag) in the main process. If there is a target application program, mark the target application program, and adjust the main chip from the working state to the idle state, so as to wait for these target threads to run completely. In this embodiment, the idle state of the main chip means that the main chip is powered on to run, but this power-on operation is a low-power operation mode, that is, some functions are turned off, such as network connection functions, audio playback functions, and screen display functions. etc., retain the corresponding functions of the target application, such as data read and write functions, that is, only execute the currently running target application, and no longer respond to new commands (except for shutdown commands and power-on commands). In this way, other commands initiated by the user at this time can be prevented from affecting the power-off process of the main chip, thereby avoiding affecting the standby process of the display device 200 . Each target application program continues to run, and after the operation is completed, it is unlocked, that is, it applies to the kernel layer for clearing the power lock, so as to eliminate the lock mark on the target application program. The main chip can periodically check whether the marked target application program has a lock flag, so as to check whether the target application program has finished running. Alternatively, after the target application program finishes running, it notifies the result of running. For example, after the data recording application completes recording the playing information of the video 1 currently being played, the lock flag is cleared to indicate that the data recording application has finished running. For another example, after the update application program finishes updating the system and application program currently being updated, the lock flag is cleared to indicate that the update application program has finished running.
当显示设备200识别到当前不存在目标应用程序之后,可以将主芯片断电。在本实施例中,可以参考图9所示的流程将主芯片断电,具体流程如下:After the display device 200 recognizes that no target application program currently exists, the main chip may be powered off. In this embodiment, the main chip can be powered off with reference to the process shown in FIG. 9, and the specific process is as follows:
S901、将内核层中的各个内核模块调整为休眠状态,内核模块的休眠状态是指内核模块断电。S901. Adjust each kernel module in the kernel layer to a sleep state. The sleep state of a kernel module means that the kernel module is powered off.
S902、将用户空间调整为冻结状态,用户空间的冻结状态是指用户空间不响应应用程序的数据读写任务。S902. Adjust the user space to a frozen state. The frozen state of the user space means that the user space does not respond to the data read and write tasks of the application program.
S903、将主芯片调整为休眠状态,主芯片的休眠状态是指主芯片断电。S903. Adjust the main chip to a dormant state. The dormant state of the main chip means that the main chip is powered off.
在主进程中不存在目标应用程序时,调用电源硬件接口层的“待机”事件,在电源硬件接口层记录“待机”事件的信息,例如待机事件的原因、时间等,然后将该待机事件通知到内核层,以将内核层中的各个内核模块由工作状态调整为休眠状态,即将各个内核模块断电,以终止内核层的运行。并进一步冻结用户空间,以令用户空间不再执行数据的写入与读出任务,以终止应用层的运行。至此,在主芯片控制下的各个模块以及用户空间均调整为休眠状态,不再执行任务,主芯片可以断电进入休眠状态,此时显示设备200进入真正的待机状态。When there is no target application program in the main process, call the "standby" event of the power supply hardware interface layer, record the information of the "standby" event at the power supply hardware interface layer, such as the reason and time of the standby event, and then notify the standby event Go to the kernel layer to adjust each kernel module in the kernel layer from the working state to the dormant state, that is, power off each kernel module to terminate the operation of the kernel layer. And further freeze the user space, so that the user space no longer performs data writing and reading tasks, so as to terminate the operation of the application layer. So far, all the modules and user space under the control of the main chip are adjusted to the dormant state, no longer perform tasks, the main chip can be powered off and enter the dormant state, at this time the display device 200 enters the true standby state.
为上述显示设备200的待机流程提供一个示例,可以参考图10~图12所示的用户与显示设备200的待机交互示意图。如图10所示,显示设备200当前处于工作状态,即显示设备200的显示器为开启状态,在窗口内显示如图10所示的用户界面,即风景画面。用户通过操控控制装置100,例如用户通过按压遥控器上的“待机”按键,向显示设备200发送待机指令,该待机指令包含“待机”键值,以控制显示设备200进入待机模式。To provide an example of the above standby process of the display device 200 , reference may be made to the schematic diagrams of standby interaction between the user and the display device 200 shown in FIGS. 10 to 12 . As shown in FIG. 10 , the display device 200 is currently in a working state, that is, the display of the display device 200 is in an on state, and a user interface as shown in FIG. 10 , that is, a landscape image, is displayed in the window. The user manipulates the control device 100, for example, the user sends a standby command to the display device 200 by pressing the "standby" button on the remote control. The standby command includes the "standby" key value to control the display device 200 to enter the standby mode.
如图11所示,显示设备200接收该待机指令,并通过窗口管理服务识别到该待机指令中的“待机”键值,确定该指令为待机指令,窗口管理服务处理该“待机”键值的广播后,生成电源按键事件“待机”,并将该电源按键事件通知到电源管理服务。电源管理服务基于该电源按键事件,首先断开对显示器的供电,如图12所示,示出了一种显示设备关闭显示器之后的后台断电流程图。显示器息屏,显示器进入关闭状态,不再产生功耗。As shown in FIG. 11, the display device 200 receives the standby command, and recognizes the "standby" key value in the standby command through the window management service, determines that the command is a standby command, and the window management service processes the "standby" key value. After broadcasting, generate a power button event "standby" and notify the power management service of the power button event. Based on the power button event, the power management service first cuts off the power supply to the display, as shown in FIG. 12 , which shows a background power-off flow chart after the display device turns off the display. The display screen is off, and the display enters the off state, which no longer generates power consumption.
S1201、控制装置发送待机指令。S1201. The control device sends a standby instruction.
S1202、启动窗口管理服务。S1202. Start the window management service.
S1203、启动电源管理服务。S1203. Start the power management service.
S1204、关闭显示器发送待机广播。S1204. Turn off the display and send the standby broadcast.
S1205、判断是否存在目标线程,若是,则执行S1206,否则执行S1210。S1205. Determine whether there is a target thread, if yes, execute S1206, otherwise execute S1210.
S1206、调用电源硬件接口层。S1206. Call the power supply hardware interface layer.
S1207、调用内核层。S1207. Call the kernel layer.
S1208、通知各个模块进入休眠状态,并冻结用户空间。S1208. Notify each module to enter the sleep state, and freeze the user space.
S1209、主芯片进入休眠状态。S1209, the main chip enters a sleep state.
S1210、主芯片进入空闲状态。S1210, the main chip enters an idle state.
主芯片进入空闲状态后,返回执行S1205。After the main chip enters the idle state, return to execute S1205.
由此,当显示设备200接收到待机指令之后,立即关闭显示器,以令用户可以直观感受到显示器从亮屏快速变更为息屏,使得用户体验到显示设备200对待机指令响应的高效性,从而提高用户的使用体验感。Thus, when the display device 200 receives the standby command, it immediately turns off the display, so that the user can intuitively experience the rapid change of the display from a bright screen to an off screen, so that the user can experience the high efficiency of the display device 200 in responding to the standby command, thereby Improve user experience.
显示设备200在关闭显示器之后,将主芯片断电,并保持语音芯片通电。如图11所示,电源管理服务基于显示器当前的状态生成对应的状态信息,即关闭状态,并将该状态信息广播至内核层中的各个内核模块,以通知各个内核模块显示器已经断电,显示器的硬件接口不可调用,并通知各个内核模块进入休眠状态。主芯片识别主进程中是否存在目标应用程序,即带有锁标志的应用程序。如果存在目标应用程序,则将主芯片调整为空闲模式,即主芯片通电,关闭一部分功能,仅支持目标应用程序的运行,并且不再响应新的指令(关机指令、开机指令除外),以进入低功耗模式。在目标应用程序运行完毕之后,消除目标应用程序带有的锁标志。当主进程中不存在目标应用程序时。调用电源硬件接口层的“待机”事件,硬件接口层记录该“待机”事件的信息,并将该“待机”事件通知到内核层,以将内核层中的各个内核模块由工作状态调整为休眠状态,以终止内核层的运行,并进一步将用户空间调整为冻结状态,以终止应用层的运行,最后将主芯片断电,以调整为休眠状态,显示设备200真正进入待机状态。After the display device 200 turns off the display, the main chip is powered off, and the voice chip is kept powered on. As shown in Figure 11, the power management service generates corresponding state information based on the current state of the display, that is, the off state, and broadcasts the state information to each kernel module in the kernel layer to notify each kernel module that the display has been powered off. The hardware interface of the system cannot be called, and each kernel module is notified to enter the sleep state. The main chip recognizes whether there is a target application program in the main process, that is, an application program with a lock flag. If there is a target application program, the main chip is adjusted to idle mode, that is, the main chip is powered on, some functions are turned off, and only the operation of the target application program is supported, and no longer responds to new commands (except for shutdown commands and power-on commands) to enter low power mode. After the target application program finishes running, remove the lock flag attached to the target application program. When the target application does not exist in the main process. Call the "standby" event of the power supply hardware interface layer, the hardware interface layer records the information of the "standby" event, and notifies the "standby" event to the kernel layer, so as to adjust each kernel module in the kernel layer from working state to dormancy State, to terminate the operation of the kernel layer, and further adjust the user space to a frozen state, to terminate the operation of the application layer, and finally power off the main chip to adjust to a sleep state, and the display device 200 really enters a standby state.
由此,主芯片的断电不会影响各模块相应应用的运行,可以有效避免显示设备200响应待机指令时出现数据不完整、程序错乱等问题,从而有效保证显示设备200再次开机后的运行效果。而且,显示设备200响应于待机指令,可以将主芯片断电,并保持语音芯片通电,令显示设备200进入真正的待机状态。此时,显示设备200仍然可以通过语音应用运行唤醒服务和语音指令响应服务,以通过远场语音功能对显示设备200进行唤醒,并在成功唤醒主芯片之后,进一步响应语音指令。由此,显示设备200在待机状态下,可以进一步实现主芯片断电,以降低由主芯片产生的功耗,从而有效降低显示设备200的整体功耗,且不会影响显示设备200在待机状态下的远场语音控制功能。Therefore, the power failure of the main chip will not affect the operation of the corresponding applications of each module, which can effectively avoid problems such as incomplete data and program confusion when the display device 200 responds to the standby command, thereby effectively ensuring the operation effect of the display device 200 after it is turned on again. . Moreover, in response to the standby command, the display device 200 can power off the main chip and keep the voice chip powered on, so that the display device 200 enters a real standby state. At this time, the display device 200 can still run the wake-up service and the voice command response service through the voice application, so as to wake up the display device 200 through the far-field voice function, and further respond to the voice command after successfully waking up the main chip. Thus, when the display device 200 is in the standby state, the main chip can be further powered off to reduce the power consumption generated by the main chip, thereby effectively reducing the overall power consumption of the display device 200 without affecting the display device 200 in the standby state. The far-field voice control function under.
基于上述待机流程,显示设备200处于待机状态时,即主芯片断电、语音芯片保持通电,显示设备200可以通过语音芯片采集和识别用户发送的唤醒指令,并响应于该唤醒指令,指示主芯片重新上电启动,以启动语音应用,通过主芯片执行第二唤醒服务和语音服务,以始终保证远场语音控制功能的正常运行。显示设备200从待机状态调整为开机状态的过程可以参考图13所示的开机流程,具体流程如下:Based on the above standby process, when the display device 200 is in the standby state, that is, the main chip is powered off and the voice chip is powered on, the display device 200 can collect and recognize the wake-up command sent by the user through the voice chip, and instruct the main chip to respond to the wake-up command. Re-power on to start the voice application, and execute the second wake-up service and voice service through the main chip to always ensure the normal operation of the far-field voice control function. The process of adjusting the display device 200 from the standby state to the power-on state can refer to the power-on process shown in FIG. 13 , and the specific process is as follows:
S1301、通过语音芯片执行第一唤醒服务。S1301. Execute the first wake-up service through the voice chip.
在本实施例中提供的显示设备200的待机状态下,显示设备200可以通过语音芯片执行第一唤醒服务。如果显示设备200所处的环境比较吵杂,则语音芯片采集到的语音数据比较繁杂,例如处于商场环境的显示设备200,其可以采集到来往人群产生的语音数据、其它音频设备产生的音频数据、以及显示设备200自身播放的音频数据(为了方便表述,也统一称为语音数据)等,这些语音数据均会对识别真正的唤醒指令产生干扰,为了准确执行唤醒服务,避免响应与唤醒指令的语音数据,可以参考图14所示的流程识别语音指令,具体流程如下:In the standby state of the display device 200 provided in this embodiment, the display device 200 may execute the first wake-up service through the voice chip. If the environment in which the display device 200 is located is relatively noisy, the voice data collected by the voice chip is relatively complicated. For example, the display device 200 in a shopping mall environment can collect voice data generated by passing crowds and audio data generated by other audio devices. , and the audio data played by the display device 200 itself (for the convenience of expression, also collectively referred to as voice data), etc., these voice data will interfere with the recognition of the real wake-up command. Voice data, you can refer to the process shown in Figure 14 to recognize voice commands, the specific process is as follows:
S1401、接收用户发送的语音数据。S1401. Receive voice data sent by a user.
S1402、识别语音数据中是否包含唤醒词。S1402. Identify whether the voice data contains a wake-up word.
S1403、如果包含唤醒词,则确定语音数据是唤醒指令,并响应于唤醒指令,指示主芯片上电启动。S1403. If the wake-up word is included, determine that the voice data is a wake-up instruction, and instruct the main chip to be powered on in response to the wake-up instruction.
S1404、如果不包含唤醒词,则丢弃语音数据。S1404. If the wake-up word is not included, the voice data is discarded.
语音芯片通过语音数据采集服务调用麦克风的硬件接口,以通过麦克风采集全部语音 数据。通过上述语音数据的采集过程,保证语音芯片采集到的语音数据的广泛性,以保证不会遗漏重要的语音数据,例如音量较小的、音节较短的包含有唤醒词的语音数据,进而提高基于所采集到的语音数据准确识别到唤醒指令的有效性。The voice chip calls the hardware interface of the microphone through the voice data collection service to collect all voice data through the microphone. Through the collection process of the above-mentioned voice data, the universality of the voice data collected by the voice chip is guaranteed to ensure that important voice data will not be missed, such as voice data with low volume and short syllables containing wake-up words, thereby improving The validity of the wake-up instruction is accurately identified based on the collected voice data.
语音芯片通过第一唤醒服务,识别语音数据中的唤醒词。示例地,第一唤醒服务通过调用唤醒词库,以获取所有指定的唤醒词,或者专属于待机状态下的唤醒词。其中,所有指定的唤醒词是指在显示设备200处于待机状态以及处于工作状态下均可以实现唤醒功能的指定词语,如“嘿”、“嗨”等词语。专属于待机状态下的唤醒词是指在显示设备200处于待机状态下,可以实现唤醒功能的指定词语,如“wake up”,该专属于待机状态下的唤醒词在显示设备200处于工作状态下,将无法实现唤醒功能,即处于工作状态下的显示设备200不响应该专属于待机状态下的唤醒词。The voice chip recognizes the wake-up word in the voice data through the first wake-up service. Exemplarily, the first wake-up service calls the wake-up word library to obtain all specified wake-up words, or wake-up words exclusive to the standby state. Wherein, all specified wake-up words refer to specified words that can realize the wake-up function when the display device 200 is in the standby state and in the working state, such as words such as "hey" and "hi". The wake-up word exclusive to the standby state refers to a specified word that can realize the wake-up function when the display device 200 is in the standby state, such as "wake up". , the wake-up function cannot be realized, that is, the display device 200 in the working state does not respond to the wake-up word exclusively in the standby state.
在本实施例中,可以通过回声消除技术进一步提高语音芯片识别唤醒词的准确性。具体地,唤醒服务启动时,创建第一音频录制线程和第二音频录制线程,其中,第一音频录制线程用于录制麦克风采集到的语音数据,第二音频录制线程用于录制显示设备200播放的音频数据,即回采信号。通过对比通过第一音频录制线程采集到的语音数据,以及通过第二音频录制线程采集到的回采信号,提取出上述语音数据与回采信号不同的数据,该不同的数据对应于可能包含唤醒词的语音数据。并进一步通过分析该不同的语音数据是否包含唤醒词,以识别所采集到的语音数据是否包含唤醒词。显示设备200处于待机状态时,显示设备200用于播放音频数据的音频播放模块也处于休眠模式,即第二音频录制线程采集到的回采信号为空,由此,上述语音数据与回采信号不同的数据就是通过第一音频录制线程采集到的语音数据。In this embodiment, the accuracy of recognizing the wake-up word by the voice chip can be further improved by using the echo cancellation technology. Specifically, when the wake-up service is started, a first audio recording thread and a second audio recording thread are created, wherein the first audio recording thread is used to record the voice data collected by the microphone, and the second audio recording thread is used to record the audio data played by the display device 200. audio data, that is, the echo signal. By comparing the voice data collected through the first audio recording thread and the echo signal collected through the second audio recording thread, the data that is different from the above voice data and the echo signal is extracted, and the different data corresponds to possible wake-up words. voice data. And further analyzing whether the different voice data contains wake-up words to identify whether the collected voice data contains wake-up words. When the display device 200 is in the standby state, the audio playback module of the display device 200 for playing audio data is also in the dormant mode, that is, the echo signal collected by the second audio recording thread is empty, thus, the above-mentioned voice data is different from the echo signal The data is the voice data collected through the first audio recording thread.
进一步地,在显示设备200处于待机状态时,语音芯片可以配置为,不采用回声消除技术识别唤醒词。由此,可以提高显示设备200在待机状态时的唤醒速度,表现为显示设备200快速响应用户发送的唤醒指令,以提高用户的体验感。Further, when the display device 200 is in the standby state, the voice chip may be configured to recognize the wake-up word without using the echo cancellation technology. Thus, the wake-up speed of the display device 200 in the standby state can be increased, which means that the display device 200 quickly responds to the wake-up instruction sent by the user, so as to improve the user experience.
语音芯片通过对比从语音数据中识别到的关键词与调取的唤醒词库中的唤醒词是否匹配,当存在与该关键词匹配的唤醒词时,说明该关键词是唤醒词,即语音数据中包含唤醒词;当不存在与该关键词匹配的唤醒词时,说明该关键词不是唤醒词,即语音数据不包含唤醒词。基于上述唤醒词的识别过程,如果语音芯片识别到语音数据中存在唤醒词,则确定该语音数据为唤醒指令,并响应于该唤醒指令,指示主芯片上电启动。如果语音芯片未识别到唤醒词,则该语音数据为无效数据,语音芯片丢弃该语音数据,保持待机状态,并继续采集和识别下一语音数据。The voice chip compares whether the keyword identified from the voice data matches the wake-up word in the recalled wake-up vocabulary. When there is a wake-up word that matches the keyword, it means that the keyword is a wake-up word, that is, the voice data contains a wake-up word; if there is no wake-up word matching the keyword, it means that the keyword is not a wake-up word, that is, the voice data does not contain a wake-up word. Based on the recognition process of the above-mentioned wake-up word, if the voice chip recognizes that there is a wake-up word in the voice data, it determines that the voice data is a wake-up command, and instructs the main chip to be powered on in response to the wake-up command. If the voice chip does not recognize the wake-up word, the voice data is invalid data, the voice chip discards the voice data, keeps the standby state, and continues to collect and recognize the next voice data.
语音芯片响应于唤醒指令,指示主芯片上电启动,以将内核层中的各个内核模块调整为开机模式,并将用户空间调整为解冻模式,其中,内核模块的开机模式是指内核模块上电启动,解冻模式是指用户空间响应应用程序的数据读写任务。In response to the wake-up command, the voice chip instructs the main chip to power on and start, so as to adjust each kernel module in the kernel layer to the boot mode, and adjust the user space to the unfreezing mode, wherein, the boot mode of the kernel module refers to the power-on mode of the kernel module. Start, unfreeze mode means that the user space responds to the data read and write tasks of the application.
通知内核层中的各个内核模块按照指定顺序上电启动,以从休眠状态调整为开机状态,以唤醒内核层,令内核层可以正常运行。同时,将用户空间调整为解冻状态,以令用户空间可以执行数据的读出和写入任务,令应用层可以正常运行。在各内核模块与用户空间成功唤醒之后,通知电源硬件接口层本次开机的状态(开机),并由电源硬件接口层记录开机原因,将该开机事件通知电源管理模块,由电源管理模块基于该开机事件发送开机状态的通知,恢复对内核层、应用层的供电。Notify each kernel module in the kernel layer to power on and start according to the specified order, so as to adjust from the sleep state to the boot state, so as to wake up the kernel layer, so that the kernel layer can run normally. At the same time, adjust the user space to the unfreezing state, so that the user space can perform data reading and writing tasks, so that the application layer can run normally. After each kernel module and user space are successfully woken up, notify the power supply hardware interface layer of the state of the boot (startup), and record the boot reason by the power supply hardware interface layer, and notify the power management module of the boot event, based on the power management module. The power-on event sends a notification of the power-on status, and restores the power supply to the kernel layer and application layer.
在本实施例中,显示设备200的唤醒启动流程中,不包括显示器的启动过程,即显示设备200响应于唤醒词,并不会直接开启显示器,显示器仍处于息屏状态,以避免显示器在不需要使用时开启,产生额外的功耗。In this embodiment, the wake-up process of the display device 200 does not include the start-up process of the display, that is, the display device 200 does not directly turn on the display in response to the wake-up word, and the display is still in the off-screen state, so as to avoid Turn on when needed, resulting in additional power consumption.
S1302、在主芯片上电启动之后,通过主芯片执行语音应用中的第二唤醒服务和语音服务,第二唤醒服务是指识别并响应用户发送的唤醒指令,语音服务是指识别并响应用户发送的语音指令,语音指令是指包含指示信息的语音数据,其中,语音服务还包括,基于语音指令的类别,确定显示器的显示状态,显示状态为开启状态或者关闭状态。S1302. After the main chip is powered on and started, execute the second wake-up service and voice service in the voice application through the main chip. The second wake-up service refers to recognizing and responding to the wake-up instruction sent by the user, and the voice service refers to recognizing and responding to the user sending The voice command refers to the voice data containing instruction information, wherein the voice service also includes determining the display state of the display based on the type of the voice command, and the display state is on or off.
在本实施例中,主芯片执行语音服务响应于语音指令时,进一步基于语音指令的类别,判断是否需要开启显示器。语音指令包括两种类别,其中,响应于第一类别的语音指令需 要开启显示器,例如指示播放视频数据的语音指令,需要开启显示器,属于第一类别。响应于第二类别的语音指令不需要开启显示器,例如指示播放音频数据的语音指令,不需要开启显示器,属于第二类别。由此,显示设备200通过识别语音指令对应的类别,以准确判断是否需要开启显示器。In this embodiment, when the main chip executes the voice service in response to the voice command, it further determines whether the display needs to be turned on based on the type of the voice command. The voice command includes two categories, wherein, in response to the voice command of the first category, the display needs to be turned on, for example, the voice command indicating to play video data needs to turn on the display, which belongs to the first category. Responses to voice commands of the second category do not require turning on the display, for example, a voice command instructing to play audio data does not need to turn on the display, which belongs to the second category. Thus, the display device 200 can accurately determine whether to turn on the display by identifying the category corresponding to the voice command.
进一步地,为了保证基于语音指令的类别控制显示器的准确性,可以对语音指令的类别进行标记,可以参考图15所示的标记流程,具体流程如下:Further, in order to ensure the accuracy of controlling the display based on the category of the voice command, the category of the voice command can be marked, and you can refer to the marking process shown in Figure 15. The specific process is as follows:
S1501、基于语音指令中的指示信息,确定语音指令的类别,其中,响应于第一类别的语音指令开启显示器,响应于第二类别的语音指令关闭显示器。S1501. Determine the category of the voice command based on the indication information in the voice command, wherein the display is turned on in response to the voice command of the first category, and the display is turned off in response to the voice command of the second category.
S1502、基于第一类别的语音指令,生成第一标识,基于第二类别的语音指令,生成第二标识。S1502. Generate a first identifier based on the voice instruction of the first category, and generate a second identifier based on the voice instruction of the second category.
S1503、基于第一标识,开启显示器,或者,基于第二标识,关闭显示器。S1503. Turn on the display based on the first identification, or turn off the display based on the second identification.
语音指令中包含的指示信息,用于指示具体的动作和对象。例如,语音数据为“播放视频1”。主芯片通过语音服务可以识别到该语音数据包含指示信息“播放视频1”,该指示信息所指示的动作是“播放”,对象是“视频1”。主芯片通过语音服务,基于所识别到的指示信息,可以进一步判定语音指令对应的类别。示例地,通过对比指示信息中的关键词与类别词库中的类别词,确定语音指令对应的类别。其中,类别词库中的类别词为可以指示类别的指定词语,各类别词与所指示的类别具有映射关系,例如类别词为“图片”,对应的类别为“第二类别”;类别词为“音频”,对应的类别为“第二类别”;类别词为“视频”,对应的类别为“第一类别”,此处不赘述。语音服务通过对比关键词与类别词,确定与该关键词匹配的类别词,并进一步基于该类别词与所指示的类别之间的映射关系,以确定对应的类别,即语音指令对应的类别。例如,指示信息中的关键词“视频1”,通过对比各个类别词,确定相匹配的类别词为“视频”,并进一步基于“视频”与“第一类别”的映射关系,确定该语音指令对应的类别为“第一类别”,即需要开启显示器。又如,指令信息中的关键词“音频2”,通过对比各个类别词,确定相匹配的类别词为“音频”,并进一步基于“音频”与“第二类别”的映射关系,确定该语音指令对应的类别为“第二类别”,即不需要开启显示器。The instruction information contained in the voice instruction is used to indicate specific actions and objects. For example, voice data is "play video 1". Through the voice service, the main chip can recognize that the voice data contains instruction information "play video 1", the action indicated by the instruction information is "play", and the object is "video 1". Through the voice service, the main chip can further determine the category corresponding to the voice command based on the identified indication information. For example, the category corresponding to the voice instruction is determined by comparing the keyword in the indication information with the category word in the category thesaurus. Wherein, the classifiers in the thesaurus are designated words that can indicate categories, and each classifier has a mapping relationship with the indicated category, for example, the classifier is "picture", and the corresponding category is "second category"; the classifier is "Audio", the corresponding category is "Second Category"; the category word is "Video", and the corresponding category is "First Category", which will not be described here. The voice service compares the keyword and the category word to determine the category word matching the keyword, and further determines the corresponding category based on the mapping relationship between the category word and the indicated category, that is, the category corresponding to the voice instruction. For example, for the keyword "Video 1" in the instruction information, by comparing each category word, it is determined that the matching category word is "video", and further based on the mapping relationship between "video" and "first category", the voice command is determined The corresponding category is "first category", that is, the display needs to be turned on. As another example, for the keyword "audio 2" in the instruction information, by comparing various class words, it is determined that the matching class word is "audio", and further based on the mapping relationship between "audio" and "second class", it is determined that the voice The category corresponding to the instruction is "the second category", that is, the display does not need to be turned on.
基于语音指令的不同类别,生成不同的标识,以对各类别加以区分。在本实施例中,用第一标识标记第一类别,用第二标识标记第二类别。具体的,可以将第一标识与第二标识携带在对应的标志位上,通过识别标志位,就可以准确识别到标识,进而确定该语音指令的类别。在一种实现方式中,第一标识与第二标识位于同一标志位,第一标识与第二标识的具体内容不同,由此,通过识别该标志位上携带的具体标识,可以准确判断语音指令对应的类别。在另一种实现方式中,第一标识与第二标识位于不同的标志位,例如,第一标识位于第一标志位(亮屏标志位),第二标识位于第二标志位(不亮屏标志位)。通过识别存在标识的标志位,确定携带的是哪一种标识,例如识别到第一标志位上存在标识,则确定携带的是第一标识,或者,识别到第二标志位上存在标识,则确定携带的是第二标识,并进一步基于标识确定语音指令对应的类别。在该实现方式中,第一标识与第二标识的具体内容可以相同,也可以不同。Based on different categories of voice commands, different identifiers are generated to distinguish each category. In this embodiment, the first category is marked with the first identifier, and the second category is marked with the second identifier. Specifically, the first identifier and the second identifier can be carried on the corresponding flags, and by identifying the flags, the logos can be accurately identified, and then the category of the voice command can be determined. In an implementation manner, the first identification and the second identification are located at the same identification position, and the specific content of the first identification and the second identification are different. Therefore, by identifying the specific identification carried on the identification position, the voice command can be accurately judged. corresponding category. In another implementation, the first logo and the second logo are located at different flag positions, for example, the first logo is located at the first flag position (the bright screen flag), and the second logo is located at the second flag position (the screen is not bright). flag bit). By identifying the flag of the presence of the logo, determine which kind of logo is carried, for example, if it is recognized that there is a logo on the first flag, it is determined that the first logo is carried, or if it is recognized that there is a logo on the second flag, then It is determined that what is carried is the second identifier, and the category corresponding to the voice instruction is further determined based on the identifier. In this implementation manner, the specific content of the first identifier and the second identifier may be the same or different.
如果识别到第一标识,则可以确定语音指令对应第一类别,开启显示器;如果识别到第二标识,则可以确定语音指令对应第二类别,不开启显示器。If the first logo is recognized, it can be determined that the voice command corresponds to the first category, and the display is turned on; if the second logo is recognized, it can be determined that the voice command corresponds to the second category, and the display is not turned on.
如果识别到第一标识,可以参考图16所示的流程,进一步配置窗口状态,具体流程如下:If the first logo is identified, you can refer to the process shown in Figure 16 to further configure the window status, the specific process is as follows:
S1601、基于第一标识,开启显示器,并将窗口设置为活动状态,活动状态是指窗口可操作,以响应于非开机指令,显示对应的用户界面。S1601. Based on the first identifier, turn on the display, and set the window to an active state, where the active state means that the window is operable to display a corresponding user interface in response to a non-starting instruction.
S1602、将语音应用标记锁标志,以指示语音应用处于运行状态,禁止将显示设备调整为待机状态。S1602. Mark the voice application with a lock sign to indicate that the voice application is in a running state, and prohibit adjusting the display device to a standby state.
通常,需要开启显示器的语音指令,在显示器开启之后,用户与显示设备200再次交互的概率也较高,即用户再次向显示设备200发送指令的概率较高。基于此,显示设备200需要保持显示器的开启状态,并保持响应用户的任何指令。Usually, a voice command to turn on the display is required. After the display is turned on, the user has a higher probability of interacting with the display device 200 again, that is, the user has a higher probability of sending an instruction to the display device 200 again. Based on this, the display device 200 needs to keep the display turned on and keep responding to any instructions of the user.
显示设备200基于第二标识,开启显示器之后,将窗口设置为活动状态,在该活动状 态下,窗口可操作性,即用户可以基于窗口内显示的用户界面发起指令。例如,用户通过控制装置100发送的包含任意键值的控制指令,或者用户发送的包含任意关键词的语音指令,以避免显示设备200漏响应用户发送的指令,提高用户对显示设备200控制的体验感。After the display device 200 turns on the display based on the second identification, the window is set to an active state. In this active state, the window is operable, that is, the user can initiate instructions based on the user interface displayed in the window. For example, the user sends a control instruction containing any key value through the control device 100, or a voice instruction containing any keyword sent by the user, so as to prevent the display device 200 from missing the instruction sent by the user and improve the user's experience of controlling the display device 200. feel.
为了避免显示设备200自动进入待机流程,主芯片上电启动语音应用之后,为语音应用在内核层申请电源锁,以为语音应用标记锁标志,指示语音应用正在运行中,禁止断电。以通过语音应用的锁标志,有效阻止显示设备200进入待机流程。如果需要显示设备200再次进入待机状态,则需要重新发送待机指令,以主动指示显示设备200进入待机流程。在接收到该待机指令时,将消除语音应用的锁标志,以令主芯片可以进入休眠模式。In order to prevent the display device 200 from automatically entering the standby process, after the main chip is powered on to start the voice application, apply for a power lock at the kernel layer for the voice application, and mark the voice application with a lock sign to indicate that the voice application is running, and power off is prohibited. With the lock mark applied by voice, the display device 200 is effectively prevented from entering the standby process. If the display device 200 needs to enter the standby state again, it is necessary to resend the standby command to actively instruct the display device 200 to enter the standby process. When the standby command is received, the lock flag of the voice application will be removed, so that the main chip can enter the dormant mode.
如果识别到第二标识,可以参考图17所示的流程,进一步配置窗口状态,具体流程如下:If the second logo is identified, you can refer to the process shown in Figure 17 to further configure the window status, the specific process is as follows:
S1701、基于第二标识,保持关闭显示器,并将窗口设置为非活动状态,非活动状态是指窗口不可操作,以不响应于非开机指令。S1701. Based on the second identification, keep turning off the display, and set the window to an inactive state, where the inactive state means that the window is inoperable and does not respond to a non-starting instruction.
S1702、等待指定时间之后,将显示设备调整为待机状态,其中,语音应用不带有锁标志。S1702. After waiting for a specified time, adjust the display device to a standby state, wherein the voice application does not have a lock symbol.
通常,无需开启显示器的语音指令,对应的响应过程也比较简短,例如,语音指令“播放音频1”,显示设备200响应于该语音指令,无需开启显示器,只需要播放音频1对应的音频数据即可,通常,音频1对应的播放时长较短,由此,显示设备200响应于该语音指令的过程也比较简短。而且,用户在显示器的关闭状态下,再次发送指令的概率较低,即用户与显示设备200再次交互的概率较低。由此,在显示设备200响应第二类别的语音指令之后,将处于无任务执行的空闲状态。此时,虽然显示器处于关闭状态,不会产生功耗,但是,主芯片处于通电运行的工作状态,主芯片会产生功耗。且在这种状态下,用户会忘记或者无意识再次下达待机指令,导致主芯片会始终处于通电运行的工作状态,始终产生功耗。为了避免在这种状态下由主芯片产生的功耗,以降低显示设备200的整体功耗,可以将主芯片配置为在响应语音指令完毕之后,自动进入如上文的待机流程。Usually, there is no need to turn on the voice command of the display, and the corresponding response process is relatively short. For example, the voice command "play audio 1", and the display device 200 responds to the voice command without turning on the display, and only needs to play the audio data corresponding to audio 1. However, generally, the playing time corresponding to the audio 1 is relatively short, so the process for the display device 200 to respond to the voice instruction is also relatively short. Moreover, in the off state of the display, the user has a low probability of sending an instruction again, that is, the probability of the user interacting with the display device 200 again is low. Thus, after the display device 200 responds to the voice command of the second category, it will be in an idle state without task execution. At this time, although the display is in the off state and does not generate power consumption, the main chip is in the working state of power-on operation, and the main chip will generate power consumption. And in this state, the user will forget or unconsciously issue the standby command again, so that the main chip will always be in the working state of power-on operation, and will always generate power consumption. In order to avoid the power consumption generated by the main chip in this state and reduce the overall power consumption of the display device 200 , the main chip can be configured to automatically enter the above standby process after completing the response to the voice command.
基于第一标识,保持显示器处于关闭状态时,同时将窗口设置为非活动状态,即窗口不可操作,此时不会响应任何非开机指令。例如,虽然显示器处于关闭状态,但是主芯片上电启动之后,可能默认生成对应的用户界面,例如主桌面,此时,如果窗口处于活动状态,那么用户可以通过向窗口下达控制指令,以对用户界面进行操作。基于此,虽然由于显示器处于关闭状态,用户看不到用户界面的变化,但是,后台已经完成了控制指令的响应过程,产生了相应的资源浪费。为了避免上述问题,将窗口设置为非活动状态,例如将窗口置灰,令窗口不可操作,此时,即使用户向显示设备200发送控制指令,例如用户通过遥控器向显示设备200发送键值“菜单”,显示设备200也不会响应于该键值生成对应的用户界面。只有在用户发送开机指令时,显示设备200开启显示器。例如,用户通过遥控器向显示设备200发送键值“开机”,显示设备200响应于该键值,开启显示器,或者,用户向显示设备200发送语音指令“打开显示器”,显示设备200响应于该语音指令,开启显示器。进一步地,显示设备200将窗口重新调整为活动状态,以在显示器亮屏之后,可以正常响应于用户发送的各种指令。Based on the first identification, when the display is kept in the off state, the window is set to an inactive state at the same time, that is, the window is inoperable and will not respond to any non-startup command at this time. For example, although the display is turned off, after the main chip is powered on, the corresponding user interface may be generated by default, such as the main desktop. At this time, if the window is active, the user can issue control instructions to the window. interface to operate. Based on this, although the user cannot see the change of the user interface because the display is turned off, the background has already completed the response process of the control command, resulting in a corresponding waste of resources. In order to avoid the above problems, set the window to an inactive state, such as graying out the window to make the window inoperable. At this time, even if the user sends a control command to the display device 200, for example, the user sends a key value "" menu", the display device 200 will not generate a corresponding user interface in response to the key value. Only when the user sends a power-on command, the display device 200 turns on the display. For example, the user sends the key value "power on" to the display device 200 through the remote control, and the display device 200 turns on the display in response to the key value, or the user sends a voice command "turn on the display" to the display device 200, and the display device 200 responds to the key value. Voice command to turn on the display. Further, the display device 200 readjusts the window to the active state, so that after the display is turned on, it can normally respond to various instructions sent by the user.
为了实现在响应语音指令完毕之后,显示设备200自动进入待机流程,在该响应过程中,语音应用不带有锁标志,即语音应用不会限制显示设备200进入待机流程。In order to realize that the display device 200 automatically enters the standby process after responding to the voice command, during the response process, the voice application does not have a lock mark, that is, the voice application does not restrict the display device 200 from entering the standby process.
进一步地,为了避免主芯片在短时间内反复上电和断电,为主芯片配置自动进入待机流程的等待时长,例如10s。在响应语音指令完毕之后,主芯片等待10s之后,再自动进入待机流程,在该等待时长内,显示设备200可以接收用户发送的开机指令、新的语音指令等(上述指令均为可以再次唤醒主芯片的指令,即令主芯片从断电再次启动的指令),以避免主芯片在自动进入待机流程断电后,短时间内再次响应于上述指令再次启动,从而保护主芯片,也可以有效避免短时间内接收上述指令之后,由于主芯片重新启动过程所耗费的时间,从而提高显示设备200的响应速度。Further, in order to avoid repeated power-on and power-off of the main chip in a short period of time, the waiting time for the main chip to automatically enter the standby process is configured, for example, 10s. After responding to the voice command, the main chip waits for 10 seconds before automatically entering the standby process. During the waiting period, the display device 200 can receive the power-on command sent by the user, new voice commands, etc. (the above commands can wake up the main chip again) Chip instruction, that is, the instruction to restart the main chip from power failure), so as to prevent the main chip from automatically entering the standby process and restarting in response to the above instructions in a short period of time after power failure, thereby protecting the main chip and effectively avoiding short-term After the above command is received within a certain time, the response speed of the display device 200 is improved due to the time spent in the restart process of the main chip.
在上述主芯片在等待自动进入待机流程,以及显示设备200开启显示器,保持工作状态的过程中,语音应用将通过回声消除技术,识别用户再次发出的语音指令。由于显示设 备200当前存在正在执行的语音指令,即存在正在播放的音频数据,因此,通过回声消除技术,可以准确提取出再次接收到的语音数据与当前正在播放的音频数据(回采信号)不同的数据,并基于该不同的数据准确识别唤醒词以及指令信息,进而准确响应语义指令。上述回声消除技术的具体实施过程可以参考上文,此处不再赘述。While the above-mentioned main chip is waiting to automatically enter the standby process, and the display device 200 turns on the display and keeps working, the voice application will recognize the voice command issued by the user again through the echo cancellation technology. Since the display device 200 currently has a voice command being executed, that is, there is audio data being played, the echo cancellation technology can accurately extract the difference between the voice data received again and the audio data currently being played (backtracking signal). data, and accurately identify wake-up words and instruction information based on the different data, and then accurately respond to semantic instructions. For the specific implementation process of the above-mentioned echo cancellation technology, reference may be made to the above, and details will not be repeated here.
基于上述过程,显示设备200处于待机状态时,可以通过语音芯片执行语音数据采集服务和第一唤醒服务,以在识别到用户发送的唤醒指令之后,指示主芯片上电启动,并继续由主芯片执行语音应用中的第二唤醒服务和语音服务。进一步地,主芯片通过语音服务识别语音指令对应的类别,以基于语音指令的类别,准确控制显示器的开启或者关闭,从而精准控制待机启动后的功耗。Based on the above process, when the display device 200 is in the standby state, the voice data collection service and the first wake-up service can be executed through the voice chip, so as to instruct the main chip to power on and start after recognizing the wake-up command sent by the user, and continue to be activated by the main chip. Execute the second wake-up service and the voice service in the voice application. Furthermore, the main chip recognizes the category corresponding to the voice command through the voice service, so as to accurately control the opening or closing of the display based on the category of the voice command, so as to precisely control the power consumption after the standby is started.
为上述显示设备200的待机启动流程提供一个示例,可以参考图18~图23所示的用户与显示设备200的待机启动交互示意图。如图18所示,显示设备200处于待机状态,即显示器处于关闭状态,且主芯片断电,语音芯片通电,由语音芯片执行第一唤醒服务。其中,显示设备200进入待机状态的流程可以参考上文公开的待机流程以及示例,此处不赘述。To provide an example of the above-mentioned standby startup process of the display device 200 , reference may be made to the schematic diagrams of the standby startup interaction between the user and the display device 200 shown in FIGS. 18 to 23 . As shown in FIG. 18 , the display device 200 is in the standby state, that is, the display is off, the main chip is powered off, the voice chip is powered on, and the voice chip performs the first wake-up service. Wherein, for the process of the display device 200 entering the standby state, reference may be made to the standby process and examples disclosed above, which will not be repeated here.
如图19所示,至少包括如下步骤:As shown in Figure 19, at least the following steps are included:
S1901、采集语音数据。S1901. Collect voice data.
其中,在语音芯片中,首先启动语音数据采集服务,通过语音数据采集服务调用麦克风硬件接口,通过麦克风采集用户发送的语音数据,例如“wake up”。Among them, in the voice chip, first start the voice data collection service, call the microphone hardware interface through the voice data collection service, and collect the voice data sent by the user through the microphone, such as "wake up".
S1902、判断语音数据中是否包括唤醒词,若是,则执行S1903,否则执行S1908。S1902. Determine whether the voice data includes a wake-up word, if yes, execute S1903, otherwise execute S1908.
其中,采集到语音数据后,启动第一唤醒服务,通过第一唤醒服务识别“wake up”中的唤醒词。通过比对语音数据中的关键词与唤醒词库中的各个唤醒词,可以判断该语音数据中是否包含唤醒词“wake up”。Wherein, after the voice data is collected, the first wake-up service is started, and the wake-up word in "wake up" is identified through the first wake-up service. By comparing the keywords in the voice data with the wake-up words in the wake-up lexicon, it can be judged whether the voice data contains the wake-up word "wake up".
S1903、唤醒内核层。S1903, wake up the kernel layer.
S1904、通知个模块进程重启。S1904. Notify a module process to restart.
通知内核层中的各个内核模块按照指定顺序上电启动,以从休眠状态调整为开机状态,以唤醒内核层,令内核层可以正常运行。同时,将用户空间调整为解冻状态,以令用户空间可以执行数据的读出和写入任务,令应用层可以正常运行。Notify each kernel module in the kernel layer to power on and start according to the specified order, so as to adjust from the sleep state to the boot state, so as to wake up the kernel layer, so that the kernel layer can run normally. At the same time, adjust the user space to the unfreezing state, so that the user space can perform data reading and writing tasks, so that the application layer can run normally.
S1905、通知电源硬件接口层开机状态。S1905. Notify the power supply hardware interface layer of the power-on state.
在各内核模块与用户空间成功唤醒之后,通知电源硬件接口层本次开机的状态(开机)。After each kernel module and the user space are successfully awakened, the power supply hardware interface layer is notified of the current boot state (startup).
S1906、记录开机原因。S1906. Record the reason for starting up.
由电源硬件接口层记录开机原因。The power-on reason is recorded by the power supply hardware interface layer.
S1907、通知电源管理模块开机状态。S1907. Notify the power management module of the power-on state.
S1908、丢弃语音数据。S1908. Discard the voice data.
其中,丢弃语音数据后,返回执行S1902。Wherein, after discarding the voice data, return to execute S1902.
确定语音数据中包括唤醒词,第一唤醒服务基于该唤醒词确定该语音数据为唤醒指令,并响应于该唤醒指令,指示主芯片上电启动。It is determined that the voice data includes a wake-up word, and the first wake-up service determines that the voice data is a wake-up instruction based on the wake-up word, and instructs the main chip to be powered on in response to the wake-up instruction.
将该开机事件通知电源管理模块,由电源管理模块基于该开机事件发送开机状态的通知,恢复对内核层、应用层的供电。The power management module is notified of the power-on event, and the power management module sends a power-on status notification based on the power-on event to restore power supply to the kernel layer and the application layer.
主芯片上电启动之后,由主芯片执行语音应用中的第二唤醒服务和语音服务,并由语音芯片继续承担语音数据采集服务。语音芯片继续采集用户发送的语音数据,如“播放音频1”,并将该语音数据直接传输至主芯片,由主芯片通过语音服务识别并响应于语音指令,可以参考图20。图20至少包括如下步骤:After the main chip is powered on, the main chip executes the second wake-up service and voice service in the voice application, and the voice chip continues to undertake the voice data collection service. The voice chip continues to collect the voice data sent by the user, such as "play audio 1", and directly transmits the voice data to the main chip, which recognizes and responds to the voice command through the voice service, as shown in Figure 20. Figure 20 at least includes the following steps:
S2001、启动语音应用。S2001. Start a voice application.
S2002、创建第一音频录制线程。S2002. Create a first audio recording thread.
第一音频录制线程比如是麦克风的Audio Recoder,以采集用户发送的语音数据,例如“播放音频1”。The first audio recording thread is, for example, the Audio Recoder of the microphone to collect voice data sent by the user, such as "play audio 1".
S2003、创建第二音频录制线程。S2003. Create a second audio recording thread.
第二音频录制线程比如是回采信号的Audio Recoder,以采集显示设备200播放的音频 数据。The second audio recording thread is, for example, the Audio Recoder of the echo signal, to collect the audio data played by the display device 200.
S2004、回声消除。S2004. Echo cancellation.
采用回声消除技术,通过对比语音数据“播放音频1”和回采信号,提取两者不同的数据,即“播放音频1”,并进一步识别“播放音频1”中的指示信息“播放音频1”。Using echo cancellation technology, by comparing the voice data "play audio 1" and the echo signal, extract the different data between the two, that is, "play audio 1", and further identify the instruction information "play audio 1" in "play audio 1".
S2005、判断是否包括唤醒词,若是,则执行S2006,否则执行S2010。S2005. Determine whether the wake-up word is included, if yes, execute S2006, otherwise execute S2010.
S2006、启动语音识别界面。S2006, start the speech recognition interface.
S2007、识别指令信息。S2007. Identify instruction information.
S2008、执行指令信息。S2008. Execute instruction information.
S2009、退出语音识别界面。S2009, exit the speech recognition interface.
S2010、启动下一个语音数据的识别流程。S2010, start the recognition process of the next voice data.
也就是,返回执行S2004。That is, return to execute S2004.
如图21所示,至少包括如下步骤:As shown in Figure 21, at least the following steps are included:
S2101、识别指令信息。S2101. Identify instruction information.
S2102、判断语音指令的类型,如果是第一类型,则执行S2103,如果是第二类型,则执行2106。S2102. Determine the type of the voice instruction. If it is the first type, execute S2103. If it is the second type, execute S2106.
S2103、在第一标志位(亮屏标志位)携带第一标识。S2103. Carry the first identifier in the first flag (the bright screen flag).
语音指令为“播放视频1”,该语音指令包含的指示信息为“播放视频1”,语音应用可以确定该语音指令对应的类别为第一类别。则需要开启显示器,并在第一标志位(亮屏标志位)携带第一标识,以标识该语音指令对应第一类别。The voice command is "play video 1", the indication information included in the voice command is "play video 1", and the voice application can determine that the category corresponding to the voice command is the first category. Then it is necessary to turn on the display, and carry the first identification in the first flag (bright screen flag), to identify that the voice command corresponds to the first category.
S2104、电源管理服务申请电源锁。S2104. The power management service applies for a power lock.
S2105、窗口管理服务设定为活动状态。S2105. The window management service is set to an active state.
S2106、开启显示器,响应开机指令和非开机指令。S2106. Turn on the display, and respond to a power-on command and a non-power-on command.
其中,语音应用携带对应的标识通知到窗口管理服务和电源管理服务。窗口服务根据亮屏标志位上的第一标识,识别到需要开启显示器,将窗口设置为活动状态,即可操作状态,可以响应开机指令以及各非开机指令。Wherein, the voice application carries a corresponding identification notification to the window management service and the power management service. The window service recognizes that the display needs to be turned on according to the first mark on the bright screen flag, sets the window to an active state, and can be in an operational state, and can respond to power-on commands and various non-power-on commands.
电源管理服务为显示器供电,如图23所示,显示器处于开启状态,显示与“视频1”对应的用户界面。同时,语音应用在内核层申请电源锁,即语音应用携带锁标志。由此,可以阻止显示设备200自动进入待机流程。The power management service supplies power to the display. As shown in Figure 23, the display is turned on and the user interface corresponding to "Video 1" is displayed. At the same time, the voice application applies for a power lock at the kernel layer, that is, the voice application carries a lock symbol. Thus, it is possible to prevent the display device 200 from automatically entering the standby process.
S2107、在第二标志位(不亮屏标志位)携带第二标识。S2107. Carry the second identifier in the second flag (the flag that does not turn on the screen).
语音应用基于识别到的指示信息,确定语音指令对应的类别,并在生成对应的标识。在本示例中,语音应用基于指示信息“播放音频1”,确定语音指令对应的类别为第二类别,即不需要开启显示器,则在第二标志位(不亮屏标志位)携带第二标识,以标识该语音指令对应第二类别。Based on the recognized indication information, the voice application determines the category corresponding to the voice command, and generates a corresponding identifier. In this example, the voice application determines that the category corresponding to the voice command is the second category based on the indication information "play audio 1", that is, it does not need to turn on the display, and carries the second identifier in the second flag (flag that does not turn on the screen) , to identify that the voice command corresponds to the second category.
S2108、窗口管理服务设定为非活动状态。S2108. The window management service is set to an inactive state.
S2109、保持显示器关闭,不响应非开机指令。S2109. Keep the display turned off, and do not respond to the non-starting command.
S2110、指定时长后,重新进入待机流程。S2110. Re-enter the standby process after a specified time period.
语音应用携带对应的标识通知到窗口管理服务和电源管理服务。窗口服务根据不亮屏标志位上的第二标识,将窗口设置为非活动状态,即不可操作状态。电源管理服务不为显示器供电,如图22所示,保持显示器处于关闭状态。同时,语音应用不在内核层申请电源锁,即语音应用不携带锁标志。由此,显示设备200在等待指定时间,例如10s之后,将自动进入待机流程。The voice application carries the corresponding identification notification to the window management service and power management service. The window service sets the window to an inactive state, that is, an inoperable state, according to the second mark on the off-screen flag. The power management service does not power the display, as shown in Figure 22, leaving the display in the off state. At the same time, the voice application does not apply for a power lock at the kernel layer, that is, the voice application does not carry a lock flag. Thus, the display device 200 will automatically enter the standby process after waiting for a specified time, for example, 10s.
基于上述过程,显示设备200处于待机状态时,可以通过语音芯片执行语音数据采集服务和第一唤醒服务,以在识别到用户发送的唤醒指令之后,指示主芯片上电启动,并继续由主芯片执行语音应用中的第二唤醒服务和语音服务。进一步地,主芯片通过语音服务识别语音指令对应的类别,以基于语音指令的类别,准确控制显示器的开启或者关闭,从而精准控制待机启动后的功耗。Based on the above process, when the display device 200 is in the standby state, the voice data collection service and the first wake-up service can be executed through the voice chip, so as to instruct the main chip to power on and start after recognizing the wake-up command sent by the user, and continue to be activated by the main chip. Execute the second wake-up service and the voice service in the voice application. Furthermore, the main chip recognizes the category corresponding to the voice command through the voice service, so as to accurately control the opening or closing of the display based on the category of the voice command, so as to precisely control the power consumption after the standby is started.
通过上述实施例,将显示设备200由开机状态调整为待机状态时,将主芯片断电,并保持语音芯片通电,以通过语音芯片执行第一唤醒任务,即通过语音芯片识别用户发送的 唤醒指令,并响应于识别到的唤醒指令指示主芯片上电启动。以在待机状态保证远场语音控制功能,并避免主芯片产生的功耗。并且,通过用户的唤醒指令将显示设备从待机状态唤醒时,进一步由主芯片执行语音服务,以识别语音指令的类别,并基于语音指令的类别,准确控制是否需要开启显示器,以仅在需要开启显示器时开启显示器,从而精准控制待机启动后的功耗。Through the above embodiment, when the display device 200 is adjusted from the power-on state to the standby state, the main chip is powered off, and the voice chip is kept powered on, so as to perform the first wake-up task through the voice chip, that is, to recognize the wake-up command sent by the user through the voice chip , and instruct the main chip to power on and start in response to the recognized wake-up command. In order to ensure the far-field voice control function in the standby state, and avoid the power consumption generated by the main chip. Moreover, when the display device is woken up from the standby state by the user's wake-up command, the main chip further executes the voice service to identify the type of voice command, and based on the type of voice command, accurately control whether the display needs to be turned on, so as to only turn on the display when needed. Turn on the monitor when the monitor is on, so as to precisely control the power consumption after standby startup.
另外,显示设备在使用过程中,由于不断的在显示设备中安装并运行应用,显示设备中的内置存储空间会变得越来越小,用户为了可以在显示设备使用更多的应用,常常将外接存储设备转换为内置存储设备,以扩大显示设备的内置存储空间。用户可以将应用安装到转换得到的内置存储设备中,但是发现在显示设备上运行该应用,随后显示设备执行真待机,即执行STR待机(显示设备处于挂起模式),在重新开启显示设备并打开该应用时,会出现显示设备死机或应用闪退等问题,严重影响用户使用体验。In addition, during the use of the display device, due to the continuous installation and running of applications on the display device, the built-in storage space in the display device will become smaller and smaller. In order to use more applications on the display device, users often use the The external storage device is converted into a built-in storage device to expand the built-in storage space of the display device. The user can install the application into the converted built-in storage device, but finds that the application is running on the display device, and then the display device performs true standby, that is, performs STR standby (the display device is in suspend mode), and then restarts the display device and When the app is opened, problems such as the display device crashing or the app crashing may occur, seriously affecting the user experience.
所以,如何能避免再次打开该应用时,出现显示设备死机或者应用闪退等,成为本领域技术人员亟待解决的问题。Therefore, how to prevent the display device from crashing or the application from crashing when the application is opened again has become an urgent problem to be solved by those skilled in the art.
经过研究发现,出现上述技术问题的原因为真待机后应用所持有的文件句柄没有释放,当再次开机并启动该应用时,又重新获取应用对应的句柄,这样未释放的句柄与重新获取的句柄产生矛盾,最终造成显示设备死机或者应用闪退等问题。After research, it is found that the reason for the above technical problems is that the file handle held by the application is not released after the true standby. The handle conflicts, eventually causing problems such as display device crashes or application crashes.
考虑上述技术问题,本公开实施例提供一种实现假待机的方法,该方法通过执行假待机,以使显示设备开机并运行应用时,不再重新获取应用对应的句柄,这样显示设备中只存在原有未释放的句柄,不会造成显示设备死机或者应用闪退等问题,如图24所示,图24示出了根据一些实施例的一种实现假待机的方法的流程图,方法包括S100-S200:Considering the above-mentioned technical problems, the embodiments of the present disclosure provide a method for implementing false standby. By performing false standby, the method does not reacquire the handle corresponding to the application when the display device is turned on and runs the application. In this way, only the The original unreleased handle will not cause problems such as display device crash or application flashback, as shown in FIG. 24 . FIG. 24 shows a flowchart of a method for implementing false standby according to some embodiments. The method includes S100 -S200:
S100、接收显示设备关机指令,确定电源锁管理模块是否持有锁(wake_lock),以及,获取省电开关的状态,其中当显示设备中存在由外接存储设备转换得到的内置存储设备时,控制电源锁管理模块持有锁。S100. Receive the display device shutdown command, determine whether the power lock management module holds the lock (wake_lock), and obtain the state of the power saving switch, wherein when there is a built-in storage device converted from an external storage device in the display device, control the power supply The lock management module holds locks.
本公开实施例中,显示设备关机指令的生成可以通过不同的方式。一些实施例中,用户可以按压设置在控制装置上的电源键(power按键),生成显示设备关机指令。另一些实施例中,显示设备的用户界面上设置关机控件,用户可以通过控制装置将焦点移动到关机控件上,并按压控制装置上的确认键,生成显示设备关机指令。如图25所示,图25中示例性示出了根据一些实施例的一种显示设备的用户界面示意图,在图25中,用户界面上显示有关机控件,一些情况下为了丰富用户对显示设备可执行的操作,还可以控制在显示关机控件时显示重新启动控件。需要说明的是,本公开实施例中,并不限制生成显示设备关机指令的操作,只要可以实现生成显示设备关机指令的操作均可。In the embodiments of the present disclosure, different ways may be used to generate the shutdown instruction of the display device. In some embodiments, the user may press a power button (power button) provided on the control device to generate a shutdown instruction of the display device. In other embodiments, a power-off control is set on the user interface of the display device, and the user can move the focus to the power-off control through the control device, and press the confirmation key on the control device to generate a power-off command of the display device. As shown in FIG. 25, FIG. 25 exemplarily shows a schematic diagram of a user interface of a display device according to some embodiments. In FIG. 25, a power-off control is displayed on the user interface. Action that can also control the display of the restart control when the shutdown control is displayed. It should be noted that, in the embodiments of the present disclosure, the operation of generating the display device shutdown instruction is not limited, as long as the operation of generating the display device shutdown instruction can be realized.
本公开实施例中焦点移动到控件上,可以使该控件的边框加粗,另外,也可以采用其他形式表示该控件被选中,示例性的当焦点移动到该控件上,该控件可以改变形态,可以从方形改成圆形等,也可以当控件被选中,该控件按照预设比例被放大,例如,用户界面上的视频控件的显示面积相同,当某一控件被选中后,该控件的显示面积照比原有控件的显示面积增大1.2倍。由于本公开并不对焦点位于控件上,控件的形态进行限制,所以其他可以便于用户分辨用于视频控件被选中的形式均可以被接受。In the embodiment of the present disclosure, when the focus is moved to the control, the border of the control can be thickened. In addition, other forms can also be used to indicate that the control is selected. For example, when the focus is moved to the control, the control can change its form. It can be changed from a square to a circle, etc., or when the control is selected, the control will be enlarged according to the preset ratio. For example, the display area of the video control on the user interface is the same. When a certain control is selected, the display of the control The area according to the display area of the original control is increased by 1.2 times. Since the present disclosure does not limit the focus on the control and the shape of the control, other forms that can facilitate the user to distinguish that the video control is selected can be accepted.
本公开实施例中,执行确定电源锁管理模块是否持有锁,以及,获取省电开关的状态的步骤,二者可以同时进行,也可以先执行确定电源锁管理模块是否持有锁,当持有锁时,获取省电开关的状态的步骤,还可以先执行获取省电开关的状态的步骤,当省电开关的状态为开启时,确定电源锁管理模块是否持有锁。所以对于当接收到显示设备关机指令后,确定电源锁管理模块是否持有锁,以及,获取省电开关的状态,二者执行的先后顺序,本公开不做限制,可以根据实际需要设置。In the embodiment of the present disclosure, the steps of determining whether the power lock management module holds the lock and obtaining the state of the power saving switch can be performed at the same time, or can be performed first to determine whether the power lock management module holds the lock. When there is a lock, the step of obtaining the state of the power saving switch may also firstly perform the step of obtaining the state of the power saving switch, and when the state of the power saving switch is on, determine whether the power lock management module holds the lock. Therefore, this disclosure does not limit the sequence of execution of determining whether the power lock management module holds the lock and obtaining the state of the power saving switch after receiving the shutdown command of the display device, which can be set according to actual needs.
一些实施例中,在显示设备开机后,显示设备中创建一种常驻监听服务(Agent),用于接收为了显示设备运行,发出的各种广播,并根据广播执行响应的操作,示例性的,广播对应的操作可以为关掉声音和控制灯效等。当显示设备接收到关机指令时,系统会发送关屏(screen_off)广播,监听服务(Agent)接收到关屏广播后,确定电源锁管理模式是否持有锁,以及,获取省电开关的状态。一些实施例中,当显示设备接收到关机指令后, 示例性的,用户按压控制装置上的电源键,驱动解析按键键值,并上抛至框架层(framework层),调用phonewindowmanager服务,执行powerpress函数,发送str关机广播,调用PMS服务(power manager service),执行gotosleep函数,发送关屏广播。In some embodiments, after the display device is turned on, a resident listening service (Agent) is created in the display device to receive various broadcasts sent for the operation of the display device, and perform corresponding operations according to the broadcasts. Exemplary , the operation corresponding to the broadcast can be to turn off the sound and control the lighting effect, etc. When the display device receives the shutdown command, the system will send a screen off (screen_off) broadcast. After receiving the screen off broadcast, the monitoring service (Agent) determines whether the power lock management mode holds the lock, and obtains the status of the power saving switch. In some embodiments, after the display device receives the shutdown command, for example, the user presses the power button on the control device, the driver parses the button key value, and throws it up to the framework layer (framework layer), calls the phonewindowmanager service, and executes the powerpress Function, send str shutdown broadcast, call PMS service (power manager service), execute gotosleep function, and send shutdown broadcast.
本公开实施例中,当显示设备中存在由外接存储设备转换得到的内置存储设备,控制电源锁管理模块持有锁。一些实施例中,当存在由外接存储设备转换得到的内置存储设备,利用监听服务调用电源锁管理模块获取锁,具体的,利用wakelockManager.acquireWakeLock接口持有锁。一些实施例中,电源锁管理模块持有锁主要是通过电源管理(powermanager)服务来实现,通过调用电源管理服务来利用newwakelock方法创建电源锁(wakelock)对象,并使用该对象利用acquire方法获取锁。In the embodiment of the present disclosure, when there is a built-in storage device converted from an external storage device in the display device, the power lock management module is controlled to hold the lock. In some embodiments, when there is a built-in storage device converted from an external storage device, the monitoring service is used to call the power lock management module to acquire the lock, specifically, the wakelockManager.acquireWakeLock interface is used to hold the lock. In some embodiments, the power lock management module holds the lock mainly through the power management (powermanager) service, by calling the power management service to use the newwakelock method to create a power lock (wakelock) object, and use the object to use the acquire method to acquire the lock .
相关技术中,当应用安装在由外接存储设备转换得到的内置存储设备中运行且显示设备真待机后,重新开机并运行该应用会出现显示设备死机或者应用闪退的问题,所以本公开实施例中,为了保证不会出现上述技术问题,在显示设备中存在由外接存储设备转换得到的内置存储设备时,直接控制电源锁管理模块持有锁,当电源锁管理模块持有锁时,可以根据省电开关的设置情况,确定是否执行假待机。当显示设备接收到关机指令后执行假待机,再次开机并启动应用时,不会重新获取应用对应的句柄,不会造成与未释放的句柄产生矛盾的问题,进而改善用户的使用体验。In related technologies, when the application is installed and run in the built-in storage device converted from the external storage device and the display device is really in standby, the display device crashes or the application crashes when the application is restarted, so the embodiment of the present disclosure In order to ensure that the above technical problems will not occur, when there is a built-in storage device converted from an external storage device in the display device, directly control the power lock management module to hold the lock. The setting of the power saving switch determines whether to perform false standby. When the display device receives the shutdown command and executes false standby, when it is turned on again and starts the application, it will not reacquire the handle corresponding to the application, and will not cause conflicts with unreleased handles, thereby improving the user experience.
下面分别详细介绍如何判断显示设备中是否存在外接存储设备转换得到的内置存储设备,以及,有关电源管理模块持有锁的相关内容。The following describes in detail how to determine whether there is a built-in storage device converted from an external storage device in the display device, and related content about the lock held by the power management module.
首先介绍如何判断显示设备中是否存在外接存储设备转换得到的内置存储设备。Firstly, how to judge whether there is a built-in storage device converted from an external storage device exists in the display device.
在一些实施例中,判断显示设备中是否存在由外接存储设备转换得到的内置存储设备的步骤包括:获取显示设备中存储设备(volume)的设备信息,设备信息包括设备标识和设备类型;当设备标识指示存在与显示设备连接的外界存储设备,且设备类型为私有类型(TYPE_PRIVATE)时,确定显示设备中存在由外接存储设备转换得到的内置存储设备。一些实施例中,获取显示设备中存储设备的设备信息可以通过存储设备管理系统服务完成。In some embodiments, the step of judging whether there is a built-in storage device converted from an external storage device in the display device includes: obtaining device information of a storage device (volume) in the display device, where the device information includes a device identifier and a device type; when the device When the identifier indicates that there is an external storage device connected to the display device, and the device type is a private type (TYPE_PRIVATE), it is determined that there is a built-in storage device converted from the external storage device in the display device. In some embodiments, acquiring the device information of the storage device in the display device may be accomplished through a storage device management system service.
显示设备实现存储功能可以利用内置存储设备完成,还可以利用外接存储设备完成。该内置存储设备可能为原有设置在显示设备中的内置存储设备,还可能为外接存储设备通过转换得到的内置存储设备。所以显示设备中的存储设备的数量可以为一个或多个。The storage function of the display device can be completed by using a built-in storage device, and can also be completed by using an external storage device. The built-in storage device may be a built-in storage device originally set in the display device, or may be a built-in storage device converted from an external storage device. Therefore, the number of storage devices in the display device can be one or more.
本公开实施例中,获取显示设备中存储设备的设备信息,可以有不同的获取方式。一些实施例中,可以一次性获取显示设备中所有存储设备的设备信息,然后逐个对设备信息进行分析,当出现一个由外接存储设备转换得到的内置存储设备,则停止对剩余的设备信息进行分析。如果当前分析的设备信息未能确定存在由外接存储设备转换得到的内置存储设备,则继续分析下一个设备信息,直至全部的设备信息均被分析,如果仍未能确定存在由外接存储设备转换得到的内置存储设备,则确定显示设备中不存在由外接存储设备转换得到的内置存储设备。In the embodiments of the present disclosure, there may be different acquisition methods for obtaining the device information of the storage device in the display device. In some embodiments, the device information of all storage devices in the display device can be acquired at one time, and then the device information is analyzed one by one. When a built-in storage device converted from an external storage device appears, the analysis of the remaining device information is stopped. . If the currently analyzed device information fails to confirm that there is a built-in storage device converted from an external storage device, continue to analyze the next device information until all device information is analyzed. If there is a built-in storage device, it is determined that the built-in storage device converted from the external storage device does not exist in the display device.
示例性的,显示设备中的存储设备包括设备A、设备B和设备C。将三个存储设备的设备信息一次性获取到,按照一定顺序逐个对存储设备的设备信息进行分析。比如,首先对设备A的设备进行分析,通过分析,得到设备A不是由外接存储设备转换得到的内置存储设备。进而对下一个存储设备B的设备信息进行分析,通过分析,得到设备B是由外接存储设备转换得到的内置存储设备,则此时确定显示设备中存在由外接存储设备转换得到的内置存储设备。不继续对下一个存储设备C的设备信息进行分析。Exemplarily, the storage devices in the display device include device A, device B, and device C. The device information of the three storage devices is obtained at one time, and the device information of the storage devices is analyzed one by one in a certain order. For example, firstly, the device of device A is analyzed, and through the analysis, it is found that device A is not a built-in storage device converted from an external storage device. Further, the device information of the next storage device B is analyzed. Through the analysis, it is obtained that device B is a built-in storage device converted from an external storage device, and at this time it is determined that there is a built-in storage device converted from an external storage device in the display device. Do not continue to analyze the device information of the next storage device C.
另一些实施例中,可以采用每次获取一个存储设备对应的设备信息,对该设备信息进行分析,如果确定该设备信息对应的存储设备为由外接存储设备转换得到的内置存储设备,则不继续获取显示设备中下一个存储设备对应的设备信息。如果确定该设备信息对应的存储设备不是由外接存储设备转换得到的内置存储设备,则继续获取显示设备中下一个存储设备对应的设备信息,继续对该设备信息分析,直至获取全部的显示设备中存储设备的设备信息。如果仍未能确定存在由外接存储设备转换得到的内置存储设备,则确定显示设备中不存在由外接存储设备转换得到的内置存储设备。In some other embodiments, the device information corresponding to a storage device can be obtained each time, and the device information is analyzed. If it is determined that the storage device corresponding to the device information is a built-in storage device converted from an external storage device, do not continue. Get the device information corresponding to the next storage device in the display device. If it is determined that the storage device corresponding to the device information is not a built-in storage device converted from an external storage device, continue to obtain the device information corresponding to the next storage device in the display device, and continue to analyze the device information until all the display devices are obtained. Device information of the storage device. If it is still not determined that there is a built-in storage device converted from the external storage device, it is determined that there is no built-in storage device converted from the external storage device in the display device.
示例性的,显示设备中的存储设备包括设备A、设备B和设备C。首先获取设备A的 设备信息,对该设备信息进行分析,确定该设备A不是由外接存储设备转换得到的内置存储设备。然后继续获取设备B的设备信息,对该设备信息进行分析,确定设备B也不是由外接存储设备转换得到的内置存储设备。继续获取设备C的设备信息,对该设备信息进行分析,确定设备C也不是由外接存储设备转换得到的内置存储设备,则认定显示设备中不存在外接存储设备转换得到的内置存储设备。Exemplarily, the storage devices in the display device include device A, device B, and device C. First obtain the device information of device A, analyze the device information, and determine that device A is not a built-in storage device converted from an external storage device. Then continue to obtain the device information of device B, analyze the device information, and determine that device B is not a built-in storage device converted from an external storage device. Continue to obtain the device information of device C, analyze the device information, and determine that device C is not a built-in storage device converted from an external storage device, then it is determined that there is no built-in storage device converted from an external storage device in the display device.
一些实施例中,设备信息包括设备标识和设备类型。该设备标识为存储设备的唯一标识,该设备标识的形式可以包括数字、字母和/或符号。设备类型包括私有类型和共有类型。存储设备的设备类型为私有类型,可以理解为存储设备为内置存储设备。存储设备的设备类型为共有类型,可以理解为存储设备为外接存储设备。In some embodiments, the device information includes device identification and device type. The device identifier is a unique identifier of the storage device, and the form of the device identifier may include numbers, letters and/or symbols. Device types include private types and public types. The device type of the storage device is a private type, which can be understood as a built-in storage device. The device type of the storage device is a common type, which can be understood as an external storage device.
确定设备信息中的设备标识是否指示存储设备存在的步骤包括:判断设备标识是否为空;当设备标识不为空时,则指示存在与显示设备连接的外界存储设备。当设备标识为空时,则指示不存在与显示设备连接的外界存储设备,本公开实施例中设备标识为空时,可能是因为设备信息对应的存储设备为显示设备自身的内置存储设备。The step of determining whether the device identifier in the device information indicates the existence of the storage device includes: judging whether the device identifier is empty; if the device identifier is not empty, indicating that there is an external storage device connected to the display device. When the device identifier is empty, it indicates that there is no external storage device connected to the display device. In the embodiment of the present disclosure, when the device identifier is empty, it may be because the storage device corresponding to the device information is a built-in storage device of the display device itself.
示例性的,设备A的设备标识为空,则说明设备A为显示设备自身的内置存储设备,所以也无需考虑设备A的设备类型。设备B和设备C设备标识不为空,说明设备B和设备C为外接存储设备,在后续步骤中仅对外接存储设备进行判别,判别外接存储设备是否已经转换为内置存储设备。Exemplarily, if the device ID of device A is empty, it means that device A is a built-in storage device of the display device itself, so the device type of device A does not need to be considered. The device IDs of device B and device C are not empty, indicating that device B and device C are external storage devices. In the subsequent steps, only external storage devices are judged to determine whether the external storage device has been converted into a built-in storage device.
将指示存在与显示设备连接的外界存储设备,判断对应的设备类型是否为私有类型,如果出现某一存储设备的设备类型是私有类型,则确定显示设备中存在由外接存储设备转换得到的内置存储设备。如果所有指示存在的存储设备的设备类型均不是私有类型,即全部为公有类型,则确定显示设备中仅存在外接存储设备,不存在内置存储设备。It will indicate that there is an external storage device connected to the display device, and judge whether the corresponding device type is a private type. If the device type of a certain storage device is a private type, it is determined that there is a built-in storage device converted from an external storage device in the display device. equipment. If none of the device types indicating the existing storage devices is a private type, that is, all of them are public types, then it is determined that only an external storage device exists in the display device, and no built-in storage device exists.
本公开实施例中,在确定存在与显示设备连接的外界存储设备后,判断所有与显示设备连接的外界存储设备的设备类型是否为私有类型。当至少一个存储设备的设备类型为私有类型时,确定显示设备中存在由外接存储设备转换得到的内置存储设备,一些实施例中,显示设备中可能存在多个存在与显示设备连接的外界存储设备,可以对外接存储设备的设备类型逐一判断,当出现外接存储设备的设备类型为私有类型后,确定该外接存储设备已经转换为内置存储设备,这样可以不再继续对剩余的与显示设备连接的外接存储设备进行判断。可以理解为,显示设备出现一个由外接存储设备转换得到的内置存储设备后,就不在继续对存储设备的设备类型进行判断。因为只要存在外接存储设备转换得到的内置存储设备就可能出现相关技术中的技术问题。In the embodiment of the present disclosure, after it is determined that there are external storage devices connected to the display device, it is determined whether the device types of all external storage devices connected to the display device are private types. When the device type of at least one storage device is a private type, it is determined that there is a built-in storage device converted from an external storage device in the display device. In some embodiments, there may be multiple external storage devices connected to the display device in the display device , you can judge the device type of the external storage device one by one. When it appears that the device type of the external storage device is a private type, make sure that the external storage device has been converted into a built-in storage device, so that you can no longer continue to check the remaining devices connected to the display device. External storage device for judgment. It can be understood that after a built-in storage device converted from an external storage device appears on the display device, the device type of the storage device does not continue to be judged. Because as long as there is a built-in storage device converted from an external storage device, technical problems in related technologies may occur.
一些实施例中,为了更准确的确定设备标识是否指示存在与显示设备连接的外接存储设备,确定设备标识是否指示存在与显示设备连接的外接存储设备的步骤包括:In some embodiments, in order to more accurately determine whether the device identifier indicates that there is an external storage device connected to the display device, the step of determining whether the device identifier indicates that there is an external storage device connected to the display device includes:
设备标识包括设备标识符(diskid)和通用唯一识别码(uuid)。本公开实施例中,每个外接存储设备对应有唯一的设备标识符,每个外接存储设备还对应有唯一的通用唯一识别码,设备标识符和通用唯一识别码在两个不同的方面均可确定唯一的外接存储设备。为了更精准的确定设备标识是否指示存在与显示设备连接的外接存储设备,本公开实施例中,判断设备标识符是否为空,如果设备标识符不为空,则判断通用唯一识别码是否为空;如果通用唯一识别码不为空,则确定设备标识指示存在与显示设备连接的外接存储设备。这样,通过设备标识符和通用唯一识别码两个标识可以更准确的确定设备标识是否指示存在与显示设备连接的外接存储设备。Device identification includes a device identifier (diskid) and a universally unique identifier (uuid). In the embodiment of the present disclosure, each external storage device corresponds to a unique device identifier, and each external storage device also corresponds to a unique universal unique identification code. The device identifier and the universal unique identification code can be used in two different aspects. Identify the only external storage device. In order to more accurately determine whether the device identifier indicates that there is an external storage device connected to the display device, in the embodiment of the present disclosure, it is judged whether the device identifier is empty, and if the device identifier is not empty, it is judged whether the universal unique identification code is empty ; If the UUID is not empty, it is determined that the device identifier indicates that there is an external storage device connected to the display device. In this way, it can be more accurately determined whether the device identifier indicates that there is an external storage device connected to the display device through the two identifiers of the device identifier and the UUID.
一些实施例中,外接存储设备转换得到的内置存储设备的步骤包括:In some embodiments, the step of converting the external storage device into the built-in storage device includes:
接收显示预设控件的指令,控制显示界面显示该预设控件。本公开实施例中,预设控件为外接存储设备转换为内置存储设备对应的控件。一些实施例中,用户将外接存储设备与显示设备连接,此时生成显示预设控件的指令,示例性的大容量存储设备通过设置在显示设备上的USB接口插入到显示设备中,此时生成显示预设控件的指令。当显示设备接收到显示预设控件的指令后,控制显示器显示如图26所示的用户界面,图26中示例性示出了根据一些实施例的又一种显示设备的用户界面示意图,在图26中显示有预设控件,该预设控件显示为“转换为内置存储设备”。Receiving an instruction to display a preset control, and controlling the display interface to display the preset control. In the embodiment of the present disclosure, the preset control is a control corresponding to the conversion from an external storage device to a built-in storage device. In some embodiments, the user connects the external storage device to the display device, at this time an instruction for displaying preset controls is generated, and an exemplary large-capacity storage device is inserted into the display device through a USB interface provided on the display device, and at this time an instruction is generated Displays commands for preset controls. After the display device receives the instruction to display the preset control, it controls the display to display the user interface as shown in FIG. 26 . FIG. 26 exemplarily shows another schematic diagram of the user interface of the display device according to some embodiments. In FIG. 26 shows a preset control that says "convert to built-in storage device".
接收选中预设控件的指令,确定与显示设备连接的外接存储设备对应的所在路径。一些实施例中,用户可以通过控制装置将焦点移动到预设控件上,并按压控制装置上的确认键,此时生成选中预设控件的指令。An instruction for selecting the preset control is received, and the path corresponding to the external storage device connected to the display device is determined. In some embodiments, the user can move the focus to the preset control through the control device, and press the confirmation key on the control device, at this time, an instruction for selecting the preset control is generated.
一些实施例中,为了更准确的了解用户的意图,在用户通过控制装置将焦点移动到预设控件上,并按压控制装置上的确认键后,不立即生成选中预设控件的指令,而是控制显示器显示询问消息,该询问消息用于询问用户是否确定执行将外接存储设备转化为内置存储设备的操作,这样可以更准确的了解用户意图,避免误操作带来的问题。In some embodiments, in order to understand the user's intention more accurately, after the user moves the focus to the preset control through the control device and presses the confirmation key on the control device, an instruction to select the preset control is not generated immediately, but The control display displays an inquiry message, which is used to ask the user whether to confirm the operation of converting the external storage device into a built-in storage device, so that the user's intention can be more accurately understood, and problems caused by misoperation can be avoided.
示例性的,如图27所示,图27示出了根据一些实施例的又一种显示设备的用户界面示意图,当用户在显示设备上插入外接存储设备后,用户界面发生变化。一些实施例中,用户界面直接发生跳转,跳转后的用户界面显示有询问消息,示例性的,由如图27所示的用户界面,跳转到图28所示的用户界面,图28中示例性示出了根据一些实施例的又一种显示设备的用户界面示意图,图28中显示有询问消息。另一些实施例中,用户界面的浮层上显示有询问消息,示例性的,如图29所示,图29中示例性示出了根据一些实施例的又一种显示设备的用户界面示意图,图29中显示有询问消息,该询问消息以浮层的方式显示在用户界面上。Exemplarily, as shown in FIG. 27 , which shows a schematic diagram of a user interface of another display device according to some embodiments, when a user inserts an external storage device into the display device, the user interface changes. In some embodiments, the user interface jumps directly, and the user interface after the jump displays a query message. Exemplarily, the user interface shown in FIG. 27 jumps to the user interface shown in FIG. 28, and FIG. 28 28 exemplarily shows a schematic diagram of a user interface of another display device according to some embodiments, and FIG. 28 shows an inquiry message. In some other embodiments, a query message is displayed on the floating layer of the user interface. For example, as shown in FIG. 29 , FIG. 29 exemplarily shows a schematic diagram of a user interface of another display device according to some embodiments. Figure 29 shows an inquiry message, which is displayed on the user interface in the form of a floating layer.
具体的,该询问消息可以为“是否确定执行将外接存储设备转换为内置存储设备的操作”,在显示该询问消息的同时,还显示有确认控件和取消控件。当用户确认执行该操作时,用户可以利用控制装置将焦点移动到确认控件上,并按压控制装置上的确认键,此时生成选中预设控件的指令,确定与显示设备连接的外接存储设备对应的所在路径。一些实施例中,在接收到选中预设控件的指令,还控制显示器继续显示显示设备插入外接存储设备前的用户界面,示例性的,显示如图27所示的用户界面,该用户界面为在显示设备插入外接存储设备前的用户界面。Specifically, the query message may be "whether you are sure to perform the operation of converting the external storage device into a built-in storage device", and while the query message is displayed, a confirmation control and a cancel control are also displayed. When the user confirms to perform the operation, the user can use the control device to move the focus to the confirmation control, and press the confirmation key on the control device. At this time, an instruction to select the preset control is generated to determine the corresponding external storage device connected to the display device. of the path. In some embodiments, after receiving the instruction to select the preset control, the display is also controlled to continue to display the user interface before the display device is inserted into the external storage device. For example, the user interface shown in FIG. 27 is displayed. Display the user interface before the device is inserted into the external storage device.
当用户不希望显示设备执行该操作时,用户可以利用控制装置将焦点移动到取消控件上,并按压控制装置上的确认键,此时不生成选中预设控件的指令。一些实施例中,在用户选中该取消控件时,当显示有预设控件的用户界面还显示有其他控件时,可以控制显示器显示设置有预设控件的用户界面,如图28或图29所示的用户界面。这样如果用户失误选中取消控件,则可以提供再一次选择的机会。当第二次用户仍选中取消控件,则不再显示该询问消息。一些实施例中,当显示有预设控件的用户界面没有显示其他控件时,可以控制显示器继续显示显示设备插入外接存储设备前的用户界面,示例性的,不存在显示询问消息的步骤,则用户界面直接显示显示设备插入外接存储设备前的用户界面,如图27所示。When the user does not want the display device to perform the operation, the user can use the control device to move the focus to the cancel control, and press the confirmation key on the control device, and at this time no instruction for selecting the preset control is generated. In some embodiments, when the user selects the cancel control, when the user interface displayed with preset controls also displays other controls, the display may be controlled to display the user interface with preset controls, as shown in Figure 28 or Figure 29 user interface. This gives the user another chance to select if they mistakenly select the cancel control. When the user still selects the cancel control for the second time, the asking message will not be displayed again. In some embodiments, when the user interface with preset controls does not display other controls, the display can be controlled to continue to display the user interface before the display device is inserted into the external storage device. For example, if there is no step of displaying an inquiry message, the user The interface directly displays the user interface before the display device is inserted into the external storage device, as shown in Figure 27.
本公开实施例中,当外接存储设备插入显示设备时,都会自动确定外接存储设备对应的路径,这样便于查找外接存储设备对应的存储位置。In the embodiment of the present disclosure, when the external storage device is inserted into the display device, the path corresponding to the external storage device will be automatically determined, so that it is convenient to find the storage location corresponding to the external storage device.
判断路径是否存在,如果存在,则卸载外接存储设备;如果不存在,则控制显示器显示提示消息。一些实施例中,调用framwake中的ExtemalStorageFormatter类的onStartCommand方法接收路径,并执行updateProgressState方法来判断路径是否存在,如果存在,卸载外接存储设备。Judging whether the path exists, if it exists, uninstall the external storage device; if it does not exist, control the display to display a prompt message. In some embodiments, the onStartCommand method of the ExtemalStorageFormatter class in framwake is called to receive the path, and the updateProgressState method is executed to determine whether the path exists, and if so, uninstall the external storage device.
本公开实施例中,判断路径是否存在,如果存在,说明当前外接存储设备与显示设备连接,此时可以卸载外接存储设备。如果不存在,则说明此时与该路径对应的外接存储设备未与显示设备连接。一些实施例中,可以控制显示器显示提示消息。示例性的,如图30所示,图30中示例性示出了根据一些实施例的又一种显示设备的用户界面示意图,该提示消息可以为当前无格式化设备,便于用户了解当前显示设备的状态。In the embodiment of the present disclosure, it is judged whether the path exists. If it exists, it means that the external storage device is currently connected to the display device. At this time, the external storage device can be uninstalled. If it does not exist, it means that the external storage device corresponding to the path is not connected to the display device at this time. In some embodiments, the display may be controlled to display a prompt message. Exemplarily, as shown in FIG. 30 , which exemplarily shows a schematic diagram of a user interface of another display device according to some embodiments, the prompt message may be that there is currently no formatted device, so that the user can understand the current display device status.
需要说明的是,本公开实施例中的卸载外接存储设备,是指外接存储设备与显示设备只是实体上的连接,此时外接存储设备与显示设备中的数据没有交互。It should be noted that the unloading of the external storage device in the embodiments of the present disclosure means that the external storage device and the display device are only physically connected, and at this time there is no interaction between the external storage device and the data in the display device.
当卸载成功后,格式化外接存储设备,并清除相应的缓存。一些实施例中,卸载成功会激发StorageEventListener事件,执行updateProgressState方法,以格式化存储设备;此时,会执行格式化操作并清除缓存。After uninstalling successfully, format the external storage device and clear the corresponding cache. In some embodiments, a StorageEventListener event will be triggered if the uninstallation is successful, and the updateProgressState method will be executed to format the storage device; at this time, the format operation will be performed and the cache will be cleared.
需要说明的是,当格式化外接存储设备后,该外接存储设备中原有存储的文件等均被 删除,相应的缓存是指在外接存储设备插入显示设备时产生的与显示设备之间产生的运行数据,本公开实施例中将该运行数据也进行删除。It should be noted that when the external storage device is formatted, the original stored files in the external storage device will be deleted, and the corresponding cache refers to the operation generated between the external storage device and the display device. In the embodiment of the present disclosure, the operation data is also deleted.
一些实施例中,在格式化外接存储设备后,如果格式化成功,则控制显示器显示格式化成功提示,示例性的如图31所示,图31中示例性示出了根据一些实施例的又一种显示设备的用户界面示意图;图31中显示有格式化成功提示。In some embodiments, after the external storage device is formatted, if the format is successful, the display is controlled to display a prompt that the format is successful, as shown in FIG. 31 . FIG. 31 exemplarily shows another A schematic diagram of a user interface of a display device; Fig. 31 shows a prompt of successful formatting.
以上内容详细介绍了如何判断显示设备中是否存在外接存储设备转换得到的内置存储设备。下面介绍关于电源管理模块持有锁的相关内容。The above content introduces in detail how to determine whether there is a built-in storage device converted from an external storage device in the display device. The relevant content about the lock held by the power management module is introduced below.
本公开实施例中,电源锁管理模块(wakelockManager)持有锁主要是通过电源管理(powermanager)服务来实现,具体的,电源管理服务通过调用电源管理模块创建电源锁对象,并使用该对象获得锁。In the embodiment of the present disclosure, the power lock management module (wakelockManager) holds the lock mainly through the power management (powermanager) service. Specifically, the power management service creates a power lock object by calling the power management module, and uses the object to obtain the lock .
本公开实施例中,使用对象获得的锁,还可以称之为唤醒锁(wakelock),在一些实施例中,唤醒锁是安卓系统功耗管理的一个核心机制,包括以下四类:PARTIAL_WAKE_LOCK、SCREEN_DIM_WAKE_LOCK、SCREEN_BRIGHT_WAKEIn the embodiment of the present disclosure, the lock obtained by using the object can also be called a wakelock (wakelock). In some embodiments, the wakelock is a core mechanism of Android system power management, including the following four categories: PARTIAL_WAKE_LOCK, SCREEN_DIM_WAKE_LOCK , SCREEN_BRIGHT_WAKE
_LOCK、FULL_WAKE_LOCK。当持有类型为PARTIAL_WAKE_LOCK的唤醒锁,在显示待机时,可能显示器被关闭,但其他模块一直处于运行状态,即处于假待机。本公开实施例中,具体是否在显示设备关闭时,即待机时,是否执行假待机,还需要考虑省电开关的设置情况,具体内容下文中介绍。_LOCK, FULL_WAKE_LOCK. When holding a wake lock of type PARTIAL_WAKE_LOCK, the display may be turned off during display standby, but other modules are always running, that is, in false standby. In the embodiments of the present disclosure, specifically whether to perform false standby when the display device is turned off, that is, in standby, also needs to consider the setting of the power saving switch, and the specific content will be introduced below.
本公开实施例中,假待机与真待机相对应,真待机为STR(suspend to ram,挂起到内存,又称内存待机模式)。在显示设备处于STR待机状态下,显示设备中的控制器仅控制电源电路保持对RAM和MCU的供电,而其他硬件,例如显示器、蓝牙模块、MIC模块、SOC模块等则处于掉电状态(关闭状态)。而本公开实施例中的假待机,显示器被关闭,但是其他模块一直处于运行状态。In the embodiment of the present disclosure, false standby corresponds to real standby, and real standby is STR (suspend to ram, also known as memory standby mode). When the display device is in the STR standby state, the controller in the display device only controls the power supply circuit to maintain power supply to the RAM and MCU, while other hardware, such as the display, Bluetooth module, MIC module, SOC module, etc., are in a power-down state (off state). In contrast to the false standby in the embodiment of the present disclosure, the display is turned off, but other modules are always in the running state.
S200、当电源锁模块持有锁,且省电开关的状态为开启时,执行假待机。S200. When the power lock module holds the lock and the state of the power saving switch is on, perform false standby.
本公开实施例中,显示设备的用户界面上显示有省电开关的状态控件,用户通过控制装置控制状态控件,以使省电开关的状态处于开启或者关闭。当用户通过省电开关的状态控件,选择省电开关的状态为开启时,代表用户希望显示设备在运行时可以节省用电量。当用户通过省电开关的状态控件,选择省电开关的状态为关闭时,代表用户不希望显示设备在运行时节省用电量。In the embodiment of the present disclosure, a state control of the power saving switch is displayed on the user interface of the display device, and the user controls the state control through the control device so that the state of the power saving switch is on or off. When the user selects the state of the power saving switch as ON through the state control of the power saving switch, it means that the user wishes to save power consumption when the display device is running. When the user selects the state of the power saving switch as off through the state control of the power saving switch, it means that the user does not want the display device to save power consumption during operation.
示例性的,如图32所示,图32示出了根据一些实施例的又一种显示设备的用户界面示意图,图32中显示有省电开关的状态控件。用户可以通过控制装置调节省电开关的状态控件,使省电开关的状态处于开启或者关闭。在图32中的省电开关的状态为关闭状态时,用户可以通过控制装置将焦点移动到省电开关的状态控件上,并按压控制装置上的确认键,或者按压右键,切换省电开关的状态为开启状态。如图33所示,图33中示例性示出了根据一些实施例的又一种显示设备的用户界面示意图,在图33中省电开关的状态为开启状态。当省电开关的状态为开启状态时,按压控制装置上的确认键,或者按压左键,切换省电开关的状态为关闭状态,再次参阅图32的省电开关,该省电开关的状态为关闭状态。Exemplarily, as shown in FIG. 32 , FIG. 32 shows a schematic diagram of a user interface of another display device according to some embodiments, and FIG. 32 shows a state control of a power saving switch. The user can adjust the state control of the power saving switch through the control device, so that the state of the power saving switch is on or off. When the state of the power saving switch in FIG. 32 is off, the user can move the focus to the state control of the power saving switch through the control device, and press the confirmation key on the control device, or press the right button to switch the power saving switch. Status is On. As shown in FIG. 33 , which exemplarily shows a schematic diagram of a user interface of another display device according to some embodiments. In FIG. 33 , the state of the power saving switch is on. When the state of the power-saving switch is on, press the confirmation key on the control device, or press the left button, switch the state of the power-saving switch to off, refer to the power-saving switch in Figure 32 again, the state of the power-saving switch is Disabled.
一些实施例中,当省电开关的状态处于开启状态,且电源锁模块持有锁,电源管理服务器(PMS)永久不会释放锁,从而实现假待机的目标。In some embodiments, when the state of the power saving switch is on and the power lock module holds the lock, the power management server (PMS) will never release the lock, so as to achieve the goal of false standby.
当显示设备中存在由外接存储设备转换得到的内置存储设备,电源锁模块持有锁,由于相关技术中在显示设备执行真待机后,未释放安装在由外接存储设备转换为内置存储设备中应用所持有的文件的句柄,本公开实施例中,通过持有锁的设置,且省电开关的状态为开启时,可以保证显示设备在接收到关机指令后,不会进入真待机,而是执行假待机,这样不会重复获取应该所持有的文件的句柄,避免造成显示设备死机以及应用闪退的问题。When there is a built-in storage device converted from an external storage device in the display device, the power lock module holds the lock. In the related art, after the display device performs true standby, it is not released and installed in the conversion from an external storage device to a built-in storage device. The handle of the file held, in the embodiment of the present disclosure, through the setting of the holding lock and the state of the power saving switch is turned on, it can be ensured that the display device will not enter the true standby after receiving the shutdown command, but Perform false standby, so that the handle of the file that should be held will not be obtained repeatedly, so as to avoid the problem of display device crash and application crash.
本公开实施例中,一方面,将外接存储设备转换为内置存储设备,节省了显示设备原有的内置存储空间,另一方面解决了应用安装在由外接存储设备转换得到的内置存储设备中运行可能出现卡机或者闪退的问题,便于用户能够非常顺利的启动并使用应用,提升操作实时性,为用户使用显示设备带来巨大便利。In the embodiment of the present disclosure, on the one hand, the external storage device is converted into a built-in storage device, which saves the original built-in storage space of the display device; There may be a problem of stuck or crashing, so that users can start and use the application very smoothly, improve the real-time operation, and bring great convenience to users when using display devices.
上述实施例中,一种投屏方法及显示设备,该方法通过执行假待机,以使显示设备开机并运行应用时,不再重新获取应用对应的句柄,这样显示设备中只存在原有未释放的句柄,不会造成显示设备死机或者应用闪退等问题。该方法包括:接收显示设备关机指令,确定电源锁管理模块是否持有锁,以及,获取省电开关的状态,其中当显示设备中存在由外接存储设备转换得到的内置存储设备时,控制电源锁模块持有锁;当电源锁模块持有锁,且省电开关的状态为开启时,执行假待机。In the above-mentioned embodiment, a screen projection method and a display device, the method implements false standby, so that when the display device starts up and runs the application, the handle corresponding to the application will not be reacquired, so that only the original unreleased handle exists in the display device. handle, which will not cause problems such as display device crashes or application crashes. The method includes: receiving a shutdown command of the display device, determining whether the power lock management module holds the lock, and acquiring the state of the power saving switch, wherein when there is a built-in storage device converted from an external storage device in the display device, controlling the power lock The module holds the lock; when the power lock module holds the lock and the state of the power saving switch is on, perform false standby.
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释本公开的内容,从而使得本领域技术人员更好的使用实施方式。For convenience of explanation, the above description has been made in conjunction with specific implementation manners. However, the above exemplary discussion is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teachings. The selection and description of the above embodiments are for better explaining the content of the present disclosure, so that those skilled in the art can use the embodiments better.

Claims (16)

  1. 一种显示设备,包括:A display device comprising:
    显示器,用于在窗口内显示图像和/或用户界面;a display for displaying images and/or user interfaces within a window;
    控制器,与所述显示器连接,所述控制器被配置为:a controller connected to the display, the controller being configured to:
    在所述显示器为被配置为开启状态的情况下,接收待机指令;receiving a standby instruction when the display is configured to be on;
    响应于所述待机指令,关闭所述显示器;turning off the display in response to the standby instruction;
    将主芯片断电,并保持语音芯片通电,以将所述显示设备调整为待机状态,其中,在所述待机状态下,所述语音芯片用于执行第一唤醒服务,所述第一唤醒服务是指识别用户发送的唤醒指令,并响应于所述唤醒指令指示所述主芯片上电启动,所述唤醒指令是指包含唤醒词的语音数据。Power off the main chip, and keep the voice chip powered on, so as to adjust the display device to a standby state, wherein, in the standby state, the voice chip is used to perform a first wake-up service, and the first wake-up service It refers to recognizing a wake-up instruction sent by a user, and instructing the main chip to be powered on and started in response to the wake-up instruction, and the wake-up instruction refers to voice data containing a wake-up word.
  2. 根据权利要求1所述的显示设备,所述控制器将主芯片断电,并保持语音芯片通电,以将所述显示设备调整为待机状态,被配置为:According to the display device according to claim 1, the controller powers off the main chip and keeps the voice chip powered on, so as to adjust the display device to a standby state, and is configured as:
    判断是否存在带有锁标志的目标应用程序,所述锁标志用于指示相应的应用程序处于运行状态;Judging whether there is a target application program with a lock flag, the lock flag is used to indicate that the corresponding application program is in a running state;
    如果存在所述目标应用程序,则等待所述目标应用程序运行完毕,并在所述目标应用程序运行完毕后,消除所述锁标志,将所述主芯片断电;If the target application program exists, wait for the target application program to finish running, and after the target application program finishes running, remove the lock flag and power off the main chip;
    如果不存在所述目标应用程序,则将所述主芯片断电。If the target application program does not exist, the main chip is powered off.
  3. 根据权利要求2所述的显示设备,所述控制器将所述主芯片断电,被配置为:According to the display device according to claim 2, the controller powers off the main chip, and is configured to:
    将内核层中的各个内核模块调整为休眠状态,所述内核模块的休眠状态是指所述内核模块断电;Each kernel module in the kernel layer is adjusted to a sleep state, and the sleep state of the kernel module refers to that the kernel module is powered off;
    将用户空间调整为冻结状态,所述用户空间的冻结状态是指所述用户空间不响应应用程序的数据读写任务;Adjusting the user space to a frozen state, the frozen state of the user space means that the user space does not respond to the data read and write tasks of the application program;
    将所述主芯片调整为休眠状态,所述主芯片的休眠状态是指所述主芯片断电。The main chip is adjusted to be in a dormant state, and the dormant state of the main chip means that the main chip is powered off.
  4. 根据权利要求1所述的显示设备,包括:The display device according to claim 1, comprising:
    在所述显示器为待机状态且被配置为关闭状态的情况下,所述显示设备的主芯片断电、语音芯片通电,所述控制器还被配置为:When the display is in the standby state and is configured to be off, the main chip of the display device is powered off and the voice chip is powered on, and the controller is further configured to:
    通过所述语音芯片执行第一唤醒服务,所述第一唤醒服务是指识别用户发送的唤醒指令,并响应于所述唤醒指令指示所述主芯片上电启动,所述唤醒指令是指包含唤醒词的语音数据;Execute the first wake-up service through the voice chip, the first wake-up service refers to recognizing the wake-up command sent by the user, and instructing the main chip to be powered on in response to the wake-up command, the wake-up command refers to including wake-up speech data of words;
    在所述主芯片上电启动之后,通过所述主芯片执行语音应用中的第二唤醒服务和语音服务,所述第二唤醒服务是指识别并响应所述用户发送的所述唤醒指令,所述语音服务是指识别并响应所述用户发送的语音指令,所述语音指令是指包含指示信息的语音数据,其中,所述语音服务还包括,基于所述语音指令的类别,确定所述显示器的显示状态,所述显示状态为开启状态或者关闭状态。After the main chip is powered on and started, the main chip executes the second wake-up service and the voice service in the voice application, the second wake-up service refers to recognizing and responding to the wake-up instruction sent by the user, so The voice service refers to recognizing and responding to the voice instruction sent by the user, and the voice instruction refers to voice data containing instruction information, wherein the voice service also includes, based on the category of the voice instruction, determining the The display state of , the display state is an on state or an off state.
  5. 根据权利要求4所述的显示设备,所述控制器通过语音芯片执行第一唤醒服务,被配置为:According to the display device according to claim 4, the controller executes the first wake-up service through the voice chip, and is configured to:
    接收所述用户发送的语音数据;receiving voice data sent by the user;
    识别所述语音数据中是否包含所述唤醒词;identifying whether the wake-up word is included in the voice data;
    如果包含所述唤醒词,则确定所述语音数据是所述唤醒指令,并响应于所述唤醒指令,指示所述主芯片上电启动;If the wake-up word is included, it is determined that the voice data is the wake-up instruction, and in response to the wake-up instruction, instruct the main chip to be powered on;
    如果不包含所述唤醒词,则丢弃所述语音数据。If the wake-up word is not included, the voice data is discarded.
  6. 根据权利要求4所述的显示设备,所述控制器通过语音芯片执行第一唤醒服务,被配置为:According to the display device according to claim 4, the controller executes the first wake-up service through the voice chip, and is configured to:
    响应于所述唤醒指令,指示所述主芯片上电启动,以将内核层中的各个内核模块调整为开机模式,并将用户空间调整为解冻模式,其中,所述内核模块的开机模式是指所述内核模块上电启动,所述解冻模式是指所述用户空间响应应用程序的数据读写任务。In response to the wake-up instruction, instruct the main chip to be powered on, so as to adjust each kernel module in the kernel layer to a boot mode, and adjust the user space to a defrost mode, wherein the boot mode of the kernel module refers to The kernel module is powered on and started, and the unfreezing mode refers to that the user space responds to the data read and write tasks of the application program.
  7. 根据权利要求4所述的显示设备,在所述主芯片上电启动之后,所述控制器通过 所述主芯片执行所述语音服务,被配置为:According to the display device according to claim 4, after the main chip is powered on and started, the controller executes the voice service through the main chip, and is configured as:
    基于所述语音指令中的指示信息,确定所述语音指令的类别,其中,响应于第一类别的语音指令开启所述显示器,响应于第二类别的语音指令关闭所述显示器;determining the category of the voice command based on the indication information in the voice command, wherein the display is turned on in response to a voice command of the first category, and the display is turned off in response to a voice command of the second category;
    基于所述第一类别的语音指令,生成第一标识,基于所述第二类别的语音指令,生成第二标识;generating a first identifier based on the voice instruction of the first category, and generating a second identifier based on the voice instruction of the second category;
    基于所述第一标识,开启所述显示器,或者,基于所述第二标识,关闭所述显示器。Based on the first identification, the display is turned on, or based on the second identification, the display is turned off.
  8. 根据权利要求7所述的显示设备,所述控制器基于所述第一标识,开启所述显示器,被配置为:According to the display device according to claim 7, the controller turns on the display based on the first identification, and is configured to:
    基于所述第一标识,开启所述显示器,并将窗口设置为活动状态,所述活动状态是指所述窗口可操作,以响应于非开机指令,显示对应的用户界面;Based on the first identifier, turn on the display, and set the window to an active state, where the active state means that the window is operable to display a corresponding user interface in response to a non-startup command;
    将所述语音应用标记锁标志,以指示所述语音应用处于运行状态,禁止将所述显示设备调整为所述待机状态;Marking the voice application with a lock sign to indicate that the voice application is in a running state, and prohibiting the display device from being adjusted to the standby state;
    所述控制器基于所述第二标识,关闭所述显示器,被配置为:The controller, based on the second identification, turns off the display, and is configured to:
    基于所述第二标识,保持关闭所述显示器,并将所述窗口设置为非活动状态,所述非活动状态是指所述窗口不可操作,以不响应于所述非开机指令;Based on the second identification, keep turning off the display, and set the window to an inactive state, where the inactive state means that the window is inoperable so as not to respond to the non-power-on instruction;
    等待指定时间之后,将所述显示设备调整为所述待机状态,其中,所述语音应用不带有所述锁标志。After waiting for a specified time, the display device is adjusted to the standby state, wherein the voice application does not have the lock symbol.
  9. 根据权利要求1~8任一项所述的显示设备,所述控制器还被配置为:According to the display device according to any one of claims 1-8, the controller is further configured as:
    接收显示设备关机指令,确定电源锁管理模块是否持有锁,以及,获取省电开关的状态,其中当显示设备中存在由外接存储设备转换得到的内置存储设备时,控制电源锁模块持有锁;当电源锁模块持有锁,且所述省电开关的状态为开启时,执行假待机。Receive the shutdown command of the display device, determine whether the power lock management module holds the lock, and obtain the state of the power saving switch, wherein when there is a built-in storage device converted from an external storage device in the display device, control the power lock module to hold the lock ; When the power lock module holds the lock, and the state of the power saving switch is on, perform false standby.
  10. 根据权利要求9所述的显示设备,所述控制器,被配置为按照下述步骤执行确定显示设备中是否存在由外接存储设备转换得到的内置存储设备:According to the display device according to claim 9, the controller is configured to determine whether there is a built-in storage device converted from an external storage device in the display device according to the following steps:
    获取显示设备中所有存储设备的设备信息,所述设备信息包括设备标识和设备类型;Acquire device information of all storage devices in the display device, where the device information includes device identifiers and device types;
    当所述设备标识指示存在与显示设备连接的外界存储设备,且所述设备类型为私有类型时,确定显示设备中存在由外接存储设备转换得到的内置存储设备。When the device identifier indicates that there is an external storage device connected to the display device, and the device type is a private type, it is determined that there is a built-in storage device converted from the external storage device in the display device.
  11. 根据权利要求10所述的显示设备,所述控制器,被配置为按照下述步骤执行确定所述设备标识是否指示存在与显示设备连接的外界存储设备:The display device according to claim 10, the controller is configured to determine whether the device identifier indicates that there is an external storage device connected to the display device according to the following steps:
    所述设备标识包括设备标识符和通用唯一识别码;The device identification includes a device identifier and a universal unique identification code;
    判断所述设备标识符是否为空,如果所述设备标识符不为空,则判断所述通用唯一识别码是否为空;如果所述通用唯一识别码不为空,则确定所述设备标识指示存在与显示设备连接的外界存储设备。Judging whether the device identifier is empty, if the device identifier is not empty, then judging whether the UUID is empty; if the UUID is not empty, then determining the device identification indication There is an external storage device connected to the display device.
  12. 根据权利要求9所述的显示设备,所述控制器,被配置为按照下述步骤中控制电源锁管理模块持有锁:利用电源管理服务,控制电源锁管理模块持有锁。According to the display device according to claim 9, the controller is configured to control the power lock management module to hold the lock according to the following steps: using the power management service to control the power lock management module to hold the lock.
  13. 根据权利要求9所述的显示设备,所述控制器,被配置为按照下述步骤执行将外接存储设备转换得到内置存储设备:According to the display device according to claim 9, the controller is configured to convert an external storage device into a built-in storage device according to the following steps:
    接收选中预设控件的指令,确定与显示设备连接的外接存储设备对应的所在路径;Receive an instruction to select a preset control, and determine the path corresponding to the external storage device connected to the display device;
    判断所述路径是否存在,如果存在,则写在外接存储设备;当卸载成功后,格式化外接存储设备,并清除相应的缓存;Determine whether the path exists, and if so, write it to the external storage device; when the uninstall is successful, format the external storage device and clear the corresponding cache;
    如果不存在,则控制显示器显示提示消息。If not present, the Control Display displays a prompt message.
  14. 一种用于显示设备的待机方法,所述方法包括:A standby method for a display device, the method comprising:
    在所述显示设备的显示器被配置为开启状态的情况下,接收待机指令;receiving a standby instruction when the display of the display device is configured to be in an on state;
    响应于所述待机指令,关闭所述显示器;turning off the display in response to the standby instruction;
    将主芯片断电,并保持语音芯片通电,以将所述显示设备调整为待机状态,其中,在所述待机状态下,所述语音芯片用于执行第一唤醒服务,所述第一唤醒服务是指识别用户发送的唤醒指令,并响应于所述唤醒指令指示所述主芯片上电启动,所述唤醒指令是指包含唤醒词的语音数据。Power off the main chip, and keep the voice chip powered on, so as to adjust the display device to a standby state, wherein, in the standby state, the voice chip is used to perform a first wake-up service, and the first wake-up service It refers to recognizing a wake-up instruction sent by a user, and instructing the main chip to be powered on and started in response to the wake-up instruction, and the wake-up instruction refers to voice data containing a wake-up word.
  15. 根据权利要求14所述的方法,所述方法还包括:The method of claim 14, further comprising:
    在所述显示设备的显示器为待机状态且被配置为关闭状态的情况下,通过所述语音芯片执行第一唤醒服务,所述第一唤醒服务是指识别用户发送的唤醒指令,并响应于所述唤醒指令指示所述主芯片上电启动,所述唤醒指令是指包含唤醒词的语音数据;其中,在所述待机状态下,所述显示设备的主芯片断电、语音芯片通电;When the display of the display device is in the standby state and is configured to be in the off state, the voice chip is used to execute the first wake-up service, the first wake-up service refers to recognizing the wake-up instruction sent by the user, and responding to the The wake-up instruction indicates that the main chip is powered on and started, and the wake-up instruction refers to voice data that includes a wake-up word; wherein, in the standby state, the main chip of the display device is powered off and the voice chip is powered on;
    在所述主芯片上电启动之后,通过所述主芯片执行语音应用中的第二唤醒服务和语音服务,所述第二唤醒服务是指识别并响应所述用户发送的所述唤醒指令,所述语音服务是指识别并响应所述用户发送的语音指令,所述语音指令是指包含指示信息的语音数据,其中,所述语音服务还包括,基于所述语音指令的类别,确定所述显示器的显示状态,所述显示状态为开启状态或者关闭状态。After the main chip is powered on and started, the main chip executes the second wake-up service and the voice service in the voice application, the second wake-up service refers to recognizing and responding to the wake-up instruction sent by the user, so The voice service refers to recognizing and responding to the voice instruction sent by the user, and the voice instruction refers to voice data containing instruction information, wherein the voice service also includes, based on the category of the voice instruction, determining the The display state of , the display state is an on state or an off state.
  16. 根据权利要求14所述的方法,所述方法还包括:The method of claim 14, further comprising:
    接收显示设备关机指令,确定电源锁管理模块是否持有锁,以及,获取省电开关的状态,其中当显示设备中存在由外接存储设备转换得到的内置存储设备时,控制电源锁模块持有锁;当电源锁模块持有锁,且所述省电开关的状态为开启时,执行假待机。Receive the shutdown command of the display device, determine whether the power lock management module holds the lock, and obtain the state of the power saving switch, wherein when there is a built-in storage device converted from an external storage device in the display device, control the power lock module to hold the lock ; When the power lock module holds the lock, and the state of the power saving switch is on, perform false standby.
PCT/CN2022/136026 2022-01-28 2022-12-01 Display device and standby method WO2023142680A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202210105112.8A CN116567785A (en) 2022-01-28 2022-01-28 Display equipment, standby method and far-field voice control method
CN202210105112.8 2022-01-28
CN202210122071.3 2022-02-09
CN202210122071.3A CN116614663A (en) 2022-02-09 2022-02-09 Method for realizing false standby and display device

Publications (1)

Publication Number Publication Date
WO2023142680A1 true WO2023142680A1 (en) 2023-08-03

Family

ID=87470323

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/136026 WO2023142680A1 (en) 2022-01-28 2022-12-01 Display device and standby method

Country Status (1)

Country Link
WO (1) WO2023142680A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111586456A (en) * 2019-12-04 2020-08-25 海信视像科技股份有限公司 Standby control method and display device
CN112037784A (en) * 2020-08-14 2020-12-04 南京创维信息技术研究院有限公司 Voice control method for display device, display device and storage medium
CN112860331A (en) * 2021-03-19 2021-05-28 Vidaa美国公司 Display device and voice interaction prompting method
CN113497959A (en) * 2020-04-03 2021-10-12 海信视像科技股份有限公司 Display system and voice wake-up starting method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111586456A (en) * 2019-12-04 2020-08-25 海信视像科技股份有限公司 Standby control method and display device
CN113497959A (en) * 2020-04-03 2021-10-12 海信视像科技股份有限公司 Display system and voice wake-up starting method
CN112037784A (en) * 2020-08-14 2020-12-04 南京创维信息技术研究院有限公司 Voice control method for display device, display device and storage medium
CN112860331A (en) * 2021-03-19 2021-05-28 Vidaa美国公司 Display device and voice interaction prompting method

Similar Documents

Publication Publication Date Title
CN111510781B (en) Display device standby control method and display device
US20160209907A1 (en) Method for performing power-saving mode in electronic device and electronic device therefor
CN111935518A (en) Video screen projection method and display device
CN112511882A (en) Display device and voice call-up method
CN111930410A (en) Display device and idle time upgrading method
CN112492371A (en) Display device
CN115562744B (en) Application program loading method and electronic device
CN114302238A (en) Method for displaying prompt message in loudspeaker box mode and display device
CN113918010A (en) Display apparatus and control method of display apparatus
CN112153440A (en) Display device and display system
WO2023142680A1 (en) Display device and standby method
CN112002321B (en) Display device, server and voice interaction method
CN112165642A (en) Display device
WO2022206392A1 (en) Application wakeup method, display device, mobile terminal and server
CN113342415B (en) Timed task execution method and display device
CN111901649B (en) Video playing method and display equipment
CN114173179A (en) Compatible execution method of system upgrading task and video recording task and display equipment
CN116567785A (en) Display equipment, standby method and far-field voice control method
CN114915810A (en) Media asset pushing method and intelligent terminal
CN114079827A (en) Menu display method and display device
CN112291600B (en) Caching method and display device
EP4258674A1 (en) Display device, video recording method, and recorded file display method
CN113782021B (en) Display equipment and prompt tone playing method
CN112259096B (en) Voice data processing method and device
CN114610349A (en) Display device and upgrading method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22923471

Country of ref document: EP

Kind code of ref document: A1