WO2021184575A1

WO2021184575A1 - Display device and display method

Info

Publication number: WO2021184575A1
Application number: PCT/CN2020/098870
Authority: WO
Inventors: 孙鲁兵
Original assignee: 聚好看科技股份有限公司
Priority date: 2020-03-19
Filing date: 2020-06-29
Publication date: 2021-09-23
Also published as: CN113495711A; CN113495711B

Abstract

Provided are a display device and a display method. The display method comprises: when a display displays a screensaver picture, receiving a speech command input by a user; when the speech command matches a preset command, maintaining the display of the screensaver picture, and displaying a feedback message corresponding to the speech command above the screensaver picture; and when the speech command does not match the preset command, cancelling the display of the screensaver picture.

Description

Display device and display method

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on March 19, 2020, the application number is 202010195696.3, and the invention title is "Display Device and Display Method", the entire content of which is incorporated into this application by reference.

Technical field

This application relates to the field of Internet technology, and in particular to a display device and a display method.

Background technique

Currently, display devices can provide users with playback screens such as audio, video, and pictures. In practical applications, if the display device does not perform video playback or does not receive user input for a long time, that is, the display device display displays the same picture for a long time, which will cause the display screen to age and shorten its service life.

In order to prolong the service life of the display screen, a screen saver application (or called a screen saver application) can be installed on the display device. When the display shows the same screen for a certain period of time, the screen application will be displayed on the top of the currently presented user interface. Multimedia screen saver files to make the monitor screen enter the screen saver state, and then achieve the purpose of protecting the screen.

In the related art, when a user input is received in the screen saver state, the screen saver state will immediately exit.

Summary of the invention

In the first aspect, some embodiments of the present application provide a display device, including: a display for screen saver; a user interface for receiving voice instructions input by a user; and a controller for:

When the display screen saves the screen, receiving a voice command input by the user;

When the voice command matches the preset command, maintaining the display of the screen saver screen, and displaying a feedback message corresponding to the voice command on the top of the screen saver screen;

When the voice instruction does not match the preset instruction, the display of the screen saver screen is cancelled.

In a second aspect, the present application provides a display device, including: a display for screen saver; a user interface for receiving voice instructions input by a user; and a controller for:

Receiving the first voice instruction input by the user;

When the display screen saver screen is displayed and the interface prompts are displayed on the screen saver screen, in response to the received first voice command, the display of the screen saver screen is maintained, and the screen saver screen is displayed on the top of the screen saver screen. A feedback message corresponding to a voice command, where the first voice command corresponds to the interface prompt;

When the display screen saver screen is displayed and the interface prompt is not displayed on the screen saver screen, in response to the received first voice command, the display of the screen saver screen is cancelled, and the interface before the screen saver screen is displayed or the first display screen is displayed. An interface corresponding to a voice command.

In a third aspect, the present application provides a display device, including: a display for presenting a screen saver screen when the display enters the screen saver state; a user interface for receiving a user's voice command; and a controller for:

When a voice command input by the user is received in the screen saver state, maintain the screen saver state, and obtain a semantic analysis result of the voice command;

Judging, according to the semantic analysis result, whether the voice instruction is a preset instruction instructing to participate in network activities;

When the voice instruction is the preset instruction, send a participation request requesting participation in the network activity to the server, and display the received participation result while maintaining the screen saver state, wherein the participation request Used to enable the server to return the participation result;

When the voice instruction is not the preset instruction, exit the screen saver state.

In a fourth aspect, the present application provides a display method applied to a display device, and the method includes:

When the display screen saver screen is displayed, the voice command input by the user is received; when the voice command matches the preset command, the display of the screen saver screen is maintained, and the feedback corresponding to the voice command is displayed at the top of the screen saver screen Message; when the voice instruction does not match the preset instruction, cancel the display of the screen saver screen.

In a fifth aspect, the present application provides a display method applied to a display device, and the method includes:

A display method applied to a display device, characterized in that the method includes:

Receive the first voice command input by the user; when the screen saver screen and the interface prompt is displayed on the screen saver screen, in response to the received first voice command, maintain the display of the screen saver screen, and A feedback message corresponding to the first voice command is displayed on the top of the screen saver screen, and the first voice command corresponds to the interface prompt; when the screen saver screen does not display the interface prompt on the screen saver screen, In response to the received first voice command, the display of the screen saver screen is cancelled, and the interface before the screen saver screen is displayed or the interface corresponding to the first voice command is displayed.

In a sixth aspect, the present application provides a display method applied to a display device, and the method includes:

When the voice command input by the user is received in the screen saver state, the screen saver state is maintained, and the semantic analysis result of the voice command is obtained; when the voice command input by the user is received in the screen saver state, the screen saver state is maintained, And obtain the semantic analysis result of the voice instruction; determine whether the voice instruction is a preset instruction indicating participation in network activities according to the semantic analysis result; when the voice instruction is the preset instruction, send it to the server A participation request to request participation in the network activity, and display the received participation result while maintaining the screen saver state, the participation request is used to make the server return the participation result; when the voice command is not When the preset instruction is executed, exit the screen saver state.

Description of the drawings

In order to explain the technical solution of the present application more clearly, the following will briefly introduce the drawings needed in the embodiments. For those of ordinary skill in the art, they can also be based on These drawings acquire other drawings.

Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment;

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the embodiment;

Fig. 3 exemplarily shows a block diagram of the hardware configuration of the control device 100 according to the embodiment;

FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to the embodiment;

FIG. 5 exemplarily shows a schematic diagram of the software configuration in the display device 200 according to the embodiment;

FIG. 6 exemplarily shows a schematic diagram of the configuration of an application program in the display device 200 according to the embodiment;

FIG. 7 exemplarily shows a schematic diagram of a user interface in the display device 200 according to the embodiment;

Fig. 8a exemplarily shows the program picture presented by the display of the display device;

Fig. 8b exemplarily shows the user interface presented by the display of the display device;

Fig. 9 exemplarily shows the screen of the screen saver file presented on the display of the display device;

FIG. 10 exemplarily shows a voice search interface presented by a display device display;

FIG. 11 exemplarily shows the user interface presented by the display of the display device;

FIG. 12 exemplarily shows a user interface presented by the display of the display device;

FIG. 13 exemplarily shows a user interface presented by the display of the display device;

FIG. 14 exemplarily shows the screen of the screen saver file presented on the display of the display device;

FIG. 15 exemplarily shows the screen of the screen saver file presented on the display of the display device;

The flowchart of the display method is exemplarily shown in FIG. 16;

FIG. 17 exemplarily shows a flow chart of the display method;

FIG. 18 exemplarily shows the screen of the screen saver file presented on the display of the display device.

Detailed ways

In order to make the purpose and technical solutions of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the exemplary embodiments of the present application. Obviously, The described exemplary embodiments are only a part of the embodiments of the present application, rather than all the embodiments.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application. In addition, although the disclosure in this application is introduced in accordance with one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete technical solution.

It should be understood that the terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or Priority. It should be understood that the data used in this way can be interchanged under appropriate circumstances, for example, it can be implemented in a sequence other than those given in the illustration or description of the embodiments of the present application.

In addition, the terms "including" and "having" and any variations of them are intended to cover but not exclusively include. For example, a product or device including a series of components need not be limited to those clearly listed, but may include Other components not clearly listed or inherent to these products or equipment.

The term "module" used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.

The term "remote control" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually be controlled wirelessly within a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect to electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

Wherein, the control device 100 may be a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 through wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices can also be used to control the display device 200. For example, an application program running on a smart device is used to control the display device 200. The application can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

In some embodiments, the mobile terminal 300 can install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 300 can be used to establish a control command protocol with the display device 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to realize the synchronous display function.

As also shown in FIG. 1, the display device 200 also performs data communication with the server 400 through multiple communication methods. The display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. In some embodiments, the display device 200 transmits and receives information, interacts with an electronic program guide (EPG), receives software program updates, or accesses a remotely stored digital media library. The server 400 may be one group or multiple groups, and one type or multiple types of servers may be used. The server 400 provides other network service content such as video-on-demand and advertising services.

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the display device 200 can be changed in performance and configuration as required.

In addition to providing the broadcast receiving TV function, the display device 200 may additionally provide a smart network TV function with a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and so on.

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 2, the display device 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, and an audio processor 60-2, At least one of a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

The display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images, and a component of the menu control interface. The display 280 includes a display screen component for presenting a picture, and a driving component for driving image display. Display video content, it can come from broadcast TV content, or it can be a variety of broadcast signals that can be received through wired or wireless communication protocols. Or, it can display various image content received from the network server side from the network communication protocol.

At the same time, the display 280 simultaneously displays a user manipulation UI interface generated in the display device 200 and used to control the display device 200.

And, depending on the type of the display 280, it also includes a driving component for driving the display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

The communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communication interface 230 may be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown in the figure).

The display device 200 may establish control signal and data signal transmission and reception with an external control device or content providing device through the communication interface 230. And, the infrared receiver is an interface device that can be used to receive infrared control signals of the control device 100 (such as an infrared remote control, etc.).

The detector 240 is used by the display device 200 to collect signals from the external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes and the like by collecting ambient light.

And including image collector 241, such as camera, camera, etc., can be used to collect external environment scenes, as well as to collect user attributes or interact with user gestures, can adaptively change display parameters, can also recognize user gestures to achieve The function of interaction between users.

In some other exemplary embodiments, the detector 240 may also be a temperature sensor or the like. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the display device 200 can be adjusted to display a colder image color temperature, or when the temperature is relatively low, the display device 200 can be adjusted to display a warmer image.

In some other exemplary embodiments, the detector 240 can also be a sound collector, such as a microphone, which can be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sounds, using In order to identify the environmental scene type, the display device 200 can adaptively adapt to the environmental noise.

The input/output interface 250 transmits data between the control display device 200 of the controller 210 and other external devices. Such as receiving data such as video signals and audio signals from external devices, or commands and instructions.

The input/output interface 250 may include, but is not limited to, the following: a high-definition multimedia interface HDMI interface 251, an analog or data high-definition component input interface 253, a composite video input interface 252, a USB input interface 254, and an RGB port (not shown in the figure) Out) Wait for any one or more interfaces.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the aforementioned multiple interfaces.

The tuner and demodulator 220 receives broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate the frequency of the television channel selected by the user from multiple wireless or cable broadcast television signals The TV audio and video signals and EPG data signals carried in the.

The tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV signal frequency selected by the user and the TV signal carried by the frequency.

The tuner and demodulator 220 can receive signals according to different TV signal broadcasting formats, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals; and according to different modulation types, it can be digitally modulated, or The modulation method can be simulated. According to the different types of received TV signals, analog signals and digital signals can be used.

In some other exemplary embodiments, the tuner and demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them into the display device 200 through the input/output interface 250.

The video processor 260-1 is used to receive external video signals and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., according to the standard codec protocol of the input signal, A signal that can be directly displayed or played on the display device 200 can be obtained.

In some embodiments, the video processor 260-1 includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate, and the usual format is realized by inserting a frame.

The display formatting module is used to convert the video output signal after the received frame rate is converted, and change the signal to conform to the signal of the display format, such as outputting RGB data signals.

The audio processor 260-2 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be played in the speaker Sound signal.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the controller 210 in one or more chips.

The audio output 272 receives the sound signal output by the audio processor 260-2 under the control of the controller 210, such as a speaker 272, and other than the speaker 272 carried by the display device 200, it can be output to the generator of an external device External audio output terminal 274, such as: external audio interface or headphone jack, etc.

The power supply, under the control of the controller 210, provides power supply support for the display device 200 with power input from an external power supply. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be an external power supply installed in the display device 200, and a power interface for providing an external power supply in the display device 200.

The user input interface is used to receive user input signals, and then send the received user input signals to the controller 210. The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

In some embodiments, the user inputs user commands through the remote controller 100 or the mobile terminal 300, the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 210.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

The controller 210 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory 290.

As shown in FIG. 2, the controller 210 includes RAM 213 and ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, such as a first interface 218-1 to an nth interface 218-n, and a communication bus. Among them, the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a bus.

ROM213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 213 to start the start-up of the operating system. After the operating system is started up, the CPU processor 212 copies various application programs in the memory 290 to the RAM 213, and then starts to run and start various application programs.

The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display 280.

The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used for an operation in a state such as standby mode.

The controller 210 may control the overall operation of the display device 100. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

The memory 290 includes storing various software modules used to drive the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Among them, the basic module is used for signal communication between various hardware in the postpartum care display device 200, and the underlying software module that sends processing and control signals to the upper module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.

For example: the voice recognition module includes a voice parsing module and a voice command database module. The display control module is a module for controlling the display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is used to provide various services and modules including various applications.

At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.

Fig. 3 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in FIG. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, so as to serve as an intermediary between the user and the display device 200. For example, the user operates the channel addition and subtraction key on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1, the mobile terminal 300 or other smart electronic device can perform a similar function to control the device 100 after installing an application that controls the display device 200. For example, the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 300 or other smart electronic devices by installing applications to realize the function of controlling the physical keys of the device 100.

The controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as communication and cooperation between internal components, and external and internal data processing functions.

The communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the received user input signal is sent to the display device 200. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip, a Bluetooth module, and an NFC module.

The user input/output interface 140, wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal and the digital signal into a corresponding instruction signal, and sends it to the display device 200.

The output interface includes an interface for sending the received user instruction to the display device 200. In some embodiments, it may be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and then sent to the display device 200 via the infrared sending module. For another example, in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is configured with a communication interface 130, such as WiFi, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WiFi protocol, or Bluetooth protocol, or NFC protocol encoding.

The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 200 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. Can battery and related control circuit.

FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 4, the memory 290 is used to store an operating system, application programs, content, user data, etc., and executes the system operation of driving the display device 200 and responds to various operations of the user under the control of the controller 210. The memory 290 may include volatile and/or non-volatile memory.

The memory 290 is used to store the operating program that drives the controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and various graphical user interfaces related to the application , And various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.

The memory 290 is used to store driver programs and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input/output interface of the detector 240.

In some embodiments, the memory 290 may store software and/or programs. The software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller , In order to achieve control or management of system resources.

In some embodiments, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, and a communication control module 2908 , At least one of a light receiving module 2909, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module, and so on. The controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.

FIG. 5 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.

As shown in FIG. 5, the operating system 2911 includes operating software for processing various basic system services and performing hardware-related tasks, and serves as a medium for data processing completed between application programs and hardware components. In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. In some embodiments, it includes a display screen, a camera, Flash, WiFi, and an audio driver.

Among them, the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.

The communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects for displaying the user interface, which can be accessed by various applications and can realize user operability.

The control application 2911-4 is used for controllable process management, including runtime applications.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand and in the application program 2912 at the same time to monitor various user input events. , Will implement one or more sets of pre-defined operation processing procedures according to the recognition results of various events or sub-events in response to various events.

Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.

The event recognition module 2914-1 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute the corresponding one or more sets of processing programs .

The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.). Such as: various sub-events of voice input, gesture input of gesture recognition, and sub-events of remote control button command input for controlling equipment, etc. In some embodiments, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of up/down/left-right/, confirm key, and key press. And the operations of non-physical buttons, such as moving, pressing, and releasing.

The interface layout manager 2913 directly or indirectly receives the user input events or sub-events monitored by the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of the controls or sub-controls in the interface, and the container The size or position, level, etc. of the interface are related to the various execution operations of the interface layout.

As shown in FIG. 6, the application layer 2912 contains various application programs that can also be executed on the display device 200. The application program may include, but is not limited to, one or more application programs, such as at least one of a live TV application, a video-on-demand application, a media center application, an application center, and a game application.

Live TV applications can provide live TV through different sources. For example, a live TV application can provide a TV signal using input from cable TV, wireless broadcasting, satellite services, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200.

Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.

Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.

Application center, can provide storage of various applications. The application program may be a game, an application program, or some other application program that is related to a computer system or other equipment but can be run on a smart TV. The application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.

FIG. 7 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 7, the user interface includes a plurality of view display areas. In some embodiments, the first view display area 201 and a play screen 202, where the play screen includes the layout of one or more different items. And the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.

It should be noted that multiple view display areas can present display screens of different levels. For example, the display area of the first view may present the content of the video chat item, and the display area of the second view may present the content of the application layer item (eg, webpage video, VOD display, application screen, etc.).

In some embodiments, the presentation of different view display areas has different priorities, and the display priorities of the view display areas are different between view display areas with different priorities. For example, the priority of the system layer is higher than the priority of the application layer. When the user uses the acquisition selector and screen switching in the application layer, the screen display in the view display area of the system layer is not blocked; and the application layer is enabled according to the user's choice. When the size and position of the view display area change, the size and position of the view display area of the system layer will not be affected.

The same level of display screen can also be presented. At this time, the selector can switch between the display area of the first view and the display area of the second view, and when the size and position of the display area of the first view change, the second view The size and position of the display area can be changed at any time.

In some embodiments, any area in FIG. 7 may display a picture obtained by a camera.

In some embodiments, the display device of the present application may not be the display device listed in the foregoing embodiments, but may be other display devices that can implement the solution of the present application.

Fig. 8a is a program screen exemplarily shown in an embodiment of the application, and Fig. 8b is a user interface exemplarily shown in an embodiment of the application. When the monitor displays the same program picture or the user interface for too long, it will cause the screen to deteriorate, which is not conducive to its service life.

In order to prevent the monitor from displaying the same program screen or the same user interface for a long time, when the time for the monitor to display the same playback screen reaches a preset value, the screen saver file is displayed on the monitor immediately, thereby achieving the purpose of protecting the screen.

4, an application 3912 or an application 2912 is stored in the memory 390 or the memory 290, and the application 3912 or the application 2912 includes a screen saver (screen saver, not shown in the figure), and the controller runs the screen saver application , To count the static time of the monitor screen (the time to display the same playback picture), when the static time reaches the preset value, read the screen saver file (such as picture file) pre-stored in the memory, and the video processor will read it The screen saver file is processed to obtain the image signal for display, and the image signal is output to the display through the output interface, and then, the screen of the screen saver file is displayed on the upper layer of the screen currently displayed on the display, that is, the screen saver screen.

In some embodiments, the screen saver image refers to an image file displayed in a locked screen state (screen saver state), so as to avoid pixel attenuation caused by pixels maintaining the same content for a long time.

In some embodiments, the screen saver picture refers to an image file used to display on the display during the operation of the screen saver.

For example, the screen saver picture on the upper layer of the picture shown in FIG. 8a or 8b, and then the screen saver picture shown in FIG. 9 is obtained. For the convenience of description, when the display shows the program screen or user interface as shown in Fig. 8a or 8b, the display screen is in the non-screensaver state, and when the display shows the screen saver picture as shown in Fig. 9, the display screen is in the screen saver state.

In some embodiments, when the screen of the display screen saver file (such as an image file) is in the screen saver state, the screen saver application is a foreground application running in the foreground.

Among them, the foreground application may refer to the application that presents the interface displayed to the user. For example, if the interface displayed on the display is the A application, then the A application is the foreground application. If the user triggers the B application through the remote control device at this time, the display If the interactive interface of the B application is displayed, the B application is the foreground application. The switching of the foreground application may be when the user uses the A application, the display device automatically or controlled start the B application, and the content displayed on the display is switched from the interactive interface corresponding to the A application to the corresponding B application interactive interface.

When the display shows the screen saver screen as shown in FIG. 9, that is, in the screen saver state, the user can input control instructions to the controller by operating the control device 100. For example, the user can use the volume up and down keys, channel control keys, and up /Down/Left/Right mobile buttons, voice input buttons, menu keys, etc. input corresponding control instructions. In response to some or all of the control instructions input by the user, the controller will cancel the display of the screen saver file to exit the screen saver state, and then Return to the interface shown in Figure 8a or 8b.

In some embodiments, the controller exits the screen saver state in response to any control command input by the user. At the same time, the controller executes the user by running other programs (such as application layer programs, middleware programs, and/or kernel layer programs). Enter the corresponding operation.

In some embodiments, when the display shows the screen saver screen as shown in FIG. 9, the user can press the voice input button on the remote control to input a voice command, and the controller responds to the voice command to cancel the screen saver file to make The screen exits the screen saver state and controls the display of the voice search interface as shown in Figure 10.

In other embodiments, the controller presents a corresponding interface in response to a preset control command input by the user. For example, to enter the screen saver setting interface, the user can press the down arrow key on the remote control to input the screen saver to change. The control instruction of the picture, the controller responds to the control instruction, while maintaining the screen saver state, at the upper layer of the currently displayed screen saver picture, it displays the selectable screen saver picture as shown in FIG. 11. The controller exits the screen saver state in response to other control instructions other than the preset control instructions input by the user.

As can be seen from the above example, when the screen saver screen is displayed, if the user inputs a user input instruction including a voice command through the user interface, the screen saver state exit will be triggered, so that the user cannot continue to enjoy the screen saver. If you want to continue to enjoy the screen saver The screen needs to wait for a certain amount of time or perform some tedious operations.

In order to solve the above problems, in some embodiments of the present application, a voice command (preset command for short) that does not need to exit the screen saver state is preset and stored in the voice recognition module or voice server. When the preset command is received in the screen saver state When the time, the display device maintains the screen saver state, performs the corresponding operation of the preset instruction in the background, and displays the feedback message obtained from the operation on the screen saver screen, such as the Toast prompt shown in Figure 18 ("Congratulations, you have signed up for the event) "). Furthermore, the user can not only control the display device through voice input to realize quick operation on the display device, but also maintain the screen saver state without exiting, and continue to enjoy the screen saver picture.

In some embodiments, when the display shows the screen saver screen as shown in Figure 8b, if the controller receives a voice command input by the user through the control device or using the far-field voice function of the display device, the controller maintains the screen saver state and will receive The received voice command is sent to the voice server or the voice recognition module for analysis, and the semantic analysis result returned by the voice server or the voice recognition module is obtained. Then the controller determines whether the voice instruction matches the preset instruction by judging whether the voice analysis result matches the interface prompt corresponding to the preset instruction, and continues to maintain the display of the screen saver screen when the voice instruction matches the preset instruction , That is, the screen saver state is maintained, and the feedback message corresponding to the voice command is displayed in a floating layer above the screen saver screen. When the voice command does not match the preset command, the display of the screen saver screen is cancelled and the screen saver state is exited , Displaying the operation result corresponding to the voice instruction on the user interface or giving feedback indicating that the voice instruction cannot be recognized. The technical solution of the present application will be described in detail below in conjunction with specific examples.

In some embodiments, on the user interface as shown in FIG. 8b, interface elements for participating in/signing up for network activities can be displayed. The aforementioned network activities may be network sweepstakes, reservation activities, red envelope grabbing activities, etc., the aforementioned interface Elements can be clickable controls used to trigger processing such as page jumps. For example, as shown in Figure 12, clickable controls for participating in the "July ** 3rd Anniversary Lottery" are displayed on the user interface.

When the display shows the interface as shown in Figure 12, the user can click on the above controls by operating the control device. The controller responds to the click input by the user and jumps to the active page shown in Figure 13, as shown in Figure 13. On the activity page, the user operates the control device again and clicks the button "sign up activity" on the activity page for participating in the activity. The controller responds to the user's input and requests the server to participate in the network activity.

It can be seen from the above example that if a user wants to participate in the network activity displayed on the screensaver interface, the control device needs to be operated multiple times, and the user needs to go through processes such as page jumps that cause the user to wait, making the registration process for the network activity not fast enough. Conducive to user experience.

In order to solve the above-mentioned problem, in some embodiments of the present application, a voice instruction for instructing to participate in network activities can be used as the above-mentioned preset instruction without exiting the screen saver state. In this way, the user can input for instructions by controlling the operating device. The voice command for participating in the network activity is sent to the controller, and the controller responds to the voice command, while maintaining the screen saver, it sends a participation request to the server to request participation in the network activity, that is, the user’s registration process is executed, and the voice shortcut is realized Sign up and display the received participation results while maintaining the screensaver status.

As described in the above example, the preset instructions can have corresponding interface prompts, which can be displayed on the screen saver screen, so that when the display screen saves the screen, the user can input the corresponding prompts according to the interface prompts on the display screen. Preset instructions. For example, in some embodiments, related information about network activities and interface prompts for participating in the network interaction can be displayed on the screen saver. Furthermore, the user can follow the prompts of the interface prompts and input the prompts for participating in the network. Active voice commands. For example, as shown in Figure 14, the screen saver screen displays "! Voice speaks for the 3rd anniversary of the gathering to sign up for the lucky draw". It should be noted that the interface prompt can be the text contained in the screensaver file, or it can be the text displayed in the upper transparent layer of the screensaver file.

In some embodiments, the interface prompt is an inherent part of the image file corresponding to the screensaver screen, that is, the image file with the interface prompt is a promotional poster specially made for the network event, and the interface prompt is used as an image file Part and image files are displayed on the same layer of the screen saver screen.

In some embodiments, the interface prompt is a newly generated part on the screensaver screen according to the publicity requirements, that is, the image file is a conventional screensaver picture. When the image file is displayed, in response to the need to display the activity prompt, the controller controls The monitor draws a new floating layer above the layer where the image file is located to display the interface prompts. The layer where the interface prompts is located is above the layer where the image file is located. At this time, the interface prompts and the image file are both used as the screen saver for the cycle Sexual display (that is, the interface prompts switch with the switch of image files). This kind of setting does not require a promotional poster specially made for the network activity, which is conducive to improving the efficiency of the system.

It can be seen from the above example that if the display device receives a voice instruction instructing to participate in network activities in the screen saver state, it can maintain the screen saver state without exiting, and perform the operation corresponding to the voice instruction in the background, so that the user can continue to enjoy The screen saver screen, at the same time, you can get the operation result corresponding to the voice command, that is, the participation result that indicates whether the activity is successful or not.

In some embodiments, the preset instruction may have a corresponding validity period. For example, the validity period of a voice command used to participate in a network activity is the holding period of the network activity. Correspondingly, the interface prompts corresponding to the preset instructions are only displayed on the screensaver screen during the validity period. For example, during the network event, the interface prompts used to participate in the network interaction are displayed on the screensaver screen, after the event ends. , The screen saver file with the prompt language of this interface will not be displayed. Among them, the preset instruction corresponds to the interface prompt, and the validity period of the preset instruction is the validity period of the interface prompt. For specific implementation, it can be achieved by updating the screen saver file.

Based on the above embodiments, in some embodiments of the present application, if and only when the display screen saver screen is displayed and the screen saver screen displays the interface prompt corresponding to the first voice command, respond to the reception of the first voice command , To maintain the display of the screen saver screen, and display the feedback message corresponding to the first voice command on the top of the screen saver screen to ensure that the display device is only available within the validity period of the interface prompt/first voice command (preset command) Quick operation, to avoid the user from misoperation of the display device outside the validity period of the interface prompt/first voice command (preset command). For example, if and only if the display screen saver screen and the screen saver screen has interface prompts for participating in network activities, in response to receiving the voice command for participating in network activities, the display of the screen saver screen is maintained, and the screen saver screen is displayed on the screen saver screen. The participation result is displayed on the screen.

Further, in the above embodiment, when the screen saver screen is displayed and the interface prompt corresponding to the first voice command is not displayed on the screen saver screen, in response to receiving the first voice command, the display of the screen saver screen is cancelled to exit the screen saver State, and display the interface before entering the screen saver state or display the interface corresponding to the first voice command. In this way, it is possible to avoid misoperation of the display device outside the validity period of the interface prompt/preset instruction.

For example, the controller cancels the display of the screen saver screen in response to the received first voice instruction; when the operation corresponding to the first voice instruction is not recognized, displays the interface in front of the screen saver screen; When the operation corresponding to the first voice instruction is recognized, the interface corresponding to the first voice instruction is displayed.

As can be seen from the above example, in the same screen saver state, when the screen saver screen is displayed with and without interface prompts, the controller will do the same voice command (that is, the first voice command). Different responses. When there are interface prompts on the screen saver screen, it means that within the validity period of the interface prompts, if the first voice command is received at this time, the display device will maintain the screen saver state and display the feedback message corresponding to the first voice command on the screen saver On the screen; when there are no interface prompts on the screensaver screen, it means that the interface prompts are outside the validity period of the interface prompts. At this time, if the first voice command is received, the display device will exit the screensaver state to display the interface before entering the screensaver state or The interface corresponding to the first voice command is displayed.

In some embodiments, the same voice command directly executes the operation corresponding to the voice command when the screen saver interface is not displayed. For example, if the voice command corresponding to the interface prompt is input in the non-screen saver state, the smart terminal parses out the voice command , And send a voice command to the server. The server returns the interface corresponding to the voice command to the display device. The display device displays the corresponding interface according to the received interface information. The interface may be an activity interface as shown in FIG. 15. As shown in FIG. 15, the activity page displays that the activity has ended.

In other embodiments, the interface corresponding to the above-mentioned first voice command may be a voice search interface as shown in FIG. 10. Of course, it can also be other interfaces similar to the page shown in FIG. 10 and related to the first voice command, which will not be listed in this application.

5, the application program 3912 or the application program 2912 may also include a voice assistant application (not shown in the figure). The controller runs the voice assistant application to complete the voice-based interaction between the display device and the user, for example, presenting a presentation Voice search page for users, etc.

In some embodiments, the present application provides a display method. The main application scenario of the method is a display device, such as a smart TV. The execution subject of the method may be a controller of the display device, but is not limited to this.

It should be noted that the embodiment of the present application implements the reception of voice instructions through the user input interface (218-1 and/or 218-n) shown in FIG. 2.

FIG. 16 is a flowchart of a display method exemplarily shown in some embodiments of this application. As shown in FIG. 16, the method may include:

Step 101: Receive a voice instruction input by a user when the display is in a screen saver state.

In some embodiments, receiving the user input and sending the voice command may be when the display is like a screen saver, or not when the display is like a screen saver. When the display saves the picture, the display performs subsequent steps.

Step 102: Obtain a semantic analysis result of the voice instruction, and determine whether the voice instruction matches a preset instruction according to the semantic analysis result; when the voice instruction matches the preset instruction, perform step 103, When the voice instruction does not match the preset instruction, step 104 is executed.

In some embodiments, the controller needs to determine whether the voice instruction matches the preset instruction. This determination may correspond to step 102 to step 104, or may be other steps that can realize the determination of the match between the voice instruction and the preset instruction.

In some embodiments, the display device sends the voice command to a voice analysis server to obtain the corresponding semantic analysis result, or the display device parses the voice command through its own program to obtain the voice analysis result. Determine whether the voice instruction matches the preset instruction by determining whether the semantic analysis result matches the interface prompt corresponding to the preset instruction, the interface prompt is displayed on the screen saver screen; if If the semantic analysis result matches the interface prompt corresponding to the preset instruction, the voice instruction matches the preset instruction, and if the semantic analysis result matches the interface prompt corresponding to the preset instruction If it does not match, the voice instruction does not match the preset instruction.

Step 103: When the voice command matches the preset command, maintain the screen saver state, and display a feedback message corresponding to the voice command on the screen saver screen;

In some embodiments, maintaining the screen saver state is the display of the location screen saver screen. At this time, it can be the display of one screen saver screen in the location, or it can be the display of multiple screen saver images, as long as the display device is in the screen saver state.

In some embodiments, the feedback message is displayed on the top of the screen saver screen in a floating layer.

In some embodiments, the screen saver screen when the feedback message is displayed may be the same as or different from the screen saver screen when the voice command is received.

Step 104: When the voice instruction does not match the preset instruction, exit the screen saver state.

In some embodiments, exiting the screen saver state refers to canceling the display of the screen saver screen.

In some embodiments, after the display of the screen saver screen is cancelled, if there is an operation result corresponding to the voice command, the operation result corresponding to the voice command is displayed on the user interface.

In some embodiments, after the display of the screen saver screen is cancelled, if there is no operation result corresponding to the voice command, the user interface before entering the screen saver state is displayed on the user interface, and a prompt that the voice command cannot be recognized is displayed.

In some embodiments, when the screen saver screen is not displayed on the display, in response to receiving a voice command input by the user, an operation corresponding to the voice command is performed, such as performing volume up and down operations, channel increase, and channel increase corresponding to the voice command. Reduction operations, etc. Or when the voice command is not recognized, a prompt indicating that the voice command cannot be recognized is displayed.

It can be seen from the embodiment shown in FIG. 16 that, in some embodiments, the display method provided by the present application not only enables the user to control the display device through voice input, and realizes quick operation of the display device, but also can maintain the screen saver state without exiting, and continue Enjoy the screensaver screen.

It should be noted that the embodiment of the present application implements the reception of voice instructions through the user input interface (218-1 and/or 218-n) shown in FIG. 4.

FIG. 17 is a flow chart of a display method exemplarily shown in some embodiments of the application. As shown in FIG. 17, taking a preset instruction as participating in a network activity and giving a prompt of successful participation on the screen saver as an example, the method may include:

Step 201: Display the program picture, the user interface or the picture of the screen saver file on the display.

In some embodiments, the program picture is first displayed on the display, of course, it can also be a user interface, where the program picture is displayed on the Video layer, and the user interface is displayed on the OSD layer. When the time of the same program picture or the same user interface displayed on the monitor reaches the preset value, that is, when the static time of the monitor screen reaches the preset value, the screen saves the file at the top of the OSD layer.

Step 202: Receive a voice instruction input by the user.

In some embodiments, the user can press a voice input key on the remote control to input a voice command. For example, when the display shows the screen saver screen shown in FIG. 14, the user presses the voice input key and says "the 3rd anniversary of gathering **" to sign up for the lottery and give a prompt on the screen saver screen.

In some embodiments, the user presses the voice input key to say "how is the weather today" to obtain weather data provided by the display device and display the weather data interface.

In some embodiments, if the command uttered by the user pressing the voice input key is not recognized, the interface in front of the screen saver is displayed.

Step 203: In response to receiving the voice command, determine whether the display screen is in a screen saver state. If it is in the screen saver state, step 204 is executed, and if it is not in the screen saver state, step 209 is executed.

In some possible implementation manners, it is determined whether the display screen is in the screen saver state by determining whether the foreground application is a screen saver application. If the foreground application is a screensaver application, the display screen is in a screensaver state, and if the foreground application is not a screensaver application, the display screen is in a non-screensaver state.

Step 204: If the display screen is in the screen saver state, keep the screen saver state without exiting, and obtain the semantic analysis result of the voice command.

Step 205: Determine whether the voice instruction is a preset instruction for participating in network activities according to the obtained voice analysis result.

4, the external instruction recognition module 2907 may include a voice recognition module 2907-2. The voice recognition module 2907-2 stores a voice database, and the above-mentioned preset instructions for indicating participation in network activities are pre-stored in the voice database. When the voice command input by the user is received in the screen saver state, the voice assistant application is called up in the background, and the received voice command is transmitted to the voice recognition module. Through the voice recognition module, the received voice instructions are matched with the preset instructions in the voice database, and the matching results are returned to the voice assistant application, so that the voice assistant application performs different logic controls according to the specific matching results, for example, When it is determined that the voice command input by the user corresponds to the preset command prompted on the screen saver screen, the logic processing control or other corresponding processing logic involved in the network activity is executed; otherwise, the command corresponding to the matching voice command is executed Logic processing control.

In some embodiments, it is determined whether the voice instruction input by the user is the preset instruction by semantic matching between the voice instruction and the preset instruction.

In some embodiments, when the semantic analysis result of the voice command matches the semantics of the interface prompt on the screen saver screen, it is determined that the voice command is a preset instruction indicating participation in network activities; when the semantic analysis result of the voice command matches the screen saver screen When the semantics of the prompt words on the interface do not match, it is determined that the voice command is not a preset command for instructing to participate in network activities.

Step 206: When it is determined that the voice instruction is a preset instruction, perform processing of the voice instruction according to the network activity indicated by the voice instruction to participate in the network activity.

It should be noted that, according to the different network activities instructed to participate in, the processing of voice commands performed is different.

In some embodiments, when the "3rd Anniversary of Gathering" red envelope activity shown in Figure 14 is displayed on the screensaver screen, in response to the received voice instruction for instructing to participate in the red envelope activity, by calling the corresponding red envelope activity The service interface of, sends a participation request requesting participation in the red envelope activity to the server, and the participation request includes user information, such as user ID. Receive the participation result returned by the server, such as a result indicating that the user has participated successfully or failed.

Step 207: Display a text prompt containing the participation result on the upper layer of the screen of the screen saver file, and/or play a voice prompt corresponding to the participation result.

In some embodiments, FIG. 18 shows a schematic diagram of a Toast prompt containing participation results displayed on a floating layer above the screen of the screen saver file. The Toast prompt displays the text: Congratulations, you have signed up for the event.

In some embodiments, voice announcements of the participation results can also be performed through a voice assistant application, such as voice playback: Congratulations, you have signed up to participate in the event.

In this way, the user does not need to operate the control device multiple times, that is, the registration for the network activity can be completed, and the screen saver can continue to be enjoyed.

Step 208: When it is determined that the voice command is not a preset command, cancel the screen showing the screen saver file to exit the screen saver state.

In some embodiments, the display of the screen saver screen is cancelled when the screen saver state is exited; and when the operation corresponding to the first voice command is not recognized, the interface in front of the screen saver screen is displayed; after the first voice command is recognized When the operation corresponding to the instruction is given, the interface corresponding to the first voice instruction is displayed.

Step 209: If the display screen is in a non-screensaver state, in response to receiving the voice command, perform an operation corresponding to the voice command.

In some embodiments, if the display screen does not have a display screen saver, the normal voice processing procedure is executed, and the operation corresponding to the voice command is executed

In some embodiments, when it is determined that the voice instruction is not a preset instruction, in response to receiving the voice instruction, the display of the screen saver screen is cancelled and the operation corresponding to the voice instruction is performed.

For example, the voice search page as shown in FIG. 10 is presented.

It can be seen from the above embodiments that when a voice command input by the user is received in the screen saver state, the screen saver state is maintained without exiting so that the user can continue to enjoy the screen saver screen, and at the same time obtain the semantic analysis result of the voice command; judge according to the semantic analysis result Whether the voice instruction is a preset instruction for instructing to participate in network activities; when it is determined that the voice instruction is a preset instruction, the voice instruction is processed according to the network activity indicated by the voice instruction to participate in the network activity, so as to realize quick voice registration for the voice instruction Network activities do not require cumbersome user operations, and do not require users to wait, and the user experience is friendly.

In specific implementation, this application also provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in each embodiment of the method provided in this application when the program is executed. When the provided controller of the display device runs the computer program instructions, the controller executes the steps in which the controller described in this application is configured. The storage medium may be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM), etc.

Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions in the embodiments of the present application can be embodied in the form of software products, which can be stored in storage media, such as ROM/RAM, A magnetic disk, an optical disk, etc., include several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in the various embodiments or some parts of the embodiments of the present application.

The same or similar parts in the various embodiments in this specification can be referred to each other. In particular, as for the embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the description in the method embodiment.

The implementation manners of the application described above do not constitute a limitation on the protection scope of the application.

Claims

A display device, characterized in that it comprises:

Display, used for screen saver;

User interface for receiving voice commands input by users;

Controller for:

When the display screen saves the screen, receiving a voice command input by the user;

When the voice command matches the preset command, maintaining the display of the screen saver screen, and displaying a feedback message corresponding to the voice command on the top of the screen saver screen;

When the voice instruction does not match the preset instruction, the display of the screen saver screen is cancelled.
The display device according to claim 1, wherein after receiving the voice instruction input by the user, the controller is further configured to:

Sending the voice command to a voice server, where the voice server is used to parse the voice command to obtain a semantic analysis result;

Receiving the semantic analysis result returned by the voice server;

By judging whether the semantic analysis result matches the preset instruction, it is determined whether the voice instruction matches the preset instruction.
The display device according to claim 2, wherein the controller is configured to:

Determine whether the voice instruction matches the preset instruction by determining whether the semantic analysis result matches the interface prompt corresponding to the preset instruction, and the interface prompt is displayed on the screen saver screen;

Wherein, if the semantic analysis result matches the interface prompt corresponding to the preset instruction, the voice instruction matches the preset instruction, and if the semantic analysis result corresponds to the preset instruction If the interface prompt language does not match, the voice instruction does not match the preset instruction.
The display device according to claim 1, wherein the controller is further configured to:

When the screen saver screen is not displayed on the display, in response to receiving a voice command input by the user, performing an operation corresponding to the voice command or giving feedback indicating that the voice command cannot be recognized.
A display device, characterized in that it comprises:

Display, used for screen saver;

User interface for receiving voice commands input by users;

Controller for:

Receiving the first voice instruction input by the user;

When the display screen saver screen is displayed and the interface prompts are displayed on the screen saver screen, in response to the received first voice command, the display of the screen saver screen is maintained, and the screen saver screen is displayed on the top of the screen saver screen. A feedback message corresponding to a voice command, where the first voice command corresponds to the interface prompt;

When the display screen saver screen is displayed and the interface prompt is not displayed on the screen saver screen, in response to the received first voice command, the display of the screen saver screen is cancelled, and the interface before the screen saver screen is displayed or the first display screen is displayed. An interface corresponding to a voice command.
The display device according to claim 5, wherein the controller cancels the display of the screen saver screen in response to the received first voice instruction, and displays the interface in front of the screen saver screen or displays the first The interface corresponding to the voice command is:

The controller cancels the display of the screen saver screen in response to the received first voice instruction;

When the operation corresponding to the first voice instruction is not recognized, display the interface in front of the screen saver screen;

When the operation corresponding to the first voice instruction is recognized, the interface corresponding to the first voice instruction is displayed.
A display device, characterized in that it comprises:

The display is used to present the screen saver screen when the display enters the screen saver state;

User interface, used to receive user's voice instructions;

Controller for:

When a voice command input by the user is received in the screen saver state, maintain the screen saver state, and obtain a semantic analysis result of the voice command;

Judging, according to the semantic analysis result, whether the voice instruction is a preset instruction instructing to participate in network activities;

When the voice instruction is the preset instruction, send a participation request requesting participation in the network activity to the server, and display the received participation result while maintaining the screen saver state, wherein the participation request Used to enable the server to return the participation result;

When the voice instruction is not the preset instruction, exit the screen saver state.
The display device according to claim 7, wherein the screen saver screen has an interface prompt for participating in the network activity; the controller is used for:

Judging whether the voice instruction is the preset instruction by judging whether the semantic analysis result matches the interface prompt word corresponding to the preset instruction;

Wherein, if the semantic analysis result matches the interface prompt corresponding to the preset instruction, the voice instruction is the preset instruction, and if the semantic analysis result matches the interface prompt corresponding to the preset instruction If the language does not match, the voice command is not the preset command.
The display device according to claim 7, wherein the sending a participation request requesting participation in the network activity to the server includes:

Obtain user information;

According to the user information and the service interface corresponding to the network activity, a participation request requesting participation in the network activity is sent to the server.
8. The display device according to claim 7, wherein the display of the received participation result comprises:

The floating layer above the screen saver screen displays a text prompt containing the participation result, and/or plays a voice prompt corresponding to the participation result.
7. The display device according to claim 7, wherein before the maintaining the screen saver state and obtaining the semantic analysis result of the voice command, the controller is further configured to:

When a voice command input by the user is received, it is determined whether the display screen is in a screen saver state.
The display device according to claim 11, wherein the controller is further configured to:

When a voice command input by a user is received in a non-screensaver state, in response to receiving the voice command, an operation corresponding to the received voice command is performed or a feedback indicates that the voice command cannot be recognized.
A display method applied to a display device, characterized in that the method includes:

When the display screen saves the picture, receive the voice command input by the user;

When the voice instruction matches the preset instruction, maintaining the display of the screen saver screen, and displaying a feedback message corresponding to the voice instruction on the top of the screen saver screen;

When the voice instruction does not match the preset instruction, the display of the screen saver screen is cancelled.
A display method applied to a display device, characterized in that the method includes:

Receiving the first voice instruction input by the user;

When the screen saver screen and the interface prompts are displayed on the screen saver screen, in response to the received first voice command, the screen saver screen is maintained, and the screen saver screen is displayed on the top of the screen saver screen and the first A feedback message corresponding to a voice command, where the first voice command corresponds to the interface prompt;

When the screen saver screen and the interface prompt is not displayed on the screen saver screen, in response to the received first voice instruction, the display of the screen saver screen is cancelled, and the interface before the screen saver screen is displayed or the first The interface corresponding to the voice command.
A display method applied to a display device, characterized in that the method includes:

When a voice command input by the user is received in the screen saver state, maintain the screen saver state, and obtain a semantic analysis result of the voice command;

Judging, according to the semantic analysis result, whether the voice instruction is a preset instruction instructing to participate in network activities;

When the voice instruction is the preset instruction, send a participation request requesting participation in the network activity to the server, and display the received participation result while maintaining the screen saver state, and the participation request is used for Enable the server to return the participation result;

When the voice instruction is not the preset instruction, exit the screen saver state.