CN113495711B

CN113495711B - Display apparatus and display method

Info

Publication number: CN113495711B
Application number: CN202010195696.3A
Authority: CN
Inventors: 孙鲁兵
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2020-03-19
Filing date: 2020-03-19
Publication date: 2023-05-05
Anticipated expiration: 2040-03-19
Also published as: CN113495711A; WO2021184575A1

Abstract

The application discloses a display device and a display method, wherein when a screen saver picture is displayed on a display, a voice instruction input by a user is received; when the voice command is matched with a preset command, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the voice command above the screen saver picture; and when the voice command is not matched with the preset command, the display of the screen saver picture is canceled, so that the quick operation of the display equipment is realized in the screen saver state.

Description

Display apparatus and display method

Technical Field

The application relates to the technical field of internet, in particular to a display device and a display method.

Background

Currently, display devices may provide a user with a play screen such as audio, video, pictures, and the like. In practical applications, if the display device does not play video or does not receive user input for a long time, that is, the display device displays the same picture for a long time, the display screen is aged, which shortens the service life of the display device.

In order to prolong the service life of the display screen, a screen saver application (or screen saver application) can be installed on the display device, and when the duration of displaying the same picture on the display reaches a certain duration, the screen application presents a multimedia screen saver file on the top layer of the currently presented user interface so as to enable the display screen to enter a screen saver state, thereby achieving the purpose of protecting the screen.

In the related art, when a user input is received in a screen saver state, the screen saver state is immediately exited.

Disclosure of Invention

The application provides a display device and a voice instruction processing method, which are used for realizing the rapid operation of the display device in a screen saver state.

In a first aspect, the present application provides a display device, comprising:

a display for displaying a screen saver picture;

the user interface is used for receiving a voice instruction input by a user;

a controller for:

receiving a voice instruction input by a user when the display displays a screen saver picture;

when the voice command is matched with a preset command, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the voice command above the screen saver picture;

and when the voice command is not matched with a preset command, the display of the screen saver picture is canceled.

In a second aspect, the present application provides a display device, comprising:

a display for displaying a screen saver picture;

the user interface is used for receiving a voice instruction input by a user;

a controller for:

receiving a first voice instruction input by a user;

when a screen saver picture is displayed by a display and an interface prompt is displayed on the screen saver picture, responding to the received first voice instruction, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the first voice instruction above the screen saver picture, wherein the first voice instruction corresponds to the interface prompt;

When the display displays a screen saver picture and the interface prompt is not displayed on the screen saver picture, responding to the received first voice command, canceling the display of the screen saver picture, and displaying an interface before the screen saver picture or displaying an interface corresponding to the first voice command.

In a third aspect, the present application provides a display device, including:

a display for presenting a screen saver picture when the display enters a screen saver state;

the user interface is used for receiving the voice instruction of the user;

a controller for:

when a voice command input by a user is received in a screen protection state, maintaining the screen protection state and acquiring a semantic analysis result of the voice command;

judging whether the voice command is a preset command for indicating to participate in network activities according to the semantic analysis result;

when the voice command is the preset command, sending a participation request for requesting to participate in the network activity to a server, and displaying a received participation result under the condition of maintaining the screen saver state, wherein the participation request is used for enabling the server to return the participation result;

and when the voice instruction is not the preset instruction, exiting the screen protection state.

In a fourth aspect, the present application provides a display method, applied to a display device, the method including:

In a fifth aspect, the present application provides a display method, applied to a display device, the method including:

a display method applied to a display device, the method comprising:

receiving a first voice instruction input by a user;

when a screen saver picture is displayed and an interface prompt is displayed on the screen saver picture, responding to the received first voice instruction, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the first voice instruction above the screen saver picture, wherein the first voice instruction corresponds to the interface prompt;

when the screen saver picture is displayed and the interface prompt is not displayed on the screen saver picture, responding to the received first voice command, canceling the display of the screen saver picture, and displaying an interface before the screen saver picture or displaying an interface corresponding to the first voice command.

In a sixth aspect, the present application provides a display method, applied to a display device, the method including:

when a voice command input by a user is received in a screen protection state, maintaining the screen protection state, and acquiring a semantic analysis result of the voice command;

In the embodiment of the application, when the display displays a screen saver picture, a voice instruction input by a user is received; when the voice command is matched with a preset command, maintaining the screen protection state, and displaying a feedback message corresponding to the voice command on the screen protection picture; and when the voice command is not matched with the preset command, the screen protection state is exited, and an operation result corresponding to the voice command is displayed on a user interface, so that the quick operation of the display equipment is realized in the screen protection state.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

A schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment is exemplarily shown in fig. 1;

a hardware configuration block diagram of the display device 200 in accordance with the embodiment is exemplarily shown in fig. 2;

a hardware configuration block diagram of the control device 100 in accordance with the embodiment is exemplarily shown in fig. 3;

a functional configuration diagram of the display device 200 according to the embodiment is exemplarily shown in fig. 4;

a schematic diagram of the software configuration in the display device 200 according to an embodiment is exemplarily shown in fig. 5;

a schematic configuration of an application program in the display device 200 according to an embodiment is exemplarily shown in fig. 6;

a schematic diagram of a user interface in a display device 200 according to an embodiment is exemplarily shown in fig. 7;

a program screen presented by the display device display is exemplarily shown in fig. 8 a;

the user interface presented by the display device display is exemplarily shown in fig. 8 b;

A screen of a screen saver file presented by the display device display is illustrated in fig. 9;

a voice search interface presented by a display of a display device is exemplarily shown in fig. 10;

the user interface presented by the display device display is exemplarily shown in fig. 11;

one type of user interface presented by a display device display is illustrated schematically in FIG. 12;

one type of user interface presented by a display device display is illustrated schematically in FIG. 13;

a screen of a screen saver file presented by the display device display is illustrated in fig. 14;

a screen of a screen saver file presented by the display device display is illustrated in fig. 15;

a display method flow chart is exemplarily shown in fig. 16;

a display method flow chart is exemplarily shown in fig. 17;

a screen of a screen saver file presented by the display device display is illustrated in fig. 18.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the exemplary embodiments of the present application more apparent, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is apparent that the described exemplary embodiments are only some embodiments of the present application, but not all embodiments.

All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present application, are intended to be within the scope of the present application based on the exemplary embodiments shown in the present application. Furthermore, while the disclosure has been presented in terms of an exemplary embodiment or embodiments, it should be understood that various aspects of the disclosure can be practiced separately from the disclosure in a complete subject matter.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate, such as where appropriate, for example, implementations other than those illustrated or described in accordance with embodiments of the present application.

Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the function associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as a display device as disclosed in this application) that can typically be controlled wirelessly over a relatively short distance. Typically, the electronic device is connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a touch screen user interface.

The term "gesture" as used herein refers to a user action by a change in hand shape or hand movement, etc., used to express an intended idea, action, purpose, or result.

A schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment is exemplarily shown in fig. 1. As shown in fig. 1, a user may operate the display apparatus 200 through the mobile terminal 300 and the control device 100.

The control device 100 may control the display apparatus 200 through a wireless or other wired manner by using a remote controller including an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication manners. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, on-off keys, etc. on the remote controller to realize the functions of the control display device 200.

In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device. The application program, by configuration, can provide various controls to the user in an intuitive User Interface (UI) on a screen associated with the smart device.

By way of example, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. Such as: it is possible to implement a control command protocol established between the mobile terminal 300 and the display device 200, synchronize a remote control keyboard to the mobile terminal 300, and implement a function of controlling the display device 200 by controlling a user interface on the mobile terminal 300. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display device 200 is also in data communication with the server 400 via a variety of communication means. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. By way of example, display device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be one or more groups, and may be one or more types of servers. Other web service content such as video on demand and advertising services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limited, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display device 200 may additionally provide an intelligent network television function of a computer support function in addition to the broadcast receiving television function. Examples include web tv, smart tv, internet Protocol Tv (IPTV), etc.

A hardware configuration block diagram of the display device 200 according to an exemplary embodiment is illustrated in fig. 2. As shown in fig. 2, the display device 200 includes therein at least one of a controller 210, a modem 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

A display 280 for receiving image signals from the video processor 260-1 and for displaying video content and images and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting pictures, and a drive assembly for driving the display of images. The video content may be displayed from broadcast television content, or may be various broadcast signals receivable via a wired or wireless communication protocol. Alternatively, various image contents received from the network server side transmitted from the network communication protocol may be displayed.

Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the display device 200 and used to control the display device 200.

And, depending on the type of display 280, a drive assembly for driving the display. Alternatively, if the display 280 is a projection display, a projection device and projection screen may be included.

The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown in the figure).

The display device 200 may establish control signal and data signal transmission and reception with an external control device or a content providing device through the communication interface 230. And an infrared receiver, which is an interface device for receiving infrared control signals of the control device 100 (such as an infrared remote controller).

The detector 240 is a signal that the display device 200 uses to collect an external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, a parameter change may be adaptively displayed by collecting the ambient light, etc.

And the image collector 241, such as a camera, a video camera, etc., can be used for collecting external environment scenes, collecting attributes of a user or interacting gestures with the user, can adaptively change display parameters, and can also recognize the gestures of the user so as to realize the interaction function with the user.

In other exemplary embodiments, the detector 240 may also be a temperature sensor or the like, such as by sensing ambient temperature, and the display device 200 may adaptively adjust the display color temperature of the image. The display device 200 may be adjusted to display a colder color temperature shade of the image, such as when the temperature is higher, or the display device 200 may be adjusted to display a warmer color shade of the image when the temperature is lower.

In other exemplary embodiments, the detector 240, and also a sound collector or the like, such as a microphone, may be used to receive the user's sound, including the voice signal of a control instruction of the user controlling the display device 200, or collect the ambient sound for identifying the type of the ambient scene, and the display device 200 may adapt to the ambient noise.

An input/output interface 250 for data transmission between the control display device 200 of the controller 210 and other external devices. Such as receiving video signals and audio signals of an external device, or command instructions.

The input/output interface 250 may include, but is not limited to, the following: any one or more of a high definition multimedia interface HDMI interface 251, an analog or data high definition component input interface 253, a composite video input interface 252, a USB input interface 254, an RGB port (not shown in the figures), etc. may be used.

In other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface from the plurality of interfaces described above.

The modem 220 receives broadcast television signals by a wired or wireless receiving method, and can perform modulation and demodulation processing such as amplification, mixing, resonance, etc., and demodulates television audio and video signals carried in a television channel frequency selected by a user and EPG data signals from a plurality of wireless or wired broadcast television signals.

The tuning demodulator 220 is responsive to the user selected television signal frequency and television signals carried by that frequency, as selected by the user, and as controlled by the controller 210.

The tuning demodulator 220 can receive signals in various ways according to broadcasting systems of television signals, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation can be digital modulation or analog modulation mode. Depending on the type of television signal received, both analog and digital signals may be used.

In other exemplary embodiments, the modem 220 may also be in an external device, such as an external set-top box, or the like. Thus, the set-top box outputs television audio and video signals after modulation and demodulation, and inputs the television audio and video signals to the display device 200 through the input/output interface 250.

The video processor 260-1 is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to the standard codec protocol of the input signal, and obtain a signal that can be displayed or played on the directly displayable device 200.

The video processor 260-1, as an example, includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio/video data stream, such as the input MPEG-2, and demultiplexes the input audio/video data stream into video signals, audio signals and the like.

And the video decoding module is used for processing the demultiplexed video signals, including decoding, scaling and the like.

And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display.

The frame rate conversion module is configured to convert the input video frame rate, for example, converting the 60Hz frame rate into the 120Hz frame rate or the 240Hz frame rate, and the common format is implemented in an inserting frame manner.

The display format module is used for converting the received frame rate into a video output signal, and changing the video output signal to a signal conforming to the display format, such as outputting an RGB data signal.

The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the external audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like, to obtain a sound signal that can be played in a speaker.

In other exemplary embodiments, video processor 260-1 may include one or more chip components. The audio processor 260-2 may also include one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or integrated together in one or more chips with the controller 210.

An audio output 272, which receives the sound signal output by the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and an external sound output terminal 274 that can be output to a generating device of an external device, other than the speaker 272 carried by the display device 200 itself, such as: external sound interface or earphone interface, etc.

And a power supply source for providing power supply support for the display device 200 with power inputted from an external power source under the control of the controller 210. The power supply may include a built-in power circuit installed inside the display apparatus 200, or may be an external power source installed in the display apparatus 200, and a power interface providing an external power source in the display apparatus 200.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

By way of example, a user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210 by the display device 200 according to the user input.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

The controller 210 controls the operation of the display device 200 and responds to the user's operations through various software control programs stored on the memory 290.

As shown in FIG. 2, the controller 210 includes RAM213 and ROM214, as well as a graphics processor 216, CPU processor 212, a communication interface 218, such as first interface 218-1 through nth interfaces 218-n, and a communication bus. The RAM213 and the ROM214 are connected to the graphics processor 216, the CPU processor 212, and the communication interface 218 via buses.

A ROM213 for storing instructions for various system starts. When the power of the display device 200 starts to be started when the power-on signal is received, the CPU processor 212 executes a system start instruction in the ROM and copies the operating system stored in the memory 290 to the RAM213, so that the running of the start operating system starts. When the operating system is started, the CPU processor 212 copies various applications in the memory 290 to the RAM213, and then starts running the various applications.

A graphics processor 216 for generating various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The device comprises an arithmetic unit, wherein the arithmetic unit is used for receiving various interaction instructions input by a user to carry out operation and displaying various objects according to display attributes. And a renderer that generates various objects based on the results of the operator, and displays the results of rendering on the display 280.

CPU processor 212 is operative to execute operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. The plurality of processors may include one main processor and a plurality or one sub-processor. A main processor for performing some operations of the display apparatus 200 in the pre-power-up mode and/or displaying a picture in the normal mode. A plurality of or a sub-processor for one operation in a standby mode or the like.

The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command to select a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon. The user command for selecting the UI object may be an input command through various input means (e.g., mouse, keyboard, touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice uttered by the user.

Memory 290 includes storage for various software modules for driving display device 200. Such as: various software modules stored in memory 290, including: a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

The base module is a bottom software module for communicating signals between the various hardware in the post-partum care display device 200 and sending processing and control signals to the upper module. The detection module is used for collecting various information from various sensors or user input interfaces and carrying out digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is used for controlling the display 280 to display the image content, and can be used for playing the multimedia image content, the UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. And the service module is used for providing various services and various application programs.

Meanwhile, the memory 290 also stores received external data and user data, images of various items in various user interfaces, visual effect maps of focus objects, and the like.

A block diagram of the configuration of the control device 100 according to an exemplary embodiment is illustrated in fig. 3. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200, and may receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, to function as an interaction between the user and the display device 200. Such as: the user responds to the channel addition and subtraction operation by operating the channel addition and subtraction key on the control apparatus 100, and the display apparatus 200.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications for controlling the display apparatus 200 according to user's needs.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similarly to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication collaboration among the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display device 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display device 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can implement a user instruction input function through actions such as voice, touch, gesture, press, and the like, and the input interface converts a received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the corresponding instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display device 200. In some embodiments, an infrared interface may be used, as well as a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. And the following steps: when the radio frequency signal interface is used, the user input instruction is converted into a digital signal, and then the digital signal is modulated according to a radio frequency control signal modulation protocol and then transmitted to the display device 200 through the radio frequency transmission terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130 such as: the WiFi, bluetooth, NFC, etc. modules may send the user input instruction to the display device 200 through a WiFi protocol, or a bluetooth protocol, or an NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control device 200 under the control of the controller 110. The memory 190 may store various control signal instructions input by a user.

A power supply 180 for providing operating power support for the various elements of the control device 100 under the control of the controller 110. May be a battery and associated control circuitry.

A schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment is illustrated in fig. 4. As shown in fig. 4, the memory 290 is used to store an operating system, application programs, contents, user data, and the like, and performs system operations for driving the display device 200 and various operations in response to a user under the control of the controller 210. Memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically used for storing an operation program for driving the controller 210 in the display device 200, and storing various application programs built in the display device 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the application, various objects related to the graphical user interfaces, user data information, and various internal data supporting the application. The memory 290 is used to store system software such as OS kernel, middleware and applications, and to store input video data and audio data, and other user data.

Memory 290 is specifically used to store drivers and related data for audio and video processors 260-1 and 260-2, display 280, communication interface 230, modem 220, detector 240 input/output interface, and the like.

In some embodiments, memory 290 may store software and/or programs, the software programs used to represent an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, APIs, or application programs), and the kernel may provide interfaces to allow the middleware and APIs, or applications to access the controller to implement control or management of system resources.

The example memory 290 includes at least one of a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, and the like. The controller 210 executes various software programs in the memory 290 such as: broadcast television signal receiving and demodulating functions, television channel selection control functions, volume selection control functions, image control functions, display control functions, audio control functions, external instruction recognition functions, communication control functions, optical signal receiving functions, power control functions, software control platforms supporting various functions, browser functions and other applications.

A block diagram of the configuration of the software system in the display device 200 according to an exemplary embodiment is illustrated in fig. 5.

As shown in FIG. 5, operating system 2911, which includes executing operating software for handling various basic system services and for performing hardware-related tasks, acts as a medium for data processing completed between applications and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage display device hardware resources and to serve other programs or software code.

In other embodiments, portions of the operating system kernel may contain one or more device drivers, which may be a set of software code in the operating system that helps operate or control the devices or hardware associated with the display device. The driver may contain code to operate video, audio and/or other multimedia components. Examples include a display screen, camera, flash, wiFi, and audio drivers.

Wherein, accessibility module 2911-1 is configured to modify or access an application program to realize accessibility of the application program and operability of display content thereof.

The communication module 2911-2 is used for connecting with other peripheral devices via related communication interfaces and communication networks.

User interface module 2911-3 is configured to provide an object for displaying a user interface, so that the user interface can be accessed by each application program, and user operability can be achieved.

Control applications 2911-4 are used for controllable process management, including runtime applications, and the like.

The event transmission system 2914, which may be implemented within the operating system 2911 or within the application 2912, is implemented in some embodiments on the one hand within the operating system 2911, and simultaneously within the application 2912, for listening to various user input events, and will implement one or more sets of predefined operational handlers based on various event references in response to recognition results of various types of events or sub-events.

The event monitoring module 2914-1 is configured to monitor a user input interface to input an event or a sub-event.

The event recognition module 2914-1 is configured to input definitions of various events to various user input interfaces, recognize various events or sub-events, and transmit them to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the display device 200, and an input from an external control device (e.g., the control device 100, etc.). Such as: various sub-events are input through voice, gesture input through gesture recognition, sub-events of remote control key instruction input of a control device and the like. By way of example, one or more sub-events in the remote control may include a variety of forms including, but not limited to, one or a combination of key press up/down/left/right/, ok key, key press, etc. And operations of non-physical keys, such as movement, holding, releasing, etc.

Interface layout manager 2913 directly or indirectly receives user input events or sub-events from event delivery system 2914 for updating the layout of the user interface, including but not limited to the location of controls or sub-controls in the interface, and various execution operations associated with the interface layout, such as the size or location of the container, the hierarchy, etc.

As shown in fig. 6, the application layer 2912 contains various applications that may also be executed on the display device 200. Applications may include, but are not limited to, one or more applications such as: at least one of a live television application, a video on demand application, a media center application, an application center, a gaming application, and the like.

Live television applications can provide live television through different signal sources. For example, a live television application may provide television signals using inputs from cable television, radio broadcast, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

Video on demand applications may provide video from different storage sources. Unlike live television applications, video-on-demand provides video displays from some storage sources. For example, video-on-demand may come from the server side of cloud storage, from a local hard disk storage containing stored video programs.

The media center application may provide various applications for playing multimedia content. For example, a media center may be a different service than live television or video on demand, and a user may access various images or audio through a media center application.

An application center may be provided to store various applications. The application may be a game, an application, or some other application associated with a computer system or other device but which may be run in a smart television. The application center may obtain these applications from different sources, store them in local storage, and then be run on the display device 200.

A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 7. As shown in fig. 7, the user interface includes a plurality of view display areas, illustratively, a first view display area 201 and a play screen 202, wherein the play screen includes a layout of one or more different items. And a selector in the user interface indicating that an item is selected, the position of the selector being movable by user input to change selection of a different item.

It should be noted that the multiple view display areas may present different levels of display images. For example, the first view display region may present video chat item content and the second view display region may present application layer item content (e.g., web page video, VOD presentation, application screen, etc.).

Optionally, the presentation of different view display areas has priority difference, and the display priorities of the view display areas are different among the view display areas with different priorities. If the priority of the system layer is higher than that of the application layer, when the user uses the acquisition selector and the picture switching in the application layer, the picture display of the view display area of the system layer is not blocked; and when the size and the position of the view display area of the application layer are changed according to the selection of the user, the size and the position of the view display area of the system layer are not affected.

The same level of display may be presented, in which case the selector may switch between the first view display region and the second view display region, and the size and position of the second view display region may change as the size and position of the first view display region changes.

In some embodiments, any one of the areas in fig. 7 may display a screen acquired by the camera.

Fig. 8a is a program screen exemplarily shown in an embodiment of the present application, and fig. 8b is a user interface exemplarily shown in an embodiment of the present application. When the display displays the same program picture or the user interface for too long, the screen can be aged, which is unfavorable for the service life.

In order to avoid the display to display the same program picture or the same user interface for a long time, when the time of displaying the same playing picture by the display reaches a preset value, the picture of the screen protection file is immediately displayed on the display, so that the purpose of protecting the screen is achieved.

Referring to fig. 4, an application 3912 or 2912 is stored in the memory 390 or 290, the application 3912 or 2912 includes a screen saver (not shown in the drawings), the controller counts a rest time of a display screen (a time for displaying the same play screen) by running the screen saver application, reads a screen saver file (e.g., a picture file) stored in the memory in advance when the rest time reaches a preset value, processes the read screen saver file by the video processor to obtain an image signal for display, and outputs the image signal to the display through an output interface, and further, displays a screen of the screen saver file, that is, a screen saver screen, on an upper layer of a screen currently displayed on the display.

In some embodiments, a screen saver refers to an image file that is presented in a lock state (screen saver state) to avoid pixel decay caused by the pixels remaining the same content for a long period of time.

In some embodiments, a screen saver screen refers to an image file for display on a display during the running of a screen saver (screen saver).

For example, a screen saver screen is displayed on the upper layer of the screen shown in fig. 8a or 8b, and the screen saver screen shown in fig. 9 is obtained. For ease of illustration, the display screen is in a non-screen saver state when the display is displaying a program screen or user interface as shown in fig. 8a or 8b, and in a screen saver state when the display is displaying a screen saver screen as shown in fig. 9.

In some embodiments, the screen saver application is a foreground application running in the foreground when the display shows a picture of a screen saver file (e.g., an image file), i.e., in a screen saver state.

The foreground application may refer to an application presenting an interface displayed to a user, for example, if the interface displayed by the display is an a application, the a application is a foreground application, and if at this time, the user triggers a B application through a remote control device, so that the display displays an interactive interface of the B application, the B application is a foreground application. The switching of the foreground application may be that the display device automatically or controllably starts the application B in the process of using the application a by the user, and the content displayed by the display is switched from the interactive interface corresponding to the application a to the interactive interface corresponding to the application B.

When the display displays a screen saver as shown in fig. 9, i.e., in a screen saver state, the user may input a control command to the controller by operating the control device 100, for example, the user may input a corresponding control command by a volume up-down key, a channel control key, an up/down/left/right movement key, a voice input key, a menu key, etc. on the remote controller, and in response to a part or all of the control command input by the user, the controller will cancel the display of the screen saver file to exit the screen saver state, and return to displaying the interface as shown in fig. 8a or 8 b.

In some embodiments, the controller exits the screensaver state in response to any control instruction entered by the user, while the controller performs the corresponding operation of the user input by running other programs (e.g., application layer programs, middleware programs, and/or kernel layer programs).

For example, when the display displays the screen saver as shown in fig. 9, the user may press a voice input button on the remote controller to input a voice command, and the controller cancels the display of the screen saver file to exit the screen saver state and controls the display of the voice search interface as shown in fig. 10 in response to the voice command.

In other embodiments, the controller presents a corresponding interface in response to a preset control command input by the user, for example, enters a screen saver setting interface, the user can input a control command for changing a screen saver picture by pressing a down direction key on the remote controller, and the controller displays an alternative screen saver picture as shown in fig. 11 at an upper layer of a currently displayed screen saver picture while maintaining a screen saver state in response to the control command. The controller exits the screen saver state in response to a control command other than a preset control command entered by a user.

As can be seen from the above examples, when the display displays the screen saver, if the user inputs a user input command including a voice command through the user interface, the user triggers the screen saver state to exit, so that the user cannot continue to enjoy the screen saver, and if the user wants to continue to enjoy the screen saver, the user needs to wait for a certain period of time or perform some complicated operations.

To solve the above-mentioned problem, in some embodiments of the present application, a voice command (abbreviated as a preset command) that does not need to exit the screen saver state is preset and stored in the voice recognition module or the voice server, when the preset command is received in the screen saver state, the display device maintains the screen saver state, performs a corresponding operation of the preset command in the background, and displays a feedback message obtained by performing the operation, such as a Toast prompt ("mayyou, registered to participate in the activity") shown in fig. 18, on the screen saver screen. Furthermore, the user can control the display device through voice input to realize quick operation on the display device, and can also keep the screen protection state not to exit, so as to continuously appreciate the screen protection picture.

In some embodiments, when the display displays the screen saver as shown in fig. 8b, if the controller receives a voice command input by the user through the control device or using the far-field voice function of the display device, the controller maintains the screen saver state, and simultaneously sends the received voice command to the voice server or the voice recognition module for analysis, so as to obtain a semantic analysis result returned by the voice server or the voice recognition module. And then the controller judges whether the voice command is matched with the preset command by judging whether the voice analysis result is matched with the interface prompt corresponding to the preset command, when the voice command is matched with the preset command, the display of the screen saver is continuously maintained, namely, the screen saver state is maintained, and a feedback message corresponding to the voice command is displayed above the screen saver in a floating layer mode, and when the voice command is not matched with the preset command, the display of the screen saver is canceled, namely, the screen saver state is withdrawn, and an operation result corresponding to the voice command or a prompt that the voice command cannot be recognized is displayed on the user interface. The technical scheme of the present application will be described in detail below with reference to specific examples.

In some embodiments, on a user interface as shown in FIG. 8b, interface elements for participating in/registering a network activity, such as a network lottery activity, a reservation activity, a robbery package activity, etc., may be displayed, which may be clickable controls for triggering a process such as a page jump, etc. For example, as shown in FIG. 12, a user interface for participating in "poly" is displayed on the user interface ^** Clickable controls for 3 annual lottery events ".

When the display displays the interface as shown in fig. 12, the user can click on the control by operating the control device, the controller jumps to the active page as shown in fig. 13 in response to the click input by the user, and on the active page as shown in fig. 13, the user operates the control device again to click on the button "register activity" for participating in the activity on the active page, and the controller requests to the server to participate in the network activity in response to the user input.

As can be seen from the above examples, if a user wants to participate in a network activity displayed on the screen saver interface, the user needs to operate the control device multiple times, and needs to go through a process of waiting by the user, such as a page jump, so that the registration process of the network activity is not fast, which is not beneficial to user experience.

In order to solve the above-mentioned problems, in some embodiments of the present application, a voice command for indicating participation in a network activity may be used as the preset command without exiting a screen saver state, so that a user may input the voice command for indicating participation in the network activity to the controller by controlling the operation device, and the controller may send a participation request for requesting participation in the network activity to the server in response to the voice command while maintaining the screen saver, i.e. execute the registration procedure of the user, thereby implementing a voice shortcut registration, and display the received participation result while maintaining the screen saver state.

As in the examples above, the preset instructions may have corresponding interface cues that may be displayed on the screen saver screen so that when the screen saver screen is displayed on the display, the user may follow the interface thereonThe face prompt inputs a corresponding preset instruction. For example, in some embodiments, information about network activities and interface prompts for participating in the network interactions may be displayed on the display screen of the screensaver, and further, the user may input voice instructions for participating in the network activities according to the prompts of the interface prompts. For example, as shown in FIG. 14, the screen saver displays "+|! Speech speech utterances gathering ^** The lottery event was entered by registering for 3 years. The interface prompt may be a text contained in the screen saver, or may be a text displayed in a transparent layer on the upper layer of the screen saver.

In some embodiments, the interface prompt is an inherent portion of the image file corresponding to the screen saver, i.e., the image file with the interface prompt is a promotional poster specifically tailored for the network activity, the interface prompt being displayed as part of the image file and the image file at the same layer of the screen saver.

In some embodiments, the interface prompt is a new portion on the screen saver according to the propaganda requirement, that is, the image file is a conventional screen saver picture, when the image file is displayed, in response to the need to display the activity prompt, the controller controls the display to draw a new floating layer above the layer where the image file is located so as to display the interface prompt, and the layer where the interface prompt is located is above the layer where the image file is located, where the interface prompt and the image file are together used as the screen saver picture to perform periodic display (that is, the interface prompt is switched along with the switching of the image file). This arrangement eliminates the need for a promotional poster specially made for the network activity, and is beneficial to providing the efficiency of the system.

From the above example, it can be seen that if the display device receives a voice command for indicating to participate in the network activity in the screen saver state, the screen saver state can be maintained without exiting, and the operation corresponding to the voice command is executed in the background, so that the user can continue to enjoy the screen saver picture, and meanwhile, the operation result corresponding to the voice command can be obtained, that is, whether the activity is involved successfully or not is indicated.

In some embodiments, the preset instructions may have a corresponding validity period, for example, a validity period of a voice instruction for participating in a network activity, that is, a holding period of the network activity. Accordingly, the interface prompt corresponding to the preset instruction is only displayed on the screen saver picture in the effective period, for example, the interface prompt for participating in the network interaction is displayed on the screen saver picture during the holding period of the network activity, and after the holding period of the activity is ended, the screen saver file with the interface prompt is not displayed. The preset instruction corresponds to the interface prompt, and the validity period of the preset instruction is the validity period of the interface prompt. In particular, the screen saver file can be updated.

Based on the above embodiments, in some embodiments of the present application, if and only if the display displays a screen saver screen and an interface prompt corresponding to a first voice instruction is displayed on the screen saver screen, in response to receiving the first voice instruction, display of the screen saver screen is maintained, and a feedback message corresponding to the first voice instruction is displayed above the screen saver screen, so as to ensure that shortcut operation to the display device is realized only within the validity period of the interface prompt/the first voice instruction (preset instruction), and avoid misoperation of the display device by a user outside the validity period of the interface prompt/the first voice instruction (preset instruction). For example, if and only if the display displays a screen saver screen with an interface prompt thereon for participating in a network activity, in response to receipt of a voice instruction for participating in the network activity, display of the screen saver screen is maintained and the participation result is displayed on the screen saver screen.

Further, in the above embodiment, when the display displays the screen saver picture and the interface prompt corresponding to the first voice command is not displayed on the screen saver picture, in response to receiving the first voice command, the display of the screen saver picture is canceled to exit the screen saver state, and the interface before entering the screen saver state or the interface corresponding to the first voice command is displayed, so that misoperation of the display device outside the validity period of the interface prompt/the preset command can be avoided.

For example, the controller, in response to the received first voice instruction, dismisses display of the screen saver screen; when the operation corresponding to the first voice instruction is not recognized, displaying an interface before the screen saver image; and displaying an interface corresponding to the first voice command when the operation corresponding to the first voice command is identified.

As can be seen from the above examples, also in the screen saver state, the controller responds differently to the same voice command (i.e., the first voice command) when the displayed screen saver has an interface prompt and when the screen saver has no interface prompt. When the screen saver picture is provided with the interface prompt, the display equipment maintains the screen saver state if the first voice command is received at the moment in the effective period of the interface prompt, and the feedback message corresponding to the first voice command is displayed on the screen saver picture; when the screen saver picture does not have the interface prompt, the display device can exit the screen saver state to display the interface before entering the screen saver state or display the interface corresponding to the first voice command when the first voice command is received outside the validity period of the interface prompt.

In some embodiments, the same voice command is directly executed when the screen saver interface is not displayed, for example, if the voice command corresponding to the interface prompt is input in the non-screen saver state, the intelligent terminal parses the voice command and sends the voice command to the server, the server returns the interface corresponding to the voice command to the display device, and the display device displays the corresponding interface according to the received interface information, where, for example, the interface corresponding to the first voice command received in the non-screen saver state may be an active interface as shown in fig. 15, and the display activity on the active page is finished as shown in fig. 15.

In other embodiments, the interface corresponding to the first voice command may be a voice search interface as shown in fig. 10. Of course, other interfaces related to the first voice command similar to the page shown in fig. 10 are also possible, and are not further described in this application.

Referring to FIG. 5, the application 3912 or 2912 may also include a voice assistant application (not shown) that the controller accomplishes voice-based interactions between the display device and the user by running, for example, presenting a voice search page presented to the user, and the like.

In some embodiments, the application provides a display method, and a main application scenario of the method is a display device, such as a smart television, and an execution subject of the method may be a controller of the display device, but is not limited thereto.

It should be noted that, in the embodiment of the present application, the receiving of the voice command is implemented through the user input interface (218-1 and/or 218-n) shown in fig. 2.

Fig. 16 is a flowchart of a display method according to some embodiments of the present application, as shown in fig. 16, where the method may include:

step 101, when the display is in a screen protection state, receiving a voice instruction input by a user.

In some embodiments, receiving user input to speak may be performed by the display in a subsequent step while the display is, or not, the display is, e.g., a screen saver

102, acquiring a semantic analysis result of the voice instruction, and judging whether the voice instruction is matched with a preset instruction according to the semantic analysis result; step 103 is performed when the voice command matches a preset command, and step 104 is performed when the voice command does not match a preset command.

In some embodiments, the controller needs to make a determination that the voice command matches the preset command, which may correspond to steps 102-104, or may be other steps that can implement the determination that the voice command matches the preset command.

In some embodiments, the display device sends the voice command to a voice parsing server to obtain a corresponding semantic parsing result, or the display device parses the voice command through its own program to obtain a voice parsing result. Judging whether the voice instruction is matched with the preset instruction or not by judging whether the semantic analysis result is matched with an interface prompt corresponding to the preset instruction or not, wherein the interface prompt is displayed on the screen saver picture; if the semantic analysis result is matched with the interface prompt corresponding to the preset instruction, the voice instruction is matched with the preset instruction, and if the semantic analysis result is not matched with the interface prompt corresponding to the preset instruction, the voice instruction is not matched with the preset instruction.

Step 103, when the voice command is matched with a preset command, maintaining the screen protection state, and displaying a feedback message corresponding to the voice command on a screen protection picture;

In some embodiments, the maintenance of the screen saver state is the display of a position screen saver, and may be the display of one screen saver or the display of a plurality of screen savers, so long as the display device is in the screen saver state.

In some embodiments, the feedback message is presented above the screen saver screen in a floating layer.

In some embodiments, the screen saver when the feedback message is presented may be the same as or different from the screen saver when the voice command is received.

And 104, when the voice instruction is not matched with a preset instruction, exiting the screen protection state.

In some embodiments, exiting the screen saver state refers to dropping the presentation of the screen saver screen.

In some embodiments, after the display of the screen saver is canceled, if there is an operation result corresponding to the voice instruction, displaying the operation result corresponding to the voice instruction on the user interface.

In some embodiments, after the display of the screen saver screen is dismissed, if there is no operation result corresponding to the voice instruction, displaying the user interface before entering the screen saver state, and displaying a prompt that the voice instruction cannot be recognized.

In some embodiments, when the screen saver is not displayed on the display, in response to receiving a voice command input by a user, an operation corresponding to the voice command is performed, for example, a volume up, down operation, a channel up, down operation, etc. corresponding to the voice command is performed. Or when the voice command is not recognized, displaying a prompt that the voice command cannot be recognized.

As can be seen from the embodiment shown in fig. 16, in some embodiments, the display method provided by the present application not only enables a user to control the display device through voice input, so as to implement a quick operation on the display device, but also can maintain the screen saver state without exiting, and continue to enjoy the screen saver.

It should be noted that, in the embodiment of the present application, the receiving of the voice command is implemented through the user input interface (218-1 and/or 218-n) shown in fig. 4.

Fig. 17 is a flowchart of a display method according to some embodiments of the present application, where, as shown in fig. 17, a preset instruction is taken to participate in a network activity, and a prompt for success of participation is given on a screen saver, where the method may include:

step 201, displaying a program screen, a user interface or a screen saver file screen on a display.

For example, the program screen is first displayed on the display, but may be a user interface, where the program screen is displayed in the Video layer and the user interface is displayed in the OSD layer. When the time of the same program picture or the same user interface displayed on the display reaches a preset value, namely the rest time of the screen of the display reaches the preset value, the picture of the screen saver file is displayed on the top layer of the OSD layer.

Step 202, receiving a voice instruction input by a user.

For example, a voice command may be entered by pressing a voice input key on a remote control. For example, when the display shows the screen saver screen shown in FIG. 14, the user presses the voice input key and speaks "focus" ^** For 3 years ", to register for lottery and prompt on screen saver.

For another example, the user presses a voice input key to say "how weather today" to obtain weather data provided by the display device and display a weather data interface.

For another example, if the command spoken by the user pressing the voice input key is not recognized, an interface in front of the screen saver is displayed.

In step 203, in response to receiving the voice command, it is determined whether the display screen is in a screen saver state. If in the screen saver state, step 204 is performed, and if not, step 209 is performed.

In some possible implementations, whether the display screen is in a screen saver state is determined by determining whether the foreground application is a screen saver application. If the foreground application is a screen saver application, the display screen is in a screen saver state, and if the foreground application is not a screen saver application, the display screen is in a non-screen saver state.

Step 204, if the display screen is in the screen saver state, the screen saver state is kept not to be exited, and the semantic analysis result of the voice instruction is obtained.

Step 205, judging whether the voice command is a preset command for indicating to participate in network activities according to the acquired voice analysis result.

Referring to fig. 4, the external instruction recognition module 2907 may include a voice recognition module 2907-2, and a voice database is stored in the voice recognition module 2907-2, in which the above-mentioned preset instructions for instructing to participate in the network activity are stored in advance. When a voice command input by a user is received in a screen saver state, a voice assistant application is called in the background, and the received voice command is transmitted to a voice recognition module. And matching the received voice command with a preset command in a voice database through the voice recognition module, and returning a matching result to the voice assistant application so that the voice assistant application executes different logic control according to the specific matching result, for example, when the voice command input by the user is judged to be the preset command corresponding to prompt on a screen saver picture through matching, executing logic processing control or other corresponding processing logic participating in network activities, and otherwise, executing logic processing control corresponding to the command matched by the voice command.

In some embodiments, by performing semantic matching on the voice command and the preset command, it is determined whether the voice command input by the user is the preset command.

For example, when the semantic analysis result of the voice command is matched with the semantic of the interface prompt on the screen saver picture, determining that the voice command is a preset command for indicating to participate in network activities; when the semantic analysis result of the voice command is not matched with the semantic meaning of the interface prompt on the screen saver picture, judging that the voice command is not a preset command for indicating to participate in network activities.

And 206, when the voice command is determined to be a preset command, executing the processing of the voice command according to the network activity instructed to participate by the voice command so as to participate in the network activity.

The processing of the voice command to be executed is different depending on the network activity to be instructed to participate.

For example, when the "focus" as shown in FIG. 14 is displayed on the screen saver screen ^** And when the red packet is played for 3 years, responding to the received voice instruction for indicating to play the red packet, and sending a play request for requesting to play the red packet to the server by calling a service interface corresponding to the red packet, wherein the play request comprises user information such as a user ID. And receiving a participation result returned by the server, for example, a result indicating that the user has participated in success or failed in participation.

Step 207, displaying a text prompt containing the participation result on the upper layer of the screen protection file picture, and/or playing a voice prompt corresponding to the participation result.

By way of example, FIG. 18 shows a schematic diagram of floating layer display of a Toast hint containing participation results over a screen of a screen saver document, the Toast hint displaying text: you can please enter the activities after having been registered.

For example, the participation result may also be voice-broadcasted by the voice assistant application, for example, voice-broadcasted: you can please enter the activities after having been registered.

Thus, the user can finish the registration of the network activity without operating the control device for many times, and can continuously appreciate the screen saver picture.

In step 208, when the voice command is not the preset command, the screen of the screen saver file is canceled to exit the screen saver state.

In some embodiments, the display of the screen saver screen is dismissed when the screen saver state is exited; when the operation corresponding to the first voice instruction is not recognized, displaying an interface before the screen saver image is displayed; and displaying an interface corresponding to the first voice command when the operation corresponding to the first voice command is identified.

Step 209, if the display screen is in the non-screen-saver state, responding to the receiving of the voice command, and executing the operation corresponding to the voice command.

In some embodiments, if the display screen does not display the screen saver, the normal voice processing flow is executed, and the operation corresponding to the voice command is executed

In some embodiments, when it is determined that the voice command is not a preset command, in response to receiving the voice command, the display of the screen saver is canceled and an operation corresponding to the voice command is performed.

For example, a voice search page as shown in fig. 10 is presented.

According to the embodiment, when the voice command input by the user is received in the screen saver state, the screen saver state is kept not to exit so that the user can continuously enjoy the screen saver picture, and the semantic analysis result of the voice command is obtained; judging whether the voice command is a preset command for indicating to participate in network activities according to the semantic analysis result; when the voice command is judged to be the preset command, the processing of the voice command is executed according to the network activity which the voice command indicates to participate in, so that the network activity is quickly and conveniently named by voice, complicated user operation is not needed, waiting of a user is not needed, and user experience is friendly.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, where the program may include some or all of the steps in each embodiment of the method provided by the present invention, and when the controller of the display device provided by the present application runs the computer program instructions, the controller performs the steps in which the controller is configured. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (random access memory, RAM), or the like.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in essence or what contributes to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present invention.

The same or similar parts between the various embodiments in this specification are referred to each other. In particular, for the embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference should be made to the description of the method embodiments for the matters.

The embodiments of the present invention described above do not limit the scope of the present invention.

Claims

1. A display device, characterized by comprising:

a display for displaying a screen saver picture;

the user interface is used for receiving a voice instruction input by a user;

A controller for:

receiving a voice instruction input by a user when the display displays a screen saver picture, wherein an interface prompt for prompting participation in network activities is displayed on the screen saver picture;

when the voice command is matched with a preset command, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the voice command above the screen saver picture, wherein the preset command is a command corresponding to the interface prompt, and the feedback message is used for prompting the participation result of the network activity;

and when the voice command is not matched with a preset command, canceling display of the screen saver picture, and displaying an operation result corresponding to the voice command on a user interface, wherein the operation result is different from the participation result.

2. The display device of claim 1, wherein after the receiving the user-entered voice command, the controller is further configured to:

the voice command is sent to a voice server, and the voice server is used for analyzing the voice command to obtain a semantic analysis result;

receiving the semantic analysis result returned by the voice server;

And judging whether the voice instruction is matched with the preset instruction or not by judging whether the semantic analysis result is matched with the preset instruction or not.

3. The display device according to claim 2, wherein the controller is specifically configured to:

judging whether the voice instruction is matched with the preset instruction or not by judging whether the semantic analysis result is matched with an interface prompt corresponding to the preset instruction or not;

the voice command is matched with the preset command if the semantic analysis result is matched with the interface prompt corresponding to the preset command, and the voice command is not matched with the preset command if the semantic analysis result is not matched with the interface prompt corresponding to the preset command.

4. The display device of claim 1, wherein the controller is further configured to:

when the screen saver picture is not displayed on the display, responding to the voice command input by the user, and executing the operation corresponding to the voice command or feeding back the prompt that the voice command cannot be recognized.

5. A display device, characterized by comprising:

a display for displaying a screen saver picture;

The user interface is used for receiving a voice instruction input by a user;

a controller for:

receiving a first voice instruction input by a user;

when a screen saver picture is displayed by a display and an interface prompt for prompting participation in network activities is displayed on the screen saver picture, responding to the received first voice command, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the first voice command above the screen saver picture, wherein the first voice command corresponds to the interface prompt, and the feedback message is used for prompting participation results of the network activities;

when the screen saver picture is displayed by the display and the interface prompt word for prompting participation in the network activity is not displayed on the screen saver picture, the display of the screen saver picture is canceled in response to the received first voice command, and an activity interface corresponding to the first voice command is displayed so as to prompt the participation result of the network activity on the activity interface.

6. The display device according to claim 5, wherein the controller, in response to the received first voice instruction, cancels the display of the screen saver, and displays an active interface corresponding to the first voice instruction specifically:

The controller responds to the received first voice instruction and cancels the display of the screen saver picture;

when the operation corresponding to the first voice instruction is not recognized, displaying an interface before the screen saver image;

and when the operation corresponding to the first voice instruction is identified, displaying an active interface corresponding to the first voice instruction.

7. A display device, characterized by comprising:

the user interface is used for receiving the voice instruction of the user;

a controller for:

And when the voice command is not the preset command, exiting the screen saver state, and displaying an operation result corresponding to the voice command on a user interface, wherein the operation result is different from the participation result.

8. The display device of claim 7, wherein the screen saver has an interface prompt thereon for engaging in the network activity; the controller is specifically used for:

judging whether the voice instruction is the preset instruction or not by judging whether the semantic analysis result is matched with an interface prompt corresponding to the preset instruction or not;

the voice instruction is the preset instruction if the semantic analysis result is matched with the interface prompt corresponding to the preset instruction, and the voice instruction is not the preset instruction if the semantic analysis result is not matched with the interface prompt corresponding to the preset instruction.

9. The display device of claim 7, wherein the sending a participation request to a server requesting participation in the network activity comprises:

acquiring user information;

and sending a participation request for requesting to participate in the network activity to a server according to the user information and the service interface corresponding to the network activity.

10. The display device of claim 7, the presenting the received engagement results comprising:

and displaying a text prompt containing a participation result on a floating layer above the screen saver picture, and/or playing a voice prompt corresponding to the participation result.

11. The display device of claim 7, wherein prior to the maintaining the screensaver state, the controller is further configured to:

and when a voice instruction input by a user is received, judging whether the display screen is in a screen protection state.

12. The display device of claim 11, wherein the controller is further configured to:

when a voice command input by a user is received in a non-screen-saver state, responding to the receiving of the voice command, and executing an operation or feedback corresponding to the received voice command to fail to recognize the prompt of the voice command.

13. A display method applied to a display device, the method comprising:

receiving a voice instruction input by a user when a screen saver picture is displayed on a display, wherein an interface prompt for prompting participation in network activities is displayed on the screen saver picture;

14. A display method applied to a display device, the method comprising:

receiving a first voice instruction input by a user;

when a screen saver picture is displayed and an interface prompt prompting participation in network activities is displayed on the screen saver picture, responding to the received first voice instruction, maintaining display of the screen saver picture, and displaying a feedback message corresponding to the first voice instruction above the screen saver picture, wherein the first voice instruction corresponds to the interface prompt, and the feedback message is used for prompting participation results of the network activities;

When a screen saver picture is displayed and the interface prompt prompting participation in network activities is not displayed on the screen saver picture, responding to the received first voice command, canceling the display of the screen saver picture, and displaying an activity interface corresponding to the first voice command so as to prompt participation results of the network activities on the activity interface.

15. A display method applied to a display device, the method comprising: