CN113495711A

CN113495711A - Display apparatus and display method

Info

Publication number: CN113495711A
Application number: CN202010195696.3A
Authority: CN
Inventors: 孙鲁兵
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2020-03-19
Filing date: 2020-03-19
Publication date: 2021-10-12
Anticipated expiration: 2040-03-19
Also published as: WO2021184575A1; CN113495711B

Abstract

The application discloses a display device and a display method, wherein when a screen saver screen is displayed on a display, a voice instruction input by a user is received; when the voice instruction is matched with a preset instruction, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the voice instruction above the screen saver picture; and when the voice command is not matched with a preset command, canceling the display of the screen saver picture, and further realizing the quick operation of the display equipment in the screen saver state.

Description

Display apparatus and display method

Technical Field

The present application relates to the field of internet technologies, and in particular, to a display device and a display method.

Background

Currently, display devices may provide a user with a play picture such as audio, video, pictures, and the like. In practical applications, if the display device does not play video or receives no user input for a long time, that is, the display device displays the same picture for a long time, the screen of the display device may be aged and the service life of the display device may be shortened.

In order to prolong the service life of the screen of the display, a screen saver application (or called screen saver application) can be installed on the display device, and when the time length of the same picture displayed by the display reaches a certain length, the screen application presents a multimedia screen saver file on the top layer of the currently presented user interface, so that the screen of the display enters a screen saver state, and the purpose of protecting the screen is further achieved.

In the related art, when user input is received in the screensaver state, the screensaver state is immediately exited.

Disclosure of Invention

The application provides a display device and a processing method of a voice instruction, so that the display device can be operated quickly in a screen saver state.

In a first aspect, the present application provides a display device comprising:

a display for displaying a screen saver screen;

the user interface is used for receiving a voice instruction input by a user;

a controller to:

receiving a voice instruction input by a user when the display displays a screen saver screen;

when the voice instruction is matched with a preset instruction, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the voice instruction above the screen saver picture;

and when the voice instruction is not matched with a preset instruction, canceling the display of the screen saver picture.

In a second aspect, the present application provides a display device comprising:

a display for displaying a screen saver screen;

the user interface is used for receiving a voice instruction input by a user;

a controller to:

receiving a first voice instruction input by a user;

when a display displays a screen saver picture and an interface prompt is displayed on the screen saver picture, responding to the received first voice instruction, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the first voice instruction above the screen saver picture, wherein the first voice instruction corresponds to the interface prompt;

when the display displays a screen saver picture and the interface prompt is not displayed on the screen saver picture, canceling the display of the screen saver picture in response to the received first voice instruction, and displaying an interface in front of the screen saver picture or displaying an interface corresponding to the first voice instruction.

In a third aspect, the present application provides a display device comprising:

the display is used for presenting a screen saver picture when the display enters a screen saver state;

the user interface is used for receiving a voice instruction of a user;

a controller to:

when a voice command input by a user is received in a screen saver state, maintaining the screen saver state and acquiring a semantic analysis result of the voice command;

judging whether the voice instruction is a preset instruction indicating participation in network activities according to the semantic analysis result;

when the voice instruction is the preset instruction, sending a participation request for requesting participation in the network activity to a server, and displaying a received participation result under the condition of maintaining the screen saver state, wherein the participation request is used for enabling the server to return the participation result;

and when the voice instruction is not the preset instruction, exiting the screen saver state.

In a fourth aspect, the present application provides a display method applied to a display device, the method including:

receiving a voice instruction input by a user when a screen saver screen is displayed on a display;

In a fifth aspect, the present application provides a display method applied to a display device, the method including:

a display method is applied to a display device, and is characterized by comprising the following steps:

receiving a first voice instruction input by a user;

when a screen saver picture is displayed and an interface prompt is displayed on the screen saver picture, responding to the received first voice instruction, maintaining the display of the screen saver picture, and displaying a feedback message corresponding to the first voice instruction above the screen saver picture, wherein the first voice instruction corresponds to the interface prompt;

and when the screen saver picture is displayed and the interface prompt is not displayed on the screen saver picture, canceling the display of the screen saver picture in response to the received first voice instruction, and displaying an interface in front of the screen saver picture or displaying an interface corresponding to the first voice instruction.

In a sixth aspect, the present application provides a display method applied to a display device, the method including:

In the embodiment of the application, when the screen saver screen is displayed on the display, a voice instruction input by a user is received; when the voice instruction is matched with a preset instruction, maintaining the screen saver state, and displaying a feedback message corresponding to the voice instruction on the screen saver picture; and when the voice instruction is not matched with a preset instruction, exiting the screen saver state, and displaying an operation result corresponding to the voice instruction on a user interface, thereby realizing quick operation on display equipment in the screen saver state.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;

fig. 2 is a block diagram exemplarily showing a hardware configuration of a display device 200 according to an embodiment;

fig. 3 is a block diagram exemplarily showing a hardware configuration of the control apparatus 100 according to the embodiment;

fig. 4 is a diagram exemplarily showing a functional configuration of the display device 200 according to the embodiment;

fig. 5 is a diagram exemplarily showing a software configuration in the display device 200 according to the embodiment;

fig. 6 is a diagram exemplarily showing a configuration of an application program in the display device 200 according to the embodiment;

fig. 7 schematically illustrates a user interface in the display device 200 according to an embodiment;

FIG. 8a is an exemplary illustration of a program screen presented by a display device display;

FIG. 8b illustrates a user interface presented by the display device display;

FIG. 9 is an exemplary illustration of a screen displaying a screen saver file presented by the device display;

FIG. 10 is an exemplary illustration of a voice search interface presented by a display device display;

FIG. 11 is an exemplary illustration of a user interface presented by the display device display;

FIG. 12 illustrates one user interface presented by the display device display;

FIG. 13 illustrates one user interface presented by the display device display;

FIG. 14 is an exemplary illustration of a screen displaying a screen saver file presented by the device display;

FIG. 15 is an exemplary illustration of a screen displaying a screen saver file presented by the device display;

FIG. 16 is a flow chart of a display method;

FIG. 17 is a flow chart of a display method;

a screen displaying a screen saver file presented by the device display is illustrated in fig. 18.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," as well as any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module" as used herein refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device, such as the display device disclosed in this application, that is typically wirelessly controllable over a short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.

The control device 100 may control the display device 200 in a wireless or other wired manner by using a remote controller, including infrared protocol communication, bluetooth protocol communication, other short-distance communication manners, and the like. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the display device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, the display device 200 includes at least one of a controller 210, a tuner 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

A display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting a picture, and a driving assembly for driving the display of an image. The video content may be displayed from broadcast television content, or may be broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.

The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).

The display apparatus 200 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communication interface 230. And an infrared receiver, an interface device for receiving an infrared control signal for controlling the apparatus 100 (e.g., an infrared remote controller, etc.).

The detector 240 is a signal used by the display device 200 to collect an external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, and parameters such as parameter changes can be adaptively displayed by collecting the ambient light.

The image acquisition device 241, such as a camera and a camera, may be used to acquire an external environment scene, acquire attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize gestures of the user, so as to implement an interaction function with the user.

In some other exemplary embodiments, the detector 240, a temperature sensor, etc. may be provided, for example, by sensing the ambient temperature, and the display device 200 may adaptively adjust the display color temperature of the image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In other exemplary embodiments, the detector 240, and a sound collector, such as a microphone, may be used to receive a user's voice, a voice signal including a control instruction from the user to control the display device 200, or collect an ambient sound for identifying an ambient scene type, and the display device 200 may adapt to the ambient noise.

The input/output interface 250 controls data transmission between the display device 200 of the controller 210 and other external devices. Such as receiving video and audio signals or command instructions from an external device.

Input/output interface 250 may include, but is not limited to, the following: any one or more of high definition multimedia interface HDMI interface 251, analog or data high definition component input interface 253, composite video input interface 252, USB input interface 254, RGB ports (not shown in the figures), etc.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned plurality of interfaces.

The tuning demodulator 220 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, frequency mixing, resonance, and the like, and demodulates the television audio and video signals carried in the television channel frequency selected by the user and the EPG data signals from a plurality of wireless or wired broadcast television signals.

The tuner demodulator 220 is responsive to the user-selected television signal frequency and the television signal carried by the frequency, as selected by the user and controlled by the controller 210.

The tuner-demodulator 220 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation mode can be digital modulation or analog modulation. Depending on the type of television signal received, both analog and digital signals are possible.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the input/output interface 250.

The video processor 260-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

Illustratively, the video processor 260-1 includes at least one of a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain an audio signal that can be played in the speaker.

In other exemplary embodiments, video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with the controller 210 in one or more chips.

An audio output 272, which receives the sound signal output from the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and the external sound output terminal 274 that can be output to the generation device of the external device, in addition to the speaker 272 carried by the display device 200 itself, such as: an external sound interface or an earphone interface and the like.

The power supply provides power supply support for the display device 200 from the power input from the external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply interface installed outside the display device 200 to provide an external power supply in the display device 200.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210 according to the user input, and the display device 200 responds to the user input.

In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The controller 210 controls the operation of the display apparatus 200 and responds to the user's operation through various software control programs stored in the memory 290.

As shown in fig. 2, the controller 210 includes a RAM213 and a ROM214, as well as a graphic processor 216, a CPU processor 212, a communication interface 218, such as a first interface 218-1 to an nth interface 218-n, and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the display apparatus 200 starts power-on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM, copies the operating system stored in the memory 290 to the RAM213, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM213, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.

The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

Wherein the basic module is a bottom layer software module for signal communication among the various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A block diagram of the configuration of the control apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 3. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display apparatus 200 according to user demands.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similar to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

Fig. 4 is a diagram schematically illustrating a functional configuration of the display device 200 according to an exemplary embodiment. As shown in fig. 4, the memory 290 is used to store an operating system, an application program, contents, user data, and the like, and performs system operations for driving the display device 200 and various operations in response to a user under the control of the controller 210. The memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically configured to store an operating program for driving the controller 210 in the display device 200, and to store various application programs installed in the display device 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data such as the audio/video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuning demodulator 220, the input/output interface of the detector 240, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The example memory 290 includes at least one of a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, and so forth. The controller 210 performs functions such as: a broadcast television signal reception demodulation function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction recognition function, a communication control function, an optical signal reception function, an electric power control function, a software control platform supporting various functions, a browser function, and the like.

Fig. 5 is a block diagram illustrating a configuration of a software system in the display apparatus 200 according to an exemplary embodiment.

As shown in fig. 5, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary for data processing performed between application programs and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display screen, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controllable process management, including runtime applications and the like.

The event transmission system 2914, which may be implemented within the operating system 2911 or within the application program 2912, in some embodiments, on the one hand, within the operating system 2911 and on the other hand, within the application program 2912, is configured to listen for various user input events, and to refer to handlers that perform one or more predefined operations in response to the identification of various types of events or sub-events, depending on the various events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control device 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting gestures through gesture recognition, inputting sub-events through remote control key commands of the control equipment and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout manager 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, and other various execution operations related to the layout of the interface.

As shown in fig. 6, the application layer 2912 contains various applications that may also be executed at the display device 200. The application may include, but is not limited to, one or more applications such as: at least one of a live television application, a video-on-demand application, a media center application, an application center, a gaming application, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 7. As shown in fig. 7, the user interface includes a plurality of view display areas, illustratively, a first view display area 201 and a play screen 202, wherein the play screen includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.

It should be noted that the multiple view display areas may present display screens of different hierarchies. For example, a first view display area may present video chat project content and a second view display area may present application layer project content (e.g., web page video, VOD presentations, application screens, etc.).

Optionally, the different view display areas are presented with different priorities, and the display priorities of the view display areas are different among the view display areas with different priorities. If the priority of the system layer is higher than that of the application layer, when the user uses the acquisition selector and picture switching in the application layer, the picture display of the view display area of the system layer is not blocked; and when the size and the position of the view display area of the application layer are changed according to the selection of the user, the size and the position of the view display area of the system layer are not influenced.

The display frames of the same hierarchy can also be presented, at this time, the selector can switch between the first view display area and the second view display area, and when the size and the position of the first view display area are changed, the size and the position of the second view display area can be changed along with the change.

In some embodiments, any one of the regions in fig. 7 may display a picture captured by the camera.

Fig. 8a is a program screen exemplarily shown in the embodiment of the present application, and fig. 8b is a user interface exemplarily shown in the embodiment of the present application. When the display displays the same program picture or the user interface is too long, the screen is aged, which is not favorable for the service life of the screen.

In order to avoid that the display displays the same program picture or the same user interface for a long time, when the time for displaying the same playing picture by the display reaches a preset value, the picture of the screen saver file is immediately displayed on the display, and the purpose of protecting the screen is further achieved.

Referring to fig. 4, an application 3912 or an application 2912 is stored in the memory 390 or the memory 290, where the application 3912 or the application 2912 includes a screen saver (not shown), the controller times a static time (a time for displaying the same playing screen) of a display screen by running a screen saver application, reads a screen saver file (such as a picture file) stored in the memory in advance when the static time reaches a preset value, processes the read screen saver file by the video processor to obtain an image signal for display, and outputs the image signal to the display through the output interface, so as to display a screen saver picture, which is a screen saver picture, on an upper layer of a picture currently displayed by the display.

In some embodiments, a screen saver screen refers to an image file that is displayed in a screen locked state (screen saver state) to avoid pixel degradation caused by pixels remaining the same content for a long time.

In some embodiments, a screen saver picture refers to an image file for display on a display during the execution of a screen saver (screen saver).

For example, a screen saver screen is displayed on the upper layer of the screen shown in fig. 8a or 8b, and a screen saver screen as shown in fig. 9 is obtained. For ease of illustration, the display screen is in the non-screensaver state when the display displays a program picture or user interface as shown in fig. 8a or 8b, and the display screen is in the screensaver state when the display displays a screensaver picture as shown in fig. 9.

In some embodiments, the screen saver application is a foreground application running in the foreground when the display displays a screen of a screen saver file (e.g., an image file), i.e., in a screen saver state.

The foreground application may be an application presenting an interface displayed to a user, for example, if the interface displayed by the display is the a application, the a application is the foreground application, and if the user triggers the B application through the remote control device at this time, so that the display displays an interactive interface of the B application, the B application is the foreground application. The switching of the foreground application may be that, in the process of using the application a by the user, the display device automatically or under control starts the application B, and the content displayed by the display is switched from the interactive interface corresponding to the application a to the interactive interface corresponding to the application B.

When the display displays the screen saver screen as shown in fig. 9, that is, in the screen saver state, the user can input a control instruction to the controller by operating the control device 100, for example, the user can input a corresponding control instruction by using a volume up/down key, a channel control key, an up/down/left/right movement key, a voice input key, a menu key, etc. on the remote controller, and in response to a part or all of the control instruction input by the user, the controller cancels the display of the screen saver file to exit the screen saver state, and then returns to display the interface shown in fig. 8a or 8 b.

In some embodiments, the controller exits the screensaver state in response to any control command input by the user, and simultaneously, the controller executes an operation corresponding to the user input by running other programs (such as an application layer program, a middleware program and/or a kernel layer program).

For example, when the display displays a screen saver screen as shown in fig. 9, the user can press a voice input key on the remote controller to input a voice command, and the controller cancels the display of the screen saver file to make the screen exit the screen saver state in response to the voice command and controls the display of a voice search interface as shown in fig. 10.

In other embodiments, the controller presents a corresponding interface in response to a preset control instruction input by the user, for example, entering a screen saver setting interface, the user may input a control instruction for changing a screen saver picture by pressing a down direction key on the remote controller, and the controller displays an alternative screen saver picture as shown in fig. 11 on an upper layer of a currently displayed screen saver screen in response to the control instruction while maintaining the screen saver state. The controller exits the screen saver state in response to a control instruction other than the preset control instruction input by the user.

It can be seen from the above example that, when the screen saver screen is displayed on the display, if the user inputs a user input instruction including a voice instruction through the user interface, the screen saver state is triggered to exit, so that the user cannot continue to enjoy the screen saver screen, and if the user wants to continue to enjoy the screen saver screen, the user needs to wait for a certain time period or perform some tedious operations.

In order to solve the above problem, in some embodiments of the present application, a voice instruction (referred to as a preset instruction) that does not need to exit the screen saver state is preset and stored in the voice recognition module or the voice server, when the preset instruction is received in the screen saver state, the display device maintains the screen saver state, performs a corresponding operation of the preset instruction in the background, and displays a feedback message obtained by performing the operation, such as a Toast prompt ("congratulate you, signed up for activity") shown in fig. 18, on the screen saver screen. Furthermore, the user can control the display device through voice input to realize quick operation of the display device, and can keep the screen saver state without quitting and continue to enjoy the screen saver picture.

In some embodiments, when the display displays the screen saver screen as shown in fig. 8b, if the controller receives a voice command input by a user through the control device or using a far-field voice function of the display device, the controller maintains the screen saver state, and simultaneously sends the received voice command to the voice server or the voice recognition module for parsing, so as to obtain a semantic parsing result returned by the voice server or the voice recognition module. And then the controller judges whether the voice instruction is matched with the preset instruction or not by judging whether the voice analysis result is matched with an interface prompt corresponding to the preset instruction or not, when the voice instruction is matched with the preset instruction, the display of the screen saver picture is continuously maintained, namely, the screen saver state is maintained, a feedback message corresponding to the voice instruction is displayed above the screen saver picture in a floating layer mode, when the voice instruction is not matched with the preset instruction, the display of the screen saver picture is cancelled, namely, the screen saver state is exited, and an operation result corresponding to the voice instruction is displayed on a user interface or a prompt that the voice instruction cannot be identified is fed back. The technical solution of the present application will be described in detail with reference to specific examples.

In some embodiments, on the user interface as shown in fig. 8b, interface elements for joining/registering network activities, such as network lottery activities, reservation activities, red envelope robbing activities, etc., may be displayed, which may be clickable controls for triggering processes such as page jumps, etc. For example, as shown in FIG. 12, a user interface for participating in "poly" is displayed on the user interface^**Clickable controls for 3 anniversary lottery events ".

When the display displays the interface shown in fig. 12, the user can click the above-mentioned control by operating the control means, the controller jumps to the activity page shown in fig. 13 in response to the click input by the user, and on the activity page shown in fig. 13, the user again operates the control means to click a button "entry activity" for participating in the activity on the activity page, and the controller requests the server to participate in the network activity in response to the user input.

As can be seen from the above example, if a user wants to participate in a network activity displayed on a screen saver interface, the user needs to operate the control device many times and needs to go through a process of waiting for the user, such as page jump, so that the registration process of the network activity is not fast enough, which is not favorable for user experience.

In order to solve the above problem, in some embodiments of the present application, a voice instruction for instructing to participate in a network activity may be used as the preset instruction that does not need to exit the screen saver state, so that a user may input the voice instruction for instructing to participate in the network activity to the controller by controlling the operation device, and the controller responds to the voice instruction, and sends a participation request for requesting to participate in the network activity to the server while maintaining the screen saver screen, i.e., executes a registration process of the user, thereby implementing a voice prompt registration, and displaying a received participation result while maintaining the screen saver state.

As described in the above example, the preset instructions may have corresponding interface prompts, which may be displayed on the screen saver screen, so that when the display displays the screen saver screen, the user may input the corresponding preset instructions according to the interface prompts thereon. For example, in some embodiments, information related to a network activity and an interface prompt for participating in the network interaction may be displayed on a screen saver screen, and a user may input a voice instruction for participating in the network activity according to a prompt of the interface prompt. For example, as shown in FIG. 14, a screen saver screen is displayed with! Voice speaking focus^**3 annual entry into a lottery event ". It should be noted that the interface prompt may be a text included in the screen saver file, or may be a text displayed in a transparent layer on the upper layer of the screen saver file.

In some embodiments, the interface prompt is an inherent part of the image file corresponding to the screen saver screen, that is, the image file with the interface prompt is a poster specifically made for the network event, and the interface prompt is displayed as a part of the image file and the image file on the same layer of the screen saver screen.

In some embodiments, the interface hint is a newly generated portion on the screen saver screen according to a promotion requirement, that is, the image file is a conventional screen saver picture, and when the image file is displayed, in response to a requirement for displaying an activity hint, the controller controls the display to draw a new floating layer above a layer where the image file is located to display the interface hint, where the layer where the interface hint is located above the layer where the image file is located, and at this time, the interface hint and the image file are collectively used as the screen saver screen to be periodically displayed (that is, the interface hint is switched with switching of the image file). This arrangement advantageously provides for system efficiency without the need for promotional posters specifically created for the network event.

As can be seen from the above example, if the display device receives a voice instruction for instructing to participate in a network activity in the screen saver state, the screen saver state can be maintained without exiting, and an operation corresponding to the voice instruction is executed in the background, so that the user can continue to enjoy a screen saver screen, and at the same time, an operation result corresponding to the voice instruction, that is, an participation result indicating whether the activity is successfully participated or not, can be obtained.

In some embodiments, the preset instructions may have a corresponding validity period, such as a validity period of the voice instructions for participating in the network activity, i.e., a holding period of the network activity. Correspondingly, the interface prompt corresponding to the preset instruction is only displayed on the screen saver screen in the valid period, for example, during the holding period of the network event, the interface prompt for participating in the network interaction is displayed on the screen saver screen, and after the event holding is finished, the screen saver file with the interface prompt is not displayed. The preset instruction corresponds to the interface prompt, and the validity period of the preset instruction is the validity period of the interface prompt. In the specific implementation, the screen saver can be implemented by updating the screen saver file.

Based on the above embodiments, in some embodiments of the present application, if and only if the display displays the screen saver screen and the interface prompt corresponding to the first voice instruction is displayed on the screen saver screen, the display of the screen saver screen is maintained in response to receiving the first voice instruction, and the feedback message corresponding to the first voice instruction is displayed on the screen saver screen, so as to ensure that the shortcut operation on the display device is only implemented within the valid period of the interface prompt/first voice instruction (preset instruction), and avoid the user from mistakenly operating the display device outside the valid period of the interface prompt/first voice instruction (preset instruction). For example, if and only if the display displays a screen saver screen with an interface prompt for participation in the network activity on the screen saver screen, in response to receiving a voice instruction for participation in the network activity, display of the screen saver screen is maintained and a participation result is displayed on the screen saver screen.

Further, in the above embodiment, when the display displays the screen saver screen and the interface prompt corresponding to the first voice instruction is not displayed on the screen saver screen, in response to receiving the first voice instruction, the display of the screen saver screen is cancelled to exit the screen saver state, and the interface before entering the screen saver state or the interface corresponding to the first voice instruction is displayed, so that the display device is prevented from being operated by mistake outside the validity period of the interface prompt/the preset instruction.

For example, the controller may cancel display of the screen saver screen in response to the received first voice instruction; when the operation corresponding to the first voice instruction is not identified, displaying an interface in front of a screen saver picture; and when the operation corresponding to the first voice instruction is identified, displaying an interface corresponding to the first voice instruction.

As can be seen from the above example, also in the screen saver state, the controller will respond differently to the same voice command (i.e., the first voice command) when there is an interface prompt on the screen saver screen and when there is no interface prompt on the screen saver screen. When the screen saver picture has the interface prompt, the interface prompt means in the valid period of the interface prompt, and if a first voice instruction is received, the display equipment maintains the screen saver state and displays a feedback message corresponding to the first voice instruction on the screen saver picture; when the screen saver picture does not have the interface prompt, the interface prompt is beyond the valid period of the interface prompt, and at the moment, if the first voice instruction is received, the display equipment exits the screen saver state so as to display the interface before entering the screen saver state or display the interface corresponding to the first voice instruction.

In some embodiments, the same voice instruction directly executes an operation corresponding to the voice instruction when the screen saver interface is not displayed, for example, if the voice instruction corresponding to the interface hint is input in a non-screen saver state, the intelligent terminal parses the voice instruction and sends the voice instruction to the server, the server returns an interface corresponding to the voice instruction to the display device, and the display device displays the corresponding interface according to the received interface information, for example, the interface corresponding to the first voice instruction received in the non-screen saver state may be an activity interface as shown in fig. 15, and as shown in fig. 15, the display activity on the activity page is finished.

In other embodiments, the interface corresponding to the first voice command may be a voice search interface as shown in fig. 10. Of course, other interfaces related to the first voice command similar to the page shown in fig. 10 are also possible, and are not further listed in this application.

Referring to fig. 5, the applications 3912 or 2912 may also include a voice assistant application (not shown), and the controller may perform voice-based interaction between the display device and the user by running the voice assistant application, for example, presenting a voice search page presented to the user, etc.

In some embodiments, the present application provides a display method, a main application scenario of the method is a display device, such as a smart television, and an execution subject of the method may be a controller of the display device, but is not limited thereto.

It should be noted that the embodiment of the present application implements receiving of the voice command through the user input interface (218-1 and/or 218-n) shown in fig. 2.

Fig. 16 is a flowchart illustrating a display method according to some embodiments of the present application, and as shown in fig. 16, the method may include:

step 101, receiving a voice instruction input by a user when a display is in a screen saver state.

In some embodiments, receiving the user input voice command may be performed when the display device is a screen saver screen or when the display device is not a screen saver screen and the screen saver screen is displayed, and the display device performs the operation of the subsequent steps

102, obtaining a semantic analysis result of the voice instruction, and judging whether the voice instruction is matched with a preset instruction according to the semantic analysis result; when the voice command matches with the preset command, step 103 is executed, and when the voice command does not match with the preset command, step 104 is executed.

In some embodiments, the controller needs to make a determination that the voice command matches the preset command, which may correspond to steps 102-104, or may be another step that can implement the determination that the voice command matches the preset command.

In some embodiments, the display device sends the voice command to a voice parsing server to obtain a corresponding semantic parsing result, or the display device parses the voice command through its own program to obtain a voice parsing result. Judging whether the voice instruction is matched with the preset instruction by judging whether the semantic analysis result is matched with an interface prompt corresponding to the preset instruction, wherein the interface prompt is displayed on the screen saver picture; if the semantic analysis result is matched with the interface prompt corresponding to the preset instruction, the voice instruction is matched with the preset instruction, and if the semantic analysis result is not matched with the interface prompt corresponding to the preset instruction, the voice instruction is not matched with the preset instruction.

103, when the voice command is matched with a preset command, maintaining the screen saver state, and displaying a feedback message corresponding to the voice command on a screen saver picture;

in some embodiments, the maintaining of the screen saver state is the displaying of a screen saver screen at a position, at this time, the displaying of one screen saver screen at a position may be performed, or the displaying of a plurality of screen saver screens may be performed as long as the display device is in the screen saver state.

In some embodiments, the feedback message is presented above the screen saver screen in a floating layer.

In some embodiments, the screen saver screen on which the feedback message is presented may or may not be the same screen saver screen on which the voice command was received.

And 104, when the voice instruction is not matched with a preset instruction, exiting the screen saver state.

In some embodiments, exiting the screensaver state refers to dismissing the presentation of the screensaver screen.

In some embodiments, after the display of the screen saver screen is canceled, if an operation result corresponding to the voice instruction exists, the operation result corresponding to the voice instruction is displayed on the user interface.

In some embodiments, after the display of the screen saver screen is canceled, if there is no operation result corresponding to the voice instruction, the user interface before entering the screen saver state is displayed on the user interface, and a prompt that the voice instruction cannot be recognized is displayed.

In some embodiments, when the screen saver screen is not displayed on the display, in response to receiving a voice instruction input by a user, an operation corresponding to the voice instruction is performed, for example, volume up, volume down, channel up, channel down, and the like corresponding to the voice instruction are performed. Or when the voice command is not recognized, displaying a prompt that the voice command cannot be recognized.

As can be seen from the embodiment shown in fig. 16, in some embodiments, the display method provided in the present application enables a user to control the display device through voice input to implement a quick operation on the display device, and also can maintain the state of the screen saver without exiting, and continue to enjoy the screen saver screen.

It should be noted that the embodiment of the present application implements receiving of the voice command through the user input interface (218-1 and/or 218-n) shown in fig. 4.

Fig. 17 is a flowchart illustrating a display method according to some embodiments of the present application, and as shown in fig. 17, taking a preset instruction as an example of participating in a network activity and giving a prompt on a screen saver about successful participation, the method may include:

step 201, displaying a program picture, a user interface or a picture of a screen saver file on a display.

For example, a program picture is first displayed on the display, but it may also be a user interface, where the program picture is displayed on the Video layer and the user interface is displayed on the OSD layer. When the time of the same program picture or the same user interface displayed on the display reaches a preset value, namely the static time of the display screen reaches the preset value, the picture of the screen saver file is displayed on the top layer of the OSD layer.

Step 202, receiving a voice instruction input by a user.

Illustratively, the user may enter a voice command by pressing a voice input key on a remote control. For example, when the display displays the screen saver screen shown in FIG. 14, the user presses the voice input key and says "focus"^**3 years "to attend the lottery and prompt on the screen saver screen.

For another example, the user presses the voice input key to say "what is today's weather" to obtain weather data provided by the display device and display the weather data interface.

For another example, if the user presses the voice input key and the spoken command is not recognized, an interface in front of the screen saver screen is displayed.

Step 203, responding to the receiving of the voice command, and judging whether the display screen is in a screen saver state. If the screen saver state is present, step 204 is executed, and if the screen saver state is not present, step 209 is executed.

In some possible implementations, whether the display screen is in a screensaver state is determined by determining whether a foreground application is a screensaver application. If the foreground application is a screensaver application, the display screen is in a screensaver state, and if the foreground application is not a screensaver application, the display screen is in a non-screensaver state.

And step 204, if the screen of the display is in the screen saver state, keeping the screen saver state from exiting, and acquiring a semantic analysis result of the voice instruction.

Step 205, determining whether the voice command is a preset command indicating participation in network activities according to the obtained voice parsing result.

Referring to fig. 4, the external command recognition module 2907 may include a voice recognition module 2907-2, and a voice database is stored in the voice recognition module 2907-2, in which the preset command for instructing participation in the network activity is previously stored. When a voice command input by a user is received in the screen saver state, the voice assistant application is invoked in the background, and the received voice command is transmitted to the voice recognition module. Matching the received voice command with a preset command in a voice database through a voice recognition module, and returning a matching result to the voice assistant application so that the voice assistant application executes different logic controls according to the specific matching result, for example, when the voice command input by a user is judged to be a preset command corresponding to prompt on a screen saver screen through matching, executing logic processing control participating in network activities or other corresponding processing logic, otherwise, executing the logic processing control corresponding to the command matched with the voice command.

In some embodiments, whether the voice command input by the user is the preset command is determined by semantic matching the voice command and the preset command.

For example, when the semantic parsing result of the voice instruction matches the semantics of the interface prompt on the screen saver screen, it is determined that the voice instruction is a preset instruction indicating participation in a network activity; and when the semantic analysis result of the voice instruction is not matched with the semantics of the interface prompt words on the screen saver picture, judging that the voice instruction is not a preset instruction indicating participation in network activities.

And step 206, when the voice command is judged to be the preset command, executing the processing of the voice command according to the network activity which is indicated by the voice command to participate in the network activity.

It should be noted that the processing of the voice command performed differs according to the network activity instructed to participate.

Illustratively, when the screen saver screen displays "gather" as shown in FIG. 14^**3 year of year "Red envelope Activity, responsive to received indicationsAnd the voice instruction participating in the red packet activity sends a participation request requesting to participate in the red packet activity to the server by calling the service interface corresponding to the red packet activity, wherein the participation request comprises user information, such as a user ID. And receiving a participation result returned by the server, for example, a result indicating that the user has successfully participated in or failed to participate in.

And step 207, displaying a text prompt containing a participation result on the upper layer of the screen saver file, and/or playing a voice prompt corresponding to the participation result.

For example, fig. 18 shows a schematic diagram of displaying a Toast prompt containing a participation result in a floating layer above a screen of a screen saver file, where the Toast prompt displays the following characters: congratulate you and have been registered for activity.

For example, the participation result may also be broadcasted by voice through the voice assistant application, such as voice broadcast: congratulate you and have been registered for activity.

Therefore, the user can complete the registration of the network activity without operating the control device for many times, and can continue to enjoy the screen saver picture.

And step 208, when the voice command is not determined to be the preset command, canceling the picture of the screen saver file to exit the screen saver state.

In some embodiments, the display of the screen saver screen is deactivated upon exiting the screen saver state; when the operation corresponding to the first voice instruction is not identified, displaying an interface in front of a screen saver picture; and when the operation corresponding to the first voice instruction is identified, displaying an interface corresponding to the first voice instruction.

Step 209, if the display screen is in the non-screen saver state, responding to the receiving of the voice command, and executing the operation corresponding to the voice command.

In some embodiments, if the screen saver screen is not displayed on the display screen, the normal voice processing flow is executed, and the operation corresponding to the voice instruction is executed

In some embodiments, when it is determined that the voice command is not a preset command, the display of the screen saver screen is cancelled and an operation corresponding to the voice command is executed in response to receiving the voice command.

For example, a voice search page as shown in FIG. 10 is presented.

According to the embodiment, when the voice command input by the user is received in the screen saver state, the screen saver state is kept not to exit so that the user can continue to enjoy the screen saver picture, and meanwhile, the semantic analysis result of the voice command is obtained; judging whether the voice command is a preset command indicating participation in network activities according to the semantic analysis result; when the voice command is judged to be the preset command, the voice command is processed according to the network activity indicated by the voice command, and therefore the network activity is rapidly and conveniently reported through voice without complex user operation, waiting of a user and friendly user experience.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments of the method provided by the present invention when executed, and when the controller of the display device provided by the present application runs the computer program instructions, the controller executes the steps in which the controller described in the present application is configured. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the description in the method embodiments.

The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.

Claims

1. A display device, comprising:

a display for displaying a screen saver screen;

the user interface is used for receiving a voice instruction input by a user;

a controller to:

2. The display device of claim 1, wherein after the receiving of the user-input voice instruction, the controller is further configured to:

sending the voice instruction to a voice server, wherein the voice server is used for analyzing the voice instruction to obtain a semantic analysis result;

receiving the semantic parsing result returned by the voice server;

and judging whether the voice instruction is matched with the preset instruction or not by judging whether the semantic analysis result is matched with the preset instruction or not.

3. The display device of claim 2, wherein the controller is specifically configured to:

judging whether the voice instruction is matched with the preset instruction by judging whether the semantic analysis result is matched with an interface prompt corresponding to the preset instruction, wherein the interface prompt is displayed on the screen saver picture;

if the semantic analysis result is matched with the interface prompt corresponding to the preset instruction, the voice instruction is matched with the preset instruction, and if the semantic analysis result is not matched with the interface prompt corresponding to the preset instruction, the voice instruction is not matched with the preset instruction.

4. The display device of claim 1, wherein the controller is further configured to:

and when the screen saver screen is not displayed on the display, responding to a voice instruction input by a user, and executing operation corresponding to the voice instruction or feeding back a prompt that the voice instruction cannot be identified.

5. A display device, comprising:

a display for displaying a screen saver screen;

the user interface is used for receiving a voice instruction input by a user;

a controller to:

receiving a first voice instruction input by a user;

6. The display device according to claim 5, wherein the controller cancels the display of the screen saver screen in response to the received first voice instruction, and displays an interface in front of the screen saver screen or an interface corresponding to the first voice instruction, specifically:

the controller cancels the display of the screen saver picture in response to the received first voice instruction;

when the operation corresponding to the first voice instruction is not identified, displaying an interface in front of a screen saver picture;

and when the operation corresponding to the first voice instruction is identified, displaying an interface corresponding to the first voice instruction.

7. A display device, comprising:

the user interface is used for receiving a voice instruction of a user;

a controller to:

8. The display device of claim 7, wherein the screen saver screen has an interface prompt for engaging in the network activity; the controller is specifically configured to:

judging whether the voice instruction is the preset instruction or not by judging whether the semantic analysis result is matched with an interface prompt corresponding to the preset instruction or not;

if the semantic analysis result is matched with the interface prompt corresponding to the preset instruction, the voice instruction is the preset instruction, and if the semantic analysis result is not matched with the interface prompt corresponding to the preset instruction, the voice instruction is not the preset instruction.

9. The display device according to claim 7, wherein the sending a participation request to a server requesting participation in the network activity comprises:

acquiring user information;

and sending a participation request for requesting to participate in the network activity to a server according to the user information and a service interface corresponding to the network activity.

10. The display device of claim 7, the presenting the received engagement results comprising:

and displaying a text prompt containing a participation result on a floating layer above the screen saver picture, and/or playing a voice prompt corresponding to the participation result.

11. The display device of claim 7, wherein before the maintaining the screen saver state and obtaining the semantic parsing result of the voice command, the controller is further configured to:

and when a voice instruction input by a user is received, judging whether the display screen is in a screen saver state.

12. The display device of claim 11, wherein the controller is further configured to:

when a voice command input by a user is received in a non-screen saver state, responding to the receiving of the voice command, executing the operation corresponding to the received voice command or feeding back a prompt that the voice command cannot be recognized.

13. A display method is applied to a display device, and is characterized by comprising the following steps:

14. A display method is applied to a display device, and is characterized by comprising the following steps:

receiving a first voice instruction input by a user;

15. A display method is applied to a display device, and is characterized by comprising the following steps: