CN112860331B

CN112860331B - Display equipment and voice interaction prompting method

Info

Publication number: CN112860331B
Application number: CN202110296619.1A
Authority: CN
Inventors: 郝云英; 黄宏勋
Original assignee: Vidaa Netherlands International Holdings BV; Vidaa USA Inc
Current assignee: Vidaa Netherlands International Holdings BV; Vidaa USA Inc
Priority date: 2021-03-19
Filing date: 2021-03-19
Publication date: 2023-11-10
Anticipated expiration: 2041-03-19
Also published as: CN112860331A

Abstract

The embodiment of the application discloses a display device and a prompting method of voice interaction, and the display device provided by the embodiment of the application comprises a display and a controller, wherein the controller is configured to respond to a starting instruction and read a starting mode; and generating prompt information according to the starting-up mode, wherein the prompt information is used for reminding a user of carrying out voice interaction with the display equipment. It can be seen that the display device shown in this embodiment may generate different prompt messages according to the power-on mode, where the prompt messages are used to remind the user of the mode of performing voice interaction with the display device. Through the prompt message, the user can better know the display equipment, and the user experience is better.

Description

Display equipment and voice interaction prompting method

Technical Field

The application relates to the technical field of file display, in particular to display equipment and a voice interaction prompting method.

Background

Since the display device may provide a user with a function such as a media asset playing function, which may be playing of audio, video, pictures, etc., is receiving a great deal of attention from the user. In recent years, the functional demands of users on display devices have increased. For example, some users may wish to interact with a display device using voice.

To meet the needs of users, some display devices support voice interaction functions. Some display devices may utilize a remote control to sound. And some display devices are directly provided with a sound receiving device, so that the sound receiving function capable of directly supporting voice is not directly communicated with the remote controller.

In the process of voice interaction between the display equipment and the user, the realization mode of the voice interaction function is diversified, and how to correctly guide the user to conveniently and rapidly use the voice interaction function of the display equipment becomes a technical problem to be solved urgently.

Disclosure of Invention

In order to solve the technical problems in the prior art, the embodiment of the application shows a display device and a voice interaction prompting method.

A first aspect of an embodiment of the present application provides a display apparatus, including:

a display;

a controller configured to control the operation of the device,

responding to a starting instruction, and reading a starting mode;

and generating prompt information according to the starting-up mode, wherein the prompt information is used for reminding a user of carrying out voice interaction with the display equipment.

The display device provided by the embodiment of the application comprises a display and a controller, wherein the controller is configured to respond to a starting instruction and read a starting mode; and generating prompt information according to the starting-up mode, wherein the prompt information is used for reminding a user of carrying out voice interaction with the display equipment. It can be seen that the display device shown in this embodiment may generate different prompt messages according to the power-on mode, where the prompt messages are used to remind the user of the mode of performing voice interaction with the display device. Through the prompt message, the user can better know the display equipment, and the user experience is better.

A second aspect of the embodiment of the present application provides a method for prompting voice interaction, including:

responding to a starting instruction, and reading a starting mode;

The voice interaction prompting method provided by the embodiment of the application comprises the steps of responding to a starting instruction and reading a starting mode; and generating prompt information according to the starting-up mode, wherein the prompt information is used for reminding a user of carrying out voice interaction with the display equipment. It can be seen that the method shown in this embodiment can generate different prompt messages according to the power-on mode, where the prompt messages are used to remind the user of the mode of performing voice interaction with the display device, and through the prompt messages, the user can better understand the display device, so that the user experience is better.

Drawings

In order to more clearly illustrate the embodiments of the present application or the implementation of the related art, the drawings that are required for the embodiments or the related art description will be briefly described, and it is apparent that the drawings in the following description are some embodiments of the present application and that other drawings may be obtained according to these drawings for a person having ordinary skill in the art.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 is a flowchart showing the overall operation of the display device in one possible embodiment;

FIG. 6 is a flowchart of a workflow diagram illustrating a display device according to one possible embodiment;

FIG. 7 is a schematic view of interface 1 of FIG. 5;

FIG. 8 is a schematic view of interface 1 of FIG. 5;

FIG. 9 is a flow chart of a prompt message display process according to a feasibility embodiment

FIG. 10 is a flowchart of a second and third hint information presentation process according to one embodiment of the present invention;

FIG. 11 is a schematic view of interface 3 of FIG. 5;

FIG. 12 is a schematic view of interface 4 of FIG. 5;

FIG. 13 is a schematic view of interface 5 of FIG. 5;

FIG. 14 is a schematic view of interface 6 of FIG. 5;

FIG. 15 is a schematic view of interface 7 of FIG. 5;

FIG. 16 is a schematic view of the interface 8 of FIG. 5;

FIG. 17 is a schematic view of interface 9 of FIG. 5;

FIG. 18 is a schematic view of the interface 10 of FIG. 5;

FIG. 19 is a schematic view of the interface 11 of FIG. 5;

FIG. 20 is a schematic view of interface 12 of FIG. 5;

FIG. 21 is a flow chart of a hint information presentation process according to one embodiment of the present application;

FIG. 22 is a flowchart of a fifth hint information presentation process according to one embodiment of the present application;

FIG. 23 is a schematic view of interface 13 of FIG. 5;

FIG. 24 is a schematic view of interface 14 of FIG. 5;

FIG. 25 is a schematic view of interface 15 of FIG. 5;

FIG. 26 is a schematic view of interface 16 of FIG. 5;

fig. 27 is a schematic view of the interface 17 of fig. 5.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet, computer, notebook, AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. For example, software steps executed by the server may migrate to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is configured to communicate with the outside, including at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, keys, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: operations to connect to a hyperlink page, document, image, etc., or operations to execute a program corresponding to an icon are displayed.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application instructions stored in the memory, and executing various applications, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode according to a standard codec protocol of an input signal, and at least one of noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on a display device body, or the like) that may be used to receive control inputs.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-thread communication (IPC) are operated and maintained. After the kernel is started, shell and user application are loaded again. The application is compiled into machine code after start-up, forming a thread.

Referring to fig. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (abbreviated as "application layer"), an application framework layer (APPlication Framework layer) (abbreviated as "framework layer"), a An Zhuoyun row (Android run) and a system library layer (abbreviated as "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application is running in the application layer, where the application may be a Window (Window) program, a system setup program, or a clock program, etc. that is self-contained in the operating system; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (APPlication programming interface, API) and programming framework for applications of the application layer. The application framework layer includes some predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application can access the resources in the system and obtain the services of the system in execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists or not, locking the screen, capturing the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

To meet the needs of users, some display devices support voice interaction functions. Some display devices may utilize a remote control to sound. And some display devices are directly provided with a sound receiving device, so that the sound receiving function capable of directly supporting voice is not directly communicated with the remote controller. In the process of voice interaction between the display equipment and the user, the realization mode of the voice interaction function is diversified, and how to correctly guide the user to conveniently and rapidly use the voice interaction function of the display equipment becomes a technical problem to be solved urgently.

In order to solve the technical problem, the embodiment of the application shows a display device, which at least comprises a display and a controller. Fig. 5 is a flowchart showing the overall operation of the display device according to one possible embodiment.

The operation of the display device will be described in detail with reference to the accompanying drawings, and fig. 6 is a flowchart of a possible embodiment of the operation flow chart of the display device. Wherein the controller is configured to execute S61 to S62;

s61, responding to a starting instruction, and reading a starting mode;

the power-on mode related to the present application may be, but not limited to, voice power-on, voice key power-on and power key power-on, and the three power-on modes will be described in detail later.

According to the application, the display can pop up different prompt messages according to different starting modes, and the prompt messages are used for reminding a user of the mode of voice interaction with the display equipment. Therefore, in the technical solution shown in this embodiment, the controller needs to read the power-on mode during power-on.

There are various implementations of the read-on mode.

As a feasible embodiment, the display device may include a remote controller, on which a plurality of keys are disposed, and a user may trigger the keys of the display device to start up through touch control to control the display device to start up, and the keys sent by different keys are different, so that the controller may identify the start-up mode of the display device by reading the keys. For example, in a feasible embodiment, a power key and a voice key are provided on the remote controller, and a user may touch the power key or the voice key to control the display device to be turned on. When a user touches a power key, the key code sent by the remote controller is different from the key code sent by the remote controller when the user touches a voice key, so that the controller can distinguish the starting mode according to the key code.

As a possible embodiment, the power-on mode of the display device only involves voice power-on, voice key power-on and power-on, where the controller receives the key code sent by the remote controller, and where the controller does not receive the key code, based on which the controller can determine whether the power-on mode of the display device is voice power-on by receiving the key code.

The present embodiment is merely illustrative of two implementations of the read power-on mode, and the implementation of the read power-on mode in the actual application process may be, but is not limited to, the two implementations described above.

And S62, generating prompt information according to the starting-up mode, wherein the prompt information is used for reminding a user of the mode of voice interaction with the display equipment.

According to the technical scheme, the starting-up modes are different, different prompt messages are popped up from the display, and the prompt messages are used for reminding a user of carrying out voice interaction with the display device, so that the user can conveniently and rapidly use the voice interaction function of the display device.

The technical solution shown in this embodiment is further described below with reference to specific examples.

As an implementation manner, the power-on mode may be voice power-on. In the case that the user starts up by voice, the user is informed that the user has already known the voice interaction with the display device, and in this case, no prompt message may be popped up. The voice startup mode may be, but is not limited to, collecting startup voice input by a user by using a remote controller, and then sending the received startup voice to the controller by the remote controller, so that the controller responds to startup voice startup. The voice startup mode may be that a sound receiving device arranged on the controller is used for receiving startup voice input by a user, and then the remote controller sends the received startup voice to the controller, so that the controller responds to startup voice startup.

In a feasible embodiment, the controller determines that the power-on mode is voice power-on in response to a power-on command. If the startup is successful, the interface displayed by the display can refer to fig. 7, and fig. 7 is a schematic diagram of the interface 1 in fig. 5; it can be seen that if the starting mode is voice starting, no prompt message is popped up on the display, and the display directly displays the home page. If the power on is unsuccessful, the interface displayed by the display can refer to fig. 8, and fig. 8 is a schematic diagram of the interface 2 in fig. 5; it can be seen that if the power on is unsuccessful, no content is shown on the display.

In a feasible implementation manner, the display device further comprises a remote controller, wherein the remote controller is provided with a power key, and in response to the touch of a user on the power key, the remote controller can send a starting instruction to the controller so that the controller is started in response to the starting instruction; the following describes a process of displaying the hint information in an application scenario where the power-on mode is a power-on mode with reference to a specific drawing, and fig. 9 is a flowchart of a process of displaying the hint information in a feasible embodiment, where the controller is further configured to execute S91-S96:

if the power-on mode is the power key power-on mode, the controller executes S91 to read a first identification bit, wherein the first identification bit is an identification bit of a far-field switch.

As an implementation manner, the far-field switch is used for controlling the far-field radio function of the controller to be turned on or off; when the far-field switch is in an on state, the far-field sound receiving function of the controller is started, and the corresponding controller can receive voice by utilizing the sound receiving device; when the far-field switch is in a closed state, the far-field sound receiving function of the controller is closed, and the corresponding controller cannot receive voice by utilizing the sound receiving device.

As an implementation manner, the first identification bit may be configured for the far-field switch, so that the controller knows that the far-field switch is in an on state or an off state; when the far-field switch is turned off, the state corresponding to the first identification bit is turned off, and when the far-field switch is turned on, the state corresponding to the first identification bit is turned on. Thus, the controller may determine the state of the far field switch via the first identification bit.

S92, judging whether the state corresponding to the first identification bit is an on state or not;

the implementation of determining whether the state corresponding to the first identification bit is an on state may be implemented by using a identification bit determining method that is conventional in the art, where the applicant does not make any limitation.

And if the state corresponding to the first identification bit is an on state, executing S93 to control the display to display first prompt information, wherein the first prompt information prompts a user that the far-field switch is in the on state.

If the state corresponding to the first identification bit is in the on state, the far-field switch is in the on state, and correspondingly, the first prompt information can be popped up on the display.

The following describes a manner of displaying the first prompt information with reference to the accompanying drawings, where the manner of displaying the first prompt information may refer to fig. 11, and fig. 11 is a schematic diagram of the interface 3 in fig. 5; it can be seen that the far-field switch is in an on state, and the controller controls the display to display a first prompt message "far-field switch on" 111.

It should be noted that "the far-field switch is turned on" is merely an exemplary description of a content of the first prompt information, and the content is not limited, and the content of the first prompt information can be configured according to the requirement in the practical application process, and any content that can remind the user that the far-field switch is in the turned-on state can be used as the content of the first prompt information.

As one implementation, the far field switch and the wake-up switch may be configured to turn off the far field switch when the wake-up switch is turned off. Wherein the wake-up switch is used for controlling whether the controller responds to the voice of the user. If the wake-up switch is off, the controller will not respond to the user's voice, in which case it is clearly wasteful of display device resources if the far-field switch is continued to be turned on. Therefore, in the technical solution shown in this embodiment, when the wake-up switch is turned off, the far-field switch is turned off. As one implementation, the far field switch and wake-up switch may be set to: the wake-up switch may be on or off when the far-field switch is off. As an implementation manner, if the far-field switch is turned off, the controller cannot use the far-field radio function, and in this case, the user can still receive the user's voice by using the radio function of the remote controller, so in the technical scheme shown in this embodiment, when the far-field switch is turned off, the wake-up switch can be turned on or turned off.

As a possible embodiment, if the far-field switch is in the on state, the controller may be further configured to read the state of the wake-up switch, and if the wake-up switch is in the on state, may control the display to pop up the prompt that the wake-up switch is in the on state.

As a possible embodiment, if the far-field switch is in an on state, the controller may be further configured to read a state of the wake-up switch, and if the wake-up switch is in an off state, may control the display to pop up a prompt that the wake-up switch is in the off state.

As a feasible embodiment, in order to prevent the first prompt information from being displayed for a long time and affecting the playing effect of the display, in some feasible embodiments, the controller may count the display time of the first prompt information, and if the display time is equal to the preset time, the controller controls the display to cancel the first prompt information.

The following description will explain the first prompt message to be withdrawn with reference to the accompanying drawings, and the display page of the display after the first prompt message is withdrawn can refer to fig. 12, and fig. 12 is a schematic diagram of the interface 4 in fig. 5; after the first prompt information is withdrawn, the display device continues to display the playing content.

As one possible embodiment, the user may display the home page by touching the home page key control display.

The manner of displaying the homepage will be described with reference to the accompanying drawings. In this embodiment, the user touches the home button, and the corresponding display displays the home page, and the display page of the display can refer to fig. 13, and fig. 13 is a schematic diagram of the interface 5 in fig. 5.

As a possible embodiment, if the display device has popped up the prompt message that the far-field switch is in the on state, after the user views the prompt message, the user has already known that the display device has the far-field radio function. In order to prevent the appearance of the prompt information from affecting the experience of the user in watching the video, the user sets a function of 'no longer reminding', so that the display does not pop up the prompt information.

The above-described display modes are described below with reference to the accompanying drawings. Referring to fig. 14, fig. 14 is a schematic diagram of the interface 6 in fig. 5. It can be seen that the display simultaneously displays the prompt 141 with the far-field switch in the on state and the "no longer alert control" 142, and in response to the user touching the "no longer alert control" 142, the display no longer pops up the prompt.

And if the state corresponding to the first identification bit is the closing state, executing S94 to control the display to display second prompt information, wherein the second prompt information reminds a user that the far-field switch is in the closing state.

The second prompt message is described below with reference to the accompanying drawings, and the second prompt message may be displayed by referring to fig. 15, where fig. 15 is a schematic diagram of the interface 7 in fig. 5; it can be seen that the far-field switch is in the off state, and the controller controls the display to display the second prompt message "far-field switch off" 151.

It should be noted that "the far-field switch is turned off" is merely an exemplary description of a content of the second prompt information, and the content is not limited, and the content of the second prompt information can be configured according to the requirement in the practical application process, and any content that can remind the user that the far-field switch is in the turned-off state can be used as the content of the second prompt information.

As a feasible embodiment, in order to prevent the second prompt information from being displayed for a long time and affecting the playing effect of the display, in some feasible embodiments, the controller may count the display time of the second prompt information, and if the display time is equal to the preset time, the controller controls the display to cancel the prompt information. Wherein the preset time may be set according to the requirements, for example, in a feasible embodiment, the preset time may be equal to 3s.

The following description will be made with reference to the accompanying drawings, in which the display page of the display after the second prompt is cancelled can be referred to fig. 16, and fig. 16 is a schematic diagram of the interface 8 in fig. 5; after the second prompt information is withdrawn, the display device continues to display the playing content.

The manner of displaying the homepage will be described with reference to the accompanying drawings. In this embodiment, the user touches the home page button, and the corresponding display displays the home page, and the display page of the display can refer to fig. 17, and fig. 17 is a schematic diagram of the interface 9 in fig. 5.

As a possible embodiment, if the state corresponding to the first identification bit is an off state, the controller is further configured to: s95, judging whether the operation of the user accords with a preset rule or not;

the preset rule is set in this embodiment to help the new user to understand the voice interaction function of the display device, and as a feasible embodiment, the preset rule may be to determine whether the user is a new user. The specific implementation process may be that the user starts up each time, the controller counts the time between the user start up and the first start up of the user, if the time is smaller than the preset time, the user is proved to be a new user, and in this case, the display needs to pop up the prompt information. The preset time can be set according to requirements. For example, in a viable embodiment, the preset time may be equal to 2 months.

The preset rule is set in the present embodiment in order to prevent the user from forgetting some functions of the display device without using the display device for a long time, and may be to judge whether the user has not used the display device for a long time in one possible embodiment. The specific implementation process can be as follows: and counting the time from the last startup of the user when the user starts up each time, and if the time is longer than the preset time, proving that the display equipment is not used for a long time, wherein the display is required to pop up prompt information. The preset time can be set according to requirements. For example, in a viable embodiment, the preset time may be equal to 7 days.

As a possible embodiment, the preset rule may be to determine whether the display device does not pop up the prompt message for a long time, and the specific implementation process may be: and counting the time from the last time the user pops up the prompt information after the user starts up each time, and if the time is longer than the preset time, proving that the display equipment is not used for a long time, wherein the display is required to pop up the prompt information under the condition. The preset time can be set according to requirements. For example, in a viable embodiment, the preset time may be equal to 7 days.

It should be noted that this embodiment is merely illustrative of the description of several preset rules, and the foregoing is not meant to be limiting, and the preset rules may be configured according to the needs during the actual application process, where the applicant does not make any excessive limitation.

And if the operation of the user accords with the preset rule, executing S96 to control the display device to pop up third prompt information, wherein the third prompt information is used for reminding the user of the starting mode of the far-field switch, or the third prompt information is also used for reminding the user of the starting modes of the wake-up switch and the far-field switch.

In order to prevent the second prompt information and the third prompt information from displaying the content which covers more play for a long time, in the technical scheme shown in the embodiment, the second prompt information and the third prompt information are displayed in steps, please refer to fig. 10, fig. 10 is a flowchart of a display process of the second prompt information and the third prompt information shown in a feasible embodiment; the controller is further configured to perform S101-S103;

s101, controlling a display to display second prompt information and an extension control;

in response to the touch control of the user on the extension control, executing S102 to control a display to display a detail control;

And in response to the touch control of the user on the detail control, executing S103 to control the display to display third prompt information.

The manner of displaying the homepage will be described with reference to the accompanying drawings. In this embodiment, the preset rule is "whether the user is a new user within 2 months, and whether the user is more than 7 days from the last use of the display device". In this embodiment, the user is a new user within 2 months, and the user is no more than 7 days from the last use of the display device. At this time, the interface displayed by the display device may refer to fig. 18, where fig. 18 corresponds to a schematic diagram of the interface 10 in fig. 5. It can be seen that the display shows a second hint message "far field switch off" 181 extension control 182 and detail control 183. In response to the touch of the user on the detail control 183, the display device displays third prompt information, specifically referring to fig. 19, fig. 19 is a schematic diagram of the interface 11 in fig. 5, and the interface shown in fig. 19 is used to display third prompt information 191, where in this embodiment, the third prompt information may include an on mode 192 of a wake-up switch, and an on mode 193 of the wake-up switch and the far-field switch. Optionally, in order to prevent the third prompt from displaying the third prompt for a long time to affect the viewing effect of the user, as a feasible embodiment, the third prompt may further include a return control 194, and the controller controls the display to withdraw the third prompt in response to the user touching the return control 194.

It should be noted that, the embodiment of the present application is merely an exemplary description of the content of the third prompt message, and the content is not limited to the embodiment, and the content of the third prompt message may be configured according to the requirement in the actual application process.

In one possible embodiment, the controller may further determine whether the radio receiver is in an on state, and the specific determination manner may refer to the determination manner of whether the wake-up switch or the far-field switch is on, which is not described in detail herein, if the radio receiver is in an off state, the interface displayed by the display may refer to fig. 20, where fig. 20 corresponds to the schematic diagram of the interface 12 in fig. 5; the display can be seen to pop up the prompt message of opening the radio device. The display content of the prompt information can be set according to the requirement, and the applicant does not limit the display content excessively.

As an implementation manner, the display device further includes a remote controller, where the remote controller is provided with a voice key, and in response to a user touching the voice key, the remote controller may send a startup instruction to the controller, so that the controller starts in response to the startup instruction;

the voice key in the embodiment at least comprises two functions, one is that when the display device is in a closed state, a user can control the display to be opened through touching the voice key; one is that when the display device is in an on state, the user presses the voice key for a long time, and the remote controller can start the radio function. The key code corresponding to the voice key is different from the key code corresponding to the power key.

In the following, description will be made on a process of displaying the hint information in an application scenario in which the startup mode is voice key startup with reference to the specific drawings, and fig. 21 is a flowchart of a hint information displaying process shown in a feasible embodiment, where the controller is further configured to execute S211 to S213:

if the power-on mode is voice key power-on, the step S211 is executed to read a second identification bit, wherein the second identification bit is the identification bit of the wake-up switch.

As one implementation manner, the wake-up switch is used for controlling whether the controller responds to user voices, wherein the user voices comprise voices received by the remote controller and voices received by the controller by utilizing a far-field radio function; when the wake-up switch is in an on state, the controller can respond to the voice of the user; when the wake-up switch is in the off state, the controller is unable to respond to the user's voice.

As an implementation manner, the second identification bit may be configured for the wake-up switch, so that the controller knows that the wake-up switch is in an on state or in an off state; when the wake-up switch is turned off, the state corresponding to the second identification bit is turned off, and when the wake-up switch is turned on, the state corresponding to the second identification bit is turned on. Thus, the controller may determine the state of the wake-up switch through the second identification bit.

S212, judging whether the state corresponding to the second identification bit is an on state or not;

the implementation of determining whether the state corresponding to the second identification bit is an on state may be implemented by using a identification bit determining method that is conventional in the art, where the applicant does not make any limitation.

If the state corresponding to the second identification bit is the on state, S213 controls the display to display a fourth prompting message, where the fourth prompting message is used to prompt the user for a new power-on mode, and the new power-on mode is different from the power-on mode adopted by the user.

The fourth prompting message is described below with reference to the accompanying drawings, and the fourth prompting message can be displayed by referring to fig. 23, and fig. 23 is a schematic diagram of the interface 13 in fig. 5; it can be seen that the wake-up switch is in an on state, and the controller controls the display to show a fourth prompt message, "you can say ALEXA turns on the display device" 231.

It should be noted that, "you can say that the ALEXA turn-on display device" is an exemplary presentation content introducing a fourth prompting message, the above content is not limited, and the presentation content of the fourth message can be configured according to the requirement in the actual application process, and any content that can play a role in prompting the user of a new turn-on mode can be used as the content of the fourth prompting message.

As an implementation, if the wake-up switch is in an on state, the controller may not read the state of the far-field switch because the display device may collect user speech using the radio function of the remote control.

As an implementation manner, if the wake-up switch is in an on state, the controller may continue to read the state of the far-field switch and generate corresponding prompt information according to the state of the far-field switch.

As a feasible embodiment, in order to prevent the fourth prompt information from being displayed for a long time and affecting the playing effect of the display, in some feasible embodiments, the controller may count the display time of the fourth prompt information, and if the display time is equal to the preset time, the controller controls the display to cancel the prompt information. The preset time may be set according to the requirement, for example, in a feasible embodiment, the preset time may be 3s.

The fourth prompt message is withdrawn by referring to the following description with reference to the accompanying drawings, and the display page of the display after withdrawal of the first prompt message may refer to fig. 24, fig. 24 is a schematic diagram of the interface 14 in fig. 5; after the fourth prompt information is withdrawn, the display device continues to display the playing content.

And if the state corresponding to the second identification bit is the off state, S214 controls the display to display fifth prompting information, wherein the fifth prompting information is used for prompting a user that the wake-up switch is in the off state.

The fifth prompt message is described below with reference to the accompanying drawings, and the fifth prompt message may be displayed by referring to fig. 25, where fig. 25 is a schematic diagram of the interface 15 in fig. 5; it can be seen that the wake-up switch is in an off state, and the controller controls the display to display a fifth prompt message "wake-up switch is off" 251.

It should be noted that "wake-up switch is turned off" is an exemplary presentation content introducing a fifth prompt message, and the content is not limited, and the presentation content of the fifth message may be configured according to the requirement in the actual application process, and any content that can serve as a reminder for a user that the wake-up switch is turned off may be used as the content of the fifth prompt message.

As an implementation manner, the fifth prompting information is further used for reminding the user of the starting mode of the wake-up switch, or the fifth prompting information is further used for reminding the user of the starting modes of the wake-up switch and the far-field switch.

In order to prevent the fifth prompt from covering more play content, the technical solution shown in this embodiment shows the fifth prompt in steps, please refer to fig. 22, which is a flowchart of a fifth prompt showing process shown in a feasible embodiment, where in this embodiment, the fifth prompt includes a first sub-information, an extension control, a detail control and a second sub-information; the controller is further configured to perform S221-S223;

if the state corresponding to the second identification bit is the closed state, executing S221 to control the display to display first sub-information and an extension control, wherein the first sub-information is used for reminding a user that the wake-up switch is in the closed state;

in response to the touch of the user on the extension control, S222 controls the display to display a detail control;

in response to the touch control of the user on the detail control, S223 controls the display to display second sub-information, wherein the second sub-information is used for reminding the user of the starting mode of the wake-up switch, or the fifth prompting information is also used for reminding the user of the starting modes of the wake-up switch and the far-field switch.

With continued reference to fig. 25, when it is determined that the wake-up switch is in the off state, the controller controls the display to display a first prompt message "wake-up switch is off" 251 and an extension control 251. The user can select the touch control extension control or the non-touch control extension control according to the requirement. In an application scenario of a user touch extension control, an interface displayed by a display may refer to fig. 26, where fig. 26 corresponds to a schematic diagram of the interface 16 in fig. 5; it can be seen that the display presents a first child control 261, an extension control 262, and a detail control 263. The user can select the touch detail control or the non-touch detail control according to the requirements. In an application scenario of the user touch detail control, referring to fig. 27, as can be seen from a schematic diagram of the interface 17 in fig. 27 corresponding to fig. 5, the display displays second sub-information 271, where the second sub-information may include an on mode 272 of a wake-up switch, the wake-up switch, and an on mode 273 of the far-field switch. Optionally, to prevent the third prompt from displaying the third prompt information for a long time to affect the viewing effect of the user, as a feasible embodiment, the second sub-information may further include a return control 274, and the controller controls the display to withdraw the second sub-information in response to the user touching the return control 274.

responding to a starting instruction, and reading a starting mode;

In a specific implementation, the present application further provides a computer storage medium, where the computer storage medium may store a program, where the program may include some or all of the steps in each embodiment of the method for customizing and starting a control key provided by the present application when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (random access memory, RAM), or the like.

It will be apparent to those skilled in the art that the techniques of embodiments of the present application may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present application may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments or some parts of the embodiments of the present application.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display;

the remote controller is provided with a power key and a voice key, responds to the touch control of a user on the power key or the voice key, and sends a corresponding starting instruction to the controller so that the controller responds to the corresponding starting instruction to start;

a controller configured to control the operation of the device,

responding to a starting instruction, and reading a starting mode;

when a power-on instruction corresponding to a power key is received, the power-on mode is that the power key is turned on, a first identification bit is read, the first identification bit is an identification bit of a far-field switch, and the far-field switch is used for controlling the far-field radio function of the controller to be turned on or off;

When the state corresponding to the first identification bit is an on state, the display is controlled to display first prompt information, and the first prompt information reminds a user that the far-field switch is in the on state; when the state corresponding to the first identification bit is in a closed state, the display is controlled to display second prompt information, and the second prompt information reminds a user that the far-field switch is in the closed state;

when a starting instruction corresponding to a voice key is received, the starting mode is voice key starting, a second identification bit is read, the second identification bit is an identification bit of a wake-up switch, the wake-up switch is used for controlling whether a controller responds to user voice or not, and the user voice comprises voice received by a remote controller and voice received by the controller by utilizing a far-field radio function;

when the state corresponding to the second identification bit is an on state, controlling a display to display fourth prompting information, wherein the fourth prompting information is used for prompting the wake-up switch to be in the on state; and when the state corresponding to the second identification bit is in the off state, controlling the display to display fifth prompting information, wherein the fifth prompting information is used for prompting a user that the wake-up switch is in the off state.

2. The display device of claim 1, wherein if the state corresponding to the first identification bit is an off state, the controller is further configured to:

judging whether the operation of the user accords with a preset rule or not;

if the operation of the user accords with a preset rule, the display device is controlled to pop up a third prompt message, wherein the third prompt message is used for reminding the user of the starting mode of the far-field switch, or the third prompt message is also used for reminding the user of the starting modes of the wake-up switch and the far-field switch.

3. The display device of claim 1, wherein the fifth prompt is further configured to alert a user of an on-mode of the wake-up switch or the fifth prompt is further configured to alert a user of an on-mode of the wake-up switch and the far-field switch.

4. The display device of claim 1, wherein the far field switch is in an off state if the wake-up switch is in an off state; and if the wake-up switch is in an on state, the far-field switch is in an off state or an on state.

5. The display device of claim 3, wherein the fifth hint information includes a first sub-information, an extension control, a detail control, and a second sub-information; the controller is further configured to:

If the state corresponding to the second identification bit is the closed state, controlling a display to display first sub-information and an extension control, wherein the first sub-information is used for reminding a user that the wake-up switch is in the closed state;

responding to the touch control of the user on the extension control, and controlling a display to display a detail control;

and responding to the touch control of the user on the detail control, controlling a display to display second sub-information, wherein the second sub-information is used for reminding the user of the starting mode of the wake-up switch, or the fifth prompting information is also used for reminding the user of the starting modes of the wake-up switch and the far-field switch.

6. A method for prompting voice interaction, applied to the display device of any one of claims 1-5, comprising:

responding to a starting instruction, and reading a starting mode;