CN117812310A

CN117812310A - Display equipment and display method of voice instruction learning page

Info

Publication number: CN117812310A
Application number: CN202311544362.2A
Authority: CN
Inventors: 范琳
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2023-11-17
Filing date: 2023-11-17
Publication date: 2024-04-02

Abstract

The application provides a display device and a display method of a voice instruction learning page. The display equipment receives a first control instruction input by a user, and responds to the first control instruction to obtain instruction information of an example sentence supporting response, wherein the instruction information comprises a first text, a first instruction and a first parameter corresponding to the example sentence, and the first parameter is a parameter required when the first instruction is executed. The display device displays a voice instruction learning page according to the instruction information, wherein the page comprises a first option corresponding to the example sentence, and a first text corresponding to the corresponding example sentence is displayed corresponding to the first option, and the first option is associated with a first instruction and a first parameter corresponding to the corresponding example sentence. Therefore, the user can learn the example sentences corresponding to the voice instructions through the voice instruction learning page, and can directly give the corresponding instructions to the display equipment by clicking the first option in the voice instruction learning page, so that the instruction giving operation of the user is simplified.

Description

Display equipment and display method of voice instruction learning page

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a display method of a voice instruction learning page.

Background

The display device refers to a terminal device capable of outputting a specific display screen, and may be a terminal device such as a smart television, a mobile terminal, a smart advertisement screen, and a projector. Taking intelligent electricity as an example, the intelligent television is based on the Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, and is a television product integrating multiple functions of video, entertainment, data and the like, and the intelligent television is used for meeting the diversified and personalized requirements of users.

The display device is configured with a Voice Assistant (Voice Assistant) function through which a user can interact with the display device in a Voice manner. The voice assistant is configured to respond to the voice including the specific content, and if the voice input by the user does not include the specific content, the voice assistant does not respond to the voice of the user, or does not conform to the actual intention of the user in response to the execution result of the voice of the user. The display device is configured with a voice instruction learning page, such as a help page of a voice assistant, that includes example sentences that the voice assistant supports corresponding to the voice, through which the user can learn.

After learning the example sentences through the voice instruction, the user still needs to input the voices corresponding to the example sentences in the form of voices to interact with the display device through the voice assistant. However, if the control device or the display device used by the user cannot well support the voice input function, such as the remote controller used by the user does not support the bluetooth function, the display device does not support the far-field voice function, etc., or the user is unfamiliar with the use of the voice assistant, such as the user cannot quickly and accurately find an entry for opening the voice assistant function, etc., even if the user grasps the example sentence, the display device cannot be controlled by the voice assistant, resulting in a greatly reduced experience of the user.

Disclosure of Invention

The application provides a display device and a display method of a voice instruction learning page, wherein the voice instruction learning page can be used for providing an example sentence corresponding to voice supported by a voice assistant, and corresponding instructions and parameters are associated with the example sentence, so that a user can give corresponding instructions to the display device in a mode of clicking the example sentence through a control device.

In a first aspect, the present application provides a display device, comprising:

A controller configured to:

receiving a first control instruction input by a user, wherein the first control instruction is used for indicating to display a voice instruction learning page;

in response to the first control instruction, acquiring instruction information of an example sentence of which the display device supports response, wherein the instruction information comprises: the method comprises the steps of enabling a display device to execute a first instruction according to a first text, a first instruction and a first parameter corresponding to the example sentence, wherein the first parameter is a parameter required by the display device when the first instruction is executed;

and controlling a display to display the voice instruction learning page according to the instruction information, wherein the voice instruction learning page comprises a first option corresponding to the example sentence, and displaying the first text corresponding to the corresponding example sentence corresponding to the first option, and the first option is associated with the first instruction and the first parameter corresponding to the corresponding example sentence.

In some embodiments of the present application, the controller, in response to the first control instruction, obtains instruction information of an example sentence of the display device supporting response, configured to:

retrieving the instruction information from a memory in response to the first control instruction;

Requesting the instruction information from a server if the instruction information does not exist in the memory;

wherein the controller is configured to: and deleting the instruction information stored in the memory in response to a power-down instruction.

In some embodiments of the present application, before the controller receives the first control instruction input by the user, the controller is configured to:

receiving a second control instruction input by a user, wherein the second control instruction is used for indicating to display a preposed page of the voice instruction learning page;

responding to the second control instruction, controlling the display to display the preposed page, wherein the preposed page comprises a second option, and the second option corresponds to an application scene of the example sentence, and the instruction information of the example sentence comprises the application scene to which the example sentence belongs;

when the front page is displayed, the controller responds to the first control instruction, acquires instruction information of an example statement of the display equipment supporting response, and is configured to:

and responding to the first control instruction input by the user based on the target second option, and acquiring the instruction information, wherein the instruction information comprises information of an application scene corresponding to the target second option.

In some embodiments of the present application, when displaying the voice instruction learning page, the controller is further configured to:

receiving a click command input by a user based on a target first option in the first options;

responding to the click command, and acquiring a target first command and a target first parameter associated with the target first option;

and executing the target first instruction according to the target first parameter.

receiving a first voice input by a user;

converting the first voice into a corresponding second text;

determining a target intention according to the second text;

and converting the target intention into corresponding instruction data, and executing corresponding instructions according to the instruction data, wherein if the second text is identical to the first text of the example sentence, the instruction data comprises the first instruction and the first parameter corresponding to the example sentence.

In some embodiments of the present application, the pre-page further includes a history option, and when the pre-page is displayed, the controller is further configured to:

Responding to a third control instruction input by a user based on the history record options, acquiring instruction information of a second instruction stored in the display device in a preset time period and storage time of the instruction information of the second instruction, wherein the second instruction is input by the user in a mode of inputting second voice and/or is input by the user in a mode of clicking a target option in the first option through the control device, the second voice comprises a first example sentence in the example sentences, the target option corresponds to the first example sentence, the instruction information of the second instruction comprises a third text corresponding to the first example sentence, the second instruction and a second parameter, and the second parameter is a parameter required by the display device when executing the second instruction;

and controlling the display to display a history page according to the instruction information of the second instruction and the storage time, wherein the history page comprises a third option corresponding to the first example sentence, the third option is displayed corresponding to the time period to which the storage time belongs, and the third text corresponding to the corresponding first example sentence is displayed corresponding to the third option, and the third option is associated with the second instruction and the second parameter corresponding to the corresponding first example sentence.

In some embodiments of the present application, the preset time period includes N time periods, and at most m third options are displayed in the history page corresponding to each time period, where N is a positive integer greater than 0, and m is a positive integer greater than 0.

In some embodiments of the present application, when displaying the history page, the controller is further configured to:

receiving a click command input by a user based on a target third option in the third options;

responding to the click command, and acquiring a target second command and a target second parameter associated with the target third option;

and executing the target second instruction according to the target second parameter.

In a second aspect, the present application further provides a method for displaying a learning page of voice instruction, which is applied to the display device according to any one of the first aspect, and the method includes:

And displaying the voice instruction learning page according to the instruction information, wherein the voice instruction learning page comprises a first option corresponding to the example sentence, and displaying the first text corresponding to the corresponding example sentence corresponding to the first option, and the first option is associated with the first instruction and the first parameter corresponding to the corresponding example sentence.

In some embodiments of the present application, the method further comprises:

The display device receives a first control instruction input by a user, and responds to the first control instruction to obtain instruction information of an example sentence which the display device supports to respond to, wherein the instruction information comprises a first text, a first instruction and a first parameter corresponding to the example sentence, and the first parameter is a parameter required by the display device when the display device executes the first instruction. The display device displays a voice instruction learning page according to the instruction information, wherein the page comprises a first option corresponding to the example sentence, and a first text corresponding to the corresponding example sentence is displayed corresponding to the first option, and the first option is associated with a first instruction and a first parameter corresponding to the corresponding example sentence. Therefore, the user can learn the example sentences corresponding to the voice instructions through the voice instruction learning page, and can directly give the corresponding instructions to the display equipment by clicking the first option in the voice instruction learning page, so that the instruction giving operation of the user is simplified.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a usage scenario of a display device according to an embodiment of the present application;

fig. 2 is a block diagram of a configuration of a control device in an embodiment of the present application;

fig. 3 is a configuration diagram of a display device in an embodiment of the present application;

fig. 4 is an operating system configuration diagram of a display device according to an embodiment of the present application;

FIG. 5 is a flowchart of a display device displaying a voice command learning page according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a front page in an embodiment of the present application;

FIG. 7 is a schematic diagram of a learning page of voice command in an embodiment of the present application;

FIG. 8 is a flowchart of a display device displaying a voice command learning page according to an embodiment of the present application;

fig. 9 is a flowchart of a display device acquiring instruction information in an embodiment of the present application;

FIG. 10 is a schematic diagram of a learning page of voice command in an embodiment of the present application;

FIG. 11 is a flowchart of a display device responding to a first instruction issued by a user based on a first option in an embodiment of the present application;

FIG. 12 is a flowchart of a display device responding to a first instruction issued by a user through voice in an embodiment of the present application;

FIG. 13 is a schematic diagram of a front page in an embodiment of the present application;

FIG. 14 is a flowchart of a display device displaying a history page in an embodiment of the present application;

FIG. 15 is a schematic diagram of a history page according to an embodiment of the present application;

fig. 16 is a flowchart of a display device responding to a second instruction issued by a user based on a third option in an embodiment of the present application.

Detailed Description

Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the examples below do not represent all embodiments consistent with the present application. Merely as examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided by the embodiment of the application can have various implementation forms, for example, can be a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table) and the like, and can also be a device with a display screen, such as a mobile phone, a tablet computer, a smart watch and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic view of a usage scenario of a display device according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the control device 100. In some embodiments, the display device 200 may obtain network data through the server 300 or obtain live signals through satellites.

Fig. 2 is a block diagram of the configuration of the control apparatus 100. In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device 200 may include at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 may be controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

Fig. 3 shows a block diagram of a configuration of the display device 200 in accordance with an exemplary embodiment.

The display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280.

In some embodiments, the display apparatus 200 may establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 300 through the communicator 220. In some embodiments, detector 230 includes a sound collector. The display device 200 may collect user voice through the sound collector and transmit the collected user voice to the controller 250 for processing. In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like. In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. In some embodiments, the controller 250 includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like. In some embodiments, the display 260 includes a display screen component for presenting pages, and a driving component for driving image display, components for receiving image signals output from the controller 250, displaying video content, image content, and menu manipulation interfaces, and user manipulation UI interfaces. In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection device, and a projection screen. In some embodiments, a user may input a user command through a graphical user interface (Graphic User Interface, GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command. In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the display device 100 is based on a VIDAA software platform, as shown in fig. 4, and the Linux platform-based operating system is divided into three layers, namely, an application layer, a middleware layer and a hardware layer from top to bottom. The application layer comprises various applications and application frameworks. The middleware layer includes various protocols and components. The hardware layer includes various interfaces, hardware and drivers.

The display device 200 is configured with a Voice Assistant (Voice Assistant) function through which a user can interact with the display device 200 in a Voice manner after turning on the Voice control function. In some embodiments, the portal for turning on the voice assistant function may be configured to control a designated key, such as a voice key, on the device 100 by which a user may input an instruction to turn on the voice assistant function to the display device 200. In some embodiments, the entry for turning on the voice assistant function may be configured to set a designated setting item in a menu, and the user may control the display device 200 to display the setting menu through the control device 100, then flip through the setting menu step by step to find the designated setting item, and after finding the designated setting item, input a selection instruction to the display device 200 through the control device 100 based on the designated setting item to turn on the voice assistant function. In some embodiments, the entry for opening the voice assistant function is configured as a shortcut option in a shortcut menu, and the user may control the display device 200 through the control device 100 to display the shortcut menu, find the shortcut option through the shortcut menu, and after finding the shortcut option, input a selection instruction to the display device 200 through the control device 100 based on the shortcut option to open the voice assistant function. In some embodiments, the portal to turn on the voice assistant function may be configured to specify a specified control on a page, such as a voice control in a launcher page, based on which a user may input a selected instruction to the display device 200 by the control device 100 to turn on the voice assistant function.

After turning on the voice assistant function, the user may wake up the voice assistant by voice and interact with the display device 200 through the voice assistant after waking up the voice assistant. The user may enter a wake-up instruction of the voice assistant to the display device 200 by a designated key on the control device 100, such as by the user pressing a voice key on the control device 100 for a long time. When the control device 100 supports the bluetooth function, as shown in fig. 1, a user can input voice to the display device 200 through the control device 100 to wake up a voice assistant by voice, and after the voice assistant is awakened, control the display device 200 by voice. When the display apparatus 200 supports the far-field voice function, as shown in fig. 1, the user may transmit voice in the vicinity of the display apparatus 200, collect the voice by the microphone of the display apparatus 200 to wake up the voice assistant by voice, and control the display apparatus 200 by voice after the voice assistant is awakened.

The voice assistant is configured to respond to voice that includes specific content. For example, the voice input by the user includes a wake word and the voice assistant wakes up. As another example, the user-entered voice includes a shutdown, and the voice assistant shuts down the display device 200 in response to the voice. If the voice input by the user does not include the specific contents, the voice assistant does not respond to the voice of the user, or the execution result of responding to the voice of the user does not conform to the real intention of the user. For example, if the voice input by the user does not include a wake word while the voice assistant is not awake, the voice assistant will not wake, i.e., will not respond to the user's voice. As another example, after the voice assistant wakes up, if the user wants to shut down, but the voice input by the user does not include content related to shutdown, such as voice includes standby, the voice assistant will standby the display device 200 in response to the voice, but the execution result does not conform to the actual intention of the user to shut down.

In order to improve the validity and accuracy of the voice input by the user, the display device 200 is configured with a voice instruction learning page, such as a help page of a voice assistant, which includes example sentences that the display device 200 supports responses, through which the user can learn, and when a certain function is required to be implemented by the display device 200, voices that include example sentences corresponding to the function so that the display device 200 can accurately execute the corresponding instructions.

The display device 200 may display a voice instruction learning page according to the flow shown in fig. 5, and the specific steps are as follows:

s501, receiving a first display instruction input by a user, wherein the first display instruction is used for indicating to display a front page.

In some embodiments, the user may input the second display instruction based on a designated key on the control device 100, e.g., the user may press a voice key on the control device 100 to input the second display instruction to the display device 200. In some embodiments, a designated icon or option, such as a voice control option, a voice assistant option, a VIDAAVOICE option, etc., may be configured in the system interface of the display device 200, which the user may click through by the control device 100 to input a second display instruction to the display device 200. In some embodiments, a designated option, such as a VIDAA option, a VIDAASmart TV option, etc., may be provided in a setup menu of the display device 200, and the user may click on the designated option through the control device 100 to input a second display instruction to the display device 200. In some embodiments, a designated shortcut option, such as a voice control option, a voice assistant option, etc., may be provided in the shortcut menu of the display device 200, and the user may click on the designated shortcut option through the control device 100 to input a second display instruction to the display device 200.

The second display instruction is used for indicating to display a voice setting page or a voice setting menu, wherein the voice setting page or the voice setting menu comprises a voice instruction learning option. The user can input a first display instruction to the display device 200 by clicking the voice instruction learning option through the control device 100.

S502, responding to a first display instruction, and displaying a front page.

The pre-page includes at least one option corresponding to an application scenario of the example statement. The example sentence is a voice content that the display device 200 supports in response, and when the display device 200 responds to a voice containing the example sentence, the voice is converted into a corresponding text including a text corresponding to the example sentence, the display device 200 analyzes a semantic meaning corresponding to the text corresponding to the example sentence, and determines a corresponding instruction according to the semantic meaning, thereby executing the instruction. It can be seen that the example sentence has corresponding instructions that the display device 200 executes to implement the corresponding functions, i.e. the example sentence has the corresponding implemented functions. Application scenes may be classified according to functions correspondingly implemented by example sentences, and for example, the application scenes may include searching for television programs (Search TV Programs), voice recommendations (Voice Recommendations), media Control (Media Control), television Basic Control (TV Basic Control), open device functions (Open Device Feature), browser (Browser), timer (Timer), voice Guide (Voice Guide), and the like.

Referring to the pre-page shown in fig. 6, the pre-page includes at least one option such as Search TV Programs, voice Recommendations, media Control, TV Basic Control, open Device Feature, browser, timer, and Voice Guide.

S503, responding to a selection instruction input by a user based on a target option, and acquiring a text corresponding to a target example sentence, wherein the target example sentence belongs to an application scene corresponding to the target option.

The user may input a selection instruction to the display device 200 by clicking the target option through the control device 100. The display device 200 determines an application scenario corresponding to the target option in response to the selection instruction, and obtains text of an example sentence belonging to the application scenario, that is, text of the target example sentence.

In some embodiments, the display device 200 obtains text of the target example sentence from the server 300. For example, the display apparatus 200 transmits a text request for requesting text of an example sentence of an application scene corresponding to the belonging target option to the server 300 in response to the selection instruction. The server 300 determines a target example sentence corresponding to the application scene and a text corresponding to the target example sentence in response to the text request, and returns the text of the target example sentence to the display device 200.

In some embodiments, the display device 200 may be configured to, after receiving the text of the target example sentence, store the text of the target example sentence locally, such as storing the text of the target example sentence in the first location. The display apparatus 200 first recognizes whether the text of the target example sentence exists at the first location in response to the selection instruction input by the user based on the target option, if the text of the target example sentence does not exist at the first location, it is stated that the display apparatus 200 needs to acquire the text of the target example sentence from the server 300, if the text of the target example sentence exists at the first location, it is stated that the display apparatus 200 has acquired the text of the target example sentence from the server 300, and the text of the target example sentence may be acquired directly from the first location without acquiring the text of the target example sentence again from the server 300.

In some embodiments, the display device 200 may be configured to delete text of the target example sentence stored in the first location in response to the power-down instruction. Thus, the display apparatus 200, after each power-up, re-acquires the text of the target example sentence from the server 300 if the voice instruction learning page is displayed. In this way, the display apparatus 200 can acquire the text of the latest version of the target example sentence from the server 300 in time.

In some embodiments, the example sentences belonging to the same application scenario may be further divided according to intent, i.e. the example sentences belonging to the same application scenario may be assigned at least one intent. For example, the example sentence of the generic Search TV Programs may belong to a plurality of intents, such as Specific Content (Specific Content), genre (Type), electronic program Guide (Electronic Program Guide, EPG)/television Guide (TV Guide).

In some embodiments, the data returned by the server 300 to the display device 200 further includes information about the target example sentence, such as an application scenario to which the target example sentence belongs, an intention to which the target example sentence belongs, a correspondence between the target example sentence and the intention, and the like.

In other embodiments, the display device 200 may send a text request to the server 300 in response to the first display instruction to request text and related information of the example sentence corresponding to each option in the pre-page from the server 300 at a time.

Taking the front page shown in fig. 6 as an example, if the user inputs a selection instruction based on Search TV Programs, the display device 200 may acquire the text of the target example sentence of Search TV Programs, which may be classified into a meaning, such as specific content, genre, and EPG/tv guide, from the server 300. The display device 200 may acquire the text of the target example sentence and the related information of the target example sentence, and may refer to the following data structure example 1 (the data structure example 1 is a simplified data structure, and only a portion of the example sentence intended to be specific and corresponding to the EPG/television guide is shown):

Wherein, "skillnde" is used to identify an application scenario, "intguide" is used to identify a text that is guided by intent, "type" is used to identify intent, and "content" is used to identify an example sentence.

S504, displaying a voice instruction learning page, wherein the voice instruction learning page comprises texts corresponding to target example sentences.

Taking Search TV Programs in the front page shown in fig. 6 as an example, the display apparatus 200 displays a voice instruction learning page shown in fig. 7, the voice instruction learning page including a classification field 701 and a presentation area 702, the classification field 701 including respective intents to which target example sentences belong, the presentation area 702 being for displaying target example sentences corresponding to the selected intents. Taking the example of the intent of the target example sentence affiliation of the affiliated Search TV Programs including specific content, genre, and EPG/tv guide, the display device 200 displays the specific content, genre, and EPG/tv guide options within the classification field 701. Taking the example of data structure example 1 shown above as a user selecting an EPG/tv guide, the display device 200 displays text of a target example sentence corresponding to the EPG/tv guide, such as "open EGP", "open program guide", "show me 8 pm programs", "show me channel 3 8 pm programs", in the display area 702.

After the user learns the example sentences through the voice instruction learning page, it is still necessary to input voices corresponding to the example sentences in the form of voices to interact with the display device 200 through the voice assistant. However, if the control device 100 or the display device 200 used by the user cannot well support the voice input function, such as the control device 100 (e.g., remote controller) used by the user does not support the bluetooth function, the display device 200 does not support the far-field voice function, etc., or the user is unfamiliar with the use of the voice assistant, such as the user cannot quickly and accurately find an entry for turning on the voice assistant function, etc., or the user cannot conveniently input voice, etc., the display device 200 cannot be controlled in a voice manner even if the user grasps the example sentence, resulting in a great reduction in the user's experience.

In order to solve the above-mentioned problems, the present application provides a display method of a voice instruction learning page, which allows a user to directly issue an instruction to the display device 200 in a manner of clicking an option on the page by the control device 100, without the user having to issue the instruction in a voice manner.

The display device 200 may display a voice instruction learning page according to the flow shown in fig. 8, and the specific steps are as follows:

S801, a first control instruction input by a user is received, wherein the first control instruction is used for indicating to display a voice instruction learning page.

Prior to step S801, the display apparatus 200 may perform steps S8011 to S8012, specifically as follows:

and S8011, receiving a second control instruction input by the user, wherein the second control instruction is used for indicating to display a preposed page of the voice instruction learning page. And S8012, responding to the second control instruction, and displaying the front page.

Steps S8011 to S8012 are similar to steps S501 to S502, and are not repeated here. In step S8012, the front page includes a second option similar to at least one option in the front page in step S502, corresponding to an application scenario of the example sentence.

S802, responding to a first control instruction, acquiring instruction information of an example statement of which the display device supports response, wherein the instruction information comprises: the first text, the first instruction and the first parameter corresponding to the example sentence, wherein the first parameter is a parameter required by the display equipment when executing the first instruction.

When the front page is displayed, the display apparatus 200 executes step S8021, specifically as follows:

s8021, responding to a first control instruction input by a user based on the target second option, and acquiring instruction information, wherein the instruction information comprises information of an application scene corresponding to the target second option.

The instruction information of the example sentence includes text of the example sentence (referred to as first text for convenience of distinction), and related information of the example sentence, such as an application scenario to which the example sentence belongs, an intention of the example sentence to be classified in the application scenario, and the like, reference may be made to the data structure example 1.

In some embodiments, the display apparatus 200 may obtain instruction information corresponding to the example sentence from the server 300 in response to the first control instruction. For example, the display apparatus 200 transmits, to the server 300, a request for requesting instruction information of an example sentence of an application scene corresponding to the target second option to which the request belongs, in response to the first control instruction. As shown in fig. 1, the server 300 determines an application scenario corresponding to the target second option in response to the request, and determines an example sentence included in the application scenario and instruction information corresponding to the example sentence. When determining an example sentence included in an application scenario, the server 300 may identify the application scenario according to information included in instruction information corresponding to the example sentence. If the information of the application scene included in the instruction information is matched with the application scene corresponding to the target second option, the example sentence corresponding to the instruction information belongs to the application scene corresponding to the target second option. If the information of the application scene included in the instruction information is not matched with the application scene corresponding to the target second option, the example sentence corresponding to the instruction information does not belong to the application scene corresponding to the target second option. The server 300 feeds back the determined instruction information to the display device 200.

In some embodiments, the display device 200 may be configured to store the instruction information sent by the server 300 locally, such as to a first location, after receiving the instruction information. In this way, the display device 200 may acquire instruction information according to the flow shown in fig. 9, and the specific steps are as follows:

s901, instruction information is acquired from a memory in response to a first control instruction.

The display device 200 may first obtain instruction information from the local area, such as first identifying whether the memory stores corresponding instruction information. If the corresponding instruction information is stored, it is explained that the display apparatus 200 does not need to acquire the instruction information again from the server 300, and the instruction information may be directly acquired from the memory.

S902, if the instruction information does not exist in the memory, the instruction information is requested from the server.

If the corresponding instruction information is not stored, i.e., the instruction information does not exist in the memory, it is indicated that the display apparatus 200 needs to acquire the instruction information from the server 300.

In some embodiments, the display device 200 may be further configured to delete the instruction information stored in the first location in response to the power-down instruction, i.e., the display device 200 needs to re-acquire the instruction information from the server 300 after each power-up if the voice instruction learning page is displayed. The process of the display device 200 obtaining instruction information may refer to steps S901-S902, where a difference from step S902 is that if instruction information does not exist in the memory, it is explained that after the current power-up, the display device 200 has not displayed a voice instruction learning page corresponding to the target second option.

In other embodiments, the display apparatus 200 may send a request to the server 300 in response to the second control instruction to request instruction information of an example sentence corresponding to each second option in the front page from the server 300 at a time.

In the embodiment of the present application, the instruction information of the example sentence acquired by the display device 200 further includes a first instruction and a first parameter corresponding to the example sentence. The first instruction is consistent with an instruction executed when the display apparatus 200 responds to the voice including the example sentence, and is included in instruction information transmitted from the server 300, i.e., set by the server 300, and thus, the display apparatus 200 does not need to determine by self-analyzing the example sentence. The first parameter is a parameter required for the display device 200 to execute the first instruction, and the first parameter is also included in the instruction information sent by the server 300, that is, set by the server 300, so that the display device 200 does not need to determine through self-analysis of the example sentence.

Taking the front page shown in fig. 6 as an example, if the user inputs a selection instruction based on Search TV Programs, the display device 200 may acquire instruction information of example sentences belonging to Search TV Programs, which may be classified into meaning, such as specific contents, genre, and EPG/tv guide, from the server 300. The display device 200 may acquire instruction information of an example sentence, and may refer to the following data structure example 2 (the data structure example 2 is a simplified data structure, and only a portion of the example sentence to which specific content is intended is shown):

/>

The method comprises the steps of using 'skillnde' to identify an application scene, using 'intguide' to identify guidance according to intention, using 'type' to identify intention, using 'content' to identify instruction information corresponding to an example sentence, using 'text' to identify text corresponding to the example sentence, using 'command' to identify an instruction corresponding to the example sentence, and using 'params' to identify parameters corresponding to the example sentence.

S803, according to the instruction information, displaying a voice instruction learning page. The voice instruction learning page includes first options corresponding to example sentences, and first text corresponding to the respective example sentences is displayed corresponding to the first options. Wherein the first option is associated with a first instruction and a first parameter corresponding to the respective example statement.

Each first option corresponds to one example sentence, and different first options correspond to different example sentences. The display apparatus 200 may display the first text of the example sentence on the first option, or the display apparatus 200 may set the first option in the form of the first text, or the display apparatus 200 may display the first text in a region corresponding to the first option, such as displaying the first text on the right side of the first option.

The display apparatus 200 configures the first option to be associated with the first instruction and the first parameter corresponding to the corresponding example sentence, so that when the user inputs the click instruction based on the first option, the display apparatus 200 may acquire the corresponding first instruction and first parameter based on the association relationship. In some embodiments, the display device 200 may obtain the first instruction and the first parameter associated with the first option according to the stored instruction information, for example, the display device 200 may obtain corresponding instruction information according to the first text corresponding to the first option, where the instruction information includes the first text, and obtain the instruction and the parameter in the instruction information, that is, the first instruction and the first parameter associated with the first option. In other embodiments, the display device 200 may map the first option with the stored instructions and parameters in the corresponding instruction information, and based on the mapping, the display device 200 may directly obtain the corresponding instructions and parameters, i.e. the first instruction and the first parameter associated with the first option.

Referring to a voice instruction learning page shown in fig. 10, the voice instruction learning page includes a classification column 1001 and a presentation area 1002, the classification column 1001 includes respective intents to which an example sentence is classified, and the presentation area 1002 is used to display the example sentence corresponding to the selected intention. Taking the example sentence of Search TV Programs as an example where the intent of the sentence grouping includes specific content, genre, and EPG/tv guide, the display device 200 displays the specific content, genre, and EPG/tv guide options within the classification column 1001. Taking the EPG/tv guide selected by the user as an example, the display apparatus 200 displays at least one first option of an example sentence corresponding to the EPG/tv guide in the presentation area 1002, and displays a first text of one example sentence corresponding to each first option. Taking the example of displaying the first text of the corresponding example sentence on the first option, for example, the first option 1003 corresponds to displaying the first text "open EGP", the first option 1004 corresponds to displaying the first text "open program guide", the first option 1005 corresponds to displaying the first text "show me 8 pm program", and the first option 1006 corresponds to displaying the first text "show me 8 pm program of channel 3".

In this way, the voice instruction learning page not only can provide the text of the example sentence for the user to learn the example sentence, but also can provide the user with an entry for clicking the input instruction in the form of the first option because the first instruction and the first parameter are associated with the first option in the voice instruction learning page, so that the display device 200 can directly acquire the first instruction and the first parameter corresponding to the selected first option, and the user can directly click the first option to give the first instruction to the display device 200 through the control device 100, thereby realizing the same effect as the first instruction given to the display device 200 by inputting the voice containing the corresponding example sentence, and effectively simplifying the operation of the user.

When displaying the voice instruction learning page, the display device 200 may respond to the first instruction issued by the user based on the first option according to the flow shown in fig. 11, and the specific steps are as follows:

s1101, receiving a click command input by a user based on a target first option in the first options.

The example statement corresponding to the target first option may express the function that the user wants to implement. Taking the control device 100 as an example of a remote controller, the user may move the focus to the target first option through the remote controller, and input a click command to the display device 200 by pressing a determination key on the remote controller.

S1102, responding to the click command, and acquiring a target first command and a target first parameter associated with the target first option.

The target first option is associated with a target first instruction and a target first parameter corresponding to the corresponding example sentence, and the display device 200 may directly obtain the target first instruction and the target first parameter according to the association relationship between the target first option and the target first instruction and the target first parameter in response to the click instruction.

S1103, executing the target first instruction according to the target first parameter.

After the target first instruction and the target first parameter are acquired, the display device 200 may execute the target first instruction according to the target first parameter to implement the corresponding function indicated by the example sentence.

Thus, when the voice command learning page is displayed, the user can continue to use the control device 100 to issue the target first command to the display device 200, instead of having to issue the target first command in the form of voice, so that the problem that the control device 100 and/or the display device 200 used by the user cannot support the voice input function well or the user cannot master the voice input function skillfully can be solved.

Moreover, compared to the complex process in which the display device 200 responds to the first instruction given by the user in the form of voice, in step S1102, the display device 200 may quickly obtain the stored first target instruction and the first target parameter from the memory based on the association relationship between the first target option and the first target instruction and the first target parameter, so that the first target instruction may be quickly executed, and efficient response to the user instruction may be achieved.

When displaying the voice command learning page, the display device 200 may also respond to the first command issued by the user through voice according to the flow shown in fig. 12, and the specific steps are as follows:

s1201, a first voice input by a user is received.

After turning on the voice assistant function, the user may give a first instruction to the display apparatus 200 by inputting voice. The user may input the first voice to the display apparatus 200 through the control apparatus 100, or the user may input the first voice in the vicinity of the display apparatus 200 and collect the first voice through the microphone by the display apparatus 200.

S1202, converting the first voice into a corresponding second text.

After receiving the first voice, the display device 200 converts the first voice into a corresponding text, such as a second text. In some embodiments, the display device 200 may be configured with a speech recognition model, and the display device 200 may input the received first speech into the model and output the converted second text through the model.

S1203, determining the target intention according to the second text.

The display device 200 may analyze the second text through natural language processing (Natural Language Processing, NLP) techniques, such as extracting keywords, phrases, grammatical structures, etc. in the second text, thereby deducing the target intent of the user, i.e., determining the target intent corresponding to the second text.

S1204, converting the target intention into corresponding instruction data, and executing corresponding instructions according to the instruction data.

The display apparatus 200 extracts the related parameter information from the second text, for example, the second text is "switch to channel 1", and extracts the parameter information therefrom as channel name "1". Corresponding instruction parameters including an instruction, parameters required for executing the instruction, and the like are generated according to the target intention and the extracted parameter information, and the format of the instruction parameters conforms to the execution requirements of the display device 200. The display device 200 executes the corresponding instruction according to the parameters in the instruction data.

In step S1203, if the second text is an example sentence provided in the voice instruction learning page, it is explained that the first voice input by the user includes a content corresponding to the example sentence, and the instruction data converted in step S1204 may be the same as the instruction information corresponding to the example sentence, such as the instruction data includes the first instruction and the first parameter. In this way, the display device 200 executes the first instruction according to the first parameter in response to the first sentence including the example sentence, i.e., the user can issue the first instruction to the display device 200 by voice.

If the second text is not an example sentence provided in the voice instruction learning page, it is explained that the user does not input a voice in accordance with the example sentence, and the instruction data converted in step S1204 may be identical to the instruction information corresponding to the example sentence provided in the voice instruction learning page, the intention corresponding to the target intention obtained by the display device 200 analyzing the second text, according to the analysis result of the intention of the second text by the display device 200.

The display apparatus 200 is also configured with a history option in the front page, the history option being an entry for viewing the second instruction received by the display apparatus 200 in the preset time period, that is, an entry for viewing the second instruction input by the user to the display apparatus 200 in the preset time period. Referring to the pre-page shown in fig. 13, the pre-page shown in fig. 13 further includes a History option as compared to the pre-page shown in fig. 6.

The display device 200 may display the history page according to the flow shown in fig. 14, which includes the following steps:

s1401, in response to a third control instruction input by the user based on the history option, acquiring instruction information of a second instruction stored in the display device in a preset period of time, and a storage time of the instruction information of the second instruction.

When the user needs to view the instruction of the history input, the control device 100 may control the display device 200 to enter the pre-page, and input a third control instruction based on the history options in the pre-page, for example, by the control device 100 moving the focus to the history options, and pressing the ok key on the control device 100 to input the third control instruction, so as to instruct the display device 200 to display the history page.

The display apparatus 200 acquires instruction information of the second instruction stored in a preset period of time and acquires a storage time of the instruction information of the second instruction in response to the third control instruction.

The second instruction may be an instruction input by the user by inputting a second voice, that is, the second instruction may be an instruction issued by the user to the display device 200 in a voice manner, where the second instruction may be an instruction input by the user when the display device 200 displays a voice instruction learning page, or an instruction input by the user when the display device 200 displays other pages. The second voice includes a first example sentence among the example sentences, wherein the second voice includes the first example sentence may be the same as the first text corresponding to the first example sentence after the display device 200 converts the second voice into the corresponding text; the second voice including the first example sentence may be that after the display apparatus 200 converts the second voice into the corresponding text, the text is different from the first text corresponding to the first example sentence, but by analyzing the intention of the text, it may be determined that the intention is the same as the intention corresponding to the first example sentence.

And/or the second instruction may be input by the user by clicking on the target option of the first option through the control device 100, i.e., the second instruction is an instruction input by the user when the display device 200 displays the voice instruction learning page. The target option corresponds to a first example sentence, wherein the first example sentence corresponding to the target option may be the same as or different from the first example sentence included in the second speech.

The display apparatus 200 receives a second instruction input by the user before executing step S1301, and locally stores instruction information corresponding to the second instruction. For example, the display apparatus 200 acquires instruction information corresponding to the second instruction in response to the second instruction, stores the instruction information to the second location, and records the storage time of the instruction information. The instruction information corresponding to the second instruction includes a first text (referred to as a third text for convenience of distinction) corresponding to the first example sentence, a first instruction (referred to as a second instruction for convenience of distinction), and a first parameter (referred to as a second parameter for convenience of distinction), which is a parameter required when executing the second instruction. In this way, the display apparatus 200 can acquire instruction information of which storage time is within a preset period from the second position when performing step S1301.

The preset time period may include N time periods, N being a positive integer greater than 0. For example, a period of time may be 1 day, 1 week, one month, etc.

In some embodiments, the N time periods are the most recent N time periods. Wherein, if the display apparatus 200 correspondingly stores the instruction information of the second instruction in the current time period, the latest N time periods include the current time period. For example, if one period is 1 day, N is 3, and today is 2023, 11, 15, and the display apparatus 200 stores instruction information of the second instruction correspondingly today, the preset period is the last 3 days including today, that is, 2023, 11, 15, 2023, 11, 14, and 2023, 11, 13.

In some embodiments, the N time periods are the last N time periods corresponding to instruction information in which the second instruction is stored. For example, if one period of time is 1 day, N is 3, and today is 2023, 11 and 15, and the display apparatus 200 stores instruction information of the second instruction corresponding to today, whereas the display apparatus 200 does not have instruction information of the stored second instruction at 2023, 11 and 13, and stores instruction information of the second instruction corresponding to 2023, 11 and 12, the preset period of time is the last 3 days excluding 200 at 2023, 11 and 13, that is, 2023, 11, 15, 2023, 11, 14, and 2023, 11, 12.

The display apparatus 200 dynamically determines N time periods included in the preset time period according to the current system time and the stored record of the instruction information of the second instruction.

In some embodiments, the display apparatus 200 deletes instruction information of the second instruction not belonging to the preset time period from the second location. In this way, the storage pressure of the display apparatus 200 can be reduced.

S1402, displaying a history page according to the instruction information and the storage time of the second instruction. The history page includes a third option corresponding to the first example sentence, the third option displayed corresponding to a time period to which the storage time belongs, and a third text corresponding to the respective first example sentence is displayed corresponding to the third option, wherein the third option is associated with a second instruction and a second parameter corresponding to the respective first example sentence.

Step S1402 is similar to step S803, in which a third option corresponds to a storage time of instruction information of the second instruction corresponding to the corresponding first example sentence, a target time period to which it belongs within a preset time period (N time periods) may be determined according to the storage time, the third option is displayed corresponding to the target time period, and is used to indicate that the display device 200 stores the instruction information of the second instruction corresponding to the third option in the target time period, and it may also be understood that the user issues the second instruction to the display device 200 in the target time period.

In some embodiments, the display device 200 displays at most m third options in the history page corresponding to each time period, m being a positive integer greater than 0. For example, m is 1, a maximum of 1 third option is displayed per time period. As another example, m is 2, then a maximum of 2 third options are displayed per time period. In this way, if the display apparatus 200 corresponds to instruction information in which more second instructions are stored in one period, an upper limit is set for the number of third options that can be displayed for each period in order to display the effect of the history page and the effect of browsing by the user, so as to limit the number of third options displayed in the history page, thereby reducing the effort expended by the user to browse each third option.

In some embodiments, if the instruction information of the second instructions stored by the display apparatus 200 corresponding to the same time period is M pieces, M being greater than M, the M third options displayed by the display apparatus 200 correspond to M second instructions having the latest storage time.

In some embodiments, if instruction information of the second instruction repeatedly stored occurs within N time periods, the third option corresponding to the same second instruction is displayed only with respect to the third option corresponding to the second instruction having the latest storage time.

Taking the example of clicking the history option in the front page shown in fig. 13 by the control apparatus 100, if the preset time period is the last N time periods, N is 3, one time period is 1 day, and today is 2023, 11 and 15 days, wherein the display apparatus 200 correspondingly stores the instruction information of the second instruction today, the first example sentence corresponding to the second instruction includes "Search for spider" and "Open setting", the display apparatus 200 correspondingly stores the instruction information of the second instruction on 2023, 11 and 14 days, the first example sentence corresponding to the second instruction includes "Open y pipe", the display apparatus 200 correspondingly 2023/stores the instruction information of the second instruction on 2023, 11 and 13 days, and the first example sentence corresponding to the second instruction includes "Show me something interesting", the display apparatus 200 can acquire the instruction information of the second instruction stored in the last 3 days and the corresponding storage time in response to the clicking instruction, and display the history page, for example, the history page shown in fig. 15.

In this way, the user can determine the instruction issued in the preset time period through the history page, and because the third option is associated with the second instruction and the second parameter, the display device 200 can directly acquire the second instruction and the second parameter corresponding to the selected third option, so the history page can also provide an entry for clicking the input instruction for the user in the form of the third option, so the user can directly click the third option through the control device 100 to issue the second instruction to the display device 200, and the same effect as that of issuing the second instruction to the display device 200 by inputting the voice containing the corresponding first example sentence can be achieved, and the operation of the user can be effectively simplified.

In some application scenarios, the user may input some common second instructions, and cause the display device 200 to store a history of these second instructions. Therefore, when the user needs to issue the instructions, the instructions can be directly found through the history page, and the instructions are rapidly issued based on the history page, so that the history page is used as a collection page of the instructions.

In some embodiments, when displaying the history page, the display apparatus 200 may respond to the second instruction issued by the user based on the third option according to the flow shown in fig. 16, and the specific steps are as follows:

s1601, a click command input by the user based on a target third option in the third options is received.

S1602, responding to the clicking instruction, and acquiring a target second instruction and a target second parameter associated with a target third option.

S1603, executing the target second instruction according to the target second parameter.

Steps S1601-S1603 are similar to steps S1101-S1103 and are not described here.

In some embodiments, when displaying the history page, the display device 200 may also respond to a second instruction issued by the user through voice, and the specific steps are similar to steps S1201-S1204, which are not repeated herein.

Wherein, for the second instruction issued by the user based on the third option, and the second instruction issued by the user in a voice manner, the display device 200 may be configured to restore the corresponding instruction information to the second location according to the new storage time, so as to update the data of the history.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the above discussion in some examples is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the disclosure and to enable others skilled in the art to best utilize the embodiments.

Claims

1. A display device, characterized by comprising:

a controller configured to:

2. The display device according to claim 1, wherein the controller, in response to the first control instruction, acquires instruction information of an example sentence in which the display device supports a response, is configured to:

3. The display device of claim 1, wherein prior to the controller receiving the first control instruction entered by the user, the controller is configured to:

4. A display device according to any one of claims 1-3, wherein in displaying the voice instruction learning page, the controller is further configured to:

5. A display device according to any one of claims 1-3, wherein in displaying the voice instruction learning page, the controller is further configured to:

receiving a first voice input by a user;

converting the first voice into a corresponding second text;

determining a target intention according to the second text;

6. The display device of claim 3, wherein the pre-page further comprises a history option, the controller, when displaying the pre-page, further configured to:

7. The display device according to claim 6, wherein the preset time period includes N time periods, up to m of the third options are displayed in the history page corresponding to each of the time periods, where N is a positive integer greater than 0 and m is a positive integer greater than 0.

8. The display device of claim 6 or 7, wherein in displaying the history page, the controller is further configured to:

9. A display method of a voice instruction learning page, which is applied to the display device according to any one of claims 1 to 8, the method comprising:

10. The method according to claim 9, wherein the method further comprises: