KR20200074635A - Electronic device and control method thereof - Google Patents

Abstract

The present invention relates to a display device capable of controlling a display to display an image of content, acquiring a keyword of the content of which the image is displayed, transmitting the acquired keyword to an external device through a communication part, receiving information of a voice command related to the keyword and performing a corresponding operation among voice commands uttered by a plurality of users from an external device, controlling the display to display guide information of the voice command based on the received information, and performing the operation according to the received voice command in respond to the voice command of a user that is received through a receiving part according to the display of guide information.

Description

Display device and its control method {ELECTRONIC DEVICE AND CONTROL METHOD THEREOF}

The present invention relates to a display device and a control method thereof, and more particularly, to a display device and a control method for recommending a voice command for a video of content.

Recent display devices have a voice recognition function that performs various operations according to a user's voice command. For example, the TV recognizes voice commands for power on/off, channel up/down, and volume up/down, and performs basic operations such as power on/off, channel up/down, and volume up/down as recognized. The voice recognition function can be performed.

The display device may recommend a voice command to further improve user convenience and accessibility to the voice recognition function. That is, the display device may recommend or exemplify a voice command for an action that can be performed, and induce a user to utter a voice command that is recommended or exemplified. For example, while the TV displays the video of the B drama starring A, while the TV recognizes and performs voice commands for actions that the TV can recognize and perform, such as "Please find the movie where A star appeared" Can recommend The user can easily know which voice command the TV recognizes and what action the TV can perform through the recommended voice command, so that the voice recognition function of the TV can be easily and conveniently used.

However, since the conventional display device does not recommend a voice command that can be spoken by the user based on the user's intention, the user's convenience and accessibility to the voice recognition function are reduced. As an example, the TV may recommend voice commands such as "Please find the movie where A star appeared," "tell me the story of B drama," while displaying the video of B drama where A star appears. The recommendation may be unnecessary or useless for a user who wants to utter a voice command for recording a B drama.

Accordingly, there is a demand for a method for improving user convenience and accessibility to a voice recognition function by recommending a voice command that can be spoken by the user.

An object of the present invention is to provide a voice command recommendation function optimized for a user by recommending a voice command that can be spoken by the user, and a display device and a control method for improving the user's convenience and accessibility to the voice recognition function Is to provide

The above object of the present invention, the display, the communication unit, the receiving unit, and controls the display to display the image of the content, obtains the keyword of the content on which the image is displayed, and obtains the obtained keyword through the communication unit external device The voice command is associated with the keyword among the voice commands spoken by a plurality of users from the external device and receives information of a voice command on which a corresponding operation has been performed, and guides the voice command based on the received information. By a display device including a processor for controlling the display to display information, and in response to the user's voice command received through the receiving unit according to the display of the guide information, performs an operation according to the received voice command Can be achieved.

Here, the processor may display the guide information such that a plurality of voice commands have priority.

Here, the processor may distinguish and display the color of the guide information of each voice command according to the priority.

Here, the voice command includes two or more words, and the processor may display the guide information to distinguish words that can be spoken by substituting other words among the two or more words.

Here, the processor may control the display to display guide information of the voice command based on a user input requesting the guide information.

Here, the processor may transmit the signal of the guide information to an external display device through the communication unit, so that the external display device displays the guide information.

Here, the processor may acquire the keyword based on at least one of video, sound, EPG, or caption information of the content.

In addition, the above object of the present invention, in response to the request of the communication unit and a plurality of first external devices received through the communication unit: Recognition of voice commands uttered by a plurality of users of the plurality of first external devices Performing, and transmitting information of the recognized voice command and operation corresponding to the recognized voice command to the plurality of first external devices, and corresponding to keywords received from the second external device through the communication unit, the plurality of Among the voice commands spoken by the user of, it may be achieved by an electronic device including a processor that transmits information of a voice command related to the keyword and the corresponding operation is performed to the second external device.

In addition, the object of the present invention described above is the step of displaying an image of the content; Obtaining a keyword of the content on which the image is displayed; Transmitting the obtained keyword to an external device; Receiving information of a voice command related to the keyword from among voice commands uttered by a plurality of users from the external device and corresponding operations; Displaying guide information of the voice command based on the received information; And in response to a user's voice command received according to the display of the guide information, performing an operation according to the received voice command.

Here, the displaying of the guide information may include displaying the guide information so that the priority of the plurality of voice commands appears.

Here, the displaying of the guide information may include distinguishing and displaying the color of the guide information of each voice command according to the priority.

Here, the voice command includes two or more words, and the step of displaying the guide information includes displaying the guide information to distinguish words that can be spoken by substituting other words among the two or more words. can do.

Here, the displaying of the guide information may include displaying guide information of the voice command based on a user input requesting the guide information.

Here, the displaying of the guide information may include transmitting a signal of the guide information to an external display device, so that the external display device displays the guide information.

Here, the acquiring step may include acquiring the keyword based on at least one of video, sound, EPG, or caption information of the content.

In addition, the above object of the present invention, in response to a request received from a plurality of first external devices: performing a recognition of a voice command spoken by a plurality of users of the plurality of first external devices; And, Transmitting information of the recognized voice command and operations corresponding to the recognized voice command to the plurality of first external devices; In response to a keyword received from a second external device, transmitting the information of the voice command associated with the keyword among the voice commands spoken by the plurality of users and the corresponding operation is performed to the second external device. It can also be achieved by the control method of the electronic device.

In addition, the object of the present invention described above is a computer-readable code in a recording medium on which a computer program including code for performing a control method of an electronic device is stored, displaying an image of content; Obtaining a keyword of the content on which the image is displayed; Transmitting the obtained keyword to an external device; Receiving information of a voice command related to the keyword from among voice commands uttered by a plurality of users from the external device and corresponding operations; Displaying guide information of the voice command based on the received information; And a control method of a display device including a step of performing an operation according to the received voice command in response to a user's voice command received according to the display of the guide information. It can also be achieved by means of a record carrier.

According to the present invention, it is possible to provide a display device and a control method for providing a voice command recommendation function optimized for a user and improving user convenience and accessibility to a voice recognition function.

1 shows an example of a display device according to an embodiment of the present invention.
FIG. 2 illustrates an example in which the display device of FIG. 1 displays guide information.
FIG. 3 shows the configuration of the display device and the first electronic device of FIG. 1.
FIG. 4 shows a control method of the display device of FIG. 3.
FIG. 5 shows a control method of the first electronic device of FIG. 3.
FIG. 6 illustrates an example of displaying guide information so that the priority of the voice command is displayed in relation to operation S15 of FIG. 4.
FIG. 7 is a diagram illustrating an example of displaying guide information so that words that can be uttered are distinguished in relation to operation S15 of FIG. 4.
8 illustrates an example of a control method for obtaining a keyword based on a user input in relation to operation S12 of FIG. 4.
9 illustrates an example of displaying guide information of a voice command in the second electronic device in relation to operation S15 of FIG. 4.
FIG. 10 illustrates an example of setting a keyword acquisition range and a guide information display range in relation to S12 and S15 of FIG. 4.
11 shows another example of setting a display range of guide information in relation to S12 and S15 of FIG. 4.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the embodiments, reference is made to the items described in the accompanying drawings, and the same reference numbers or signs in each drawings denote components that perform substantially the same operation. At least one of the plurality of configurations in the present specification refers to not only all of the plurality of configurations, but each one or a combination of all of them excluding the rest of the plurality of configurations.

1 shows an example of a display device 1 according to an embodiment of the present invention. As shown in FIG. 1, the display device 1 according to the present embodiment may display an image 16 of content. 1 shows the display device 1 as a TV, but is not limited thereto, so the display device 1 is a smart phone, a tablet, a personal computer capable of displaying an image, a wearable device such as a smart watch, and a multimedia player. , It can be implemented as an electronic frame, household appliances such as a refrigerator. However, hereinafter, for convenience of description, it is assumed that the display device 1 is implemented as a TV.

The display device 1 may provide a voice recognition function through the first electronic device 4. Here, the first electronic device 4 may include a display device 1 and a server that provides services to the second electronic device 5, and the second electronic device 5 is a first device of the display device 1. As a device used by the first user 30 and the second second user 50, a display device such as a TV, a wearable device such as a smart phone, a tablet or a smart watch, a multimedia player, an electronic picture frame, a household appliance such as a refrigerator, and the like are used. It can contain.

Hereinafter, a voice recognition function of the display device 1 through the first electronic device 4 will be described in detail with reference to FIG. 1. The display device 1 may receive a voice command spoken by the first user 30 and transmit the received voice command to the first electronic device 4. Similarly, the second electronic device 5 may receive a voice command uttered by the second user 50 and transmit it to the first electronic device 4. The voice commands spoken by the first user 30 and the second user 50 may be voice commands instructing the display device 1 and the second electronic device 5 to perform a predetermined operation, for example. In addition to voice commands for basic operations of TV, such as power on/off, channel up/down, volume up/down, etc., content selection/execution/end, internet search, home shopping, telephone, video call, social network service ), voice commands for operations such as karaoke.

The first electronic device 4 performs voice recognition on the voice commands received from the display device 1 and the second electronic device 5, and displays the recognition result on the display device 1 and the second electronic device 5 Can be transferred to. The recognition result may include at least one of a voice command recognized by voice recognition and operation information corresponding to the recognized voice command. The information of the operation corresponding to the recognized voice command may include a control code that allows the display device 1 and the second electronic device 5 to perform an operation corresponding to the recognized voice command. Accordingly, the display device 1 and the second electronic device 5 operate according to the recognition result received from the first electronic device 4, so that the voices uttered by the first user 30 and the second user 50 A voice recognition function according to a command can be performed.

In particular, the first electronic device 4 may provide information on the recommended voice command so that the display device 1 can perform the voice command recommendation function. To this end, the first electronic device 4 collects a plurality of voice commands spoken by the first user 30 and the second user 50 and classifies voice commands that have successfully recognized among the plurality of spoken voice commands. Can. Here, when the recognition is successful, the display device 1 and the second electronic device (not only when the first user 30 and the second user 50 have successfully recognized the voice command spoken, but also according to the recognition result) 5) may include a case where the corresponding operation is performed.

Then, when the first electronic device 4 receives the keyword of the content from the display device 1, the first electronic device 4 may transmit information regarding the successful voice command to the display device 1 as a voice command related to the received keyword. . Here, the keyword received from the display device 1 is a keyword for the content of the image 16 displayed by the display device 1, and is an electronic program guide (EPG), image 16, sound, or caption of the content. It may include keywords obtained from at least one of.

The display device 1 displays guide information 2 having a recommended voice command for the content based on the information received from the first electronic device 4, so that the first user 30 displays the guide information 2 Accordingly, it is possible to induce to utter a recommended voice command. This will be described in detail with reference to FIG. 2.

As described above, the display device 1 according to the present embodiment displays guide information 2 of a voice command related to a keyword among voice commands spoken by a plurality of users and an operation corresponding to the spoken voice command is performed. can do. Therefore, by recommending a voice command that can be spoken by the first user 30, it is possible to provide a voice command recommendation function optimized for the user and improve the user's convenience and accessibility to the voice recognition function.

FIG. 2 shows an example in which the display device 1 of FIG. 1 displays guide information 2. As shown in FIG. 2, the display device 1 displays an image 16 of a predetermined content, obtains a keyword from the content of the image 16, and transmits the obtained keyword to the first electronic device 4 Can. For example, it is assumed that the display device 1 displays the video 16 of the drama content with the work name B, and the actor 17 with the name A appears on the video 16. The display device 1 obtains the name of the actor 17 and the work of the B drama as keywords through image recognition of the image 16, and obtains the name of the actor 17 and the B drama of the acquired keywords. The name of the work can be transmitted to the first electronic device 4. However, since the keyword is not limited to being obtained from the image 16, it can be obtained from EPG, sound, and caption of the content. In addition, since the keyword is not limited to the name of the actor 17 and the work name of the B drama, various keywords can be obtained from the EPG, sound, and caption of the content.

Based on the keyword received from the display device 1, the first electronic device 4 is associated with a keyword among a plurality of spoken voice commands, and a voice command that performs an operation corresponding to the spoken voice command, that is, recognition It is possible to identify a successful voice command, and transmit information on the identified voice command to the display device 1. As an example, the first electronic device 4 is a voice command related to the name of the actor 17, which is a keyword received from the display device 1, and the work name of the B drama, "Please find the movie where the actor appeared" (21), "tell me the story of the B drama" (22), "reserve the B drama recording" (23), "search for the B drama 24 episodes" (24), and "tell me the B drama producer" can be identified. Among them, "Find a movie starring A actor" (21), "Tell me the story of B drama" (22), "Schedule a B drama recording" (23), and "Search for episode 24 of B drama" (24) On the other hand, if the operation for "tell me the drama producer B" has not been performed, the first electronic device 4 finds a movie in which the actor appeared in the voice command "A Actor" in which the corresponding operation was performed. You can identify (21), "tell me the story of B drama" (22), "schedule B drama recording" (23), and "search B drama 24" (24). Information about it can be transmitted to the display device 1.

The display device 1 may display guide information 2 including recommended voice commands based on the information received from the first electronic device 4. As an example, the display device 1 is based on the information received from the first electronic device 4, "Find a movie starring A actor" (21), "Tell me the story of B drama" (22), "B drama It is possible to display guide information 2 including a reservation for recording" 23 and a search for episode 24 of B drama 24.

When the first user 30 speaks according to one voice command, for example, "Find a movie starring A actor" 21 based on the guide information 2, the display device 1 receives the receiver ( Through 13), a voice command 31 spoken may be received, and information on a movie starred by an Actor, which is an operation corresponding to the recognized voice command 31, may be provided.

As described above, the display device 1 according to the present embodiment displays guide information 2 of a voice command related to a keyword among voice commands spoken by a plurality of users and an operation corresponding to the spoken voice command is performed. can do. Therefore, by recommending a voice command that can be spoken by the first user 30, it is possible to provide a voice command recommendation function optimized for the user and improve the user's convenience and accessibility to the voice recognition function.

3 shows the configuration of the display device 1 and the first electronic device 4 of FIG. 1. First, the configuration of the display device 1 of FIG. 1 will be described with reference to FIG. 3. The display device 1 may include a display 11, a communication unit 12, a reception unit 13, and a processor 14.

The display 11 may display an image based on the signal/data of the processed image. For example, the display 11 may display a broadcast image based on the tuned broadcast signal. The display 11 includes liquid crystal, plasma, light emitting diode, organic light-emitting diode, carbon nano-tube, and nano-crystal ), and the like, but is not limited thereto.

The communication unit 12 may transmit/receive signals/data through wired or wireless communication with at least one of the first electronic device 4 or the second electronic device 5. Here, each electronic device may be an external device to the display device 1. The communication unit 13 is a wired or wireless LAN (Local Area Network), WiHD (Wireless HD), WiGig (Wireless) to communicate with at least one of the first electronic device 4 or the second electronic device 5 by wire or wirelessly. Gigabit Alliance), 4G (4th-Generation) Communication, 5G (5th-Generation) Communication, BT (Bluetooth), BLE (Bluetooth Low Energy), Infrared Communication (IrDA, infrared Data Association), Wi-Fi (Wi-Fi), Zigbee , WFD ((Wi-Fi Direct), UWB (Ultra-Wideband), NFC (Near Field Communication), etc. It may include at least one of the communication unit 12 to perform two or more wired or wireless communication to perform wired or wireless communication It can be implemented as a module or an integrated module.

The receiver 13 may receive a voice command from the first user 30. For example, the receiving unit 13 may be provided on the display device 1 to receive a voice command from the first user 30. In this case, the receiver 13 may be implemented with at least one microphone for receiving a voice command. As another example, when the voice command of the first user 30 is received by the second electronic device 5, the receiving unit 13 transmits a signal related to the voice command of the first user 30 to the second electronic device 5 You can receive from For example, when the second electronic device 5 includes a remote control, the reception unit 13 may further include a remote control signal reception unit for receiving a signal of the voice command of the first user 30 from the remote control.

The processor 14 may control the overall configuration of the display device 1. For example, the processor 14 may perform a voice recognition function. Specifically, the processor 14 transmits the voice command of the first user 30 received through the receiving unit 13 to the first electronic device 4, and through the communication unit 12, the first electronic device 4 The recognition result can be received from. The processor 14 may perform an operation corresponding to the voice command of the first user 30 based on the received recognition result.

As another example, the processor 14 may perform a voice command recommendation function. Specifically, the processor 14 controls the display 11 so that the image 16 of the content is displayed, acquires keywords of the content on which the image 16 is displayed, and receives the first electronic device through the communication unit 12 ( 4). In this case, the processor 14 may transmit the identified keyword to the first electronic device 4 based on the sameness, similarity, and relevance between the obtained keywords. For example, the processor 14 may transmit the obtained keyword to the first electronic device 4 when the keyword obtained through image recognition for the image 16 is identified as the same or similar to the keyword of the EPG. Then, the processor 14 receives information of a voice command associated with a keyword from among voice commands uttered by a plurality of users from the first electronic device 4, and a corresponding operation is performed, based on the received information. The display 11 can be controlled so that the guide information 2 of the voice command is displayed. The processor 14 may perform an operation according to the received voice command 31 in response to the user's voice command 31 received through the receiver 13 according to the indication of the guide information 2.

The processor 14 is a control program (or instruction) that enables control of the overall configuration of the display device 1, a nonvolatile memory in which the control program is installed, and at least a portion of the installed control program is loaded volatile It may include at least one processor or CPU (Central Processing Unit) for executing the memory and the loaded control program. In addition, such a control program can be stored in the second electronic device 5 other than the display device 1.

The control program may include program(s) implemented in at least one form of a BIOS, device driver, operating system, firmware, platform, and application program (application). As an embodiment, the application program may be installed or stored in advance at the time of manufacture of the display device 1, or may be installed based on the received data by receiving data of the application program from the outside during future use. The data of the application program may be downloaded from a server, for example, an application market. Such a server is an example of a computer program product, but is not limited thereto.

Meanwhile, since the configuration of the display device 1 is not limited to FIG. 3, the display device 1 may exclude some of the configurations shown in FIG. 3 or include a configuration not shown in FIG. 3. As an example, the display device 1 may further include at least one of an image signal receiving unit, an image signal processing unit, a user input unit, a power unit, or a storage unit.

The video signal receiving unit may receive a video signal from the outside. Since the type of the video signal received by the video signal receiving unit is not limited, a broadcast video signal, a cable video signal, or a satellite video signal can be received. The video signal processor may process the video signal received by the video signal receiver to be displayed on the display 11.

The user input unit may be provided to receive a user input. The user input unit may include at least one of a touch panel for receiving a user's touch input, a menu button provided on the front of the display device 1, and a remote control signal receiving unit for receiving a remote control signal from the remote control.

The power supply unit may receive power supplied from the outside under the control of the processor 14 to supply necessary power for each of the components of the display device 1 or may store the supplied power. The storage unit may store a command, a program, an application for controlling the display device 1, or sound signals for various contents. For example, the storage unit is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM. , A storage medium of at least one type of ROM.

Hereinafter, the configuration of the first electronic device 4 will be described with reference to FIG. 3. The first electronic device 4 may communicate with at least one of the display device 1 or the second electronic device 5 through a network, and may be implemented as a server. The first electronic device 4 may include a communication unit 42, a storage unit 43, and a processor 44.

The communication unit 42 of the first electronic device 4 may transmit/receive signals/data by wire or wirelessly with the display device 1 and the second electronic device 5. Here, the display device 1 and the second electronic device 5 may be external devices to the first electronic device 4. The communication unit 42 is a wired or wireless LAN, WiHD, WiGig, 4G communication, 5G communication, BT, BLE, infrared communication, Wi-Fi, Zigbee to communicate wired or wirelessly with the display device 1 and the second electronic device 5 WFD, UWB, NFC, and the like. The communication unit 42 may be implemented as two or more wired/wireless communication modules or one integrated module to perform wired or wireless communication.

The storage unit 43 may store a command, a program, an application for controlling the first electronic device 4, or sound signals related to various contents. For example, the storage unit 43 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD or XD memory). Etc.), a storage medium of at least one of RAM and ROM.

The processor 44 can control the overall configuration of the first electronic device 4. For example, the processor 44 receives the voice commands spoken by the first user 30 and the second user 50 from the display device 1 and the second electronic device 5, and the The voice recognition may be performed to transmit the recognition result to the display device 1 and the second electronic device 5.

The processor 44 may collect voice commands. The plurality of voice commands collected by the processor 44 is determined in advance at the time of manufacture, or stored in the storage unit 43 using voice commands, rule-based or artificial intelligence algorithms using at least one of machine learning, neural networks, and deep learning algorithms. It may include learned voice commands.

In particular, the processor 44 may collect the voice commands uttered by the first user 30 and the second user 50 and classify the voice commands that have been successfully recognized, that is, recognized successfully. For example, the voice commands of the first user 30 and the second user 50 received from the display device 1 and the second electronic device 5 are "Find a movie starring an Actor" (21), It is assumed that "tell me the story of B drama" (22), "schedule B drama recording" (23), "search B drama 24" (24), and "tell me about B drama producer". If the processor 44 finds, "Find a movie starring A actor" (21), "Tell me the story of the B drama" (22), "Schedule a B drama recording" (23), and "Search for episode 24 of B drama Regarding "24, the recognition succeeds, or the display device 1 and the second electronic device 5 perform a corresponding operation according to the recognition success, while the recognition of the "tell me about the B drama maker" fails. Or, if the display device 1 and the second electronic device 5 do not perform a corresponding operation due to a failure in recognition, the processor 44 may display "Find a movie starring an Actor" (21), " The "tell me the story of the B drama" (22), the "reservation of the B drama recording" (23), and the "search for the B drama 24 episodes" (24) can be classified as a successful voice command.

When a keyword is received from the display device 1, the processor 44 is associated with a keyword among a plurality of spoken voice commands, identifies a voice command that has been successfully recognized, and displays information on the identified voice command (1). ) To enable the display device 1 to perform a voice command recommendation function. As an example, it is assumed that the keywords received from the display device 1 are the names of the actor 17 and the works of the B drama. The processor 44 includes the names of the actor 17 and the work of the B drama among the successful voice commands, "Please find the movie where the Actor appeared" (21), "Tell me the story of the B drama" (22) , "Schedule B drama recording" (23), and "Search for B drama 24 episodes" (24) may be identified, and information regarding the identified voice command may be transmitted to the display device (1). The display device 1 is based on the information received from the first electronic device 4, "Find a movie starring A actor" (21), "Tell me the story of the B drama" (22), "Reservation of B drama recording Guide information (2), including "Please do (23)," and "Search for B drama episode 24" (24) can be displayed.

However, since the voice commands classified by the processor 44 are not limited to recognition success, voice commands may be classified based on factors such as utterance frequency, continuous utterance, and current recommendation. For example, the processor 44 may have a plurality of voice commands that are spoken by the first user 30 and the second user 50, and the first user 30 and the second user 50, respectively. ) May be classified as a voice command having a large number of consecutive utterances, or a voice command that is currently recommended for the second electronic device 5 or has a high search ranking on the web or SNS. In addition, the processor 44 is a voice command related to a keyword from the display device 1, the recognition is successful, the utterance frequency is high, the number of consecutive utterances is high, or the current second electronic device 5 ), or identify a voice command having a high search rank on the web or SNS, and transmit information regarding the identified voice command to the display device 1.

In addition, the processor 44 is a voice command related to a keyword, assigns a score to the voice command corresponding to the at least one factor described above, identifies at least one voice command having a high total score, and information about the identified voice command Can be transmitted to the display device 1. In assigning a score, the processor 44 may set a priority or weight for a factor, and transmit information on at least one voice command having a high total score according to the priority or weight to the display device 1.

However, the factor, the priority or weight of the factors for a plurality of spoken voice commands may be set in advance or may be selected by the first user 30. An embodiment of identifying a voice command by a factor, a priority or a weight of a factor by selection of the first user 30 will be described in detail with reference to FIGS. 10 and 11.

In addition, the processor 44 is a control program (or instruction) that allows control over the entire configuration of the first electronic device 4, a non-volatile memory in which the control program is installed, and at least a part of the installed control program It may include a volatile memory to be loaded and at least one processor or a central processing unit (CPU) that executes the loaded control program. In addition, such a control program can be stored in the display device 1 and the second electronic device 5 other than the first electronic device 4.

The control program may include program(s) implemented in at least one form of a BIOS, device driver, operating system, firmware, platform, and application program (application). As an embodiment, the application program may be installed or stored in advance at the time of manufacture of the first electronic device 4, or may be installed based on the received data by receiving data of the application program from the outside in the future use. . The data of the application program may be downloaded from a server, for example, an application market. Such a server is an example of a computer program product, but is not limited thereto.

However, since the configuration of the first electronic device 4 is not limited to FIG. 3, the first electronic device 4 may exclude some of the components illustrated in FIG. 3 or include components not illustrated in FIG. 3. have.

4 shows a control method of the display device 1 of FIG. 3. The control method according to this embodiment may be performed by the processor 14 of the display device 1 executing the control program described above. Hereinafter, for convenience of description, an operation performed by the processor 14 by executing a control program may be briefly described as an operation of the processor 14.

Referring to FIG. 4, the processor 14 may display an image 16 of the content (S11) and obtain keywords of the content on which the image 16 is displayed (S12). As an example, the keyword of the content may be obtained based on at least one of EPG, video 16, sound, or caption of the content.

The processor 14 transmits a keyword to the first electronic device 4 (S13), and among the voice commands spoken by a plurality of users from the first electronic device 4, the keyword is associated with and a corresponding operation is performed Information of the voice command may be received (S14), and guide information of the voice command may be displayed based on the received information (S15).

The processor 14 may perform an operation according to the received voice command 31 in response to the user's voice command 31 received according to the display of the guide information 2 (S16 ).

As described above, the display device 1 according to the present embodiment may display guide information 2 associated with a keyword among voice commands spoken by a plurality of users and performed with a function corresponding to the spoken voice command. . Therefore, by recommending a voice command that can be spoken by the first user 30, it is possible to provide a voice command recommendation function optimized for the user and improve the user's convenience and accessibility to the voice recognition function.

5 shows a control method of the first electronic device 4 of FIG. 3. The control method according to this embodiment may be performed by the processor 44 of the first electronic device 4 executing the control program described above. Hereinafter, for convenience of description, an operation performed by the processor 44 by executing a control program may be briefly described as an operation of the processor 44.

Referring to FIG. 5, the processor 44 responds to a request received from the display device 1 or the second electronic device 5, and the plurality of users of the display device 1 or the second electronic device 5 30, 50) recognizes the spoken voice command, and transmits information on the recognized voice command and the operation corresponding to the recognized voice command to the display device 1 or the second electronic device 5 (S21). ). The display device 1 and the second electronic device 5 can be external devices to the first electronic device 4, and a plurality of users 30 and 50 are first users 30 of the display device 1 ) And the second user 50 of the second electronic device 5.

The first electronic device 4 is associated with a keyword among voice commands uttered by a plurality of users 30 and 50 in response to a keyword received from the display device 1, and Information can be transmitted to the display device 1 (S21).

As described above, the first electronic device 4 according to the present embodiment may provide information regarding the spoken voice command to the display device 1, which is associated with a keyword among voice commands spoken by a plurality of users. Accordingly, the display device 1 can provide a voice command recommendation function optimized for the user by recommending a voice command that the first user 30 can utter, and improve user convenience and accessibility to the voice recognition function. have.

FIG. 6 shows an example of displaying the guide information 2 so that the priority of the voice command is displayed in relation to operation S15 of FIG. 4. The processor 14 of the display device 1 according to the present exemplary embodiment may receive information regarding a voice command and information regarding a priority for the voice command from the first electronic device 4.

The priority information may include information about the identifier given to the voice command based on factors such as the recognition success rate, the utterance frequency, the continuous utterance, or the current recommendation. As an example, the processor 14 is a voice command from the first electronic device 4, in which the identifiers are assigned in the order of utterance frequency, "Find a movie starring an Actor" (21), "Tell me the story of the B drama" (22), When receiving information about "Please reserve B drama recording" (23) and "Search for B drama 24" (24), based on the identifier given in order of utterance frequency, "Find the movie starring Actor" Guide information (2) can be displayed in the order of "(21), "Tell me about B drama story" (22), "Schedule B drama recording" (23), and "Search for B drama 24 episodes" (24). have.

In addition, the processor 14 may display the guide information 2 so that voice commands having a high priority are distinguished. For example, the color of the voice command may be displayed differently from the rest of the voice commands according to priority. The method of displaying to be distinguished according to priority is not limited to displaying colors differently, so applying gradation to color, brightness, saturation, etc., or font, size, slope, underline, subscript, etc. At least one may be displayed differently according to priority.

In this way, the display device 1 according to the present embodiment can display the priority in the voice command of the guide information 2. Accordingly, by allowing the first user 30 to intuitively recognize a spoken voice command, the user's convenience and accessibility to the voice recognition function can be improved.

FIG. 7 shows an example of displaying guide information 2 so that words that can be uttered are distinguished in relation to operation S15 of FIG. 4. The processor 14 of the display device 1 according to the present embodiment may receive information regarding a voice command including a plurality of words from the first electronic device 4. Each of the plurality of words may have different kinds of characteristics. For example, each word of the voice command may include a word related to the genre, content, type, etc. of content, or a word instructing the display device 1 to perform a predetermined operation. However, the characteristics of words are not limited thereto, and each word may be composed of various expressions having various meanings.

The first electronic device 4 may classify a plurality of words that the first user 30 can speak by substituting other words included in the word group into one word group. Words included in the word group may have correlation, relevance, and the like. The first electronic device 4 may identify that any one word of the voice command is replaceable with another word included in the word group, and assign an identifier to the corresponding word replaceable with another word. For example, the first electronic device 4, for the voice command "Play B episode 24" (24), when the B drama forms one word group with the A drama and the C drama, the B drama ( 51) can be assigned an identifier with a replaceable word family. Alternatively, if the B drama consists of multiple rounds, an identifier having a group of words of multiple rounds that can be substituted for episode 24 (52) may be assigned.

The first electronic device 4 may transmit information regarding the identifier to the display device 1, and the processor 14 of the display device 1 may use a voice command based on the identifier given by the first electronic device 4. Guide information 2 may be displayed to identify words that can be spoken by being replaced by the first user 30 among the plurality of words. For example, when the processor 14 displays the guide information 2 including the “Search for 24 episodes of B drama” 24, based on the identifier information received from the first electronic device 4, the processor 14 displays the “B drama D” Among the words included in "Search for 24 episodes" (24), it may indicate that the B dramas 51 and 24 (52) are words that can be spoken by replacing. In some cases, the processor 14 displays at least one of fonts, sizes, slopes, underscores, subscripts, etc. of the B dramas 51 and 24 episodes 52 differently from the rest of the words, thereby causing the B dramas 51 and 24 It is possible to indicate that (52) is a word that can be replaced.

The first user 30 uses the B dramas 51 and 24 episodes 52 according to the guide information 2 displayed so that the words that can be spoken by the B dramas 51 and 24 52 are replaced. It is possible to utter the voice command 31 replacing the word with another word. For example, the first user 30 not only "Search for episode 24 of B drama" (24), but also "Search for episode 23 of B drama", "Search for episode 1 of A drama", "Search for episode 2 of A drama" As described above, voice commands 31 that replace B dramas 51 and 24 episodes 52 can be uttered.

On the other hand, the processor 14 of the display device 1 displays guide information 2 so that other words in the word group are displayed instead of words identified as replaceable among a plurality of words of the voice command based on the identifier information. Can. As an example, the processor 14 identifies that “B drama” and “24 episode” of “Please search for episode 24 of “D drama 24” 24” are replaceable words based on information received from the first electronic device 4. A guide to voice commands 31 replacing B dramas 51 and 24 (52), such as "Search for episode 23 of B drama", "Search for episode 1 of A drama", and "Search for episode 2 of A drama", etc. Information 2 can be displayed. In this case, information about the words "A drama", "23 episodes", "1 episode", and "2 episodes" which are replaced with "B drama" and "24 episodes" is received from the first electronic device 4 Alternatively, the processor 14 may include information obtained from EPG or the like of the content of the image 16.

As described above, since the display device 1 according to the present embodiment can display the guide information 2 so that the first user 30 can substitute and distinguish the utterable words, the user's convenience and accessibility to the voice recognition function Can be further improved.

8 illustrates an example of a control method for obtaining a keyword based on a user input in relation to operation S12 of FIG. 4. Hereinafter, descriptions of operations overlapping with those of FIG. 4 will be omitted, and descriptions will mainly focus on different operations.

Referring to FIG. 8, the processor 14 of the display device 1 may display a video 16 of the content (S61) and receive a user input requesting guide information (S62). For example, a user input requesting the guide information 2 may be received through at least one of a remote control, a touch panel, or a menu button. When the guide information 2 is requested through the remote control, when the first user 30 clicks the predetermined remote control button once or several times, the remote control signal requesting the guide information 2 is transmitted to the display device 1 Can be set to

The processor 14 may obtain a keyword of the content on which the image 16 is displayed based on the received user input (S63). For example, the processor 14 may acquire keywords of content when a user input is received. That is, the processor 14 may acquire keywords of the content in real time in response to user input. As another example, considering the temporal difference between the time when the first user 30 requests the guide information 2 and the time when the keyword of the content is acquired, the image 16 displayed before a predetermined time from the time when the user input is received ) To obtain keywords from the content. Here, the predetermined time may be variously determined in advance according to a design method. However, since it is not limited to time, the processor 14 may acquire keywords of content based on a predetermined frame or scene.

In this way, the display device 1 according to the present embodiment can display the guide information 2 based on the user input requesting the guide information 2. Therefore, by recommending a voice command that can be spoken by the first user 30, the user's convenience and accessibility to the voice recognition function can be improved.

9 shows an example of displaying guide information 2 of a voice command in the second electronic device 5 in relation to operation S15 of FIG. 4. As illustrated in FIG. 9, the processor 14 may transmit information regarding a voice command to the second electronic device 5 so that the second electronic device 5 displays guide information 2. For example, when the second electronic device 5 receives information related to the name of the actor 17 as keywords and the work name of the B drama from the display device 1, and information about the voice command in which the corresponding operation is performed Includes, "Find a movie starring A actor" (21), "Tell me the story of B drama" (22), "Schedule B drama recording" (23), and "Search for episode 24 of B drama" (24) The guide information 2 to be displayed can be displayed.

As another example, the processor 14 may predetermine the second electronic device 5 to display the guide information 2. For example, when the second electronic device 5 is determined by the first user 30, the processor 14 may transmit information regarding the predetermined second electronic device 5 to the first electronic device 4. have. In this case, the first electronic device 4 transmits to the second electronic device 5 information on a voice command related to a keyword among the voice commands uttered by a plurality of users and the corresponding operation is performed, and the second electronic device 4. It is possible to display the guide information 2 of the voice command based on the information received by the electronic device 5.

As another example, the processor 14 may select which device to display the guide information 2 according to a specific situation. The processor 14 determines whether a device to display the guide information 2 is selected from the display device 1 or an external device by determining whether it corresponds to a preset condition in a situation in which the guide information 2 regarding the voice command is displayed. have. When the guide information 2 is displayed on an external device other than the display device 1, for example, the second electronic device 5, the processor 14 confirms the existence of an external device connected to the display device 1, and communicates with the communication unit. By controlling (12), the guide information 2 can be transmitted to the corresponding external device. Even when the guide information 2 is transmitted to the external device or displayed by the external device, the processor 14 sends the guide information 2 to the display 11 when there is no external device connected to the display device 1. Can be displayed.

In this way, the display device 1 according to the present embodiment can improve the user's convenience and accessibility to the voice recognition function because the second electronic device 5 can display the guide information 2.

FIG. 10 shows an example of setting a keyword acquisition range and a display range of guide information 2 in relation to S12 and S15 of FIG. 4. As shown in FIG. 10, the display device 1 may display a user interface (hereinafter referred to as a'setting UI') for setting a keyword acquisition range and a guide information 2 display range. have. The setting UI 90 may be displayed according to a user input through at least one of a remote control, a touch panel, or a menu button.

The setting UI 90 may include a menu item for the guide information display 91, keyword setting 92, or guide information display setting 93. When the menu item for displaying guide information 91 is activated, the display device 1 may display guide information 2 for a user input requesting guide information 2.

The keyword setting 92 is an EPG keyword acquiring keyword from EPG, an image recognition keyword acquiring keyword based on the recognized image, and a keyword acquiring based on the recognized voice. It may include a menu item for acquiring a voice recognition keyword or acquiring a caption keyword to obtain a keyword based on a subtitle of an image. For example, the display device 1 may perform image recognition on the image 16 when the menu item of image recognition keyword acquisition is activated, and acquire keywords based on the recognized image, but when deactivated, the image ( 16) may not be performed, or the keyword may not be acquired from the recognized image.

The guide information display setting 93 may include factor menu items such as recognition success, utterance frequency, continuous utterance, current recommendation, and related keywords. The menu item of recognition success may display the voice command according to whether the recognition of the voice command is successful or an operation corresponding to the voice command has been performed. For example, when the menu item of recognition success is activated, the display device 1 is a voice command related to a keyword, and displays guide information 2 including a voice command that succeeds in recognition or performs a corresponding action, but is deactivated. If it is, the guide information 2 may be displayed to include a voice command in which the corresponding operation is not performed.

Meanwhile, the first electronic device 4 may identify a voice command related to a keyword as selected through the setting UI 90. For example, when the menu item of recognition success is activated, the first electronic device 4 identifies a voice command that succeeds in recognition or performs a corresponding operation, and displays information about the identified voice command in the display device 1 Can be transferred to. Similarly, when the menu item of the utterance frequency, continuous utterance, current recommendation, or related keyword is activated, the first electronic device 4 has a high utterance frequency, the number of consecutive utterances is high, or the second electronic device 5 The information of the voice command including the keyword currently associated with the keyword currently recommended or received from the display device 1 may be transmitted to the display device 1.

Similarly, when the menu item of the utterance frequency is activated in the guide information display setting 93, the display device 1 is a voice command related to a keyword, and can display guide information 2 of a voice command having a high utterance frequency. , When the menu item of continuous speech is activated, it is possible to display guide information 2 of a voice command having a high number of consecutive speeches. In addition, when the menu item of the current recommendation is activated, the display device 1 is a voice command related to a keyword, and is recommended by the recommendation operation of the voice command in the second electronic device 5, or the search ranking on the web or SNS is It is possible to display the guide information 2 of the high voice command, and when the menu item of the related keyword is activated, the guide information 2 of the voice command including the keyword related to the obtained keyword can be displayed.

As described above, the display device 1 according to the present embodiment displays the setting UI 90 for setting the acquisition range of the keyword and the display range of the guide information, and displays the keyword according to the user input through the setting UI 90. Acquisition, and guide information 2 of the voice command based on the acquired keyword can be displayed. Therefore, by providing an optimized voice command recommendation function to the user, the user's convenience and accessibility to the voice recognition function can be improved.

11 shows another example of setting a display range of guide information in relation to S12 and S15 of FIG. 4. The first electronic device 4 may identify a voice command based on a priority or weight in a factor for a plurality of spoken voice commands. For example, when priority is set in the order of recognition success, utterance frequency, successive utterance, current recommendation, related keyword, etc., in the order of recognition success, utterance frequency, etc., the first electronic device 4 has a voice corresponding to each factor. A score can be differentially assigned to a command, and at least one voice command with a high total score can be identified. Then, the first electronic device 4 reconstructs at least one voice command according to the total score, and transmits information on the reconstructed voice command to the display device 1, so that the display device 1 recognizes successfully, the frequency of speech, and the like. It is possible to display the guide information 2 of the voice command having the order of.

In particular, the display device 1 according to the present embodiment is a setting UI including a priority setting 94 for setting priority or weight in factors such as recognition success, utterance frequency, continuous utterance, current recommendation, and related keywords. (90) can be displayed. That is, the priority setting 94 sets the priority for the factor of the guide information display setting 93 such as recognition success, utterance frequency, continuous utterance, current recommendation, and related keywords according to user input. Referring to FIG. 11, it is assumed, for example, that the recognition success, the utterance frequency, etc. are set to the 1st, 2nd, etc. through the priority setting 94. In displaying the guide information 2, the display device 1 preferentially displays a voice command that succeeds in recognition or performs a corresponding operation among a plurality of voice commands related to keywords, and ranks voice commands having a high utterance frequency. Can be displayed as

In addition, the setting UI 90 may further include a weight setting 95 for assigning a weight for each factor of the guide information display setting 93. For example, when a weight of 10 is assigned to the recognition success through the weight setting 95 and a weight of 3 is assigned to the utterance frequency, the first electronic device 4 gives 10 points to the voice command corresponding to the recognition success. And three points can be assigned to a voice command having a high frequency of speech. In this case, the display device 1 may display guide information 2 of the reconstructed voice command according to the weight set through the weight setting 95.

As such, the display device 1 according to the present embodiment may display guide information 2 of the voice command having a priority according to a user input through the priority setting 94 or the weight setting 95. Therefore, by providing an optimized voice command recommendation function to the user, the user's convenience and accessibility to the voice recognition function can be improved.

As described above, the present invention has been described in detail through preferred embodiments, but the present invention is not limited thereto and may be variously implemented within the scope of the claims.

1: Display device
11: display
12: Communication Department
13: receiver
14: processor

Claims (17)

In the display device,
display;
Communication department;
Receiver; And
Control the display to display an image of the content,
Acquiring keywords of the content in which the video is displayed,
The acquired keyword is transmitted to an external device through the communication unit,
Among the voice commands spoken by a plurality of users from the external device, information related to the keyword, and the voice command for which a corresponding operation has been performed is received,
The display is controlled to display guide information of the voice command based on the received information,
In response to the user's voice command received through the receiving unit according to the display of the guide information, performing an operation according to the received voice command
Display device including a processor. According to claim 1,
The processor, the display device for displaying the guide information so that the priority of the plurality of voice commands appear. According to claim 2,
The processor is a display device for distinguishing and displaying the color of the guide information of each voice command according to the priority. According to claim 1,
The voice command includes two or more words,
The processor is a display device that displays the guide information so that words that can be spoken by being replaced with other words among the two or more words are distinguished. According to claim 1,
The processor is a display device that controls the display so that the guide information of the voice command is displayed based on a user input requesting the guide information. According to claim 1,
The processor transmits a signal of the guide information to an external display device through the communication unit, so that the external display device displays the guide information. According to claim 1,
The processor is a display device that acquires the keyword based on at least one of video, sound, EPG or caption information of the content. In the electronic device,
Communication department; And
In response to a request of a plurality of first external devices received through the communication unit:
Recognize the voice command uttered by a plurality of users of the plurality of first external devices,
Transmitting information of the recognized voice command and operations corresponding to the recognized voice command to the plurality of first external devices,
Corresponding to a keyword received from a second external device through the communication unit, among the voice commands spoken by the plurality of users, information regarding a voice command associated with the keyword and performing a corresponding operation is transmitted to the second external device. Sending processor
Electronic device comprising a. In the control method of the display device,
Displaying an image of the content;
Obtaining a keyword of the content on which the image is displayed;
Transmitting the obtained keyword to an external device;
Receiving information of a voice command associated with the keyword from among voice commands uttered by a plurality of users from the external device, and a corresponding operation is performed;
Displaying guide information of the voice command based on the received information; And
And in response to a user's voice command received according to the display of the guide information, performing an operation according to the received voice command. The method of claim 9,
The displaying of the guide information may include displaying the guide information so that a plurality of priorities of the voice commands appear. The method of claim 10,
The displaying of the guide information may include distinguishing and displaying color of guide information of each voice command according to the priority. The method of claim 9,
The voice command includes two or more words,
The displaying of the guide information may include displaying the guide information so that words that can be spoken are distinguished by substituting other words among the two or more words. The method of claim 9,
The displaying of the guide information may include displaying guide information of the voice command based on a user input requesting the guide information. The method of claim 9,
The displaying of the guide information may include transmitting a signal of the guide information to an external display device to cause the external display device to display the guide information. The method of claim 9,
The acquiring may include acquiring the keyword based on at least one of video, sound, EPG, or caption information of the content. In the control method of the electronic device,
In response to a request received from a plurality of first external devices:
Recognizing a voice command spoken by a plurality of users of the plurality of first external devices; And,
Transmitting information of the recognized voice command and operations corresponding to the recognized voice command to the plurality of first external devices; And
In response to a keyword received from a second external device, transmitting the information of the voice command associated with the keyword among the voice commands spoken by the plurality of users and the corresponding operation is performed to the second external device. Control method of an electronic device including. A computer-readable code in a recording medium in which a computer program including code for performing a control method of an electronic device is stored, the control method of the electronic device is
Displaying an image of the content;
Obtaining a keyword of the content on which the image is displayed;
Transmitting the obtained keyword to an external device;
Receiving information of a voice command associated with the keyword from among voice commands uttered by a plurality of users from the external device, and a corresponding operation is performed;
Displaying guide information of the voice command based on the received information; And
In response to a user's voice command received according to the display of the guide information, a computer-readable program including a control method of a display device including the step of performing an operation according to the received voice command is recorded. media.

Images