JP2016029495A - Image display device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device capable of allowing a user to easily select a piece of desired information from plural pieces of selectable information by using a voice recognition.SOLUTION: A voice recognition apparatus 100 includes: a voice acquisition section that acquires a voice; a recognition result acquisition section 103 that acquires a recognition result of the voice; an extraction section 105 that, when a recognition result includes a key word and a selection command for selecting one of plural pieces of selectable information, extracts selection candidates including the key word; a selection mode change section 106 that, when plural selection candidates are included, changes all pieces of the selectable information from a selectable first selection mode to a second selection mode in which plural selection candidates are selectable; and a display control section 107 that changes the display mode of the display information according to the second selection mode. When the selection mode is the second selection mode, the display control section displays an identifier for identifying the selection candidate to each of the plural selection candidates.SELECTED DRAWING: Figure 2

Description

  The present disclosure relates to a video display apparatus and a video display method in which a user selects any one of a plurality of pieces of information by recognizing a voice uttered by the user.

  2. Description of the Related Art Conventionally, there is a voice input device that receives voice input issued by a user, recognizes a command by analyzing the received voice input, and controls a device in accordance with the recognized command (for example, see Patent Document 1). That is, in the voice input device disclosed in Patent Document 1, the voice is uttered by the user, and the device is controlled in accordance with the command that is the result of recognition.

  By the way, using such a voice input device, for example, when a user is operating the browser on a television, a PC (Personal Computer), etc., the hypertext displayed on the screen on the browser is selected. There is a need for voice recognition. In other words, information that accesses related information referenced by hyperlinks (reference information) embedded in hypertext when it is selected (hereinafter referred to as “selectable information”), such as hypertext, Select using voice recognition.

Japanese Patent No. 4812941

  However, when selecting selectable information using speech recognition, selectable information that the user does not intend to select may be selected by mistake.

  Therefore, the present disclosure is to provide a video display device and the like that can easily select selectable information intended for a user to select from among a plurality of selectable information using voice recognition. .

  The video display device according to the present disclosure is a video display device, and a display unit that displays video and a plurality of selectable information in which reference information for referencing related information is embedded is displayed on the display unit. A processor that assists a user in selecting any one of the plurality of selectable information, the processor acquiring a voice uttered by the user, and the voice The recognition result includes a recognition result acquisition unit that acquires the recognition result of the voice acquired by the acquisition unit, a keyword, and a selection command for selecting one of the plurality of selectable information. An extraction unit that extracts selection candidates that are selectable information including the keyword from among the plurality of selectable information, and a plurality of selection candidates extracted by the extraction unit The selection mode for selecting the plurality of selectable information is changed from the first selection mode capable of selecting all the selectable information to the second selection mode capable of selecting the plurality of selection candidates. And a display control unit that changes a display mode of the display information according to the second selection mode changed by the selection mode change unit, and the display control unit includes the selection mode. Is the second selection mode, an identifier for identifying the selection candidate is displayed for each of the plurality of selection candidates.

  The video display device according to the present disclosure can easily select selectable information that the user intends to select using voice recognition.

FIG. 1 is a diagram illustrating a speech recognition system according to Embodiment 1. FIG. 2 is a block diagram showing the configuration of the voice recognition system. FIG. 3 is a diagram for explaining dictation. FIG. 4 is a flowchart showing a flow of selection processing of the speech recognition apparatus according to the present embodiment. FIG. 5A is a diagram showing a search result image of the Internet search. FIG. 5B is a diagram illustrating an example when the selection mode in the selection process is the second selection mode. FIG. 5C is a diagram for describing the second selection mode. FIG. 6 is a diagram showing search results based on the program guide. FIG. 7 is a diagram showing an example of a list-up display of search results based on the program guide. FIG. 8 is a diagram for explaining a case where the type of search command is not specified.

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  The inventor provides the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and is intended to limit the subject matter described in the claims. is not.

  The speech recognition device according to the present disclosure is a speech recognition device built in the television 10 as illustrated in FIG. 1, and recognizes speech uttered by a user and controls the television 10 according to the result of speech recognition. It is. FIG. 1 is a diagram illustrating a speech recognition system according to Embodiment 1. FIG. 2 is a block diagram showing the configuration of the voice recognition system.

<Voice recognition system>
As shown in FIG. 1 and FIG. 2, the speech recognition system 1 includes a television 10 as a video display device, a remote controller (indicated as a remote controller in FIG. 2) 20, a portable terminal 30, and a network in the first embodiment. 40 and a keyword recognition unit 50.

  The television 10 includes a voice recognition device 100, a built-in camera 120, a built-in microphone 130, a display unit 140, a transmission / reception unit 150, a tuner 160, and a storage unit 170.

  The voice recognition apparatus 100 acquires a voice from a user, recognizes a keyword and a command by analyzing the acquired voice, and controls the television 10 according to the recognized result. A specific configuration will be described later.

  The built-in camera 120 is a camera installed outside the television 10 and is a camera that captures the direction displayed by the display unit 140. That is, the built-in camera 120 is a camera that faces the user facing the display unit 140 of the television 10 and can photograph the user.

  The built-in microphone 130 is a microphone installed outside the television 10 and is a microphone that mainly collects sound from the direction displayed on the display unit 140, as with the built-in camera 120. That is, the built-in microphone 130 faces the user facing the display unit 140 of the television 10 and is a microphone that can collect the sound emitted by the user.

  The remote controller 20 is a controller for the user to operate the television 10 at a position away from the television 10, and includes a microphone 21 and an input unit 22. The microphone 21 can collect the sound uttered by the user. The input unit 22 is an input device such as a touch pad, a keyboard, or a button that is input by a user. An audio signal indicating the sound collected by the microphone 21 or an input signal input by the input unit 22 is transmitted to the television 10 by wireless communication.

  The display unit 140 is a display device that includes a liquid crystal display, a plasma display, an organic EL display, and the like, and displays an image generated by the display control unit 107. The display unit 140 also displays a broadcast image related to the broadcast received by the tuner 160.

  The transmission / reception unit 150 is connected to the network 40 and transmits / receives information through the network 40.

  The tuner 160 receives a broadcast.

  The storage unit 170 is a nonvolatile or volatile memory or hard disk, and stores information for controlling each unit of the television 10. The storage unit 170 stores, for example, voice command information referred to by the command recognition unit 102 described later.

  The mobile terminal 30 is, for example, a smartphone, can use the mobile terminal 30 on which an application for operating the television 10 is activated, and includes a microphone 31 and an input unit 32. The microphone 31 is a microphone built in the mobile terminal 30, and can collect the sound uttered by the user as with the remote controller 20. The input unit 32 is an input device such as a touch panel, a keyboard, and buttons that are input by the user. Also in the portable terminal 30, as with the remote controller 20, the audio signal indicating the sound collected by the microphone 31 or the input signal input by the input unit 32 is transmitted to the television 10 by wireless communication.

  Note that the TV 10 and the remote controller 20 or the portable terminal 30 are connected by wireless communication such as a wireless LAN or Bluetooth (registered trademark), and data such as voice acquired from the remote controller 20 or the portable terminal 30 is And transmitted to the television 10 by the wireless communication.

  The network 40 is a so-called Internet network.

  The keyword recognition unit 50 is a dictionary server on the cloud that is connected to the television 10 via the network 40. Specifically, the keyword recognition unit 50 receives voice information transmitted from the television 10 and converts the voice indicated by the received voice information into a character string (including one character). Then, the keyword recognizing unit 50 transmits the character information, which is the sound after being converted into the character string, to the television 10 via the network 40 as a sound recognition result.

<Voice recognition device>
The voice recognition apparatus 100 includes a voice acquisition unit 101, a command recognition unit 102, a recognition result acquisition unit 103, a command processing unit 104, an extraction unit 105, a selection mode change unit 106, a display control unit 107, a selection Unit 108, search unit 109, operation reception unit 110, and gesture recognition unit 111.

  The voice acquisition unit 101 acquires voice uttered by the user. The voice acquisition unit 101 may acquire voice uttered by the user by directly using the built-in microphone 130 built in the television 10, or built in the microphone 21 built in the remote controller 20 or the portable terminal 30. The voice uttered by the user acquired by the microphone 31 may be acquired.

  The command recognition unit 102 analyzes the voice acquired by the voice acquisition unit 101 and identifies a preset command. Specifically, the command recognition unit 102 refers to the voice command information stored in advance in the storage unit 170 among the voices acquired by the voice acquisition unit 101. The voice command information is information in which voice and a command that is instruction information for the television 10 are associated with each other. There are multiple types of commands, and different voices are associated with each command. As a result of referring to the voice command information, if the command corresponding to the voice is specified among the plurality of commands, the command recognition unit 102 recognizes that the voice is the specified command. Further, the command recognition unit 102 transmits voice other than the command among the voices acquired by the voice acquisition unit 101 from the transmission / reception unit 150 to the keyword recognition unit 50 via the network 40.

  The recognition result acquisition unit 103 acquires a recognition result that is a result of recognition of the voice acquired by the voice acquisition unit 101 by the command recognition unit 102 or the keyword recognition unit 50. The recognition result acquisition unit 103 acquires the recognition result obtained by the keyword recognition unit 50 from the transmission / reception unit 150 received via the network 40.

  Here, the keyword recognizing unit 50 acquires a voice other than the command among the voices acquired by the voice acquisition unit 101. The keyword recognizing unit 50 recognizes a voice other than the command as a keyword, and converts the voice into a corresponding character string (hereinafter referred to as “dictation”).

  When a command is included in the recognition result acquired by the recognition result acquisition unit 103, the command processing unit 104 causes each processing unit to perform processing corresponding to the command. In addition, the command processing unit 104 performs processing corresponding to a command corresponding to an operation performed by the user received by the operation receiving unit 110 or a gesture performed by the user recognized by the gesture recognition unit 111 to each processing unit. Let it be done. Specifically, when the command includes a keyword and a selection command, the command processing unit 104 causes the extraction unit 105 to perform an extraction process described later. In addition, when the command includes a keyword and a search command, the command processing unit 104 causes the search unit 109 to perform a search process to be described later. In addition, when the command includes an operation command, the command processing unit 104 causes the selection unit 108 to perform selection processing described later. On the other hand, when the recognition result acquired by the recognition result acquisition unit 103 is only the keyword, the display control unit 107 causes the display unit 140 to output the keyword.

  In the present embodiment, the keyword recognition unit 50 receives a voice other than the command recognized by the command recognition unit 102, recognizes the keyword, and transmits the dictation result to the recognition result acquisition unit 103. However, the configuration may be such that all the voices acquired by the voice acquisition unit 101 are received and the dictation results of all the voices are transmitted to the recognition result acquisition unit 103. In this case, the recognition result acquisition unit 103 refers to the voice command information stored in advance in the storage unit 170, separates the dictation result received from the keyword recognition unit 50 into keywords and commands, and outputs them to the command processing unit 104. To do.

  The extraction unit 105 selects a plurality of selections when a keyword and a selection command for selecting one of a plurality of selectable information are included in the recognition result acquired by the recognition result acquisition unit 103. An extraction process is performed to extract selection candidates that are selectable information including the keyword from the possible information.

  When there are a plurality of selection candidates extracted by the extraction unit 105, the selection mode changing unit 106 selects a selection mode for selecting a plurality of selectable information included in the image displayed on the display unit 140 by the display control unit 107. The first selection mode in which all selectable information can be selected is changed to the second selection mode in which only a plurality of selection candidates can be selected.

  The display control unit 107 causes the display unit 140 to display the images output by the processing units of the selection mode change unit 106, the selection unit 108, and the search unit 109 according to a preset resolution for display. Specifically, for example, the display control unit 107 displays the following images on the display unit 140. The display control unit 107, when any one of a plurality of selectable information is selected by the selection unit 108, related information that is a reference destination of the reference information embedded in the selectable information selected by the selection unit 108 Is displayed on the display unit 140. Further, when the selection mode is the second selection mode, the display control unit 107 changes the display form of the plurality of selection candidates to a display form indicating that it is a selection candidate and causes the display unit 140 to display the display form. Further, when the selection mode is the second selection mode, the display control unit 107 further displays, for each of the plurality of selection candidates, an identifier for identifying the selection candidate in an area where the selection candidate is displayed. . In addition, when the selection mode is the second mode, the display control unit 107 selects one of the selectable information extracted as a selection candidate according to the operation received by the operation receiving unit 110 as another selectable information. This is selectively displayed in a display form different from the display form. In addition, the display control unit 107 causes the display unit 140 to display the search results by the search unit 109 as a plurality of selectable information. Further, the display control unit 107 displays the keyword search result in the Internet search application, the keyword search result in the program guide application, or the keyword search result in the searchable application as a plurality of selectable information. To display. Further, the display control unit 107 may display not only the search results by keywords but also a plurality of hypertexts displayed as web pages on the display unit 140 as a plurality of selectable information.

  The selection unit 108 selects any one of a plurality of selectable information according to the user operation received by the operation reception unit 110 or the gesture operation performed by the user recognized by the gesture recognition unit 111. Further, the selection unit 108 is a case where the selection mode is the second mode, and a keyword indicating a plurality of selection candidates or a plurality of selection candidates in the recognition result acquired by the recognition result acquisition unit 103. If a keyword that can specify one of the selection command and the selection command is included, by selecting a selection candidate specified by the keyword, one of a plurality of selection candidates is selected. To do. In addition, when the operation reception unit 110 receives an operation indicating determination, the selection unit 108 can select the display control unit 107 to display on the display unit 140 in a display form different from the display form of other selectable information. By selecting information, one of a plurality of selection candidates is selected.

  When the recognition result acquired by the recognition result acquisition unit 103 includes a keyword and a search command associated with a preset application, the search unit 109 searches the keyword with the application. . Here, when the search command included in the recognition result is associated with an Internet search application that is one of preset applications, the search unit 109 searches for the keyword using the Internet search application. In addition, when the search command included in the recognition result is associated with a program guide application that is one of preset applications, the search unit 109 searches for the keyword using the program guide application. In addition, when the search command included in the recognition result is not associated with a preset application, the search unit 109 searches for the keyword with a searchable application that is all applications that can perform a search with the keyword. I do.

  The operation reception unit 110 receives an operation performed by the user. Specifically, an input signal indicating a user operation performed on the input unit 22 of the remote controller 20 or a user operation performed on the input unit 32 of the mobile terminal 30 is transmitted to the TV 10 and the remote controller 20. The operation performed by the user is received by receiving the wireless communication performed between the controller 20 and the portable terminal 30.

  The gesture recognition unit 111 recognizes a gesture made by the user by performing image processing on the moving image captured by the built-in camera 120. Specifically, for example, the user's hand is recognized, and the user's hand movement is compared with a preset command to identify a command that matches the user's hand movement.

<Operation>
Next, the operation of the speech recognition apparatus 100 of the television 10 according to the present embodiment will be described.

<Activation of voice recognition device>
First, a method for starting voice recognition processing by the voice recognition device 100 of the television 10 will be described. As a method for starting speech recognition processing by the speech recognition apparatus 100, there are mainly three methods as described below.

  The first of the three methods is to press a microphone button (not shown) that is one of the input units 22 of the remote controller 20. Specifically, when the user presses the microphone button of the remote controller 20, the television 10 receives that the operation reception unit 110 has pressed the microphone button of the remote controller 20, and the television 10 speaker (not shown). ) Is set to a volume that is sufficiently low so that the microphone 21 can easily recognize the voice. Then, if the volume of the sound output from the speaker of the television 10 is set to a preset volume, the voice recognition process by the voice recognition device 100 is started. At this time, if the volume output from the speaker is sufficiently small so that voice recognition is easy, the television 10 sets the volume as it is because it is not necessary to perform the volume adjustment. Note that this method is not limited to the remote controller 20 and may be similarly performed by the mobile terminal 30. In the case of the portable terminal 30 (for example, a smartphone equipped with a touch panel), instead of pressing the microphone button of the remote controller 20, an application installed in the portable terminal 30 is activated and depends on the activated application. When the microphone button displayed on the touch panel is pressed, voice recognition by the voice recognition device 100 is started.

  The second of the three methods is to speak “Hi, TV”, which is a voice recognition processing start command set in advance as shown in FIG. “Hi, TV” is an example of a start command, and the start command for the speech recognition process may be another wording. If the voice collected by the built-in microphone 130 is recognized as a preset start command, the volume of the sound output from the speaker of the television 10 is set to a preset volume as described above. Then, the voice recognition process by the voice recognition device 100 is started.

  The third of the three methods is to perform a preset gesture (for example, a gesture of shaking a hand from top to bottom) toward the built-in camera 120 of the television 10. If the gesture is recognized by the gesture recognition unit 111, the volume of the sound output from the speaker of the television 10 is set to a preset volume as described above, and the voice recognition process by the voice recognition device 100 is started. Is done.

  The speech recognition process by the speech recognition apparatus 100 may be started by combining the first method or the second method with the third method.

  As described above, when the voice recognition processing by the voice recognition device 100 is started, the display control unit 107 starts voice recognition at the lower part of the image 200 displayed on the display unit 140 as shown in FIG. A voice recognition icon 201 indicating that the sound has been collected and an indicator 202 indicating the volume of the collected voice are displayed. Note that the start of the voice recognition process as described above is indicated by displaying the voice recognition icon 201. However, the present invention is not limited to this, and a message indicating that the voice recognition process has started is displayed. It may be indicated by making it appear, or it may be indicated by outputting the message by voice.

<Voice recognition>
Next, the speech recognition process by the speech recognition apparatus 100 of the television 10 according to the present embodiment will be described. In the speech recognition process of the speech recognition apparatus 100 according to the present embodiment, two types of speech recognition are performed. One is a voice recognition process for recognizing a preset command (hereinafter referred to as “command recognition process”), and the other is a voice recognition process for recognizing a voice other than the command as a keyword. (Hereinafter referred to as “keyword recognition processing”).

  The command recognition process is performed by the command recognition unit 102 included in the speech recognition apparatus 100 as described above. That is, the command recognition process is performed inside the speech recognition apparatus 100. The command recognition unit 102 identifies the command by comparing the voice from the user to the television 10 with the voice command information stored in the storage unit 170 in advance. The “command” here is a command for operating the television 10.

  As described above, the keyword recognition process is performed by the keyword recognition unit 50, which is a dictionary server connected to the television 10 via the network 40 (see FIG. 3). That is, the keyword recognition process is performed outside the voice recognition device 100. The keyword recognition unit 50 acquires voices other than commands from the voices acquired by the voice acquisition unit 101. Then, the keyword recognizing unit 50 recognizes speech other than the acquired command as a keyword and performs dictation. The keyword recognizing unit 50 performs conversion to a character string by comparing the voice and the database using a database in which the voice and the character string are associated with each other for dictation. In the present embodiment, the voice other than the acquired command is recognized as a keyword and dictated. However, all the voices acquired by the voice acquisition unit 101 are received, and all the voices are dictated. It may be a configuration.

  Specifically, as shown in FIG. 3, when the cursor is in the input field 203 for inputting the search keyword of the browser, the user can start the voice recognition process by the voice recognition device 100. And displayed on the display unit 140 as an image 210. When the user speaks “ABC”, voice information indicating the spoken voice is transmitted to the keyword recognition unit 50 connected to the television 10 via the network 40. The keyword recognizing unit 50 converts the received voice information “ABC” into a character string “ABC” by comparing it with the database, and converts the character information indicating the converted character string to the television 10 via the network 40. To send. The television 10 acquires the character information received from the keyword recognition unit 50 and inputs the character string “ABC” in the input field 203 via the recognition result acquisition unit 103, the command processing unit 104, and the display control unit 107. .

  In this way, the speech recognition apparatus 100 can acquire speech uttered by the user by performing speech recognition processing and input the speech as a character string to the television 10. Then, for example, when a command is included in the acquired voice, such as “search”, the television 10 is caused to perform processing according to the command, and the acquired “search“ ABC ”” is acquired. When a command and a keyword are included in the voice, the television 10 is caused to perform processing based on the command using the keyword. The case where a command and a keyword are included in the voice is, for example, a case where the command is a search command associated with a preset application. That is, a keyword search is performed using a preset application. Here, the preset application is, for example, an Internet search application that is executed by starting a web browser as described above, or a program search application that performs keyword search from a program guide. The search process using such a search command is performed by the search unit 109 described above.

<Selection process>
Next, the selection process by the speech recognition apparatus 100 of the television 10 according to the present embodiment will be described.

  For example, as shown in FIG. 5A, the selection process is performed when a plurality of search results 221a, 221b, 221c, 221d,... This is a process for selecting an optimum search result from the result 221 according to the voice uttered by the user. Here, the plurality of search results 221a, 221b, 221c, 221d,... Are not displayed on the display unit 140 as well as the search results 221a to 221d included in the image 220a displayed on the display unit 140. Some search results are not included. That is, the plurality of search results 221a, 221b, 221c, 221d,... Indicate search results included in an image on the same page that can be displayed only by scrolling without changing to another page.

  Hereinafter, the selection process will be described with reference to FIGS. 4 and 5A to 5C. FIG. 4 is a flowchart showing a flow of selection processing of the speech recognition apparatus according to the present embodiment. FIG. 5A is a diagram showing a search result image of the Internet search. FIG. 5B is a diagram illustrating an example when the selection mode in the selection process is the second selection mode. FIG. 5C is a diagram for describing the second selection mode.

  First, in the selection process, as shown in FIG. 5A, a plurality of search results 221a, 221b, 221c, 221d,. Can be started when. At this time, it is assumed that the user tries to select the search result 221c by voice recognition processing and pays attention to the character string “ABC” included in the search result 221c. Therefore, as shown in FIG. 5B, the user utters a voice “jump to ABC” in a state where the voice recognition process is started. Thereby, the selection process is started. That is, the voice acquisition unit 101 acquires voice from the user through the built-in microphone 130, the microphone 21 of the remote controller 20, or the microphone 31 of the mobile terminal 30 (S101).

  Then, the command recognition unit 102 compares “jump”, which is a command of the voice “jump to“ ABC ””, acquired by the voice acquisition unit 101 with the voice command information stored in the storage unit 170 in advance. Thus, the command is recognized (S102). In the present embodiment, the command “jump” is a selection command for selecting any one of a plurality of selectable information.

  The command recognizing unit 102 identifies a speech “ABC” other than “jump” recognized as a command from the speech “Jump to ABC” as a keyword, and the keyword recognizing unit via the network 40 from the transmission / reception unit 150. The voice specified as the keyword is transferred to 50 (S103).

  The keyword recognizing unit 50 performs dictation on the voice information indicating the voice “ABC” to convert it into a character string “ABC”, and uses the character information indicating the converted character string as a recognition result as “ABC”. Is transmitted to the television 10 which is the transmission source of the sound information indicating the sound.

  The recognition result acquisition unit 103 acquires the command recognized in step S102 and the keyword that is the character string indicated by the character information transmitted by the keyword recognition unit 50 (S104).

  The extraction unit 105 extracts selection candidates that are selectable information including the command and keyword acquired by the recognition result acquisition unit 103 (S105). Specifically, the search result is selectable information including the character string “ABC” 225 recognized as a keyword from among the plurality of search results 221a, 221b, 221c, 221d,... Shown in FIG. 221a, 221c, and 221e are extracted as selection candidates.

  The extraction unit 105 determines whether there are a plurality of search results extracted as selection candidates (S106).

  If it is determined that there are a plurality of search results extracted as selection candidates by the extraction unit 105 (S106: Yes), the selection mode changing unit 106 includes a plurality of search results included in the image displayed on the display unit 140 by the display control unit 107. The selection mode for selecting the search results is changed from the first selection mode in which all search results can be selected to the second selection mode in which only a plurality of selection candidates can be selected (S107). Specifically, as shown in FIG. 5B, since the selection candidates extracted by the extraction unit 105 are the three search results 221a, 221c, and 221e, the selection mode is changed from the first selection mode to the second selection mode. Change to mode. The first selection mode referred to here is, for example, a free cursor mode in which a cursor can be freely moved with a mouse or the like.

  Further, when the selection mode is changed to the second selection mode by the selection mode changing unit 106, an image 220b as shown in FIG. 5B is displayed on the display unit 140. Specifically, the image 220b includes search results 221a, 221c, and 221e extracted as selection candidates, and frames 222 and 223 indicating that the search results 221a, 221c, and 221e are selection candidates, and a search Identifiers 224a, 224b, and 224c for identifying each of the results 221a, 221c, and 221e are included. There are two types of frames 222 and 223. The first frame 222 indicates that the focus is for selecting one of a plurality of selection candidates, and the second indicates that the focus is not focused. This is a frame 223.

  If the selection mode is changed to the second selection mode by the selection mode changing unit 106, one of the search results 221a, 221c, and 221e as a plurality of selection candidates is selected according to the input from the user (S108). In the second selection mode, the user has a plurality of methods for selecting one of a plurality of selection candidates.

  As shown in FIG. 5C, the first method is to selectively switch the first frame 222 to the selection candidate by operating the input unit 22 of the remote controller 20 or the input unit 32 of the mobile terminal 30. It is a method of selecting by. Specifically, in the state of the image 220b displayed in FIG. 5B, when the user inputs an operation of swiping downward as shown in FIG. 5C to the input unit 22 of the remote controller 20, the search result 221a before input. The first frame 222 indicating the focus displayed on the search result 221c is displayed on the search result 221c as in the image 220c shown in FIG. 5C. In this way, after switching the search result in which the first frame 222 is displayed, the input indicating the determination is performed by the input unit 22 or 32 of the remote controller 20 or the portable terminal 30, thereby the first indicating the focus. The search result 221c in which the frame 222 is displayed is selected. In addition, the first frame 222 moves only to the search result in which the second frame 223 is displayed. Further, not only input by the input units 22 and 32 but also a command by voice recognition processing may be used. Specifically, the user utters “move down” after starting the speech recognition process. Thus, the command recognition unit 102 may recognize the command “move down” and the focus destination may be moved.

  The second method is to press a button with a number displayed as the identifiers 224a to 224c. For example, by displaying a numeric keypad on a remote controller having a numeric keypad or the portable terminal 30, pressing a number button indicating an identifier may accept user input as an operation command and select a desired search result. .

  Note that the number indicating the identifier is preferably a single digit in consideration of the convenience that it can be determined by pressing the numeric keypad of the remote controller once and the viewability that can be displayed as a list on the display unit 140. That is, when there are 11 or more selection candidates, it is preferable to narrow down to ten search results from the highest priority after giving some priority. It should be noted that the ordering of the search results from the higher priority order with priorities is not limited to narrowing down to ten search results. In other words, the search results may be arranged in descending order of priority without narrowing down the search results. The priority order may be determined by the ratio of the keywords ("ABC" 225 described above) used in combination with the selection command to the number of characters in the search result.

  The identifier is not limited to a number and may be a character such as an alphabet. Also in this case, if it is recognized that the identifier attached to the search result desired by the user is uttered by using the voice recognition process, the search result corresponding to the identifier is selected. It may be. When using the voice recognition processing, the identifier is an identifier included in the voice command information stored in advance in the storage unit 170 so as to be recognized as an operation command.

  If it is determined that there are not a plurality of search results extracted as selection candidates by the extraction unit 105 (S106: No), the selection unit 108 selects a search result that is one selection candidate (S109).

  If a selection candidate is selected in step S108 or step S109, the selection process is terminated by jumping to related information referred to by the reference information embedded in the search result that is the selection candidate. The reference information referred to here is, for example, a URL (Uniform Resource Locator), and the related information is a web page referenced by the URL.

  In the speech recognition apparatus 100 according to the above embodiment, the selection process for the Internet search result has been described as an example, but the present invention is not limited to the Internet search process. For example, it may be a search result of a program guide application. FIG. 6 shows a search result of a program table (EPG: Electronic Program Guide). FIG. 6 is a diagram showing search results based on the program guide.

  As shown in FIG. 6, an image 300 indicating a search result as a result of keyword search by the program guide application includes time information 301 indicating the time when the program is broadcast, channel information 302 indicating the channel where the program is broadcast, Program information 303 indicating a program broadcast on the time and each channel, search results 304 and 305 as search results by the program guide application, and identifiers 306 and 307 for identifying the search results 304 and 305 Is done.

  In this manner, the search results 304 and 305 as a plurality of selection candidates extracted by searching the program guide with keywords such as actor names are such that the background and characters on which the program information 303 is displayed are reversed. It is displayed. That is, the search results 304 and 305 as selection candidates are displayed in a display form different from the program information 303 that is not a selection candidate. In FIG. 6, the program of the search result 304 is displayed in focus, and the search result 304 is selected if an operation indicating determination is performed. As for the identifiers 306 and 307, as in the Internet search result, if an input indicating each identifier 306 and 307 is performed, the identifier corresponding to the input is selected. Here, if one of the search results is selected, the details of the program information corresponding to the search result are displayed.

  Further, in the search result by the program guide application shown in FIG. 6, selection candidates are extracted by changing the display form of the corresponding program in the program guide, but this is not restrictive. For example, as shown in FIG. 7, the search results of programs may be listed and displayed. An image 400 showing search results when listing and displaying is composed of channel information 401, identifier 402, time information 403, and program information 404. Also in this case, as described above, the user can selectively select one of a plurality of selection candidates.

  In the voice recognition apparatus 100, although not particularly mentioned, the search command and the keyword are included in the voice uttered by the user in the voice recognition process, and the search command type is a search by the Internet search application. If it is, the keyword search is performed by the Internet search application. For example, if the user speaks “Search ABC on the Internet”, the voice “Search on the Internet” is recognized as a search command by the Internet search application. For this reason, the user can perform an Internet search using the keyword only by speaking the voice.

  Further, when the search command and the keyword are included in the voice uttered by the user in the voice recognition process, and the type of the search command is a search by the program guide application, the keyword of the keyword by the program guide application is displayed. A search is performed. For example, if the user says “Search ABC in the program guide”, the voice “Search in program guide” is recognized as a search command by the program guide application. For this reason, the user can perform the program guide search by the keyword only by speaking the voice.

  Further, when the search command and the keyword are included in the voice uttered by the user in the voice recognition process and the type of the search command is not designated, as shown in FIG. A screen for selecting an application for performing the search may be displayed. FIG. 8 is a diagram for explaining a case where the type of search command is not specified. If the search command is recognized in a state where the type of the search command is not specified, icons 501 to 507 of all applications that can be searched using keywords are displayed on the image 500.

  In this state, if the user selects a desired application by operating the input units 22 and 32 of the remote controller 20 or the portable terminal 30, or if selected by voice recognition processing, keyword search is performed by the selected application. Will be done. The icons 501 to 507 included in the image 500 are respectively an Internet search application, an Internet image search application, an Internet news search application, a video posting site application, an Internet encyclopedia application, a program guide application, and a recording list. Is an application.

  Further, when the search command and the keyword are included in the voice uttered by the user in the voice recognition process, and the type of the search command is not specified, the search command and the keyword are not used in all applications including the keyword. You may make it search a keyword and to display the search result in all the applications which searched.

  Since the voice recognition process can be started by the above-described start method, the search as described above can be performed even when the TV 10 is watching a program as long as the voice recognition process is started. Can do.

  According to the speech recognition apparatus 100 according to the present embodiment, when the extraction unit 105 extracts selection candidates according to the keyword and the selection command as a result of speech recognition, when there are a plurality of selection candidates extracted, The first mode in which selectable information can be selected is changed to the second mode in which only the extracted selection candidates can be selected. In other words, even when trying to select one piece of selectable information from among a plurality of selectable information using a keyword as a result of speech recognition, there are a plurality of selection candidates, and the selection candidates cannot be narrowed down to one. In this case, the mode is changed to the second mode in which only the plurality of selection candidates can be selected.

  Therefore, the user can narrow down a plurality of selectable information to a plurality of selectable information including a keyword, and can select from only a plurality of narrowed selection candidates. For this reason, the user can select the intended selectable information more easily than selecting one from all the plurality of selectable information.

  Moreover, according to the speech recognition apparatus 100 according to the present embodiment, since the display form of a plurality of selection candidates is changed to a display form different from other selectable information, the user can display a plurality of selectable information. It is possible to easily determine a plurality of selection candidates.

  Further, according to speech recognition apparatus 100 according to the present embodiment, an identifier is displayed for each of a plurality of extracted selection candidates, so that the user can select selectable information intended to be selected from a plurality of selection candidates. When selecting an identifier of an intended selectable information, the selectable information can be easily selected.

  Further, according to speech recognition apparatus 100 according to the present embodiment, a user can specify a keyword indicating an identifier assigned to a plurality of selection candidates, or a keyword that can specify one of a plurality of selection candidates, The user can select selectable information that the user intends to select only by emitting a voice including a selection command for performing selection based on the keyword.

  Further, according to voice recognition device 100 according to the present embodiment, one of a plurality of selection candidates is displayed differently from the display mode of other selection candidates in accordance with a user operation received by operation reception unit 110. Display selectively in the form. When the operation received by the operation receiving unit 110 is an operation indicating determination, selection candidates displayed in different display forms when the operation is received are selected. That is, based on the operation performed by the user, one of a plurality of selection candidates is selectively focused, and the selection candidate focused when the determination operation is accepted can be selected. Therefore, the user can easily select selectable information intended for selection from among a plurality of selection candidates.

  Moreover, according to the speech recognition apparatus 100 according to the present embodiment, the plurality of selectable information is a keyword search result by a predetermined application. That is, even if it is a keyword search result by a predetermined application, the user can easily select selectable information that the user intends to select from among the search results.

  In addition, according to the speech recognition apparatus 100 according to the present embodiment, the plurality of selectable information is a keyword search result via the Internet. That is, even if it is the search result of the keyword by the internet, the user can select easily the selectable information which a user intends to select among the search results.

  Moreover, according to the speech recognition apparatus 100 according to the present embodiment, the plurality of selectable information is a keyword search result by the program guide application. That is, even if it is the search result of the keyword in a program schedule, the user can select easily the selectable information which a user intends to select among the search results.

  In addition, according to the speech recognition apparatus 100 according to the present embodiment, the plurality of selectable information are keyword search results by all searchable applications among all applications. That is, even if it is a keyword search result in all searchable applications, the user can easily select selectable information that the user intends to select from among the search results.

  Moreover, according to the speech recognition apparatus 100 according to the present embodiment, the plurality of selectable information is a plurality of hypertexts. That is, even for a plurality of hypertexts, the user can easily select selectable information that the user intends to select from among the plurality of hypertexts.

  Although the present invention has been described based on the above embodiment, it is needless to say that the present invention is not limited to the above embodiment. The following cases are also included in the present invention.

  (1) Specifically, each of the above devices can be realized by a system including a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, and the like. A program is stored in the RAM or the hard disk unit. Each device achieves its function by the microprocessor operating according to the program. Here, the program is configured by combining a plurality of instruction codes indicating instructions to the microprocessor in order to achieve a predetermined function.

  (2) A part or all of the constituent elements constituting each of the above-described devices may be configured by one system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip. Specifically, the system LSI includes a microprocessor, a ROM, a RAM, and the like. A program is stored in the ROM. The system LSI achieves its functions by the microprocessor loading a program from the ROM to the RAM and performing operations such as operations in accordance with the loaded program.

  (3) Part or all of the constituent elements constituting each of the above apparatuses may be configured from an IC card that can be attached to and detached from each apparatus or a single module. The IC card or module is a system that includes a microprocessor, ROM, RAM, and the like. The IC card or the module may include the super multifunctional LSI described above. The IC card or the module achieves its function by the microprocessor operating according to the program. This IC card or this module may have tamper resistance.

  (4) The present invention may be realized by the method described above. Further, these methods may be realized by a program realized by a computer, or may be realized by a digital signal composed of a program.

  The present invention also relates to a computer-readable recording medium such as a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, or BD (Blu-ray (registered trademark)). Disc), and may be realized by recording in a semiconductor memory or the like. Moreover, you may implement | achieve with the digital signal currently recorded on these recording media.

  In the present invention, a program or a digital signal may be transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, a data broadcast, or the like.

  Further, the present invention is a system including a microprocessor and a memory. The memory stores a program, and the microprocessor may operate according to the program.

  Further, the program or digital signal may be recorded on a recording medium and transferred, or the program or digital signal may be transferred via a network or the like, and may be executed by another independent computer system.

  (5) The above embodiment and the above modifications may be combined.

  As described above, the embodiments have been described as examples of the technology in the present disclosure. For this purpose, the accompanying drawings and detailed description are provided.

  Accordingly, among the components described in the accompanying drawings and the detailed description, not only the components essential for solving the problem, but also the components not essential for solving the problem in order to illustrate the above technique. May also be included. Therefore, it should not be immediately recognized that these non-essential components are essential as those non-essential components are described in the accompanying drawings and detailed description.

  Moreover, since the above-mentioned embodiment is for demonstrating the technique in this indication, a various change, replacement, addition, abbreviation, etc. can be performed in a claim or its equivalent range.

  The present disclosure can be applied as a video display device capable of easily selecting selectable information intended to be selected by a user using voice recognition. Specifically, the present disclosure can be applied to a television or the like.

DESCRIPTION OF SYMBOLS 1 Voice recognition system 10 Television 20 Remote controller 21, 31 Microphone 22, 32 Input part 30 Portable terminal 40 Network 50 Keyword recognition part 100 Voice recognition apparatus 101 Voice acquisition part 102 Command recognition part 103 Recognition result acquisition part 104 Command processing part 105 Extraction Unit 106 selection mode change unit 107 display control unit 108 selection unit 109 search unit 110 operation reception unit 111 built-in camera 130 built-in microphone 140 display unit 150 transmission / reception unit 160 tuner 170 storage unit

Claims (8)

A video display device,
A display unit for displaying images;
When display information including a plurality of selectable information in which reference information for referencing related information is embedded is displayed on the display unit, any one of the plurality of selectable information is displayed as a user. And a processor that assists in selecting
The processor is
An audio acquisition unit for acquiring audio emitted by the user;
A recognition result acquisition unit that acquires a recognition result of the voice acquired by the voice acquisition unit;
When a keyword and a selection command for selecting one of the plurality of selectable information are included in the recognition result, a selection is possible that includes the keyword among the plurality of selectable information. An extraction unit for extracting selection candidates that are information;
When there are a plurality of selection candidates extracted by the extraction unit, the selection mode for selecting the plurality of selectable information is changed from the first selection mode in which all of the selectable information can be selected. A selection mode changing unit for changing the selection candidate to a selectable second selection mode;
A display control unit that changes a display mode of the display information according to the second selection mode changed by the selection mode change unit,
When the selection mode is the second selection mode, the display control unit displays, for each of the plurality of selection candidates, an identifier for identifying the selection candidate. A video display device,
A display unit for displaying images;
When display information including a plurality of selectable information in which reference information for referencing related information is embedded is displayed on the display unit, any one of the plurality of selectable information is displayed as a user. And a processor that assists in selecting
The processor is
An audio acquisition unit for acquiring audio emitted by the user;
A recognition result acquisition unit that acquires a recognition result of the voice acquired by the voice acquisition unit;
When a keyword and a selection command for selecting one of the plurality of selectable information are included in the recognition result, a selection is possible that includes the keyword among the plurality of selectable information. An extraction unit for extracting selection candidates that are information;
When there are a plurality of selection candidates extracted by the extraction unit, the selection mode for selecting the plurality of selectable information is changed from the first selection mode in which all of the selectable information can be selected. A selection mode changing unit for changing the selection candidate to a selectable second selection mode;
A display control unit that changes a display mode of the display information according to the second selection mode changed by the selection mode change unit;
When the recognition result acquired by the recognition result acquisition unit includes a keyword and a search command associated with a preset application, a search unit that searches the keyword with the application; Have
The display control unit displays a result of the search by the search unit as the plurality of selectable information. A video display device,
A display unit for displaying images;
When display information including a plurality of selectable information in which reference information for referencing related information is embedded is displayed on the display unit, any one of the plurality of selectable information is displayed as a user. And a processor that assists in selecting
The processor is
An audio acquisition unit for acquiring audio emitted by the user;
A recognition result acquisition unit that acquires a recognition result of the voice acquired by the voice acquisition unit;
When a keyword and a selection command for selecting one of the plurality of selectable information are included in the recognition result, a selection is possible that includes the keyword among the plurality of selectable information. An extraction unit for extracting selection candidates that are information;
Only when there are a plurality of selection candidates extracted by the extraction unit, the selection mode for selecting the plurality of selectable information is changed from the first selection mode in which all the selectable information can be selected. A selection mode changing unit for changing the selection candidate to a selectable second selection mode;
A display control unit configured to change a display mode of the display information according to the second selection mode changed by the selection mode changing unit. When there is one selection candidate extracted by the extraction unit, the display control unit displays related information referred to by reference information embedded in selectable information extracted as the selection candidate. The video display device according to claim 3. further,
An operation reception unit that receives operations from the user is provided.
The first selection mode is a mode in which the operation reception unit receives a free cursor operation, and the second selection mode is a mode in which the operation reception unit receives a predetermined command operation or a swipe operation in a predetermined direction. Item 4. The video display device according to Item 3. When display information including a plurality of selectable information embedded with reference information for referencing related information and a display unit that displays video is displayed on the display unit, the plurality of selectable information A video display method of a video display device comprising: a processor that supports a user to select any one of them,
An audio acquisition step for acquiring audio uttered by the user;
A recognition result acquisition step for acquiring the recognition result of the voice acquired in the voice acquisition step;
When a keyword and a selection command for selecting one of the plurality of selectable information are included in the recognition result, a selection is possible that includes the keyword among the plurality of selectable information. An extraction step for extracting selection candidates that are information;
When there are a plurality of selection candidates extracted in the extraction step, the selection mode for selecting the plurality of selectable information is changed from the first selection mode in which all of the selectable information can be selected. A selection mode change step for changing the selection candidate to a selectable second selection mode;
A display control step of changing a display mode of the display information according to the second selection mode changed in the selection mode change step,
In the display control step, when the selection mode is the second selection mode, for each of the plurality of selection candidates, an identifier for identifying the selection candidate is displayed. When display information including a plurality of selectable information embedded with reference information for referencing related information and a display unit that displays video is displayed on the display unit, the plurality of selectable information A video display method of a video display device comprising: a processor that supports a user to select any one of them,
An audio acquisition step for acquiring audio uttered by the user;
A recognition result acquisition step for acquiring the recognition result of the voice acquired in the voice acquisition step;
When a keyword and a selection command for selecting one of the plurality of selectable information are included in the recognition result, a selection is possible that includes the keyword among the plurality of selectable information. An extraction step for extracting selection candidates that are information;
When there are a plurality of selection candidates extracted in the extraction step, the selection mode for selecting the plurality of selectable information is changed from the first selection mode in which all of the selectable information can be selected. A selection mode change step for changing the selection candidate to a selectable second selection mode;
A display control step of changing a display mode of the display information according to the second selection mode changed in the selection mode change step;
When the recognition result acquired in the recognition result acquisition step includes a keyword and a search command associated with a preset application, a search step of searching for the keyword with the application; Including
In the display control step, a video display method of displaying the search result in the search step as the plurality of selectable information. When display information including a plurality of selectable information embedded with reference information for referencing related information and a display unit that displays video is displayed on the display unit, the plurality of selectable information A video display method of a video display device comprising: a processor that supports a user to select any one of them,
An audio acquisition step for acquiring audio uttered by the user;
A recognition result acquisition step for acquiring the recognition result of the voice acquired in the voice acquisition step;
When a keyword and a selection command for selecting one of the plurality of selectable information are included in the recognition result, a selection is possible that includes the keyword among the plurality of selectable information. An extraction step for extracting selection candidates that are information;
Only when there are a plurality of selection candidates extracted in the extraction step, the selection mode for selecting the plurality of selectable information is changed from the first selection mode in which all the selectable information can be selected. A selection mode changing step for changing the selection candidate to a selectable second selection mode;
A display control step of changing a display mode of the display information in accordance with the second selection mode changed in the selection mode changing step.