JP5701327B2 - Speech recognition apparatus, speech recognition method, and program - Google Patents

Description

  The present invention relates to a speech recognition device that recognizes speech.

  In the conventional speech recognition apparatus, when an inappropriate recognition result is output due to misrecognition, the user re-executes speech input or corrects a misrecognized portion (for example, see Patent Document 1).

JP 2008-90625 A

  However, redoing voice input or correcting a misrecognized location has a problem of increasing the burden on the user after voice recognition.

  In view of the above problems, an object of the present invention is to reduce the burden on the user after speech recognition.

  The voice recognition device according to the first aspect of the invention performs voice recognition processing on voice data receiving means that receives voice data that is voice data spoken by a user, and voice data received by the voice data receiving means, Speech recognition result information acquisition means for acquiring speech recognition result information including two or more arrangements of element candidates that are candidate elements that are part of the speech recognition result corresponding to the speech data, and two or more included in the speech recognition result information The element candidate display means for displaying the element candidates, the element candidate selection accepting means for accepting selection of the arrangement of the element candidates for the display of the element candidates by the element candidate displaying means, and the element candidate selection accepting means accepting the selection The speech recognition apparatus includes output means for outputting output information that is an array of element candidates.

  In addition, the speech recognition apparatus according to the second aspect of the present invention is different from the first aspect in that the element candidate display means stores the speech recognition result information according to the size of the area to be displayed or the information amount of the speech recognition result information. This is a speech recognition apparatus that displays all element candidates or some element candidates.

  In the speech recognition device according to the third aspect of the present invention, in contrast to the first or second aspect of the invention, the speech recognition result information acquisition unit obtains speech recognition result information including likelihood information that is likelihood related to the arrangement of element candidates. The acquired element candidate display means is a speech recognition device that displays an element candidate according to likelihood information.

  The speech recognition apparatus according to the fourth aspect of the present invention is a speech recognition apparatus in which the element candidate display means displays the arrangement with the highest likelihood of the element candidates so that the arrangement of the element candidates is linear. is there.

  The speech recognition apparatus according to the fifth aspect of the invention is a term different from the term, which is the same sound as at least some of the terms included in the element candidates with respect to the invention according to any one of the first to fourth aspects. The apparatus further comprises a homophone term acquisition means for acquiring one or more homophone terms, and the element candidate display means replaces the terms included in the element candidates with the homophone terms using the one or more homophone terms acquired by the homophone term acquisition means. This is a speech recognition device that also displays the selected element candidates.

  The speech recognition apparatus according to the sixth aspect of the present invention provides the element candidate selection accepting means according to the invention according to any one of the first to fifth aspects, wherein the element candidate selection accepting means is an element candidate according to the order of the element candidates designated by the user It is a voice recognition device that accepts selection of the arrangement of.

  Further, in the speech recognition device according to the seventh aspect of the invention, in contrast to the invention according to any one of the first to fifth aspects, the element candidate selection accepting unit arranges any of the element candidates included in the speech recognition result information. It is a voice recognition device that accepts the selection.

  According to the speech recognition apparatus and the like according to the present invention, it is possible to reduce the burden on the user after speech recognition.

Block diagram of speech recognition apparatus according to Embodiment 1 The flowchart which shows operation | movement of the speech recognition apparatus in the embodiment. The figure which shows an example of the same sound term stored in the same sound term storage means in the embodiment The figure which shows an example in the case of displaying the arrangement | sequence of the element candidate contained in the speech recognition result information by the element candidate display means in the embodiment The figure which shows an example in the case of displaying the same sound term by the element candidate display means in the embodiment The figure which shows an example of the display of the information which the output means in the embodiment output The figure which shows an example of the change of the display by the element candidate display means in the embodiment The figure which shows an example of the selection which the element candidate selection reception means in the embodiment receives The figure which shows an example in the case of displaying the arrangement | sequence of the element candidate contained in the speech recognition result information by the element candidate display means in the embodiment The figure which shows an example in the case of displaying the arrangement | sequence of the element candidate contained in the speech recognition result information by the element candidate display means in the embodiment The figure which shows an example of the selection which the element candidate selection reception means in the embodiment receives The figure which shows an example of a structure of the computer system in the embodiment

  Hereinafter, embodiments of a speech recognition apparatus will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.

(Embodiment 1)
In the present embodiment, a speech recognition apparatus 1 that displays a sequence of element candidates obtained upon speech recognition and can select the sequence of element candidates from the displayed element candidates will be described.

  FIG. 1 is a block diagram of a speech recognition apparatus 1 in the present embodiment. The voice recognition apparatus 1 includes a voice data receiving unit 101, a voice recognition result information acquiring unit 102, a homophone term storing unit 103, a homophone term acquiring unit 104, an element candidate display unit 105, a display change receiving unit 106, and an element candidate selection receiving unit 107. , Output means 108, microphone 1001, and touch panel 1002. The microphone 1001 acquires voice data that is voice data from voice uttered by the user. The touch panel 1002 displays the information output by the element candidate display unit 105 and the output unit 108. The touch panel 1002 acquires information indicating an operation performed by the user. Note that the microphone 1001 and the touch panel 1002 are well-known technologies, and thus detailed descriptions thereof are omitted.

  The voice data receiving unit 101 receives voice data. This voice data is data of voice uttered by the user. The voice data accepting unit 101 may accept voice data obtained by collecting the spoken voice by the microphone 1001 and converting it into a voice signal, or may accept voice data obtained by other than the microphone 1001. For example, the audio data reception unit 101 may receive audio data transmitted via a wired or wireless communication line, and audio data read from a predetermined recording medium such as an optical disk, a magnetic disk, or a semiconductor memory. May be accepted. The voice may be a voice of one or more words, may be a voice of one or more phrases, or may be a voice of one or more sentences. Note that the voice data receiving unit 101 may or may not include a device such as an interface card, a modem, or a network card for receiving. The audio data receiving unit 101 may be realized by hardware, or may be realized by software such as a driver that drives a predetermined device.

  The voice recognition result information acquisition unit 102 acquires voice recognition result information including two or more arrangements of element candidates that are candidate elements that are part of the voice recognition result corresponding to the voice data. Speech recognition is a process of acquiring the content of an utterance indicated by speech data as character information. This character information is a set of a plurality of elements. The general processing flow of speech recognition is to detect speech segments that are segments containing human speech from speech data, and perform speech collation based on an acoustic model and a vocabulary dictionary for speech data in speech segments to extract character information. This is the flow. The details of the voice recognition process performed by the voice recognition result information acquisition unit 102 may be any process. Since the voice recognition process is a known technique, its details are omitted. The voice recognition result information is information obtained as a result of performing voice recognition processing on the voice data received by the voice data receiving unit 101. The unit of the element may be a word, a morpheme, a phrase, or a mixture of them. The unit of the element may be determined by a speech recognition algorithm. For example, if the user utters “I want to squeeze”, the candidate elements may be “Kishu”, “Kashiwa”, “Buy”, and “Tai”. “No”, “」 ”,“ O ”,“ Buy ”and“ Tai ”may be used. Hereinafter, the case where the element unit is mainly the former will be described. The element candidates are acquired as a result of voice recognition on the voice data received by the voice data receiving unit 101. The reason for “candidate” is that, in the present embodiment, as a result of speech recognition, it is assumed that an array of two or more element candidates is acquired.

  As described above, the speech recognition result information is information including two or more element candidate sequences obtained by converting speech data into character information for each element unit as a result of performing speech recognition processing. For example, when the user utters “I want to buy oysters”, the speech recognition result information is “I want to buy Kishu cocoons”, “I want to buy Kishu oysters” and “I want to buy Kishu flowers” ”Or the like. In this case, the voice recognition result information has not been able to determine which “oyster” is the same as the content spoken by the user in “、”, “oyster” and “vase” in the voice recognition process. It has a list of element candidates. Note that the speech recognition result information may have a sequence of element candidates that are character strings, as described above, and the element candidate expressed by a graph structure in which the element candidates are nodes and the element candidates are edges. You may have a line.

  The speech recognition result information acquisition unit 102 may acquire speech recognition result information including likelihood information. The likelihood information is information indicating the likelihood regarding the arrangement of element candidates. The likelihood is a value indicating the likelihood. The likelihood information is a value calculated in the speech recognition process. The likelihood information may be information for each arrangement of element candidates, or may be information for each part of the arrangement of element candidates. A part of the element candidate list may be, for example, one element candidate, two consecutive element candidates, or three or more consecutive element candidates. Note that the element candidate sequence included in the speech recognition result information may be an element candidate sequence having a likelihood higher than a predetermined threshold in the speech recognition process, and is obtained by the speech recognition process. Among the candidate element sequences, the candidate element sequences that include the likelihoods related to the candidate element sequence may be included in the top N items. N is a natural number of 2 or more. The voice recognition result information acquisition unit 102 can be usually realized by an MPU, a memory, or the like. The processing procedure of the voice recognition result information acquisition unit 102 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The homophone term storage means 103 stores homophone terms. A homophone term is a term that is the same as a certain term and different from that term. The same sound means that the pronunciation is the same, such as “柿” and “oyster”. It should be noted that the pronunciation here may or may not include intonation. Note that the homophone terms may include homonyms or synonyms. Homophone synonyms are terms that have the same meaning with the same sound. The synonym synonym is a term having a relationship in which the sound and the meaning are common, such as “sufficient” and “sufficient”, and the notation is different. The same sound term may be expressed by any method as long as the information can express that a different term from a certain term is the same sound. For example, homophone terms may be expressed in a one-to-one relationship such as “柿, oysters” or “柿, vase”, or “、, oysters, vases,. A plurality of terms of the same sound may be expressed as a group. The homophone term storage means 103 may store a homophone term consisting only of a term, or may store a homophone term including a symbol. For example, the symbol may be associated with “star” or “hoshi” by applying a sound “hoshi” to “☆” or “★”.

  The homophone term storage means 103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The process of storing the homophone term in the homophone term storage means 103 does not matter. For example, a homophone term may be stored in the homophone term storage means 103 via a recording medium, and a homophone term transmitted via a communication line or the like is stored in the homophone term storage means 103. Alternatively, the homophone term input via the input device may be stored in the homophone term storage means 103.

  The homophone term acquisition unit 104 acquires a homophone term of at least some of the terms included in the element candidates. The element candidate including the term for which the homophone term acquisition unit 104 acquires the homonym term is an element candidate included mainly in the voice recognition result information acquired by the voice recognition result information acquisition unit 102. The homophone term acquisition unit 104 may acquire the homonym term from the homophone term storage unit 103 or may acquire the homonym term from other than the homophone term storage unit 103. In the case of “acquiring homophone terms from other than the homophone term storage means 103”, the homophone term acquisition means 104 may be obtained from an external device that can search for homophone terms via a network (not shown). The device that can search for external homophone terms may be a device that publishes a conversion dictionary used in IME (Input Method Editor), for example, and stores the same contents as the homophone term storage means 103. It may be a device having storage means. “At least some of the terms included in the element candidates” may be words or morphemes. The syllable term acquisition unit 104 performs morphological analysis and acquires “at least a part of terms included in the element candidates”, and searches the syllable term storage unit 103 using the term as a search key. Get homophone terms. In addition, when acquiring a homonym term, the homonym term acquisition means 104 may acquire a homonym term only from an independent word. For example, the homophone term acquisition unit 104 may acquire a homophone term using a noun, pronoun, verb, adjective, adjective verb, and the like as a search key. Moreover, the method by which the homonym term acquisition means 104 extracts a word and a morpheme from a character string may be any method. Since morphological analysis or the like can be performed by a known technique, detailed description of morphological analysis is omitted. In addition, when the speech recognition result information includes information indicating some terms such as the result of morphological analysis of each element candidate, the homophone term storage unit 103 uses the term indicated by the information as a search key. You may search against. The syllable term acquisition unit 104 can be usually realized by an MPU, a memory, or the like. The processing procedure of the homophone term acquisition means 104 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The element candidate display unit 105 displays two or more element candidates included in the speech recognition result information. The element candidate display means 105 may display so that two or more arrangements of element candidates can be understood, or may display for each of two or more element candidates that are the result of speech recognition of the same portion of the speech data. In the case of “displaying so that two or more arrangements of element candidates can be understood”, the element candidate display unit 105 may display the arrangement of element candidates in the vertical direction and display the arrangement of element candidates in the horizontal direction. You may do it. “Display so that two or more arrangements of element candidates can be understood” may be to display a part of the arrangement of element candidates, or to display all of the arrangement of element candidates. In the case of “display for every two or more element candidates that are the result of speech recognition of the same part of the speech data”, the element candidate display means 105 displays the element candidate that is the result of speech recognition of the same part of the speech data in the vertical direction May be displayed side by side, and element candidates that are the result of speech recognition of the same portion of the audio data may be displayed side by side in the horizontal direction. In this case, the element candidate display unit 105 displays the next element candidate of the element candidate in the array including the selected element candidate every time the element candidate selection receiving unit 107 receives the selection of the element candidate. You may do it. In this case, when the selected element candidate includes a plurality of element candidates, the element candidate display unit 105 displays the next element candidate next to the selected element candidate in each element candidate array. The next element candidate of the selected element candidate and the element candidate that is the result of speech recognition for the same part of the speech data as the next element candidate of the selected element candidate are displayed. Also good. When displaying the element candidate next to the selected element candidate, the element candidate display means 105 may display the element candidate next to the selected element candidate so that it can be easily selected. For example, the element candidate display unit 105 may display the element candidate next to the selected element candidate at the upper part of the display area or at the center of the display area. Note that the element candidate display unit 105 does not redundantly display element candidates that are the result of speech recognition of the same portion of the speech data included in the plurality of element candidates among the element candidates included in the speech recognition result information. You may make it do, and you may make it display it overlappingly. For example, when the voice data indicates “Kikyu no Oki” and the speech recognition result information includes “Kiju no Oki” and “Kishu no Oyster”, the element candidate display means 105 It is not necessary to display one “Kishu” of “Kishu”, which is a common element of two candidate elements obtained from the voice data “Kisyu”. In other words, in this case, the element candidate display means 105 may display “kishuno”, “柿”, and “oyster” one by one in one display. The “speech recognition result of the same part of the voice data” may be a voice recognition result of a part of the voice data that is the same. For example, when the voice data is “~ does not change”, the arrangement of two types of element candidates “[˜ha”, “tile”, “none”] and [“˜ha” “does not change”] When acquired, “tile” and “not changed” may be “speech recognition result of the same part of the voice data”. Hereinafter, the case of “displaying so that two or more arrangements of element candidates can be understood” will be mainly described.

  Further, the element candidate display unit 105 may display all element candidates included in the speech recognition result information, or may display some element candidates. For example, FIG. 4 shows a state in which all element candidates included in the speech recognition result information when the user utters “I want to write a meal” are displayed. Further, the left side of FIG. 7 shows a state in which the first half element candidates included in the speech recognition result information similar to FIG. 4 are displayed. The element candidate display unit 105 may display all or some element candidates included in the speech recognition result information according to the size of the area to be displayed or the information amount of the speech recognition result information. . The element candidate display means 105 determines whether or not all element candidates included in the speech recognition result information can be displayed from the size of the area to be displayed or the amount of information of the speech recognition result information. Can be displayed, all element candidates may be displayed, and when all element candidates cannot be displayed, some element candidates may be displayed. In addition, the element candidate display unit 105 may display each element candidate with a predetermined size for the area to be displayed, and may display all the element candidates when all the element candidates can be displayed. If all the element candidates cannot be displayed, some element candidates may be displayed. That is, the element candidate display unit 105 may display all element candidates or a part of element candidates as a result. When determining whether or not all element candidates can be displayed, the element candidate display unit 105 sets the size of the area to be displayed when each element candidate is arranged in a predetermined size with respect to the area to be displayed. It may be determined whether or not it can fit, or how many element candidates are arranged in the vertical and horizontal directions, respectively, and whether or not they fit within the size of the area to be displayed may be determined. In addition, the element candidate display unit 105 may change and display the size of the element candidate characters so that all element candidates can be displayed. Note that the size of the display area may be, for example, the size of the screen or the size of the work window.

  When the speech recognition result information includes likelihood information, the element candidate display unit 105 may display the element candidates according to the likelihood information. In the case of “displaying according to likelihood information”, the element candidate display unit 105 may display, for example, an element candidate with a high likelihood of the element candidate, and may display the element candidate with a high likelihood of the element candidate. It may be highlighted. In the case of “display for easy selection”, for example, the element candidate display unit 105 may display the arrangement with the highest likelihood of the element candidates such that the arrangement with the highest likelihood of the element candidates is linear. You may display so that it may become so linear. When “highlighted” is displayed, the element candidate display unit 105 may display, for example, a high likelihood element candidate or a sequence thereof surrounded by a double line. You may change and display the color of the arrangement. In addition, in the case of “highlighted display”, the element candidate display unit 105 may display the display method by changing the display method in multiple stages according to the likelihood value. In addition, in the case of “displaying so as to be linear”, the element candidate display unit 105 may display the arrangement of element candidates having the highest likelihood in the center of the display area. FIG. 4 shows an example in which “I want to buy a Kishu bag” has the highest likelihood information in the list of element candidates included in the speech recognition result information. For example, in FIG. 4, the element candidate display means 105 displays an array of element candidates so that “I want to buy Kishu's coffee” is linear.

  As shown in FIG. 5, the element candidate display means 105 also displays element candidates obtained by replacing the terms included in the element candidates with the homophone terms using one or more homophone terms acquired by the homophone term acquisition means 104. May be. The element candidate display means 105 may display the element candidate of the same sound term in association with the element candidate used for acquiring the same sound term, or may display it without associating. In the case of displaying in association with each other, the element candidate display unit 105 may display the same sound term acquired using at least some of the terms included in the element candidate so that the connection can be understood. For example, the element candidate display unit 105 displays a candidate element in which a part of the element candidate is replaced with a homophone term and a part other than the replaced part is omitted, as in the “KISHU” part of FIG. Alternatively, an element candidate in which all of the element candidates are replaced with the same term may be displayed as in “disassembly”. Even in the former case, since the portion “NO” where the display is omitted is clear, it can be considered that the display of “Ambush” is an element candidate display. Note that the element candidate display unit 105 may display the same term in a non-displayed state, such as a portion such as “柿” in FIG. In this case, the element candidate display means 105 may arrange on the screen an interface for switching between display and non-display of the homophone terms. For example, a button may be used as the interface for switching between display and non-display of the same sound term. The element candidate display unit 105 may switch between display and non-display of the same term by receiving whether the display change receiving unit 106 has pressed a button for switching between display and non-display. In FIG. 5, a button for displaying a homophone term is a “▽” button at the bottom of an element candidate for which no homophone element is displayed. The button for displaying the same term is a “Δ” button below the candidate element where the same term is displayed. When displaying a homonym term, the element candidate display means 105 may display the same homonym term as a term included in another element candidate, or may not display it. In the case where the same homonym term as the term included in the other element candidates is not displayed, the homonym term obtaining unit 104 may not obtain the same homonym term in the first place. Moreover, the element candidate display means 105 may also display the arrangement relationship of the element candidates included in the speech recognition result information as shown in FIG. Further, as shown in FIG. 10, the element candidate display unit 105 may explicitly display the arrangement of element candidates included in the speech recognition result information acquired by the speech recognition result information acquisition unit 102. Moreover, the element candidate display means 105 may also display likelihood information.

  The element candidate display unit 105 may change the displayed information in accordance with the change instruction information received by the display change receiving unit 106. The change instruction information received by the display change receiving means 106 will be described later. The element candidate display means 105 may be considered as including a display device or not. The element candidate display means 105 can be realized by display device driver software, display device driver software and a display device, or the like.

  The display change receiving unit 106 receives change instruction information that is information for instructing a change to the display by the element candidate display unit 105. For example, the change instruction information may be information indicating an instruction for enlarging the element candidate, information indicating an instruction for reducing the element candidate, or information indicating an instruction for displaying all the element candidates. , Information indicating an instruction to display some element candidates, information indicating an instruction to display a homophone term, or information indicating an instruction to hide the homophone term may be used. Information indicating an instruction to scroll the screen may be used. Note that the information indicating the instruction to scroll the screen may include numerical information indicating the amount of scrolling. The display change accepting unit 106 accepts change instruction information from the touch panel 1002, but may accept change instruction information from other than the touch panel 1002. When the change instruction information is received from other than the touch panel 1002, the change instruction information may be received from a numeric keypad, a keyboard, a mouse, a menu screen, or the like. The display change accepting unit 106 can be realized by a device driver of an input unit such as a touch panel 1002, a numeric keypad, or a keyboard, control software for a menu screen, and the like.

  The element candidate selection accepting unit 107 accepts selection of the arrangement of element candidates for the display of the element candidates by the element candidate display unit 105. The element candidate selection receiving unit 107 receives a selection made by the user. The selection of element candidates selected by the element candidate selection receiving unit 107 may be an element candidate arrangement according to the order of the element candidates specified by the user, and any of the element candidates included in the speech recognition result information. It may be a sequence of Note that the user who selects the arrangement of element candidates may be the same person or a different person as the user who has input the voice data to the voice data reception unit 101. In addition, the element candidate selection accepting unit 107 may select an arrangement of element candidates including element candidates that are homonymous terms.

  When receiving the selection of “element candidate arrangement according to the order of element candidates designated by the user”, the element candidate selection accepting unit 107 accepts the element candidate arrangement arranged in the order selected by the user. In this case, for example, as shown in FIG. 8, the user can select the arrangement of the element candidates in the order of output. In the case of FIG. 8, the element candidate selection accepting means 107 accepts the selection of the element candidate arrangements of “柿”, “Buy”, “Tai”, and “Kishu”. When accepting the selection of “any one of the element candidates included in the speech recognition result information”, the element candidate display unit 105 displays several element candidates determined in advance by the user as shown in FIG. It may be displayed so that it can be selected from the sequence of. In the case of FIG. 11, the element candidate selection accepting unit 107 accepts selection of the arrangement of element candidates such as “Kishuno”, “Sake”, “Buy”, and “I want”. It should be noted that the element candidates received by the element candidate selection receiving unit 107 and the arrangement of the element candidates may be information as they are, or may be information for identifying the element candidates and the arrangement of the element candidates. The information for identifying the element candidates and the arrangement of the element candidates is information for identifying the element candidates included in the voice recognition result information acquired by the voice recognition result information acquisition unit 102 and the arrangement of the element candidates.

  The element candidate selection receiving unit 107 receives selection of the arrangement of element candidates from the touch panel 1002, but may receive selection of the arrangement of element candidates from other than the touch panel 1002. When accepting selection of the arrangement of element candidates from other than the touch panel 1002, the element candidate selection accepting unit 107 may accept selection of the arrangement of element candidates from, for example, a numeric keypad, a keyboard, or a mouse. The element candidate selection accepting means 107 can be realized by a touch panel 1002 or a device driver of an input means such as a numeric keypad or a keyboard.

  The output means 108 outputs output information that is a list of element candidates that the element candidate selection accepting means 107 has accepted. The output information may be a single character string obtained by connecting a sequence of element candidates without using a delimiter or the like. When the element candidate selection accepting unit 107 accepts the selection of “element candidate arrangement according to the order of element candidates designated by the user”, the output unit 108 configures output information in the order of the element candidate arrangement. You may do it. In addition, the output unit 108 selects the element candidate included in the speech recognition result information when the element candidate selection receiving unit 107 receives the selection “any one of the element candidates included in the speech recognition result information”. The output information may be configured in the order in which they are arranged. Note that the output unit 108 may output to other components or other devices. For example, the output unit 108 may output to a device that accepts a search keyword, an application that creates a sentence, or the like. The output unit 108 may or may not include an output device (for example, a display device or a printer). The output unit 108 may be realized by hardware, or may be realized by software such as a driver that drives these devices.

  FIG. 2 is a flowchart showing an example of the operation of the speech recognition apparatus 1 in the present embodiment. The operation will be described below with reference to FIG.

  (Step S201) The voice data receiving unit 101 determines whether voice data has been received. If the voice data is accepted, the process proceeds to step S202. If the voice data is not accepted, the process of step S201 is repeated until the voice data is accepted.

  (Step S202) The voice recognition result information acquisition unit 102 acquires voice recognition result information that is a result of voice recognition of the voice data received in step S201.

  (Step S203) The homophone term acquisition unit 104 acquires a homophone term of a term included in the element candidate included in the speech recognition result information acquired in Step S202.

  (Step S204) The element candidate display means 105 determines whether or not all element candidates included in the speech recognition result information acquired in step S202 can be displayed in the display area. If it cannot be displayed, the process proceeds to step S205. If it can be displayed, the process proceeds to step S206.

  (Step S205) The element candidate display unit 105 displays a part of the element candidates included in the speech recognition result information acquired in step S202.

  (Step S206) The element candidate display means 105 displays all of the element candidates included in the speech recognition result information acquired in step S202.

  (Step S207) The display change receiving means 106 determines whether a change to the display has been received. If a change to the display has been accepted, the process proceeds to step S208. If a change to the display has not been accepted, the process proceeds to step S209.

  (Step S208) The element candidate display unit 105 changes the display according to the change instruction information received by the display change receiving unit 106. Then, the process returns to step S207.

  (Step S209) The element candidate change accepting means 106 judges whether or not selection of the arrangement of element candidates has been accepted. If the selection is accepted, the process proceeds to step S210. If the selection is not accepted, the process returns to step S207.

(Step S <b> 210) The output unit 108 outputs output information that is a list of element candidates for selection received in step S <b> 209. Then, the process returns to step S201.
In the flowchart of FIG. 2, the process is terminated by powering off or a process termination interrupt.

  Hereinafter, a specific operation of the speech recognition apparatus 1 in the present embodiment will be described. In addition, the information of each drawing shown in this specific example is prepared for convenience of explanation, and does not indicate actual data. In this specific example, when the speech recognition result information acquisition unit 102 acquires the speech recognition result information, the speech recognition result information acquisition unit 102 also acquires likelihood information of each arrangement of element candidates included in the speech recognition result information. . Further, in this specific example, it is assumed that the element candidates included in the speech recognition result information acquired by the speech recognition result information acquisition unit 102 include the result of morphological analysis.

  In this specific example, it is assumed that the same term storage means 103 stores the table shown in FIG. The table of FIG. 3 has homophone terms. For example, the homophone term “oyster, oyster, firewood, firearm, oyster, below, firearm” is registered.

  It is assumed that the user activates a mailer that is software for creating an e-mail linked to the voice recognition device 1 and starts creating a mail. Then, it is assumed that the user presses the “voice input button”, starts up the voice recognition device 1 having a voice input function, and speaks to the microphone 1001 “I want to wear a sword”.

  The voice data accepting unit 101 accepts voice data “I want to squeak you” acquired by the microphone 1001 (step S201). The voice data received by the voice data receiving unit 101 is subjected to voice recognition processing by the voice recognition result information acquiring unit 102. Then, the voice recognition result information acquisition means 102 obtains the voice recognition result information {[[Kishu no], “Kashiwa,” “Buy”, “Taiwa, 0.88], [“ Kiju no, ”“ Oyster, ”“ Buy, ”“ [Taiki], 0.72], [[Kishu], [Vase], [Buy], [Taii], 0.68], [[Kishu], [Oyster], [Demolition], 0.55], [[Kishu ”,“ Vase ”,“ dismantling ”, 0.52]} (step S202). It should be noted that the number after the element candidate array included in the speech recognition result information acquired here is the likelihood information corresponding to the immediately preceding element candidate. When the speech recognition result information is passed, the homophone term acquisition means 104, among the morphemes included in the candidate elements included in the speech recognition result information, the morphemes “kishu”, “oyster” and “ Acquires the same sound terms corresponding to “柿”, “Vase”, “Buy” and “Dismantling”. As a result, the homophone term acquisition means 104 is included in the speech recognition result information excluding particles and auxiliary verbs, such as the homophone term corresponding to “Kishu” “Kishu, Kishu, Surprise, Already Repaired, Noble”. It is assumed that the same vocabulary terms of the morphemes of all element candidates obtained are acquired (step S203). When the homophone term is acquired by the homophone term acquisition unit 104, the element candidate display unit 105 determines whether or not the arrangement of element candidates included in the speech recognition result information can be displayed in the display area of the touch panel 1002. (Step S204). Here, it is assumed that the element candidate display unit 105 determines that all can be displayed. The element candidate display means 105 has a likelihood information included in the speech recognition result information of “0.88”, which is the highest in the center of the area where the element candidates of “Kishu”, “Sake”, “Buy” and “I want” are displayed. Display in a straight line. Here, the homophone terms are displayed in a non-display state, and element candidates that are recognition results of the same portion of the audio data included in the sequence of other element candidates are not displayed. In this case, the screen of the touch panel 1002 is displayed as shown in FIG. 4 (step S205).

  When the user confirms the screen of FIG. 4, the user operates the touch panel and presses the “▽” button at the bottom of “Kishu”. The display change accepting unit 106 accepts change instruction information for displaying the same term of “Kishu” (step S207). The element candidate display means 105 displays the homologous term “Kishu” in accordance with the change instruction information for displaying the homogenous term “Kishu” (step S208). Furthermore, it is assumed that the user presses the “▽” button below “disassembly”. The change instruction information for displaying the "dismantling" homophone term is similarly received by the display change receiving means 106, and the element candidate display means 105 displays the "dismantling" homophone term. Then, it is displayed as shown in FIG.

  It is assumed that the user operates the touch panel to select “Kishu no”, “Kashiwa”, “Buy”, and “Tai” in this order. Then, the element candidate selection accepting means 107 accepts an array of element candidates [“Kishu no”, “Saga”, “Buy”, “I want”] (step S209). When the element candidate selection accepting unit 107 accepts the selection, the output unit 108 configures output information “I want to buy Kishu cocoons” from the list of element candidates accepted by the element candidate selection accepting unit 107 and outputs it to the mailer ( Step S210). Then, the mailer displays as shown in FIG.

  In this specific example, the case where the element candidate display unit 105 determines that all of the element candidate arrangements included in the speech recognition result information can be displayed in the display area of the touch panel 1002 has been described. If it is determined that the arrangement of all the element candidates cannot be displayed in the area displayed on the touch panel 1002, the element candidate display unit 105 displays a part of the element candidates included in the voice recognition result information. (Step S204). Then, it is displayed as shown in the left figure of FIG. The user flicks the touch panel 1002 from right to left. Then, the display change receiving unit 106 receives change instruction information indicating an instruction to scroll the screen (step S207). The element candidate display means 105 moves the element candidates displayed so that all the element candidates appear to move from the right to the left according to the amount of scrolling included in the change instruction information, and displays them (see FIG. Step S208). Then, it is displayed as shown on the right side of FIG.

  Further, in this specific example, the case where the user selects “Kishu”, “柿”, “Buy”, and “Tai” in order has been described. However, as shown in FIG. "," Buy "," tai "and" Kishu "are selected in order, the element candidate selection receiving means 107 receives selection of the arrangement of element candidates in that order (step S209). When the element candidate selection accepting unit 107 accepts the selection, the output unit 108 configures output information “Kishu I want to buy candy” from the element candidate list accepted by the element candidate selection accepting unit 107 and outputs it to the mailer ( Step S210). Note that the element candidate selection accepting unit 107 may accept the element candidate so as to be in the same order as the element candidate array included in the speech recognition result information regardless of the order selected by the user (step S209).

  Further, in this specific example, the element candidate display means 105 is displayed as shown in FIG. 4, but the element candidate display means 105 displays the element candidates included in the speech recognition result information acquired by the speech recognition result information acquisition means 102. It may be displayed so that the arrangement can be understood. For example, the element candidate display means 105 may display the relationship of the arrangement of element candidates included in the speech recognition result information by connecting with arrows as shown in FIG. The entire arrangement of element candidates included in the speech recognition result information acquired by the recognition result information acquisition unit 102 may be clearly displayed with an arrow. In addition, when displaying so that the arrangement | sequence of the element candidate contained in the speech recognition result information which the speech recognition result information acquisition means 102 acquired can be understood, the user selected the arrow of the element candidate arrangement as shown in FIG. Shall. Then, the element candidate selection accepting means 107 accepts selection of element candidate arrangements in the order of “Kishu”, “Rin”, “Eat”, “Tai”.

  In the present embodiment, the element candidate display unit 105 can display the element candidates, and the element candidate selection receiving unit 107 can receive selection of the arrangement of the element candidates by the user. From the list of element candidates, the user can select a list of element candidates that the user wants to acquire. As a result, for example, the work of correcting the misrecognized portion by the user, which has been performed so far, is only to select the arrangement of the element candidates, so that the burden on the user who selects the arrangement of the element candidates is reduced. In addition, the element candidate display unit 105 does not redundantly display element candidates that are the result of speech recognition of the same portion of the speech data included in the plurality of element candidates among the element candidates included in the speech recognition result information. In this case, since unnecessary information is less than enumerating all the arrangements of element candidates, display with high listability can be performed. As a result, for example, the user can easily select the arrangement of element candidates. Moreover, when the element candidate display means 105 can change a display according to the amount of arrangement | sequence of the element candidate contained in audio | voice recognition result information, a different display can be implement | achieved by a tablet terminal and a smart phone, for example. Specifically, all the element candidates are displayed on the tablet terminal, and some of the element candidates are displayed on the smartphone. In addition, when the element candidate display unit 105 can display the arrangement of the element candidates according to the likelihood information, for example, the element candidate display unit 105 can display the arrangement of the element candidates with high likelihood information so that it can be easily selected. As a result, for example, the time for the user to search for an appropriate element candidate is shortened. In addition, in a case where the element candidate display unit 105 can linearly display an array of element candidates having high likelihood information, for example, in many cases, the user can select an element with high likelihood to trace a straight line. An appropriate element candidate sequence can be selected simply by selecting a candidate sequence. As a result, for example, the time for the user to search for an appropriate element candidate is shortened. Further, when the element candidate display means 105 can display a homophone term corresponding to each element candidate to be displayed, a homophone term that has not been recognized by speech recognition can be selected including the element candidates. In addition, when the element candidate selection accepting unit 107 accepts selection of the element candidate arrangement according to the order of the element candidates designated by the user, the element candidate selection accepting means 107 also starts from the element candidate arrangement in the order not included in the speech recognition result information. Output information can be configured. For example, the user can output the output information in a different order from the time of utterance. In addition, when the element candidate selection accepting unit 107 accepts selection of the arrangement of the element candidates included in the speech recognition result information regardless of the order of the element candidates designated by the user, the element candidate selection acceptance unit 107 includes the element candidates to be selected. Even if all the element candidates are not selected, the output information can be configured only by selecting the arrangement of the element candidates.

  In the present embodiment, the case where the microphone 1001 is included has been described. However, the speech recognition apparatus 1 may not include the microphone 1001. When the voice recognition apparatus 1 does not include the microphone 1001, the voice data receiving unit 101 may receive voice data stored in a storage unit (not shown) or may receive voice data via a network (not shown). Alternatively, audio data recorded by a microphone included in an external device may be received via a storage medium such as a memory card.

  In this embodiment, the case where the touch panel 1002 is included has been described. However, the voice recognition device 1 may not include the touch panel 1002. When the speech recognition apparatus 1 does not include the touch panel 1002, the element candidate display unit 105 may display on another display, and the output unit 108 outputs to another display, another device, or another component. You may do it. When the touch panel 1002 is not included, the display change accepting unit 106 may accept change instruction information output by the user using a mouse, a keyboard, or the like, and the element candidate selection accepting unit 107 may be used by the user. The selection of the arrangement of candidate elements selected using the above may be accepted.

  In the present embodiment, the case where the display change receiving unit 106 is included has been described. However, the speech recognition apparatus 1 may not include the display change receiving unit 106. When the speech recognition apparatus 1 does not include the display change accepting unit 106, the element candidate display unit 105 may change the element candidate to be displayed so that the next element candidate is displayed every time an element candidate is selected. good.

  Further, in the present embodiment, the case where the homonym term storage unit 103 and the homonym term acquisition unit 104 are included has been described, but the speech recognition apparatus 1 does not include the homonym term storage unit 103 and the homonym term acquisition unit 104. It is not necessary. When the speech recognition apparatus 1 does not include the homonym term storage unit 103 and the homonym term acquisition unit 104, the element candidate display unit 105 may not display the homonym term.

  Moreover, the software which implement | achieves the speech recognition apparatus 1 in this Embodiment is the following programs. That is, the program causes the computer to perform voice recognition processing on the voice data received by the voice data receiving means, voice data receiving means that receives voice data that is voice data spoken by the user, and Speech recognition result information acquisition means for acquiring speech recognition result information including two or more arrangements of element candidates that are candidate elements, element candidate display means for displaying two or more element candidates included in the speech recognition result information, and elements In response to the display of element candidates by the candidate display means, as an element candidate selection accepting means for accepting selection of the arrangement of element candidates, an output means for outputting output information that is an array of element candidates accepted by the element candidate selection accepting means It is a program to make it function.

  In the present embodiment, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. Also good. In the present embodiment, it goes without saying that two or more communication means existing in one apparatus may be physically realized by one medium.

  In the present embodiment, each component may be configured by dedicated hardware, or the component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, functions that can be realized only by hardware such as a modem and an interface card in an acquisition unit that acquires information, an output unit that outputs information, and the like are not included in the functions realized by the program.

  FIG. 12 is a diagram illustrating an example of an internal configuration of a computer that executes the program and implements the present invention according to the embodiment. The embodiment described above can be realized by computer hardware and a computer program executed on the computer hardware. In FIG. 12, a computer system 1000 temporarily stores a microphone 1001, a touch panel 1002, an MPU 1003, a flash ROM 1004 for storing a program such as a boot-up program and data, and an application program instruction. A RAM 1005 that provides a temporary storage space and a bus 1006 that connects the MPU 1003 and the like to each other are provided.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer system 1000 to execute the functions of the present invention according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 1000 operates is well known and will not be described in detail.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention. The “means” of each means in the present invention may be read as “part” or “circuit”.

  As described above, the speech recognition apparatus and the like according to the present invention have an effect of reducing the burden on the user after speech recognition, and are useful as a speech recognition apparatus and the like.

DESCRIPTION OF SYMBOLS 1 Voice recognition apparatus 101 Voice data reception means 102 Voice recognition result information acquisition means 103 Homophone term storage means 104 Homophone term acquisition means 105 Element candidate display means 106 Display change reception means 107 Element candidate selection reception means 108 Output means

Claims (9)

Voice data receiving means for receiving voice data which is voice data spoken by the user;
A speech recognition result including two or more sequences of element candidates that are candidates for elements that are part of the speech recognition result corresponding to the speech data, by performing speech recognition processing on the speech data received by the speech data receiving unit Speech recognition result information acquisition means for acquiring information;
Element candidate display means for displaying two or more element candidates included in the speech recognition result information;
Element candidate selection accepting means for accepting selection of the arrangement of element candidates for display of element candidates by the element candidate display means;
Output means for outputting output information that is a list of element candidates for which the element candidate selection receiving means has received selection ;
One or more homophone terms that are the same sound as a part of at least one of the two or more element candidates included in the speech recognition result information and that are different from the term are acquired. Further comprising a homonym term acquisition means,
The element candidate display means includes
A speech recognition apparatus that also displays an element candidate obtained by replacing a term included in an element candidate with the same term using one or more same term obtained by the same term term acquisition means . The element candidate display means includes
The speech recognition apparatus according to claim 1, wherein all or some element candidates of the speech recognition result information are displayed according to a size of a region to be displayed or an amount of information of the speech recognition result information. The voice recognition result information acquisition means includes
Obtain speech recognition result information including likelihood information that is the likelihood related to the arrangement of element candidates,
The element candidate display means includes
The speech recognition apparatus according to claim 1, wherein element candidates are displayed according to the likelihood information. The element candidate display means includes
The speech recognition apparatus according to claim 3, wherein the arrangement having the highest likelihood of element candidates is displayed so as to be linear. One or more element candidates of the two or more element candidates included in the speech recognition result information include independent words and non-independent words,
The homonym term acquisition means includes:
The speech recognition device according to any one of claims 1 to 4, wherein a homonym term is acquired only from an independent word included in the element candidate . The element candidate selection receiving means
The speech recognition device according to any one of claims 1 to 5, which receives selection of an arrangement of element candidates according to an order of element candidates designated by a user. The element candidate selection receiving means
The speech recognition apparatus according to any one of claims 1 to 5, which receives selection of any one of element candidates included in the speech recognition result information. A speech recognition method processed using speech data reception means, speech recognition result information acquisition means, element candidate display means, element candidate selection reception means, and output means,
A voice data receiving step in which the voice data receiving means receives voice data which is voice data spoken by a user;
The voice recognition result information acquisition means performs voice recognition processing on the voice data received by the voice data receiving step, and selects candidate elements that are candidates for elements that are part of the voice recognition result corresponding to the voice data. A voice recognition result information acquisition step for acquiring voice recognition result information including two or more sequences;
An element candidate display step in which the element candidate display means displays two or more element candidates included in the speech recognition result information;
The element candidate selection accepting means for accepting selection of the arrangement of element candidates for displaying the element candidates in the element candidate display step; and
The output means includes an output step of outputting output information that is an array of element candidates that the element candidate selection receiving step has received selection;
One or more homophone terms that are the same sound as a part of at least one of the two or more element candidates included in the speech recognition result information and that are different from the term are acquired. A homonym term acquisition step,
In the element candidate display step,
A speech recognition method for displaying an element candidate obtained by replacing a term included in an element candidate with a homophone term by using one or more homophone terms acquired in the homophone term acquisition step . Computer
Voice data receiving means for receiving voice data which is voice data spoken by the user;
A speech recognition result including two or more sequences of element candidates that are candidates for elements that are part of the speech recognition result corresponding to the speech data, by performing speech recognition processing on the speech data received by the speech data receiving unit Voice recognition result information acquisition means for acquiring information,
Element candidate display means for displaying two or more element candidates included in the voice recognition result information;
Element candidate selection accepting means for accepting selection of the arrangement of element candidates for displaying the element candidates by the element candidate display means,
A program for causing the element candidate selection accepting means to function as an output means for outputting output information that is an array of element candidates accepted for selection ,
Computer
One or more homophone terms that are the same sound as a part of at least one of the two or more element candidates included in the speech recognition result information and that are different from the term are acquired. Further function as a homonym term acquisition means,
The element candidate display means includes
A program for causing a computer to function as an element candidate obtained by replacing a term included in an element candidate with a homophone term using one or more homophone terms acquired by the homophone term acquisition means .

Images