WO2016129188A1

WO2016129188A1 - Speech recognition processing device, speech recognition processing method, and program

Info

Publication number: WO2016129188A1
Application number: PCT/JP2015/086000
Authority: WO
Inventors: 久坂本
Original assignee: Ｎｅｃソリューションイノベータ株式会社
Priority date: 2015-02-10
Filing date: 2015-12-24
Publication date: 2016-08-18
Also published as: JPWO2016129188A1; JP6429294B2

Abstract

A speech recognition processing device according to the present invention comprises: a speech collection means (11) for acquiring input speech as speech data; a speech segmentation means (12) for segmenting the speech data into a plurality of speech data pieces and allocating a sequence number to each speech data piece in the order of input; a storage means (13) for storing the sequence number; a recognition-request transmitting and receiving means (14) for sorting the speech data pieces while mapping the sequence numbers to a plurality of preliminarily established communication ports, and transmitting the speech data pieces to a speech recognition server via a network, and when receiving speech recognition results from the speech recognition server via the communication ports, the recognition-request transmitting and receiving means (14) allocating the sequence numbers mapped to the communication ports to the speech recognition results received, and storing the speech recognition results in the storage means together with sequence numbers matching the allocated sequence numbers; a recognition result integrating means (15) for generating a recognition result sentence composed of the speech recognition results stored together with the sequence numbers, arranged in order of the sequence number; and a display means (16) for displaying the generated recognition result sentence.

Description

Speech recognition processing apparatus, speech recognition processing method, and program

The present invention relates to a speech recognition processing device for recognizing information by human speech, a speech recognition processing method, and a program for causing a computer to execute the method.

The technology related to speech recognition has not changed significantly over the past decade, and it is said that more language models and teacher data need to be accumulated in order to improve recognition accuracy. The speech recognition systems disclosed in Patent Literature 1 and Non-Patent Literature 1 include all of a large amount of data related to these language models and teacher data. The operation of such a voice recognition system is often performed in a personal computer (PC) or a terminal device such as a smartphone or a tablet terminal that has been increasingly used in recent years. However, even though the main storage device and the auxiliary storage device of these terminal devices are increasing in capacity, it is necessary to store all of the large amount of data necessary for the speech recognition system in the terminal device. Difficult from a viewpoint.

To solve this problem, a cloud-type speech recognition service is provided (see Non-Patent Document 2). In such a cloud-type speech recognition service, a large amount of data necessary for speech recognition processing is stored not on the terminal device but on a cloud platform built in a data center. If this service is used, the terminal device is connected to the data center via a network, so that a result of voice recognition processing using the large amount of data can be obtained. As a result of advances in network technology and communication technology, the speed of information processing has increased, so that a user operating a terminal device can immediately obtain a speech recognition result from the cloud platform when inputting voice into the terminal device. In this way, the user can obtain a highly accurate speech recognition result without accumulating a large amount of language models and teacher data in the terminal device. Furthermore, since there is a large amount of storage area on the cloud platform, it is possible to store a huge amount of language models and voice data for each pattern of various speakers, and further improve accuracy.

Japanese Patent No. 1603542

The cloud-type voice recognition service disclosed in Non-Patent Document 2 solves the problems of the techniques disclosed in Patent Document 1 and Non-Patent Document 1. However, this cloud-type speech recognition service is not suitable for recognition processing of long conversational sentences composed of multiple sentences because short sentences such as short words at a word level and relatively short conversational sentences are processed. .

An object of the present invention is to provide a speech recognition processing device, a speech recognition processing method, and a program that enable recognition processing of a long conversation sentence.

A speech recognition processing apparatus according to an aspect of the present invention includes a voice sampling unit that acquires input voice as voice data, a voice sampling unit that divides the voice data into a plurality of voice data pieces, and each of the plurality of voice data pieces. Voice dividing means for assigning permutation numbers in accordance with the order input to the memory, storage means for storing the permutation numbers, and assigning permutation numbers to a plurality of preset communication ports, and distributing voice data pieces via the network When a speech recognition result, which is a result of recognition processing performed on the speech data piece by the speech recognition server, is received from the speech recognition server via the communication port, the received speech recognition result is associated with the communication port. A permutation number is assigned, and the speech recognition result is stored in an area of the storage means in which the permutation number matching the assigned permutation number is stored. Recognition request transmission / reception means, recognition result aggregating means for generating a recognition result sentence in which speech recognition results stored in the storage means together with the permutation number are arranged according to the permutation number, display means for displaying the generated recognition result sentence, It is the structure which has.

A speech recognition processing method according to an aspect of the present invention is a speech recognition processing method by an information processing apparatus, which acquires input speech as speech data, divides speech data into a plurality of speech data pieces, A permutation number is assigned to each of the audio data pieces according to the order in which the audio data is acquired, the permutation numbers are stored in the storage means, and the audio data pieces are assigned to the plurality of preset communication ports while associating the permutation numbers with the network. When a voice recognition result, which is a result of recognition processing of the voice data piece by the voice recognition server, is received from the voice recognition server via the communication port, the received voice recognition result is transmitted to the communication port. A permutation number associated with the assigned permutation number is assigned, and the speech recognition result is stored in the storage means area where the permutation number matching the assigned permutation number is stored. It was paid, in which the speech recognition result stored in the storage means together with the permutation numbers to generate a recognition result sentences arranged according permutation number, displays the generated recognition results statement.

A program according to one aspect of the present invention is a procedure for acquiring input audio as audio data in a computer, dividing the audio data into a plurality of audio data pieces, and acquiring the audio data for each of the plurality of audio data pieces. A procedure for assigning permutation numbers in accordance with the order in which the permutation numbers are assigned, a procedure for storing the permutation numbers in the storage means, and a voice recognition server that distributes voice data pieces while associating permutation numbers with a plurality of preset communication ports. And when a speech recognition result, which is a result of recognition processing of the speech data piece by the speech recognition server, is received from the speech recognition server via the communication port, a permutation associated with the received speech recognition result corresponding to the communication port Voice recognition in the area of the storage means in which the number assignment procedure and the permutation number matching the assigned permutation number are stored A procedure for storing the results, a procedure for generating a recognition result sentence in which the speech recognition results stored in the storage means together with the permutation numbers are arranged according to the permutation numbers, and a procedure for displaying the generated recognition result sentences. is there.

FIG. 1 is a block diagram for explaining the configuration of the speech recognition processing apparatus of the present embodiment. FIG. 2 is a diagram showing a configuration example of data stored in the permutation number storage means shown in FIG. FIG. 3 is a diagram showing another configuration example of data stored in the permutation number storage means shown in FIG. FIG. 4 is a flowchart showing an operation procedure performed by the speech recognition processing apparatus according to the present embodiment. FIG. 5 is a flowchart showing the detailed operation of step S02 shown in FIG. FIG. 6 is a flowchart showing the detailed operation of step S05 shown in FIG. FIG. 7 is a block diagram for explaining the configuration of the speech recognition processing apparatus according to the first embodiment. FIG. 8 is a diagram illustrating a configuration of data stored in the permutation number storage unit in the first embodiment. FIG. 9 is a diagram showing the transmission contents of the recognition request transmission / reception means in the first embodiment. FIG. 10 is a diagram illustrating the contents received by the recognition request transmission / reception unit according to the first embodiment. FIG. 11 is a diagram showing an example when data is stored in the field shown in FIG. 12 is a diagram illustrating an example of the screen of the display unit illustrated in FIG. 7 in the first embodiment. FIG. 13 is a block diagram showing another configuration example of the speech recognition processing apparatus of this embodiment.

The configuration of the speech recognition processing apparatus of this embodiment will be described.

FIG. 1 is a block diagram for explaining the configuration of the speech recognition processing apparatus of this embodiment.

The voice recognition processing device 1 is an information processing device that outputs information in which a conversation made by the speaker 4 is converted to text so that the viewer 5 can view it. The speech recognition processing device 1 may be a desktop or notebook PC, or a portable information terminal such as a PDA (Personal Digital Assistant) smaller than the PC. The number of speakers 4 and viewers 5 may be plural.

The voice recognition processing device 1 is connected via a network 6 to a voice recognition server 3 that provides a cloud type voice recognition service. The cloud type speech recognition service is a cloud type speech recognition service disclosed in Non-Patent Document 2, for example.

As shown in FIG. 1, the speech recognition processing device 1 includes a permutation number storage unit 13, a recognition request transmission / reception unit 14, and a control unit 30. The control unit 30 is provided with a memory (not shown) that stores a computer program (hereinafter simply referred to as a program) and a CPU (Central Processing Unit) (not shown) that executes processing according to the program. .

The control unit 30 includes a voice collection unit 11, a voice division unit 12, a recognition result aggregation unit 15, and a recognition result display unit 16. When the CPU in the control unit 30 executes processing according to the program, the voice collection unit 11, the voice division unit 12, the recognition result aggregation unit 15, and the recognition result display unit 16 are virtually configured in the voice recognition processing device 1. The

It should be noted that a microphone is connected to the voice sampling means 11 and a display unit is connected to the recognition result display means 16, but the illustration is omitted. Further, although a case where a display unit is connected to the recognition result display unit 16 as an output unit for the recognition result sentence will be described, a printer may be used.

Also, some or all of the voice collection unit 11, the voice division unit 12, the recognition result aggregation unit 15, and the recognition result display unit 16 shown in FIG. 1 are ASIC (Application Specific Integrated Circuit) or the like specialized for each function. A dedicated integrated circuit may be used. In particular, in speech recognition technology, it is necessary to perform speech recognition processing in accordance with the input speed of speech, and the speed of information processing becomes important. By providing a dedicated integrated circuit specialized for the function of some of the plurality of means, the overall information processing speed can be improved.

Each configuration of the speech recognition processing device 1 shown in FIG. 1 will be described in detail.

The voice sampling means 11 receives voice information emitted from one or more speakers 4 as digital data, which is voice data continuously input via a microphone (not shown), and is continuous information like stream data. Get as. In the present embodiment, the voice collection unit 11 will be described as a case where the acquired voice data is output to the voice division unit 12 without being processed, but the voice data may be processed and output. As processing of audio data, for example, noise canceling processing for removing noise and filtering processing for extracting only a frequency band indicating human speech can be considered.

The voice dividing unit 12 analyzes the voice data acquired by the voice sampling unit 11, and divides the voice data into voice data pieces that are smaller units. The method of dividing is to detect a part in which voice information of a person does not exist (for example, a part in which no person's voice exists) or a breathing part, and extract data before and after that as a piece of voice data. is there. The audio data in the area sandwiched between the detected parts corresponds to an audio data piece. As a method of determining whether or not a human voice exists, by examining the presence or absence of data in a frequency band (eg, about 200 Hz to about 4 KHz) that is normally recognized as a human voice in the target voice data, There is a method for determining whether there is audio information. In addition, as a method for determining whether there is sound information, sound data in a state in which no human sound is included is collected, and the sound is recorded as an environmental sound. A method of determining that there is no information is conceivable. The method for detecting the presence or absence of audio information is not limited to the method described here, and other methods may be used.

Also, the voice dividing means 12 assigns a permutation number indicating the order of appearance of the voice data to the divided voice data pieces. Here, the voice dividing means 12 assigns permutation numbers in order from the first voice data piece of the voice data received from the voice sampling means 11. Therefore, the permutation numbers assigned to the audio data pieces are in the order of input to the audio sampling means 11.

When the recognition request transmission / reception means 14 receives from the voice division means 12 a pair of the voice data piece divided by the voice division means 12 and the permutation number assigned to the voice data piece, the voice request containing the voice data piece is sent to the voice request. It transmits to the recognition server 3. At that time, the recognition request transmission / reception means 14 transmits a plurality of voice recognition requests to the voice recognition server 3 in parallel. This will be specifically described below.

In the recognition request transmission / reception means 14, the number of communication ports (communication channels) for transmitting / receiving data to / from the voice recognition server 3 is preset. The number of communication ports is determined by the information processing capability of the voice recognition server 3 that is a data transmission / reception destination. In the present embodiment, a plurality of communication ports are set to be usable in the recognition request transmission / reception means 14. The recognition request transmission / reception unit 14 has a plurality of logically usable communication ports, and associates a pair of a permutation number and a voice data piece passed from the voice division unit 12 to each of the plurality of communication ports. And permutation number combination information. And the recognition request transmission / reception means 14 can transmit a plurality of voice recognition requests in parallel by transmitting a recognition request including a voice data fragment to the voice recognition server 3 via each communication port. At this time, there is no need to synchronize between communication ports, and transmission can be performed asynchronously. The number of voice recognition requests that can be made at one time may be fixedly set in the recognition request transmission / reception means 14 or may be set freely by a setting file or the like.

The recognition request transmission / reception unit 14 associates the received voice data piece with the communication port when receiving the voice recognition result from the voice recognition server 3 through the communication port. The permutation number that has been assigned is assigned to the received speech recognition result. Furthermore, the recognition request transmission / reception unit 14 stores the speech recognition result and the permutation number in the permutation number storage unit 13 in association with each other.

The permutation number storage means 13 records the permutation numbers assigned to the audio data pieces divided by the audio dividing means 12. FIG. 2 is a diagram showing a configuration example of data stored in the permutation number storage means.

Referring to FIG. 2, the configuration of data stored in the storage area provided in the permutation number storage means 13 will be described.

The storage area of T1301 shown in FIG. 2 is a field in which the maximum value of the permutation numbers assigned to the audio data pieces divided by the audio dividing means 12 is recorded. In the initial stage where no permutation number is assigned, 0 is recorded in the field T1301 of the permutation number storage means 13 as the initial value of the maximum permutation number. The initial stage is when the speech recognition processing program of this embodiment is started.

When assigning the permutation number, the voice division means 12 reads the maximum value of the permutation number from the permutation number storage means 13, assigns the value obtained by adding 1 to the next voice data piece, and then updates it. The maximum value of the permutation number is recorded in the permutation number storage means 13. The permutation number storage means 13 stores the speech recognition result received by the recognition request transmission / reception means 14 in pairs with the permutation number.

A schema having a data structure different from the data structure shown in FIG. 2 in the permutation number storage means 13 will be described. FIG. 3 is a diagram showing another configuration example of data stored in the permutation number storage means shown in FIG.

The storage area of T1311 shown in FIG. 3 is a field for storing the number (permutation number) assigned to the audio data pieces divided by the audio dividing means 12. The storage area of T1312 shown in FIG. 3 is a field for storing the speech recognition result received by the recognition request transmission / reception means 14.

The permutation number storage means 13 is not limited to the data structure described above, and may be realized by a database or the like so that data can be referred to and recorded as described above.

The recognition result aggregating unit 15 reads the speech recognition result received by the recognition request transmitting / receiving unit 14 from the speech recognition server 3 and the permutation number associated with the recognition result from the permutation number storage unit 13, and the speech recognition results in the order of the permutation number. And a recognition result sentence composed of a certain number of words or syllables is created. The recognition result aggregating unit 15 periodically searches the permutation number storage unit 13 to determine whether a predetermined number or more of speech recognition results are stored from the smallest permutation number. When the recognition result aggregating unit 15 determines that a certain number or more of speech recognition results can be connected, the recognition result sentence is created by connecting the voice recognition results in order, and the created recognition result sentence is displayed as a recognition result. Pass to means 16. Then, the recognition result aggregation means 15 deletes the connected speech recognition result and the record of the permutation number from the data stored in the permutation number storage means 13. Note that the number of speech recognition results for confirming a sentence may be fixedly set in the recognition result aggregating unit 15 or may be freely set by a setting file or the like.

When the recognition result display unit 16 receives the recognition result sentence from the recognition result aggregation unit 15, the recognition result display unit 16 outputs the recognition result sentence as a character string to a display unit (not shown) so that the viewer 5 can view it. As a display method, a window may be displayed by GUI (Graphical User Interface), or output to a file or the like. Further, at the time of display, processing for converting all output sentences into “Hiragana” or “Katakana” may be performed, or processing for converting a part or all of them into Roman characters or the like may be performed.

Next, the operation procedure of the speech recognition processing apparatus of this embodiment will be described.

FIG. 4 is a flowchart showing the operation procedure of the speech recognition processing apparatus of this embodiment.

Step S01: The voice collecting means 11 continuously receives voice information from one or more speakers 4 from a microphone (not shown) as digital data, and acquires it as continuous information such as stream data.

Step S02: The voice dividing unit 12 detects a breathing and silent portion from the voice data collected by the voice collecting unit 11, and divides the voice data before and after the breathing and silent parts. Subsequently, the voice dividing means 12 assigns a permutation number to the divided voice data pieces, registers the permutation numbers in the permutation number storage means 13, and sets the divided voice data pieces and the assigned permutation numbers as a set. To the recognition request transmission / reception means 14.

Here, the operation of step S02 shown in FIG. 4 will be described in detail with reference to FIG.

Step S0201: The voice dividing means 12 detects breathing and silent parts from the collected voice data.

Step S0202: The voice dividing unit 12 divides the voice data before and after the detected breathing and silence parts to create a voice data piece.

Step S0203: The voice dividing unit 12 assigns a permutation number to each of the voice data pieces in the divided order. Then, the voice dividing unit 12 acquires the current maximum value of the permutation number from the field T1301 of the permutation number storage unit 13, increments the value by 1, and records it in the field T1301 of the permutation number storage unit 13.

Step S0204: The voice dividing unit 12 assigns the permutation number assigned in step S0203 to the divided voice data piece and passes it to the recognition request transmitting / receiving unit 14.

This completes the detailed description of the operation in step S02.

Returning to the description of the flowchart shown in FIG.

Step S03: The recognition request transmission / reception means 14 requests voice recognition by transmitting a plurality of pieces of voice data divided by the voice division means 12 to the voice recognition server 3 asynchronously and in parallel. At the time of transmission, the recognition request transmission / reception unit 14 has a plurality of communication ports, associates the communication port used for transmission of the recognition request with the permutation number passed from the voice division unit 12, and holds information on the correspondence.

Step S04: Upon receiving the speech recognition result from the speech recognition server 3, the recognition request transmission / reception means 14 searches the permutation number in the field T1311 of the permutation number storage means 13 using the permutation number held in Step S03. The speech recognition result is stored in the field T1312 of the record whose value matches.

Step S05: The recognition result aggregating unit 15 periodically searches the speech recognition result storage state in the permutation number storage unit 13, and if the speech recognition result is continuously stored for a certain length, those recognition results are stored. Connect the results to create a recognition result sentence.

The operation of step S05 shown in FIG. 4 will be described in detail with reference to FIG.

Step S0501: The recognition result aggregating unit 15 periodically retrieves the speech recognition result storage state in the permutation number storage unit 13, and a predetermined number of speech recognition results are continuously registered from the smallest permutation number. Find out the state of being.

Step S0502: The recognition result aggregating means 15 acquires a plurality of permutation number (field T1311) and speech recognition result (field T1312) pairs found in step S0501 from the permutation number storage means 13, and performs speech recognition in the order of the permutation numbers. The results are rearranged and the speech recognition results are connected to generate a recognition result sentence.

Step S0503: The recognition result aggregating unit 15 deletes the record storing the speech recognition result and the permutation number acquired in step S0502 from the permutation number storage unit 13.

Step S0504: The recognition result aggregating unit 15 passes the recognition result sentence generated in step S0502 to the recognition result display unit 16.

This completes the detailed description of the operation in step S05.

Returning to the description of the flowchart shown in FIG.

Step S06: The recognition result display means 16 displays the recognition result sentence generated by the recognition result aggregating means 15 so that the viewer 5 can view it. In this embodiment, the recognition result display means 16 outputs a recognition result sentence to a display unit (not shown).

The speech recognition processing method by the speech recognition processing apparatus of the present embodiment will be specifically described using examples. Detailed description of the same configuration as that shown in FIG. 1 is omitted.

FIG. 7 is a block diagram showing a configuration example of the voice recognition processing apparatus of the present embodiment.

The voice recognition processing apparatus 1 of the present embodiment has a configuration in which a program for executing the above-described voice recognition processing method is stored in advance in a memory (not shown) in the control unit 30 in a general PC. A microphone 21 is connected to the voice sampling means 11 of the voice recognition processing device 1 as a device for inputting voice. Further, a display unit 22 is connected to the recognition result display means 16 of the speech recognition processing device 1 as a device for displaying the recognition result sentence.

In this embodiment, the network 6 is a network including the Internet. The voice recognition processing device 1 and the voice recognition server 3 use TCP (Transmission Control Protocol) / IP (Internet Protocol) as a communication protocol. Each of the speech recognition processing device 1 and the speech recognition server 3 stores in advance the terminal identification of the own device and the counterpart device.

In the field T1301 of the permutation number storage means 13, 0 is recorded as the initial value of the permutation number maximum value. The recognition request transmission / reception means 14 has five communication ports that can simultaneously transmit a voice recognition request. The recognition result aggregating unit 15 creates a recognition result sentence when three voice recognition results are continuously obtained.

The operation of the speech recognition processing apparatus 1 of this embodiment will be described with reference to FIG.

After the viewer 5 operates the voice recognition processing device 1 and inputs an instruction to start the voice recognition processing program, the speaker 4 speaks “Today is fine”. However, in this sentence, a punctuation mark indicates breathing in actual occurrence, and a punctuation mark indicates a silent part.

Step S01: The voice sampling means 11 continuously receives voice data from the microphone 21 as digital data, and obtains it as stream data.

Step S02: The breath data and the silent part are detected from the voice data collected by the voice dividing unit 12 (today is fine), and the voice data is divided before and after that. Subsequently, the voice dividing means 12 assigns a permutation number to the divided voice data pieces, registers the permutation numbers in the permutation number storage means 13, and sets the divided voice data pieces and the assigned permutation numbers as a set. To the recognition request transmission / reception means 14.

Here, the operation of step S02 will be described in detail with reference to FIG.

Step S0201: The voice dividing means 12 detects breathing and silent parts from the collected voice data (it is fine today). In this embodiment, a punctuation mark of a sentence representing voice data is detected. As a detection method, when the voice data of 200 Hz to 4 KHz is less than 60 decibels and the state is continued for 0.5 seconds or more, it is determined that breathing and silence are present.

Step S0202: The voice dividing unit 12 divides the voice data before and after the detected breathing and silence parts to create a voice data piece. In this embodiment, it is divided into a voice data piece “Today”, a voice data piece “Sunny”, and a voice data piece “I”.

Step S0204: The voice dividing means 12 passes the permutation number numbered in step S0203 to the divided voice data piece and assigns it to the allocation recognition request transmission / reception means 14, and records the permutation number information in the permutation number storage means 13. In this embodiment, the voice division means 12 assigns the permutation number 1 to the voice data piece “Today”, the permutation number 2 to the voice data piece “Sunny”, and the voice data “I”. Number permutation number 3 on a piece. The state of the permutation number storage means 13 at this time is shown in FIG.

This completes the detailed description of the operation in step S02.

Returning to the description of the flowchart shown in FIG.

Step S03: The recognition request transmission / reception means 14 requests the voice recognition by transmitting a plurality of pieces of voice data divided by the voice dividing means 12 to the voice recognition server 3 asynchronously and in parallel. At the time of transmission, the recognition request transmission / reception means 14 has five communication ports, and holds the communication port used for transmission of the recognition request and the permutation number passed from the voice division means 12 as shown in FIG. . FIG. 9 is a diagram showing a state in which a recognition request is sent from the voice recognition processing device to the voice recognition server for each communication port. In FIG. 9, ports 1 to 3 represent communication port numbers, and “port 1: permutation number 1” means that permutation number 1 is held in association with communication port 1. In FIG. 9, the communication ports 4 and 5 are omitted. Since the speech recognition processing device 1 is realized on the PC by executing a program, each communication port and the corresponding permutation number are recorded on a memory (not shown) assigned from the PC.

Step S04: The recognition request transmission / reception means 14 receives the speech recognition result from the speech recognition server 3 as shown in FIG. FIG. 10 is a diagram illustrating a state in which the recognition result is returned from the voice recognition server to the voice recognition processing apparatus for each communication port. Comparing FIG. 9 and FIG. 10, it can be seen that the recognition result corresponding to the recognition request is returned from the voice recognition server 3 to the same communication port.
The recognition request transmission / reception means 14 searches the permutation number in the field T1311 of the permutation number storage means 13 using the permutation number held in step S03, and displays the speech recognition result in the field T1312 of the record with the matching value. Store as shown in FIG.

At this time, it is assumed that the order of arrival of the speech recognition results is the order of permutation number 2, permutation number 3, and permutation number 1, and the speech recognition results are stored in the permutation number storage means 13 in that order.

Step S05: The recognition result aggregating unit 15 periodically searches the speech recognition result storage state in the permutation number storage unit 13, and finds a data string in which three speech recognition results are stored continuously. Then, the recognition result aggregating unit 15 connects the results to create a recognition result sentence “Today is sunny”. At the time of joining, the recognition result aggregation means 15 inserts a blank character between the speech recognition results.

The operation of step S05 will be described in detail with reference to FIG.

Step S0501: The recognition result aggregating means 15 periodically searches the speech recognition result storage state in the permutation number storage means 13, and three consecutive speech recognition results are registered from the smallest permutation number. Find the state, that is, the records with

permutation numbers

1, 2, and 3.

Step S0502: The recognition result aggregating unit 15 acquires a plurality of permutation number (field T1311) and speech recognition result (field T1312) pairs found in step S0501 from the permutation number storage unit 13. In this embodiment, the recognition result aggregating unit 15 acquires “Today” from the record with the permutation number 1, acquires “sunny” from the record with the permutation number 2, and acquires “is” from the record with the permutation number 3. To do. Thereafter, the recognition result aggregating unit 15 rearranges the speech recognition results according to the order of the permutation numbers, and generates a recognition result sentence “Today is fine” by connecting the respective speech recognition results. When connecting each speech recognition result, a space is inserted between them.

Step S0503: The recognition result aggregating unit 15 deletes the record storing the speech recognition result and the permutation number acquired in step S0502 from the permutation number storage unit 13. In this case, the records with

permutation numbers

1, 2, and 3 correspond.

Step S0504: The recognition result aggregating unit 15 passes the recognition result sentence “Today is fine” generated in step S0502 to the recognition result display unit 16.

This completes the detailed description of the operation of step S05.

Returning to the description of the flowchart shown in FIG.

Step S06: The recognition result display means 16 outputs the recognition result sentence “Today is fine” generated by the recognition result aggregation means 15 to the result display area 2201 of the display unit 22 as shown in FIG. To the user. FIG. 12 is an example of a display screen.

In this way, voice recognition processing of a long conversation sentence is performed, and the viewer can browse the recognition result sentence corresponding to the conversation sentence.

Note that, as described in steps S03 to S05 of the first embodiment, there may be a case where the speech recognition result of the recognition request sent after the recognition request sent earlier is delivered first. A method for processing the next recognition request in this case will be described.

The recognition request transmission / reception means 14 assigns the permutation number 2 to the speech recognition result received through the port 2 while the port 1 is waiting for the speech recognition result reception, and the permutation number 3 to the speech recognition result received through the port 3. And the combination of the speech recognition result and the permutation number is stored in the permutation number storage means 13.

When the recognition request transmission / reception means 14 receives a combination of the voice data piece and the permutation number as the next recognition processing target from the voice division means 12, the recognition request transmission / reception means 14 associates the pair with a communication port that is not waiting for the recognition result. Here, when there are four voice data pieces to be recognized next, the recognition request transmitting / receiving unit 14 associates each of the four voice data pieces with each of the ports 2 to 5. That is, the recognition request transmission / reception means 14 sequentially distributes the next speech data pieces to be recognized to the unused ports 2 to 5 without waiting for the reception of the speech recognition result of the port 1.

As described above, even if the speech recognition result of the recognition request sent after the recognition request sent earlier is delivered first, the next recognition processing target speech data piece is sequentially associated with the communication port that is not used. Thus, information processing can be performed efficiently.

In the present embodiment, as described above, the voice data of a long conversation sentence is divided into voice data pieces having a word level that can be recognized by the cloud type voice recognition service, and each voice data piece is obtained using the cloud type voice recognition service. Are obtained, and the obtained speech recognition results are arranged in the original order to output a recognition result sentence of a long conversation sentence. Therefore, a user can convert a long conversation sentence composed of a plurality of sentences into character information without storing a large amount of data necessary for recognition processing in a terminal device such as his / her PC, smartphone or tablet terminal. Voice recognition results can be acquired.

In addition, since a large amount of language models and teacher data are not arranged in the terminal device, management such as update work and backup of these data is not required, and the storage area in the terminal device is not compressed and the load is relatively low. Voice recognition processing can be realized. The reason is that in this embodiment, the cloud type speech recognition service provided via the network is requested to perform speech recognition, the result is received, and the recognition result sentence is presented.

In the above-described embodiments and examples, the speech recognition processing device of the present invention has been specifically described for easy understanding. However, the speech recognition processing device may be an information processing device as shown in FIG. Good.

FIG. 13 is a block diagram showing another configuration example of the speech recognition processing apparatus of the present embodiment. As illustrated in FIG. 13, the speech recognition processing apparatus includes a storage unit 33, a communication unit 34, and a control unit 30. Each of the communication unit 34 and the storage unit 33 illustrated in FIG. 13 corresponds to the recognition request transmission / reception unit 14 and the permutation number storage unit 13 illustrated in FIG. 1.

The same effect as that of the above-described embodiment can be obtained with the apparatus shown in FIG.

Note that a program for causing a computer to execute the speech recognition processing method described in this embodiment may be stored in a computer-readable recording medium. In this case, by installing the program from the recording medium into another information processing apparatus, it is possible to cause the other information processing apparatus to execute the above information processing method.

An example of the effect of the present invention will be described. According to the present invention, a user can obtain a speech recognition result of a long conversation sentence without storing a large amount of data necessary for speech recognition processing in his / her terminal device.

The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

The present invention can be applied to the use of supporting the communication by displaying the contents spoken by the speaker in a characterized manner in a scene where a person with hearing impairments in general life recognizes the surrounding conversation. Moreover, by replacing the speech recognition process with a translation process, the present invention can be applied to a purpose of supporting communication with a foreigner.

Note that this application incorporates all the contents of Japanese Patent Application No. 2015-023836 filed on February 10, 2015, and claims priority based on this Japanese application.

DESCRIPTION OF SYMBOLS 1 Voice recognition processing apparatus 3 Voice recognition server 6 Network 11 Voice collection means 12 Voice division means 13 Permutation number storage means 14 Recognition request transmission / reception means 15 Recognition result aggregation means 16 Recognition result display means 21 Microphone 22 Display part

Claims

A voice sampling means for acquiring input voice as voice data;
Voice dividing means for dividing the voice data into a plurality of voice data pieces, and assigning a permutation number to each of the plurality of voice data pieces according to the order input to the voice sampling means;
Storage means for storing the permutation number;
As a result of distributing the voice data pieces to the plurality of communication ports set in advance while associating the permutation numbers with each other and transmitting them to the voice recognition server via the network, the voice data pieces are recognized by the voice recognition server. When a speech recognition result is received from the speech recognition server via the communication port, a permutation number associated with the communication port is assigned to the received speech recognition result, and a permutation number that matches the assigned permutation number is stored. A recognition request transmission / reception means for storing the speech recognition result in an area of the storage means;
Recognition result aggregating means for generating a recognition result sentence in which the speech recognition results stored in the storage means together with the permutation numbers are arranged according to the permutation numbers;
Display means for displaying the generated recognition result sentence;
A speech recognition processing apparatus.
The speech recognition processing device according to claim 1,
The recognition request transmission / reception means includes:
A speech recognition processing device that distributes the speech data pieces to be subjected to the next recognition processing to communication ports that are not waiting to receive a recognition result from the speech recognition server among the plurality of communication ports.
The speech recognition processing device according to claim 1 or 2,
The voice dividing means is
When dividing the voice data acquired by the voice sampling means, a part where no voice information of a person exists and a breathing part are detected in the voice data, and voice data in a region sandwiched between the detected parts is used as the voice data piece. A speech recognition processing device for extraction.
A speech recognition processing method by an information processing device,
The input voice is acquired as voice data,
Dividing the audio data into a plurality of audio data pieces, and assigning a permutation number to each of the plurality of audio data pieces according to the order in which the audio data was acquired;
Storing the permutation number in a storage means;
Distributing the voice data pieces while associating the permutation numbers with a plurality of communication ports set in advance, and transmitting them to the voice recognition server via the network,
When a speech recognition result, which is a result of recognition processing of the speech data piece by the speech recognition server, is received from the speech recognition server via the communication port, a permutation number associated with the communication port to the received speech recognition result Assign
Storing the speech recognition result in an area of the storage means in which a permutation number matching the assigned permutation number is stored;
Generating a recognition result sentence in which the speech recognition results stored in the storage means together with the permutation numbers are arranged according to the permutation numbers;
A speech recognition processing method for displaying the generated recognition result sentence.
The speech recognition processing method according to claim 4,
The speech recognition processing method of distributing the said audio | voice data piece of the next recognition process object to the communication port which is not waiting for the recognition result reception from the said speech recognition server among these communication ports.
The speech recognition processing method according to claim 4 or 5,
When dividing the acquired voice data, the voice data detects a part where no human voice information exists and a breathing part, and extracts voice data of a region sandwiched between the detected parts as the voice data piece Recognition processing method.
On the computer,
The procedure to acquire the input audio as audio data,
Dividing the audio data into a plurality of audio data pieces, and assigning a permutation number to each of the plurality of audio data pieces according to the order in which the audio data was acquired;
Storing the permutation number in a storage means;
A procedure of distributing the voice data pieces while associating the permutation numbers to a plurality of communication ports set in advance and transmitting them to a voice recognition server via a network;
When a speech recognition result, which is a result of recognition processing of the speech data piece by the speech recognition server, is received from the speech recognition server via the communication port, a permutation number associated with the communication port to the received speech recognition result The steps to assign
Storing the speech recognition result in an area of the storage means in which a permutation number that matches the assigned permutation number is stored;
Generating a recognition result sentence in which the speech recognition results stored in the storage means together with the permutation numbers are arranged according to the permutation numbers;
A computer-readable recording medium recording a program for executing a procedure for displaying the generated recognition result sentence.
The recording medium according to claim 7,
A computer-readable record in which a program having a procedure for allocating the voice data piece to be subjected to the next recognition processing to a communication port not waiting for reception of a recognition result from the voice recognition server among the plurality of communication ports is recorded. Medium.
The recording medium according to claim 7 or 8,
In the procedure of dividing the acquired audio data, a process in which a part where no human voice information exists and a breathing part are detected in the voice data, and voice data in a region sandwiched between the detected parts is extracted as the voice data piece A computer-readable recording medium having a program recorded thereon.