JP2023148706A - Speech recognition result display system, speech recognition result display device, and speech recognition result display method and non-transitory storage medium storing program - Google Patents

Abstract

To provide a speech recognition result display system, a speech recognition result display device, a speech recognition result display method and a non-transitory storage medium storing program that can suppress text information from becoming hard to read when one utterance section becomes long.SOLUTION: A speech recognition result display system comprises: an acquisition part; a speech recognition part which performs speech recognition on an utterance speech acquired by the acquisition part and outputs text information; an image generation part which generates image data based upon the text information; and a display part. The image generation part is configured to: when the number of characters of the text information included in a one-utterance section is less than a predetermined value, generate image data for displaying the text information included in the one-utterance section of a user in one group; and otherwise when the number of characters is equal to or larger than the predetermined value, generate the image data for displaying the text information included in the one-utterance section in a plurality of groups, wherein the numbers of characters of the text information included in the plurality of groups are less than the predetermined value.SELECTED DRAWING: Figure 2

Description

The present invention relates to a speech recognition result display system, a speech recognition result display device, a speech recognition result display method, and a program.

2. Description of the Related Art Conventionally, there has been known a device that converts the content (uttered audio) uttered by each participant into text and displays it when a plurality of participants hold a conference (for example, see Patent Document 1). Such devices are sometimes used to assist hearing-impaired people in attending conferences.

JP2019-179480A

For example, in the device described in Patent Document 1, if the utterances of conference participants continue for a long time without interruption, the display of text may also continue for a long time without interruption. In this case, it may be difficult for other participants to read the text. Such problems become particularly noticeable when hearing-impaired people participate in a meeting. This is because hearing-impaired people understand the content of the meeting by reading the text.

The present invention has been made in view of the above problems, and includes a speech recognition result display system, a speech recognition result display device, and a speech recognition result display system capable of suppressing text information from becoming difficult to read when one utterance section becomes long. The purpose is to provide a recognition result display method and program.

(1) In order to achieve the above object, the speech recognition result display system (1) according to one aspect of the present invention includes an acquisition unit (222) that acquires the user's uttered voice, and a A voice recognition unit (speech recognition unit 223, text conversion unit 224, dependency analysis unit 225) that performs voice recognition on spoken voice and outputs text information, and an image generation unit that generates image data based on the text information. (minutes creation unit 226, image generation unit 241), and a display unit (display unit 203, display unit 303) that displays the image data, and the image generation unit includes a If the number of characters of the text information included in the one utterance section is less than a predetermined value, the image data that displays the text information included in the one utterance section as one group is generated, and the text information included in the one utterance section is generated. If the number of characters is greater than or equal to the predetermined value, image data generation processing is performed to generate the image data that displays the text information included in the one utterance section divided into a plurality of groups, and The number of characters of the text information included in each text information is less than the predetermined value.

(2) Furthermore, in the speech recognition result display system according to one aspect of the present invention, the image generation unit may be controlled so that the one utterance section is not divided into the plurality of groups in the middle of a clause.

(3) Furthermore, in the speech recognition result display system according to one aspect of the present invention, the image generation unit may provide a text frame to each of the plurality of groups when generating the image data.

(4) Furthermore, in the speech recognition result display system according to one aspect of the present invention, when the text information included in the one utterance section spans the plurality of text frames, the image generation unit A serial number display may be given.

(5) Further, in the speech recognition result display system according to one aspect of the present invention, when the text information included in the one utterance section spans the plurality of text frames, the image generation unit The colors may be unified.

(6) Furthermore, in the speech recognition result display system according to one aspect of the present invention, the image generation unit may generate the image data that distinguishes each of the plurality of groups by performing a line break.

(7) Furthermore, in the speech recognition result display system according to one aspect of the present invention, the image generation section may perform the image data generation process every time the text information is output from the speech recognition section. .

(8) In order to achieve the above object, the speech recognition result display device according to one aspect of the present invention includes an acquisition unit that acquires the user's utterance, and a voice recognition result for the utterance acquired by the acquisition unit. A voice recognition unit that performs recognition and outputs text information, an image generation unit that generates image data based on the text information, and a display unit that displays the image data. If the number of characters of the text information included in one utterance section is less than a predetermined value, the image data that displays the text information included in the one utterance section as one group is generated, and the number of characters of the text information included in one utterance section is generated. If the number of characters of the text information included in the one-utterance section is equal to or greater than the predetermined value, image data generation processing is performed to generate the image data that displays the text information included in the one utterance section divided into a plurality of groups. , the number of characters of the text information included in each of the plurality of groups is less than the predetermined value.

(9) In order to achieve the above object, a voice recognition result display method according to one aspect of the present invention is a voice recognition result display method in a voice recognition result display system, wherein the acquisition unit acquires the user's uttered voice. an acquisition step, a voice recognition step in which a voice recognition unit performs voice recognition on the uttered voice acquired by the acquisition unit and outputs text information, and an image generation unit generates an image based on the text information. an image generation step for generating data; and a display step for a display section to display the image data; If the number of characters is less than the predetermined value, the image data that displays the text information included in the one utterance section as one group is generated, and the number of characters of the text information included in the one utterance section is less than the predetermined value. If the value is greater than or equal to the value, image data generation processing is performed to generate the image data that displays the text information included in the one utterance section divided into a plurality of groups, and the image data included in each of the plurality of groups is The number of characters of the text information is less than the predetermined value.

(10) In order to achieve the above object, a program according to an aspect of the present invention includes an acquisition step of acquiring a user's uttered voice in a voice recognition result display system, performs voice recognition on the uttered voice, and performs text A voice recognition step of outputting information, an image generation step of generating image data based on the text information, and a display step of displaying the image data are executed, and in the image generation step, one utterance of the user is executed. If the number of characters of the text information included in the section is less than a predetermined value, generating the image data that displays the text information included in the one utterance section as one group; If the number of characters of the text information is equal to or greater than the predetermined value, image data generation processing is performed to generate the image data that displays the text information included in the one utterance section divided into a plurality of groups; The number of characters of the text information included in each of the plurality of groups is less than the predetermined value.

According to (1), (8), (9), or (10) described above, it is possible to suppress text information from becoming difficult to read when one utterance section becomes long.

According to (2) above, it is possible to make text information divided into a plurality of groups easier to read.
According to (3) above, it becomes easier to visually recognize each group, and the text information can be made easier to read.
According to (4) or (5) described above, it becomes easier to visually recognize a group corresponding to one utterance section, and it is possible to make text information more effective and easier to read.
According to the above-mentioned (6), it becomes easier to visually recognize each group, and the text information can be made easier to read.
According to (7) above, the content uttered by each participant can be more quickly reflected in the display on the display unit.

1 is a block diagram showing a configuration example of a speech recognition result display device (speech recognition result display system) according to the present embodiment. FIG. FIG. 3 is a diagram showing an example of an image displayed on the display unit of the parent device according to the present embodiment. FIG. 7 is a diagram illustrating another example of an image displayed on the display unit of the parent device according to the present embodiment. FIG. 3 is a diagram illustrating an example of an image displayed on a display unit of a slave device according to the present embodiment. 2 is a flowchart illustrating an example of a processing procedure performed by the speech recognition result display device (speech recognition result display system) according to the present embodiment.

First, an example of a situation in which the speech recognition result display device (speech recognition result display system) of this embodiment is used will be described.
The speech recognition result display device (speech recognition result display system) of this embodiment is used in a conference attended by two or more people. Among the participants, a person with a speech disability may be participating in the conference. Participants who can speak should each wear a microphone or use a terminal (smartphone, tablet terminal, personal computer, etc.) equipped with a microphone. Hearing-impaired participants will use a terminal that can input text. The voice recognition result display device recognizes the voice uttered by the participants, converts it into text, and displays the text on each participant's terminal. Furthermore, the speech recognition result display device displays text information input by the hearing-impaired person on their terminal.

FIG. 1 is a block diagram showing a configuration example of a speech recognition result display device (speech recognition result display system) 1 according to the present embodiment.
As shown in FIG. 1, a speech recognition result display device (speech recognition result display system) 1 includes a base unit 2, a slave unit 3a, a slave unit 3b, . . . . Note that if one of the handset 3a, handset 3b, . . . is not specified, it will simply be referred to as the handset 3.
The base unit 2 and the slave unit 3 are connected via a wired or wireless network 4.

The base device 2 includes a sound collection section 201, an operation section 202, a display section 203, a communication section 204, an authentication section 211, an acoustic model/dictionary storage section 221, an acquisition section 222, a speech recognition section 223, a text conversion section 224, and a modification section. It includes an analysis section 225, a minutes creation section 226, a minutes storage section 227, a text acquisition section 231, and an image generation section 241.

The handset 3 includes a sound collection section 301, an operation section 302, a display section 303, a communication section 304, and a processing section 305. The sound collection section 301, the operation section 302, the display section 303, the communication section 304, and the processing section 305 are connected via a bus 306.

<Slave unit 3>
First, the handset 3 will be explained.
The handset 3 is, for example, a smartphone, a tablet terminal, a personal computer, or the like. Note that the handset 3 may include an audio output unit, a motion sensor, a GPS (Global Positioning System), and the like.

The sound collection unit 301 is a microphone. The sound collection unit 301 collects the user's utterance, converts the collected utterance from an analog signal to a digital signal, and outputs the converted utterance to the processing unit 305 .

The operation unit 302 detects user operations and outputs the detected results to the processing unit 305. The operation unit 302 is, for example, a touch panel sensor provided on the display unit 303, a keyboard with priority connection or wireless connection, or the like.

The processing unit 305 generates setting information based on the operation result of the operation unit 302 and outputs the generated setting information to the communication unit 304. Here, the setting information includes participant identification information. The setting information may include information indicating whether the sound collection section is used or not, and information indicating whether or not the operation section is used. The processing unit 305 generates a login instruction based on the operation result of the operation unit 302 and outputs the generated login instruction to the communication unit 304. Here, the login instruction includes identification information of the participant and identification information of the handset 3. The processing unit 305 adds identification information to text information based on the operation result of the operation unit 302 and outputs the text information to the communication unit 304 . The processing unit 305 adds identification information to the speech output from the sound collection unit 301 and outputs it to the communication unit 304 . The processing unit 305 acquires the image data output by the communication unit 304 and outputs the acquired image data to the display unit 303. The processing unit 305 establishes communication with the base device 2 based on the information output by the communication unit 304 that permits login. When the processing unit 305 receives a speech restriction instruction (input restriction instruction) from the base device 2, the processing unit 305 may restrict text input. Further, when the processing unit 305 receives a speech restriction instruction from the base device 2, the processing unit 305 may also restrict voice input.

The display unit 303 displays the image data output by the processing unit 305. The display unit 303 is, for example, a liquid crystal display device, an organic EL (electroluminescence) display device, an electronic ink display device, or the like. Note that the image displayed on the display unit 303 will be described later.

The communication unit 304 transmits the setting information output by the processing unit 305 to the base device 2 via the network 4. The communication unit 304 transmits the login instruction output by the processing unit 305 to the base device 2 via the network 4. The communication unit 304 transmits the text information or the uttered voice output by the processing unit 305 to the base unit 2 via the network 4 . Note that the text information or the uttered voice to be transmitted includes the user's identification information and the identification information of the handset 3. The communication unit 304 receives the image data transmitted by the base device 2 and outputs the received image data to the processing unit 305. When the communication unit 304 receives the information that permits login transmitted from the base device 2, the communication unit 304 outputs the received information that permits login to the processing unit 305.

<Main unit 2>
Next, the base unit 2 will be explained.
The parent device 2 is, for example, a notebook computer.

The sound collection unit 201 is a microphone. The sound collection unit 201 collects the user's utterance, converts the collected utterance from an analog signal to a digital signal, and outputs the converted utterance to the acquisition unit 222 .

The operation unit 202 detects a user's operation and outputs the detected result to the text acquisition unit 231. The operation unit 202 is, for example, a touch panel sensor provided on the display unit 203 or a keyboard. The operation unit 202 outputs the result of detecting the operation to the authentication unit 211 during the login process.

The display unit 203 is, for example, a liquid crystal display device, an organic EL display device, an electronic ink display device, or the like. The display unit 203 displays image data output by the image generation unit 241. Note that the image displayed on the display unit 203 will be described later.

The communication unit 204 receives the utterances transmitted by the handset 3 and outputs the received utterances to the acquisition unit 222 . The communication unit 204 receives the text information transmitted by the handset 3 and outputs the received text information to the text acquisition unit 231. The communication unit 204 receives the login instruction sent by the handset 3 and outputs the received login instruction to the authentication unit 211. The communication unit 204 transmits the image data output by the image generation unit 241 to the slave device 3 via the network 4. The communication unit 204 transmits the information output by the authentication unit 211 to permit login to the slave device 3 via the network 4 .

The authentication unit 211 determines whether to permit login based on the identification information of the participant and the identification information of the handset 3 included in the login instruction output by the communication unit 204. When permitting login, the authentication section 211 outputs information permitting login to the communication section 204. The authentication unit 211 determines whether or not to permit the user of the base device 2 to log in, based on the result of the operation on the operation unit 202. When permitting login, the authentication section 211 outputs information permitting login to each functional section, and permits the operation of each functional section. Note that each functional unit includes a communication unit 204, an authentication unit 211, an acoustic model/dictionary storage unit 221, an acquisition unit 222, a speech recognition unit 223, a text conversion unit 224, a dependency analysis unit 225, a minutes creation unit 226, These are a minutes storage section 227, a text acquisition section 231, and an image generation section 241.

The acoustic model/dictionary storage unit 221 stores, for example, acoustic models, language models, word dictionaries, and the like. The acoustic model is a model based on sound feature amounts, and the language model is a model of information about words and how they are arranged. Further, the word dictionary is a dictionary with a large number of vocabulary words, for example, a large vocabulary word dictionary. Note that the base unit 2 may store and update words and the like that are not stored in the acoustic model/dictionary storage unit 221. Note that the acoustic model/dictionary storage unit 221 may include a DB (database) for each conference, for example. For example, the first DB may be used for general conferences, the second DB may be used for presentations, and the third DB may be used for international conferences. By using a DB tailored to the conference in this way, it becomes easier to appropriately convert homonyms and the like.

The acquisition unit 222 acquires the utterances output by the sound collection unit 201 or the utterances output by the communication unit 204, and outputs the acquired utterances to the voice recognition unit 223.

The speech recognition section 223 obtains the uttered speech output by the obtaining section 222 . The speech recognition unit 223 detects the speech signal of the speech section from the speech. The speech section is detected by detecting, for example, an audio signal equal to or higher than a predetermined threshold value as the speech section. Note that the speech recognition unit 223 may detect the utterance section using other well-known techniques. The speech recognition unit 223 refers to the acoustic model/dictionary storage unit 221 and performs speech recognition on the speech signal of the detected speech section using a well-known method. Note that the speech recognition unit 223 performs speech recognition using, for example, the method disclosed in Japanese Patent Application Publication No. 2015-64554. The speech recognition section 223 outputs the recognized recognition result and speech signal to the text conversion section 224. Note that the speech recognition unit 223 outputs the recognition result and the speech signal in association with each other, for example, for each sentence, for each utterance section, or for each utterance.
Note that when the uttered voices are input simultaneously, the voice recognition unit 223 performs voice recognition for each sound collection unit (201 or 301), for example, by time-sharing processing. Furthermore, when the microphone is a microphone array, the speech recognition unit 223 also performs well-known speech recognition processing such as sound source separation processing, sound source localization processing, and sound source identification processing.

The text conversion unit 224 converts the recognition result output by the speech recognition unit 223 into text by referring to the acoustic model/dictionary storage unit 221. Note that the text information includes information of at least one character. The text conversion unit 224 outputs the converted text information and the acquired audio signal to the dependency analysis unit 225. Note that the text conversion unit 224 may delete interjections such as "ah", "um", "um", and "well" from the result of recognizing the utterance information and convert it into text.

The dependency analysis unit 225 performs morphological analysis and dependency analysis on the text information output by the text conversion unit 224 or the text information output by the communication unit 204 with reference to the acoustic model/dictionary storage unit 221. Note that SVM (Support Vector Machines) is used in the dependency analysis, for example, in the shift-reduce method, the spanning tree method, and the stepwise application method of chunk identification.
The dependency analysis unit 225 outputs text information that has been subjected to morphological analysis and dependency analysis, and the results of the analysis to the minutes creation unit 226. Note that when the dependency analysis unit 225 acquires the audio signal output by the text conversion unit 224, it also outputs the acquired audio signal to the minutes creation unit 226.

The minutes creation unit 226 creates minutes for each speaker based on the text information output by the dependency analysis unit 225 or the text acquisition unit 231. The minutes creation unit 226 causes the minutes storage unit 227 to store the audio signal corresponding to the created minutes. Further, the minutes creation unit 226 outputs the created minutes to the image generation unit 241. Note that the minutes creation unit 226 may create the minutes by deleting interjections such as "ah," "um," "um," and "well."

The minutes storage unit 227 stores minutes and audio signals in association with each other.

The text acquisition unit 231 acquires the operation result output by the operation unit 202 or the operation result of the operation unit 302 output by the communication unit 204, and generates text information based on the acquired result. The text acquisition unit 231 outputs the generated text information to the minutes creation unit 226.

The image generation unit 241 acquires the minutes information output by the minutes creation unit 226. The image generation unit 241 generates image data based on the minutes information.
The image generation unit 241 generates image data corresponding to the number of characters of the text information included in one utterance section of the user, regarding text information (minutes information) based on the user's utterance voice. That is, when the number of characters included in one utterance section is less than a predetermined value, the image generation unit 241 generates image data that displays the text information included in one utterance section as one group. On the other hand, if the number of characters in the text information included in one utterance section is greater than or equal to the predetermined value, the image generation unit 241 generates image data that displays the text information included in one utterance section divided into a plurality of groups. . In this case, the image generation unit 241 generates image data such that the number of characters of text information included in each of the plurality of groups is less than a predetermined value. Note that "one utterance period" means a period (time) in which a certain user continues to speak without interruption for a predetermined period of time or longer. The "predetermined value" may be, for example, about 500 characters.
The image generation unit 241 outputs the image data generated based on the above to the display unit 203 and the communication unit 204.

<Display image of base unit 2>
Next, an example of an image displayed on the display unit 203 of the base device 2 will be explained.
FIG. 2 is a diagram showing an example of an image displayed on the display unit 203 of the base device 2 according to the present embodiment.
Image g10 is an image displayed on display unit 203 of base device 2.

Area g100 is an area where participant information is edited.
Area g101 is an area for participant information. The code g102 is the name of the participant. Reference numeral g103 is an icon indicating that the participant inputs text using the operation unit 202 of the base unit 2 or the operation unit 302 of the slave unit 3. Reference numeral g104 is an icon indicating that the participant speaks using the sound collection unit 201 of the base unit 2 or the sound collection unit 301 of the slave unit 3. The code g105 is the number (or identification information) of the microphone used by the participant.

Area g200 is an area for displaying minutes. Note that FIG. 2 shows the state after login. Symbol g201 is a login/logout button image. Reference numeral g202 is a start/end button image of the speech recognition result display device (speech recognition result display system) 1. Reference numeral g203 is a display that lights up while the speech recognition result display device (speech recognition result display system) 1 is in use. Reference numeral g204 is a button image for displaying the minutes stored in the minutes storage unit 227 and reproducing the audio signal. Reference numeral g205 is a button image through which the user of the base unit 2 selects whether or not to use the sound collection section 201.

The code g211 is text information input by the first participant by operating the operation unit (202 or 302). As shown in the example of FIG. 2, in the image g10 displayed by the display unit 203, text information is provided with a rectangular text frame surrounding the text information. A text frame is similarly provided for the text information described below. The symbol g212 is a pictogram input by the first participant by operating the operation unit (202 or 302). The code g213 is information indicating the date and time when the first participant inputted the text information and pictograms. Code g214 is the name of the first participant.

The code g221 is text information input by the second participant by operating the operation unit (202 or 302). Code g222 and code g223 are text information obtained by voice recognition of the content uttered by the second participant. The symbol g224 is an icon indicating that text has been input by operating the operation unit (202 or 302). The symbol g225 is an icon indicating that speech has been input by the sound collection unit (201 or 301). The code g231 is text information obtained by voice recognition of the content uttered by the third participant.

Here, the text information related to code g222, "Today's topic is about the upcoming exhibition." is included in one utterance section by the user (Fujisawa), and the number of characters is less than the predetermined value. are displayed as one group (text frame). On the other hand, although the text information related to code g223, "Please tell me about... in the last meeting," is included in one utterance section by the user (Fujisawa), the number of characters is greater than the predetermined value. It is displayed divided into a plurality of groups (text frames) indicated by symbols g223a to g223d. Further, the number of characters included in each text frame indicated by symbols g223a to g223d is less than a predetermined value.

As shown in the example of FIG. 2, the display unit 203 may display image data in which each text frame indicated by symbols g223a to g223d is given a serial number display indicated by symbols g241 to g244. Further, the display unit 203 may display image data in which each text frame indicated by symbols g223a to g223d has a uniform color.

Note that in order for the display unit 203 to display the above, the image generation unit 241 generates image data in which each group is given a text frame. The image generation unit 241 may generate image data in which sequential numbers are assigned to each text frame or the colors of each text frame are unified.

Furthermore, the image generation unit 241 may control the generation of image data so that the text information corresponding to one utterance section is not divided into a plurality of groups (text frames) in the middle of a phrase. Alternatively, when dividing text information corresponding to one utterance section into a plurality of groups (text frames), the image generation unit 241 generates image data so as to divide the text information at the position where a period or comma is present. May be controlled.

Note that the image shown in FIG. 2 is an example, and the image displayed on the display unit 203 is not limited to this. For example, the display unit 203 may display image data such as image g10a shown in FIG. 3, which distinguishes each of a plurality of groups (signs g223A to g223D) by performing a line break. In this case, the image generation unit 241 generates image data that distinguishes each of the plurality of groups (symbols g223A to g223D) by performing line breaks.

Furthermore, the shape of the text frame is not limited to a rectangle, and may be, for example, a polygon, circle, oval, or other shape. Alternatively, each group may not be provided with a text frame.

<Display screen of handset 3>
Next, an example of an image displayed on the display unit 303 of the handset 3 will be described.
FIG. 4 is a diagram showing an example of an image displayed on the display unit 303 of the handset 3 according to the present embodiment.
Image g30 is an image displayed on display unit 303 of handset 3.

Area g300 is an area for displaying minutes. The code g311 is text information input by the first participant by operating the operation unit (202 or 302). The code g321 is text information input by the second participant by operating the operation unit (202 or 302). Code g322 and code g323 are text information obtained by voice recognition of the content uttered by the second participant. The code g331 is text information obtained by voice recognition of the content uttered by the third participant. Area g301 is an area for a text input section. Note that the operation unit 302 may be a software keyboard displayed on the display unit 303, or may be connected to the handset 3 by wire or wirelessly.

Here, the text information related to code g322 "Today's topic is about the upcoming exhibition" is included in one utterance section by the user (Fujisawa) and the number of characters is less than the predetermined value. are displayed as one group (text frame). On the other hand, although the text information related to code g323, "Please tell me about... in the last meeting," is included in one utterance section by the user (Fujisawa), the number of characters is greater than the predetermined value. It is displayed divided into a plurality of groups (text frames) indicated by symbols g323a to g323c. Further, the number of characters included in each text frame indicated by symbols g323a to g323c is less than a predetermined value.

As shown in the example of FIG. 4, the display unit 303 may display image data in which each text frame indicated by symbols g323a to g323c is given a serial number display indicated by symbols g341 to g343. Further, the display unit 303 may display image data in which each text frame indicated by symbols g323a to g323c has a uniform color.

Note that in order for the display unit 303 to display the above, the image generation unit 241 generates image data in which each group is given a text frame. The image generation unit 241 may generate image data in which sequential numbers are assigned to each text frame or the colors of each text frame are unified.

Furthermore, the image generation unit 241 may control the generation of image data so that the text information corresponding to one utterance section is not divided into a plurality of groups (text frames) in the middle of a clause. Alternatively, when dividing text information corresponding to one utterance section into a plurality of groups (text frames), the image generation unit 241 generates image data so as to divide the text information at the position where a period or comma is present. May be controlled.

As shown in FIGS. 2 and 4, the image displayed on the display unit 203 of the base unit 2 and the image displayed on the display unit 303 of the slave unit 3 display multiple pieces of text information corresponding to one utterance section. The positions at which the text is divided into groups (text frames) may be different. For example, the "predetermined value" (described earlier), which is the standard for determining whether the image generation unit 241 divides text information corresponding to one utterance section into multiple groups, is different between the base unit 2 and the slave unit 3. Good too. Similarly, the position at which the text information is divided into a plurality of groups and the above-mentioned "predetermined value" may be different for each handset 3a, handset 3b, and so on.

Note that the image shown in FIG. 4 is an example, and the image displayed on the display unit 303 is not limited to this. For example, the display unit 303 may display image data that distinguishes each of a plurality of groups by performing a line break. In this case, the image generation unit 241 generates image data that distinguishes each of the plurality of groups by performing line breaks.

Furthermore, the shape of the text frame is not limited to a rectangle, and may be, for example, a polygon, circle, oval, or other shape. Alternatively, each group may not be provided with a text frame.

<Processing performed by speech recognition result display device (speech recognition result display system) 1>
Next, an example of a processing procedure performed by the speech recognition result display device (speech recognition result display system) 1 will be described. FIG. 5 is a flowchart showing an example of a processing procedure performed by the speech recognition result display device (speech recognition result display system) 1 according to the present embodiment. In the following, a case will be described in which the user inputs text information using the sound pickup section (201 or 301).

(Step S1) The authentication unit 211 performs a login process based on the operation content of the operation unit (202 or 302). For example, when each user operates the operation unit (202 or 302) and inputs identification information (user ID) that identifies the user and a password, the authentication unit 211 inputs the input identification information and password. Login processing is performed based on

(Step S2) The acquisition unit 222 acquires the user's utterance that is output by the sound collection unit 201 or the communication unit 204, and outputs the acquired utterance to the voice recognition unit 223.

(Step S3) The speech recognition unit 223 acquires the uttered voice outputted by the acquisition unit 222, and performs voice recognition processing on the acquired uttered voice.

(Step S4) The text conversion unit 224 performs text conversion processing on the voice recognition result.

(Step S5) The dependency analysis unit 225 performs dependency analysis and morphological analysis processing for each speaker on the converted text information.

(Step S6) The dependency analysis unit 225 outputs the text information subjected to the modification analysis and morphological analysis processing to the minutes creation unit 226.

(Step S7) The minutes creation unit 226 creates minutes based on the text information output by the dependency analysis unit 225, and outputs the minutes to the image generation unit 241.

(Step S8) The image generation unit 241 determines whether the number of characters of text information included in one utterance section is greater than or equal to a predetermined value. If the image generation unit 241 determines that the number of characters of the text information included in one utterance section is equal to or greater than the predetermined value (step S8; YES), the process of step S9 is performed, and the text information included in one utterance section is If it is determined that the number of characters in the information is less than the predetermined value (step S8; NO), the process of step S10 is performed. Note that the above judgment may be made by the minutes creation unit 226.

(Step S9) The image generation unit 241 generates image data that displays text information included in one utterance section divided into a plurality of groups, and outputs it to the display unit 203 or the communication unit 204. In step S9, the image generation unit 241 generates image data such that the number of characters of text information included in each of the plurality of groups is less than a predetermined value.

(Step S10) The image generation unit 241 generates image data that displays text information included in one utterance section as one group, and outputs it to the display unit 203 or the communication unit 204.

(Step S11) The display unit (203 or 303) displays the image output by the image generation unit 241.

The speech recognition result display device (speech recognition result display system) 1 repeats the processing of steps S2 to S11. Note that the processing in steps S7 to S9 (image data generation processing) may be performed every time the dependency analysis unit 225 outputs text information. In other words, the processes of steps S2 to S11 may be repeated in real time during one speech section. That is, image generation by the image generation unit 241 may be repeated in real time, and the image displayed by the display unit (203 or 303) may continue to be updated in real time.
Note that the process in FIG. 5 is an example, and the process is not limited to this.

As described above, in this embodiment, when one utterance section becomes long, the text information included in the one utterance section is divided into a plurality of groups and displayed.
As a result, according to the present embodiment, it is possible to suppress text information from becoming difficult to read when one utterance section becomes long.

In the above example, the speech recognition result display device (speech recognition result display system) 1 can input text using the operation unit (202 or 302) and text input using speech recognition using the sound collection unit (201 or 301). However, this is not limited to. For example, the speech recognition result display device (speech recognition result display system) 1 may only allow text input using speech recognition by the sound collection unit (201 or 301).

Further, in the example described above, the voice recognition result display device 1 includes the base unit 2 and a plurality of slave units 3, but the present invention is not limited to this. For example, the voice recognition result display device 1 may include only one handset 3, or the voice recognition result display device 1 may not include any handset 3.

Additionally, an authentication section 211, an acoustic model/dictionary storage section 221, an acquisition section 222, a speech recognition section 223, a text conversion section 224, a dependency analysis section 225, a minutes creation section 226, a minutes storage section 227, a text acquisition section 231 , and the image generation unit 241 may be included in the slave device 3. Similarly, the processing unit 305 may be included in the base device 2.

Further, each functional section of the voice recognition result display device 1 may be provided in a device other than the base device 2 and the slave device 3. Alternatively, each functional unit of the voice recognition result display system 1 may not be provided in the base unit 2 or slave unit 3 or other physical device, but may be provided on one or more servers or the cloud. . Note that each functional unit includes a communication unit 204, an authentication unit 211, an acoustic model/dictionary storage unit 221, an acquisition unit 222, a speech recognition unit 223, a text conversion unit 224, a dependency analysis unit 225, a minutes creation unit 226, These are a minutes storage section 227, a text acquisition section 231, an image generation section 241, a communication section 304, and a processing section 305.

Note that a program for realizing all or part of the functions of the speech recognition result display device (speech recognition result display system) 1 of the present invention is recorded on a computer-readable recording medium, and the program is recorded on this recording medium. All or part of the processing performed by the speech recognition result display device (speech recognition result display system) 1 may be performed by loading the program into the computer system and executing it. Note that the "computer system" herein includes hardware such as an OS and peripheral devices. Furthermore, the term "computer system" includes a WWW system equipped with a home page providing environment (or display environment). Furthermore, the term "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into computer systems. Furthermore, "computer-readable recording medium" refers to volatile memory (RAM) inside a computer system that serves as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. This also includes programs that are retained for a certain period of time.

Further, the program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in a transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Moreover, the above-mentioned program may be for realizing a part of the above-mentioned functions. Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

Although the mode for implementing the present invention has been described above using embodiments, the present invention is not limited to these embodiments in any way, and various modifications and substitutions can be made without departing from the gist of the present invention. can be added.

1... Speech recognition result display device (speech recognition result display system) 203... Display section 222... Acquisition section 223... Speech recognition section 224... Text conversion section 225... Dependency analysis section 226... Minutes creation section 241... Image generation section 303 …Display section

Claims (10)

an acquisition unit that acquires the user's uttered audio;
a voice recognition unit that performs voice recognition on the uttered voice acquired by the acquisition unit and outputs text information;
an image generation unit that generates image data based on the text information;
a display unit that displays the image data;
When the number of characters of the text information included in one utterance section of the user is less than a predetermined value, the image generation section generates the image data that displays the text information included in the one utterance section as one group. and when the number of characters of the text information included in the one utterance section is equal to or greater than the predetermined value, the image data is generated for displaying the text information included in the one utterance section divided into a plurality of groups. Perform image data generation processing to
the number of characters of the text information included in each of the plurality of groups is less than the predetermined value;
Speech recognition result display system. The image generation unit controls the one utterance section so that it is not divided into the plurality of groups in the middle of a clause.
The speech recognition result display system according to claim 1. The image generation unit adds a text frame to each of the plurality of groups when generating the image data.
The speech recognition result display system according to claim 1 or 2. When the text information included in the one utterance section spans a plurality of the text frames, the image generation unit assigns a sequential number display to the plurality of text frames.
The speech recognition result display system according to claim 3. The image generation unit unifies the color of the plurality of text frames when the text information included in the one utterance section spans the plurality of text frames.
The speech recognition result display system according to claim 3 or 4. The image generation unit generates the image data that distinguishes each of the plurality of groups by performing a line break.
The speech recognition result display system according to claim 1 or 2. The image generation unit performs the image data generation process every time the text information is output from the voice recognition unit.
The speech recognition result display system according to any one of claims 1 to 6. an acquisition unit that acquires the user's uttered audio;
a voice recognition unit that performs voice recognition on the uttered voice acquired by the acquisition unit and outputs text information;
an image generation unit that generates image data based on the text information;
a display unit that displays the image data;
When the number of characters of the text information included in one utterance section of the user is less than a predetermined value, the image generation section generates the image data that displays the text information included in the one utterance section as one group. and when the number of characters of the text information included in the one utterance section is equal to or greater than the predetermined value, the image data is generated for displaying the text information included in the one utterance section divided into a plurality of groups. Perform image data generation processing to
the number of characters of the text information included in each of the plurality of groups is less than the predetermined value;
Speech recognition result display device. A voice recognition result display method in a voice recognition result display system, the method comprising:
an acquisition step in which the acquisition unit acquires the user's uttered audio;
a voice recognition step in which a voice recognition unit performs voice recognition on the uttered voice acquired by the acquisition unit and outputs text information;
an image generation step in which the image generation unit generates image data based on the text information;
a display step for displaying the image data;
In the image generation step, if the number of characters of the text information included in one utterance section of the user is less than a predetermined value, the image generation section converts the text information included in the one utterance section into one group. generating the image data to be displayed, and if the number of characters of the text information included in the one utterance section is equal to or greater than the predetermined value, displaying the text information included in the one utterance section divided into a plurality of groups; performing an image data generation process to generate the image data,
the number of characters of the text information included in each of the plurality of groups is less than the predetermined value;
How to display voice recognition results. For the voice recognition result display system,
an acquisition step of acquiring the user's uttered audio;
a voice recognition step of performing voice recognition on the uttered voice and outputting text information;
an image generation step of generating image data based on the text information;
performing a display step of displaying the image data;
In the image generation step, if the number of characters of the text information included in one utterance section of the user is less than a predetermined value, the image data is configured to display the text information included in the one utterance section as one group. and when the number of characters of the text information included in the one utterance section is equal to or greater than the predetermined value, the image data is divided into a plurality of groups and displayed. Image data generation processing is performed,
the number of characters of the text information included in each of the plurality of groups is less than the predetermined value;
program.

Images