JP2017187797A - Text generation device, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a text generation device, a method, and a program capable of reducing load of transcript work.SOLUTION: A text generation device comprises a recognition section, a selection section and a generation section. The recognition section recognizes acquired voice to acquire a recognized character string and reliable level of the recognized character string of each recognition unit. The selection section selects at least one of the recognized character strings used for a transcript based on at least one parameter in a transcript accuracy parameter and a parameter of workload required for transcript. The generation section generates the transcript by using the selected recognized character string.SELECTED DRAWING: Figure 2

Description

  Embodiments described herein relate generally to a text generation device, a method, and a program.

  The transcription work is, for example, a work of making the content of the voice a sentence (writing it into text) while listening to the recorded voice data. Therefore, conventionally, in order to reduce the burden of the transcription work, an apparatus that supports the transcription work using a voice recognition system is known.

JP 2007-108407 A

  However, the conventional apparatus cannot obtain an appropriate speech recognition result desired by the worker, and does not reduce the burden of the transcription work.

  The text generation device according to the embodiment includes a recognition unit, a selection unit, and a generation unit. The recognition unit recognizes the acquired voice and obtains a recognized character string for each recognition unit and a reliability of the recognized character string. The selection unit selects at least one of the recognized character strings to be used in the transcription sentence based on at least one of the parameter of the transcription accuracy and the parameter of the work amount required for the transcription. The generation unit generates the transcription sentence using the selected recognition character string.

The figure which shows the usage example of the text generation apparatus which concerns on 1st Embodiment. The figure which shows the function structural example of the text generation apparatus which concerns on 1st Embodiment. The flowchart which shows the example of a basic process at the time of the text generation which concerns on 1st Embodiment. The figure which shows the example of data of the speech recognition result which concerns on 1st Embodiment. The flowchart which shows the process example (the 1) at the time of the recognition character string selection which concerns on 1st Embodiment. The figure which shows the example of a setting of the allowable value of transcription accuracy which concerns on 1st Embodiment. The figure which shows the data example (the 1) of the recognition character string selection result which concerns on 1st Embodiment. The flowchart which shows the process example (the 2) at the time of the recognition character string selection which concerns on 1st Embodiment. The figure which shows the example of a setting of the allowable value of the transcription work time which concerns on 1st Embodiment. The figure which shows the data example (the 2) of the recognition character string selection result which concerns on 1st Embodiment. 6 is a flowchart showing a processing example (No. 3) when a recognized character string is selected according to the first embodiment. The figure which shows the example of a setting of the allowable value of the transcription work cost which concerns on 1st Embodiment. The figure which shows the data example (the 3) of the recognition character string selection result which concerns on 1st Embodiment. The flowchart which shows the process example at the time of the transcription production | generation concerning 1st Embodiment. The figure which shows the data format example of the transcription sentence which concerns on 1st Embodiment. The figure which shows the example of a display of the transcription sentence which concerns on 1st Embodiment. 6 is a flowchart showing a processing example when setting a character insertion position according to the first embodiment. The flowchart which shows the process example at the time of the audio | voice position search which concerns on 1st Embodiment. The figure which shows the function structural example of the text generation apparatus which concerns on 2nd Embodiment. The flowchart which shows the example of a basic process at the time of the text production | generation concerning 2nd Embodiment. The flowchart which shows the process example at the time of the recognition result coupling | bonding which concerns on 2nd Embodiment. The figure which shows the function structural example of the text generation apparatus which concerns on 3rd Embodiment. The flowchart which shows the example of a basic process at the time of the text production | generation concerning 3rd Embodiment. The figure which shows the example of data of the speech area information which concerns on 3rd Embodiment. The flowchart which shows the process example at the time of the recognition character string selection which concerns on 3rd Embodiment. The figure which shows the example of a setting of the allowable value of transcription accuracy which concerns on 3rd Embodiment. The figure which shows the structural example of the text generation apparatus which concerns on embodiment.

  Hereinafter, embodiments of a text generation device, a method, and a program will be described in detail with reference to the accompanying drawings.

[First Embodiment]
<Outline>
A function (hereinafter referred to as “text generation function”) of the text generation apparatus according to the present embodiment will be described. The text generation device according to the present embodiment selects a recognized character string to be used as a transcript based on the reliability of the recognized character string calculated based on the speech recognition result and a parameter related to the transcription accuracy. Alternatively, the text generation device according to the present embodiment selects a recognized character string to be used as a transcript based on the reliability of the recognized character string calculated based on the speech recognition result and a parameter relating to the work amount required for the transcription. . As a result, the text generation device according to the present embodiment generates a transcription sentence from the selected recognized character string. As a result, the text generation apparatus according to the present embodiment can perform a transcription work using an appropriate speech recognition result. The text generation apparatus according to the present embodiment has such a text generation function.

  Some conventional devices, for example, provide an overview of speech recognition results for speech data. In this apparatus, a priority is obtained for the speech recognition result based on the reliability and importance of the recognized word, and the output information of the speech recognition result is shaped according to the priority. However, in the conventional apparatus, the operator can only adjust the output by specifying the display target range. Therefore, in the conventional apparatus, an appropriate voice recognition result desired by the operator is rarely output according to the accuracy of the transcription or the amount of work required for the transcription, and the burden of the transcription work on the worker is reduced. large. Thus, the conventional apparatus does not reduce the burden of the transcription work for the worker.

  Therefore, the text generation apparatus according to the present embodiment adjusts the output of the speech recognition result in accordance with the work conditions specified by the worker (the transcription accuracy or the work amount required for the transcription). The text generation apparatus according to the present embodiment can perform a transcription work by synchronizing the input characters and the voice using the voice recognition result when the worker adds / modifies the adjusted output. It was made to work.

  As a result, in the text generation device according to the present embodiment, an appropriate speech recognition result according to work conditions such as transcription accuracy and the amount of work required for transcription can be used during the transcription work, and the speech recognition result On the other hand, characters can be easily added or modified. Thereby, the text generation device according to the present embodiment can reduce the burden of the transcription work for the worker.

  Note that the text generation apparatus according to the present embodiment can provide the following services, for example. FIG. 1 is a diagram illustrating a usage example of the text generation apparatus according to the present embodiment. For example, FIG. 1 shows a service that recognizes the voices of a plurality of speakers, transcribes the contents of each speaker's utterance, and attaches the name of the speaker who is speaking to each text. An example when used is shown.

  In the following, the functional configuration and operation of the text generating apparatus according to the present embodiment will be described.

"Constitution"
FIG. 2 is a diagram illustrating a functional configuration example of the text generation device according to the present embodiment. As shown in FIG. 2, the text generation apparatus 100 according to the present embodiment includes an acquisition unit 11, a recognition unit 12, a selection unit 13, a generation unit 14, a setting unit 15, a search unit 16, a reproduction unit 17, and a recognition result holding unit. Part 18 and the like.

  The acquisition unit 11 receives a voice input by a predetermined input unit and acquires a voice. The recognition unit 12 recognizes the voice acquired by the acquisition unit 11, calculates at least a recognized character string for each recognition unit and a reliability of the recognized character string, and stores the calculation result in the recognition result holding unit 18. Note that the recognition unit corresponds to, for example, a morpheme. The recognition result holding unit 18 corresponds to, for example, a predetermined storage area of a storage device included in the text generation device 100.

  The selection unit 13 selects at least one recognized character string to be used for the transcript based on various parameters related to the work conditions of the transcription work and the reliability of the recognized character string stored in the recognition result holding unit 18. . Note that the values of various parameters related to the work conditions are values that are specified by accepting an operation from the worker U via a UI (User Interface), for example. The generation unit 14 generates a transcript using the recognized character string selected by the selection unit 13. The setting unit 15 sets the character input start position (hereinafter referred to as “character insertion position”) by the operator U for the transcript corresponding to the recognized character string not selected by the selection unit 13. In addition, the recognition character string which was not selected is designated by receiving operation from the operator U via UI, for example.

  When the character input by the operator U is started at the character insertion position set by the setting unit 15, the search unit 16 searches for a voice position corresponding to the input character (hereinafter referred to as “voice position”). To do. The start of the search is instructed by accepting an operation from the worker U via the UI, for example. The reproduction unit 17 reproduces sound from the searched sound position.

Below, the basic process at the time of the text generation performed with the text generation apparatus 100 which concerns on this embodiment is demonstrated.
"processing"
FIG. 3 is a flowchart showing an example of basic processing at the time of text generation according to the present embodiment. As illustrated in FIG. 3, the acquisition unit 11 acquires audio (step S101). Next, the recognition unit 12 recognizes the voice acquired by the acquisition unit 11, and calculates the recognition character string for each recognition unit and the reliability of the recognition character string (step S102). As a result, the recognition character string and the reliability of the recognition character string are stored in the recognition result holding unit 18.

  Next, the selection unit 13 uses at least one used for the transcript based on various parameters (working condition parameters) relating to the working condition of the transcription work and the reliability of the recognized character string stored in the recognition result holding unit 18. Two recognized character strings are selected (step S103). At this time, the selection unit 13 selects a parameter relating to the transcription accuracy and the reliability of the recognized character string, or a combination of any parameter and reliability of the parameter relating to the work amount required for the transcription and the reliability of the recognized character string. Based on this, the recognition character string used for the transcript is selected. Next, the generation unit 14 generates a transcript using the recognized character string selected by the selection unit 13 and the recognized character string not selected by the selection unit 13 (step S104).

  Next, the setting unit 15 sets the character insertion position by the worker U according to the setting received from the worker U for the transcript corresponding to the recognized character string not selected by the selection unit 13 (step S105). ). Next, the search unit 16 searches for a voice position corresponding to the character insertion position set by the setting unit 15 based on the recognition result (step S106).

  Next, the reproducing unit 17 reproduces sound from the sound position searched by the search unit 16 in accordance with the designation received from the worker U (step S107). Thereafter, the text generating apparatus 100 accepts character input (addition / correction) from the worker U (step S108).

  When the text generation device 100 according to the present embodiment receives a transcription end instruction from the worker U (step S109: Yes), the process ends. On the other hand, the text generating apparatus 100 repeats the processing from step S106 to step S108 until an instruction to finish transcription is given from the worker U (step S109: No).

<Details>
From here, the detail of each said function part is demonstrated.

<< Details of each function >>
(Acquisition unit 11)
The acquisition part 11 acquires the audio | voice used as the object transcribed to a character.

(Recognition unit 12)
The recognition unit 12 recognizes the voice acquired by the acquisition unit 11, and obtains at least a recognized character string for each recognition unit and a reliability of the recognized character string as a recognition result.

  FIG. 4 is a diagram illustrating a data example of the speech recognition result D1 according to the present embodiment. In FIG. 4, the recognition unit 12, "Hello, this is Taro of ABC company." Example of the result obtained is shown in the case of speech recognition an utterance that. As described above, the recognition unit 12 obtains the speech recognition result D1 including the recognition ID, the recognized character string, and the reliability of the recognized character string, for example. The recognition unit 12 stores and stores the obtained speech recognition result D1 in the recognition result holding unit 18.

(Selection unit 13)
The selection unit 13 is based on a combination of any parameter and reliability of the parameter regarding the transcription accuracy and the reliability of the recognized character string, or the parameter regarding the amount of work required for the transcription and the reliability of the recognized character string. At least one recognized character string used for the transcript is selected.

  Here, the transcription accuracy and the workload will be described. Transcription accuracy is a value that indicates the degree of matching between the written character string and the character string (correct character string) when the speech is correctly transcribed. If the value is large, the written character string And the correct character string have a high degree of coincidence, indicating that it has been transcribed correctly. Also, the amount of work required for transcription is the amount of work necessary for generating speech into characters, and corresponds to, for example, the time and cost required for the transcription work.

  Below, the process in which the selection part 13 selects a recognition character string is demonstrated. FIG. 5 is a flowchart showing a processing example (part 1) at the time of selecting a recognized character string according to the present embodiment. FIG. 5 shows an example of processing in the case where the selection unit 13 uses an allowable value of transcription accuracy as a parameter related to transcription accuracy.

  As illustrated in FIG. 5, the selection unit 13 first receives a setting of the transcription accuracy tolerance P from the operator U (step S <b> 201).

  FIG. 6 is a diagram showing a setting example of the transcription accuracy allowable value P according to the present embodiment. As shown in FIG. 6, the operator U can, for example, control the transcription accuracy via a slide-type UI (slide bar) that can designate one of the N stages (N = 5 in the figure). An allowable value P is set. As described above, the selection unit 13 displays the UI on the screen and receives a setting from the worker U.

Returning to the description of FIG. Next, the selection unit 13 sets the first recognized character string as the target character string w among the recognition results obtained by the recognition unit 12 (recognition results stored in the recognition result holding unit 18) (step S202). The transcription accuracy wp of the target character string w is calculated from the reliability of the column w (step S203). At this time, for example, when using a positive integer value of 1 to N as the transcription accuracy, the selection unit 13 calculates the transcription accuracy wp of the target character string w by the following (Equation 1).
Transcription accuracy wp = N × (reliability of target character string w / maximum reliability) (Equation 1)

  Next, the selection unit 13 compares the calculated transcription accuracy wp of the target character string w with the transcription accuracy allowable value P, and determines whether or not the transcription accuracy wp is equal to or greater than the allowable value P (step S204). . As a result, when it is determined that the transcription accuracy wp is equal to or greater than the allowable value P (step S204: Yes), the selection unit 13 selects the target character string w (step S205). On the other hand, if the selection unit 13 determines that the transcription accuracy wp is less than the allowable value P (step S204: No), the selection unit 13 does not select the target character string w.

  Next, the selection unit 13 determines whether or not there is a next recognized character string in the recognition result obtained by the recognition unit 12 (step S206). As a result, when the selection unit 13 determines that there is the next recognized character string (step S206: Yes), the next recognized character string is set as the target character string w (step S207), and the processes from step S203 to S206 are performed. repeat. On the other hand, the selection part 13 complete | finishes a process, when it determines with there being no next recognition character string (step S206: No).

  FIG. 7 is a diagram showing a data example (part 1) of the recognized character string selection result D2 according to the present embodiment. In FIG. 7, when N = 5, the reliability of the target character string w = 4, and the maximum value of the reliability P = 100, the authentication character string is expressed based on the transcription accuracy wp calculated by the equation (1). The selected selection result is shown. In this way, the selection unit 13 obtains the recognized character string selection result D2 including, for example, the recognition ID, the recognized character string, the reliability of the recognized character string, the transcription accuracy wp, and the selection result. Further, the selection unit 13 may select the recognized character string based on the work amount required for transcription (for example, “work time” and “work cost”).

  FIG. 8 is a flowchart showing a processing example (No. 2) when a recognized character string is selected according to the present embodiment. FIG. 8 shows an example of processing when the selection unit 13 uses an allowable value of work time required for transcription as a parameter related to the work amount required for transcription.

  As illustrated in FIG. 8, the selection unit 13 first receives a setting of an allowable work time T required for transcription from the worker U (step S301).

  FIG. 9 is a diagram showing an example of setting the allowable value T of the transcription work time according to the present embodiment. As shown in FIG. 9, for example, the worker U performs work required for transcription via a slide-type UI (slide bar) that can specify a time between 00:00:00 and HH: MM: SS. An allowable time T is set. As described above, the selection unit 13 displays the UI on the screen and receives a setting from the worker U. For example, a predetermined value is used as the maximum value of the specifiable time. Further, a value calculated by the following method may be used as the maximum value of the specifiable time. For example, the work time per character may be determined, the product of the total number of characters in the recognized character string obtained by the recognition unit 12 and the work time per character may be calculated, and the calculated value may be used. When the recognition unit 12 outputs the start time and the end time of each recognized character string as a recognition result, it calculates a time (utterance time) obtained by subtracting the start time from the end time of each output recognized character string. The total time of utterances of all recognized character strings may be used.

  Returning to the description of FIG. Next, the selection unit 13 sorts the recognition results obtained by the recognition unit 12 in descending order of the reliability of the recognized character string (step S302). Next, the selection unit 13 initializes an accumulated work time st indicating accumulation of work time required for transcription (step S303).

Next, the selection unit 13 sets the first recognized character string among the recognition results sorted in descending order as the target character string w (step S304), and calculates the work time t required to transcribe the target character string w (step S305). ). At this time, the selection unit 13 calculates the work time t required to transcribe the target character string w using, for example, the following (Formula 2) using the number of characters of the target character string w.
Work time required for transcription t = α × (number of characters in target character string w) (Formula 2)
For example, the average time required to write one character is used as α.

For example, when the recognition unit 12 outputs the start time and the end time of each recognized character string as a recognition result, the selection unit 13 requires a work time required to transcribe the target character string w according to (Equation 3). t may be calculated.
Work time required for transcription t = β × (end time of target character string w−start time of target character string w) (Equation 3)
For β, for example, an average time taken to write one morpheme (one recognition unit) is used.

  Next, the selection unit 13 calculates the accumulated work time st required for transcription from the work time t required for transcription of the target character string w (step S306). At this time, for example, the selection unit 13 adds the work time t required for transcription of the target character string w calculated in (Expression 2) or (Expression 3) to the cumulative work time st required for transcription and accumulates.

  Next, the selection unit 13 compares the calculated cumulative work time st required for the transcription with the allowable value T of the transcription work time, and determines whether the cumulative work time st is equal to or less than the allowable value T (step S307). As a result, when it is determined that the accumulated work time st is equal to or less than the allowable value T (step S307: Yes), the selection unit 13 selects the target character string w (step S308). On the other hand, if the selection unit 13 determines that the accumulated work time st is greater than the allowable value T (step S307: No), the selection unit 13 does not select the target character string w.

  Next, the selection unit 13 determines whether or not there is a next recognized character string in the recognition result obtained by the recognition unit 12 (step S309). As a result, when the selection unit 13 determines that there is the next recognized character string (step S309: Yes), the next recognized character string is set as the target character string w (step S310), and the processes from step S305 to S309 are performed. repeat. On the other hand, the selection part 13 complete | finishes a process, when it determines with there being no next recognition character string (step S309: No).

  FIG. 10 is a diagram showing a data example (part 2) of the recognized character string selection result D2 according to the present embodiment. FIG. 10 shows a selection result of selecting an authentication character string based on the work time t required for transcription calculated by (Equation 3). Thus, the selection unit 13 recognizes the recognized character string selection result D2 including, for example, the recognition ID, the recognized character string, the reliability of the recognized character string, the work time t required for transcription, the accumulated work time st, and the selection result. Get.

  FIG. 11 is a flowchart showing a processing example (No. 3) when a recognized character string is selected according to the present embodiment. FIG. 11 shows an example of processing when the selection unit 13 uses an allowable value for the work cost required for transcription as a parameter related to the work amount required for transcription.

  As illustrated in FIG. 11, the selection unit 13 first receives a setting of an allowable value C of work cost required for transcription from the worker U (step S401).

  FIG. 12 is a diagram showing a setting example of the allowable value C of the transcription work cost according to the present embodiment. As shown in FIG. 12, the worker U sets an allowable value C of the work cost required for transcription, for example, via a slide-type UI (slide bar) that can specify a value between 0 and the maximum value. To do. As described above, the selection unit 13 displays the UI on the screen and receives a setting from the worker U. For example, a predetermined value is used as the maximum value that can be specified. Further, a value calculated by the following method may be used as the maximum value of the specifiable time. For example, the work time per character may be determined, the product of the total number of characters in the recognized character string obtained by the recognition unit 12 and the work time per character may be calculated, and the calculated value may be used. Further, when the recognition unit 12 outputs the utterance time of each recognized character string (a time obtained by subtracting the start time from the end time) as a recognition result, a time obtained by summing up the utterance times of the respective recognized character strings, and a unit A product of work costs per hour may be calculated and the calculated value may be used.

  Returning to the description of FIG. Next, the selection unit 13 sorts the recognition results obtained by the recognition unit 12 in descending order of the reliability of the recognized character string (step S402). Next, the selection unit 13 initializes an accumulated work cost sc indicating the accumulation of work costs required for transcription (step S403).

Next, the selection unit 13 sets the first recognized character string as the target character string w among the recognition results sorted in descending order (step S404), and calculates the work cost c required for transcription of the target character string w (step S405). ). At this time, for example, the selection unit 13 calculates the work cost c required for transcription of the target character string w by the following (Equation 4) using the number of characters of the target character string w.
Work cost required for transcription c = γ × (number of characters of target character string w) (Formula 4)
For γ, for example, an average cost for writing one character is used.

For example, when the recognition unit 12 outputs the start time and the end time of each recognized character string as a recognition result, the selection unit 13 performs an operation cost required for transcription of the target character string w according to (Equation 5). c may be calculated.
Work cost required for transcription c = ζ × (end time of target character string w−start time of target character string w) (Formula 5)
For ζ, for example, an average cost for writing one morpheme (one recognition unit) is used.

  Next, the selection unit 13 calculates the accumulated work cost sc required for transcription from the work cost c required for transcription of the target character string w (step S406). At this time, for example, the selection unit 13 adds and accumulates the work cost c required for transcription of the target character string w calculated in (Expression 4) or (Expression 5) to the cumulative work cost sc required for transcription.

  Next, the selection unit 13 compares the calculated cumulative work cost sc required for transcription with the allowable value C of the transcription work cost, and determines whether the cumulative work cost sc is equal to or less than the allowable value C (step S407). As a result, when it is determined that the accumulated work cost sc is equal to or less than the allowable value C (step S407: Yes), the selection unit 13 selects the target character string w (step S408). On the other hand, when the selection unit 13 determines that the accumulated work cost sc is larger than the allowable value C (step S407: No), the selection unit 13 does not select the target character string w.

  Next, the selection unit 13 determines whether or not there is a next recognized character string in the recognition result obtained by the recognition unit 12 (step S409). As a result, if the selection unit 13 determines that there is the next recognized character string (step S409: Yes), the next recognized character string is set as the target character string w (step S410), and the processes from step S405 to S409 are performed. repeat. On the other hand, the selection part 13 complete | finishes a process, when it determines with there being no next recognition character string (step S409: No).

  FIG. 13 is a diagram showing a data example (part 3) of the recognized character string selection result D2 according to the present embodiment. FIG. 13 shows the selection result of selecting the authentication character string based on the work cost c required for the transcription calculated by (Equation 5). In this way, the selection unit 13 recognizes the recognition character string selection result D2 including, for example, the recognition ID, the recognition character string, the reliability of the recognition character string, the work cost c required for transcription, the cumulative work cost sc, and the selection result. Get.

(Generator 14)
The generation unit 14 generates a transcript using the selected recognized character string and the unselected recognized character string in the selection unit 13.

  Below, the process which the production | generation part 14 produces | generates a transcription sentence is demonstrated. FIG. 14 is a flowchart showing a processing example when generating a transcript according to the present embodiment. FIG. 15 is a diagram showing an example of the data format of the transcription sentence according to this embodiment.

  As illustrated in FIG. 14, the generation unit 14 first initializes the transcription sentence k (step S501). For example, when the data format is HTML (HyperText Markup Language), the transcription sentence k is created as a DIV element as shown in FIG.

  Next, the generation unit 14 sets the first recognized character string as the target character string w among the recognition results obtained by the recognition unit 12 (step S502), and determines whether or not the target character string w is selected by the selection unit 13. Is determined (step S503). As a result, when the generation unit 14 determines that the target character string w is selected (step S503: Yes), the generation unit 14 creates a selection element s from the target character string w (step S504), and creates the created selection element s. It adds to the transcription sentence k (step S505). For example, as shown in FIG. 15, the selection element s is a SPAN element having an ID attribute as an identification ID of the target character string w and a CLASS attribute as a character string (for example, “selected”) indicating the selection element s. Created. On the other hand, when determining that the target character string w is not selected (step S503: No), the generation unit 14 creates a non-selected element ns from the target character string w (step S506), and creates the created non-selected element ns. Is added to the transcript k (step S507). For example, as shown in FIG. 15, the non-selected element ns is a SPAN in which the ID attribute is an identification ID of the target character string w, and the CLASS attribute is a character string (for example, “not_selected”) indicating the non-selected element ns. Created as an element.

  Next, the generation unit 14 determines whether or not the recognition result obtained by the recognition unit 12 includes the next recognized character string (step S508). As a result, if the generation unit 14 determines that there is the next recognized character string (step S508: Yes), the next recognized character string is set as the target character string w (step S509), and the processes from step S503 to S508 are performed. repeat. On the other hand, when it determines with the production | generation part 14 not having the following recognition character string (step S508: No), a process is complete | finished.

  FIG. 16 is a diagram showing a display example of the transcription sentence k according to the present embodiment. As shown in FIG. 16, the generation unit 14 generates a transcript k that can be displayed in a different manner so that the distinction between the character string of the selected element s and the character string of the non-selected element ns becomes clear. Also good. For example, FIG. 16A shows a display example when the character string of the non-selected element ns is underlined. FIG. 16B shows a display example when the character size of the character string of the non-selected element ns is smaller than the character string of the selected element s. FIG. 16C shows a display example when the character string of the non-selected element ns is shaded. FIG. 16D shows a display example when the character string of the non-selected element ns is replaced with a predetermined character (black circle in the drawing). In addition to this, there are display examples in which the character density, color, typeface, background color, etc. are changed. When the recognition unit 12 outputs recognition character strings up to the Nth candidate (N is an integer equal to or greater than 1) with high reliability for each recognition unit, the recognition unit 12 outputs the recognition character string that is not selected. A transcript k that displays the recognized character string up to the candidate in a state where the operator U can select may be generated.

(Setting unit 15)
The setting unit 15 sets a character insertion position (character input start position) based on the non-selected element ns of the transcript k generated by the generation unit 14. At this time, the setting unit 15 sets the detected current character insertion position, the selected element corresponding to the recognized character string selected by the selecting unit 13 and the recognized character string not selected by the selecting unit 13 in the transcript. The character insertion position is set based on the positional relationship with the corresponding non-selected element.

  Hereinafter, a process in which the setting unit 15 sets the character insertion position will be described. FIG. 17 is a flowchart showing a processing example when setting the character insertion position according to the present embodiment.

As illustrated in FIG. 17, the setting unit 15 first receives an instruction to move from the worker U to the character of the non-selected element ns (step S601). At this time, for example, when the setting unit 15 detects that a predetermined key (for example, “tab key”) is pressed in the displayed transcript, it determines that movement is instructed, and accepts the instruction.
Next, the setting unit 15 detects the current character insertion position cp in the transcript (step S602). The current character insertion position cp is the current character insertion position cp in the character string in the transcript. For example, it corresponds to the cursor position (for example, “position where the vertical bar blinks”) on the screen where the transcript is displayed.

  Next, the setting unit 15 determines whether or not the detected current character insertion position cp is within the selected element (step S603). As a result, when the setting unit 15 determines that the current character insertion position cp is within the selected element (step S603: Yes), the setting unit 15 is behind the character insertion position cp and is closest to the character insertion position cp. The selected element ns is detected (step S604). On the other hand, when the setting unit 15 determines that the character insertion position cp is not within the selected element (step S603: No), the setting unit 15 detects the selection element s that is behind the character insertion position cp and closest to the character insertion position cp. (Step S605). Thereafter, the setting unit 15 detects the non-selected element ns that is behind the detected selected element s and is closest to the detected selected element s (step S606). Next, the setting unit 15 moves the character insertion position cp to the head position nsp of the detected non-selected element ns (step S607).

  Note that the setting unit 15 moves the character insertion position cp to the head position nsp of the non-selected element ns, and then, when there is another non-selected element that continues behind by the non-selected element ns, You may display a row | line and the character string of another non-selection element in a different aspect. For example, the setting unit 15 may highlight the character string of the non-selected element ns and the character string of another non-selected element with different background colors.

(Search unit 16)
When the character input by the operator U is started at the character insertion position cp, the search unit 16 searches for a voice position corresponding to the input character.

  Hereinafter, a process in which the search unit 16 searches for a voice position will be described. FIG. 18 is a flowchart showing an example of processing at the time of voice position search according to the present embodiment.

  As illustrated in FIG. 18, the setting unit 15 first receives a search instruction for a voice position corresponding to the current character insertion position cp from the worker U (step S701). At this time, for example, when detecting that the Enter key is pressed in the displayed transcript, the search unit 16 determines that the search is instructed, and accepts the instruction.

  Next, the search unit 16 detects the current character insertion position cp in the transcript (step S702). Next, the search unit 16 determines whether or not the detected current character insertion position cp is within the selected element (step S703).

  As a result, when it is determined that the current character insertion position cp is within the selected element (step S703: Yes), the search unit 16 sets the start time of the selected element s as the voice position p (step S704). On the other hand, when the search unit 16 determines that the current character insertion position cp is not within the selected element (step S703: No), the search unit 16 uses the predetermined voice recognition technique (for example, “forced alignment method”) to determine the voice position p. Estimate (step S705). At this time, the search unit 16 estimates by the speech recognition technique from the start character of the recognized character string corresponding to the non-selected element ns having the transcription character k, the character insertion position cp, the current speech reproduction position, and the like.

(Playback unit 17)
The reproduction unit 17 reproduces sound from the sound position p searched by the search unit 16.

<Summary>
As described above, according to the text generating apparatus 100 according to the present embodiment, the reliability of the recognized character string calculated based on the speech recognition result, and various parameters (writing data related to the work conditions of the transcription work specified by the worker U). Based on the transcription accuracy and at least one parameter of the amount of work required for transcription, a recognized character string recognized from speech is selected, and a transcript is generated.

  Thereby, the text generation device 100 according to the present embodiment adjusts the output of the speech recognition result according to the work condition specified by the worker U. The text generation device 100 according to the present embodiment uses the speech recognition result to synchronize the input character and the speech when the worker U adds or corrects the adjusted output, thereby transcribe the work. Provide an environment that can

  As a result, the text generation apparatus 100 according to the present embodiment can use an appropriate speech recognition result according to the transcription work condition at the time of the transcription work. Can be added or modified. Thereby, the text generation device 100 according to the present embodiment can reduce the burden of the transcription work for the worker U.

[Second Embodiment]
<Outline>
A function (text generation function) of the text generation apparatus according to the present embodiment will be described. The text generation apparatus according to the present embodiment is different from the above-described embodiment in that the recognition result obtained by the recognition unit is combined in sentence units or time units, and the combined result is used in a transcript. More specifically, the text generation device according to the present embodiment uses a result obtained by combining the recognition results in units of sentences based on the sentence end expression of the recognized character string in the transcript. Alternatively, the text generation device according to the present embodiment uses a result obtained by combining the recognition results in predetermined time units based on the start time and the end time of the recognized character string in the transcript.

  In the following, the functional configuration and operation of the text generating apparatus according to the present embodiment will be described. In the following description, items different from the above embodiment will be described, the same items will be denoted by the same reference numerals, and description thereof will be omitted.

"Constitution"
FIG. 19 is a diagram illustrating a functional configuration example of the text generation device 100 according to the present embodiment. As illustrated in FIG. 19, the text generation device 100 according to the present embodiment further includes a combining unit 21 and a recognition combined result holding unit 22 in addition to the functional configuration of the first embodiment.

  The combination unit 21 combines the recognition results obtained by the recognition unit 12 (recognition results stored in the recognition result holding unit 18) in sentence units or time units, and combines the combined results into the recognition combination result holding unit 22. To remember. Note that the recognition combination result holding unit 22 corresponds to, for example, a predetermined storage area of a storage device included in the text generation device 100. Further, the selection unit 13 and the search unit 16 use the recognition combination result stored in the recognition combination result holding unit 22.

Below, the basic process at the time of the text generation performed with the text generation apparatus 100 which concerns on this embodiment is demonstrated.
"processing"
FIG. 20 is a flowchart showing an example of basic processing at the time of text generation according to the present embodiment. As illustrated in FIG. 20, the acquisition unit 11 acquires sound (step S801). Next, the recognition unit 12 recognizes the voice acquired by the acquisition unit 11, and calculates the recognition character string and the reliability of the recognition character string for each recognition unit (step S802). As a result, the recognition character string and the reliability of the recognition character string are stored in the recognition result holding unit 18.

  Next, the combining unit 21 combines the recognition results of the recognition unit 12 in a predetermined sentence unit or a predetermined time unit (step S803). As a result, the reliability of the combined recognized character string and the combined recognized character string is stored in the recognized combined result holding unit 22 as a recognized combined result. Next, the selection unit 13 performs various parameters (working condition parameters) related to the work conditions of the transcription work and the reliability of the recognition combination result stored in the recognition combination result holding unit 22 (reliability of the recognized character string after combination). Based on the above, at least one recognized character string to be used for the transcript is selected (step S804). At this time, the selection unit 13 selects a parameter relating to the transcription accuracy and the reliability of the recognized character string, or a combination of any parameter and reliability of the parameter relating to the work amount required for the transcription and the reliability of the recognized character string. Based on this, the recognition character string used for the transcript is selected.

  Next, the generation unit 14 generates a transcript using the recognized character string selected by the selection unit 13 and the recognized character string not selected by the selection unit 13 (step S805). Next, the setting unit 15 sets the character insertion position by the worker U according to the setting received from the worker U for the transcript corresponding to the recognized character string not selected by the selection unit 13 (step S806). ). Next, the search unit 16 searches for a voice position corresponding to the character insertion position set by the setting unit 15 based on the recognition result (step S807).

  Next, the reproducing unit 17 reproduces sound from the sound position searched by the search unit 16 in accordance with the designation received from the worker U (step S808). Thereafter, the text generating apparatus 100 accepts character input (addition / correction) from the worker U (step S809).

  When the text generation apparatus 100 according to the present embodiment receives an instruction to finish transcription from the worker U (step S810: Yes), the process ends. On the other hand, the text generating apparatus 100 repeats the processes from Steps S807 to S809 until an instruction to finish transcription is given from the worker U (Step S810: No).

<Details>
From here, the detail of the coupling | bond part 21 and the selection part 13 is mainly demonstrated.

<< Details of each function >>
(Coupling part 21)
The combining unit 21 combines the recognition results in sentence units based on the sentence end expression of the recognized character string, and obtains a recognition combination result. Alternatively, the combining unit 21 combines the recognition results in predetermined time units based on the start time and end time of the recognized character strings, and combines the combined character strings (recognized character strings after combining) and the reliability of the combined results. A recognition combination result including is obtained.

  Hereinafter, processing in which the combining unit 21 combines the recognition results will be described. FIG. 21 is a flowchart illustrating a processing example when combining recognition results according to the present embodiment.

  As shown in FIG. 21, the combining unit 21 first initializes a temporary combination result cr of the recognition result obtained by the recognition unit 12 (the recognition result stored in the recognition result holding unit 18) (step S901). Next, the combining unit 21 sets the first recognition result among the recognition results obtained by the recognition unit 12 as the target recognition result r (step S902). Next, the combining unit 21 adds the target recognition result r to the temporary combination result cr (step S903).

  Next, the combining unit 21 determines whether or not to complete the combining (step S904). At this time, the determination process of the combining unit 21 differs depending on whether it is combined in sentence units or in time units.

(A) Determination processing when combining in sentence units The combining unit 21 determines whether or not to complete combining based on the determination result of whether or not the recognized character string of the target recognition result r is the end of the sentence. In this case, the combining unit 21 determines that combining is completed when the recognized character string of the target recognition result r is the end of the sentence (step S904: Yes). On the other hand, when the recognized character string of the target recognition result r is not the end of the sentence, the combining unit 21 determines that the combining is not completed (step S904: No). Note that the end-of-sentence determination method includes, for example, a character or symbol representing the end of a sentence such as “.” (Punctuation), “.” (Period), or “?” (Question mark) in the recognized character string. For example, there is a method for determining whether or not there is. If these characters or symbols are not included, for example, the determination may be made based on whether or not a predetermined sentence ending expression such as “is” or “mas” is included in the recognized character string.

(B) Determination processing when combining in time unit The combining unit 21 determines whether or not to complete combining based on the start time and end time of the recognized character string obtained as a recognition result. In this case, the combining unit 21 starts the recognition character string corresponding to the recognition result added to the temporary combination result cr immediately before the target recognition result r from the start time of the recognition character string corresponding to the target recognition result r. If the elapsed time up to is a predetermined time or more, it is determined that the combination is completed (step S904: Yes). On the other hand, when the elapsed time is less than the predetermined time, the combining unit 21 determines that the combining is not completed (step S904: No). The combining unit 21 determines that the elapsed time from the start time of the target recognition result r to the start time of the recognized character string corresponding to the first recognition result added to the temporary combination result cr is equal to or longer than a predetermined time. It may be determined that the combination is completed.

  As a result, when it is determined that the combination is completed (step S904: Yes), the combining unit 21 calculates the reliability of the temporary combination result cr (step S905). Note that the reliability of the temporary combination result cr is calculated based on the reliability of the recognized character string corresponding to the recognition result added to the temporary combination result cr. For example, the average value of the reliability of the recognized character string corresponding to the recognition result added to the temporary combination result cr is calculated, and the calculated value is set as the reliability of the temporary combination result cr. On the other hand, when it determines with combining not being completed (step S904: No), it transfers to the process of step S908 mentioned later, and the process from step S905 to S907 is skipped.

  Next, the combining unit 21 uses the recognized combined character string corresponding to the temporary combined result cr (recognized character string after combining) and the reliability of the calculated temporary combined result cr as the recognized combined result holding unit 22. (Step S906), and the temporary combination result cr is initialized (step S907).

  Next, the combining unit 21 determines whether or not the recognition result obtained by the recognition unit 12 includes the next recognition result (step S908). As a result, when the combining unit 21 determines that there is the next recognition result (step S908: Yes), the next recognition result is set as the target recognition result r (step S909), and the processing from step S903 to S908 is repeated. On the other hand, when determining that there is no next recognition result (step S908: No), the combining unit 21 determines whether or not a recognition result remains in the temporary combination result cr (step S910). As a result, when the combining unit 21 determines that the recognition result remains in the temporary combining result cr (step S910: Yes), the combining unit 21 proceeds to the process of step S905. On the other hand, if the combining unit 21 determines that no recognition result remains in the temporary combining result cr (step S910: No), the process ends.

(Selection unit 13)
The selection unit 13 is either one of a parameter relating to transcription accuracy and reliability of a recognition combination result (reliability of a recognized character string after combination), or a parameter relating to a work amount required for transcription and reliability of a recognition combination result. Based on the combination of the parameters and the reliability, at least one recognition character string used for the transcript is selected.

<Summary>
As described above, according to the text generation device 100 according to the present embodiment, the reliability of the recognized character string combined for each sentence unit or every predetermined time unit, and the work of the transcription work specified by the worker U. Based on various parameters related to conditions (at least one of the transcription accuracy and the amount of work required for transcription), a recognized character string recognized from speech is selected, and a transcript is generated.

  As a result, the text generating apparatus 100 according to the present embodiment can easily add or modify characters as in the first embodiment, and can reduce the burden of the transcription work on the worker U.

[Third Embodiment]
A function (text generation function) of the text generation apparatus according to the present embodiment will be described. The text generation apparatus according to the present embodiment has various parameters relating to the reliability of the recognized character string and the work conditions of the transcription work (transcription accuracy or work amount required for the transcription) for each speaker or speech section. Based on the above, it is different from the above embodiment in that a recognized character string recognized from speech is selected and a transcript is generated.

  In the following, the functional configuration and operation of the text generating apparatus according to the present embodiment will be described. In the following description, items different from the above embodiment will be described, the same items will be denoted by the same reference numerals, and description thereof will be omitted.

"Constitution"
FIG. 22 is a diagram illustrating a functional configuration example of the text generation device 100 according to the present embodiment. As illustrated in FIG. 22, the text generation device 100 according to the present embodiment further includes an utterance section information generation unit 31, an utterance section information holding unit 32, and the like, in addition to the functional configuration of the first embodiment.

  The utterance section information generation unit 31 utters an utterance ID that identifies each utterance, a utterance start time (hereinafter referred to as an “utterance start time”), and an utterance that is uttered, with respect to the voice acquired by the acquisition unit 11. Utterance section information including a speaker ID for identifying a person is generated, and the generated utterance section information is stored in the utterance section information holding unit 32. Note that the utterance section information holding unit 32 corresponds to, for example, a predetermined storage area of a storage device included in the text generation device 100. Further, the selection unit 13 and the search unit 16 use the utterance section information stored in the utterance section information holding unit 32.

Below, the basic process at the time of the text generation performed with the text generation apparatus 100 which concerns on this embodiment is demonstrated.
"processing"
FIG. 23 is a flowchart showing an example of basic processing at the time of text generation according to the present embodiment. As illustrated in FIG. 23, the acquisition unit 11 acquires a voice (step S1001). Next, the recognition unit 12 recognizes the voice acquired by the acquisition unit 11, and calculates the recognition character string and the reliability of the recognition character string for each recognition unit (step S1002). As a result, the recognition character string and the reliability of the recognition character string are stored in the recognition result holding unit 18.

  Next, the utterance section information generation unit 31 generates utterance section information including the utterance ID, the utterance start time, and the utterer ID for each utterance with respect to the voice acquired by the acquisition unit 11 (step S1003). As a result, the utterance section information is stored in the utterance section information holding unit 32.

  Next, the selection unit 13 recognizes various parameters (working condition parameters) related to the work conditions of the transcription work for each utterer or each utterance section based on the utterance section information stored in the utterance section information holding unit 32. Based on the reliability of the recognized character string stored in the result holding unit 18, at least one recognized character string to be used for the transcript is selected (step S1004). At this time, the selection unit 13 selects a parameter relating to the transcription accuracy and the reliability of the recognized character string, or a combination of any parameter and reliability of the parameter relating to the work amount required for the transcription and the reliability of the recognized character string. Based on this, the recognition character string used for the transcript is selected. Next, the generating unit 14 generates a transcript using the recognized character string selected by the selecting unit 13 and the recognized character string not selected by the selecting unit 13 (step S1005).

  Next, the setting unit 15 sets the character insertion position by the worker U according to the setting received from the worker U for the transcript corresponding to the recognized character string not selected by the selection unit 13 (step S1006). ). Next, the search unit 16 searches for a voice position corresponding to the character insertion position set by the setting unit 15 based on the recognition result (step S1007).

  Next, the reproducing unit 17 reproduces sound from the sound position searched by the search unit 16 in accordance with the designation received from the worker U (step S1008). Thereafter, the text generating apparatus 100 accepts character input (addition / correction) from the worker U (step S1009).

  When the text generation device 100 according to the present embodiment receives a transcription end instruction from the worker U (step S1010: Yes), the process ends. On the other hand, the text generation device 100 repeats the processing from step S1007 to step S1009 until an instruction to finish transcription is given from the worker U (step S1010: No).

<Details>
From here, the details of the utterance section information generation unit 31 and the selection unit 13 will be mainly described.

<< Details of each function >>
(Speech section information generation unit 31)
The utterance section information generation unit 31 specifies the utterer and the utterance section by the following method, and generates the utterance section information. For example, the utterance section information generation unit 31 receives a specific result from the worker U who specified the utterer and the utterance start time of each utterance while listening to the voice, and generates utterance section information from the received specific result. Further, the utterance section information generation unit 31 may estimate the utterer and the utterance section using speaker recognition technology based on the acoustic feature amount, and may generate the utterance section information from the estimated result.

  FIG. 24 is a diagram illustrating a data example of the utterance section information D3 according to the present embodiment. FIG. 24 shows an example of data generated when the utterance section information generation unit 31 specifies (estimates) a plurality of speakers and each utterance section from the voice acquired by the acquisition unit 11. . Thus, the utterance section information generation unit 31 generates utterance section information D3 including, for example, an utterance ID, an utterance start time, and a speaker ID. The utterance section information generation unit 31 stores and stores the generated utterance section information D3 in the utterance section information holding unit 32.

(Selection unit 13)
Based on the utterance interval information D3 generated by the utterance interval information generation unit 31, the selection unit 13 sets the reliability of the recognized character string and various parameters relating to the work conditions of the transcription work for each utterer or utterance interval. Based on this, the recognition character string recognized from the voice is selected. More specifically, the selection unit 13 selects at least one recognition character string to be used for the transcription sentence based on the parameter related to the transcription accuracy and the reliability of the recognition character string for each utterer or utterance section. To do. The selection unit 13 selects at least one recognized character string to be used for the transcript based on a parameter related to the amount of work required for transcription and the reliability of the recognized character string for each utterer or utterance section. .

  Below, the process in which the selection part 13 selects a recognition character string is demonstrated. FIG. 25 is a flowchart illustrating a processing example when selecting a recognized character string according to the present embodiment. FIG. 25 shows an example of processing when the selection unit 13 uses an allowable value of transcription accuracy as a parameter related to transcription accuracy for each speaker.

  As shown in FIG. 25, the selection unit 13 first sets an allowable value P (i) (i = 1 to M; M is the number of speakers) of the transcription accuracy for each speaker i from the worker U. Accept (step S1101).

  FIG. 26 is a diagram showing a setting example of the transcription accuracy allowable value P (i) according to the present embodiment. As shown in FIG. 26, the worker U, for example, for each speaker through a slide-type UI (slide bar) that can designate one allowable stage among N stages (N = 5 in the figure). An allowable value P (i) of transcription accuracy is set. As described above, the selection unit 13 displays the UI on the screen and receives a setting from the worker U.

  Returning to the description of FIG. Next, the selection unit 13 sets the first recognized character string as the target character string w among the recognition results obtained by the recognition unit 12 (recognition results stored in the recognition result holding unit 18) (step S1102). From the reliability of the column w, the transcription accuracy wp of the target character string w is calculated (step S1103). At this time, for example, the selection unit 13 calculates the transcription accuracy wp of the target character string w according to (Expression 1) described in the first embodiment.

  Next, the selection unit 13 specifies the speaker wi of the target character string w based on the speech segment information D3 stored in the speech segment information holding unit 32 (step S1104). At this time, for example, in the utterance section information D3, the selection unit 13 selects the utterance section n in which the start time of the recognized character string exists between the start time of the utterance section n and the start time of the next utterance section n + 1. The speaker wi is extracted from the speaker ID of the utterance section n.

  Next, the selection unit 13 compares the calculated transcription accuracy wp of the target character string w with the identified transcription accuracy allowable value P (wi) of the speaker wi, and the transcription accuracy wp is the allowable value P ( wi) It is determined whether or not it is greater than or equal to (step S1105). As a result, when determining that the transcription accuracy wp is equal to or greater than the allowable value P (wi) (step S1105: Yes), the selection unit 13 selects the target character string w (step S1106). On the other hand, when determining that the transcription accuracy wp is less than the allowable value P (wi) (step S1105: No), the selection unit 13 does not select the target character string w.

  Next, the selection unit 13 determines whether or not there is a next recognized character string in the recognition result obtained by the recognition unit 12 (step S1107). As a result, when the selection unit 13 determines that there is the next recognized character string (step S1107: Yes), the next recognized character string is set as the target character string w (step S1108), and the processing from step S1103 to step S1107 is performed. repeat. On the other hand, if the selection unit 13 determines that there is no next recognized character string (step S1107: No), the process ends.

  Note that, as described above, the selection unit 13 may select a recognized character string using a parameter related to the transcription work amount for each speaker. Further, the selection unit 13 may select the recognized character string using either a parameter related to transcription accuracy for each utterance section or a parameter related to the transcription work amount.

<Summary>
As described above, according to the text generating apparatus 100 according to the present embodiment, for each speaker or each utterance section, various parameters relating to the work conditions of the transcription work specified by the worker U (the transcription accuracy, and Based on at least one parameter of the work amount required for transcription) and the reliability of the recognized character string, a recognized character string recognized from speech is selected, and a transcript is generated.

  As a result, the text generating apparatus 100 according to the present embodiment can easily add or modify characters as in the first embodiment, and can reduce the burden of the transcription work on the worker U.

<Device>
FIG. 27 is a diagram illustrating a configuration example of the text generation device 100 according to the embodiment. As shown in FIG. 27, the text generation device 100 according to the embodiment includes a CPU (Central Processing Unit) 101, a main storage device 102, and the like. The text generation device 100 includes an auxiliary storage device 103, a communication IF (interface) 104, an external IF 105, a drive device 107, and the like. In the text generating apparatus 100, devices are connected to each other via a bus B. Thus, the text generation device 100 according to the embodiment corresponds to a general information processing device.

  The CPU 101 is an arithmetic device for realizing control of the entire apparatus and mounting functions. The main storage device 102 is a storage device (memory) that holds programs, data, and the like in a predetermined storage area. The main storage device 102 is, for example, a ROM (Read Only Memory) or a RAM (Random Access Memory). The auxiliary storage device 103 is a storage device having a storage area with a larger capacity than the main storage device 102. The auxiliary storage device 103 is a non-volatile storage device such as an HDD (Hard Disk Drive) or a memory card (Memory Card). Therefore, for example, the CPU 101 reads out programs and data from the auxiliary storage device 103 to the main storage device 102 and executes processing, thereby realizing control and mounting functions of the entire device.

  The communication IF 104 is an interface that connects the apparatus to the data transmission path N. Thereby, the text generation device 100 can perform data communication with other external devices (other information processing devices) connected via the data transmission path N. The external IF 105 is an interface for transmitting and receiving data between the device and the external device 106. The external device 106 includes, for example, a display device (for example, “liquid crystal display”) that displays various types of information such as processing results, an input device (for example, “ten-key”, “keyboard”, or “touch panel”) that receives operation inputs. is there. The drive device 107 is a control device that writes or reads the storage medium 108. The storage medium 108 is, for example, a flexible disk (FD), a CD (Compact Disk), a DVD (Digital Versatile Disk), or the like.

  In addition, the text generation function according to the above-described embodiment is realized by, for example, executing the program in the text generation apparatus 100 so that the respective functional units perform a cooperative operation. In this case, the program is recorded and provided in a file that can be installed or executed in a storage medium that can be read by a device (computer) in the execution environment. For example, in the case of the text generation device 100, the program has a module configuration including the above-described functional units, and the CPU 101 reads out and executes the program from the storage medium 108, whereby each program is stored in the RAM of the main storage device 102. A functional part is generated. Note that the program providing method is not limited to this. For example, the program may be stored in an external device connected to the Internet and downloaded via the data transmission path N. Alternatively, a method may be provided that is incorporated in advance in the ROM of the main storage device 102 or the HDD of the auxiliary storage device 103. In addition, although the example which implement | achieves a text generation function by software implementation was demonstrated here, it is not this limitation. For example, some or all of the functional units included in the text generation function may be realized by hardware implementation.

  In the above embodiment, the text generation device 100 includes the acquisition unit 11, the recognition unit 12, the selection unit 13, the generation unit 14, the setting unit 15, the search unit 16, the reproduction unit 17, the recognition result holding unit 18, and the combining unit 21. The configuration including a part or all of the recognition combination result holding unit 22, the utterance section information generation unit 31, or the utterance section information holding unit 32 has been described. For example, the text generation device 100 is connected to an external device having a part of the functions of these functional units via the communication IF 104, and performs data communication with the connected external device, so that each functional unit operates in cooperation. However, it may be configured to provide the text generation function. Thereby, the text generation device 100 according to the present embodiment can be applied to a cloud environment or the like.

  Finally, although several embodiments of the present invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 11 Acquisition part 12 Recognition part 13 Selection part 14 Generation part 15 Setting part 16 Search part 17 Playback part 18 Recognizing result holding | maintenance part 21 Combining part 22 Recognition combining result holding part 31 Utterance area information generating part 32 Utterance area information holding part 100 Text generation apparatus

Claims (19)

A recognition unit that recognizes the acquired speech and obtains a recognized character string for each recognition unit and a reliability of the recognized character string;
A selection unit that selects at least one of the recognized character strings to be used in a transcript based on a parameter of the amount of work required for transcription;
Using the selected recognized character string, a generation unit that generates the transcription sentence,
A text generator comprising: The selection unit includes:
Selecting the recognized character string based on a combination of a parameter of the amount of work required for the transcription and the reliability of the recognized character string;
The text generation device according to claim 1. The selection unit includes:
The accumulated work amount accumulated based on the reliability of the recognized character string is compared with the allowable value of the parameter, and the recognized character string is selected when the accumulated work amount is equal to or less than the allowable value. ,
The text generation device according to claim 1. The selection unit includes:
Using the transcription work time as a parameter of the work amount required for the transcription,
Calculate the transcription work time based on the number of characters in the recognized character string,
The text generation device according to claim 3. The recognition unit
Further obtaining the start time and end time of the recognition character string,
The selection unit includes:
Using the transcription work time as a parameter of the work amount required for the transcription,
Based on the start time and end time of the recognized character string, calculate the transcription work time,
The text generation device according to claim 3. The selection unit includes:
The transcription work cost is used as a parameter of the work amount required for the transcription,
Based on the number of characters of the recognized character string, to calculate the transcription work time, to calculate the transcription work cost based on the calculated transcription work time and the work cost per unit time,
The text generation device according to claim 3. The recognition unit
Further obtaining the start time and end time of the recognition character string,
The selection unit includes:
The transcription work cost is used as a parameter of the work amount required for the transcription,
Based on the start time and end time of the recognized character string, calculate a transcription work time, and calculate the transcription work cost based on the calculated transcription work time and a work cost per unit time.
The text generation device according to claim 3. The generator is
A state in which an operator can select the recognized character string up to the Nth candidate (N is an integer of 1 or more) with high reliability of the recognized character string among the recognized character strings not selected by the selection unit. Generate the transcript displayed in
The text generation device according to claim 1. A setting unit that sets a character insertion position corresponding to a start position of character input by an operator at the position of the transcript corresponding to the recognized character string not selected by the selection unit;
The setting unit
In the detected current character insertion position, in the transcript, a selection element corresponding to the recognized character string selected by the selection unit and a non-corresponding to the recognition character string not selected by the selection unit Based on the positional relationship with the selection element, the character insertion position is set.
The text generation device according to claim 1. The setting unit
A determination is made as to whether or not the detected current character insertion position is within the selection element, and when the character insertion position is within the selection element, a position behind the character insertion position and closest to the character insertion position Detecting the non-selected element, and moving the character insertion position to the head position of the detected non-selected element,
The text generation device according to claim 9. The setting unit
It is determined whether or not the detected current character insertion position is within the selection element, and if the character insertion position is not within the selection element, the position closest to the character insertion position is behind the character insertion position. Detecting the selected element, detecting the non-selected element at a position closest to the selected element behind the detected selected element, and moving the character insertion position to the detected first position of the non-selected element;
The text generation device according to claim 9. In the character insertion position set by the setting unit, when character input by an operator is started, a search unit that searches for a voice position corresponding to the input character;
A reproduction unit that reproduces the audio from the audio position searched by the search unit;
The search unit
The current character insertion position detected by the setting unit, the selection element corresponding to the recognition character string selected by the selection unit in the transcript, and the recognition character not selected by the selection unit Searching for the voice position based on the positional relationship with the non-selected elements corresponding to the columns;
The text generation device according to claim 9. The search unit
It is determined whether or not the detected current character insertion position is within the selection element, and when the character insertion position is within the selection element, the start time of the recognized character string corresponding to the selection element is The voice position,
The text generation device according to claim 12. The recognizing character string obtained by the recognizing unit is combined with a sentence unit or a predetermined time unit, and further includes a combining unit that obtains reliability of the combined recognized character string and the combined recognized character string. ,
The selection unit includes:
Selecting the recognized character string combined with the sentence unit or the time unit;
The text generation device according to claim 1. The selection unit includes:
Based on the parameter of the amount of work required for the transcription and the reliability of the combined recognized character string, the recognized character string combined with the sentence unit or the time unit is selected.
The text generation device according to claim 14. A generator for generating utterance section information including information identifying each utterance, utterance start time of each utterance, and information identifying a utterer of each utterance for the voice,
The selection unit includes:
The recognition character string is selected for each of the utterers or the utterances.
The text generation device according to claim 1. The selection unit includes:
For each of the utterers or the utterances, the recognition character string is selected based on the parameter of the amount of work required for the transcription and the reliability of the recognition character string.
The text generation device according to claim 16. A recognition step of recognizing the acquired speech and obtaining a recognition character string for each recognition unit and the reliability of the recognition character string;
A selection step of selecting at least one of the recognized character strings to be used in a transcript based on a parameter of the amount of work required for transcription;
Using the selected recognized character string to generate the transcript sentence;
Text generation method including Computer
Means for recognizing the acquired speech and obtaining a recognized character string for each recognition unit and the reliability of the recognized character string;
Means for selecting at least one recognized character string to be used in a transcript based on a parameter of the amount of work required for transcription;
Means for generating the transcript using the selected recognized character string;
Text generator to function as

Images