JP2001042996A - Device and method for document preparation - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability in document preparation by performing key input and voice input in arbitrary timing respectively and effectively using them. SOLUTION: Reading characters inputted by operating an input device 14 (keyboard) are converted by a conversion part 40 to input the character string and a voice inputted from a voice input device 20 is recognized by a voice recognition part 36 to input the character string; while input discrimination information showing which of a voice and a character string is inputted is added, the character string is stored in an input buffer 44 in time series. The character string stored in the input buffer 44 is displayed at a display device 16 by a display part 50.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a document preparation apparatus and a document preparation method for inputting characters.

[0002]

2. Description of the Related Art Generally, in a document preparation apparatus such as a computer for inputting characters, input means such as a keyboard, a tablet and a mouse are used for inputting characters. In particular, keyboards are often used. However,
Character input using a keyboard is not perfect in terms of operability, and there is still room for improvement.

[0003]

For example, in order to improve the efficiency of character input, there is a document creation apparatus equipped with a function of inputting characters by voice input using a voice recognition function. Even if both input and keyboard input are possible, character input is performed by selecting one of them, and the advantage of using two input methods has not been effectively utilized.

In a normal keyboard, a plurality of characters are assigned to one key, and which of a plurality of characters is input is switched by a shift switching operation.
Since the number of characters assigned to the key differs depending on the key (2 to 4 characters), there is a key to which no corresponding character is assigned depending on a certain shift state. When an operation is performed on a key to which a corresponding character is not assigned in the current shift state, an input is not accepted, and the operation is totally wasted.

Further, in the conventional document creation apparatus, the input can be performed by arbitrarily switching between hiragana input and Roman character input. However, the key operation differs depending on the input mode. In the Roman character input, a plurality of keys are operated. , One character or a plurality of characters input by the hiragana input. Therefore, when performing Roman character input, a character string in an undetermined state in which a plurality of key operations are performed, a confirmed read character string to be converted,
The character string mixed with kanji or kana, which has been converted to the read character string, is mixed and displayed in the same row (line), making it difficult to see.

Further, in a normal keyboard, a plurality of characters are assigned to one key, and which of a plurality of characters is input is switched by a shift switching operation, so that the current shift state is always determined. I had to figure out. However, even if there is a display indicating the shift state, it is only fixedly displayed at a predetermined position on the display screen, so during normal document creation, since the character string currently being input is viewed, The user has to move his or her line of sight to the display indicating the shift state, which places a burden on the user.

The present invention has been made in view of the above circumstances, and has as its object to provide a document creation apparatus and a document creation method capable of improving operability.

[0008]

According to the present invention, there is provided a keyboard input means for executing a conversion process on a character read by an operation on a keyboard and inputting a character string;
Voice input means for recognizing the input voice and inputting a character string; a character string input by the keyboard input means; and a character string input by the voice input means, using a character string input by a keyboard. Input buffer means for storing in chronological order while adding input identification information indicating whether there is a character string or a character string input by voice, and display means for displaying the character string stored by the input buffer means And characterized in that:

Thus, a character can be input by performing key input and voice input at arbitrary timings.

The present invention also provides a voice input means for recognizing an input voice and inputting a character string, and identifies a speaker who has performed a voice input corresponding to the character string input by the voice input means. The apparatus further comprises speaker identification means, and display means for displaying a character string input by the voice input means in a different form for each speaker identified by the speaker identification means.

[0011] Thus, a conversation (such as a conference) by a plurality of people can be input by voice, and characters can be input so that the content spoken by each speaker can be identified.

According to the present invention, there is provided a keyboard input means for executing a conversion process on a reading character input by operating a keyboard to input a character string, and a voice for recognizing the input voice and inputting the character string. Input means, a comparing means for comparing a character string input by the keyboard input means and a character string input by the voice input means to determine whether or not both are similar; and Are determined to be similar to each other, based on the character string input by the voice input means, an input content correcting means for correcting the character string input by the keyboard input means, and the keyboard input means Display means for displaying a character string input by the user or a character string corrected by the input content correcting means. That.

According to the present invention, there is also provided a keyboard input means for executing a conversion process on a reading character input by an operation on a keyboard to input a character string as a plurality of input candidates, and inputting input voice. Voice input means, input field determination means for determining the input field of the content represented by the voice based on the voice input by the voice input means, and a plurality of input candidates input by the keyboard input means An output order changing means for changing the output priority of a column based on the input field determined by the input field determining means, and an input by the keyboard input means according to the output priority changed by the output order changing means. Display means for displaying the set character string.

Thus, the field of the utterance content of the voice input separately from the keyboard input is determined,
Output priorities are changed for a plurality of input candidates input by keyboard input based on this field.

According to the present invention, there is provided a keyboard operated to input characters and input instructions for executing various functions, and a usage frequency counting means for counting the usage frequency for each function instructed to be executed by operating the keyboard. When there is a function whose use frequency counted by the use frequency counting means exceeds a predetermined number, a key assignment means for assigning this function to a specific key provided on the keyboard, and a function assigned by the assignment means. And control means for executing a function corresponding to the specific key when a specific key to which the is assigned is operated.

If the frequency of use of a certain function exceeds a predetermined value, the function is automatically assigned to a specific key on the keyboard. Thereafter, the function assigned by operating the specific key is activated. Can be done.

According to the present invention, there is provided a keyboard operated for inputting a character and an instruction to execute various functions, and a character string arbitrarily designated with respect to the character string input by operating the keyboard. Temporary storage means for temporarily storing the character string, character string assignment means for assigning a character string stored by the temporary storage means to a specific key provided on the keyboard, and a character string assigned by the character string assignment means. And input means for inputting a character string stored in the temporary storage means corresponding to the specific key when one of the keys is operated.

Thus, when a range is specified (copy, cut and paste, word / phrase registration, etc.) for the input character string, the specified character string is automatically assigned to a specific key on the keyboard. Thereafter, a character string assigned by operating the specific key can be input.

Further, according to the present invention, there are provided a plurality of keys to which two or more characters each assigned to a specific shift state are assigned, and a plurality of keys to which different numbers of characters are assigned are mixed. A keyboard; basic shift setting means for setting a basic shift to be referred to when a key to which a character associated with a specific shift state is not assigned is operated; First key input means for inputting a character associated with the current shift state assigned to this key, and a current shift state assigned to this key in response to an operation on one key of the keyboard. If there is no associated character, enter a character corresponding to the shift state of the basic shift set by the basic shift setting means. And characterized by including a second key input unit that.

Accordingly, when a key to which a character associated with the current shift state is not assigned is operated, the character is handled in the same manner as the operation in the preset basic shift, and the character is handled. The operation is not wasted because it is input.

Further, according to the present invention, there are provided a plurality of keys to which two or more characters each associated with a specific shift state are assigned, and a plurality of keys to which different numbers of characters are assigned are mixed. A keyboard, key input means for inputting a character associated with a current shift state assigned to the key in response to an operation on one key of the keyboard, and displaying a character input by the key input means Character display means, and a shift state display means for displaying the changed shift state in the vicinity of the character displayed by the character display means when an instruction to change the shift state is input. And

Thus, the shifted state after the change is displayed near the character string currently being input, so that it is not necessary to largely move the line of sight to confirm the shifted state, and the burden on the user is reduced. It is reduced.

According to the present invention, there is provided a keyboard provided with a plurality of keys, input means for outputting an undetermined character to be converted by operating the plurality of keys on the keyboard, and input by the input means. A conversion unit that converts a character into a different character, a first display unit that displays the character converted by the conversion unit, and a character input by the input unit is converted by the conversion unit. Up to this point, there is provided a second display means for displaying in the vicinity of the same character different from the arrangement of the characters displayed by the first display means.

With this, the undetermined character to be converted, which is input by operating a plurality of keys, is displayed at a position different from the sequence in which the converted characters are displayed, so that it can be easily distinguished from other characters. it can.

[0025]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the system configuration of the document creation device according to the present embodiment.
The document creation device according to the present embodiment is, for example, a CD-RO
It is realized by a computer which reads a program recorded on a recording medium such as an M, DVD, or magnetic disk, and whose operation is controlled by the program.

As shown in FIG. 1, a document creation device according to the present embodiment includes a CPU 10, a memory 12, an input device 1
4, display device 16, storage device 18, and voice input device 2
0.

The CPU 10 controls the entire apparatus, and realizes various functions by executing based on programs and data stored in the memory 12. In the present embodiment, by executing a control program stored in the memory 12, a kana-kanji conversion process for a reading character string input by a Roman character input or a hiragana input,
Various processes, such as a voice recognition process for the input voice, a kana-kanji conversion, and an editing process for the character string input by the voice recognition process, are executed.

The memory 12 is a read-only or readable / writable memory device by the CPU 10 or the like, and stores programs and data. In the memory 12, areas such as a control program area 12a, a document storage area 12b, a dictionary storage area 12c, an input buffer area 12d, a control data storage area 12e, and a temporary buffer area 12f are secured as necessary.

A control program area 12a provided in the memory 12 stores various programs such as a control program (operating system) and a document creation control program. It is assumed that the document creation control program includes various programs for realizing kana-kanji conversion processing, voice recognition processing, editing processing, and the like.

The document storage area 12b stores character string data including input candidates input by kana-kanji conversion processing and voice recognition processing, character string data determined from a plurality of input candidates, and the like.

The dictionary storage area 12c stores dictionary data used for kana-kanji conversion processing or voice recognition processing.

In the input buffer area 12d, the input device 1
4 is temporarily stored.
The character data stored in the input buffer area 12d is converted into a Roman character input character string (an undetermined character to be converted by inputting a plurality of keys) and further, a Kana-Kanji conversion process is performed. Is done.

The control data storage area 12e stores various setting data referred to in various processing.
Data indicating a display output form, an input mode, and the like are stored.

The temporary buffer area 12f is for storing a character string in an arbitrarily designated range with respect to the input character string.
When an operation such as cut-and-paste or word / phrase registration is performed, data of a character string designated as the target is temporarily stored.

Various information is stored in the memory 12 as necessary according to the execution status of the program.
, Or data input from the input device 14, and the like.

The input device 14 is a device for inputting data to be processed, instructions for the device, and the like. For example, a keyboard is mainly used when creating a document. Character keys for inputting character data, conversion keys for instructing execution of Kana-Kanji conversion for input character strings, up / down / left / right cursor keys for inputting various selection direction instructions, and selection keys for confirming various selections , A shift key for setting the shift state of the input mode, and function keys to which various functions are assigned. The character key is assigned two or more characters, for example, any number of two to four characters, each of which is associated with a specific shift state, and these different numbers of characters are assigned. Multiple keys are mixed.

The display device 16 displays input data and output results, and includes a liquid crystal display, a CRT, and the like, and a controller.

The storage device 18 is a device for storing various data and programs. Note that the storage device 18 can read a program (a document creation control program or the like) recorded on a recording medium such as a hard disk, a CD-ROM, a DVD, or a floppy disk, and can be executed by the document creation device. The storage device 18 stores various dictionaries (character string dictionaries) used in kana-kanji conversion processing, voice recognition processing, and the like, processing data, and the like.

The voice input device 20 is used for inputting voice in various processes, and has a microphone.

The clock 21 generates data of the date and time and is referred to as needed.

Next, a document creation apparatus according to the first embodiment of the present invention will be described. In the first embodiment, the input device 14
A document can be efficiently created by performing not only character input (key input) by operation on (keyboard) but also voice input from the voice input device 20.

FIG. 2 is a block diagram showing a functional configuration of the document creating apparatus according to the first embodiment. Each function is a CP
U10 is realized by executing a program stored in the control program area 12a. As shown in FIG. 2, the document creation device according to the first embodiment includes an input control unit 30, a key input unit 32, a voice input unit 34, a voice recognition unit 36, a voice recognition dictionary 38, a conversion unit 40, and a dictionary unit 42. , An input buffer unit 44, a document storage unit 46, an editing unit 48, a display unit 50, a control data unit 54, a setting unit 56, an input content correcting unit 58, and an input field discriminating unit 59.

The input control unit 30 includes a key input for inputting a character string by operating the input device 14 (keyboard) in the document creation device, and a voice input device 20 (microphone).
It controls the input of voice input for inputting a character string by voice input from a user.

The key input section 32 is for inputting data input by operating the input device 14 (keyboard), and transfers the input key data to the input control section 30. Among the key data passed by the key input unit 32, control data is notified to the editing unit 48 and the like, and character data is notified to the conversion unit 40.

The voice input unit 34 converts voice input from the voice input device 20 (microphone) into voice data, and converts the voice data into the voice recognition unit 36 or the speaker identification unit 39.
Hand over to When there are a plurality of voice input devices 20, the voice data is transferred in such a manner that voice data input from each of the voice input devices 20 can be identified.

The voice recognition unit 36 performs voice recognition processing on voice data input from the voice input unit 34, and performs a plurality of voice recognition processes while referring to dictionary data registered in the voice recognition dictionary 38. A candidate (character string) is obtained and passed to the input control unit 30. At this time, the voice recognition unit 36 adds input identification information indicating that the voice recognition candidate is a candidate obtained by voice input.

The voice recognition dictionary 38 is referred to by the voice recognition unit 36, and is used for voice recognition processing on voice data input from the voice input unit 34.

The conversion unit 40 executes a conversion process on key data input from the key input unit 32 via the input control unit 30. When inputting in the Roman character input mode, a plurality of keys are used. The unconverted character string to be converted, which is input by the above operation, is converted into one or more characters (reading character string), and the input reading character string (Roman character input mode, Hiragana input mode) The kana-kanji conversion process is performed for the kana-kanji. In the kana-kanji conversion process,
A plurality of conversion candidates (character strings) are obtained with reference to the dictionary data registered in the dictionary unit 42 and transferred to the input control unit 30. At this time, the conversion unit 40 adds input identification information indicating that the conversion candidate is an input candidate obtained by key input. Further, when the input field is instructed from the input field discriminating section 59, the conversion section 40 changes the output priorities of the plurality of conversion candidates obtained by the conversion process according to the input field, and sends the output priority to the input buffer section 44 Remember.

The dictionary unit 42 is referred to by the conversion unit 40, and is used for a kana-kanji conversion process on the character string read from the key input unit 32.

The input buffer section 44 temporarily stores input candidates (conversion candidates and speech recognition candidates) obtained by the conversion processing by the conversion section 40 and the speech recognition processing by the speech recognition section 36. While adding the added input identification information, the conversion candidates and the speech recognition candidates are mixed and stored in chronological order in the order of input.

The document storage unit 46 stores a character string determined as an input character string from the conversion candidates stored in the input buffer unit 44.

The editing unit 48 controls the input buffer unit 4 based on the control key data obtained through the input control unit 30.
The editing process is performed on the input candidate stored in the input candidate 4 or on the confirmed character string stored in the document storage unit 46. The process of selecting a confirmed character string from a plurality of candidates included in the input candidate, It includes functions such as copy, cut and paste, and word / phrase registration for character strings.

The display unit 50 displays characters corresponding to the character data input from the key input unit 32 and the input buffer unit 44.
Character strings of input candidates stored in the document storage unit 4
The determined character string and the like stored in
Is displayed at a predetermined position on the display screen. Display unit 50
Controls the display of character strings in a form corresponding to the control data relating to the display set in the control data unit 54 when displaying various character strings. The display unit 50
A setting screen for setting various control data by the setting unit 56 is displayed.

The control data section 54 stores various control data set by the setting processing by the setting section 56, and sets control data indicating a display mode of a character string on the display section 50, a voice input mode, and the like. You. Details will be described later.

The setting section 56 sets various control data and stores the control data in the control data section 54.
At 0, a setting screen is displayed, and control data is set on the setting screen based on key data input by operating the input device 14.

The input content correcting section 58 is provided in the input buffer section 4.
Input contents for correcting a key-input character string based on a voice-input character string when the key-input conversion candidate stored in step 4 is similar to the voice-input speech recognition candidate Execute the correction process.

The input field discriminating section 59 includes the input buffer section 4
The input field represented by the input voice is determined based on the voice recognition candidates input by voice stored in
Notify 0.

Next, the operation of the document creation device according to the first embodiment will be described. First, a description will be given of a character input method of the document creation device according to the first embodiment.
The document creation device according to the first embodiment can input a character string by mixing key input and voice input.

FIG. 3 is a diagram for explaining a mechanism for mixing key input and voice input. When character data is input from the key input unit 32 by operating the input device 14, the conversion unit 40 performs kana-kanji conversion on the input character data with reference to the dictionary unit 42. The input control unit 30 stores a plurality of conversion candidates obtained by the conversion processing by the conversion unit 40 in the input buffer unit 44 as input candidates. At this time, input identification information indicating that a key input has been made is added to the input candidate.

On the other hand, the voice input from the voice input device 20 irrespective of the key input is converted into voice data by the voice input unit 34 and subjected to voice recognition processing by the voice recognition unit 36. The speech recognition candidates obtained by the speech recognition processing are stored in the input buffer unit 44 by the input control unit 30 in the same manner as the candidates obtained by key input.
At this time, input identification information indicating that voice input has been performed is added.

Accordingly, input candidates obtained by key input and voice input are stored in the input buffer unit 44 in chronological order in a mixed order.

The display unit 50 displays the character string as the first output candidate of each input candidate stored in the input buffer unit 44,
The data is sequentially read out in the stored order and displayed on the display device 16.

As described above, a character string can be input by mixing key input and voice input, so that a user can create a document while arbitrarily selecting and using a desired input method. Therefore, a character string portion suitable for key input and a character string portion suitable for voice input can be selectively used without performing a special operation for switching the input method. For example, a conversation such as during a meeting can be converted into characters by voice input and stored, and a key input can be performed for a secret comment that is otherwise known.

Next, a description will be given of a display form of a character string input by mixing key input and voice input. As described above, since the character string input by the key input and the voice input is stored in the input buffer unit 44 in chronological order, when both are displayed and output in the same form, the displayed character string is input by the key. It becomes impossible to determine whether it is a character string part or a character string part input by voice. Therefore, characters input by keys and characters input by voice are displayed and output in different forms.

For this purpose, the display output form is set in advance for each of the character string input by key and the character string input by voice. FIG. 4A shows an example of the output mode setting screen. When a request for output mode setting is instructed by an operation on the input device 14, the setting unit 56 causes the display unit 50 to display an output mode setting screen as shown in FIG. On the output mode setting screen, display attributes for each of the key input and the voice input can be arbitrarily specified. Examples of display attributes include color, font, character size, presence / absence of inversion, presence / absence of blink, and the like. As for the color, an arbitrary color can be designated for each of the key input and the voice input. In the output mode setting screen, it is possible to arbitrarily select whether or not “line display” is provided, in which a line for displaying a character string input by a key and a line for displaying a character string input by voice are displayed separately. it can. Setting unit 56
Causes the control data unit 54 to store the display attribute set by the instruction on the output form setting screen as control data of the output form.

The display section 50 displays and outputs the input candidates stored in the input buffer section 44 in accordance with the flowchart of FIG. 5 while referring to the control data stored in the control data section 54. That is, when a character string input by key input or voice input is stored in the input buffer unit 44 (step A1), the display unit 50 displays the input character string (input candidate).
Is extracted (step A2), and based on the input identification information added to this input candidate, it is determined whether the input candidate is a character string input by a key or a character string input by voice ( Step A4).

As a result, if it is a character string input by voice, the display unit 50 displays and outputs in the output mode indicated by the control data set for the voice input on the output mode setting screen (step A6). On the other hand, if the character string is a key input, the display unit 50 displays the character string in the output mode indicated by the control data set for the key input using the output mode setting screen (step A5).

Similarly, the display section 50 displays and outputs each of the input candidates stored in the input buffer section 44 (step A7).

In this way, even when character strings input by key input and voice input are mixed, both can be displayed and output in a form that can be identified.

FIG. 6 shows a display example of input candidates displayed in a line-by-line manner by setting "display by line" on the output form setting screen. In the example shown in FIG. 6A, after “Today is input” by voice input,
In this example, "one day" is input by key input, "very good" is input by voice, and then a character string of "weather was sent" is input by key input.

As described above, since the characters are displayed on different lines according to the respective inputs, it is possible to easily identify which character string is a character string input by key input or voice input.

In the example shown in FIG. 6B, an example in which "Today was a transcript which could be one day" was input by key input. In addition, an example is shown in which character strings of “Kyowa”, “Very”, and “Weather” are input at arbitrary timings by voice input in parallel with the key input. The input candidates shown in FIG. 6B include erroneous input and erroneously converted character strings.

Next, a description will be given of an editing process for creating a document by removing a character string erroneously input or erroneously converted from a character string displayed as a line as shown in FIG. 6B. I do.

For example, when a selection execution process is instructed from the input device 14, the editing unit 48 selects or deletes each input candidate stored in the input buffer unit 44 in order from the top, or selects the next candidate. It is executed in response to an operation on the input device 14.

The input buffer 44 stores the input candidates (first output candidates) in the order shown in FIG. 7A for the character strings shown in FIG. 6B. I do.

First, "Today is" is set as a character string to be selected and executed as shown in FIG. 7 (b1). When the selection is instructed here, the editing unit 48
As shown in (b2), the character string of “Today is” is determined, and the next voice-input character string “Kyowa” is displayed as the next selection target.

Here, when deletion is instructed, FIG.
As shown in 3), the character string "key" entered next
Is displayed as a selection target. In addition, the string "one day"
Is instructed to select, as shown in FIG. 7 (b4), the next key-inputted character string "very much" is displayed as a selection target.

In this manner, the input candidates stored in the input buffer unit 44 can be sequentially determined from the beginning only by the selection or deletion instruction, so that the key input and the voice input are easily mixed. A document can be created by arbitrarily selecting a character string and excluding a character string that has been erroneously input or incorrectly converted.

For simplicity, only the case where there is an instruction for selection or deletion is shown. However, for each character string of an input candidate, an instruction for displaying the next candidate is given to the input buffer unit. It is also possible to sequentially display and select the second and subsequent output candidates stored in 44.

It is also possible to select one of a key-input character string and a voice-input character string at once.
In this case, all of the selected input candidates (the respective first output candidates) are determined and stored in the document storage unit 46. According to this operation, it is not necessary to give a selection or deletion instruction to each of the plurality of input candidates, so that the operation can be extremely simplified.

Next, a case where there are a plurality of speakers will be described. In the above description, since there is only one speaker, the key input and the voice input can be distinguished from each other so that they can be distinguished from each other. The display mode can be arbitrarily set so that a character string inputted by the user can be identified.

FIG. 8 shows an example of the output mode setting screen for each speaker. When the request for the speaker-specific output mode setting is instructed by operating the input device 14, the setting unit 56 causes the display unit 50 to display a speaker-specific output mode setting screen shown in FIG. Can be arbitrarily specified in the same manner as in the case of the output form setting screen (FIG. 4A).

The voice input from the voice input device 20 is
The audio data is converted into audio data by the audio input unit 34. The speaker identification unit 39 identifies the speaker for each audio data, and the information for identifying the speaker for each audio data (speaker identification information). Is added.

As a method of identification by the speaker identification section 39, for example, there are the following methods (1), (2) and (3). (1) A voice input device 20 (microphone) is provided for each of a plurality of speakers. The speaker identification unit 39 includes the voice input device 2
Based on the intensity level of the voice input from 0, it is determined that the speaker corresponding to the microphone having the higher intensity level is speaking. The voice input unit 34 converts the voice input from the voice input device 20 corresponding to the speaker identified by the speaker identification unit 39 into voice data, adds speaker identification information, and Hand over.

(2) A specific key operation of the input device 14 indicates which speaker the voice input from the voice input device 20 is from. The speaker identification unit 39
The designation of the speaker by operating the input device 14 is performed by the key input unit 3.
2. Received through the input control unit 30, and receives this through the voice input unit 3.
Notify 4. The voice input unit 34 converts the voice input from the voice input device 20 into voice data in response to the notification from the speaker identification unit 39, adds speaker identification information, and transfers the voice data to the voice recognition unit 36. .

(3) In the speaker identification section 39, information on the sound quality of voice is registered for each of a plurality of speakers who may speak. The speaker identification unit 39 examines the sound quality input from the voice input device 20, and determines which one of a plurality of pre-registered speakers is speaking based on the sound quality. To the voice input unit 34. The voice input unit 34 converts the voice input from the voice input device 20 into voice data in response to the notification from the speaker identification unit 39, and adds the speaker identification information to the voice recognition unit 36.
Hand over to

As described above, with regard to the voice recognition candidate for the voice data to which the speaker identification information is added, the speaker identification information is added and stored in the input buffer unit 44 in the same manner as the input identification information described above. . The display unit 50 refers to the speaker identification information when displaying the speech recognition candidates stored in the input buffer unit 44, and outputs according to the control data set on the speaker-specific output mode setting screen (FIG. 8). Depending on the form, the display is output in a different form for each speaker.

FIG. 9 shows a plurality of speakers (1) (2) (3)
In this example, a character string input as the content of a comment is displayed. In the output mode setting screen for each speaker, the display color is "red" for the speaker (1), the display color is "blue" for the speaker (2), and the display color is "blue" for the speaker (3). It is assumed that the display color is set to “yellow” and the control data is stored in the control data section 54.

As shown in FIG. 9, a character string "Start a conference from now on ..." about the content of the utterance of the speaker (1) is displayed in red according to the control data. Similarly, the character string “Situation in district A ...” of the content of the remark made by speaker (2) is displayed in blue characters, and speaker (3)
Is displayed in yellow characters.

Thus, even when a character string is input based on the voices of a plurality of speakers, which of the speakers is the input character string input? Can be easily determined.

In the display example shown in FIG. 9, the voice recognition candidates for the input voice are displayed in the same display area position in the order of input, but the input character strings are classified by speaker. Display in different regions, it is possible to make it easier to understand which speaker's voice is input based on the input character string.

FIG. 10 shows an example of a display screen provided with a display area for each speaker. The display unit 50 displays a plurality of display areas for each speaker provided on the display screen based on the voice identification information added to each of the input candidates (voice recognition candidates) stored in the input buffer unit 44, That is, the input candidates are classified and displayed for the speaker (1), the speaker (2), and the speaker (3).

According to such a display form, when voices from a plurality of speakers are input, it is easy to determine from which speaker the input character string is input. Can be determined. Whether the normal display shown in FIG. 9 or the display in the speaker-specific area shown in FIG. 10 may be arbitrarily selected on the speaker-specific output mode setting screen. The display unit 50 displays the character string input by voice in one of the display modes of FIG. 9 or FIG. 10 according to this setting. In addition, even when a display area is provided for each speaker and displayed, the setting for each speaker set on the output form setting screen for each speaker, for example, a color, a font, a size, and the like are reflected. It is possible.

Next, a case where a plurality of speakers utter at arbitrary timings will be described. In the above description, it is basically assumed that a plurality of speakers utter alternately, but utterances of a plurality of speakers may overlap.

[0095] For example, as shown in FIG. 11 (a), while the speaker A is say "Hello (B) How are you (B)", the speaker B is "Akkon'nichiwa ( B)
(B). " Note that (B) in FIG. 11 (a) is a word delimiter (timing of breathing), and indicates a portion where the voice has not been input during each utterance.

The speaker identification section 39 identifies the voice input by the speaker A and the voice input by the speaker B. In addition, the voice input unit 34 includes the voice input device 20.
It monitors the time during which audio is not input for audio input from
This non-voice input time is divided for each continuous utterance as a word delimiter, and the voice data for each utterance is transferred to the voice recognition unit 36. The voice recognition unit 36 performs voice recognition processing on voice data for each utterance input corresponding to each speaker to obtain voice recognition candidates.

Since the voice recognition unit 36 performs voice recognition processing on each of the voice data separated by the voice non-input time, for example, the voice of the speaker A, “Are you fine? Even if the voice "I'm overwhelmed" is input repeatedly,
That is, the voice recognition processing is executed in the order of the voice of the speaker A and the voice of the speaker B, and the obtained voice recognition candidates are sequentially stored in the input buffer unit 44.

FIG. 11B shows an example of a screen on which the character strings input by the statements of the speakers A and B are displayed. Note that FIG. 11B is a display example in which line-by-line display is not performed. A character string input by the speaker A is underlined, and a character string input by the speaker B is indicated by a character frame. It shows an example in which each is added and displayed. As shown in FIG. 11B, messages separated by the unvoiced input time (B) are displayed as a group so that a character string input by each of the messages can be identified by a speaker.

In this way, for voices input simultaneously by a plurality of speakers, utterances are separated based on the voice non-input time, and a character string input for each group of utterances is output for each speaker. be able to. Therefore, even when a plurality of speakers perform voice input at the same time, it is possible to easily identify who spoke the character string input by the voice input.

[0100] In addition, since classification is performed for each speaker,
In the same manner as the editing process by the editing unit 48, it is possible to select only a character string representing a utterance of a specific speaker, or to create a character string in which the contents of a plurality of speakers are arbitrarily combined. Also, editing processing such as batch selection of a character string input by a specific speaker is possible. Also, as for the display form, the display form shown in FIG. 9 or FIG. 10 can be arbitrarily selected and classified and displayed so that each speaker can be identified.

In the above description, the case where the input candidates stored in the input buffer unit 44 are displayed has been described. However, the input candidates (including a plurality of candidates) stored in the input buffer unit 44 are displayed. Similarly, the character string obtained by performing the confirmation processing, that is, the character string stored in the document storage unit 46, is also distinguished between a key input and a voice input, or a story when a plurality of speakers exist. Of course, it is also possible to display in an output form that enables individual identification.

In the above description, an example in which an input character string is displayed and output in a form in which it is possible to identify a key input and a voice input or to identify each speaker when a plurality of speakers are present. However, a display that clearly indicates the time (voice input time) at which the character string was input by voice input may be performed as follows.

As for voice input, a voice input mode can be set. When the setting of the voice input mode is requested by a predetermined operation on the input device 14, the setting unit 56 receives the voice input mode setting request via the input control unit 30, and for example, as shown in FIG. An audio input mode setting screen is displayed on the display device 16 by the display unit 50.

FIG. 4B shows the voice input mode setting screen.
As shown in (1), an item for setting a voice input time is provided, and it is possible to arbitrarily set whether or not to input the voice input time and whether to display the input voice input time. . The setting unit 56 causes the control data unit 54 to store the content set on the voice input mode setting screen as control data. The setting items for voice input will be described later.

When the input of the voice input time is set, the input control unit 30 obtains the current time from the clock 21 for the voice recognition candidate obtained by the voice recognition processing of the voice recognition unit 36. Then, it is added as voice input time information.

FIG. 12 shows an example in which voice input time information is added to each of voice input candidates (voice input character strings) stored in the input buffer unit 44. For example,
For the string "Start a meeting now ..."
Voice input time information indicating voice input time “9:23:52” is added.

If the control data section 54 is set to display voice input time information, the display section 50 displays the voice input character string when displaying the voice input character string. The input time information is referred to and displayed near the character string. FIG. 13 shows an example of a display screen on which a voice input time is displayed together with a voice input character string.

It is not necessary to always display the voice input time information when inputting the voice input time information. The voice input time information is added to the voice input character string, and the voice input time information is displayed as necessary. The screen for displaying the character string can be simplified for easy viewing. Further, when the setting for displaying the voice input time is made, for example, only the character string specified by the cursor may be displayed.

In the above description, the time information is added to the character string input by voice. However, the input time information is similarly applied to the character string input by key. It may be added to the input character string information and displayed together with the input character string.

In the above description, the case where the input start time of the voice is input and displayed is described. However, not only the input start time but also the input end time or both the input start time and the end time are input. May be displayed. The input start time, the input end time, and either of the input start time and the input end time may be arbitrarily set on the voice input mode setting screen. Also, when displaying the time, the input start time is displayed near the beginning of the character string, and the input end time is displayed near the end of the character string. It is possible to determine whether it is the input end time.

The unit of the voice input character string to which the time information is added is, for example, for each voice input continuously, for each sentence, or for each paragraph (provided that a paragraph break is specified). , Any character string unit.

In this way, by inputting and displaying the time relating to voice input, for example, in a conference or the like, it is possible to input not only the contents of the conversation as a character string but also the speech time of each speaker. Can be recorded as detailed minutes of the meeting. Also,
Even in the case of using a mode of classifying and displaying for each speaker as shown in FIG. 10, it is possible to easily grasp the context of character strings input by different speakers.

In the above description, it is assumed that the voice input from the voice input device 20 is subjected to voice recognition processing to input characters. Next, a case where voice input is used for key input support will be described. explain.

The input support by voice input in the first embodiment includes input content correction for correcting a key-input character string based on a voice-input character string, and an input field of the content represented by the input voice. There is an input field discrimination that changes the output priority of a plurality of input candidates that are key-input.

As shown in FIG. 4B, on the voice input mode setting screen, setting items for voice input are provided, and the voice input is used for character input, input support, or voice input. It is possible to arbitrarily set whether or not to input. The setting unit 56 causes the control data unit 54 to store control data indicating the setting content for the voice input set on the voice input mode setting screen. Here, a description will be given assuming that a setting has been made to use voice input for input support. In the example shown in FIG. 4B, it is possible to simply specify that the voice input is used for the input support. However, in the input support, the input content correction and the input field determination are individually executed. It may be made possible to set whether or not to make it.

First, the case where the input contents are corrected will be described. The key input and the voice input are respectively performed at arbitrary timings, and the character string input by the key input and the character string input by voice are stored in the input buffer unit 44 in time series at respective arbitrary timings. Have been. In the voice recognition processing by the voice recognition unit 36, it is assumed that a read character string (a hiragana character string) is obtained instead of directly obtaining a character string mixed with kanji or kana based on input voice data.

[0117] The input content correction unit 58 is provided with the control data unit 54
Is set to execute input support, the character string read by key input (the character string to be subjected to the kana-kanji conversion processing by the conversion unit 40) and the character read by the voice recognition unit 36 A comparison is made with a column (a hiragana character string) to determine whether or not both are similar. For example, the input content correction unit 58 may input a reading character string portion delimited by a specific delimiter (punctuation mark, line feed, page break, etc.) of a key input reading character string, and input the reading character string before and after inputting the reading character string. By comparing the read character string of the voice input
If characters equal to or greater than a preset ratio match, it is determined that they are similar.

If it is determined that they are similar to each other, the input content correcting unit 58 regards the read character string input by voice as a character string that should be key input, and determines that the key input is not matched. Modify the characters in the string. On the other hand, if it is determined that the character strings are not similar, the input content correcting unit 58 does not correct the character string input by keying assuming that the reading character string input by voice is irrelevant to the key input. .

FIG. 14 shows a specific example of correction of input contents. Here, as shown in FIG. 14A, a character string of “Today is the fastest weather” (Today is the fastest weather) is input by key input. In this character string, the place where "good" is supposed to be "yay" and the place where "is" is erroneously entered as "tesu".

On the other hand, while the character string shown in FIG. 14A is being keyed in, "Today is good" is uttered, and the voice is recognized as shown in FIG. 14B. Is assumed to have been entered.

Here, if it is determined by comparing the key-input character string and the voice-input character string that they are similar, the key-input reading character string (today's character string) is obtained. Is corrected to "Today is a good day" based on the read character string input by voice, and FIG. 14 (d)
As a result, a character string "Today is fine weather" can be obtained as a result of the Kana-Kanji conversion of the reading character string.

When it is determined that the character string input by the key and the character string input by voice are not similar,
The key-in character string "Today is the finest weather" is input as it is.

As described above, by performing voice input, a character string input by a key can be automatically corrected. Therefore, a person who does not completely perform a key operation on the input device 14 (a person who frequently performs erroneous input operations). In this case, the erroneous key input can be automatically corrected by uttering the reading of the character string to be input while performing the key input operation. Therefore, every time you make a mistake by key input,
Since there is no need to make another correction by operating the input device 14, the operability is greatly improved.

Next, the case where the input field discrimination is performed will be described. Also in the case of performing the input field discrimination, the key input and the voice input are respectively performed at arbitrary timings, and the input buffer unit 44 stores the character string input by the key input and the character string input by voice at the respective arbitrary timings. They are stored in chronological order. However, the character string input by voice is not directly used for document creation.

FIG. 15 shows a configuration for performing input field discrimination. As shown in FIG. 15, the input field discriminating section 59 includes a field-specific counting section 59a and a field-specific identification information section 5.
9b is provided. The field-specific identification information section 59b registers, for each of a plurality of input fields prepared in advance, for example, fields such as the computer field, the medical field, the sports field, and the political economy field, a large number of character strings frequently used in the field are registered. Have been. When the input voice input character string matches the character string registered in the field-specific identification information section 59b, the count value for the field is incremented by the field-specific counting section 59a.

First, when the character string input by voice is stored in the input buffer section 44, the input field discriminating section 59 reads out the character string (a) and is registered in the field-specific identification information section 59b in advance. It is determined whether the corresponding character string exists by comparing the character string. Here, if the corresponding character string has been registered, the input field discriminating section 59 increases the count value counted in the field-specific counting section 59a corresponding to the field. This processing is performed by the input buffer unit 44.
Is performed for each of the voice input character strings stored in.

If there is a field in which the count value counted by the field-specific counting section 59a exceeds a preset value, the input field discriminating section 59 sends this field to the conversion section 40 as input field information. Notify (b). That is, it is determined that the contents of the conversation spoken by or around the person operating the document creation device relate to the field indicated by the input field information, and the character string input by the key also relates to the field. We consider it likely.

The conversion section 40 corresponds to the input field information among a plurality of key input candidates stored in the input buffer section 44, based on the input field information notified from the input field determination section 59. It is determined whether or not there is a character string in the field of interest, and if there is a corresponding character string, the character string is changed so as to have the first output order (c).
Therefore, the character string whose output order has been changed to the first place is displayed and output by the display unit 50. If there are multiple candidates in the same field,
The output order is sequentially changed to the second, third,....

The field to which the character string of the input candidate falls is determined, for example, by the dictionary unit 42 with respect to the heading character string (character string of the input candidate) to be output for the input read character string. The data representing the field is added to the input buffer and stored in the input buffer unit 44 together with the input candidates, or the dictionary unit 42 is classified into a plurality of fields in advance, and from which classification the input candidate is obtained. It is assumed that data indicating whether or not the data is added to the input candidates and stored in the input buffer unit 44.

The count value stored in the sector-specific counting section 59a is smaller at a predetermined timing (for example, when the maximum count value becomes a predetermined value) at the same ratio in each field. By updating the count value so as to change the field for voice input during document creation, the character string of the changed field is easily output.

By inputting a voice related to a specific field in this way, as a candidate for a key-input character string, a candidate related to the content of the voice can be easily output. Output control becomes possible.
Therefore, when the character string inputted by the key is not the intended one, it is conventionally necessary to instruct the display of the next candidate or the like by the key operation on the input device 14. Output control is performed so that a candidate in a specific field is output by a voice input that is input irrespective of the operation, so that operability is improved.

Next, a document creation apparatus according to a second embodiment of the present invention will be described. The second embodiment is intended to improve operability when giving various instructions to the document creation device.

FIG. 16 is a block diagram showing the functional configuration of the document creation device according to the second embodiment. Each function is C
This is realized by the PU 10 executing a program stored in the control program area 12a. As shown in FIG. 16, the document creation device according to the second embodiment includes an input control unit 30, a key input unit 32, a conversion unit 40, and a dictionary unit 4.
2, input buffer unit 44, document storage unit 46, editing unit 4
8, display unit 50, control data unit 54, setting unit 56, function determination unit 60, key assignment unit 62, character string storage unit 64,
The functions of a temporary buffer unit 66 and an input state display control unit 70 are provided. The same reference numerals are given to portions that perform basically the same operation as the configuration shown in FIG. 2 used in the description of the first embodiment, and detailed description thereof will be omitted. A slight difference in function will be supplementarily described in the description of the operation.

The function discriminating section 60 discriminates, based on key data input to the input control section 30, that an execution instruction for various functions provided in the document creating apparatus has been input.
It monitors whether the frequency of use for each function exceeds a predetermined number.

When a function whose use frequency exceeds a predetermined specified number is determined by monitoring by the function determination section 60, the key assignment section 62 assigns this function to a specific function provided on the input device 14 (keyboard). It is assigned to a key and notified to the input control unit 30. In addition, the key assignment unit 62 performs a range designation process (copy, cut-and-paste,
When word registration is performed, the input character string is assigned to a specific key provided on the input device 14 (keyboard) and the input control unit 30 is notified.

The character string storage section 64 stores a character string in an arbitrarily designated range for the input character string in the temporary buffer section 66. For example, functions such as copy, cut and paste, and word registration are provided. Is obtained from the document storage unit 46 and output to the temporary buffer unit 66.

The temporary buffer section 66 has a character string storage section 64.
The data of the character string obtained by the above is temporarily stored, and a plurality of character strings are stored.

The input state display control unit 70
The display unit 50 causes the display unit 16 to display the state of data input by the user, for example, a shift state at the time of inputting character data, an undetermined character string input by operating a plurality of keys, and the like.

Next, the operation of the second embodiment will be described. First, a method of activating a function provided in the document creation device according to the second embodiment will be described. Second
The document creation device according to the embodiment has various functions other than the function of creating a document, such as figure creation, ruled line creation,
Address book management and the like can be executed. In order to activate each function, there is a method of selecting from a prepared menu or a method of giving an instruction by a combination of a plurality of keys.

In the document creation device according to the second embodiment,
Further, functions are assigned to a plurality of function keys provided on the input device 14, and each function can be activated in accordance with an operation on the function keys.
Note that the functions assigned to the function keys are not fixed, and the functions that are used frequently are assigned with priority.

For example, as shown in FIG. 17A, the display unit 50 displays the function assigned to each function key on the bottom line of the display screen of the display device 16 as a guide. ing. The example shown in FIG. 17A shows that the function key F1 is assigned a function of creating a figure, and the function key F2 is assigned a function of creating a ruled line.

Assignment of functions to function keys is executed according to the flowchart shown in FIG.
When determining that a function execution instruction has been input to the input control unit 30 by operating the input device 14 (step B1), the function determination unit 60 adds 1 to the count value of the frequency of use for the corresponding function (step B1). B2). Thus, the function determining unit 60 counts the frequency of use of each function provided in the document creation device.

The function determining section 60 determines whether or not the count value of the frequency of use has exceeded a predetermined number. For example, when a particular function is frequently used, the count value of the frequency of use for that function increases. When the counted value exceeds the specified number, the function determining section 60 instructs the key assigning section 62 to assign the corresponding function to the function key (step B3).

The key assigning unit 62 checks the function currently assigned to each function, and assigns an empty function key or, if there is no empty function key, the function key to which the least frequently used function is assigned. A function whose frequency of use exceeds the specified number is newly assigned (step B4).

When a function is assigned to a function key, the input control unit 30 determines whether or not key data that is frequently assigned to the function key to which the function is assigned is input.
The activation of the function assigned to the key is notified to the function unit.

For example, as shown in FIG. 17A, the function key F1 is used to create a figure and the function key F
If the function of creating a ruled line is assigned to 2 and the function of managing the address book is frequently used, the function of managing the address book is assigned to the function key F3. Thereafter, the address book management function can be activated by an instruction to the function key F3.

As described above, when the frequency of use of the function actually used exceeds the specified number, the corresponding function is automatically assigned to the function key, so that the function is activated only by operating the function key. be able to. That is, select from the menu,
Alternatively, there is no need to give an instruction using a combination of a plurality of keys, and the operation for activating the function is facilitated.

Next, a case where a character string is assigned to a function key will be described with reference to a flowchart shown in FIG.

The document creation device is provided with a function of designating an arbitrary range for an input character string, for example, a function of copying, cutting and pasting, registering a phrase, and the like. When a range is specified for an input character string along with the execution of such a function, the character string storage unit 64 acquires these character strings and stores them in the temporary buffer unit 66 (step C1). . The character string storage unit 6
4 instructs the key assignment unit 62 to assign the character string stored in the temporary buffer unit 66 to the function key.

The key assigning section 62 includes a character string accumulating section 64
When the assignment of the character string is instructed, the acquired character string is assigned to an empty function key or a function key that is used least frequently (step C).
2).

For example, when a character string “President XXXX” in the input character string is designated for copying, this character string is stored in the temporary buffer unit 66 and , Function key F1. Subsequently, when the character string of "I am grateful for the increasing maturity and prosperity" of the entered character string is registered as a phrase, the character string is similarly assigned to the function key F2, and then If the character string "Today is a good day" is cut and pasted from the input character string, this character is assigned to the next function key F3.

The display unit 50 displays the first few characters of the character string assigned to the function key, for example, as shown in FIG.
As shown in FIG. 20A, the contents of the character string (FIG. 20B) stored in the temporary buffer 66 assigned to each function key can be easily determined and selected.

When a function key is designated, input control unit 30 reads a character string corresponding to the function key from temporary buffer unit 66,
4 is stored as the read character string.

[0154] Since the part of the input character string whose range is specified is automatically assigned to the function key,
Thereafter, the character string assigned to the function key can be input only by operating the function key.

If the character string assigned to the function key is not subsequently input by operating the function key, it is assumed that the character string is replaced with a character string whose range is newly specified. Further, it is assumed that the character string input by operating the function key is continuously allocated until the other character strings are replaced. For example, when a character string assigned to F1 is input by operating a function key, the character strings assigned to F2 to F10 (the function keys are assumed to be F1 to F10) are not used and are sequentially used. , F2, F3 ... F1
When a character string whose range is newly specified is assigned to 0, assignment to the function key F1 is performed next. Therefore, before all the assignments of the function keys to F2 to F10 are changed,
When 1 is used, the state in which the same character string is assigned continues until the assignment to the other function keys is completed.

As described above, by assigning a character string to a function key, a frequently used character string can be easily and repeatedly input only by operating the function key, so that the operation can be simplified.

Next, a key operation method for the input device 14 will be described. A plurality of characters (two to four characters) are assigned to each key of the input device 14 (keyboard), and characters can be input in accordance with switching of each shift state. However, since keys to which two to four characters are assigned are mixed, even if a key operation is performed in a certain shift state, the corresponding character may not exist. In such a case, the shift state of the character to be input is registered in advance as the basic shift.

For example, when a basic shift setting request is instructed from the input device 14, the setting section 56 receives this setting request and causes the display section 50 to display a basic shift setting screen as shown in FIG. On the basic shift setting screen, a shift state as a basic shift can be arbitrarily designated from a plurality of shift states prepared in advance, such as "Hiragana", "Takatakana", "English small numbers", and "English large numbers". FIG. 21 shows a state in which the “alphanumeric digit” shift state is selected. The basic shift set on the basic shift setting screen is stored in the control data unit 54 as control data by the setting unit 56.

Here, key input utilizing basic shift using specific keys will be described. FIG.
3 shows an example of key tops (a), (b), and (c) of two keys. The key shown in FIG. 22A is three characters, and FIG.
Are assigned to four characters, and two keys are assigned to the key shown in FIG.

When an operation is performed on a key to which the four characters shown in FIG. 22B are assigned, the hiragana character "A" is input in the "Hiragana" shift state, which is accompanied by the operation of the "shift key". Hiragana lower case "ぁ"
(In the “Katakana” shift state, “A” and “A” are used in each case). In the "alphanumeric" shift state, the numeral "3" is input, and when the "shift key" is operated, the symbol "#" is input (the same applies to the "alphanumeric" shift state). ). That is, in any shift state, the corresponding character exists.

It is also assumed that "alphanumeric" is set as the basic shift. Here, as shown in FIG. 22 (11), when the key of (c) is operated in the “small alphanumeric” shift state by the normal shift state switching operation, the key input unit 32 Is input as shown in FIG. 22 (12).
When the key (c) is operated together with the "shift key", an uppercase letter "S" is inputted.

Further, as shown in FIG. 22 (21), when the key (c) is operated in the "Hiragana" shift state by the normal shift state switching operation, the key input unit 32 causes the hiragana to be changed. Enter the characters "and". However, as shown in FIG. 22 (22), when the key of (c) is operated together with the "shift key" in the "Hiragana" shift state, there is no corresponding character.
In this case, the key input unit 32 refers to the basic shift stored in the control data unit 54, and displays the character when the key of (c) is operated together with the "shift key" in the "alphanumeric" shift state. , Ie, the capital letter "S" of the alphabet.

Similarly, when the key (a) is operated together with the "shift key" as shown in FIG. 22 (31) in the "Hiragana" shift state, the key input section 32 The symbol "!" That is input when the user is in the "alphanumeric" shift state is input.

In this manner, the basic shift can be set in advance, so that, for example, if the shift state is erroneously changed, even if there is no character corresponding to the current shift state corresponding to the operated key. Since the character according to the basic shift is input, the intended character can be input, and the key operation is not wasted.

Next, a display example of the input state will be described. First, a display in the case of performing Roman character input will be described with reference to a flowchart shown in FIG.

In character input in the Roman character input mode,
A reading character string (hiragana) to be converted by the conversion unit 40 is input by one key or a plurality of characters by a plurality of key operations. When there is a character in an undetermined state corresponding to each key operation input by inputting a Roman character (step D1), the input state display control unit 70 obtains a cursor position indicating the display position of the input character string (step D).
2) On the basis of the cursor position, a position where a character string that has been input in Roman characters in an undetermined state is to be displayed, that is, the same character that is different from the arrangement of the characters in which the determined input character string is displayed. Finding the Nearby Position (Step D
3). Then, the input state display control unit 70 displays the undetermined Roman character input character string portion at a position near the cursor obtained based on the cursor position (step D4).

For example, as shown in FIG. 24 (a), a state is shown in which, after a character string of "Haruha" is input, "s" and "h" are input in Roman characters to input the next character. ing. The character string in the undecided state in which the Roman characters are input is displayed in the Roman character input display near the cursor position, for example, near the cursor on the immediately preceding line different from the line on which the input read character string is displayed in FIG. ing.

Depending on the situation on the display screen, such as when the input reading character string is displayed at the top line of the character string display area, as shown in FIG. A Roman character input display may be performed near the cursor on the line next to the displayed line.

As described above, when one character or a plurality of character strings are input by a plurality of key operations, the vicinity of the cursor position on a line different from the line (array) displaying the input read character string is displayed. , It is possible to clearly indicate that the input character is in an undetermined state. Therefore, a character string in an undetermined state in which a plurality of key operations are performed and a confirmed read character string to be converted (FIG.
In FIG. 4, the character string of "Karuha") is clearly distinguished from the character string mixed with kanji or kana, which has been converted to the read character string, so that it is very easy to see.

Next, a description will be given, with reference to the flowchart shown in FIG. 25, of displaying a shift state which can be switched in accordance with a key input operation.

In the key operation for character input, a shift state switching is arbitrarily instructed to arbitrarily switch a plurality of characters assigned to keys. The input state display control unit 70 monitors a shift state switching operation input to the input control unit 30 via the key input unit 32,
The current shift state is obtained (step E1).

Further, in order to obtain a position for displaying the shift state, the position of the cursor on the screen is obtained (step E2), and a predetermined nearby position to be displayed is obtained based on the cursor position (step E3). ). Then, the input state display control unit 70 causes the display unit 50 to display the shift state near the cursor (step E4).

FIG. 26 shows an example of a screen on which the shift state is displayed. In the example shown in FIG. 26, a shift state display indicating that the shift state is, for example, “alphanumeric shift” is displayed near the cursor position.

After displaying the shift state, the input state display control unit 70 monitors whether a predetermined time (for example, about 2 seconds) has elapsed (step E5) or whether the next key input has been made. (Step E6).

Here, if a predetermined time has elapsed before the next key input is performed (step E5), the input state display control unit 70 causes the display unit 50 to automatically delete the display of the shift state (step E5). E10).

If a key input is made before the predetermined time has elapsed (step E6), the shift state is also deleted (step E7), and a process corresponding to the key input is executed (step E8). ).

If the key input is for instructing to change the shift state (step E9), the input state display control unit 70 acquires the newly switched shift state, and Is displayed in the same manner as described above.

If the input is not a key input for changing the shift state, the input state display control unit 70 monitors whether there is a new key input (step E1).
1).

In this manner, when a key input is made and the shift state is changed, as shown in FIG. 26, the shift state is displayed near the position where the input character string is displayed. Do. As a result, the current shift state can be confirmed without greatly changing the line of sight of the character string being input. When a shift state switching instruction is given, the shift state is displayed near the cursor position based on the cursor position and the current shift state is clearly indicated. When an operation is performed, the shift state display is automatically deleted. Thus, the shift state display is deleted without specially erasing the shift state, so that the work load is not increased, and the screen on which the input character string is displayed is not complicated.

[0180]

As described in detail above, according to the present invention, a key input and a voice input are respectively performed at arbitrary timings to input characters, and a document is created by effectively using each of them. As a result, the operability of document creation is improved. Further, operability when giving various instructions to the document creation device is improved.

[Brief description of the drawings]

FIG. 1 is a block diagram showing the system configuration of a document creation device according to an embodiment.

FIG. 2 is a block diagram illustrating a functional configuration of the document creation device according to the first embodiment.

FIG. 3 is a diagram illustrating a mechanism for mixing key input and voice input.

FIG. 4 is a view showing an example of an output mode setting screen and a voice input mode setting screen used in the first embodiment.

FIG. 5 is a flowchart showing a process for displaying and outputting input candidates stored in the input buffer unit 44;

FIG. 6 is a diagram showing a display example of input candidates displayed in a line-by-line manner.

FIG. 7 is a view for explaining an editing process for an input candidate in which a character string input by a key and a character string input by voice are mixed.

FIG. 8 is a diagram illustrating an example of a speaker-specific output mode setting screen according to the first embodiment.

FIG. 9 is a diagram showing an example in which character strings input as utterance contents of a plurality of speakers (1), (2), and (3) are displayed.

FIG. 10 is a diagram showing an example of a display screen in which a display area is provided for each speaker.

FIG. 11 is a diagram illustrating an example of a character string input by voices that have been redundantly input by speakers A and B.

12 is a diagram showing an example in which voice input time information is added to each of voice input candidates (voice input character strings) stored in the input buffer unit 44. FIG.

FIG. 13 is a diagram showing an example of a display screen on which a voice input time is displayed together with a voice input character string.

FIG. 14 is a diagram showing a specific example of input content correction.

FIG. 15 is a diagram showing a configuration for performing input field discrimination.

FIG. 16 is a block diagram illustrating a functional configuration of a document creation device according to a second embodiment.

FIG. 17 is a diagram showing an example of a guide display showing functions assigned to each function key.

FIG. 18 is a flowchart for explaining assignment of functions to function keys.

FIG. 19 is a flowchart illustrating a process of assigning a character string to a function key.

FIG. 20 is a diagram showing an example of a character string assigned to a function key.

FIG. 21 is a view showing an example of a basic shift setting screen according to the second embodiment.

FIG. 22 is a diagram illustrating a configuration of the input device 14 (keyboard).
The figure which shows the example of the key top of one key.

FIG. 23 is a flowchart for explaining a display in the case of performing Roman character input.

FIG. 24 is a diagram illustrating an example in which an undetermined Roman character input character string is displayed near a cursor position;

FIG. 25 is a flowchart for explaining a case where a shift state switched according to a key input operation is displayed.

FIG. 26 is a diagram showing an example of a screen on which a shift state is displayed.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 ... CPU 12 ... Memory 12a ... Control program area 12b ... Document storage area 12c ... Dictionary storage area 12d ... Input buffer area 12e ... Control data storage area 12f ... Temporary buffer area 14 ... Input device 16 ... Display device 18 ... Storage device 20 ... voice input device 21 ... clock 30 ... input control unit 32 ... key input unit 34 ... voice input unit 36 ... voice recognition unit 38 ... voice recognition dictionary 39 ... speaker identification unit 40 ... conversion unit 42 ... dictionary unit 44 ... input buffer Unit 46 document storage unit 48 editing unit 50 display unit 54 control data unit 56 setting unit 58 input content correction unit 59 input field discrimination unit 60 function discrimination unit 62 key assignment unit 64 character string storage Unit 66: Temporary buffer unit 70: Input state display control unit

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G10L 15/28 G10L 3/00 551B 561H (72) Inventor Tomoko Kudo 2-9-9 Suehirocho, Ome-shi, Tokyo Inside the Toshiba Ome Plant (72) Inventor Hideki Nagasaki 2-9-9 Suehirocho, Ome-shi, Tokyo Inside the Toshiba Ome Plant (72) Inventor Seiden 2-9-9 Suehirocho, Ome-shi, Tokyo Stock F-term in the Toshiba Ome Plant (reference) 5B009 KA01 KA03 KA04 KA06 KB05 QB11 RB21 RB32 VA02 VA05 5B020 BB10 CC01 CC12 5D015 AA03 KK03 LL05 9A001 BB04 DD11 EE01 HH04 HH08 HZ17

Claims (22)

[Claims] 1. A keyboard input means for executing a conversion process on a character read by an operation on a keyboard to input a character string, and a voice input means for recognizing an input voice and inputting a character string. A character string input by the keyboard input means;
A character string input by the voice input means is stored in a chronological order while adding input identification information indicating whether the character string is a keyboard input character string or a voice input character string. A document creation apparatus, comprising: an input buffer unit; and a display unit for displaying a character string stored by the input buffer unit. 2. The display device according to claim 1, further comprising: a display unit configured to display the character string input from the keyboard and the character string input by voice based on input identification information added to the character string stored in the input buffer unit. The document creation device according to claim 1, wherein the document is displayed. 3. The document creation device according to claim 1, further comprising an editing device for creating a document by arbitrarily selecting a character string displayed by said display device based on said input identification information. apparatus. 4. Voice input means for recognizing input voice and inputting a character string, and speaker identification corresponding to the character string input by the voice input means for identifying a speaker who has performed voice input. Means for displaying a character string input by the voice input means in a different form for each speaker identified by the speaker identification means. 5. The document creation apparatus according to claim 4, wherein said display means displays the input character string using a different character expression for each speaker. 6. The document creation apparatus according to claim 4, wherein said display means displays the input character strings classified by speaker in different areas provided for each speaker. 7. The document creating apparatus according to claim 4, wherein said speaker identification means monitors a non-voice input time for each of the speakers who input the voice, and determines a break of the utterance. 8. A voice input time obtaining means for obtaining a time at which a voice is input by the voice input means, and a time obtained by the voice input time obtaining means,
5. The document creation apparatus according to claim 1, further comprising: time display means for displaying a character string together with the character string when the character string is displayed by the display means. 9. A keyboard input means for executing a conversion process on a character read by an operation on a keyboard and inputting a character string, and a voice input means for recognizing the input voice and inputting the character string. A comparison unit that compares a character string input by the keyboard input unit with a character string input by the voice input unit to determine whether or not both are similar; If it is determined that the character string is input by the keyboard input unit, the input content correction unit corrects the character string input by the keyboard input unit based on the character string input by the voice input unit. Display means for displaying a corrected character string or a character string corrected by the input content correcting means. Apparatus. 10. A keyboard input unit for executing a conversion process on a character read by an operation on a keyboard to input a character string as a plurality of input candidates, and a voice input unit for inputting input voice. Input field discriminating means for discriminating an input field of the content represented by the voice based on the voice input by the voice input means; and outputting a plurality of input character strings input by the keyboard input means Output order changing means for changing the priority based on the input field determined by the input field determining means; and characters input by the keyboard input means according to the output priority changed by the output order changing means. A document creation device, comprising: display means for displaying a column. 11. A keyboard input means for executing a conversion process on a character read by an operation on a keyboard and inputting a character string, and a voice input means for recognizing the input voice and inputting the character string. A character string input by the keyboard input means;
A character string input by the voice input means is stored in a chronological order while adding input identification information indicating whether the character string is a keyboard input character string or a voice input character string. Input buffer means, speaker identification means corresponding to the character string input by the voice input means, for identifying a speaker who has performed voice input, and a character string input by the voice input means, First display means for displaying in a different form for each speaker identified by the identification means, voice input time obtaining means for obtaining the time at which the voice was input by the voice input means, and voice input time obtaining means for obtaining the voice input time obtaining means. Time
When a character string is displayed by the display means, the character string input by the second display means and the keyboard input means, which is displayed together with the character string, is compared with the character string input by the voice input means. Comparing means for determining whether or not are similar to each other; and when the comparing means determines that both are similar, the keyboard input means based on a character string input by the voice input means. Input content correcting means for correcting a character string input by the user; third display means for displaying a character string input by the keyboard input means or a character string corrected by the input content correcting means; Input field discriminating means for discriminating an input field of the content represented by the voice based on the voice input by the means; Output priority changing means for changing the output priority of a plurality of input candidate character strings based on the input field determined by the input field determining means; and Fourth display means for displaying a character string input by the keyboard input means in accordance with the output priority order, and setting means for setting whether or not to display by the first to fourth display means. The document creation device according to claim 1, wherein said first to fourth display means perform display in accordance with a setting by said setting means. 12. A keyboard operated for inputting characters and inputting execution instructions of various functions, a usage frequency counting means for counting usage frequency for each function instructed to be executed by operating the keyboard, and the usage frequency When there is a function whose usage frequency counted by the counting means exceeds a predetermined number, a key assigning means for assigning this function to a specific key provided on the keyboard; and a function assigned by the assigning means. A document creation apparatus comprising: a control unit that executes a function corresponding to a specific key when a specific key is operated. 13. A keyboard operated for inputting characters and inputting execution instructions of various functions, and temporarily storing a character string arbitrarily designated for the character string input by operating the keyboard. Temporary storage means, a character string allocating means for allocating a character string stored by the temporary storage means to a specific key provided on the keyboard, and a specific key to which a character string is allocated by the character string allocating means. An input unit for inputting a character string stored in the temporary storage unit corresponding to the specific key when operated. 14. A keyboard in which a plurality of keys each assigned with two or more characters respectively associated with a specific shift state are provided, and a plurality of keys assigned different numbers of characters are mixed. Basic shift setting means for setting a basic shift to be referred to when a key to which a character associated with a specific shift state is not assigned is operated; First key input means for inputting a character associated with the current shift state assigned to the key, and in response to an operation on one key of the keyboard, associated with the current shift state assigned to this key If no character is found, a second key for inputting a character corresponding to the shift state of the basic shift set by the basic shift setting means. -A document creation device comprising input means. 15. A keyboard provided with a plurality of keys to each of which two or more characters associated with a specific shift state are assigned, and a plurality of keys to which different numbers of characters are assigned are mixed. Key input means for inputting a character associated with a current shift state assigned to the key in response to an operation on one key of the keyboard; and a character display for displaying a character input by the key input means And a shift state display means for displaying the changed shift state in the vicinity of the character displayed by the character display means when an instruction to change the shift state is input. Creation device. 16. The shift state display unit according to claim 15, wherein when a character is input by the key input unit while the shift state is being displayed, the shift state display is erased. Document creation device. 17. The document creating apparatus according to claim 15, wherein the shift state display means deletes the display of the shift state when the display of the shift state has elapsed for a predetermined time. 18. A keyboard provided with a plurality of keys, input means for outputting an undetermined character to be converted by operating the plurality of keys on the keyboard, and a character input by the input means Conversion means for performing a conversion process to convert the characters into different characters; first display means for displaying the characters converted by the conversion means; and the character input by the input means until the characters are converted by the conversion means. A document creating apparatus comprising: a second display unit that displays a character in the vicinity of the same character different from the arrangement of characters displayed by the first display unit. 19. A keyboard input step of executing a conversion process on a character read by an operation on the keyboard to input a character string, and a voice input step of recognizing the input voice and inputting the character string. An input identification indicating whether a character string input in the keyboard input step and a character string input in the voice input step are a character string input by a keyboard or a character string input by voice; A document creation method, comprising: an input step of storing information in a time series while adding information; and a display step of displaying a character string stored in the input buffer step. 20. A voice input step of recognizing an input voice and inputting a character string, and a speaker identification corresponding to the character string input in the voice input step, for identifying a speaker who performed a voice input. And a character string input by the voice input step.
A display step of displaying in a different form for each speaker identified in the speaker identification step. 21. A keyboard input step of executing a conversion process on a reading character input by an operation on a keyboard to input a character string, and a voice input step of recognizing input voice and inputting the character string. A comparing step of comparing a character string input in the keyboard input step with a character string input in the voice input step to determine whether or not the two are similar; If it is determined that the character string is input in the voice input step, an input content correcting step of correcting the character string input in the keyboard input step; and Displayed character string or character string corrected by the input content correction step Document preparation method is characterized in that comprising a display step that. 22. A keyboard input step of executing a conversion process on a read character input by an operation on a keyboard to input a character string as a plurality of input candidates, and a voice input step of inputting input voice An input field discriminating step of discriminating an input field of the content represented by the voice based on the voice input in the voice input step; and outputting a plurality of input character strings input in the keyboard input step An output order change step of changing the priority order based on the input field determined by the input field determination step; and a character input by the keyboard input step according to the output priority order changed by the output order change step. A display step of displaying a column.