JPS60189070A - Character input device - Google Patents

Character input device

Info

Publication number
JPS60189070A
JPS60189070A JP59044511A JP4451184A JPS60189070A JP S60189070 A JPS60189070 A JP S60189070A JP 59044511 A JP59044511 A JP 59044511A JP 4451184 A JP4451184 A JP 4451184A JP S60189070 A JPS60189070 A JP S60189070A
Authority
JP
Japan
Prior art keywords
character
candidates
input
dictionary
word
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP59044511A
Other languages
Japanese (ja)
Other versions
JPH023222B2 (en
Inventor
Toshiro Shibanuma
敏郎 柴沼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to JP59044511A priority Critical patent/JPS60189070A/en
Publication of JPS60189070A publication Critical patent/JPS60189070A/en
Publication of JPH023222B2 publication Critical patent/JPH023222B2/ja
Granted legal-status Critical Current

Links

Landscapes

  • Document Processing Apparatus (AREA)

Abstract

PURPOSE:To obtain a correct decision result and perform easily input operation without any sensing of incompatibility by inputting only characters which have partial features on handwriting basis, and limiting the ranges of candidates for the input characters greatly. CONSTITUTION:The character input device processes character data electronically by using a speech recognition part 2 and a character recognition part 8 in combination, and when a handwritten character is recognized, partial features of the character is handwritten through a character radical feature pattern dictionary 21. Then, its reading is recognized and the word/phrase vocabulary belonging to the reading is selected in a word/phrase vocabulary dictionary 23 through a word/phrase vocabulary generation part 22. Then, this is compared by a character decision part 12 with speed recognition candidates obtained by the speech recognition part. Namely, only characters having partial features are inputted on handwriting basis and the ranges of candidates for the input characters are limited greatly to obtain correct decision results and also perform input operation easily without any sensing of incompatibility.

Description

【発明の詳細な説明】 [al 発明の技術分野 本発明は、データ処理装置で文字を処理するために、音
声による文字入力と手書きによる文字入力とを併用する
文字入力装置に関する。
DETAILED DESCRIPTION OF THE INVENTION [al] Technical Field of the Invention The present invention relates to a character input device that uses both vocal character input and handwritten character input in order to process characters in a data processing device.

[b) 技術の背景 近来、音声認識技術と文字パターン認識技術はデータ処
理技術の発達と、音声認識1文字パターン認識等のアル
ゴリズムのための複雑高度な論理回路及び高速大容量を
要する手段等が、半導体集積化技術の進展による小型化
・低コストの高集積回路素子(LSI)の実現により可
能となり、これ等の高集積回路素子を使用してデータ処
理が容易にできるようになり2日本語音声の未知入力音
声を認識する音声認識装置や2手書き文字のパターンを
認識して文字読めに変換する文字人力装置が実用化され
ている。
[b) Background of the technology In recent years, voice recognition technology and character pattern recognition technology have evolved due to the development of data processing technology and the need for complex, sophisticated logic circuits and high-speed, large-capacity methods for algorithms such as voice recognition and character pattern recognition. This has been made possible by the realization of smaller, lower-cost highly integrated circuit devices (LSI) due to advances in semiconductor integration technology, and it has become possible to easily process data using these highly integrated circuit devices. Speech recognition devices that recognize unknown input speech and human-powered text devices that recognize patterns of two handwritten characters and convert them into text readings have been put into practical use.

特に、未知人力音声を認識して単音節文字列を作成し、
この単音節文字列を各単語/7Jj詔語常辞書と照合し
て複数の単語/41語に変換する機能を持った音声認識
装置や5手書き文字の文字形状のパターンを認識して文
字読みを作成し、この文字読みより各単語/熟語SK党
辞書と照合して複数の単語/熟語に変換する機能を持っ
た手書き文字入力装置等が実現している。しかし、音声
認識と文字認識においては、認識誤りを避けることがで
きない。しかしながら1両者の誤認識の傾向には全く相
関性がないため1両者の結果から総合的に判断すれば、
極めて高い認識率と高速文字入力が可能となると考えら
れ、昭和58年10月25日イ」けで出願された「文字
入ノJ装置」は、この音声認識装置と手書き文字入力装
置とを41用して文字の81 LJ率と文字入力を向上
させた提案であり5本発明は。
In particular, we recognize unknown human voice and create monosyllabic character strings.
A voice recognition device has the function of converting this monosyllabic character string into multiple words/41 words by comparing each word/7JJ imperial dictionary, and 5 recognizes the character shape pattern of handwritten characters to read the characters. Handwritten character input devices and the like have been realized that have the function of creating a handwritten character and converting it into a plurality of words/idioms by comparing each word/idiom with the SK party dictionary based on the character pronunciation. However, recognition errors cannot be avoided in speech recognition and character recognition. However, since there is no correlation between the tendency of misrecognition in both cases, if we judge the results comprehensively from the results of both cases,
The ``Character Input Device'', which was filed on October 25, 1980, was thought to enable extremely high recognition rates and high-speed character input, and was developed by combining this voice recognition device and handwritten character input device into 41 The present invention is a proposal that improves the 81 LJ rate and character input using the 81 LJ rate of characters.

この昭和58年10月25日イ;]げで出願された「文
字入力装置」の改良案である。
This is an improvement proposal for the ``Character Input Device'' filed on October 25, 1988.

(C) 従来技術と問題点 以下、先に出願された昭和58年10月25日(=Jけ
の1文字入力装置」について説明する。第1図は従来の
文字入力装置の構成)lコック図を示す。回申、1はマ
イクロホン、2は音声認識部、3は音声特徴パラメータ
辞書、4は仮名漢字変換部、5は仮名漢字変換辞書、6
ばタブレット、7ば指示ペン、8は文字認識部、9は文
字特徴パターン辞書、10は読み変換部、11は読の変
換辞書、12は文字判定部、13は文字/単語辞書、1
4ば主制御部。
(C) Prior Art and Problems Below, we will explain the earlier application filed on October 25, 1980 (= J-key single-character input device). Figure 1 shows the configuration of a conventional character input device. Show the diagram. 1 is a microphone, 2 is a speech recognition unit, 3 is a speech feature parameter dictionary, 4 is a kana-kanji conversion unit, 5 is a kana-kanji conversion dictionary, 6
1 is a tablet, 7 is an indicator pen, 8 is a character recognition unit, 9 is a character feature pattern dictionary, 10 is a reading conversion unit, 11 is a reading conversion dictionary, 12 is a character determination unit, 13 is a character/word dictionary, 1
4B Main control unit.

15は表示制御部、16はディスプレイを示す。15 is a display control unit, and 16 is a display.

第1図において、まず、マイクロホン1より未知人力音
声を入力し音声認識するまでの手順を説明する。マイク
ロホン1より入力した未知人力音声は電気的信号に変換
されて、音声人ノj信号として音声認識部2に入力する
。音声認識部2に人力した音声人ツノ信号を9例えば、
ピッチ周波数、ホルマント周波数、スペクトラム、線型
予測係数またLSI偏自己相関係数等の特徴パラメータ
として抽出し、抽出した人力音声特徴パラメータを、音
声特徴パラメータ辞@3に予め登録された音声標準特徴
パラメータと比較照合し、類似度の高いものを単音節認
識候補として選択する。次に、音声認識部2で得られた
単音節認識候補を順次仮名漢字変換部4に入力し、仮名
漢字変換部4で順次入力された単音節認識候補を複数の
単音節文字列候補を作成し、仮名漢字変換辞書5を参照
して仮名漢字の複数の文字列コードに変換する。
In FIG. 1, first, the procedure from inputting an unknown human voice through the microphone 1 to recognizing the voice will be explained. An unknown human voice input through the microphone 1 is converted into an electrical signal and input to the voice recognition unit 2 as a voice human signal. For example, if the voice recognition unit 2 inputs a voice human horn signal 9,
The pitch frequency, formant frequency, spectrum, linear prediction coefficient, LSI partial autocorrelation coefficient, etc. are extracted as feature parameters, and the extracted human speech feature parameters are combined with the speech standard feature parameters registered in advance in the speech feature parameter dictionary @3. They are compared and matched, and those with a high degree of similarity are selected as monosyllable recognition candidates. Next, the monosyllabic recognition candidates obtained by the speech recognition unit 2 are sequentially input to the kana-kanji conversion unit 4, and the kana-kanji conversion unit 4 creates a plurality of monosyllabic character string candidates from the sequentially input monosyllabic recognition candidates. Then, referring to the kana-kanji conversion dictionary 5, the character string codes are converted into a plurality of character string codes of kana-kanji.

次に、タブレット6に入力する手書き文字を認識する手
順を説明する。人力した音声と同じ文字を指示ペン7で
タブレット6に手書きし、指示ペン7の移動する座標デ
ータを電磁気検出や超音波による位置検出等により逐次
読め取り、タブレット6から座標データを文字認識部8
に入ノjする。
Next, a procedure for recognizing handwritten characters input to the tablet 6 will be explained. The same characters as the human voice are handwritten on the tablet 6 using the pointing pen 7, and the coordinate data of the moving pointing pen 7 is sequentially read by electromagnetic detection or ultrasonic position detection, and the coordinate data is transferred from the tablet 6 to the character recognition unit 8.
I'm going to enter.

文字認識部8に入力された手書き文字に関する座標デー
タは1例えば、ストロークの特徴1位相幾何学的特徴、
芯線の方向特徴、背景部分の特徴等のパターン分析を行
い文字特徴パラメータを抽出し、抽出しな文字特徴パラ
メータと予め登録された文字特徴パターン辞書9の各標
準文字特徴パラン〜りとを比較照合し、距離の近い標準
文字特徴パラメータが属する「読み」候補を選択して読
め変換部10に人ノjする。読み変換部10は文字認識
部8で得られた「読み」候補を、予め用意した読み変換
辞書11を参照して1手書き文字の読み文字コードに変
換する。
Coordinate data related to handwritten characters input to the character recognition unit 8 include 1, for example, stroke features 1 topological features,
Character feature parameters are extracted by pattern analysis of core line direction features, background part features, etc., and the extracted character feature parameters are compared with each standard character feature paran~ri in the character feature pattern dictionary 9 registered in advance. Then, the "reading" candidates to which the standard character feature parameters that are close to each other belong are selected and sent to the reading conversion unit 10. The reading conversion section 10 converts the "reading" candidates obtained by the character recognition section 8 into reading character codes of one handwritten character by referring to a reading conversion dictionary 11 prepared in advance.

以上で入力音声と手書き文字の認識手順が終了し1文字
判定部12にそれぞれの認識候補を入力する。文字判定
部12は仮名漢字変換部4より人力した音声認識結果の
複数の文字列コードと、読み変換部10より入力した手
書き文字認識結果の読め文字コードとの双方について比
較照合を行い、同一文字コートを選出して判定結果とし
、更に、その判定結果の文字コードを予め認識結果とし
て意味のある文字または文字列コードとして登録して置
いた文字/単語辞書13から文字/単語コードを選出し
、その選出された文字/A′L語コードを認識結果とし
て主制御部14に伝達する。主制御部14に伝達された
文字/単語コードを表示制御部15に送り。
With this, the input voice and handwritten character recognition procedure is completed, and each recognition candidate is input to the single character determination section 12. The character determination unit 12 compares and collates both the plurality of character string codes of the voice recognition results manually inputted by the kana-kanji conversion unit 4 and the reading character codes of the handwritten character recognition results inputted from the reading conversion unit 10, and identifies the same characters. Selecting a coat as a judgment result, further selecting a character/word code from a character/word dictionary 13 in which the character code of the judgment result is registered in advance as a meaningful character or character string code as a recognition result, The selected character/A'L word code is transmitted to the main control section 14 as a recognition result. The character/word code transmitted to the main control section 14 is sent to the display control section 15.

表示制御部15はその文字/単語コードを仮名漢字に変
換してディスプレイ16の表示画面に表示する。
The display control unit 15 converts the character/word code into kana/kanji and displays it on the display screen of the display 16.

これが従来の未知入力音声を音声認識する機能と。This is the conventional voice recognition function for unknown input voice.

手書き文字を文字認識する機能とを併用した文字入力装
置である。
This is a character input device that also has a function to recognize handwritten characters.

次に、実際例で説明すると9例えば1判定したい文字を
仮に1連絡」とする。マイクロホン1に入力する音声入
力は「れ・ん・ら・く」であり。
Next, to explain with an actual example, let us say that the characters that we want to judge as 1, for example, 9, are 1 connection. The voice input to microphone 1 is "Re-n-ra-ku".

タブレン1−6に指示ベン7で手書きする文字入力は「
連絡」となる。この場合、音声認識部2で認識された単
音節候補を仮名漢字変換部4で単音節文字列候補として
作成された文字列候補は、「え・ん・ら・<」、「れ・
ん・ら・<」、「れ・ん・や・く」・・・と複数個あり
、仮名漢字変換部4で変換される音声認識のめでは1例
えば、「田楽」と誤認識する可能性がある。一方9文字
認識部8で「読み」候補を選択し、読め変換部10で文
字コードに変換され1文字認識による候補として。
To input characters by hand using instruction ben 7 on tablets 1-6,
"Contact". In this case, the character string candidates created by the kana-kanji conversion unit 4 as monosyllabic character string candidates from the monosyllabic candidates recognized by the speech recognition unit 2 are “E・N・Ra・<”, “Re・
There are multiple words such as ``n・ra・<'', ``re・n・ya・ku'', etc., and the voice recognition converted by the kana-kanji converter 4 may misrecognize it as ``Dengaku'', for example. There is. On the other hand, the 9-character recognition section 8 selects a "reading" candidate, and the reading conversion section 10 converts it into a character code as a candidate based on 1-character recognition.

例えば、「連絡」、「連絡」、「連絡」等があり。For example, there are "contact", "contact", "contact", etc.

文字認識のみでも正確な認識が困離であり5文字判定部
12で「田楽」、「連絡」等を排除し1両者が共通に同
一文字を選択した候補、「連絡」を正しく認識する文字
入力装置である。
Accurate recognition is difficult even with character recognition alone, so the 5-character judgment unit 12 eliminates "Dengaku", "Tsunagi", etc., and inputs characters that correctly recognize "Tsunagi", a candidate for which both parties have selected the same character. It is a device.

以上説明した従来の文字入力装置は、音声認識Φ結果得
られる複数の候補から1つの判定結果を得るため2手書
き文字認識という相関のない方式による認識結果の候補
を使用し、総合的に判断することにより、極めて高い認
識率を得ることができる。しかし2人間にとって書きな
がら読む行為としては2通常行われているとは1え9漢
字を正しく書くのに抵抗を感する人間も少なくはない。
The conventional character input device described above uses recognition result candidates based on an uncorrelated method of two handwritten character recognition in order to obtain a single determination result from multiple candidates obtained as a result of voice recognition Φ, and makes a comprehensive judgment. By doing so, an extremely high recognition rate can be obtained. However, although it is a normal practice for people to read while writing, there are many people who feel reluctant to write kanji correctly.

従って、この従来の方式は、すべての文字を手書きする
のに手間がかかり、能率の悪くなる欠点と。
Therefore, this conventional method has the drawback that it takes time and effort to handwrite all the characters, which reduces efficiency.

また2手書き文字の入力操作が面倒となり違和感を持た
一ヒかねない欠点を有していた。
In addition, the input operation for inputting two handwritten characters is troublesome and may cause a sense of discomfort and failure.

fd) 発明の目的 本発明は、この能率の悪いすべての文字を手書きし9面
倒で違和感を持たせかねない従来の欠点を改善し、違和
感のない入力操作の容易な方式を1号ることを目的とし
ている。
fd) Purpose of the Invention The present invention aims to improve the drawbacks of the conventional method of handwriting all characters, which is inefficient and can cause a user to feel uncomfortable and troublesome, and to provide a method that is easy to input without causing any discomfort. The purpose is

fe) 発明の構成 上記目的は9文字データを電子的に処理する処理装置に
用いられる文字入力装置であって、未知入力音声を入力
する音声人ノコ手段と5文字の部分的特徴形状を手書き
して人力する手書き文字人力手段と、前記音声入力手段
により入力した音声情報を音響分析して得られた入力音
声特徴パラメータと、予め辞書に登録された単音節標準
パラメータとを照合し単音節文字列認識候補を選択する
音声認識部と、前記音声認識部で得られた単音節文字列
認識候補を、予め辞書に登録された仮名漢字辞書と照合
し複数の仮名漢字候補を選択する第1の選択手段と、前
記手書き文字入力手段により入力した部分的特徴文字情
報をパターン分析して得られた部分的入力特徴パラメー
タと、予め辞書に登録された部分的特徴文字標準パラメ
ータとを照合し1部分的文字「読み」候補を選択する手
書文字認識部と、前記手書文字認識部で得られた部分的
「読み」候補により、予め登録された部分的文字「読み
」に属する単語/熟語語党辞書から部分的文字「読み」
候補の属する複数の単語/熟語候補を選択する第2の選
択手段と、前記第1の選択手段により選択された複数の
仮名漢字候補と前記第2の選択手段により選択された複
数の単語/熟語候補とを比較判定する判定部と、前記音
声認識部、前記手書文字認識部、前記第1の選択手段。
fe) Structure of the Invention The above object is to provide a character input device used in a processing device that electronically processes 9 character data, which includes a voice hook means for inputting unknown input voice and a character input device for manually inputting partial characteristic shapes of 5 characters. A monosyllabic character string is generated by comparing input voice characteristic parameters obtained by acoustically analyzing the voice information inputted by the voice input means with monosyllabic standard parameters registered in advance in a dictionary. a speech recognition unit that selects recognition candidates; and a first selection that selects a plurality of kana-kanji candidates by comparing the monosyllabic character string recognition candidates obtained by the speech recognition unit with a kana-kanji dictionary registered in advance in a dictionary. 1. Compare the partial input characteristic parameters obtained by pattern analysis of the partial characteristic character information inputted by the handwritten character input means with the partial characteristic character standard parameters registered in advance in the dictionary. A handwritten character recognition unit that selects a character “reading” candidate and a partial “reading” candidate obtained by the handwritten character recognition unit select words/idiom words belonging to the pre-registered partial character “reading”. Partial character “reading” from the dictionary
a second selection means for selecting a plurality of word/idiom candidates to which the candidate belongs; a plurality of kana-kanji candidates selected by the first selection means and a plurality of words/idioms selected by the second selection means; a determination unit that compares and determines candidates; the voice recognition unit; the handwritten character recognition unit; and the first selection unit.

前記第2の選択手段および前記判定部を制御する制御部
とを具備してなり、前記第1の選択手段により選択され
た複数の仮名漢字候補と前記第2の選択手段により選択
された複数の単語/熟語候補とを前記判定部に入ノル、
前記制御部の制御により前記判定部にて複数の候補中よ
り同一の候補を比較判定するよう構成した本発明によゲ
て達成される。
said second selection means and a control section that controls said determination section, said plurality of kana-kanji candidates selected by said first selection means and said plurality of kana-kanji candidates selected by said second selection means. Enter the word/idiom candidate into the judgment section,
This is achieved according to the present invention, wherein the determination unit compares and determines the same candidate from among a plurality of candidates under the control of the control unit.

即ち、未知入力音声を入力し音声認識する音声認識部と
9手書き文字を人力し文字認識する文字認識部をイ51
用して文字データを電子的に処理する処理装置に用いら
れる文字入力装置において5手?:き文字認識の場合に
文字の部分的!+、’l徴を書き。
In other words, the voice recognition unit inputs unknown input voice and recognizes the voice, and the character recognition unit inputs 9 handwritten characters and recognizes the characters.
5 moves in a character input device used in a processing device that electronically processes character data using a computer? : Partial character recognition in case of character recognition! Write the +, 'l signs.

文字の部分的特徴の「読み」を文学誌8ii1i L 
、部分的「読め」に属する文字の偏である部首よりなる
単詔詔党辞書や漢字−字毎の熟語諸量辞書とした漢和辞
典に相当する単語/ツ1語語當辞書を(IVi+え。
``Reading'' of partial characteristics of characters in literary magazine 8ii1i L
, a word/tu 1-word dictionary that is equivalent to a single imperial dictionary consisting of radicals that are partial partial readings of characters, and a Kanwa dictionary that is a dictionary of idioms for each kanji character. picture.

部分的「読め」に属する単語/熟語諸量辞書中より2部
分的「読み」の属するjr4語/熟語語党候補を選択し
1判定部にて音声認識部で得られた音声認識候補と同一
の候補を比較判定するよう構成することにより1部分的
な特徴を持つ文字のみを手書きで人力し、その部首また
は漢字−字の入力文字による候補の範囲か大幅に限定さ
れるため、これ等文字の一部分または文字列の一部によ
る手書き入力文字認識より得られた人力文字または入力
文字列候補と、音声認識による複数の文字列候補とを総
合的に判断して正しい判定結果かえられ。
Select JR4 words/idiom words to which the 2nd partial ``yomi'' belongs from the word/idiom dictionary that belongs to the 2nd partial ``yomi'', and in the 1st judgment section select the speech recognition candidates that are the same as the speech recognition candidates obtained by the speech recognition section. By configuring the system to compare and judge candidates, only characters with one partial characteristic are manually handwritten, and the range of candidates is greatly limited by the input character of the radical or kanji-character. The correct judgment result is changed by comprehensively judging human characters or input character string candidates obtained by handwritten input character recognition of a part of a character or a part of a character string, and a plurality of character string candidates by voice recognition.

高い認識率を確保しつ一つ、且つ、入力操作が容易に行
うことのできる文字入力装置を提供するものである。
An object of the present invention is to provide a character input device that can easily perform input operations while ensuring a high recognition rate.

(fl 発明の実施例 以下本発明の一実施例について説明する。第2図は本発
明による文字入力装置の構成ブロック図を示し、同一対
象物は第1図と同−符列で示ず。
Embodiment of the Invention An embodiment of the present invention will be described below. FIG. 2 shows a block diagram of the structure of a character input device according to the present invention, and the same objects are not shown with the same reference numerals as in FIG. 1.

21ば文字部首特徴パターン辞凹、22は卑語/熟語諸
量作成部、23は単語/熟語語党辞書を示す。文字部首
特徴パターン辞書21は文字の部首部分の特徴パラメー
タを標準文字部首パラメータとして予め登録した辞書で
あり2例えば1文字の部首[ンj、r:F′j、「■1
]J、r糸」・・・等の標?1(文字部首特徴パラメー
タに対応する読め毎に登録されている。単語/熟語作成
部22ば文字認識部8で得られた「読み」候補に属する
単語/ツ1語を単語/41語語示辞書23より選択し1
文字列候補を作成するものである。単語/熟語諸量辞刊
23には文字の各部首に属する複数の単語/熟語を部首
諸量毎に予め登録されている。
Reference numeral 21 indicates a character radical feature pattern dictionary, 22 indicates an idiom/idiom quantity creation unit, and 23 indicates a word/idiom dictionary. The character radical feature pattern dictionary 21 is a dictionary in which feature parameters of radical parts of characters are registered in advance as standard character radical parameters.
]J, r thread”...marks? 1 (registered for each reading corresponding to the character radical feature parameter. The word/idiom creation unit 22 converts one word/tzu belonging to the “reading” candidate obtained by the character recognition unit 8 into a word/41 words. Select from dictionary 23
It creates character string candidates. In the word/idiom quantity dictionary 23, a plurality of words/idioms belonging to each radical of a character are registered in advance for each radical quantity.

第2図におい゛ζ、マイクロホン1より人力した人力音
声を音声認識部2で音声認識し、仮名漢字変換部4より
文字判定部12に複数の文字列コードを入力するまでの
手順は、前記述と同様なので省略する。タブレット6に
指示ペン7で入力音声と同し文字の部首を手書きするこ
とにより、その座標データを文字認識部8に人力する。
In FIG. 2, the steps from the voice recognition unit 2 recognizing the human voice input through the microphone 1 to inputting multiple character string codes from the kana-kanji conversion unit 4 to the character determination unit 12 are as described above. Since it is the same as , it is omitted. By handwriting the same radical of a character as the input voice with an instruction pen 7 on a tablet 6, the coordinate data is inputted to a character recognition unit 8.

文字認識部8は人)jされた座標データの文字部首特徴
パラメータを抽出し、抽出した文字部首特徴パラメータ
と予め登録された文字部首特徴パターン辞書21の標準
文字部首特徴パラメータとを比較照合し、距離の最も近
い標準文字部首特徴パラメータが属する「読み」候補を
選択してi11語/ QpH詔詔党作成部22に入力す
る。単語/熟語語営作成部22は文字認識部8で得られ
た「読み」候補にこ属する複数のif=語/熟語候補を
単語/熟語諸量辞書23から読み出し、δftL7j変
換部10に人力する。JソLみ変換部10に入力された
複数の単語/熟語候補は読み変換辞書11を参照して手
摺き文字の読み文字コードに変換され1文字判定部12
に入力する。文字判定部12に入力された仮名漢字変換
部4からの音声認識結果の複数の文字列コードと、読み
変換部10からの手書き文字部首の文字認識結果の複数
の文字コー1との双方について比較照合し、前記述した
と同様の手順により同一の認識候補の文字がディスプレ
イ16に認識結果として表示される。
The character recognition unit 8 extracts the character radical feature parameters of the coordinate data, and compares the extracted character radical feature parameters with the standard character radical feature parameters of the character radical feature pattern dictionary 21 registered in advance. After comparison and collation, the "reading" candidate to which the closest standard character radical feature parameter belongs is selected and input to the i11 word/QpH imperial party creation section 22. The word/idiom creation section 22 reads out a plurality of if=word/idiom candidates that belong to the "reading" candidates obtained by the character recognition section 8 from the word/idiom quantity dictionary 23 and manually inputs them to the δftL7j conversion section 10. . A plurality of word/idiom candidates inputted to the J/SO/Lomi conversion section 10 are converted into pronunciation character codes of handrail characters with reference to the reading conversion dictionary 11, and then converted to the reading character code of the handrail characters.
Enter. Regarding both the plurality of character string codes of the voice recognition results from the kana-kanji conversion section 4 input to the character determination section 12 and the plurality of character string codes 1 of the character recognition results of handwritten character radicals from the reading conversion section 10 After comparison and collation, the same recognition candidate characters are displayed on the display 16 as recognition results in the same procedure as described above.

次に、実際例で説明すると5例えば、前記述と同様に1
連絡」という単語を人力する場合、音声認識側は「れ・
ん・ら・く」と発声し、「゛連絡」。
Next, to explain with a practical example, 5, for example, 1 as in the previous description.
When inputting the word ``contact'' manually, the voice recognition side
Say "N-ra-ku" and say "Contact."

「田楽」・・・等の文字列コー トが文字判定部12に
入力されることは前記述と同様であるが1文字認識側で
は、タブレット6に「連絡」のうちの1−− 車」とい
う「連」の部首を手摺きするのめでよい。
It is the same as the previous description that a character string code such as "Dengaku" is input to the character determination section 12, but on the single character recognition side, the tablet 6 is sent one of "Contact" to "Car". It is good to handrail the radical of ``ren''.

文字認識部8でタブレット6よりの座標データ「車」を
認識して「くるま」の読みを単語/ 9JH詔語光作成
部22に入力する。単語/熟語詔?作成部22ではjQ
語/熟語語諸量書23に登録されている「軌道」、「連
絡」、「連珠」、「軽快」・・・等の「車」偏のある諸
量を読み出して読み変換部10に入力し2文字コードに
変換される。文字判定部12で「田楽」、「軌道」、「
連珠」、「軽快」等をII除し、双方の候補に含まれる
「連絡」を認識判定しディスプレイ16に表示する。
The character recognition section 8 recognizes the coordinate data "car" from the tablet 6 and inputs the pronunciation of "car" to the word/9JH edict light creation section 22. Vocabulary/idiom edict? In the creation section 22, jQ
The various quantities with a "car" bias such as "trajectory", "contact", "renju", "light", etc. registered in the word/idiom word quantity book 23 are read out and input to the reading conversion unit 10. and converted to a two-letter code. The character determination unit 12 selects "Dengaku", "Kyoku", "
``Renju'', ``Kikai'', etc. are divided by II, and ``Contact'' included in both candidates is recognized and determined and displayed on the display 16.

また2例えば、「認識」という単語を入力する場合は、
「に・ん・し・き」と発声し、「言」を書く。音声認識
による候補は、「認識」、「新式」・・・等が選択され
、「言」を部首として持つ漢字を含む単語候補、「言上
J、r;ti上」、「訂正」、「認識」・・・等が選択
される。双方の候補に含まれるものとして「認識」が判
定結果となり、ディスプレイ16に表示される。
2For example, if you enter the word "recognition",
Say ``ni-n-shi-ki'' and write the ``word''. Candidates based on voice recognition include "recognition", "shinshiki", etc., and word candidates that include kanji with "go" as a radical, "gojo J, r; ti,""correction","Recognition", etc. are selected. As both of the candidates are included, "recognition" is the determination result and is displayed on the display 16.

以上の本発明による実施例を文字部首特徴パターン辞書
21に2文字の部首特徴標準パターンが登録されている
辞摺で説明したが、漢字−字毎の特徴積率パターンを登
録し2単語/熟語語堂辞書23に漢字−字毎の単語/熟
語の語量辞書を登録して置いても同様の結果かえられる
ことば言うまでもない。文字の一部分とするか1文字列
の一部とするかにより選択すればよい。
The above embodiment of the present invention has been explained using a dictionary in which standard radical feature patterns for two characters are registered in the character radical feature pattern dictionary 21. It goes without saying that the same result can be obtained even if a kanji-character-based word/idiom vocabulary dictionary is registered in the Ikugodo dictionary 23. The selection can be made depending on whether it is a part of a character or a part of a character string.

+gl 発明の詳細 な説明したように、未知入力音声を入力し音声認識する
音声認識部と9手書き文字を入力し文字認識する文字認
識部を(jf用して文字データを電子的に処理する処理
装置に用いられる文字入力装置において5手書き文字認
識とし゛ζ1文字の部分的特徴を書き1文字の部分的特
徴の1読み」を文字認識し1部分的「読め」に属する文
字の偏である部首よりなる単語語量辞書や漢字−字毎の
熟語語量辞書とした漢和辞典に相当する単語/熟語諸量
辞書を備え1部分的「読み」に属する単語/熟語諸量辞
書中より2部分的「読み」の属する単語/ Qp5語語
霊候補を選択し1判定部にて音声認識部で得られた音声
認識候補と同一の候補を比較判定するよう構成した本発
明により9部分的な特徴を持つ文字のめを手書きで入力
することにより。
+gl As described in detail of the invention, a voice recognition unit that inputs unknown input speech and recognizes the voice, and a character recognition unit that inputs handwritten characters and recognizes the characters (processing of electronically processing character data using jf). In the character input device used in the device, 5 handwritten character recognition is performed, ``ζ 1 character partial feature is written, 1 character partial feature 1 reading'' is character recognized, and 1 radical is the bias of the character belonging to the partial ``reading''. It is equipped with a word/idiom quantity dictionary equivalent to the Kanji dictionary, which is a dictionary with a word quantity dictionary and a kanji/idiom quantity dictionary for each character. The present invention is configured to select the word/Qp5 word spirit candidates to which "yomi" belongs, and compare and determine the same candidates as the speech recognition candidates obtained by the speech recognition section in the first judgment section. By handwriting the name of the character you have.

入力文字の候補の範囲が大幅に限定され2手書き文字認
識により得られた入力文字または入力文字列候補と、音
声認識による複数の文字列候補とを総合的に判断して正
しい判定結果が得られ、入力操作が容易となり、且つ、
高い認識率が確保される効果がある。
The range of input character candidates is greatly limited, and correct judgment results can be obtained by comprehensively judging the input character or input character string candidates obtained by handwritten character recognition and the multiple character string candidates obtained by voice recognition. , the input operation becomes easier, and
This has the effect of ensuring a high recognition rate.

【図面の簡単な説明】 第1図は従来の文字入力装置の構成ブロック図を示し、
第2図は本発明による文字入力装置の構成ブロック図を
示す。 図面において、1はマイクロホン、2は音声認識部、3
は音声特徴パラメータ辞書、4は仮名漢字変換部、5は
仮名漢字変換辞書、6はタブレット 7は指示ペン、8
は文字認識部、 10は読み変換部、 11は読め変換
辞書、 12は文字判定部、13は文字/単語辞書、1
4は主制御部、15は表示制御部。 16はディスプレイ、21は文字部首特徴パターン辞書
、22は単語/ツ1語諸量作成部、23は単語/熟語諸
量辞書をそれぞれ示す。
[Brief Description of the Drawings] Figure 1 shows a block diagram of a conventional character input device.
FIG. 2 shows a block diagram of a character input device according to the present invention. In the drawing, 1 is a microphone, 2 is a voice recognition unit, and 3 is a microphone.
is a voice feature parameter dictionary, 4 is a kana-kanji conversion unit, 5 is a kana-kanji conversion dictionary, 6 is a tablet, 7 is an indicator pen, 8
is a character recognition unit, 10 is a reading conversion unit, 11 is a reading conversion dictionary, 12 is a character judgment unit, 13 is a character/word dictionary, 1
4 is a main control section, and 15 is a display control section. Reference numeral 16 indicates a display, 21 a character radical feature pattern dictionary, 22 a word/twenty-word quantity creation unit, and 23 a word/idiom quantity dictionary.

Claims (1)

【特許請求の範囲】 文字データを電子的に処理する処理装置に用いられる文
字入力装置であって、未知入力音声を入力する音声入力
手段と1文字の部分的特徴形状を手書きして人力する手
書き文字入力手段と、前記゛音声人力手段により入力し
た音声情報を音響分析して得られた入力音声特徴パラメ
ータと、予め辞書に登録された単音節標準パラメータと
を照合し単音節文字列認識候補を選択する音声認識部と
。 前記音声認識部で得られた単音節文字列認識候補を、予
め辞書に登録された仮名漢字辞書と照合し複数の仮名漢
字候補を選択する第1の選択手段と。 前記手書き文字入力手段により入力した部分的特徴文字
情報をパターン分析して得られた部分的文字入力特徴パ
ラメータと、予め辞書に登録された部分的特徴文字標準
パラメータとを照合し1部分的文字「@み」候補を選択
する手書文字認識部と。 前記手書文字認識部で得られた部分的「読み」候補によ
り、予め登録された部分的文字「読み」に属する単語/
熟語諸量辞書から部分的文字「読み」候補の属する複数
の単語/熟語候補を選択する第2の選択手段と、前記第
1の選択手段により選択された複数の仮名漢字候補と前
記第2の選択手段により選択された複数の単語/熟語候
補とを比較判定する判定部と、前記音声認識部、前記手
書文字認識部、前記第1の選択手段、前記第2の選択手
段および前記判定部を制御する制御部とを具備してなり
、前記第1の選択手段により選択された複数の仮名漢字
候補と前記第2の選択手段により選択された複数の単語
/熟語候補とを前記判定部に人力し、前記制御部の制御
により前記判定部にて複数の候補中より同一の候補を比
較判定するよう構成したことを特徴とする文字入力装置
[Scope of Claims] A character input device used in a processing device that electronically processes character data, comprising a voice input means for inputting unknown input voice and a handwriting device for handwriting a partial characteristic shape of one character. The input voice feature parameters obtained by acoustically analyzing the voice information input by the character input means and the voice input means are compared with monosyllabic standard parameters registered in advance in a dictionary to identify monosyllabic character string recognition candidates. With a voice recognition unit to choose from. a first selection means for selecting a plurality of kana-kanji candidates by comparing the monosyllabic character string recognition candidates obtained by the speech recognition unit with a kana-kanji dictionary registered in advance in a dictionary; The partial character input characteristic parameters obtained by pattern analysis of the partial characteristic character information inputted by the handwritten character input means are compared with the partial characteristic character standard parameters registered in advance in the dictionary, and one partial character " A handwritten character recognition unit that selects ``@mi'' candidates. Words/words belonging to the pre-registered partial character "yomi" are determined by the partial "yomi" candidates obtained by the handwritten character recognition unit.
a second selection means for selecting a plurality of word/idiom candidates to which the partial character "reading" candidate belongs from the idiom dictionary; and a plurality of kana-kanji candidates selected by the first selection means and the second selection means. a determination unit that compares and determines a plurality of word/idiom candidates selected by the selection means, the speech recognition unit, the handwritten character recognition unit, the first selection unit, the second selection unit, and the determination unit and a control unit that controls the plurality of kana-kanji candidates selected by the first selection means and the plurality of word/idiom candidates selected by the second selection means to the determination unit. A character input device characterized in that the character input device is configured such that the determination unit compares and determines the same candidate from among a plurality of candidates under the control of the control unit.
JP59044511A 1984-03-08 1984-03-08 Character input device Granted JPS60189070A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP59044511A JPS60189070A (en) 1984-03-08 1984-03-08 Character input device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP59044511A JPS60189070A (en) 1984-03-08 1984-03-08 Character input device

Publications (2)

Publication Number Publication Date
JPS60189070A true JPS60189070A (en) 1985-09-26
JPH023222B2 JPH023222B2 (en) 1990-01-22

Family

ID=12693572

Family Applications (1)

Application Number Title Priority Date Filing Date
JP59044511A Granted JPS60189070A (en) 1984-03-08 1984-03-08 Character input device

Country Status (1)

Country Link
JP (1) JPS60189070A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992005517A1 (en) * 1990-09-26 1992-04-02 Roth Richard G Audio-augmented handwriting recognition
US6285785B1 (en) 1991-03-28 2001-09-04 International Business Machines Corporation Message recognition employing integrated speech and handwriting information
JP2008537806A (en) * 2005-02-08 2008-09-25 テジック コミュニケーションズ インク Method and apparatus for resolving manually input ambiguous text input using speech input

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1992005517A1 (en) * 1990-09-26 1992-04-02 Roth Richard G Audio-augmented handwriting recognition
US6285785B1 (en) 1991-03-28 2001-09-04 International Business Machines Corporation Message recognition employing integrated speech and handwriting information
JP2008537806A (en) * 2005-02-08 2008-09-25 テジック コミュニケーションズ インク Method and apparatus for resolving manually input ambiguous text input using speech input
JP4829901B2 (en) * 2005-02-08 2011-12-07 テジック コミュニケーションズ インク Method and apparatus for confirming manually entered indeterminate text input using speech input

Also Published As

Publication number Publication date
JPH023222B2 (en) 1990-01-22

Similar Documents

Publication Publication Date Title
US7428516B2 (en) Handwriting recognition using neural networks
Waibel et al. Multimodal interfaces
US5794204A (en) Interactive speech recognition combining speaker-independent and speaker-specific word recognition, and having a response-creation capability
US6167376A (en) Computer system with integrated telephony, handwriting and speech recognition functions
JPS59139485A (en) Pattern identification method and apparatus
JPH07105316A (en) Handwritten-symbol recognition apparatus
CN108446278B (en) A kind of semantic understanding system and method based on natural language
CN102439660A (en) Voice-tag method and apparatus based on confidence score
US7424156B2 (en) Recognition method and the same system of ingegrating vocal input and handwriting input
Leedham et al. Automatic recognition and transcription of Pitman's handwritten shorthand—An approach to shortforms
KR20150045335A (en) Method and apparatus for translation sign language into character
Wazalwar et al. Multimodal Interface for deaf and dumb communication
Suhm Multimodal interactive error recovery for non-conversational speech user interfaces
JPS60189070A (en) Character input device
Miyao et al. An online handwritten music score recognition system
US20160253992A1 (en) Ocr through voice recognition
Abbott et al. Identifying an aurally distinct phrase set for text entry techniques
JPS592191A (en) Recognizing and processing system of handwritten japanese sentence
JPH086940A (en) Voice input system and information processor using the system
JPH05119793A (en) Method and device for speech recognition
JPH10198766A (en) Device and method for recognizing character, and storage medium
JP2022183012A (en) Display device, display system, display method, and program
Jeong et al. Syllable-level Korean Fingerspelling Recognition from a Video
JPS6091435A (en) Character input device
JPS61139828A (en) Language input device

Legal Events

Date Code Title Description
LAPS Cancellation because of no payment of annual fees