JPH02206825A - Device for preparing minutes - Google Patents

Device for preparing minutes

Info

Publication number
JPH02206825A
JPH02206825A JP1026869A JP2686989A JPH02206825A JP H02206825 A JPH02206825 A JP H02206825A JP 1026869 A JP1026869 A JP 1026869A JP 2686989 A JP2686989 A JP 2686989A JP H02206825 A JPH02206825 A JP H02206825A
Authority
JP
Japan
Prior art keywords
voice
sentence
speaker
words
minutes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP1026869A
Other languages
Japanese (ja)
Inventor
Koichi Iwata
耕一 岩田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meidensha Corp
Meidensha Electric Manufacturing Co Ltd
Original Assignee
Meidensha Corp
Meidensha Electric Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Meidensha Corp, Meidensha Electric Manufacturing Co Ltd filed Critical Meidensha Corp
Priority to JP1026869A priority Critical patent/JPH02206825A/en
Publication of JPH02206825A publication Critical patent/JPH02206825A/en
Pending legal-status Critical Current

Links

Abstract

PURPOSE:To securely and speedily prepare minutes without depending on a manual operation and to correct the content of a statement while the processing is expedited by automatically making a sentence from the voice of the speaker of the processing, and preparing a summarized sentence so as to visualize it. CONSTITUTION:In a voice recognition device 4, a voice signal from a microphone 1 and the like is segmented at every constant period, and a characteristic parameter is extracted by Fourier-transform and the like so as to segment words. The device 4 segments the words and identifies the speaker of the voice signal concerned by comparing the words with the voice characteristic parameter of an attendance registered in an attendance voice registration device 3. A sentence preparation device 5 fetches a word string which has been speaker- identified from the device 4 together with speaker identification information, analyzes a construction and a meaning by considering the context in terms of words. Furthermore, the device 5 prepares the meaningful sentence by bringing in a dictionary for processing and the like. A sentence summary device 6 fetches information from the device 5, which to made into the sentence, summarizes it, and displays it in a display device 8.

Description

【発明の詳細な説明】 A、産業上の利用分野 本発明は、議事録を作成するための装置に関する。[Detailed description of the invention] A. Industrial application field The present invention relates to a device for creating minutes.

B1発明の概要 本発明は、議事録を作成するにおいて、発言者の音声認
識と文章化と文章要約と可視化を自動的に行うことによ
り、 議事録の作成に人手を使うことなく確実、迅速に行うこ
とができるようにしたものである。
B1 Overview of the Invention The present invention automatically recognizes the speaker's voice, converts it into text, summarizes the text, and visualizes it, thereby reliably and quickly creating the minutes without using any human hands. It has been made possible to do so.

C9従来の技術 会議、講演会、講習会等の議事録作成には、議事出席者
の一人が記録係となって専門に議事録を作成−するか、
テープレコーダ等で音声記録をしておきこれを後に担当
者が聴き直して議事録を作成するようにしている。
C9 When creating the minutes of conventional technical meetings, lectures, training sessions, etc., one of the attendees should act as the recorder and prepare the minutes professionally.
Audio is recorded using a tape recorder, etc., and the person in charge later listens to it again to create minutes.

D0発明が解決しようとする課題 前者の議事録作成方法では、記録係になるものは議事に
参加するのが難しくなるし、専門の速記者を必要とする
場合が多い。一方、後者の作成方法では、議事録の作成
が時間的4こずれるため、作成後の修正や誤り訂正に発
言者の再チエツクに相当の遅れを伴う。
The problem that the D0 invention aims to solve In the former method of creating minutes, it becomes difficult for the recorder to participate in the proceedings, and a specialized stenographer is often required. On the other hand, in the latter preparation method, the preparation of the minutes is delayed by 4 hours, so there is a considerable delay in re-checking the speaker for corrections and error corrections after the minutes have been prepared.

本発明の目的は、議事録を人手を使うことなく確実、迅
速に自動作成できる議事録作成装置を提供することにあ
る。
An object of the present invention is to provide a minutes creation device that can automatically create minutes reliably and quickly without using any human labor.

80課題を解決するための手段 本発明は、上記目的を達成するため、議事出席者の音声
特徴パラメータを登録しておく出席者音声登録装置と、
議事発言者の発言音声信号を得る発言音入力装置と、前
記発言音声信号をその特徴パラメータから単語に切出す
と共に前記音声特徴パラメータとの比較によって発言者
の同定を行う音声認識装置と、前記切出された単語及び
発言者識別情報による音声特徴パラメータから構文解析
及び意味解析によって文章化を行う文章作成装置と、前
記文章化されたデータから文章の要約を行う文章要約装
置と、前記要約された文章を発言番名と共に記録する議
事録出力装置とを備え、発言者の音声を発言音別に認識
してその文章化を行い、さらに文章を要約して可視化し
、これら処理を自動的に行う。
Means for Solving 80 Problems In order to achieve the above object, the present invention provides an attendee voice registration device for registering voice characteristic parameters of conference attendees;
a speech sound input device that obtains a speech signal of a speaker, a speech recognition device that cuts the speech signal into words based on its feature parameters and identifies the speaker by comparing the speech feature parameters with the speech feature parameters; a sentence creation device that converts speech feature parameters based on spoken words and speaker identification information into sentences by syntactic analysis and semantic analysis; a sentence summarization device that summarizes sentences from the transcribed data; It is equipped with a minutes output device that records sentences together with the name of the speaking number, recognizes the voice of the speaker by speech sound, converts it into sentences, further summarizes and visualizes the sentences, and automatically performs these processes.

F、実施例 第1図は本発明の一実施例を示すブロック図である。マ
イクロホンIは議事発言者の発言音声を入力する発言者
入力手段とされ、これに代えてテープレコーダ2等の録
音音声とする場合もある。
F. Embodiment FIG. 1 is a block diagram showing an embodiment of the present invention. The microphone I is used as a speaker input means for inputting the speech voice of the speaker, and may be replaced with a voice recorded by a tape recorder 2 or the like.

出席者音声登録装置3は議事開始に先立って議事出席者
全員の特徴音声及びその氏名発声音を入力することで出
席者毎の音声特徴パラメータをテーブルデータとして登
録する。
Prior to the start of the proceedings, the attendee voice registration device 3 registers the voice characteristic parameters of each attendee as table data by inputting the characteristic voices of all the attendees and their name pronunciation sounds.

音声認識装置4は、マイクロホン1等からの音声信号を
一定周期(例えば5〜10m5ec)毎に切出し、フー
リエ変換等により特徴パラメータを抽出して単語切出し
を行う。この音声特徴パラメータからの単語切出しは、
例えば隔週刊誌、日経エレクトロニクス出版、「ニュー
ラルネットを音声タイプライタに応用するJ19B8年
6月13日号に記載される方法によって実現される。
The speech recognition device 4 cuts out the speech signal from the microphone 1 or the like at regular intervals (for example, 5 to 10 m5ec), extracts characteristic parameters by Fourier transform, etc., and cuts out words. Word extraction from this speech feature parameter is
For example, this can be realized by the method described in the biweekly magazine, Nikkei Electronics Publishing, ``Applying neural net to voice typewriter'' June 13, J19B8 issue.

上述の音声認識装置4は、単語切出しを行うと共に、出
席者音声登録装置3に登録する出席者音声特徴パラメー
タとの比較によって当該音声信号の話者同定を行う。
The above-mentioned speech recognition device 4 performs word extraction, and also performs speaker identification of the speech signal by comparison with the attendee speech feature parameters registered in the attendee speech registration device 3.

文章作成装置5は、話者同定された単語列を話者識別情
報と共に音声認識装置4から取込み、単語単位の前後関
係を考慮した構文解析及び意味解析を行い、さらに議事
用語辞典等を参照して意味のある文章を生成する。
The sentence creation device 5 takes in the speaker-identified word string together with the speaker identification information from the speech recognition device 4, performs syntactic analysis and semantic analysis taking into account the context of each word, and further refers to a dictionary of proceedings terms and the like. generate meaningful sentences.

文章要約装置6は、文章作成装置5からの文章化された
情報を取込み、この要約を行う。この文章要約を第2図
を参照して説明する。
The text summarization device 6 takes in text information from the text creation device 5 and summarizes the information. This text summary will be explained with reference to FIG.

入力された原文量は、まずキーワード抽出部11によっ
て原文量中のキーワードが自動抽出されると共に、発言
内容の性質が分析される。この分折は、当該文章が質問
になるか、答えになるか、意味になるか、感想になるか
等の分析さらに答えや意味が肯定的か否定的かを分析し
、分析結果は当該文章に対して発言属性テーブル12に
登録される。
First, the keyword extraction unit 11 automatically extracts keywords from the input source text and analyzes the nature of the content of the statement. This analysis involves analyzing whether the sentence in question is a question, an answer, a meaning, or an impression, and then analyzing whether the answer or meaning is positive or negative. is registered in the comment attribute table 12.

次に、テーブル!2の発言属性データとキーワード抽出
部11のキーワードが当該文章と共に発言音別に発言内
容テーブル13及び議事内容経過テーブル14に発言者
及び議題をキーとして登録される。さらに、テーブル1
4の内容を解析してそれまでの贅成意見数9反対意見数
及びその内容が統計分析され、この分析結果が議事経過
統計テーブル!5に登録される。
Next, the table! The statement attribute data of No. 2 and the keywords of the keyword extraction unit 11 are registered together with the text in the statement contents table 13 and the proceedings progress table 14 for each speech sound, using the speaker and the topic as keys. Furthermore, table 1
After analyzing the content of 4, the number of luxurious opinions, 9 dissenting opinions, and their contents were statistically analyzed, and the results of this analysis are the minutes progress statistics table! Registered in 5.

上述までの各テーブル13,14.15のデータはニュ
ーロメモリによる文章要約部16に転送され、要約部!
6ではキーワード、発言属性テーブルI2の属性データ
及び同意語/反意語辞書部17と要約側辞書18の参照
によって連想演算が実行され、要約文の作成がなされる
The data in each of the tables 13, 14, and 15 described above is transferred to the sentence summary unit 16 using neuromemory, and the summary unit!
In step 6, an associative operation is executed by referring to the keyword, the attribute data of the comment attribute table I2, the synonym/antonym dictionary section 17, and the summary dictionary 18, and a summary sentence is created.

このような文章要約は、例えば議事が下記手順で発言者
A、B、Cによる発言・文章化されたとき、 (A1)本日はお忙しい所・・・新製品Xの会議を始め
たいと思います。
Such a text summary can be created, for example, when the proceedings are uttered and written by speakers A, B, and C according to the following procedure: (A1) I'm busy today...I'd like to start a meeting about new product X. .

(B1)新製品Xの開発計画は・・・のようになってお
ります。
(B1) The development plan for new product X is as follows.

(CI)スケジュール通りに時間は守れますか?(B2
)・・・の点が問題ですが、概ね計画通りに進行する予
定です。
(CI) Are you able to keep to your schedule on time? (B2
)... is a problem, but it is expected to proceed as planned.

上述の原文量に対して、キーワード抽出は新製品Z、開
発計画、スケジュール、時間等になり、発言属性は発言
(AI)では議題提示、発言(Bl)では紹介、発言(
CI)では質問、発言(B2)では答えになる。また、
発言(C1)では質問数テーブルデータが+1される。
For the above-mentioned amount of original text, keyword extraction is new product Z, development plan, schedule, time, etc., and comment attributes are agenda presentation for comment (AI), introduction, comment (for comment (Bl)), etc.
CI) is a question, and statement (B2) is an answer. Also,
In the statement (C1), the question number table data is incremented by 1.

こうした分析による要約結果例は下記のようになる。An example of the summary results from such an analysis is as follows.

(AI)新製品Xの会議。(AI) New product X meeting.

(Bl)新製品開発計画の紹介。(Bl) Introduction of new product development plan.

(CI)開発スケジュールの質問。(CI) Development schedule question.

(B2)計画は概ね予定通り。(B2) The plan is generally on schedule.

次に、第1図に戻って、文章要約装置6によりて要約さ
れた文章は発言者名と共に漢字プリンタ7やデイスプレ
ィ装置8に印字・表示される。また、文章要約装置6に
よる発言属性テーブル作成や発言属性が肯定か否定かの
判定ができないとき、要約不能伝達手段として音声合成
装置9と音声出力袋M10を利用して音声による要約不
能を出力する。例えば、要約不能時に、定形文として登
録する [ただいまの発言は要約できません。もう−度趣旨をお
話し願います。] の文章を音声合成し、スピーカ等による音声出力を得る
。この要約不能伝達によって、あいまいな発言内容の訂
正と明瞭化を図る。
Next, returning to FIG. 1, the sentence summarized by the sentence summarizing device 6 is printed and displayed on the kanji printer 7 and the display device 8 together with the speaker's name. Furthermore, when the sentence summarization device 6 cannot create a comment attribute table or determine whether a comment attribute is affirmative or negative, the speech synthesis device 9 and the audio output bag M10 are used as a means of transmitting the non-summarization to output a speech indicating that the text cannot be summarized. . For example, when you cannot summarize, you can register it as a fixed phrase. [The current statement cannot be summarized.] Please tell me the purpose again. ] The text is synthesized into speech, and the audio output is obtained from a speaker or the like. This unsummarizable communication helps correct and clarify ambiguous statements.

以上までのことから、本実施例では議事参加者全員の発
言がなされる都度その音声認識と文章化と要約と可視化
が自動的に行われ、また不明確な発言内容には再発言を
促して認識文章化等を確実にすると共に発言内容の確実
化を図って議事密度を高める。そして、自動化によって
人手による議事録作成を不要にしながら発言とほぼ同時
の議事録作成になる。
Based on the above, in this embodiment, voice recognition, transcription, summarization, and visualization are automatically performed every time a statement is made by all participants in the discussion, and if the content of the statement is unclear, the speaker is prompted to repeat the statement. Increasing the density of the proceedings by ensuring the recognition and writing, etc., and ensuring the content of what is being said. Then, through automation, the minutes can be created almost simultaneously with the statements being made, eliminating the need for manual minutes.

G0発明の効果 以上のとおり、本発明によれば、議事発言者の音声から
自動的にその文章化と要約文章を作成して可視化するよ
うにしたため、人手にたよることなく確実、迅速な議事
録作成ができ、また議事進行途中で発言内容の訂正や修
正も行うことができる。
Effects of the G0 Invention As described above, according to the present invention, since the voice of the speaker is automatically converted into text and a summary sentence is created and visualized, the discussion can be carried out reliably and quickly without relying on human hands. Recordings can be made, and comments and corrections can be made during the proceedings.

【図面の簡単な説明】[Brief explanation of the drawing]

第1図は本発明の一実施例を示すブロック図、第2図は
第1図における文章要約装置のブロック図である。 l・・・マイクロホン、3・・・出席者音声登録装置、
4・・・音声認識装置、5・・・文章作成装置、6・・
・文章要約装置、7・・・漢字プリンタ、8・・・デイ
スプレィ装置、9・・・音声合成装置、11・・・キー
ワード抽出部、12・・・発言属性テーブル、13・・
・発言内容テーブル、14・・・議事内容経過テーブル
、15・・・議事経過統計テーブル、16・・・文章要
約部、17・・・同意語/反!!語辞書、18・・・要
約側辞書。
FIG. 1 is a block diagram showing an embodiment of the present invention, and FIG. 2 is a block diagram of the text summarization device shown in FIG. l...Microphone, 3...Attendee voice registration device,
4...Speech recognition device, 5...Text creation device, 6...
- Sentence summary device, 7... Kanji printer, 8... Display device, 9... Speech synthesis device, 11... Keyword extraction unit, 12... Speech attribute table, 13...
・Remarks content table, 14... Minute progress table, 15... Minute progress statistics table, 16... Sentence summary section, 17... Synonyms/contras! ! Word dictionary, 18... summary side dictionary.

Claims (1)

【特許請求の範囲】[Claims] (1)議事出席者の音声特徴パラメータを登録しておく
出席者音声登録装置と、議事発言者の発言音声信号を得
る発言音入力装置と、前記発言音声信号をその特徴パラ
メータから単語に切出すと共に前記音声特徴パラメータ
との比較によって発言者の同定を行う音声認識装置と、
前記切出された単語及び発言者識別情報による音声特徴
パラメータから構文解析及び意味解析によって文章化を
行う文章作成装置と、前記文章化されたデータから文章
の要約を行う文章要約装置と、前記要約された文章を発
言者名と共に記録する議事録出力装置とを備えたことを
特徴とする議事録作成装置。
(1) An attendee voice registration device that registers the voice characteristic parameters of the conference attendees, a voice input device that obtains the voice signal of the voice speaker, and a voice input device that extracts the voice signal from the voice characteristic parameters into words. and a speech recognition device that identifies a speaker by comparing the speech feature parameters with the speech feature parameters;
a sentence creation device that converts the extracted words and speech feature parameters based on the speaker identification information into sentences by syntactic analysis and semantic analysis; a sentence summarization device that summarizes sentences from the text-formed data; and the summarization device. What is claimed is: 1. A minutes creation device comprising: a minutes output device for recording written sentences together with names of speakers.
JP1026869A 1989-02-06 1989-02-06 Device for preparing minutes Pending JPH02206825A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP1026869A JPH02206825A (en) 1989-02-06 1989-02-06 Device for preparing minutes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP1026869A JPH02206825A (en) 1989-02-06 1989-02-06 Device for preparing minutes

Publications (1)

Publication Number Publication Date
JPH02206825A true JPH02206825A (en) 1990-08-16

Family

ID=12205300

Family Applications (1)

Application Number Title Priority Date Filing Date
JP1026869A Pending JPH02206825A (en) 1989-02-06 1989-02-06 Device for preparing minutes

Country Status (1)

Country Link
JP (1) JPH02206825A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09281991A (en) * 1996-04-18 1997-10-31 Nec Software Ltd Speech totalizing system and speech totalizing method
JPH11344995A (en) * 1998-06-01 1999-12-14 Olympus Optical Co Ltd Voice data recording and reproducing device
JP2000352996A (en) * 1999-03-26 2000-12-19 Canon Inc Information processing device
JP2004020739A (en) * 2002-06-13 2004-01-22 Kojima Co Ltd Device, method and program for preparing minutes
JP2007180828A (en) * 2005-12-27 2007-07-12 Canon Marketing Japan Inc Network conference system, network conference method, and program for executing the method
JP2021067830A (en) * 2019-10-24 2021-04-30 日本金銭機械株式会社 Minutes creation system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09281991A (en) * 1996-04-18 1997-10-31 Nec Software Ltd Speech totalizing system and speech totalizing method
JPH11344995A (en) * 1998-06-01 1999-12-14 Olympus Optical Co Ltd Voice data recording and reproducing device
JP2000352996A (en) * 1999-03-26 2000-12-19 Canon Inc Information processing device
JP2004020739A (en) * 2002-06-13 2004-01-22 Kojima Co Ltd Device, method and program for preparing minutes
JP2007180828A (en) * 2005-12-27 2007-07-12 Canon Marketing Japan Inc Network conference system, network conference method, and program for executing the method
JP2021067830A (en) * 2019-10-24 2021-04-30 日本金銭機械株式会社 Minutes creation system

Similar Documents

Publication Publication Date Title
Matheson The Voice Transcription Technique: Use of Voice Recognition Software to Transcribe Digital Interview Data in Qualitative Research.
Mergenthaler et al. Psychotherapy transcription standards
Forbes-Riley et al. Predicting emotion in spoken dialogue from multiple knowledge sources
Roberts et al. Interobserver agreement on first-stage conversation analytic transcription
CN101551947A (en) Computer system for assisting spoken language learning
JPH11513144A (en) Interactive language training device
WO2004063902B1 (en) Speech training method with color instruction
JP6705956B1 (en) Education support system, method and program
Wendahl et al. Identification of stuttering during relatively fluent speech
Liscombe Prosody and speaker state: paralinguistics, pragmatics, and proficiency
Batliner et al. On laughter and speech-laugh, based on observations of child-robot interaction
Wagner et al. Applying cooperative machine learning to speed up the annotation of social signals in large multi-modal corpora
Nagano et al. Data augmentation based on vowel stretch for improving children's speech recognition
CN108986785B (en) Text recomposition method and device
CN110675292A (en) Child language ability evaluation method based on artificial intelligence
Zue et al. The collection and preliminary analysis of a spontaneous speech database
JPH02206825A (en) Device for preparing minutes
Galibert et al. Ritel: an open-domain, human-computer dialog system.
CN112767940B (en) Voice training recognition method, system, equipment and storage medium
Louw Automated transcription software in qualitative research
CN114241835A (en) Student spoken language quality evaluation method and device
Kraleva Design and development a children's speech database
Fogg et al. Improving Transcription of Qualitative Research Interviews with Speech Recognition Technology.
Soclof et al. Collection and analysis of spontaneous and read corpora for spoken language system development.
Ma et al. Optimization of Computer Aided English Pronunciation Teaching System Based on Speech Signal Processing Technology