KR20130116128A - Question answering system using speech recognition by tts, its application method thereof - Google Patents

Question answering system using speech recognition by tts, its application method thereof Download PDF

Info

Publication number
KR20130116128A
KR20130116128A KR1020120038840A KR20120038840A KR20130116128A KR 20130116128 A KR20130116128 A KR 20130116128A KR 1020120038840 A KR1020120038840 A KR 1020120038840A KR 20120038840 A KR20120038840 A KR 20120038840A KR 20130116128 A KR20130116128 A KR 20130116128A
Authority
KR
South Korea
Prior art keywords
voice
answer
question
sentence
text
Prior art date
Application number
KR1020120038840A
Other languages
Korean (ko)
Inventor
윤재민
Original Assignee
윤재민
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 윤재민 filed Critical 윤재민
Priority to KR1020120038840A priority Critical patent/KR20130116128A/en
Publication of KR20130116128A publication Critical patent/KR20130116128A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/63Querying
    • G06F16/638Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • G10L13/08Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/221Announcement of recognition results

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a voice recognition question answering system using TTS and a method thereof, and more particularly, to recognize a question and answer voice from a user's voice and convert the question and answer sentence to the question and answer. Store a text file, index and store the question and answer sentence;
When a user inputs a question by voice, voice is converted into text after voice recognition, and a question-and-answer is performed. The voice using TTS outputs an answer to a sentence input by the question and answer as voice and text. A perception question answering system and method.

Figure pat00001

Description

Question answering system using speech recognition by TTS, its application method

The present invention relates to a voice recognition question answering system using TTS and a method thereof, and more particularly, to recognize a question and answer voice from a user's voice and convert the question and answer sentence to the question and answer. Store a text file, index and store the question and answer sentence;

When a user inputs a question by voice, voice is converted into text after voice recognition, and a question-and-answer is performed. The voice using TTS outputs an answer to a sentence input by the question and answer as voice and text. A perception question answering system and method.

The Q & A system has asked the system in order to obtain the knowledge desired by the user, and the system has analyzed the Q & A system and outputted the related answers. Thus, the Q & A system has been implemented in various ways. However, existing systems have limitations in that questions and answers are stored and expressed in text form.

The present invention has been proposed to solve the above problems, and has presented a method of storing a question and answer sentence by voice and a method of talking by voice.

Voice recognition question and answer system using TTS according to the characteristics of the present invention for achieving the above object is

Recognizes the voice of the question and answer from the user's voice and converts it to a question and answer sentence, saves the text file for the question and answer, indexes and stores the question and answer sentence,

When the user inputs a question by voice, the voice signal is converted into text after voice recognition, and a question and answer is performed, and the answer to the sentence input by the question and answer is output as voice and text.

In addition, the voice recognition question and answer system using TTS according to the characteristics of the present invention

Voice input device for receiving a voice,

Voice input unit for converting the analog voice transmitted through the voice input device into a digital signal,

A voice recognition unit for performing voice recognition from the voice information received by the voice input unit, a natural language processing unit for indexing or performing a question and answer based on information converted from voice to text by the voice recognition unit;

A text output unit for outputting the response transmitted from the natural language processing unit to the monitor screen as text;

A TIES unit for converting the answer sentence into a voice, A voice output unit for converting the voice from a digital signal to an analog signal,

It includes a voice output device for outputting the voice to the earphone or speaker.

In addition, in the operating method of the voice recognition question and answer system using the TS according to the characteristics of the present invention a method for storing the question and answer sentences by voice,

Step 1 of receiving a question and answer by voice;

Two steps of speech recognition;

Storing the voice recognized sentences as question and answer sentences;

Indexing the question and answer sentences;

.

And, in the method of operating the voice recognition question and answer system using the TTS according to the characteristics of the present invention the method of question and answer conversation by voice

Step 1 of receiving a question by voice;

Two steps of speech recognition;

3) performing a question and answer processing with sentence information (text) generated after the speech recognition;

Outputting a response extracted or generated by the question and answer as an answer voice and an answer text;

.

According to the embodiment of the present invention, there is an effect of storing the question and answer sentence by voice, or by talking by voice.

1 is a view showing the internal configuration of the voice recognition question and answer system using the TS according to an embodiment of the present invention.
2 is a flowchart illustrating a method of storing a question and an answer from a voice in a voice recognition question and answer system using TTS according to an embodiment of the present invention.
3 is a diagram illustrating a method of storing a question and an answer from a voice in a voice recognition question and answer system using TTS according to an exemplary embodiment of the present invention.
4 is a flowchart illustrating a method of question-and-answer conversation with voice in a voice recognition question-and-answer system using TTS according to an embodiment of the present invention.
5 is a diagram illustrating a method of question-and-answer conversation with voice in a voice recognition question-and-answer system using TTS according to an embodiment of the present invention.
6 is an example of a screen for talking with a voice in a voice recognition question and answer system using TTS according to an embodiment of the present invention.
7 is an example of a screen for talking by voice in a voice recognition question and answer system using TTS according to an embodiment of the present invention.
8 is an example of a question and answer sentence display screen after the question and answer voice input in the voice recognition question and answer system using TTS according to an embodiment of the present invention.
9 is an example of a question and answer sentence display screen after the question and answer voice input in the voice recognition question and answer system using TTS according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains can easily carry out the embodiments.

Since the present invention can be implemented in various different forms, the present invention is not limited to the exemplary embodiments described herein, and parts not related to the description are omitted in the drawings in order to clearly describe the present invention.

1 is a view showing the internal configuration of the voice recognition question and answer system using the TS according to an embodiment of the present invention.

As shown in Figure 1, the present invention

Voice input device 100 for receiving a voice,

Voice input unit 110 for converting the analog voice transmitted through the voice input device into a digital signal,

A voice recognition unit 120 for performing voice recognition from the voice information received by the voice input unit, a natural language processor 130 for indexing or performing a question and answer based on information converted from voice to text by the voice recognition unit,

Text output unit 140 for outputting the response transmitted from the natural language processing unit as a text on the monitor 150 screen,

The Teeth unit 161 for converting the answer sentence into a voice, the voice output unit 160 for converting the voice from a digital signal to an analog signal,

Voice output device 170 for outputting the voice to the earphone or speaker.

Through this, the voice of the question and answer is recognized from the user's voice and converted into a question and answer sentence, storing the text file for the question and answer, indexing and storing the question and answer sentence,

When the user inputs a question by voice, the voice may be converted into text after voice recognition, and a question and answer may be performed to output an answer to a sentence input by the question and answer in voice and text.

Voice recognition question and answer system using TTS according to an embodiment of the present invention can be operated in a medium capable of two-way voice and data communication, such as personal computer (PC), notebook, smart phone (iPhone, Android phone, Google phone, etc.) have.

Here, TTS is an automatic text-to-speech technology, which stands for Text to speech.

The voice input unit 110 provides a predetermined question input unit and answer input unit,

When the question input unit receives a question from a user by voice, the question voice is displayed as a question sentence after speech recognition,

When the answer input unit receives an answer from the user by voice, the answer voice is displayed as an answer sentence after speech recognition,

When the voice input of the question and answer is completed and the user detects the input completion button click, the question sentence and the answer sentence are indexed, and the position information (sentence number) of the question sentence and the response sentence in which a specific word (keyword) occurs is generated. Save to DB.

Voice recognition question answering system using TTS according to an embodiment of the present invention detects the user's voice and displays the voice recognition result in the question input window, find the answer sentence for the question by the question and answer answer input window Display the response sentence in, and output the answer voice using TTS.

In addition, when outputting answers using Titles, users can choose from a variety of voice-overs by voice, age, and gender.

In addition, the user's voice is detected, and after voice recognition of the voice data detected as a meaningful voice, if there is no voice recognition result, the user is prompted to input the voice again so that the user can input the voice correctly.

The voice input and output method converts a question voice, which is an analog signal transmitted to an external microphone or an internal microphone of a terminal, from a voice input unit to a digital signal, and a voice output consisting of earphones or speakers. The analog signal is converted and output through the device.

At this time, the text output unit displays the text information on the screen of the terminal.

After the voice recognition by the voice recognition unit 120, the sentence text information resulting from the voice recognition is stored in the question and answer DB, indexing process based on the information consisting of a pair of questions and answer sentences in the question and answer DB 121 To store in the indexing DB (122).

In addition, the speech recognition unit 120 recognizes speech by a predetermined speech recognition algorithm and converts the speech into sentence text, and stores the sentence text as text information.

The natural language processor 130 finds an answer by a question and answer module 132 that finds an answer to a specific question, based on the question and answer sentence information converted from the voice into the text by the voice recognition unit 120. Generate an answer.

And, the question and answer module 132 performs a sentence analysis process from the question sentence to determine the exact question intention, and the question requiring the correct answer brings the answer from the pre-built answer DB, when the specific information is requested You will generate answers based on the information.

The question and answer module 132 may generate an answer by obtaining the corresponding information through a wired or wireless communication network when the question sentence requests specific information such as time, news, and weather.

In the operation method of the voice recognition Q & A system using TTS, the method of storing the question and answer sentence by voice,

Step 1 of receiving a question and answer by voice (S100);

Two steps (S110) of speech recognition;

Storing the voice-recognized sentence as a question and answer sentence (S120_);

Indexing the question and answer sentences (S130);

.

2 is a flowchart illustrating a method of storing a question and an answer from a voice in a voice recognition question and answer system using TTS according to an embodiment of the present invention.

By receiving the user's voice for the question and answer (S200), by recognizing the voice for the question and answer (S210) to convert the question and answer sentences, extract the text file for the question and answer (S220), It is stored in the question and answer DB (S230), and indexing the question and answer sentences (S240) and indexing DB (S250) is stored.

Indexing DB stores the morphological information list of the words appearing in the question and answer sentence, and the position information (phrase number) of the question sentence and answer sentence in which the morpheme occurred.

3 is a diagram illustrating a method of storing a question and an answer from a voice in a voice recognition question and answer system using TTS according to an exemplary embodiment of the present invention.

The procedure for receiving a question and answer by the voice,

Providing a predetermined question input unit and a response input unit, and providing the user with the question input unit to receive a question by voice, receives a voice recognition result, displays the question voice as a question text,

When the answer input unit is provided to the user and the answer is input by voice, the voice recognition result is returned, the answer voice is displayed as the answer text,

When the voice input of the question and answer is completed and a click of the input completion button is detected from the user, the question sentence and the answer sentence are indexed, and the position information (sentence number) of the question sentence and the answer sentence in which a specific word (keyword) occurs. Save to DB.

When recording with voice recognition,

It receives the question input voice and the answer input voice, respectively, converts the voice into a question sentence and an answer sentence, stores them in a DB, indexes them by keywords through a morphological analysis process, and positions of the question sentence and the answer sentence in which the keyword appears for each keyword. Record the information (sentence number).

4 is a flowchart illustrating a method of question-and-answer conversation with voice in a voice recognition question-and-answer system using TTS according to an embodiment of the present invention.

In the operation method of the voice recognition question answering system using TTS,

Step 1 of receiving a question by voice (S300);

Two steps (S310) of speech recognition;

A step 3 of performing a question and answer processing of the sentence information (text) generated after the speech recognition (S320);

Outputting the answer extracted or generated by the question and answer as an answer voice and an answer text (S330);

.

The first step in answering questions by voice,

After detecting the user's voice, the voice recognition result is returned and displayed in the question input window. After answering the question, the answer sentence is displayed on the answer input window, and the answer voice is output to the TS.

The first step in answering questions by voice,

A separate voice input device may be attached to the outside of the terminal or receive a user's question voice in real time using a built-in voice input device (microphone).

Here, if the voice is not received, the method further includes receiving text.

The second stage of speech recognition,

Recognizing a speech by a predetermined speech recognition algorithm and converting the speech into text (sentence).

Three steps of query response processing of the text (sentence) generated after the speech recognition,

Based on the question information converted from voice to text (sentence), the answer is generated or the answer is generated by the Q & A module that finds the answer to a specific question.

Three steps of query response processing of the text (sentence) generated after the speech recognition,

The question-and-response module performs a sentence analysis process (morphological analysis, syntax analysis, semantic analysis, speech act analysis) from the question sentence to determine the exact question intention, and the question requiring the correct answer has an answer in a pre-built answer DB. When a request for specific information comes, an answer is generated based on the information, and an answer requiring daily life or common sense finds an answer sentence using a similarity search method.

Three steps of query response processing of the text (sentence) generated after the speech recognition,

The question-and-answer module may generate an answer by obtaining the corresponding information through a wired / wireless wired / wireless communication network when the question sentence requests specific information such as time, news, and weather.

The fourth step of outputting the answer extracted or generated by the question and answer in the answer voice and answer text,

Receives the response sentence (text) extracted or generated by the Q & A, outputs the voice through the TTS, and displays the corresponding sentence as text (phrase).

The fourth step of outputting the answer extracted or generated by the question and answer in the answer voice and answer text,

When receiving a response sentence (text) extracted or generated by a question and answer, and outputting a voice through the TTS, the user may select various TTS voices by voice type, age, and gender.

In addition, after the first step,

The method may further include verifying whether a voice recognition result is correctly input.

5 is a diagram illustrating a method of question-and-answer conversation with voice in a voice recognition question-and-answer system using TTS according to an embodiment of the present invention.

When the user senses the voice and receives a question, the voice analog signal is converted into a digital signal to recognize the voice of the question (S400) and the question sentence is converted, and a question and answer process is performed (S410), for the question sentence The response text information is output in the form of voice and text.

The query response S410 is a sentence analysis process (morpheme analysis, syntax analysis, semantic analysis, transcription analysis) from the question sentence to grasp the precise intent of the question, and a question requiring an accurate answer (S430) When an answer is requested from the DB (S431) and specific information is requested (S440), an answer is generated based on the information, and an answer requesting daily life or common sense is transmitted to the indexing DB S421 ) And a query response dictionary DB (S422).

That is, the morpheme (word) information contained in the question sentence is found in the indexing DB (S421), the question and answer sentence number containing the morpheme information is found in the question and answer dictionary DB (S422), and the morpheme included in the question sentence Find the most frequently asked questions or answers in the Q & A DB (S422), extract the answers from the corresponding question and answer pairs, and output them in the form of voice and text.

6 is an example of a screen for talking with a voice in a voice recognition question and answer system using TTS according to an embodiment of the present invention.

When talking with a voice, a question voice input start button (S500) is clicked to receive a voice of a user. After receiving the input, when the speech recognition is performed, the sentence (who are you?) That the voice recognition is displayed in the question voice input window (S510).

If you click Send (S520), the text of the reply sentence is returned by the question and answer function, and if the reply sentence is displayed on the answer display window (S540), (I am a robot) is output. In addition, the answer sentence is output to the speaker or earphone using the TTS.

The send button may be pressed or set as a default, and the answer sentence may be received by the question answering function as soon as the sentence recognized by the voice input window is displayed.

7 is an example of a screen for talking by voice in a voice recognition question and answer system using TTS according to an embodiment of the present invention.

When talking by voice, the user's voice can be automatically input. In addition, when the automatic voice input is detected, the automatic response may be output in the form of voice and text by the question answering function.

8 is an example of a question and answer sentence display screen after the question and answer voice input in the voice recognition question and answer system using TTS according to an embodiment of the present invention.

In order to store a question and an answer from a voice, a voice of a user is input by pressing a question voice input start button (S600) before voice input. After receiving the input, when the speech recognition is performed, the sentence (I love you) that the voice recognition is displayed in the question voice input window (S610).

Also, the answer voice input start button S630 is pressed to receive the voice of the user. When the speech recognition is performed after receiving the input, a sentence (I love you) which is recognized as a speech is displayed in the answer input window S620.

When the input completion button S660 is pressed, the voice inputted from the voice by the voice response function is voice recognized and stored as the question and answer sentence text, respectively.

Pressing the initialization button (S620, S650) can delete the sentences entered in the voice input window (S610) and the answer input window (S620).

9 is an example of a question and answer sentence display screen after the question and answer voice input in the voice recognition question and answer system using TTS according to an embodiment of the present invention.

In order to store the question and answer from the voice, first, a question voice is input and then an answer voice is input.

When the input completion button S660_1 is pressed, the voice inputted from the voice by the voice response function is voice recognized and stored as the question and answer sentence text, respectively.

100: voice input device
110: voice input unit
120: voice recognition unit
130: natural language processing unit
140: text output unit
150: Monitor
160: audio output unit
161: TTS
170: voice output device

Claims (27)

Recognizes a voice of a question and an answer from a voice of a user and converts the voice into a question and an answer sentence, stores a text file of the question and answer, indexes and stores the question and answer sentence,
When a user inputs a question by voice, voice is converted into text after voice recognition, and a question-and-answer is performed. The voice using TTS outputs an answer to a sentence input by the question and answer as voice and text. Cognitive Question and Answer System.
Voice input device for receiving a voice,
Voice input unit for converting the analog voice transmitted through the voice input device into a digital signal,
A voice recognition unit for performing voice recognition from the voice information received by the voice input unit, a natural language processing unit for indexing or performing a question and answer based on information converted from voice to text by the voice recognition unit;
A text output unit for outputting the response transmitted from the natural language processing unit to the monitor screen as text;
A TIES unit for converting the answer sentence into a voice, A voice output unit for converting the voice from a digital signal to an analog signal,
Voice recognition question-and-answer system comprising a voice output device for outputting the voice to the earphone or speaker.
The method according to claim 1 and 2,
The voice input unit provides a predetermined question input unit and a response input unit,
When the question input unit receives a question from a user by voice, the question voice is displayed as a question sentence after speech recognition,
When the answer input unit receives an answer from the user by voice, the answer voice is displayed as an answer sentence after speech recognition,
When the voice input of the question and answer is completed and the user detects the input completion button click, the question sentence and the answer sentence are indexed, and the position information (sentence number) of the question sentence and the response sentence in which a specific word (keyword) occurs is generated. Voice recognition question and answer system using TTS, characterized in that stored in the DB.
The method according to claim 1 and 2,
Detects the user's voice and displays the voice recognition result in the question input window, finds the answer sentence to the question by question and answer, displays the answer sentence in the answer input window, and outputs the answer voice using TTS. Voice recognition question and answer system using TTS.
The method according to claim 1 and 2,
The voice recognition question-and-answer system using TTS, which provides a variety of TTS voices by voice type, age, and gender when outputting an answer using TTS.
The method according to claim 1 and 2,
After detecting the user's voice and the voice data detected as a meaningful voice, if there is no voice recognition result, the user is prompted to input the voice again, so that the user can correctly input the voice Voice recognition question and answer system using S.
The method according to claim 1 and 2,
Question voice, which is an analog signal delivered to an external microphone or an internal microphone of a terminal, is converted into a digital signal from the voice input unit, and the answer voice transmitted to the voice output unit is converted into an analog signal through a voice output device composed of earphones or speakers. Voice recognition question and answer system using TTS, characterized in that for outputting the converted.
The method according to claim 1 and 2,
The text output unit displays text information on the screen of the terminal.
The method according to claim 1 and 2,
After the speech recognition in the speech recognition unit, the sentence text information that is the result of speech recognition is stored in the question and answer DB, indexing the index based on the index based on the information consisting of a pair of questions and answer sentences in the question and answer DB Voice recognition question and answer system using TTS.
The method according to claim 1 and 2,
And the voice recognition unit recognizes a voice by a predetermined voice recognition algorithm, converts the voice into sentence text, and stores the sentence text as text information.
The method according to claim 1 and 2,
The natural language processing unit, based on the question and answer sentence information converted from the voice to the text by the speech recognition unit, to find an answer or a response by a question and answer module for finding an answer to a specific question Voice recognition question and answer system using S.
The method according to claim 1 and 2,
The question and answer module performs a sentence analysis process from a question sentence to determine the exact question intent, and a question requiring an accurate answer is obtained from a pre-established answer DB, and when a specific information is requested, an answer is based on the information. Voice recognition question and answer system using TTS.
The method according to claim 1 and 2,
The question and answer module is a voice recognition question and answer system using TTS, characterized in that when the question sentence requests specific information, such as time, news, weather, and get the corresponding information through the wired and wireless communication network.
In the operation method of the voice recognition Q & A system using TTS, the method of storing the question and answer sentence by voice,
Step 1 of receiving a question and answer by voice;
Two steps of speech recognition;
Storing the voice recognized sentences as question and answer sentences;
Indexing the question and answer sentences;
Operation method of the voice recognition question and answer system using TTS.
The method of claim 14,
The process of receiving questions and answers by voice,
Providing a predetermined question input unit and a response input unit, and providing the user with the question input unit to receive a question by voice, receives a voice recognition result, displays the question voice as a question text,
When the answer input unit is provided to the user and the answer is input by voice, the voice recognition result is returned, the answer voice is displayed as the answer text,
When the voice input of the question and answer is completed and a click of the input completion button is detected from the user, the question sentence and the answer sentence are indexed, and the position information (sentence number) of the question sentence and the answer sentence in which a specific word (keyword) occurs. Operation method of the voice recognition question and answer system using TTS, characterized in that to store in the DB.
The method of claim 14,
When recording with voice recognition,
It receives the question input voice and the answer input voice, respectively, converts the voice into a question sentence and an answer sentence, stores them in a DB, indexes them by keywords through a morphological analysis process, and positions of the question sentence and the answer sentence in which the keyword appears for each keyword. A method of operating a voice recognition question and answer system using TTS, characterized by recording information (sentence number).
In the operation method of the voice recognition question answering system using TTS,
A step 1 for inputting a question by voice;
Two steps of speech recognition;
3) performing a question and answer processing with sentence information (text) generated after the speech recognition;
Outputting a response extracted or generated by the question and answer as an answer voice and an answer text;
Operation method of the voice recognition question and answer system using TTS.
The method of claim 17,
The first step in answering questions by voice,
Detects the user's voice and receives the voice recognition result and displays it in the question input window. After answering the question and answering the question, the answer sentence is displayed in the answer input window and the answer voice is output to the TS. A method of operating a voice recognition question-and-answer system using TTS.
The method of claim 17,
The first step in answering questions by voice,
A separate voice input device is attached to the outside of the terminal or using a built-in voice input device (microphone) using a voice recognition query response system using a TTS characterized in that the input of the user's voice in real time.
The method of claim 17,
Method of operating a voice recognition question and answer system using TTS, characterized in that it further comprises the step of receiving a text if the voice is not received.
The method of claim 17,
The second stage of speech recognition,
A method of operating a voice recognition question-and-answer system using TTS, comprising: recognizing a voice by a predetermined voice recognition algorithm and converting the voice into text (sentence).
The method of claim 17,
Three steps of query response processing of the text (sentence) generated after the speech recognition,
Based on the question information converted from voice to text (sentence), the operation method of the voice recognition question answering system using TTS, characterized in that for finding the answer or generating the answer by the question answering module for finding the answer to a specific question .
The method of claim 17,
Three steps of query response processing of the text (sentence) generated after the speech recognition,
The question-and-response module performs a sentence analysis process (morphological analysis, syntax analysis, semantic analysis, speech act analysis) from the question sentence to determine the exact question intention, and the question requiring the correct answer has an answer in a pre-built answer DB. When a specific information is requested, an answer is generated based on the information, and an answer requiring daily life or common sense uses a similarity search method to find an answer sentence using a voice recognition question and answer system. Way.
The method of claim 17,
Three steps of query response processing of the text (sentence) generated after the speech recognition,
The question and answer module, when a question sentence requests specific information such as time, news, and weather, obtains the corresponding information through a wired / wireless wired / wireless communication network to generate an answer. How to use a response system.
The method of claim 17,
The fourth step of outputting the answer extracted or generated by the query response as the answer voice and the answer text,
Operation of voice recognition question answering system using TTS, characterized by receiving the answer sentence (text) extracted or generated by Q & A, outputting voice through TTS and displaying the corresponding answer sentence as text (phrase) Way.
The method of claim 17,
The fourth step of outputting the answer extracted or generated by the query response as the answer voice and the answer text,
When receiving a response sentence (text) extracted or generated by a question and answer, and outputting a voice through the TTS, the user can select various TTS voices by voice type, age, and gender. Operation method of voice recognition question answering system using TTS.
The method of claim 17,
After step 1,
Operation method of the voice recognition question-and-answer system using TTS, characterized in that it further comprises the step of checking whether the voice recognition result is correctly input.

KR1020120038840A 2012-04-14 2012-04-14 Question answering system using speech recognition by tts, its application method thereof KR20130116128A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120038840A KR20130116128A (en) 2012-04-14 2012-04-14 Question answering system using speech recognition by tts, its application method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120038840A KR20130116128A (en) 2012-04-14 2012-04-14 Question answering system using speech recognition by tts, its application method thereof

Publications (1)

Publication Number Publication Date
KR20130116128A true KR20130116128A (en) 2013-10-23

Family

ID=49635399

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120038840A KR20130116128A (en) 2012-04-14 2012-04-14 Question answering system using speech recognition by tts, its application method thereof

Country Status (1)

Country Link
KR (1) KR20130116128A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9613025B2 (en) 2014-11-19 2017-04-04 Electronics And Telecommunications Research Institute Natural language question answering system and method, and paraphrase module
CN110085316A (en) * 2019-05-11 2019-08-02 北京康健数字化健康管理研究院 A kind of hypertension question answering system and its system method for building up based on deep learning
CN114168104A (en) * 2021-12-08 2022-03-11 杭州电子科技大学 Scene character interactive understanding system for visually impaired people

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9613025B2 (en) 2014-11-19 2017-04-04 Electronics And Telecommunications Research Institute Natural language question answering system and method, and paraphrase module
CN110085316A (en) * 2019-05-11 2019-08-02 北京康健数字化健康管理研究院 A kind of hypertension question answering system and its system method for building up based on deep learning
CN114168104A (en) * 2021-12-08 2022-03-11 杭州电子科技大学 Scene character interactive understanding system for visually impaired people

Similar Documents

Publication Publication Date Title
US10332513B1 (en) Voice enablement and disablement of speech processing functionality
US10276164B2 (en) Multi-speaker speech recognition correction system
US8849628B2 (en) Software application for ranking language translations and methods of use thereof
KR101689290B1 (en) Device for extracting information from a dialog
US10811005B2 (en) Adapting voice input processing based on voice input characteristics
US20200012724A1 (en) Bidirectional speech translation system, bidirectional speech translation method and program
KR20130108173A (en) Question answering system using speech recognition by radio wire communication and its application method thereof
JP5857090B2 (en) Information search device, information search program, and information search system
KR20140123369A (en) Question answering system using speech recognition and its application method thereof
CN111919249A (en) Continuous detection of words and related user experience
KR20130086971A (en) Question answering system using speech recognition and its application method thereof
CN106713111B (en) Processing method for adding friends, terminal and server
CN107844470B (en) Voice data processing method and equipment thereof
US10699706B1 (en) Systems and methods for device communications
CN109543021B (en) Intelligent robot-oriented story data processing method and system
US20130253932A1 (en) Conversation supporting device, conversation supporting method and conversation supporting program
CN107909995B (en) Voice interaction method and device
US20180288109A1 (en) Conference support system, conference support method, program for conference support apparatus, and program for terminal
WO2019031268A1 (en) Information processing device and information processing method
KR102140391B1 (en) Search method and electronic device using the method
KR20210033850A (en) Output method for artificial intelligence speakers based on emotional values calculated from voice and face
CN111640434A (en) Method and apparatus for controlling voice device
KR20120127773A (en) Vocal recognition information retrieval system and method the same
US20210034662A1 (en) Systems and methods for managing voice queries using pronunciation information
KR20130116128A (en) Question answering system using speech recognition by tts, its application method thereof

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination