KR20150073364A - The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method - Google Patents

The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method Download PDF

Info

Publication number
KR20150073364A
KR20150073364A KR1020130160973A KR20130160973A KR20150073364A KR 20150073364 A KR20150073364 A KR 20150073364A KR 1020130160973 A KR1020130160973 A KR 1020130160973A KR 20130160973 A KR20130160973 A KR 20130160973A KR 20150073364 A KR20150073364 A KR 20150073364A
Authority
KR
South Korea
Prior art keywords
speech
voice
display
text
sentence
Prior art date
Application number
KR1020130160973A
Other languages
Korean (ko)
Inventor
안연준
Original Assignee
안연준
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 안연준 filed Critical 안연준
Priority to KR1020130160973A priority Critical patent/KR20150073364A/en
Publication of KR20150073364A publication Critical patent/KR20150073364A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition

Abstract

The present invention relates to a system for confirming a sentence position of a text of a speech using a portable mobile and a tablet PC and a confirmation system thereof and, more specifically, to a portable mobile or a tablet PC embedded with a text execution program and a voice recognition system. The voice recognition system comprises a voice recognition apparatus recognizing user′s voice in real time, a voice text comparison and indication program, and a text stress program.

Description

[0001] The present invention relates to a system and a method for confirming a sentence position of a manuscript by using a portable mobile or a tablet PC,

The present invention relates to a system and method for verifying a sentence position of a speech message manuscript using a portable mobile or tablet PC. More particularly, the present invention relates to a system and method for verifying the presence of a speech message manuscript on a portable mobile or tablet PC The present invention relates to a system and method for confirming the position of a sentence in a speech manuscript.

Generally speaking, when a parliamentarian election, a local governor election or a seminar speech, a speaker writes a manuscript, memorizes it, and makes a speech. The manuscript will be presented on the desk in case of forgetting the manuscript.

In these speeches, beginners often feel the effects of surrounding environment such as hoots or noise in the speech field, forgetting the contents of the speech, or forgetting the contents of the speech that is currently being addressed, do.

This situation is more severe for beginner speakers, in which case the speaker is accompanied by considerable stress, which may adversely affect his or her health.

In particular, in the case of a member of the National Assembly or a local governor, the failure of a single speech may cause the election to be negatively affected.

In a similar way, the script displayed on the screen device is used when a lecture or a speech is to be professionally performed, such as a news announcer. The script displayed on the screen device can be placed on the monitor where the user is looking and the script can be automatically scrolled to deliver the paragraph that he or she should read to the audience.

There is also a device in karaoke that indicates the part of the lyrics that the user should call. Here, the song lyrics accurately indicate the part that the user should call, and the user can read along with the lyrics displayed on the screen, so that even if the song lyrics are not memorized all the time,

However, since the announcer and the screen device to be used are displayed simultaneously on one screen and the script of several paragraphs is scrolled, it is difficult to recognize precisely the portion to be transmitted. If the speed of the user and the scrolling speed of the script do not match, There is a problem in that it can be missed or confused with another part to convey false information to the audience.

In the case of a karaoke system, it is difficult to perceive the contents of the previous and subsequent contents because it represents only the part to be called by the user. Also, since the lyrics are outputted in accordance with the flow of the song,

Since the presenter who has to make a general lecture or presentation needs to be familiar with a lot of exercises, the screen device in which the above-described scenario is displayed requires a device that can be conveniently used by the presenter to deliver the presentation to the audience, In the case of a karaoke system, since the speed of the lyrics displayed in accordance with the flow of the song is fixed, a device capable of displaying the paragraphs of the scripts in accordance with the situations where different situations may occur each time is presented.

Therefore, when a speaker makes a speech through a manuscript prepared by a manuscript, he or she forgets the contents of the prepared manuscript, a system is required that allows the manuscript to be easily identified.

Korean Published Patent Application No. 10-2012-0037793, published on April 20, 2012

Accordingly, it is an object of the present invention to solve and solve the above-mentioned problems, and it is an object of the present invention to provide a speech message manuscript which avoids confusion even if the speech message is easily distinguished from the portable mobile or tablet PC during speech by the user through the prepared speech message manuscript. And a method thereof.

According to an aspect of the present invention, there is provided a portable mobile or tablet PC having a document execution program and a voice recognition system, wherein the document execution program stores a user's speech content as a document, A voice recognition device for recognizing the voice of the user in real time; a voice recognition device for converting the voice of the user recognized through the voice recognition device into voice data; The text data of the speech recognition system and the text data of the document execution program are collated with each other and the text data of the user who is presently speaking is matched with the text data The entire sentence is displayed on the display as a letter, The text is automatically scrolled so as to be positioned at the center of the play, and a speech text collating and displaying program for causing the next paragraph to be immediately displayed on the display within 0.1 second after the paragraph of the sentence being speech is finished, And a character emphasis program for causing a character collating and displaying program to display a next sentence immediately following a corresponding sentence in a speech displayed on the display in a magnified manner than the characters in the other sentence.

According to the configuration of the present invention as described above, it is very advantageous to have a merit that the user can easily identify the speech document on the portable mobile or tablet PC while speaking through the speech document prepared by the user, .

According to an aspect of the present invention, there is provided a portable mobile or tablet PC having a document execution program and a voice recognition system, wherein the document execution program stores user's speech contents as a document, The speech recognition system comprises a speech recognition device for recognizing the user's speech in real time, a speech recognition device for converting the speech of the user recognized through the speech recognition device into speech data, The speech data of the speech recognition system and the text data of the document execution program are collated with each other so that the speech data of the user who is presently speaking and the entire text of the sentence in which the text data coincide with each other Is displayed on the display as a character, The text is automatically scrolled so as to be positioned at the center of the play, and a speech text collating and displaying program for causing the next paragraph to be immediately displayed on the display within 0.1 second after the paragraph of the sentence being speech is finished, And a character emphasis program for displaying a next sentence immediately following the corresponding sentence in a speech in a paragraph displayed on the display through a character verification and display program in such a manner that the next sentence is displayed larger than the character of the other sentence.

Hereinafter, embodiments according to the present invention will be described in detail.

The present invention provides a portable mobile or tablet PC having a document execution program and a speech recognition system, the document execution program including: The document contents stored and stored as documents are converted into character data and displayed as characters on a display, and the voice recognition system comprises a voice recognition device for recognizing the voice of the user in real time, a voice recognition device for recognizing the voice of the user recognized through the voice recognition device The voice data is converted into voice data and the converted voice data is divided into a character, a word, a sentence, and a paragraph unit, and the voice data of the user currently speaking is collated with the voice data of the voice recognition system against the character data of the document executing program. The entire paragraph of the sentence whose data and text data match each other The text is automatically scrolled so that the corresponding sentence in the speech is located at the center of the display on the display and the next paragraph is displayed on the display within 0.1 second And a character emphasis program for enlarging and displaying a next sentence immediately following the corresponding sentence in speech during a speech displayed on the display through the voice text collating and displaying program, .

In particular, the character emphasis program is provided with a function of displaying characters in bold, underlining characters, or displaying different colors of characters, and various functions of the character emphasis program can be selected.

In addition, in the character emphasis program, the enlargement range of the character is preferably 1.5 to 3 times as many as other characters, and it is preferable that the user enlarges the content of the speech document to be sufficiently identifiable. In the present invention, the enlargement range of the character is not necessarily limited to the upper range, but can be changed according to the state of the user or the position and location of the speech field.

In particular, there is a remote control system that allows a third party to wirelessly access a portable mobile or tablet PC of the user to assist the user in speaking and to share a document executive program and remotely control the document executive program To allow the user to further identify the contents of the speech manuscript.

A method for confirming a sentence position of a speech message manuscript using a portable mobile or a tablet PC according to an embodiment of the present invention includes a step of executing a document execution program and a speech recognition system executing a document execution program and a speech recognition system of a portable mobile or tablet PC A voice recognition step of recognizing the user's voice in real time in the voice recognition system; a voice conversion step of converting the voice of the user recognized through the voice recognition step into voice data; A speech data storage step of storing the speech data of the speech recognition system and the text data of the speech recognition system separated by character, word, sentence and paragraph unit; Display the entire paragraph of the matching sentence as a text on the display A next paragraph display step for displaying the next paragraph immediately after the paragraph of the sentence displayed on the display through the character display step on the display within 0.1 second; And a character enlargement display step of enlarging and displaying the next sentence immediately following the corresponding sentence in speech during the paragraph displayed on the screen.

In particular, it may further include a remote control step of wirelessly connecting to the portable mobile or tablet PC to share a document execution program and to remotely control the document execution program.

Therefore, according to the present invention as described above, it is a very useful invention having an advantage that it is easy to identify a speech document in a portable mobile or a tablet PC while speaking through a prepared speech message manuscript, thereby avoiding confusion even if the speech contents are forgotten.

Claims (6)

For portable mobile or tablet PCs with built-in document executables and speech recognition systems,
The document execution program stores the contents of the user's speech as a document, converts the stored contents of the document into character data, displays the characters on the display,
The voice recognition system includes a voice recognition device that recognizes a user's voice in real time, a voice recognition device that converts the voice of the user recognized through the voice recognition device into voice data, and converts the converted voice data into characters, words, Then,
The text of the speech data of the speech recognition system and the text data of the document execution program are collated with each other, and the entire text of the sentence in which the speech data of the user currently speaking is coincident with the text data is displayed as a character on the display, A voice text collating and displaying program for automatically scrolling a document so as to be located at the center of the display on the display and for displaying the next paragraph immediately after the paragraph of the sentence currently being addressed on the display within 0.1 second;
And a character emphasis program for enlarging and displaying the next sentence immediately following the corresponding sentence in speech during the speech displayed on the display through the voice text verification and display program, Sentence location confirmation system of speech text manuscript using tablet PC Executing a document execution program and a voice recognition system in which a user executes a document execution program and a voice recognition system of a portable mobile or tablet PC;
A speech recognition step of recognizing the user's speech in real time in the speech recognition system;
A voice conversion step of converting the voice of the user recognized through the voice recognition step into voice data;
A voice data storing step for storing the voice data converted by the voice converting step by dividing the voice data into characters, words, sentences, and paragraphs;
A character display step of collating the text data of the speech recognition system with the text data of the document execution program to display the entire text of the sentence in which the speech data of the user who is presently present and the text data coincide with each other on the display;
A next paragraph display step of displaying a next paragraph immediately after a paragraph of a sentence displayed on the display through the character display step is displayed on the display within 0.1 second;
And a character enlargement display step of enlarging and displaying a next sentence immediately following a corresponding sentence in a speech displayed on the display through the character display step, How to check the sentence location of a manuscript The method according to claim 1,
The character emphasis program is provided with a function of displaying characters in bold, underlining characters, or displaying the colors of characters differently, and the functions can be selected. system The method according to claim 1,
Wherein the enlargement range of the character in the character emphasis program is 1.5 to 3 times that of the other characters. The method according to claim 1,
And a remote control system that wirelessly connects to the portable mobile or tablet PC to share a document execution program and remotely control the document execution program. Location system 3. The method of claim 2,
And a remote control step of wirelessly connecting to the portable mobile or tablet PC to share the document execution program and to remotely control the document execution program. Verification systems and verification methods
KR1020130160973A 2013-12-23 2013-12-23 The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method KR20150073364A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130160973A KR20150073364A (en) 2013-12-23 2013-12-23 The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130160973A KR20150073364A (en) 2013-12-23 2013-12-23 The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method

Publications (1)

Publication Number Publication Date
KR20150073364A true KR20150073364A (en) 2015-07-01

Family

ID=53786902

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130160973A KR20150073364A (en) 2013-12-23 2013-12-23 The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method

Country Status (1)

Country Link
KR (1) KR20150073364A (en)

Similar Documents

Publication Publication Date Title
US20200175890A1 (en) Device, method, and graphical user interface for a group reading environment
CN106104677B (en) The movement that the voice identified is initiated visually indicates
TWI312984B (en) Method of enhancing voice interactions using visual messages
US10613826B2 (en) Head-mounted display system and operating method for head-mounted display device
GB2518318A (en) Speech processing system and terminal device
JP2018106148A (en) Multiplex speaker-speech-recognition correction system
US20180182399A1 (en) Control method for control device, control method for apparatus control system, and control device
US20140315163A1 (en) Device, method, and graphical user interface for a group reading environment
KR102193029B1 (en) Display apparatus and method for performing videotelephony using the same
KR101819458B1 (en) Voice recognition apparatus and system
US10540451B2 (en) Assisted language learning
US9047858B2 (en) Electronic apparatus
KR102023157B1 (en) Method and apparatus for recording and playing of user voice of mobile terminal
KR20160081244A (en) Automatic interpretation system and method
CN111902831B (en) Demonstration support system
US9472113B1 (en) Synchronizing playback of digital content with physical content
KR101562222B1 (en) Apparatus for evaluating accuracy of pronunciation and method thereof
CN110890095A (en) Voice detection method, recommendation method, device, storage medium and electronic equipment
WO2014082654A1 (en) Systems and methods for aiding quran recitation
KR102338019B1 (en) System and method for realizing multi-device contents based on pen-motion
KR20150073364A (en) The confirmation system of sentence position of text of a speech manuscript by using the potable mobile or tablet PC and thereof confirmation method
US20160300587A1 (en) Note-taking assistance system, information delivery device, terminal, note-taking assistance method, and computer-readable recording medium
KR20140107067A (en) Apparatus and method for learning word by using native speakerpronunciation data and image data
KR20170009487A (en) Chunk-based language learning method and electronic device to do this
US20140272819A1 (en) Computer-implemented language heuristics

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application