CN101494002A - Device and method for synchronously playing sound, mouth shape and finger speech - Google Patents

Device and method for synchronously playing sound, mouth shape and finger speech Download PDF

Info

Publication number
CN101494002A
CN101494002A CN 200910021392 CN200910021392A CN101494002A CN 101494002 A CN101494002 A CN 101494002A CN 200910021392 CN200910021392 CN 200910021392 CN 200910021392 A CN200910021392 A CN 200910021392A CN 101494002 A CN101494002 A CN 101494002A
Authority
CN
China
Prior art keywords
picture
sound
sign language
module
lip
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200910021392
Other languages
Chinese (zh)
Inventor
陈淮琰
王秦秦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inventec Besta Xian Co Ltd
Original Assignee
Inventec Besta Xian Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Besta Xian Co Ltd filed Critical Inventec Besta Xian Co Ltd
Priority to CN 200910021392 priority Critical patent/CN101494002A/en
Publication of CN101494002A publication Critical patent/CN101494002A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention relates to a device for synchronously displaying voice, mouth shape and sign language and a method thereof. The device comprises a receiving module for receiving a voice sentence, a processing module for dividing the voice sentence into voice phrases, an indexing module for obtaining a mouth shape picture and a sign language picture corresponding to the voice phrase of the voice sentence and an output module for displaying the voice sentence according to the indexing module and synchronously continuously displaying the corresponding mouth shape picture and the corresponding sign language picture. The receiving module is connected with the processing module, the processing module is connected with the indexing module and the indexing module is connected with the output module. The device utilizes synchronously displaying of the voice sentence, the mouth shape picture and the sign language picture to solve defects that in the prior art, the blind operator can only study and search the sign language by books or the static sign language picture.

Description

A kind of sound, the degree of lip-rounding and sign language simultaneously playing device and method
Technical field
The present invention relates to a kind of sign language playing device and method, especially a kind of sound, the degree of lip-rounding and sign language simultaneously playing device and method.
Background technology
Marched toward the electronic age of message high speed development now, be convenient for carrying, intuitively, the electronization types of applications software progressively substituted modes of learning such as in-book form in the past, paper formula and classroom formula teaching, and knowledge expertises such as the inquiry of sign language language at present, study and grasp still must be learnt from books, and therefore electronization and the universalness for the sign language language is deaf and dumb personage and the long-expected hope of interesting study sign language person.
Referring to Fig. 1, the introduction of " sign language language " at present, study and inquiry are confined to book type more, the gesture legend is all with static graphical representation, at most only in the corresponding local linear arrow that adds guided bone of figure, orientation that the indication user rotates and the conversion between the right-hand man.Therefore in the study, lack gesture figure continuity, must rely on user's deliberation and sensation, understanding is easy to make the mistake.
Therefore, prior art has can't play gesture figure continuously, and the learner is misread easily; And not electronic, can't show shortcomings such as the degree of lip-rounding and sound synchronously.
Summary of the invention
The above-mentioned technical matters of the present invention for existing in the solution background technology, and a kind of sound, the degree of lip-rounding and sign language simultaneously playing device and method are proposed.
Technical solution of the present invention is: the present invention is a kind of sound, the degree of lip-rounding and sign language simultaneously playing device, and its special character is: this device comprises: receiver module receives the sound statement; Processing module, cutting apart the sound statement becomes the sound phrase; Index module obtains the pairing degree of lip-rounding picture of sound phrase and the sign language picture of sound statement; Output module according to the index module statement that plays sound, and is play pairing degree of lip-rounding picture and sign language picture synchronously continuously, and receiver module inserts processing module, and processing module inserts index module, and index module inserts output module.
Above-mentioned index module obtains the pairing hand shape of sign language picture and amplifies picture.
Above-mentioned output module is according to the index module statement that plays sound, and plays pairing degree of lip-rounding picture, sign language picture and hand shape synchronously continuously and amplify picture.
Above-mentioned output module is loudspeaker and display screen.
A kind of sound, the degree of lip-rounding and sign language synchronous broadcast method of realizing above-mentioned sound, the degree of lip-rounding and sign language simultaneously playing device, its special character is: this method comprises the following step:
1) receiver module receives the sound statement;
2) receiver module is cut apart the sound statement becomes the sound phrase;
3) from index module, obtain the pairing degree of lip-rounding picture of sound phrase and the sign language picture of sound statement;
5) output module is according to the index module statement that plays sound, and plays pairing degree of lip-rounding picture and sign language picture synchronously continuously.
Above-mentioned steps 3) and also comprise step 4) between the step 5) and from index module, obtain the pairing hand shape of sign language picture and amplify picture.
Above-mentioned steps 5) output module is according to the index module statement that plays sound in, and plays pairing degree of lip-rounding picture, sign language picture and hand shape synchronously continuously and amplify picture.
The present invention utilizes synchronous playing sound statement, degree of lip-rounding picture and sign language picture, solved the shortcoming that the sign language language be learnt, be inquired about to prior art only can by books or static sign language picture.
Description of drawings
Fig. 1 is the prior art synoptic diagram;
Fig. 2 is a sound statement synoptic diagram;
Fig. 3 is a synoptic diagram of the present invention;
Fig. 4 amplifies the picture synoptic diagram for the present invention plays hand shape;
Fig. 5 is apparatus of the present invention synoptic diagram;
Fig. 6 is the inventive method process flow diagram.
Wherein, 201-sound statement, 202-sound phrase, 301-degree of lip-rounding picture, 302-sign language picture, 401-hand shape is amplified picture, 501-receiver module, 502-processing module, 503-index module, 504-output module;
Embodiment
Referring to Fig. 2-Fig. 5, device of the present invention comprises: receiver module 501, processing module 502, index module 503 and output module 504.Wherein, receiver module 501 receives sound statement 201; Processing module 502 is cut apart sound statement 201 becomes sound phrase 202; Index module 503 obtains the sound phrase 202 pairing degree of lip-rounding picture 301 and the sign language pictures 302 of sound statement 201; Output module 504 is according to index module 503 statement 201 that plays sound, and plays pairing degree of lip-rounding picture 301 and sign language picture 302 synchronously continuously.
Index module 503 obtains sign language picture 302 pairing hand shapes and amplifies picture 401; Output module 504 is according to index module 503 statement 201 that plays sound, and plays pairing degree of lip-rounding picture 301, sign language picture 302 and sign language picture 302 pairing hand shapes synchronously continuously and amplify pictures 401.
Referring to Fig. 6, method of the present invention comprises the following step:
Step 601: receive sound statement 201 by receiver module 501.
Step 602: utilize processing module 502 that the sound statement 201 that is received is divided into sound phrase 202.
Step 603: obtain sound phrase 202 pairing degree of lip-rounding picture 301 and sign language pictures 302 from index module 503.
Step 604: judge whether to play hand shape and amplify picture 401,, then carry out step 606 if not if then carry out step 605.
Step 605: obtain sign language picture 302 pairing hand shapes from index module 503 and amplify picture 401.
Step 606: output module 504 is according to index module 503 statement 201 that plays sound, and plays pairing degree of lip-rounding picture 301 and sign language picture 302 synchronously continuously, and wherein output module 504 is loudspeaker and display screen.
Step 607: output module 504 is according to index module 503 statement 201 that plays sound, and plays pairing degree of lip-rounding picture 301, sign language picture 302 and hand shape synchronously continuously and amplify picture 401, and wherein output module 504 is loudspeaker and display screen.

Claims (7)

1, a kind of sound, the degree of lip-rounding and sign language simultaneously playing device, it is characterized in that: this device comprises: receiver module receives the sound statement; Processing module, cutting apart the sound statement becomes the sound phrase; Index module obtains the pairing degree of lip-rounding picture of sound phrase and the sign language picture of sound statement; Output module according to the index module statement that plays sound, and is play pairing degree of lip-rounding picture and sign language picture synchronously continuously, and described receiver module inserts processing module, and described processing module inserts index module, and described index module inserts output module.
2, sound according to claim 1, the degree of lip-rounding and sign language simultaneously playing device is characterized in that: described index module obtains the pairing hand shape of sign language picture and amplifies picture.
3, sound according to claim 2, the degree of lip-rounding and sign language simultaneously playing device is characterized in that: described output module is according to the index module statement that plays sound, and plays pairing degree of lip-rounding picture, sign language picture and hand shape synchronously continuously and amplify picture.
4, according to claim 1 or 2 or 3 described sound, the degree of lip-rounding and sign language simultaneously playing device, it is characterized in that: described output module is loudspeaker and display screen.
5, a kind of sound, the degree of lip-rounding and sign language synchronous broadcast method of realizing the described sound of claim 1, the degree of lip-rounding and sign language simultaneously playing device, it is characterized in that: this method comprises the following step:
1) receiver module receives the sound statement;
2) receiver module is cut apart the sound statement becomes the sound phrase;
3) from index module, obtain the pairing degree of lip-rounding picture of sound phrase and the sign language picture of sound statement;
5) output module is according to the index module statement that plays sound, and plays pairing degree of lip-rounding picture and sign language picture synchronously continuously.
6, sound according to claim 5, the degree of lip-rounding and sign language synchronous broadcast method is characterized in that: also comprise step 4) between described step 3) and the step 5) and obtain the pairing hand shape amplification of sign language picture picture from index module.
7, sound according to claim 6, the degree of lip-rounding and sign language synchronous broadcast method, it is characterized in that: output module and is play pairing degree of lip-rounding picture, sign language picture and hand shape synchronously continuously and is amplified picture according to the index module statement that plays sound in the described step 5).
CN 200910021392 2009-03-05 2009-03-05 Device and method for synchronously playing sound, mouth shape and finger speech Pending CN101494002A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910021392 CN101494002A (en) 2009-03-05 2009-03-05 Device and method for synchronously playing sound, mouth shape and finger speech

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910021392 CN101494002A (en) 2009-03-05 2009-03-05 Device and method for synchronously playing sound, mouth shape and finger speech

Publications (1)

Publication Number Publication Date
CN101494002A true CN101494002A (en) 2009-07-29

Family

ID=40924580

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910021392 Pending CN101494002A (en) 2009-03-05 2009-03-05 Device and method for synchronously playing sound, mouth shape and finger speech

Country Status (1)

Country Link
CN (1) CN101494002A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809928A (en) * 2015-04-23 2015-07-29 苏州锟恩电子科技有限公司 Gesture language learning machine
CN104809927A (en) * 2015-04-23 2015-07-29 苏州锟恩电子科技有限公司 Gesture interactive learning machine
CN104821107A (en) * 2015-04-23 2015-08-05 苏州固基电子科技有限公司 Learning machine suitable for learning sign language
CN104835382A (en) * 2015-04-23 2015-08-12 江苏卡罗卡国际动漫城有限公司 Sign language learning machine suitable for interactive learning
CN106157750A (en) * 2016-08-24 2016-11-23 深圳市铁格龙科技有限公司 A kind of intelligence deaf mute's pronunciation and exchange study glasses

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809928A (en) * 2015-04-23 2015-07-29 苏州锟恩电子科技有限公司 Gesture language learning machine
CN104809927A (en) * 2015-04-23 2015-07-29 苏州锟恩电子科技有限公司 Gesture interactive learning machine
CN104821107A (en) * 2015-04-23 2015-08-05 苏州固基电子科技有限公司 Learning machine suitable for learning sign language
CN104835382A (en) * 2015-04-23 2015-08-12 江苏卡罗卡国际动漫城有限公司 Sign language learning machine suitable for interactive learning
CN106157750A (en) * 2016-08-24 2016-11-23 深圳市铁格龙科技有限公司 A kind of intelligence deaf mute's pronunciation and exchange study glasses

Similar Documents

Publication Publication Date Title
CN101494002A (en) Device and method for synchronously playing sound, mouth shape and finger speech
CN107274736B (en) A kind of interactive Oral English Practice speech sound teaching apparatus in campus
KR101125572B1 (en) Interactive multi-functional language learning method
KR101378362B1 (en) Robot controlled by optical identification
CN109255130A (en) A kind of method, system and the equipment of language translation and study based on artificial intelligence
CN105551327A (en) Interactive pronunciation correcting system and method based on soft electronic skin
CN103413476A (en) Touch electronic pointer
CN204102358U (en) A kind of children manual computer study tool
CN206789126U (en) A kind of multimedia teaching apparatus
CN201425791Y (en) Device for synchronously playing sound sentence, mouth-shape pictures and sign-language pictures
CN107862918A (en) A kind of English teaching platform
CN202976525U (en) Interesting English word teaching demonstration device
KR20190105986A (en) Learning dioceses in arranging visually identifiable alphanumeric objects into their devices and entering them with electronic signals
CN203849888U (en) Portable English oral practice teaching aid
CN204965796U (en) Hand -held type korean phonetic symbol study device
CN210466849U (en) Intelligent pointer controlled by local area network communication and wireless communication
RU2004126842A (en) METHOD AND DEVICE FOR UNDERSTANDING THE LANGUAGE
CN108091215A (en) It is a kind of based on it is multimedia listen barrier student teaching appliance
KR20110011852A (en) Studyinging mat
CN106125922A (en) A kind of sign language and spoken voice image information AC system
CN214428121U (en) English teaching is practised with spelling device
CN202956910U (en) Foreign language learning device capable of giving convenience for blind person learning
KR100491947B1 (en) Apparatus for studying letter
CN202230625U (en) Multifunctional learning tool for Japanese phonetics
KR101090839B1 (en) Language education system using game utensil

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20090729