CN101452705A - Voice character conversion nd cued speech character conversion method and device - Google Patents
Voice character conversion nd cued speech character conversion method and device Download PDFInfo
- Publication number
- CN101452705A CN101452705A CNA2007101719248A CN200710171924A CN101452705A CN 101452705 A CN101452705 A CN 101452705A CN A2007101719248 A CNA2007101719248 A CN A2007101719248A CN 200710171924 A CN200710171924 A CN 200710171924A CN 101452705 A CN101452705 A CN 101452705A
- Authority
- CN
- China
- Prior art keywords
- sign language
- video data
- text
- image
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method for converting a speech and a text, which comprises the followings steps: 1) detecting input audio data; 2) converting the audio data into corresponding text information; and 3) encoding the text information into the video data by an encoder. The invention also discloses a method for converting a sign language and the text, which comprises the following steps: 1) detecting input sign language video data; 2) converting the sign language video data into corresponding text information; and 3) encoding the text information into the video data by the encoder. The invention also discloses a text visual communication device, which comprises a speech-to-text conversion terminal and a sign language-to-text conversion terminal. The method can process sound and image signals through the visual communication device, which increases the communication form and content. The method ensures that deaf-mute persons and persons who do not know the sign language can communicate through the text, and also improves the speech speed and the speech quality of mutual communication for ordinary people.
Description
Technical field
The present invention relates to communication fields such as mobile phone, phone, particularly relate to audio-frequency information or sign language video information the method and apparatus that converts Word message to and carry out communication by video.
Background technology
Present various communicating terminal constantly occurs, and can be found everywhere to portable terminal from the fixed line phone of fixed network.But these communicating terminals all are the functions of using towards the ordinary people, for deaf and dumb personage, have only this mode of note to exchange at present.Along with the arrival in Visual communications epoch, people can carry out aspectant interchange by network.But deaf and dumb personage can only be by sign language owing to exchanging with sound, and common people are ignorant of sign language again on the other hand, and this has just caused the difficulty that exchanges.
Summary of the invention
The purpose of this invention is to provide the method and apparatus of a kind of language and characters conversion, sign language text conversion, deaf and dumb personage can be exchanged with the people who is ignorant of sign language, also be fit to general population's use simultaneously.
The objective of the invention is to be achieved through the following technical solutions:
The method of a kind of voice and text conversion, its characteristics are that it may further comprise the steps: the voice data that 1) detects input; 2) convert this voice data to related words information; 3) scrambler enters this literal information coding in the video data.
The method of a kind of sign language and text conversion, its characteristics are that it may further comprise the steps: the sign language video data that 1) detects input; 2) convert this sign language video data to related words information; 3) scrambler enters this literal information coding in the video data.
Wherein, in the method for sign language and text conversion,,, find the immediate image of sign language image with this camera acquisition, and extract this image word information relates with the contrast of the sign language image information that pre-sets with the sign language image of camera acquisition.
A kind of text visual communication device, its characteristics are that it comprises: voice and text conversion terminal, be used to detect the voice data of input, convert this voice data to related words information, and this literal information coding is entered in the video data with scrambler; Sign language and text conversion terminal are used to detect the sign language video data of input, convert this sign language video data to related words information, and scrambler enters this literal information coding in the video data.
Wherein, this sign language and text conversion terminal be the sign language image of camera acquisition, with the sign language image information contrast that pre-sets, finds the immediate image of sign language image with this camera acquisition, and extract this image word information relates.
Positive progressive effect of the present invention is: by visual communication device, sound and picture signal are handled, increased communication form and content.Deaf and dumb personage can be exchanged by literal with the people who is ignorant of sign language, and, also improved the conversation speed and the speech quality of mutual interchange for the general population.
Description of drawings
Fig. 1 is in the preferred embodiment of the present invention, voice and text conversion functional flow diagram.
Fig. 2 is in the preferred embodiment of the present invention, sign language video and text conversion functional flow diagram.
Fig. 3 is in the sign language and text conversion process shown in Figure 2, extracts the concrete grammar process flow diagram of Word message.
Fig. 4 is in the preferred embodiment of the present invention, the structural representation of text visual communication device.
Fig. 5 is in the preferred embodiment of the present invention, the synoptic diagram of communication between two people.
Embodiment
Provide preferred embodiment of the present invention below in conjunction with accompanying drawing, to describe technical scheme of the present invention in detail.
One, the method and apparatus of voice and literal, sign language and text conversion
1, the flow process of voice and text conversion
2, the flow process of sign language and text conversion
In above-mentioned steps 203, the concrete mode of extraction Word message as shown in Figure 3.
3, text visual communication device
Be illustrated in figure 4 as a text visual communication device 400 that realizes said method.This device includes following terminal.
Voice and text conversion terminal 401 are used to detect the voice data of input, convert this voice data to related words information, and with scrambler this literal information coding are entered in the video data.
Sign language and text conversion terminal 402 are used to detect the sign language video data of input, convert this sign language video data to related words information, and scrambler enters this literal information coding in the video data.
Two, the concrete operation method in the actual communication
1, deaf and dumb personage and common personage's communication
As Fig. 5, suppose that A is deaf and dumb personage, B is common personage.
1) at A end, A opens sign language and the text conversion function of text visual communication device 400, and the sign language of A is converted into literal, and the while video encoder is also encoded Word message and entered video data and send B to.In B terminal display video image, Word message is also shown.
2) at B end, B opens voice and the text conversion function of text visual communication device 400, converts the voice signal of B to literal, and the while is entered video data by video encoder encodes.In A end display video image, Word message is shown.
Mutual repeatedly by top two steps just can be realized normal interchange the between deaf and dumb personage and the ordinary people.
2, ordinary people and ordinary people's communication
As Fig. 5, suppose that A, B are common personage.In the communication of visual communication device, consider problems such as voice transmission quality on the line is bad, also can be that literal shows with both sides' speech conversion, the limit is listened the other side's words limit to see and literal on the video is reached better communicative effect.
1) at A end, A opens voice and the text conversion function of text visual communication device 400, and the voice signal of A is converted into literal, and the while video encoder is also encoded Word message and entered video data and send B to.In B terminal display video image, Word message is also shown.
2) at B end, B also opens voice and the text conversion function of text visual communication device 400, converts the voice signal of B to literal, and the while is entered video data by video encoder encodes.In A end display video image, Word message is shown.
Mutual repeatedly by top two steps just can be realized normal interchange the between two ordinary peoples.
Though more than described the specific embodiment of the present invention, it will be understood by those of skill in the art that these only illustrate, under the prerequisite that does not deviate from principle of the present invention and essence, can make numerous variations or modification to these embodiments.Therefore, protection scope of the present invention is limited by appended claims.
Claims (5)
1, the method for a kind of voice and text conversion is characterized in that, it may further comprise the steps:
1) detects the voice data of importing;
2) convert this voice data to related words information;
3) scrambler enters this literal information coding in the video data.
2, the method for a kind of sign language and text conversion is characterized in that, it may further comprise the steps:
1) detects the sign language video data of importing;
2) convert this sign language video data to related words information;
3) scrambler enters this literal information coding in the video data.
3, the method for sign language according to claim 2 and text conversion, it is characterized in that, it is with the sign language image of camera acquisition, with the sign language image information contrast that pre-sets, find the immediate image of sign language image with this camera acquisition, and extract this image word information relates.
4, a kind of text visual communication device is characterized in that, it comprises:
Voice and text conversion terminal are used to detect the voice data of input, convert this voice data to related words information, and with scrambler this literal information coding are entered in the video data;
Sign language and text conversion terminal are used to detect the sign language video data of input, convert this sign language video data to related words information, and scrambler enters this literal information coding in the video data.
5, text visual communication device according to claim 4, it is characterized in that, this sign language and text conversion terminal are with the sign language image of camera acquisition, with the sign language image information contrast that pre-sets, find the immediate image of sign language image with this camera acquisition, and extract this image word information relates.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101719248A CN101452705A (en) | 2007-12-07 | 2007-12-07 | Voice character conversion nd cued speech character conversion method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101719248A CN101452705A (en) | 2007-12-07 | 2007-12-07 | Voice character conversion nd cued speech character conversion method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101452705A true CN101452705A (en) | 2009-06-10 |
Family
ID=40734905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007101719248A Pending CN101452705A (en) | 2007-12-07 | 2007-12-07 | Voice character conversion nd cued speech character conversion method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101452705A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102710539A (en) * | 2012-05-02 | 2012-10-03 | 中兴通讯股份有限公司 | Method and device for transferring voice messages |
| CN103226692A (en) * | 2012-11-22 | 2013-07-31 | 广东科学中心 | Video stream image frame recognizing system and method thereof |
| CN104038617A (en) * | 2013-03-04 | 2014-09-10 | 联想移动通信科技有限公司 | Calling method and intelligent mobile terminal |
| CN104135426A (en) * | 2014-07-11 | 2014-11-05 | Tcl通讯（宁波）有限公司 | Method and system for transmitting attachment by using voice service |
| CN104464719A (en) * | 2014-12-16 | 2015-03-25 | 上海市共进通信技术有限公司 | System for achieving intelligent communication of deaf and mute person |
| CN105162944A (en) * | 2015-06-23 | 2015-12-16 | 上海斐讯数据通信技术有限公司 | Conversation system and conversation method |
| CN105450970A (en) * | 2014-06-16 | 2016-03-30 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106943740A (en) * | 2017-04-25 | 2017-07-14 | 合肥充盈信息科技有限公司 | A kind of gesture language-voice game interactive system |
| CN107707726A (en) * | 2016-08-09 | 2018-02-16 | 深圳市鹏华联宇科技通讯有限公司 | A kind of terminal and call method communicated for normal person with deaf-mute |
| CN110740283A (en) * | 2019-10-29 | 2020-01-31 | 杭州当虹科技股份有限公司 | method for converting voice into character based on video communication |
| CN110995921A (en) * | 2019-11-19 | 2020-04-10 | 维沃移动通信有限公司 | Call processing method, electronic device and computer readable storage medium |
| CN115066907A (en) * | 2019-12-09 | 2022-09-16 | 金京喆 | User terminal, broadcasting apparatus, broadcasting system including the same, and control method thereof |
-
2007
- 2007-12-07 CN CNA2007101719248A patent/CN101452705A/en active Pending
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102710539A (en) * | 2012-05-02 | 2012-10-03 | 中兴通讯股份有限公司 | Method and device for transferring voice messages |
| CN103226692A (en) * | 2012-11-22 | 2013-07-31 | 广东科学中心 | Video stream image frame recognizing system and method thereof |
| CN104038617A (en) * | 2013-03-04 | 2014-09-10 | 联想移动通信科技有限公司 | Calling method and intelligent mobile terminal |
| CN105450970A (en) * | 2014-06-16 | 2016-03-30 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN105450970B (en) * | 2014-06-16 | 2019-03-29 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN104135426A (en) * | 2014-07-11 | 2014-11-05 | Tcl通讯（宁波）有限公司 | Method and system for transmitting attachment by using voice service |
| CN104464719A (en) * | 2014-12-16 | 2015-03-25 | 上海市共进通信技术有限公司 | System for achieving intelligent communication of deaf and mute person |
| CN105162944A (en) * | 2015-06-23 | 2015-12-16 | 上海斐讯数据通信技术有限公司 | Conversation system and conversation method |
| CN105162944B (en) * | 2015-06-23 | 2018-04-06 | 上海斐讯数据通信技术有限公司 | A kind of phone system and method |
| CN107707726A (en) * | 2016-08-09 | 2018-02-16 | 深圳市鹏华联宇科技通讯有限公司 | A kind of terminal and call method communicated for normal person with deaf-mute |
| CN106943740A (en) * | 2017-04-25 | 2017-07-14 | 合肥充盈信息科技有限公司 | A kind of gesture language-voice game interactive system |
| CN110740283A (en) * | 2019-10-29 | 2020-01-31 | 杭州当虹科技股份有限公司 | method for converting voice into character based on video communication |
| CN110995921A (en) * | 2019-11-19 | 2020-04-10 | 维沃移动通信有限公司 | Call processing method, electronic device and computer readable storage medium |
| CN115066907A (en) * | 2019-12-09 | 2022-09-16 | 金京喆 | User terminal, broadcasting apparatus, broadcasting system including the same, and control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101452705A (en) | Voice character conversion nd cued speech character conversion method and device | |
| US9111545B2 (en) | Hand-held communication aid for individuals with auditory, speech and visual impairments | |
| CN101340676B (en) | Method, apparatus and mobile terminal implementing simultaneous interpretation | |
| CN101510256B (en) | Mouth shape language conversion method and device | |
| WO2001059976A3 (en) | System and method for internet call management with text-to-speech messaging | |
| CN101123630A (en) | Communication method and system for voice and text conversion | |
| CN101175264A (en) | Visual communication device | |
| CN101931779A (en) | Video telephone and communication method thereof | |
| CN101453611A (en) | Method for video communication between the deaf and the normal | |
| CN103997571A (en) | Business card exchange method based on audio coding | |
| CN101453499A (en) | Mobile phone syllable conversion device and method thereof | |
| KR20110051385A (en) | Communication terminal and method for communicating thereof | |
| EP1855441A3 (en) | Multimedia data monitoring method | |
| CN100563334C (en) | In the video telephone mode of wireless terminal, send the method for view data | |
| CN101420585A (en) | System and method for transmitting non-video information by visible telephone terminal | |
| KR20010107877A (en) | Voice Recognized 3D Animation Sign Language Display System | |
| KR20140006198A (en) | System for providing wireless captioned conversation service | |
| CN1652562A (en) | Method for implementing multimedia communication function by cell phone | |
| JP2932027B2 (en) | Videophone equipment | |
| KR20150025750A (en) | user terminal apparatus and two way translation method thereof | |
| JP2000004304A (en) | Speech communication device enabling communication with different means | |
| CN101193150A (en) | Method of providing caller name with the voice for user recognition | |
| KR100631585B1 (en) | Method and device for message service of camera phone | |
| CN204733229U (en) | A kind of communicator by biometrics identification technology display of calling personal information | |
| CN107562738A (en) | A kind of sign language interpretation method based on user's request |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20090610 |