CN101453611A - Method for video communication between the deaf and the normal - Google Patents
Method for video communication between the deaf and the normal Download PDFInfo
- Publication number
- CN101453611A CN101453611A CNA2007101719252A CN200710171925A CN101453611A CN 101453611 A CN101453611 A CN 101453611A CN A2007101719252 A CNA2007101719252 A CN A2007101719252A CN 200710171925 A CN200710171925 A CN 200710171925A CN 101453611 A CN101453611 A CN 101453611A
- Authority
- CN
- China
- Prior art keywords
- user
- sign language
- video
- normal person
- mobile phone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to a video communication method for a deaf person and a normal person, wherein a user A is the deaf person using sign language, while a user B is the normal person only capable of using voice and character but ignorant of the sign language, and the method comprises the following steps: S1, the user A uses a mobile phone to receive voice signals sent by the user B and convert the voice signals into sign language video to be displayed on a screen, and then transmits response to the user B by sign language signals; and S2, the user B uses a mobile phone to receive the sign language signals sent by the user A and convert the sign language signals into voice video or character video to be displayed on the screen. The method has the advantage that the method solves the video communication problem between the deaf person and the normal person but ignorant of the sign language, and expands use occasions of the mobile phone.
Description
Technical field
The present invention relates to a kind of personage of becoming deaf and normal person by the method that video carries out communication, belong to mobile phone, the telephone communication terminal technical field.
Background technology
Present various communicating terminal constantly occurs, to portable terminal, these all are limited to the normal person and use from the fixed line phone of fixed network, and for becoming deaf the personage, have only this communication modes of note at present. along with entering of Visual communications epoch, people can exchange face-to-face by network, yet for the personage that becomes deaf, owing to can't exchange with sound, can only be by sign language, but common people but are ignorant of sign language, and this has just caused the difficulty that exchanges.
Summary of the invention
In sum, how solving the personage that becomes deaf exchanges with communication between the normal person who is ignorant of sign language, it is technical problem to be solved by this invention, for this reason, the object of the present invention is to provide a kind of method that can exchange with the normal person who is ignorant of sign language for the personage that becomes deaf, also can be used in the general population simultaneously.
In order to realize purpose of the present invention, the present invention proposes a kind of method, and its realization comprises following 2 kinds:
Suppose that A is the personage that becomes deaf, B is the general personage who is ignorant of sign language
At the mobile phone that A end deafness A uses, the voice signal that the other side is imported into converts sign language to, be presented on the screen, thereby the sign language of being operated by the personage A that becomes deaf simultaneously also is converted into sound or literal sends B. realization communication to;
Rectify the mobile phone that ordinary person scholar B uses at B, the vision signal that the other side is imported into converts sound or literal to, and the voice signal that is ignorant of the normal personage B of sign language simultaneously also is converted into image (sign language) thereby sending the personage A. that becomes deaf to realizes communication.
Summary is got up, and according to a kind of deafness of the present invention and normal person's video communication method, wherein: user A is for using the deafness of sign language, and user B comprises step: S for using voice and literal-be ignorant of the normal person of sign language
1, user A uses mobile phone to receive the voice signal that user B sends and convert the sign language video to and is presented on the screen, reply with the sign language signal then and send to user B; S
2, user B uses mobile phone to receive the sign language signal that user A sends and converts voice and video to or the literal video is presented on the screen.
Further, step S
1Described in user A will reply sign language and send to user B, or user A mobile phone will be replied sign language conversion of signals Chinese idiom audio-video signal earlier and be sent to user B again.
Step S
2Described in user B use mobile phone to receive the sign language signal that user A sends and change into the voice and video signal or described user B uses mobile phone directly to receive the voice signal that user A sends.
Step S
1Described in user A use mobile phone to receive the voice signal that user B sends and change into voice and video, or user A uses mobile phone directly to receive the sign language vision signal that user B sends.
Wherein, step S
1In, user A selects sign language and sound conversion operations, afterwards, user A waits for that user B confirms, after confirming successfully, the video data that user A mobile phone begins to detect user B input converts corresponding sound to, will convert the sign language video information simultaneously from the sound that the other side receives to and show.
Wherein, step S
1In, user A selects sign language and sound conversion operations, and afterwards, user A waits for that user B confirms, if confirm failure, user A analyzes failure cause, if user B refuses this function, then withdraws from this feature operation; If belong to other reason, then repeat the affirmation process.
Wherein, step S
2In, after user B receives the sign language and sound conversion request of user A, notify user A to reaffirm, if confirm successfully, user B uses mobile phone to begin to detect the information that user B inputs to user A, and convert corresponding sign language video information to, will convert acoustic information to from the vision signal that user A receives simultaneously and show.
Wherein, step S
2In, user B notifies user A to reaffirm after receiving the sign language and sound conversion request of user A, if confirm to fail, user B judges that the affirmation failure is because user A refuses just exit confirmation request, if confirm that the request failure is other reason, then enter the duplicate acknowledgment request process.
Wherein, the conversion of described sign language and sound is meant the image that checkout equipment is gathered and pre-sets the sign language image information to compare, and finds immediate with it image, extracts the immediate acoustic information of image.
Wherein, described text conversion becomes sign language information, is meant that user A receives the Word message of user B, utilizes speech recognition system to find word information relates, finds corresponding image according to Word message again and shows.
Wherein, described speech conversion becomes sign language information, is meant that user A receives the acoustic information of user B, compares with the acoustic information of the sign language image that pre-sets, and finds immediate with it image, and shows.
Advantage of the present invention is: owing to adopt by video telephone, sound (perhaps literal) and image (sign language) signal are handled, realized becoming deaf personage A and the normal personage B that generally is ignorant of sign language exchange.
Description of drawings
Fig. 1 is function conversion program one a flow process schematic diagram of the present invention.
Fig. 2 is function conversion program two flow process schematic diagrames of the present invention.
Fig. 3 is the conversion schematic diagram of sign language and sound (or literal) among the present invention.
Fig. 4 is the conversion schematic diagram of sound among the present invention (or literal) and sign language.
Embodiment
The present invention is described in further detail below by specific embodiment and in conjunction with Fig. 1-Fig. 4, so that those skilled in the art is easier to understand technical characterictic of the present invention and function characteristics, rather than is used for limiting scope of the present invention.
As shown in Figure 1, in function conversion program one, step 1000, user A selects sign language and sound conversion operations, step 1001, user A notifies the user B, and we select sign language and sound conversion, and wait for its affirmation, step 1002 confirms that successfully the terminal of user A begins to detect the video data of input, convert corresponding acoustic information to, will convert video information to from the sound that the other side (user B) receives simultaneously and show.Step 1003 is confirmed failure, and user A analyzes failure cause, if the other side (user B) refusal sign language and sound translation function, just execution in step 1004, quit a program, otherwise, execution in step 1005, rebound execution in step 1001, duplicate acknowledgment process.
As shown in Figure 2, in function conversion program two, step S
2000, user B receives sign language and the sound conversion request that user A sends, step S
2001, user B notifies user A that function conversion is reaffirmed, if confirm successfully execution in step S
2002, the terminal of user A begins to detect the acoustic information of user B input, converts corresponding video signals to, will convert acoustic information to from the vision signal that user A receives simultaneously and show, if confirm failure, execution in step S
2003, user B analyzes failure cause, if addressee refuses receives sign language and sound translation function, just execution in step S
2004, quit a program, otherwise execution in step S
2005, rebound step S
2001Repeat the affirmation process.
As shown in Figure 3, in sign language and sound conversion program, step S
3001, by the sensor acquisition image.Step S
3002, image of gathering and the sign language image that sets in advance are compared step S
3003, find immediate with it image, extract the acoustic information of image correspondence.
As shown in Figure 4, in sound and sign language conversion program, step S
4001, user A receives the acoustic information of user B, step S
4002, the voice data information of the acoustic information of resulting user B and the sign language image that sets in advance is compared step S
4003, find immediate with it image according to contrast, and the gained image shown step S
4004, if utilize speech recognition system to find word information relates, execution in step S then
4005, find corresponding image according to its Word message, and the gained image shown.
Claims (11)
1, a kind of deafness and normal person's video communication method is characterized in that, wherein user A is for using the deafness of sign language, and user B is characterized in that for using voice and literal-be ignorant of the normal person of sign language described method comprises step:
S
1, user A uses mobile phone to receive the voice signal that user B sends and convert the sign language video to and is presented on the screen, reply with the sign language signal then and send to user B;
S
2, user B uses mobile phone to receive the sign language signal that user A sends and converts voice and video to or the literal video is presented on the screen.
2, deafness according to claim 1 and normal person's video communication method is characterized in that step S
1Described in user A will reply sign language and send to user B, or user A will reply sign language conversion of signals voice and video signal earlier with mobile phone and send to user B again.
3, deafness according to claim 1 and normal person's video communication method is characterized in that step S
1Described in user A use mobile phone to receive the voice signal that user B sends and change into voice and video, or user A uses mobile phone directly to receive the sign language vision signal that user B sends.
4, deafness according to claim 1 and normal person's video communication method is characterized in that step S
2Described in user B use mobile phone to receive the sign language signal that user A sends and change into the voice and video signal or described user B uses mobile phone directly to receive the voice signal that user A sends.
5, deafness according to claim 1 and normal person's video communication method is characterized in that step S
1In, user A selects sign language and sound conversion operations, afterwards, user A waits for that user B confirms, after confirming successfully, the video data that user A mobile phone begins to detect user B input converts corresponding sound to, will convert the sign language video information simultaneously from the acoustic information that the other side receives to and show.
6, deafness according to claim 1 and normal person's video communication method is characterized in that step S
1In, user A selects sign language and sound conversion operations, and afterwards, user A waits for that user B confirms, if confirm failure, user A analyzes failure cause, if user B refuses this function, then withdraws from this feature operation; If belong to other reason, then repeat the affirmation process.
7, deafness according to claim 1 and normal person's video communication method is characterized in that step S
2In, after user B receives the sign language and voice signal conversion request of user A, notify user A to reaffirm, if confirm successfully, user B mobile phone begins to detect the user A information of being carried by user B, and convert corresponding sign language video information to, will show from the vision signal conversion acoustic information that user A receives simultaneously.
8, deafness according to claim 1 and normal person's video communication method is characterized in that step S
2In, user B notifies user A to reaffirm after receiving the sign language and sound conversion request of user A, if confirm to fail, user B judges that the affirmation failure is because user A refuses just exit confirmation request, if confirm that the request failure is other reason, then enter the duplicate acknowledgment request process.
9, deafness according to claim 1 and normal person's video communication method, it is characterized in that, the conversion of described sign language and acoustic information, be meant the image that checkout equipment is gathered and pre-set the sign language image information and compare, find immediate with it image, extract the immediate acoustic information of image.
10, deafness according to claim 1 and normal person's video communication method, it is characterized in that, described speech conversion becomes sign language information, be meant that user A receives the acoustic information of user B, compare with the acoustic information of the sign language image that pre-sets, find immediate with it image, and show.
11, deafness according to claim 1 and normal person's video communication method, it is characterized in that, described text conversion becomes sign language information, be meant that user A receives the Word message of user B, utilize speech recognition system to find word information relates, find corresponding image according to Word message again and show.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101719252A CN101453611A (en) | 2007-12-07 | 2007-12-07 | Method for video communication between the deaf and the normal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101719252A CN101453611A (en) | 2007-12-07 | 2007-12-07 | Method for video communication between the deaf and the normal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101453611A true CN101453611A (en) | 2009-06-10 |
Family
ID=40735594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007101719252A Pending CN101453611A (en) | 2007-12-07 | 2007-12-07 | Method for video communication between the deaf and the normal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101453611A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102413249A (en) * | 2010-09-20 | 2012-04-11 | 阿尔卡特朗讯 | Conversation based on speech recognition |
| CN102420897A (en) * | 2011-09-02 | 2012-04-18 | 辜进荣 | Mobile phone communication information transmitting method and device |
| CN102984496A (en) * | 2012-12-21 | 2013-03-20 | 华为技术有限公司 | Processing method, device and system of video and audio information in video conference |
| WO2013127367A1 (en) * | 2012-03-02 | 2013-09-06 | 腾讯科技（深圳）有限公司 | Instant communication voice recognition method and terminal |
| WO2014169840A1 (en) * | 2013-08-12 | 2014-10-23 | 中兴通讯股份有限公司 | Information input/output method, apparatus, terminal device, and computer storage medium |
| CN106254960A (en) * | 2016-08-30 | 2016-12-21 | 福州瑞芯微电子股份有限公司 | A kind of video call method for communication disorders and system |
| CN106981237A (en) * | 2016-01-19 | 2017-07-25 | 钟世雄 | A kind of method, device and the mobile phone of the sign language input selected based on picture |
| CN107610284A (en) * | 2017-08-23 | 2018-01-19 | 移康智能科技（上海）股份有限公司 | A kind of gesture identification method, device and intelligent peephole |
| CN107707726A (en) * | 2016-08-09 | 2018-02-16 | 深圳市鹏华联宇科技通讯有限公司 | A kind of terminal and call method communicated for normal person with deaf-mute |
| CN113766165A (en) * | 2021-08-11 | 2021-12-07 | 广州亿语智能科技有限公司 | Interactive mode, device, terminal and storage medium for realizing barrier-free video chat |
-
2007
- 2007-12-07 CN CNA2007101719252A patent/CN101453611A/en active Pending
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102413249A (en) * | 2010-09-20 | 2012-04-11 | 阿尔卡特朗讯 | Conversation based on speech recognition |
| CN102420897A (en) * | 2011-09-02 | 2012-04-18 | 辜进荣 | Mobile phone communication information transmitting method and device |
| WO2013127367A1 (en) * | 2012-03-02 | 2013-09-06 | 腾讯科技（深圳）有限公司 | Instant communication voice recognition method and terminal |
| CN103295576A (en) * | 2012-03-02 | 2013-09-11 | 腾讯科技（深圳）有限公司 | Voice identification method and terminal of instant communication |
| US9263029B2 (en) | 2012-03-02 | 2016-02-16 | Tencent Technology (Shenzhen) Company Limited | Instant communication voice recognition method and terminal |
| CN102984496B (en) * | 2012-12-21 | 2015-08-19 | 华为技术有限公司 | The processing method of the audiovisual information in video conference, Apparatus and system |
| CN102984496A (en) * | 2012-12-21 | 2013-03-20 | 华为技术有限公司 | Processing method, device and system of video and audio information in video conference |
| CN104378519A (en) * | 2013-08-12 | 2015-02-25 | 中兴通讯股份有限公司 | Information input/output method and device for voice mailbox service system and client side |
| WO2014169840A1 (en) * | 2013-08-12 | 2014-10-23 | 中兴通讯股份有限公司 | Information input/output method, apparatus, terminal device, and computer storage medium |
| CN106981237A (en) * | 2016-01-19 | 2017-07-25 | 钟世雄 | A kind of method, device and the mobile phone of the sign language input selected based on picture |
| CN107707726A (en) * | 2016-08-09 | 2018-02-16 | 深圳市鹏华联宇科技通讯有限公司 | A kind of terminal and call method communicated for normal person with deaf-mute |
| CN106254960A (en) * | 2016-08-30 | 2016-12-21 | 福州瑞芯微电子股份有限公司 | A kind of video call method for communication disorders and system |
| CN107610284A (en) * | 2017-08-23 | 2018-01-19 | 移康智能科技（上海）股份有限公司 | A kind of gesture identification method, device and intelligent peephole |
| CN113766165A (en) * | 2021-08-11 | 2021-12-07 | 广州亿语智能科技有限公司 | Interactive mode, device, terminal and storage medium for realizing barrier-free video chat |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101453611A (en) | Method for video communication between the deaf and the normal | |
| US9111545B2 (en) | Hand-held communication aid for individuals with auditory, speech and visual impairments | |
| CN102170617A (en) | Mobile terminal and remote control method thereof | |
| CN201440733U (en) | Mobile speech communication terminal suitable for person with language barrier | |
| CN100512127C (en) | Connection controller, communication system, and connection control method | |
| TWI399970B (en) | A method for interaction real information between mobile devices | |
| CN101452705A (en) | Voice character conversion nd cued speech character conversion method and device | |
| JP2003345379A (en) | Audio video conversion apparatus and method, and audio video conversion program | |
| CN101175264A (en) | Visual communication device | |
| JP2006217628A (en) | Transceiver for providing image communication among many person and transmission method | |
| US20060199601A1 (en) | Method of transforming message and mobile station using the same | |
| CN101123630A (en) | Communication method and system for voice and text conversion | |
| EP1718045A1 (en) | Method for setting main language in mobile terminal and mobile terminal implementing the same | |
| KR20110051385A (en) | Communication terminal and method for communicating thereof | |
| US20160203818A1 (en) | Wireless caption communication service system | |
| CN103187062A (en) | Vehicle-mounted data processing device and preservation service data processing system | |
| CN111246127A (en) | Cross-platform-based real-time subtitle display method and management system | |
| CN100596238C (en) | Multimedia communication method and network element device | |
| JP2003092628A (en) | Phone relay service method | |
| CN1722642A (en) | Transmission method of reception content utilizing house network | |
| CN105306695A (en) | Communication method of mobile terminal and mobile terminal | |
| CN101540798A (en) | Method and system for displaying messages during communication of mobile phone | |
| KR20140006198A (en) | System for providing wireless captioned conversation service | |
| CN103916984A (en) | Computer and mobile phone take-over communication method | |
| KR102117993B1 (en) | Method and apparatus for providing relay communication service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20090610 |