CN108960158A - Intelligent sign language translation system and method - Google Patents
Intelligent sign language translation system and method Download PDFInfo
- Publication number
- CN108960158A CN108960158A CN201810747305.7A CN201810747305A CN108960158A CN 108960158 A CN108960158 A CN 108960158A CN 201810747305 A CN201810747305 A CN 201810747305A CN 108960158 A CN108960158 A CN 108960158A
- Authority
- CN
- China
- Prior art keywords
- information
- sign language
- gesture
- model
- text information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013519 translation Methods 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000006854 communication Effects 0.000 claims abstract description 28
- 238000004891 communication Methods 0.000 claims abstract description 27
- 238000006243 chemical reaction Methods 0.000 claims abstract description 21
- 238000009877 rendering Methods 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 claims description 12
- 238000012790 confirmation Methods 0.000 claims description 7
- 238000012795 verification Methods 0.000 claims description 4
- 238000012937 correction Methods 0.000 claims description 3
- 238000009434 installation Methods 0.000 claims 1
- 208000016354 hearing loss disease Diseases 0.000 abstract 1
- 230000033001 locomotion Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/113—Recognition of static hand signs
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Telephonic Communication Services (AREA)
- Telephone Function (AREA)
- Machine Translation (AREA)
Abstract
The invention belongs to the technical field of sign language translation, and discloses an intelligent sign language translation system and a method for mutually translating sign language, characters and voice. The system comprises: the input module comprises a plurality of cameras capable of shooting simultaneously; the storage unit is used for storing a standard gesture 3D model and character information corresponding to the three-dimensional model of the standard sign language; a 3D model building module; the matching module is used for matching the standard gesture 3D model corresponding to the matching module; the sign language translation module is used for converting the standard gesture 3D model and the corresponding character information; the voice recognition module is used for converting the voice information into corresponding text information; the image identification module is used for identifying character information in the image; the voice conversion module is used for converting the text information into corresponding voice information; and an output module. An effective and convenient communication method and a reading, watching and understanding mode are provided for special people with language and hearing impairment and normal people; the translation accuracy is high, and the use habit of the user is better fitted.
Description
Technical field
The invention belongs to sign language interpreter technical field more particularly to a kind of system and methods of intelligent sign language translation.
Background technique
When playing news hookup, screen lower right just will appear a sign language teacher and translate into host's word
The animation of sign language, to facilitate the people for having S & H obstacle being capable of accessible understanding news content.In the communication of people usually
It is all that chat communication is carried out by chat software such as QQ, wechat and relatives, friend mostly in addition to making a phone call in communication process, that
With the help of no third party, there is the people of S & H obstacle how to exchange and read to people and watch related money
Material?
Present people exchange usually using the chat software on smart phone or tablet computer, and hand used at present
Language interpreting equipment is usually independent equipment, this is just inconvenient when using chat software, is handed over using sign language interpreter equipment
It flows.
Because there are the minor motions such as some digital flexion degree for the gesture in sign language, obtained sometimes through common camera shooting figure
Images of gestures is difficult to distinguish these minor motions.If the 3D rendering information for the gesture motion that can live, can differentiate this
Little trick slightly improves the accuracy of sign language interpreter.
Generally, smart phone or tablet computer are all the private equipment held, and are not belonging to the electronic product of public use, are
The comfort that the impedient people that improves one's hearing uses, it is also necessary to according to personal touch, be bonded user use habit.
The invention proposes a kind of method and system of intelligent sign language translation, which may be mounted at smart phone or flat
Plate computer, and cooperate with chat software, sign language is obtained by forward and backward camera of setting, online real-time perfoming sign language interpreter exchanges, together
When also be bonded user use habit.
Summary of the invention
In view of the above technical problems existing in the prior art, an object of the present invention is just to provide a kind of intelligent sign language and turns over
The method for being translated into voice or text obtains images of gestures by multi-cam, and is processed into 3D model, by with standard 3D
Conversion between Model Matching and model and text information obtains text information.This method can be real directly in conjunction with chat software
When translate, the accuracy of sign language interpreter is high, is more bonded the use habit of user, has personal settings.
It is the method for sign language that the second object of the present invention, which is just to provide a kind of intelligent sound or character translation, is digitized the speech into
Gesture information is obtained by the conversion between text and standard 3D model for text information, it is defeated in the form of standard images of gestures
Out.This method can also be directly in conjunction with chat software, real time translation, and the accuracy of sign language interpreter is high.
The system that the third object of the present invention is to provide a kind of intelligent sign language translation, the system are able to carry out above-mentioned two
Interpretation method.
The fourth object of the present invention is to provide a kind of mobile phone for installing above-mentioned intelligent sign language translation system.
The present invention provides a kind of method that intelligent sign language translation is voice or text, comprising the following steps:
Gesture is shot simultaneously by multiple cameras；
The image information of multiple cameras shooting is handled, obtains gesture 3D rendering information, and establish gesture 3D mould
Type；
Gesture 3D model is subjected to match cognization with the standard gesture 3D model prestored, obtains matched standard gesture 3D mould
Type；
It is corresponding text information by standard gesture 3D model conversion；
Corresponding text information is converted into corresponding voice messaging；
Export the text information；
Export the voice messaging.
Further, it in order to guarantee the accuracy of sign language interpreter, needs to verify gesture 3D model, specifically include；
The standard gesture 3D model conversion that matching is obtained is standard images of gestures information；
The standard images of gestures information is played, and user is prompted to be confirmed whether correctly；
If user's confirmation is incorrect, execution re-shoots gesture operation.
Further, in order to more be bonded the use habit of user, personal settings have been carried out to sign language interpreter, it is specific to wrap
It includes:
Incidence relation is established between gesture 3D rendering information and corresponding text information；
Judge that the whether relevant information of gesture 3D rendering information is converted directly into related if being judged as relevant information
The text information of connection relationship.
Further, sign language interpreter can also be easily carried out when using APP such as chat softwares for the ease of user, need
Communication interface is set on APP, is specifically included；
Communication interface on APP between setting and sign language interpreter program, and communication protocol is set；
The image information that multiple cameras are shot passes through communications interface transmission to sign language interpretive program；
Corresponding text information is passed through into communications interface transmission to APP.
The present invention also provides a kind of methods that intelligent sound or character translation are sign language, comprising the following steps:
Acquisition text information is scanned and identified by camera, or passes through input method inputting word information；
Recorded speech information, and identify voice messaging, obtain corresponding text information；
Text information is converted into corresponding standard gesture 3D model；
It is standard images of gestures information by standard gesture 3D model conversion；
Export the standard images of gestures information.
Further, it in order to guarantee the accuracy of sign language interpreter, needs to verify voice messaging, specifically include；
The text information that output identification voice messaging obtains, and user is prompted to be confirmed whether correctly；
If user's confirmation is incorrect, executes again recorded speech information and operate.
Further, sign language interpreter can also be easily carried out when using APP such as chat softwares for the ease of user, need
Communication interface is set on APP, is specifically included；
Communication interface on APP between setting and sign language interpreter program, and communication protocol is set；
Text information or voice messaging are passed through into communications interface transmission to sign language interpretive program；
Standard images of gestures information is passed through into communications interface transmission to APP.
Further, when using some audio frequency and video related softwares, the lyrics, letter, barrage etc. are all with text information
Occur, and talking with is occurred with voice messaging, is needed to carry out transferring for text information, is specifically included:
User in APP is shown and is taken out with the text information or voice messaging exchanged.
The present invention also provides a kind of intelligent sign language translation system, the system comprises:
Input module, images of gestures information, voice messaging or the text information obtained for inputting shooting, including can be simultaneously
Multiple cameras of shooting；
Storage unit, for storing standard gesture 3D model and text information corresponding with the threedimensional model of standard sign language；
3D model building module, for being built according to by the images of gestures information that multiple cameras shoot gesture
It founds gesture 3D model, or by standard gesture 3D model conversion is standard images of gestures information；
Matching module, for according to the standard gesture 3D model in storage unit by obtained gesture 3D Model Matching be pair
The standard gesture 3D model answered；
Standard gesture 3D model conversion is corresponding text by sign language interpreter module, information for being stored according to storage unit
Word information, or text information is converted into corresponding standard gesture 3D model；
Speech recognition module, the voice messaging inputted for identification are converted to corresponding text information；
Picture recognition module, the text information in image, is converted to corresponding text information for identification；
Voice conversion module, for text information to be converted to corresponding voice messaging；
Output module, for exporting image information, text information or voice messaging.
Further, the intelligent sign language translation system further include:
Correction verification module, for prompting user to confirm whether the broadcasting standard images of gestures information is correct, if user's confirmation is not
Correctly, triggering typing unit re-types images of gestures information.
Further, the intelligent sign language translation system further include:
Communication module, for carrying out the transmission of image information, text information, voice messaging with chat software.
Further, the intelligent sign language translation system further include:
Related information module for establishing incidence relation between gesture 3D rendering information and corresponding text information, and is sentenced
The whether relevant information of gesture of cutting off the hands 3D rendering information is converted directly into the text of incidence relation if being judged as relevant information
Information.
Further, when using some audio frequency and video related softwares, the lyrics, letter, barrage etc. are all with text information
Occur, and talking with is occurred with voice messaging, needs to carry out transferring for text information, the system comprises:
Information transfers module, takes out for showing the user in APP with the text information or voice messaging exchanged.
The present invention also provides a kind of mobile phone, the mobile phone is equipped with above-mentioned intelligent sign language translation system, and CPU is able to carry out
Above-mentioned intelligent sign language translation be text or voice method and intelligent text or voiced translation be sign language method.
The present invention can be handled the voice signal received or the text being directly scanned out by software, be converted to hand
Language simultaneously exports, perhaps by it is forward and backward set camera and obtain sign language sign language is then converted into voice signal or text issue.
It realizes the people for being ignorant of sign language and has and carry out linking up between the special population of S & H obstacle and normal reading watches video
A possibility that.
The invention has the following beneficial effects:
1, the present invention can also be independently operated, directly in conjunction with chat software to there is the special of S & H obstacle
There is provided between crowd and normal person it is a kind of effectively easily communication exchange method and read watch understanding mode；
2, it shoots using multi-cam and establishes 3D model, and set up verification step, improve the accuracy of translation；
3, personal settings can be carried out, the use habit of user is more bonded.
Detailed description of the invention
Fig. 1 is the flow chart read text in the embodiment of the present invention 1 and watch audio and video data progress sign language interpreter；
Fig. 2 is the flow chart that chat tool sign language interpreter is realized in the embodiment of the present invention 2；
Fig. 3 is to realize that sign language interpreter is the flow chart of voice or text in the embodiment of the present invention 3.
Specific embodiment
Illustrate technical solution of the present invention With reference to embodiment.But, it should be noted that following implementations
Example is only a specific embodiment in the present invention, and does not have to should be understood as limitation of the present invention.
Embodiment 1
One of the present embodiment intelligent sign language translation system, the system comprises:
Input module, images of gestures information, voice messaging or the text information obtained for inputting shooting, including can be simultaneously
Multiple cameras of shooting；
Storage unit, for storing standard gesture 3D model and text information corresponding with the threedimensional model of standard sign language；
3D model building module, for being built according to by the images of gestures information that multiple cameras shoot gesture
It founds gesture 3D model, or by standard gesture 3D model conversion is standard images of gestures information；
Matching module, for according to the standard gesture 3D model in storage unit by obtained gesture 3D Model Matching be pair
The standard gesture 3D model answered；
Standard gesture 3D model conversion is corresponding text by sign language interpreter module, information for being stored according to storage unit
Word information, or text information is converted into corresponding standard gesture 3D model；
Speech recognition module, the voice messaging inputted for identification are converted to corresponding text information；
Picture recognition module, the text information in image, is converted to corresponding text information for identification；
Voice conversion module, for text information to be converted to corresponding voice messaging；
Output module, for exporting image information, text information or voice messaging；
Correction verification module, for prompting user to confirm whether the broadcasting standard images of gestures information is correct, if user's confirmation is not
Correctly, triggering typing unit re-types images of gestures information；
Communication module, for carrying out the transmission of image information, text information, voice messaging with chat software；
Related information module for establishing incidence relation between gesture 3D rendering information and corresponding text information, and is sentenced
The whether relevant information of gesture of cutting off the hands 3D rendering information is converted directly into the text of incidence relation if being judged as relevant information
Information；
Information transfers module, takes out for showing the user in APP with the text information or voice messaging exchanged；
As shown in Figure 1, to read text in the present embodiment and watching the flow chart of audio and video data progress sign language interpreter.Institute
It states intelligent sign language translation APP and is namely based on the application program that monologue story-telling with gestures method and system of the present invention is write, and be mounted on smart phone
On.
Its detailed process includes:
1. opening intelligent sign language translation APP, and input mode is set.
If opening microphone records voice messaging, and identify to voice messaging 2. input mode selects voice, turn
It is changed to text information；If input mode poises text, camera scan text image is opened, and know to character image
Not, text information is converted to.
3. text information is converted to corresponding standard gesture 3D model by sign language interpreter module.
4. being standard images of gestures information by standard gesture 3D model conversion by 3D model building module.
5. showing the standard images of gestures information by mobile phone screen.
Embodiment 2
Intelligent sign language translation system and intelligent sign language translation APP are same as Example 1 in the present embodiment.
As shown in Fig. 2, for the flow chart for realizing chat tool sign language interpreter in the present embodiment, detailed process includes:
1. opening the chat softwares such as wechat/QQ.
2. transferring module by information, text information or voice messaging in chat software are transferred.
3. by communication module, by text information or transmission of speech information to intelligent sign language translation APP.
4. a pair voice messaging identifies, text information is converted to.
5. text information is converted to corresponding standard gesture 3D model by sign language interpreter module.
6. being standard images of gestures information by standard gesture 3D model conversion by 3D model building module.
7. standard images of gestures information is transferred to chat software by communication module.
8. showing the standard images of gestures information by mobile phone screen.
Embodiment 3
Intelligent sign language translation system and intelligent sign language translation APP are same as Example 1 in the present embodiment.
It as described in Figure 3, is to realize that sign language interpreter is the flow chart of voice or text, detailed process packet in the present embodiment
It includes:
1. opening intelligent sign language translation APP, and setting information input mode.
2. setting information input mode is gesture, start camera automatically, starts typing gesture.
3. the image information of pair multiple camera shootings is handled, gesture 3D rendering information is obtained, and establish gesture 3D
Model.
4. gesture 3D model is carried out match cognization with the standard gesture 3D model prestored, matched standard gesture 3D is obtained
Model.
5. being corresponding text information by standard gesture 3D model conversion.
6. corresponding text information is converted to corresponding voice messaging.
7. exporting the text information, or export the voice messaging.
Claims (14)
1. a kind of method that intelligent sign language translation is voice or text, which is characterized in that the described method comprises the following steps:
Gesture is shot simultaneously by multiple cameras；
The image information of multiple cameras shooting is handled, obtains gesture 3D rendering information, and establish gesture 3D model；
Gesture 3D model is subjected to match cognization with the standard gesture 3D model prestored, obtains matched standard gesture 3D model；
It is corresponding text information by standard gesture 3D model conversion；
Corresponding text information is converted into corresponding voice messaging；
Export the text information；
Export the voice messaging.
2. the method that intelligent sign language translation according to claim 1 is voice or text, which is characterized in that the method is also
Including；
The standard gesture 3D model conversion that matching is obtained is standard images of gestures information；
The standard images of gestures information is played, and user is prompted to be confirmed whether correctly；
If user's confirmation is incorrect, execution re-shoots gesture operation.
3. the method that intelligent sign language translation according to claim 1 is voice or text, which is characterized in that the method is also
Include:
Incidence relation is established between gesture 3D rendering information and corresponding text information；
Judge that the whether relevant information of gesture 3D rendering information is converted directly into relevant pass if being judged as relevant information
The text information of system.
4. the method that intelligent sign language translation according to claim 1 is voice or text, which is characterized in that the method is also
Including；
Communication interface on APP between setting and sign language interpreter program, and communication protocol is set；
The image information that multiple cameras are shot passes through communications interface transmission to sign language interpretive program；
Corresponding text information is passed through into communications interface transmission to APP.
5. a kind of method that intelligent sound or character translation are sign language, which is characterized in that the described method comprises the following steps:
Acquisition text information is scanned and identified by camera, or passes through input method inputting word information；
Recorded speech information, and identify voice messaging, obtain corresponding text information；
Text information is converted into corresponding standard gesture 3D model；
It is standard images of gestures information by standard gesture 3D model conversion；
Export the standard images of gestures information.
6. the method that intelligent sound according to claim 5 or character translation are sign language, which is characterized in that the method is also
Include:
The text information that output identification voice messaging obtains, and user is prompted to be confirmed whether correctly；
If user's confirmation is incorrect, executes again recorded speech information and operate.
7. the method that intelligent sound according to claim 5 or character translation are sign language, which is characterized in that the method is also
Including；
Communication interface on APP between setting and sign language interpreter program, and communication protocol is set；
Text information or voice messaging are passed through into communications interface transmission to sign language interpretive program；
Standard images of gestures information is passed through into communications interface transmission to APP.
8. the method that intelligent sound according to claim 7 or character translation are sign language, which is characterized in that the method is also
Include:
User in APP is shown and is taken out with the text information or voice messaging exchanged.
9. a kind of intelligent sign language translation system, which is characterized in that the system comprises:
Input module, images of gestures information, voice messaging or the text information obtained for inputting shooting, including can shoot simultaneously
Multiple cameras；
Storage unit, for storing standard gesture 3D model and text information corresponding with the threedimensional model of standard sign language；
3D model building module, should for being established according to the images of gestures information shot by multiple cameras to gesture
Gesture 3D model, or by standard gesture 3D model conversion be standard images of gestures information；
Matching module, for according to the standard gesture 3D model in storage unit by obtained gesture 3D Model Matching be it is corresponding
Standard gesture 3D model；
Standard gesture 3D model conversion is that corresponding text is believed by sign language interpreter module, information for being stored according to storage unit
Breath, or text information is converted into corresponding standard gesture 3D model；
Speech recognition module, the voice messaging inputted for identification are converted to corresponding text information；
Picture recognition module, the text information in image, is converted to corresponding text information for identification；
Voice conversion module, for text information to be converted to corresponding voice messaging；
Output module, for exporting image information, text information or voice messaging.
10. intelligent sign language translation system according to claim 9, which is characterized in that the intelligent sign language translation system is also
Include:
Correction verification module, for prompting user to confirm whether the broadcasting standard images of gestures information is correct, if user's confirmation is incorrect,
Triggering typing unit re-types images of gestures information.
11. intelligent sign language translation system according to claim 9, which is characterized in that the intelligent sign language translation system is also
Include:
Communication module, for carrying out the transmission of image information, text information, voice messaging with chat software.
12. intelligent sign language translation system according to claim 9, which is characterized in that the intelligent sign language translation system is also
Include:
Related information module for establishing incidence relation between gesture 3D rendering information and corresponding text information, and judges hand
The whether relevant information of gesture 3D rendering information is converted directly into the text information of incidence relation if being judged as relevant information.
13. intelligent sign language translation system according to claim 9, which is characterized in that the system comprises:
Information transfers module, takes out for showing the user in APP with the text information or voice messaging exchanged.
14. a kind of mobile phone, which is characterized in that the mobile phone installation is just like described in any one of claim 9-13 claim
Intelligent sign language translation system, CPU be able to carry out the intelligent sign language translation as described in any one of claim 1-4 for text
The method of word or voice and the intelligent text as described in any one of claim 5-8 or voiced translation are the method for sign language.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810747305.7A CN108960158A (en) | 2018-07-09 | 2018-07-09 | Intelligent sign language translation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810747305.7A CN108960158A (en) | 2018-07-09 | 2018-07-09 | Intelligent sign language translation system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108960158A true CN108960158A (en) | 2018-12-07 |
Family
ID=64482558
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810747305.7A Pending CN108960158A (en) | 2018-07-09 | 2018-07-09 | Intelligent sign language translation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108960158A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109460748A (en) * | 2018-12-10 | 2019-03-12 | 内蒙古科技大学 | A kind of trinocular vision hand language recognition device and multi-information fusion sign Language Recognition Method |
| CN110008839A (en) * | 2019-03-08 | 2019-07-12 | 西安研硕信息技术有限公司 | A kind of intelligent sign language interactive system and method for adaptive gesture identification |
| CN110020442A (en) * | 2019-04-12 | 2019-07-16 | 上海电机学院 | A kind of portable translating machine |
| CN110309517A (en) * | 2019-07-02 | 2019-10-08 | 北京百度网讯科技有限公司 | Expression official documents and correspondence processing method, device, system and storage medium |
| CN110728191A (en) * | 2019-09-16 | 2020-01-24 | 北京华捷艾米科技有限公司 | Sign language translation method, and MR-based sign language-voice interaction method and system |
| CN110992783A (en) * | 2019-10-29 | 2020-04-10 | 东莞市易联交互信息科技有限责任公司 | Sign language translation method and translation equipment based on machine learning |
| CN111144287A (en) * | 2019-12-25 | 2020-05-12 | Oppo广东移动通信有限公司 | Audio-visual auxiliary communication method, device and readable storage medium |
| CN111461005A (en) * | 2020-03-31 | 2020-07-28 | 腾讯科技（深圳）有限公司 | Gesture recognition method and device, computer equipment and storage medium |
| CN114157920A (en) * | 2021-12-10 | 2022-03-08 | 深圳Tcl新技术有限公司 | Playing method and device for displaying sign language, smart television and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040128350A1 (en) * | 2002-03-25 | 2004-07-01 | Lou Topfl | Methods and systems for real-time virtual conferencing |
| CN101539994A (en) * | 2009-04-16 | 2009-09-23 | 西安交通大学 | Mutually translating system and method of sign language and speech |
| CN102956132A (en) * | 2011-08-25 | 2013-03-06 | 鸿富锦精密工业（深圳）有限公司 | System, device and method for translating sign languages |
| CN105868282A (en) * | 2016-03-23 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
| CN106295603A (en) * | 2016-08-18 | 2017-01-04 | 广东技术师范学院 | Chinese sign language bidirectional translation system, method and apparatus |
-
2018
- 2018-07-09 CN CN201810747305.7A patent/CN108960158A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040128350A1 (en) * | 2002-03-25 | 2004-07-01 | Lou Topfl | Methods and systems for real-time virtual conferencing |
| CN101539994A (en) * | 2009-04-16 | 2009-09-23 | 西安交通大学 | Mutually translating system and method of sign language and speech |
| CN102956132A (en) * | 2011-08-25 | 2013-03-06 | 鸿富锦精密工业（深圳）有限公司 | System, device and method for translating sign languages |
| CN105868282A (en) * | 2016-03-23 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
| CN106295603A (en) * | 2016-08-18 | 2017-01-04 | 广东技术师范学院 | Chinese sign language bidirectional translation system, method and apparatus |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109460748A (en) * | 2018-12-10 | 2019-03-12 | 内蒙古科技大学 | A kind of trinocular vision hand language recognition device and multi-information fusion sign Language Recognition Method |
| CN109460748B (en) * | 2018-12-10 | 2024-03-01 | 内蒙古科技大学 | Three-dimensional visual sign language recognition device and multi-information fusion sign language recognition method |
| CN110008839B (en) * | 2019-03-08 | 2023-01-03 | 陕西联森电子科技有限公司 | Intelligent sign language interaction system and method for self-adaptive gesture recognition |
| CN110008839A (en) * | 2019-03-08 | 2019-07-12 | 西安研硕信息技术有限公司 | A kind of intelligent sign language interactive system and method for adaptive gesture identification |
| CN110020442A (en) * | 2019-04-12 | 2019-07-16 | 上海电机学院 | A kind of portable translating machine |
| CN110309517A (en) * | 2019-07-02 | 2019-10-08 | 北京百度网讯科技有限公司 | Expression official documents and correspondence processing method, device, system and storage medium |
| CN110309517B (en) * | 2019-07-02 | 2023-10-17 | 北京百度网讯科技有限公司 | Expression document processing method, device, system and storage medium |
| CN110728191A (en) * | 2019-09-16 | 2020-01-24 | 北京华捷艾米科技有限公司 | Sign language translation method, and MR-based sign language-voice interaction method and system |
| CN110992783A (en) * | 2019-10-29 | 2020-04-10 | 东莞市易联交互信息科技有限责任公司 | Sign language translation method and translation equipment based on machine learning |
| CN111144287A (en) * | 2019-12-25 | 2020-05-12 | Oppo广东移动通信有限公司 | Audio-visual auxiliary communication method, device and readable storage medium |
| CN111461005A (en) * | 2020-03-31 | 2020-07-28 | 腾讯科技（深圳）有限公司 | Gesture recognition method and device, computer equipment and storage medium |
| CN111461005B (en) * | 2020-03-31 | 2023-11-28 | 腾讯科技（深圳）有限公司 | Gesture recognition method and device, computer equipment and storage medium |
| CN114157920A (en) * | 2021-12-10 | 2022-03-08 | 深圳Tcl新技术有限公司 | Playing method and device for displaying sign language, smart television and storage medium |
| CN114157920B (en) * | 2021-12-10 | 2023-07-25 | 深圳Tcl新技术有限公司 | Method and device for playing sign language, intelligent television and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108960158A (en) | Intelligent sign language translation system and method | |
| WO2021078116A1 (en) | Video processing method and electronic device | |
| CN205647778U (en) | Intelligent conference system | |
| EP2210214B1 (en) | Automatic identifying | |
| EP2175647B1 (en) | Apparatus and method for providing emotion expression service in mobile communication terminal | |
| CN104777911B (en) | A kind of intelligent interactive method based on holographic technique | |
| EP4099709A1 (en) | Data processing method and apparatus, device, and readable storage medium | |
| WO2017161741A1 (en) | Method and device for communicating information with deaf-mutes, smart terminal | |
| CN110401810B (en) | Virtual picture processing method, device and system, electronic equipment and storage medium | |
| CN104484037A (en) | Method for intelligent control by virtue of wearable device and wearable device | |
| CN107527623B (en) | Screen transmission method and device, electronic equipment and computer readable storage medium | |
| CN101087151A (en) | Remote control system and method for portable device | |
| CN104394265A (en) | Automatic session method and device based on mobile intelligent terminal | |
| CN110650366A (en) | Interactive dubbing method and device, electronic equipment and readable storage medium | |
| WO2019071808A1 (en) | Video image display method, apparatus and system, terminal device, and storage medium | |
| CN108763475B (en) | Recording method, recording device and terminal equipment | |
| CN113918077A (en) | Projection method, projection control method, related device, projector, and storage medium | |
| CN108650556A (en) | A kind of barrage input method and device | |
| CN117135305B (en) | Teleconference implementation method, device and system | |
| CN110349577A (en) | Man-machine interaction method, device, storage medium and electronic equipment | |
| CN109039851B (en) | Interactive data processing method and device, computer equipment and storage medium | |
| CN105450970A (en) | Information processing method and electronic equipment | |
| CN107679485A (en) | Aid reading method and device based on virtual reality | |
| CN104754261A (en) | Projection equipment and projection method | |
| CN111079495B (en) | Click-to-read mode starting method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |