CN105868282A - Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal - Google Patents
Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal Download PDFInfo
- Publication number
- CN105868282A CN105868282A CN201610168501.XA CN201610168501A CN105868282A CN 105868282 A CN105868282 A CN 105868282A CN 201610168501 A CN201610168501 A CN 201610168501A CN 105868282 A CN105868282 A CN 105868282A
- Authority
- CN
- China
- Prior art keywords
- sign language
- voice signal
- gesture
- storehouse
- digital signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
Abstract
Embodiments of the present invention provide a method and an apparatus that are used by a deaf-mute to perform information communication, and an intelligent terminal. The method comprises the steps of: receiving a voice signal, and matching the voice signal in a pre-established sign language library; according to a matching result for the voice signal in the pre-established sign language library, selecting standard sign language information corresponding to the voice signal from the sign language library; and presenting the standard sign language information that is selected from the sign language library and that corresponds to the voice signal. The voice signal is matched in the pre-established sign language library, and the standard sign language information corresponding to the voice signal is selected from the sign language library, and therefore, the standard sign language information corresponding to the voice signal can be presented to a deaf-mute as a receiver, so that the defect that performance of the intelligent terminal is not fully exerted when the deaf-mute performs information communication is overcome, and the convenience for the deaf-mute to perform information communication by using the intelligent terminal is enhanced.
Description
Technical field
The present embodiments relate to intelligent terminal's technical field, particularly relate to a kind of deaf mute and carry out information friendship
Method, device and the intelligent terminal of stream.
Background technology
The media of communication that mobile phone is wanted as Modern Heavy and popularized, the especially arrival of development of Mobile Internet technology,
Traditional mobile phone i.e. function machine is made gradually to be had the intelligence of powerful data processing function
Machine replaces.Intelligent machine is such as sent short messages except the basic communication functions that can realize conventional mobile phone, is made a phone call
Deng, it is also possible to rely on mobile Internet and carry out acquisition of information and communication for information.
For most of users without language and dysacousis, smart mobile phone greatly facilitates information
Acquisition with exchange, can clog-free use.But, for there being the deaf of language and dysacousis
For mute, when carrying out communication for information, due to cannot normal articulation, it is impossible to listen to the language of standard,
Can only be carried out, therefore by transmitting-receiving note so that the performance of mobile phone does not fully play, to deaf and dumb
The convenience that people provides when communication for information is poor.
Summary of the invention
The purpose of the embodiment of the present invention is that providing a kind of carries out the method for communication for information, device with deaf mute
And intelligent terminal, do not have in order to solve deaf mute's intelligent terminal's performance when carrying out communication for information in prior art
There is the defect given full play to, strengthen deaf mute and utilize intelligent terminal to carry out the convenience of communication for information.
The technical scheme that the embodiment of the present invention uses is as follows:
The embodiment of the present invention provides a kind of method carrying out communication for information with deaf mute, comprising:
Receive voice signal, in the sign language storehouse pre-build, described voice signal is mated;
According to matching result to described voice signal in the sign language storehouse pre-build, from described sign language storehouse
Middle selection standard sign language information corresponding with described voice signal;
Present selection standard sign language information corresponding with described voice signal from described sign language storehouse.
Preferably, in one embodiment of this invention, described reception voice signal, at the hands pre-build
Repertorie carries out coupling to described voice signal include:
Receive voice signal, described voice signal is converted into digital signal, in the sign language storehouse pre-build
In the digital signal that described voice signal is corresponding is mated.
Preferably, in one embodiment of this invention, described basis in the sign language storehouse pre-build to institute
The matching result of predicate tone signal, selects standard sign language corresponding with described voice signal from described sign language storehouse
Information includes:
According to the matching result of the digital signal corresponding to described voice signal, select from described sign language storehouse
The standard sign language information of the digital signal coupling corresponding with described voice signal.
Preferably, in one embodiment of this invention, present described in and select with described from described sign language storehouse
Voice signal correspondence standard sign language information includes:
Display selects the standard hands of the digital signal coupling corresponding with described voice signal from described sign language storehouse
Language information.
Preferably, in one embodiment of this invention, described display selects with described from described sign language storehouse
The standard sign language information of the digital signal coupling that voice signal is corresponding includes: show to graphically from described
Sign language storehouse selects the standard sign language information of the digital signal coupling corresponding with described voice signal.
Preferably, in one embodiment of this invention, also include: judge whether to start deaf and dumb alternately, as
Fruit is, then perform to start the reception of standard voice signals;Otherwise, terminate.
The embodiment of the present invention provides a kind of method carrying out communication for information with deaf mute, comprising:
Capture sign language gesture also gathers the sign language gesture formation sign language gesture image sequence captured;
Sign language images of gestures each in sign language gesture image sequence is carried out gesture feature identification and location;
In sign language storehouse, carry out coupling according to the gesture feature identified and navigate to and generate digital signal;
Send the digital signal generated according to matching result in sign language storehouse.
Preferably, in one embodiment of this invention, the hands that described capture sign language gesture collection capture
Language gesture forms sign language gesture image sequence and includes:
Capture sign language gesture also gathers the sign language gesture captured, and forms sign language gesture image sequence, by institute
State sign language gesture image sequence and be converted into digital signal.
Preferably, in one embodiment of this invention, described according to identifying and the gesture feature that navigates to exists
Sign language storehouse is carried out coupling generate digital signal:
According to the gesture feature identified and navigate to digital signal in corresponding sign language images of gestures, at hands
Repertorie carries out coupling and generates voice signal.
Preferably, in one embodiment of this invention, described to sign language each in sign language gesture image sequence
Images of gestures carries out gesture feature identification and location includes:
Each sign language images of gestures gesture in sign language gesture image sequence is decomposed, at the hands that gesture has been decomposed
Gesture feature identification and location is carried out in language images of gestures.
Preferably, in one embodiment of this invention, also include: judge whether to start deaf and dumb alternately, as
Fruit is, then perform to start the capture of sign language gesture;Otherwise, terminate.
The embodiment of the present invention provides a kind of device carrying out communication for information with deaf mute, comprising:
Receive unit, be used for receiving voice signal, to described voice signal in the sign language storehouse pre-build
Mate;
Matching unit, is used for the basis matching result to described voice signal in the sign language storehouse pre-build,
Standard sign language information corresponding with described voice signal is selected from described sign language storehouse;
Display unit, is used for presenting from described sign language storehouse selection standard sign language corresponding with described voice signal
Information.
The embodiment of the present invention provides a kind of method carrying out communication for information with deaf mute, comprising:
Collecting unit, forms sign language gesture figure for the sign language gesture capturing sign language gesture and collection captures
As sequence;
Positioning unit, for carrying out gesture feature to sign language images of gestures each in sign language gesture image sequence
Identify and location;
Matching unit, generates for carrying out coupling in sign language storehouse according to the gesture feature identified and navigate to
Digital signal;
Transmitting element, for sending the digital signal generated according to matching result in sign language storehouse.
The embodiment of the present invention provides a kind of intelligent terminal, and it includes display unit and hardware processor, institute
State hardware processor for receiving voice signal, in the sign language storehouse pre-build, described voice signal is entered
Row coupling;And according to matching result to described voice signal in the sign language storehouse pre-build, from institute
State selection standard sign language information corresponding with described voice signal in sign language storehouse;Described display unit is used for presenting
Standard sign language information corresponding with described voice signal is selected from described sign language storehouse.
The embodiment of the present invention provides a kind of intelligent terminal, and it includes photographic head, hardware processor and radio frequency
Module, described photographic head capture sign language gesture also gathers the sign language gesture formation sign language images of gestures captured
Sequence;Described hardware processor is for carrying out hands to sign language images of gestures each in sign language gesture image sequence
Gesture feature identification and location;And mate in sign language storehouse according to the gesture feature identified and navigate to
Generate digital signal;Described radio-frequency module is for sending the numeral generated according to matching result in sign language storehouse
Signal.
The technical scheme of the embodiment of the present invention has the advantage that
By described voice signal being mated in the sign language storehouse pre-build, from described sign language storehouse
Select standard sign language information corresponding with described voice signal, such that it is able to will mark corresponding with described voice signal
Quasi-sign language information is presented to the deaf mute as recipient;Or, capture sign language gesture collection capture
Sign language gesture formed sign language gesture image sequence, each sign language images of gestures is carried out gesture feature identification
Voice signal is generated, by deaf mute's with positioning and carrying out coupling generation voice signal in sign language storehouse
Sign language be presented to recipient without audition and aphasis user, it is achieved thereby that the information of both sides is mutual,
Overcome deaf mute's defect that intelligent terminal's performance does not give full play to when carrying out communication for information, enhance
Deaf mute utilizes intelligent terminal to carry out the convenience of communication for information.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that under,
Accompanying drawing during face describes is some embodiments of the present invention, for those of ordinary skill in the art,
On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the method flow schematic diagram that the embodiment of the present invention one and deaf mute carry out communication for information;
Fig. 2 is the method flow schematic diagram that the embodiment of the present invention two and deaf mute carry out communication for information;
Fig. 3 is the apparatus structure schematic diagram that the embodiment of the present invention three and deaf mute carry out communication for information;
Fig. 4 is the apparatus structure schematic diagram that the embodiment of the present invention four and deaf mute carry out communication for information;
Fig. 5 is the embodiment of the present invention five intelligent terminal's structural representation;
Fig. 6 is the embodiment of the present invention six intelligent terminal's structural representation;
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with this
Accompanying drawing in bright embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention,
Obviously, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on
Embodiment in the present invention, those of ordinary skill in the art are obtained under not making creative work premise
The every other embodiment obtained, broadly falls into the scope of protection of the invention.
In the following embodiment of the present invention, by described voice signal being carried out in the sign language storehouse pre-build
Coupling, selects standard sign language information corresponding with described voice signal from described sign language storehouse, such that it is able to will
Standard sign language information corresponding with described voice signal is presented to the deaf mute as recipient;Or, capture
Sign language gesture also gathers the sign language gesture formation sign language gesture image sequence captured, to each sign language gesture
Image carry out gesture feature identification and location and carry out in sign language storehouse coupling generate voice signal thus generate
Voice signal, the sign language of deaf mute is presented to recipient without audition and aphasis user, thus real
The information having showed both sides is mutual, overcomes deaf mute's intelligent terminal's performance when carrying out communication for information and does not fill
The defect that distribution is waved, enhances deaf mute and utilizes intelligent terminal to carry out the convenience of communication for information.
In following embodiment, intelligent terminal is except including smart mobile phone, it is also possible to include Intelligent flat,
Intelligent television, Intelligent bracelet etc. intelligent hardware devices.
Fig. 1 is the method flow schematic diagram that the embodiment of the present invention one and deaf mute carry out communication for information;This reality
Executing in example, the user without language and dysacousis to the deaf-mutes to use phone having language and dysacousis is
Example, the side of dialing is the user without language and dysacousis, and listener is have language and dysacousis deaf and dumb
People, the present embodiment carries out the explanation of technical scheme from listener side.As it is shown in figure 1, comprising:
S101, reception voice signal, mate described voice signal in the sign language storehouse pre-build;
In the present embodiment, voice signal is from the user without language and dysacousis, and sign language storehouse includes mark
Accurate sign language information, setting up by deaf mute's all uses during routine use are arrived of sign language storehouse
Sign language, and be standardized obtaining.Specifically, the sign language of the use in country variant or area can be collected
System, the ratio " verbal sign language ", " the mosaic sign language " of China if any the U.S., can be different
The sign language storehouse of sign language Establishing independence.When specifically setting up sign language storehouse, can first determine a difference
The sign language model of sign language system difference sign language, comparison based on voice signal from different sign language models, thus
Realize the process of coupling.
Preferably, in the present embodiment or in other any embodiment, step S101 receives voice signal,
In the sign language storehouse pre-build, described voice signal is carried out coupling can specifically include: receive voice letter
Number, described voice signal is converted into digital signal, in the sign language storehouse pre-build, described voice is believed
Number corresponding digital signal mates.
Specifically, the voice signal of reception can be radiofrequency signal, by this radiofrequency signal is demodulated,
The modes such as channel separation, deciphering, channel-decoding, tone decoding obtain digital signal.
S102, according to matching result to described voice signal in the sign language storehouse pre-build, from described
Sign language storehouse selects standard sign language information corresponding with described voice signal;
In the present embodiment or in other any embodiment, the process of coupling achieves voice signal and sign language storehouse
The corresponding relation of Plays sign language determines process, when carry out voice signal and standardization sign language to time corresponding
Can first determine sign language system and sign language storehouse corresponding to this sign language system, look in the sign language storehouse determined
Look for the standardization sign language corresponding with voice signal.In specifically, due in sign language storehouse, each sign language
Figure can match a corresponding binary code, generates corresponding voice signal according to this binary code.
In the present embodiment or in other any embodiment, described basis in the sign language storehouse pre-build to institute
The matching result of predicate tone signal, selects standard sign language corresponding with described voice signal from described sign language storehouse
Information includes: according to the matching result of the digital signal corresponding to described voice signal, from described sign language storehouse
The standard sign language information of the digital signal coupling that middle selection is corresponding with described voice signal.
S103, present from described sign language storehouse selection standard sign language information corresponding with described voice signal.
In the present embodiment, described in present from described sign language storehouse selection standard hands corresponding with described voice signal
Language information includes: display selects the digital signal coupling corresponding with described voice signal from described sign language storehouse
Standard sign language information.Specifically, described display selects and described voice signal pair from described sign language storehouse
The standard sign language information of the digital signal coupling answered includes: shows to graphically and selects from described sign language storehouse
Select the standard sign language information of the digital signal coupling corresponding with described voice signal.
For clear-eyed deaf mute, sign language can be shown graphically in the display of intelligent terminal
On screen.
Preferably, in one embodiment of this invention, also include: judge whether to start deaf and dumb alternately, as
Fruit is, then perform to start the reception of standard voice signals;Otherwise, terminate.
Specifically, a quickly starting button can be set on intelligent terminal, by this quickly starting button
Triggering judge whether to start deaf and dumb interactive mode.
However, it is desirable to explanation is, it is also possible to make an APP according to the method described in above-mentioned Fig. 1,
This APP it is installed and activated on intelligent terminal.
Above-mentioned voice signal can include the signal being transmitted by carrier network such as GSM/CDMA,
The signal being transmitted by mobile Internet can also be included, such as by wechat etc..
Fig. 2 is the method flow schematic diagram that the embodiment of the present invention two and deaf mute carry out communication for information;This reality
Execute in example, have the user of language and dysacousis to the deaf-mutes to use phone without language and dysacousis to be
Example, the side of dialing is the user having language and dysacousis, and listener is deaf and dumb without language and dysacousis
People, the present embodiment carries out the explanation of technical scheme from listener side.As in figure 2 it is shown, comprising:
S201, capture sign language gesture also gather the sign language gesture formation sign language gesture image sequence captured;
In the present embodiment or in other any embodiment, intelligent terminal is each equipped with preposition or after
Put photographic head, when deaf mute is during using sign language to carry out information representation, captured also by photographic head
Gather sign language gesture thus form gesture image sequence, the images of gestures being included on continuous time point.
In the present embodiment or in other any embodiment, capture sign language gesture described in step S201 and adopt
The sign language gesture that collection captures forms sign language gesture image sequence and includes:
Capture sign language gesture also gathers the sign language gesture captured, and forms sign language gesture image sequence, by institute
State sign language gesture image sequence and be converted into digital signal.
It addition, for supporting hand-written smart mobile phone, deaf mute can be captured at Mobile phone touch control screen
The sign language gesture of upper handwriting input, such as writes out sign language at wechat left-hand seat.
S202, sign language images of gestures each in sign language gesture image sequence is carried out gesture feature identification and fixed
Position;
In the present embodiment or in other any embodiment, to sign language images of gestures sequence described in step S202
In row, each sign language images of gestures carries out gesture feature identification and location includes:
Each sign language images of gestures gesture in sign language gesture image sequence is decomposed, at the hands that gesture has been decomposed
Gesture feature identification and location is carried out in language images of gestures.
In the present embodiment, by finding invariant features on a series of image, and these features are utilized
Position into face, specifically include template matching method and method based on face shaping, constant on described finger
Feature at least includes: shape, the colour of skin, texture, marginal information.
Or, make standard form (fixed form) or by leading for template parametrization (variable formwork), calculate defeated
Entering the correlation between image and template, this correlation is the most all the profile of independent calculating finger, refers to
The comprehensive description drawn after the respective matching degree of point, finally further according to correlation and threshold value set in advance
Determine in image and whether there is finger.
S203, according to identifying and the gesture feature that navigates to carries out coupling in sign language storehouse and generates digital signal;
Similar with above-mentioned Fig. 1, according to the corresponding relation of different sign language gestures with voice signal, in gesture library
In establish mark voice signal, when carry out sign language and voice signal to can first determine hands time corresponding
Type of writing system and sign language storehouse corresponding to this sign language system, search and sign language signal pair in the sign language storehouse determined
The standard voice signals answered.
Preferably, in one embodiment of this invention, described according to identifying and the gesture feature that navigates to exists
Sign language storehouse is carried out coupling generate digital signal:
According to the gesture feature identified and navigate to digital signal in corresponding sign language images of gestures, at hands
Repertorie carries out coupling and generates voice signal.
The digital signal that S204, transmission generate according to matching result in sign language storehouse.
In the present embodiment or other any embodiment, the voice signal that will match to is sent to recipient,
And obtain recipient and to play out on intelligent terminal.
In the present embodiment or other any embodiment, it is also possible to including: judge whether to start deaf and dumb alternately,
If it is, perform to start the capture of sign language gesture;Otherwise, terminate.
Specifically, a quickly starting button can be set on intelligent terminal, by this quickly starting button
Triggering judge whether to start deaf and dumb interactive mode.
However, it is desirable to explanation is, it is also possible to make an APP according to the method described in above-mentioned Fig. 1,
This APP it is installed and activated on intelligent terminal.
Above-mentioned voice signal can include the signal being transmitted by carrier network such as GSM/CDMA,
The signal being transmitted by mobile Internet can also be included, such as by wechat etc..
It should be noted that in an other embodiment, above-mentioned steps S201 can perform in sender side,
And step S202-204 can perform in recipient side.
Fig. 3 is the apparatus structure schematic diagram that the embodiment of the present invention three and deaf mute carry out communication for information;Such as figure
Shown in 3, comprising:
Receive unit 301, be used for receiving voice signal, to described voice in the sign language storehouse pre-build
Signal mates;
Matching unit 302, is used for the basis coupling to described voice signal in the sign language storehouse pre-build
As a result, from described sign language storehouse, standard sign language information corresponding with described voice signal is selected;
Display unit 303, is used for presenting from described sign language storehouse selection standard corresponding with described voice signal
Sign language information.
In the present embodiment or in other any embodiment, described reception unit is further used for receiving voice letter
Number, described voice signal is converted into digital signal, in the sign language storehouse pre-build, described voice is believed
Number corresponding digital signal mates.
In the present embodiment or in other any embodiment, described matching unit is further used for according to described
The matching result of the digital signal that voice signal is corresponding, selects and described voice signal from described sign language storehouse
The standard sign language information of corresponding digital signal coupling.
In the present embodiment or in other any embodiment, described display unit is further used for display from described
Sign language storehouse selects the standard sign language information of the digital signal coupling corresponding with described voice signal.
In the present embodiment or in other any embodiment, described display unit is further used for graphically
Display selects the standard sign language letter of the digital signal coupling corresponding with described voice signal from described sign language storehouse
Breath.
In the present embodiment or in other any embodiment, also include judging unit, be used for judging whether to start
Deaf and dumb alternately, if it is, perform start receive unit, receive standard voice signals;Otherwise, terminate.
Fig. 4 is the apparatus structure schematic diagram that the embodiment of the present invention four and deaf mute carry out communication for information;Such as figure
Shown in 4, comprising:
Collecting unit 401: the sign language gesture for capturing sign language gesture and collection captures forms sign language hands
Gesture image sequence;
Positioning unit 402: for sign language images of gestures each in sign language gesture image sequence is carried out gesture
Feature identification and location;
Matching unit 403: for mating in sign language storehouse according to the gesture feature identified and navigate to
Generate digital signal;
Transmitting element 404: for sending the digital signal generated according to matching result in sign language storehouse.
In the present embodiment or other any embodiment, described collecting unit 401 is further used for capturing sign language
Gesture also gathers the sign language gesture captured, and forms sign language gesture image sequence, by described sign language gesture figure
As sequence is converted into digital signal.
In the present embodiment or other any embodiment, described matching unit 403 is further used for according to identification
With the gesture feature navigated to digital signal in corresponding sign language images of gestures, carry out in sign language storehouse
Join generation voice signal.
In the present embodiment or other any embodiment, described positioning unit 402 is further used for sign language hands
In gesture image sequence, each sign language images of gestures gesture is decomposed, in the sign language images of gestures that gesture has been decomposed
Carry out gesture feature identification and location.
In the present embodiment or other any embodiment, also include judging unit (not shown), be used for
Judge whether to start deaf and dumb alternately, if it is, start collecting unit capture sign language gesture;Otherwise, knot
Bundle.
Fig. 5 is the embodiment of the present invention five intelligent terminal's structural representation;As it is shown in figure 5, intelligent terminal 500
Including display unit 501 and hardware processor 502, described hardware processor 502 is used for receiving voice
Signal, mates described voice signal in the sign language storehouse pre-build;And build according in advance
Matching result to described voice signal in vertical sign language storehouse, selects and described voice from described sign language storehouse
Signal correspondence standard sign language information;Described display unit 501 be used for presenting from described sign language storehouse selection with
Described voice signal correspondence standard sign language information.
Fig. 6 is the embodiment of the present invention six intelligent terminal's structural representation;As shown in Figure 6, it can include
Photographic head 601, hardware processor 602 and radio-frequency module 603, described photographic head 601 captures sign language hands
Gesture also gathers the sign language gesture formation sign language gesture image sequence captured;Described hardware processor 602 is used
In to sign language gesture image sequence, each sign language images of gestures carries out gesture feature identification and location, and
In sign language storehouse, carry out coupling according to the gesture feature identified and navigate to and generate digital signal, described gesture
Storehouse includes the voice signal of standard;Described radio-frequency module 603 is used for sending according to coupling knot in sign language storehouse
The digital signal that fruit generates.
In an other embodiment, photographic head can be replaced by the hand-written screen of intelligent terminal, is used for capturing sign language
Gesture also gathers the sign language gesture formation sign language gesture image sequence captured, the most no longer accompanying drawing explanation.
Device embodiment described above is only schematically, wherein said illustrates as separating component
Unit can be or may not be physically separate, the parts shown as unit can be or
Person may not be physical location, i.e. may be located at a place, or can also be distributed to multiple network
On unit.Some or all of module therein can be selected according to the actual needs to realize the present embodiment
The purpose of scheme.Those of ordinary skill in the art are not in the case of paying performing creative labour, the most permissible
Understand and implement.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive each reality
The mode of executing can add the mode of required general hardware platform by software and realize, naturally it is also possible to by firmly
Part.Based on such understanding, the portion that prior art is contributed by technique scheme the most in other words
Dividing and can embody with the form of software product, this computer software product can be stored in computer can
Read in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that one
Computer equipment (can be personal computer, server, or the network equipment etc.) performs each to be implemented
The method described in some part of example or embodiment.
Last it is noted that above example is only in order to illustrate technical scheme, rather than to it
Limit;Although the present invention being described in detail with reference to previous embodiment, the ordinary skill of this area
Personnel it is understood that the technical scheme described in foregoing embodiments still can be modified by it, or
Person carries out equivalent to wherein portion of techniques feature;And these amendments or replacement, do not make corresponding skill
The essence of art scheme departs from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (15)
1. the method carrying out communication for information with deaf mute, it is characterised in that including:
Receive voice signal, in the sign language storehouse pre-build, described voice signal is mated;
According to matching result to described voice signal in the sign language storehouse pre-build, from described sign language storehouse
Middle selection standard sign language information corresponding with described voice signal;
Present selection standard sign language information corresponding with described voice signal from described sign language storehouse.
2. according to the method described in regard to claim 1, it is characterised in that described reception voice signal,
The sign language storehouse pre-build carries out coupling to described voice signal include:
Receive voice signal, described voice signal is converted into digital signal, in the sign language storehouse pre-build
In the digital signal that described voice signal is corresponding is mated.
Method the most according to claim 2, it is characterised in that described basis is at the hands pre-build
Matching result to described voice signal in repertorie, selects and described voice signal pair from described sign language storehouse
The standard sign language information of answering includes:
According to the matching result of the digital signal corresponding to described voice signal, select from described sign language storehouse
The standard sign language information of the digital signal coupling corresponding with described voice signal.
Method the most according to claim 1, it is characterised in that described in present from described sign language storehouse
Standard sign language information corresponding with described voice signal is selected to include:
Display selects the standard hands of the digital signal coupling corresponding with described voice signal from described sign language storehouse
Language information.
Method the most according to claim 4, it is characterised in that described display is from described sign language storehouse
The standard sign language information selecting the digital signal corresponding with described voice signal to mate includes: to graphically
Display selects the standard sign language letter of the digital signal coupling corresponding with described voice signal from described sign language storehouse
Breath.
6. according to the method described in any one of claim 1-5, it is characterised in that also include: judgement is
No startup is deaf and dumb alternately, if it is, perform to start the reception of standard voice signals;Otherwise, terminate.
7. the method carrying out communication for information with deaf mute, it is characterised in that including:
Capture sign language gesture also gathers the sign language gesture formation sign language gesture image sequence captured;
Sign language images of gestures each in sign language gesture image sequence is carried out gesture feature identification and location;
In sign language storehouse, carry out coupling according to the gesture feature identified and navigate to and generate digital signal;
Send the digital signal generated according to matching result in sign language storehouse.
Method the most according to claim 7, it is characterised in that described capture sign language gesture also gathers
The sign language gesture captured forms sign language gesture image sequence and includes:
Capture sign language gesture also gathers the sign language gesture captured, and forms sign language gesture image sequence, by institute
State sign language gesture image sequence and be converted into digital signal.
Method the most according to claim 8, it is characterised in that described according to identifying and navigating to
Gesture feature carry out in sign language storehouse coupling generate digital signal:
According to the gesture feature identified and navigate to digital signal in corresponding sign language images of gestures, at hands
Repertorie carries out coupling and generates voice signal.
Method the most according to claim 7, it is characterised in that described to sign language images of gestures sequence
In row, each sign language images of gestures carries out gesture feature identification and location includes:
Each sign language images of gestures gesture in sign language gesture image sequence is decomposed, at the hands that gesture has been decomposed
Gesture feature identification and location is carried out in language images of gestures.
11. methods according to claim 7, it is characterised in that also include: judge whether to start
Deaf and dumb alternately, if it is, perform start sign language gesture capture;Otherwise, terminate.
12. 1 kinds of devices carrying out communication for information with deaf mute, it is characterised in that including:
Receive unit, be used for receiving voice signal, to described voice signal in the sign language storehouse pre-build
Mate;
Matching unit, is used for the basis matching result to described voice signal in the sign language storehouse pre-build,
Standard sign language information corresponding with described voice signal is selected from described sign language storehouse;
Display unit, is used for presenting from described sign language storehouse selection standard sign language corresponding with described voice signal
Information.
13. 1 kinds of devices carrying out communication for information with deaf mute, it is characterised in that including:
Collecting unit, forms sign language gesture figure for the sign language gesture capturing sign language gesture and collection captures
As sequence;
Positioning unit, for carrying out gesture feature to sign language images of gestures each in sign language gesture image sequence
Identify and location;
Matching unit, generates for carrying out coupling in sign language storehouse according to the gesture feature identified and navigate to
Digital signal;
Transmitting element, for sending the digital signal generated according to matching result in sign language storehouse.
14. 1 kinds of intelligent terminal, it is characterised in that include display unit and hardware processor, described
Hardware processor is used for receiving voice signal, carries out described voice signal in the sign language storehouse pre-build
Coupling;And according to matching result to described voice signal in the sign language storehouse pre-build, from described
Sign language storehouse selects standard sign language information corresponding with described voice signal;Described display unit be used for presenting from
Described sign language storehouse selects standard sign language information corresponding with described voice signal.
15. 1 kinds of intelligent terminal, it is characterised in that include photographic head, hardware processor and radio frequency mould
Block, described photographic head capture sign language gesture also gathers the sign language gesture formation sign language images of gestures sequence captured
Row;Described hardware processor is for carrying out gesture to sign language images of gestures each in sign language gesture image sequence
Feature identification and location;And it is raw to carry out coupling in sign language storehouse according to the gesture feature identified and navigate to
Become digital signal;Described radio-frequency module is for sending the numeral letter generated according to matching result in sign language storehouse
Number.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610168501.XA CN105868282A (en) | 2016-03-23 | 2016-03-23 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
PCT/CN2016/088485 WO2017161741A1 (en) | 2016-03-23 | 2016-07-04 | Method and device for communicating information with deaf-mutes, smart terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610168501.XA CN105868282A (en) | 2016-03-23 | 2016-03-23 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105868282A true CN105868282A (en) | 2016-08-17 |
Family
ID=56625530
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610168501.XA Pending CN105868282A (en) | 2016-03-23 | 2016-03-23 | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN105868282A (en) |
WO (1) | WO2017161741A1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106653051A (en) * | 2016-12-09 | 2017-05-10 | 天脉聚源(北京)传媒科技有限公司 | Video deaf-mute mode expression method and apparatus |
CN106789593A (en) * | 2017-01-13 | 2017-05-31 | 山东师范大学 | A kind of instant message processing method for merging sign language, server and system |
CN107798964A (en) * | 2017-11-24 | 2018-03-13 | 郑军 | The sign language intelligent interaction device and its exchange method of a kind of Real time identification gesture |
CN108629241A (en) * | 2017-03-23 | 2018-10-09 | 华为技术有限公司 | A kind of data processing method and data processing equipment |
CN108960158A (en) * | 2018-07-09 | 2018-12-07 | 珠海格力电器股份有限公司 | A kind of system and method for intelligent sign language translation |
CN110555329A (en) * | 2018-05-31 | 2019-12-10 | 苏州欧力机器人有限公司 | Sign language translation method, terminal and storage medium |
CN111461005A (en) * | 2020-03-31 | 2020-07-28 | 腾讯科技(深圳)有限公司 | Gesture recognition method and device, computer equipment and storage medium |
US10854110B2 (en) | 2017-03-03 | 2020-12-01 | Microsoft Technology Licensing, Llc | Automated real time interpreter service |
CN113851029A (en) * | 2021-07-30 | 2021-12-28 | 阿里巴巴达摩院(杭州)科技有限公司 | Barrier-free communication method and device |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110111651A (en) * | 2018-02-01 | 2019-08-09 | 周玮 | Intelligent language interactive system based on posture perception |
CN109858043B (en) * | 2018-12-19 | 2023-10-27 | 上海立势达机电科技有限公司 | Gesture language and voice language bidirectional intelligent translation device |
CN110008839B (en) * | 2019-03-08 | 2023-01-03 | 陕西联森电子科技有限公司 | Intelligent sign language interaction system and method for self-adaptive gesture recognition |
CN112256827A (en) * | 2020-10-20 | 2021-01-22 | 平安科技(深圳)有限公司 | Sign language translation method and device, computer equipment and storage medium |
CN116805272A (en) * | 2022-10-29 | 2023-09-26 | 武汉行已学教育咨询有限公司 | Visual education teaching analysis method, system and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101539994A (en) * | 2009-04-16 | 2009-09-23 | 西安交通大学 | Mutually translating system and method of sign language and speech |
CN101605158A (en) * | 2008-06-13 | 2009-12-16 | 鸿富锦精密工业(深圳)有限公司 | Mobile phone dedicated for deaf-mutes |
CN101794528A (en) * | 2010-04-02 | 2010-08-04 | 北京大学软件与微电子学院无锡产学研合作教育基地 | Gesture language-voice bidirectional translation system |
US20120124456A1 (en) * | 2010-11-12 | 2012-05-17 | Microsoft Corporation | Audience-based presentation and customization of content |
CN102497513A (en) * | 2011-11-25 | 2012-06-13 | 中山大学 | Video virtual hand language system facing digital television |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101594434A (en) * | 2009-06-16 | 2009-12-02 | 中兴通讯股份有限公司 | The sign language processing method and the sign language processing mobile terminal of portable terminal |
CN101661330A (en) * | 2009-09-22 | 2010-03-03 | 深圳华为通信技术有限公司 | Method for converting sign language and terminal thereof |
US20140171036A1 (en) * | 2009-11-18 | 2014-06-19 | Gwendolyn Simmons | Method of communication |
CN103956167A (en) * | 2014-05-06 | 2014-07-30 | 北京邮电大学 | Visual sign language interpretation method and device based on Web |
-
2016
- 2016-03-23 CN CN201610168501.XA patent/CN105868282A/en active Pending
- 2016-07-04 WO PCT/CN2016/088485 patent/WO2017161741A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101605158A (en) * | 2008-06-13 | 2009-12-16 | 鸿富锦精密工业(深圳)有限公司 | Mobile phone dedicated for deaf-mutes |
CN101539994A (en) * | 2009-04-16 | 2009-09-23 | 西安交通大学 | Mutually translating system and method of sign language and speech |
CN101794528A (en) * | 2010-04-02 | 2010-08-04 | 北京大学软件与微电子学院无锡产学研合作教育基地 | Gesture language-voice bidirectional translation system |
US20120124456A1 (en) * | 2010-11-12 | 2012-05-17 | Microsoft Corporation | Audience-based presentation and customization of content |
CN102497513A (en) * | 2011-11-25 | 2012-06-13 | 中山大学 | Video virtual hand language system facing digital television |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106653051A (en) * | 2016-12-09 | 2017-05-10 | 天脉聚源(北京)传媒科技有限公司 | Video deaf-mute mode expression method and apparatus |
CN106789593A (en) * | 2017-01-13 | 2017-05-31 | 山东师范大学 | A kind of instant message processing method for merging sign language, server and system |
US10854110B2 (en) | 2017-03-03 | 2020-12-01 | Microsoft Technology Licensing, Llc | Automated real time interpreter service |
CN108629241A (en) * | 2017-03-23 | 2018-10-09 | 华为技术有限公司 | A kind of data processing method and data processing equipment |
CN107798964A (en) * | 2017-11-24 | 2018-03-13 | 郑军 | The sign language intelligent interaction device and its exchange method of a kind of Real time identification gesture |
CN110555329A (en) * | 2018-05-31 | 2019-12-10 | 苏州欧力机器人有限公司 | Sign language translation method, terminal and storage medium |
CN108960158A (en) * | 2018-07-09 | 2018-12-07 | 珠海格力电器股份有限公司 | A kind of system and method for intelligent sign language translation |
CN111461005A (en) * | 2020-03-31 | 2020-07-28 | 腾讯科技(深圳)有限公司 | Gesture recognition method and device, computer equipment and storage medium |
CN111461005B (en) * | 2020-03-31 | 2023-11-28 | 腾讯科技(深圳)有限公司 | Gesture recognition method and device, computer equipment and storage medium |
CN113851029A (en) * | 2021-07-30 | 2021-12-28 | 阿里巴巴达摩院(杭州)科技有限公司 | Barrier-free communication method and device |
CN113851029B (en) * | 2021-07-30 | 2023-09-05 | 阿里巴巴达摩院(杭州)科技有限公司 | Barrier-free communication method and device |
Also Published As
Publication number | Publication date |
---|---|
WO2017161741A1 (en) | 2017-09-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105868282A (en) | Method and apparatus used by deaf-mute to perform information communication, and intelligent terminal | |
CN102298533B (en) | Method for activating application program and terminal equipment | |
CN106101743B (en) | Panoramic video recognition methods and device | |
CN111556278B (en) | Video processing method, video display device and storage medium | |
US20190222806A1 (en) | Communication system and method | |
WO2013088637A2 (en) | Information processing device, information processing method and program | |
CN106104569A (en) | For setting up the method and apparatus of connection between electronic installation | |
CN105872717A (en) | Video processing method and system, video player and cloud server | |
CN105518579A (en) | Information processing device and information processing method | |
CN104021398A (en) | Wearable intelligent device and method for assisting identity recognition | |
CN104505091A (en) | Human-machine voice interaction method and human-machine voice interaction system | |
CN104077597B (en) | Image classification method and device | |
CN111107278B (en) | Image processing method and device, electronic equipment and readable storage medium | |
AU2020309094B2 (en) | Image processing method and apparatus, electronic device, and storage medium | |
CN104185086A (en) | Method and device for providing video information | |
CN112699849A (en) | Gesture recognition method and device, electronic equipment, readable storage medium and chip | |
CN112818807A (en) | Tumble detection method, tumble detection device, tumble detection apparatus, and storage medium | |
CN104349110A (en) | Terminal remote interaction method and system | |
CN108260012A (en) | Electronic device, video playing control method and related product | |
CN102594964A (en) | Intelligent contact adding method using mobile terminal | |
US20130162566A1 (en) | Terminal device | |
CN105573156B (en) | Remote control method and system | |
US20120169638A1 (en) | Device and method for transmitting data in portable terminal | |
CN105868606A (en) | Intelligent terminal control device and method | |
CN111104827A (en) | Image processing method and device, electronic equipment and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160817 |