CN104049753B - Realize the method and apparatus that sign language information and text message are mutually changed - Google Patents
Realize the method and apparatus that sign language information and text message are mutually changed Download PDFInfo
- Publication number
- CN104049753B CN104049753B CN201410253678.0A CN201410253678A CN104049753B CN 104049753 B CN104049753 B CN 104049753B CN 201410253678 A CN201410253678 A CN 201410253678A CN 104049753 B CN104049753 B CN 104049753B
- Authority
- CN
- China
- Prior art keywords
- information
- sign language
- language information
- text message
- palm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Method, device and Wearable that sign language information and text message are mutually changed are realized the invention discloses a kind of, method includes：Conversion equipment receives the sign language information that Wearable sends, and sign language information includes the relative distance between the distance between palm and conversion equipment, the elevation information of palm and finger；Conversion equipment carries out treatment to sign language information and obtains corresponding positional information, and corresponding text message is obtained according to positional information；And conversion equipment output text message.The embodiment of the present invention realizes the method that sign language information and text message are mutually changed, the relative distance between the distance between palm and conversion equipment and finger is obtained by the range sensor of Wearable, height sensor obtains the elevation information of palm, reduce the information content needed in transfer process, information processing efficiency, conversion efficiency are improve, and reduces the requirement to soft hardware equipment, and need not be by other equipment, realize simple, strong applicability.
Description
Technical field
Realize that sign language information and text message are mutual the present invention relates to artificial intelligence identification technology field, more particularly to one kind
The method of conversion, device and Wearable.
Background technology
Sign language is the proportion action that uses gesture, the change modeling image or syllable according to gesture with certain meaning for constituting or
Word, it is the main the vehicle of communication of deaf-mute.At present, to the identification of sign language, according to input mode, can be divided into based on Wearable
Equipment and based on Conventional visual.RM based on Wearable, mainly by sensor in Wearable etc.
Each joint angles information and hand for measuring hand carry out Sign Language Recognition in the track of spatial movement and timing information etc..Based on biography
The RM of vision of uniting, mainly gathers the video information or image information of gesture to be identified by camera.
But, realize it is of the invention during inventor find prior art at least there is problems with：Based on tradition
The RM of vision is needed by means of first-class equipment is imaged, and easily by ambient influnence, and the success rate of identification is low；Based on wearing
The RM of formula equipment is worn, it is necessary to obtain substantial amounts of finger-joint information by various sensors, then to these finger-joints
Information is processed, high to soft hardware equipment requirement, and information processing efficiency is low, is realized complicated.
The content of the invention
It is contemplated that at least solving one of technical problem in correlation technique to a certain extent.Therefore, of the invention
One purpose is to propose a kind of to realize the method that sign language information and text message are mutually changed.The method can be improved at information
Reason efficiency, improves conversion efficiency, reduces the requirement to soft hardware equipment, and need not realize simply, being applicable by other equipment
Property is strong.
Second object of the present invention is to propose that another kind realizes the method that sign language information and text message are mutually changed.
Third object of the present invention is that proposition is a kind of realizes the device that sign language information and text message are mutually changed.
Fourth object of the present invention is to propose a kind of Wearable.
To achieve these goals, first aspect present invention embodiment realizes that sign language information and text message are mutually changed
Method, including：Conversion equipment receives the sign language information that Wearable sends, and the sign language information includes palm with described turn
Relative distance between the distance between changing device, the elevation information of palm and finger；The conversion equipment is to the sign language
Information carries out treatment and obtains corresponding positional information, and corresponding text message is obtained according to the positional information；And described turn
Changing device exports the text message.
The embodiment of the present invention realizes the method that sign language information and text message are mutually changed, by Wearable away from
The relative distance between the distance between palm and conversion equipment and finger is obtained from sensor, height sensor obtains palm
Elevation information, greatly reduces the information content needed in transfer process, improves information processing efficiency, improves conversion effect
Rate, and the requirement to soft hardware equipment is reduced, and simple, strong applicability need not be realized by other equipment.
To achieve these goals, second aspect present invention embodiment realizes that sign language information and text message are mutually changed
Method, including：Wearable obtain sign language information, wherein, the sign language information include palm and the conversion equipment it
Between distance, the relative distance between the elevation information of palm and finger；And the Wearable is believed the sign language
Breath is processed, and to the sign language information after conversion equipment transmission processe, so that after the conversion equipment is according to the treatment
Sign language information exports corresponding text message.
The embodiment of the present invention realizes the method that sign language information and text message are mutually changed, and is obtained by range sensor
Relative distance between the distance between palm and conversion equipment and finger, height sensor obtains the elevation information of palm, greatly
The information content needed in transfer process is reduced greatly, information processing efficiency is improve, conversion efficiency is improve, and reduce
Requirement to soft hardware equipment, and simple, strong applicability need not be realized by other equipment.
To achieve these goals, third aspect present invention embodiment realizes that sign language information and text message are mutually changed
Device, including：Receiver module, for receive Wearable transmission sign language information, the sign language information include palm with
Relative distance between the distance between described device, the elevation information of palm and finger；Module is obtained, for the hand
Language information carries out treatment and obtains corresponding positional information, and corresponding text message is obtained according to the positional information；And output
Module, for exporting the text message.
The embodiment of the present invention realizes the device that sign language information and text message are mutually changed, and is obtained by range sensor
Relative distance between the distance between palm and conversion equipment and finger, height sensor obtains the elevation information of palm, greatly
The information content needed in transfer process is reduced greatly, information processing efficiency is improve, conversion efficiency is improve, and reduce
Requirement to soft hardware equipment, and simple, strong applicability need not be realized by other equipment.
To achieve these goals, the Wearable of fourth aspect present invention embodiment, including：Module is obtained, is used for
Obtain sign language information, wherein, the sign language information include the distance between palm and conversion equipment, the elevation information of palm and
Relative distance between finger；And processing module, for processing the sign language information, and to conversion equipment transmission at
Sign language information after reason, so that the conversion equipment exports corresponding text message according to the sign language information after the treatment.
The Wearable of the embodiment of the present invention, by range sensor obtain the distance between palm and conversion equipment with
Relative distance between finger, height sensor obtains the elevation information of palm, greatly reduces the letter needed in transfer process
Breath quantity, improves information processing efficiency, improves conversion efficiency, and reduces the requirement to soft hardware equipment, and is not required to
Simple, strong applicability is realized by other equipment.
Brief description of the drawings
Fig. 1 is the flow for realizing the method that sign language information and text message are mutually changed according to an embodiment of the invention
Figure.
Fig. 2 is sign language information exemplary plot according to an embodiment of the invention.
Fig. 3 is the stream for realizing the method that sign language information and text message are mutually changed in accordance with another embodiment of the present invention
Cheng Tu.
Fig. 4 is the structure for realizing the device that sign language information and text message are mutually changed according to an embodiment of the invention
Schematic diagram.
Fig. 5 is the structural representation of Wearable according to an embodiment of the invention.
Specific embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from start to finish
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
It is exemplary to scheme the embodiment of description, it is intended to for explaining the present invention, and be not considered as limiting the invention.
Below with reference to the accompanying drawings method, the dress that sign language information and text message are mutually changed realized of the embodiment of the present invention described
Put and Wearable.
Fig. 1 is the flow for realizing the method that sign language information and text message are mutually changed according to an embodiment of the invention
Figure, the embodiment is described from Wearable.
As shown in figure 1, realizing that the method that sign language information and text message are mutually changed is comprised the following steps：
S101, Wearable obtain sign language information, wherein, sign language information include between palm and conversion equipment away from
From, the relative distance between the elevation information of palm and finger.
In an embodiment of the present invention, the gesture that Wearable can be made by various sensors acquisition user is corresponding
Sign language information.Specifically, Wearable can by range sensor obtain the distance between left and right palm and conversion equipment with
Relative distance between ten fingers, can obtain the elevation information of left and right palm by height sensor.
More specifically, the distance of the left hand palm and conversion equipment can be represented with L, R represents the distance of the right hand palm and conversion equipment,
LH represents the elevation information (i.e. 5 average heights of finger of left hand) of the left hand palm, and RH represents elevation information (the i.e. right hand of the right hand palm
5 average heights of finger).L1 represents left hand thumb, and L2 represents left index finger, and L3 represents left hand middle finger, L4 represent left hand without
Name refers to that L5 represents left hand little finger, and R1 represents hand thumb, and R2 represents right hand forefinger, and R3 represents right hand middle finger, and R4 represents the right hand
The third finger, R5 represents right hand little finger.The matrix-vector of the available 10*10 or 5*5 of the distance between 10 fingers is indicated.
Data are represented by the way of matrix-vector, facilitates subsequent operation.
S102, Wearable is processed sign language information, and to the sign language information after conversion equipment transmission processe, with
Conversion equipment is set to export corresponding text message according to the sign language information after treatment.
In an embodiment of the present invention, Wearable can be amplified to the sign language information for obtaining, and then be encoded
And compression, then carry out the treatment such as storing.After processing sign language information, Wearable can (near field leads to by NFC
Letter), WIFI (Wireless Fidelity), infrared ray, the mode such as sound wave communicated with conversion equipment, and to conversion equipment transmission processe after
Sign language information so that conversion equipment exports corresponding text message according to the sign language information after treatment.
The embodiment of the present invention realizes the method that sign language information and text message are mutually changed, and is obtained by range sensor
Relative distance between the distance between palm and conversion equipment and finger, height sensor obtains the elevation information of palm, greatly
The information content needed in transfer process is reduced greatly, information processing efficiency is improve, conversion efficiency is improve, and reduce
Requirement to soft hardware equipment, and simple, strong applicability need not be realized by other equipment.
Fig. 2 is the stream for realizing the method that sign language information and text message are mutually changed in accordance with another embodiment of the present invention
Cheng Tu, the embodiment is described from conversion equipment side.
As shown in Fig. 2 realizing that the method that sign language information and text message are mutually changed is comprised the following steps：
S201, conversion equipment receives the sign language information that Wearable sends, and sign language information includes palm and conversion equipment
The distance between, the relative distance between the elevation information of palm and finger.
In an embodiment of the present invention, conversion equipment can by NFC (near-field communication), WIFI (Wireless Fidelity), infrared ray,
The modes such as sound wave are communicated with Wearable.Conversion equipment can receive the sign language information of Wearable transmission, wherein, hand
Language information may include the relative distance between the distance between palm and conversion equipment, the elevation information of palm and finger.Tool
Body ground, Wearable can by range sensor obtain the distance between palm and conversion equipment between finger it is relative away from
From, can by height sensor obtain palm elevation information.
S202, conversion equipment carries out treatment to sign language information and obtains corresponding positional information, obtains right according to positional information
The text message answered.
In an embodiment of the present invention, because arm length, finger length, the height etc. of user might not be identical, because
This is needed to collect the information of multiple users, then therefrom extracts feature as sample information, and conversion table is set up with this.Wherein, turn
Change the positional information that table can be changed comprising text message and its sign language information.The positional information can be corresponded to for the gesture that user makes
Coordinate information.After conversion equipment receives the sign language information that Wearable sends, conversion equipment can be carried out to sign language information
Treatment obtains corresponding coordinate information, then inquires about and obtain the corresponding text message of the coordinate information in conversion table.
For example：Assuming that the distance between palm and conversion equipment are 50 centimetres, the corresponding data of the gesture that user makes
It is represented by L, the data that the distance matrix of R, LH, RH=(50,45,80,130) and 10 fingers is included are as shown in table 1.
The data that the distance matrix of table 1 is included
| R1 | R2 | R3 | R4 | R5 | |
| L1 | 60 | 59 | 60 | 60 | 60 |
| L2 | 60 | 59 | 60 | 60 | 60 |
| L3 | 60 | 59 | 60 | 60 | 60 |
| L4 | 60 | 59 | 60 | 60 | 60 |
| L5 | 60 | 59 | 60 | 60 | 60 |
According to above coordinate information, the corresponding text message of conversion table can be inquired about, can finally obtain text message
" I ", as shown in Figure 3.Similarly, text message can be obtained according to the corresponding coordinate information of another two gesture using aforesaid way
" love " and " you ".It should be noted that above numerical value and unit are merely illustrative.
S203, conversion equipment output text message.
In an embodiment of the present invention, conversion equipment may include display screen, can export text message or language by display screen
Sound exports text message.
As can be seen here, the sign language information for using in the present embodiment only includes the distance between palm and conversion equipment, hand
Relative distance this three class between the elevation information and finger of the palm, relative to other conversion regimes, employed in the present embodiment
The data volume that is used of conversion regime it is smaller, therefore, the treatment effeciency of data is high, and the conversion efficiency between information is higher, especially
Suitable for requirement of real-time scene higher, there is urgent unexpected situation in such as deaf-mute.
In an embodiment of the present invention, the text message of user input can also be converted to corresponding sign language by conversion equipment
Information.Specifically, conversion equipment can obtain the text to be converted of user input, then be obtained and text to be converted according to conversion table
Corresponding positional information, further according to the positional information, sign language information corresponding with text to be converted is exported by display screen.Example
Such as：When the TV programme media of TV station need for programme televised live to express link plus sign language, can be by by host
The need for the material (text to be converted) given an oral account be input in conversion equipment, corresponding position letter is then obtained according to conversion table
Breath, further according to positional information, the action message of virtual portrait is exported by display screen, so as to illiterate deaf-mute can see
Understand the information of media releasing, save human translation into the time cost of sign language, enable deaf-mute timely as ordinary people
Obtain real time information.
The embodiment of the present invention realizes the method that sign language information and text message are mutually changed, by Wearable away from
The relative distance between the distance between palm and conversion equipment and finger is obtained from sensor, height sensor obtains palm
Elevation information, greatly reduces the information content needed in transfer process, improves information processing efficiency, improves conversion effect
Rate, and the requirement to soft hardware equipment is reduced, and simple, strong applicability need not be realized by other equipment.
Above-described embodiment can also be applied to specific information search scene.For example, when a deaf-mute user thinks
Online inquiry data, but will not be traditional input method when, now, he only need to be chosen on computer screen word be input into position i.e.
In search box, being worn by Wearable carries out sign language operation, and sign language information is sent to computer, and computer herein is conversion
Device.The conversion table that computer is prestored by inquiry, obtains corresponding text message, can show that user thinks defeated in search box
The text for entering.Deaf-mute user can scan for the input of word by the method, and search for required data.
In order to realize above-described embodiment, the present invention also proposes a kind of to realize the dress that sign language information and text message are mutually changed
Put.
As shown in figure 4, realizing that the device that sign language information and text message are mutually changed includes：Receiver module 110, acquisition mould
Block 120 and output module 130.
Receiver module 110 is used to receive the sign language information of Wearable transmission, sign language information include palm and device it
Between distance, the relative distance between the elevation information of palm and finger.
In an embodiment of the present invention, conversion equipment can by NFC (near-field communication), WIFI (Wireless Fidelity), infrared ray,
The modes such as sound wave are communicated with Wearable.Receiver module 110 can receive the sign language information of Wearable transmission, its
In, sign language information may include the distance between palm and conversion equipment, between the elevation information of palm and finger it is relative away from
From.Specifically, Wearable can be obtained between the distance between palm and conversion equipment and finger by range sensor
Relative distance, can obtain the elevation information of palm by height sensor.
Obtaining module 120 is used to carry out sign language information the corresponding positional information for the treatment of acquisition, is obtained according to positional information
Corresponding text message.
In an embodiment of the present invention, because arm length, finger length, the height etc. of user might not be identical, because
This needs to collect the information of multiple users, then therefrom extracts feature as sample information, so that setting up module 140 is based on sample
Information sets up conversion table.Wherein, conversion table can include the positional information that text message and its sign language information are changed.The positional information
The corresponding coordinate information of gesture that can be made for user.After receiver module 110 receives the sign language information that Wearable sends,
Obtaining module 120 can carry out the corresponding coordinate information for the treatment of acquisition to sign language information, then inquire about and obtain the seat in conversion table
The corresponding text message of mark information.For example：Assuming that the distance between palm and conversion equipment are 50 centimetres, the gesture that user makes
Corresponding data are represented by L, the data that the distance matrix of R, LH, RH=(50,45,80,130) and 10 fingers is included
As shown in table 1.
The data that the distance matrix of table 1 is included
| R1 | R2 | R3 | R4 | R5 | |
| L1 | 60 | 59 | 60 | 60 | 60 |
| L2 | 60 | 59 | 60 | 60 | 60 |
| L3 | 60 | 59 | 60 | 60 | 60 |
| L4 | 60 | 59 | 60 | 60 | 60 |
| L5 | 60 | 59 | 60 | 60 | 60 |
According to above coordinate information, the corresponding text message of conversion table can be inquired about, can finally obtain text message
" I ", as shown in Figure 2.Similarly, text message can be obtained according to the corresponding coordinate information of another two gesture using aforesaid way
" love " and " you ".It should be noted that above numerical value and unit are merely illustrative.
Output module 130 is used to export text message.
In an embodiment of the present invention, conversion equipment may include display screen, and output module 130 can export text by display screen
This information or voice output text message.
As can be seen here, the sign language information for using in the present embodiment only includes the distance between palm and conversion equipment, hand
Relative distance this three class between the elevation information and finger of the palm, relative to other conversion regimes, employed in the present embodiment
The data volume that is used of conversion regime it is smaller, therefore, the treatment effeciency of data is high, and the conversion efficiency between information is higher, especially
Suitable for requirement of real-time scene higher, there is urgent unexpected situation in such as deaf-mute.
Moreover, it is achieved that the device that sign language information and text message are mutually changed may also include sets up module 140.
Module 140 is set up for before module 120 is obtained according to the corresponding text message of positional information acquisition, based on sample
This information sets up conversion table, the positional information changed comprising text message and its sign language information in conversion table.
In an embodiment of the present invention, the text message of user input can also be converted to corresponding sign language by conversion equipment
Information.Specifically, obtaining module 120 can obtain the text to be converted of user input, then according to conversion table obtain with it is to be converted
The corresponding positional information of text, further according to the positional information, output module 130 exports corresponding with text to be converted by display screen
Sign language information.For example：When the TV programme media of TV station need for programme televised live to express link plus sign language, can
It is input in conversion equipment by by the material given an oral account the need for host (text to be converted), then obtains right according to conversion table
The positional information answered, further according to positional information, the action message of virtual portrait is exported by display screen, illiterate deaf so as to allow
Mute can understand the information of media releasing, real-time, save human translation into the time cost of sign language, enable deaf-mute
It is enough to obtain real time information in time as ordinary people.
The embodiment of the present invention realizes the device that sign language information and text message are mutually changed, by Wearable away from
The relative distance between the distance between palm and conversion equipment and finger is obtained from sensor, height sensor obtains palm
Elevation information, greatly reduces the information content needed in transfer process, improves information processing efficiency, improves conversion effect
Rate, and the requirement to soft hardware equipment is reduced, and simple, strong applicability need not be realized by other equipment.
In order to realize above-described embodiment, the present invention also proposes a kind of Wearable.As shown in figure 5, Wearable bag
Include：Obtain module 210 and processing module 220.
Obtain module 210 be used for obtain sign language information, wherein, sign language information include between palm and conversion equipment away from
From, the relative distance between the elevation information of palm and finger.
In an embodiment of the present invention, obtaining module 210 can obtain the gesture correspondence that user makes by various sensors
Sign language information.Specifically, obtaining module 210 can obtain the distance between left and right palm and conversion equipment by range sensor
With the relative distance between ten fingers, the elevation information of left and right palm can be obtained by height sensor.
More specifically, the distance of the left hand palm and conversion equipment can be represented with L, R represents the distance of the right hand palm and conversion equipment,
LH represents the elevation information (i.e. 5 average heights of finger of left hand) of the left hand palm, and RH represents elevation information (the i.e. right hand of the right hand palm
5 average heights of finger).L1 represents left hand thumb, and L2 represents left index finger, and L3 represents left hand middle finger, L4 represent left hand without
Name refers to that L5 represents left hand little finger, and R1 represents hand thumb, and R2 represents right hand forefinger, and R3 represents right hand middle finger, and R4 represents the right hand
The third finger, R5 represents right hand little finger.The matrix-vector of the available 10*10 or 5*5 of the distance between 10 fingers is indicated.
Data are represented by the way of matrix-vector, facilitates subsequent operation.
Processing module 220 is used to process sign language information, and to the sign language information after conversion equipment transmission processe, with
Conversion equipment is set to export corresponding text message according to the sign language information after treatment.
In an embodiment of the present invention, processing module 220 can be amplified to the sign language information for obtaining, and then be encoded
And compression, then carry out the treatment such as storing.After processing sign language information, processing module 220 can (near field leads to by NFC
Letter), WIFI (Wireless Fidelity), infrared ray, the mode such as sound wave communicated with conversion equipment, and to conversion equipment transmission processe after
Sign language information so that conversion equipment exports corresponding text message according to the sign language information after treatment.
The Wearable of the embodiment of the present invention, by range sensor obtain the distance between palm and conversion equipment with
Relative distance between finger, height sensor obtains the elevation information of palm, greatly reduces the letter needed in transfer process
Breath quantity, improves information processing efficiency, improves conversion efficiency, and reduces the requirement to soft hardware equipment, and is not required to
Simple, strong applicability is realized by other equipment.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means to combine specific features, structure, material or spy that the embodiment or example are described
Point is contained at least one embodiment of the invention or example.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.And, the specific features of description, structure, material or feature can be with office
Combined in an appropriate manner in one or more embodiments or example.Additionally, in the case of not conflicting, the skill of this area
Art personnel can be tied the feature of the different embodiments or example described in this specification and different embodiments or example
Close and combine.
Additionally, term " first ", " second " are only used for describing purpose, and it is not intended that indicating or implying relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can express or
Implicitly include at least one this feature.In the description of the invention, " multiple " is meant that at least two, such as two, three
It is individual etc., unless otherwise expressly limited specifically.
Any process described otherwise above or method description in flow chart or herein is construed as, and expression includes
It is one or more for realizing specific logical function or process the step of the module of code of executable instruction, fragment or portion
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussion suitable
Sequence, including function involved by basis by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use
In the order list of the executable instruction for realizing logic function, in may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or with reference to these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
The dress that defeated program is used for instruction execution system, device or equipment or with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：With the electricity that one or more are connected up
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can thereon print described program or other are suitable
Medium, because optical scanner for example can be carried out by paper or other media, then enters edlin, interpretation or if necessary with it
His suitable method is processed electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In implementation method, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If for example, realized with hardware, and in another embodiment, can be with well known in the art
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
The rapid hardware that can be by program to instruct correlation is completed, and described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
Additionally, during each functional unit in each embodiment of the invention can be integrated in a processing module, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.The integrated module is such as
Fruit is to realize in the form of software function module and as independent production marketing or when using, it is also possible to which storage is in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although having been shown above and retouching
Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as to limit of the invention
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention
Type.
Claims (12)
1. it is a kind of to realize the method that sign language information and text message are mutually changed, it is characterised in that including：
Conversion equipment receive Wearable send sign language information, the sign language information include palm and the conversion equipment it
Between distance, the relative distance between the elevation information of palm and finger, the sign language information represented by matrix-vector, institute
State Wearable and obtain relative between the distance between palm and described conversion equipment and finger by range sensor
Distance, wherein, represent the relative distance between finger with the matrix-vector of 10*10 or 5*5；
The conversion equipment carries out treatment to the sign language information and obtains corresponding positional information, is obtained according to the positional information
Corresponding text message；And
The conversion equipment exports the text message.
2. method according to claim 1, it is characterised in that corresponding text is obtained according to the positional information described
Before information, also include：Conversion table is set up based on sample information, is turned comprising text message and its sign language information in the conversion table
The positional information changed；
It is described that corresponding text message is obtained according to the positional information, including：Changed according to the place information inquiry
Table, obtains corresponding text message.
3. method according to claim 1 and 2, it is characterised in that the conversion equipment exports the text message, bag
Include：
The conversion equipment exports text message described in the text message or voice output by display screen.
4. method according to claim 2, it is characterised in that also include：
The conversion equipment obtains the text to be converted of user input, is obtained and the text pair to be converted based on the conversion table
The positional information answered；And
According to the positional information, sign language information corresponding with the text to be converted is exported by display screen.
5. it is a kind of to realize the method that sign language information and text message are mutually changed, it is characterised in that including：
Wearable obtains sign language information, wherein, the sign language information includes the distance between palm and conversion equipment, palm
Elevation information and finger between relative distance, the sign language information represented by matrix-vector, the Wearable
Relative distance between the distance between palm and the conversion equipment and finger is obtained by range sensor, wherein, use
The matrix-vector of 10*10 or 5*5 represents the relative distance between finger；And
The Wearable is processed the sign language information, and to the sign language information after conversion equipment transmission processe, with
The conversion equipment is set to export corresponding text message according to the sign language information after the treatment.
6. method according to claim 5, it is characterised in that the Wearable obtains sign language information, including：
The Wearable obtains the elevation information of palm by height sensor.
7. it is a kind of to realize the device that sign language information and text message are mutually changed, it is characterised in that including：
Receiver module, the sign language information for receiving Wearable transmission, the sign language information includes palm and described device
The distance between, the relative distance between the elevation information of palm and finger, the sign language information represented by matrix-vector,
The Wearable obtains the phase between the distance between palm and described conversion equipment and finger by range sensor
Adjust the distance, wherein, represent the relative distance between finger with the matrix-vector of 10*10 or 5*5；
Module is obtained, corresponding positional information is obtained for carrying out treatment to the sign language information, obtained according to the positional information
Obtain corresponding text message；And
Output module, for exporting the text message.
8. device according to claim 7, it is characterised in that also include：Module is set up, is used for：In the acquisition module
Before obtaining corresponding text message according to the positional information, conversion table is set up based on sample information, wrapped in the conversion table
Containing the positional information that text message and its sign language information are changed；
Wherein, the acquisition module, specifically for：The conversion table according to the place information inquiry, obtains corresponding text
Information.
9. the device according to claim 7 or 8, it is characterised in that the output module, specifically for：
Text message described in the text message or voice output is exported by display screen.
10. device according to claim 8, it is characterised in that the acquisition module, is additionally operable to：Obtain user input
Text to be converted, positional information corresponding with the text to be converted is obtained based on the conversion table；
The output module, is additionally operable to：According to the positional information that the acquisition module is obtained, exported by display screen and institute
State the corresponding sign language information of text to be converted.
A kind of 11. Wearables, it is characterised in that including：
Obtain module, for obtaining sign language information, wherein, the sign language information include the distance between palm and conversion equipment,
Relative distance between the elevation information and finger of palm, the sign language information represented by matrix-vector, the Wearable
Equipment obtains the relative distance between the distance between palm and the conversion equipment and finger by range sensor, its
In, represent the relative distance between finger with the matrix-vector of 10*10 or 5*5；And
Processing module, for processing the sign language information, and to the sign language information after conversion equipment transmission processe, so that
The conversion equipment exports corresponding text message according to the sign language information after the treatment.
12. Wearables according to claim 11, it is characterised in that the acquisition module, specifically for：
The elevation information of palm is obtained by height sensor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410253678.0A CN104049753B (en) | 2014-06-09 | 2014-06-09 | Realize the method and apparatus that sign language information and text message are mutually changed |
| PCT/CN2014/094708 WO2015188607A1 (en) | 2014-06-09 | 2014-12-23 | Method and apparatus for implementing mutual conversion between sign language information and text information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410253678.0A CN104049753B (en) | 2014-06-09 | 2014-06-09 | Realize the method and apparatus that sign language information and text message are mutually changed |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104049753A CN104049753A (en) | 2014-09-17 |
| CN104049753B true CN104049753B (en) | 2017-06-20 |
Family
ID=51502719
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410253678.0A Active CN104049753B (en) | 2014-06-09 | 2014-06-09 | Realize the method and apparatus that sign language information and text message are mutually changed |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104049753B (en) |
| WO (1) | WO2015188607A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104049753B (en) * | 2014-06-09 | 2017-06-20 | 百度在线网络技术（北京）有限公司 | Realize the method and apparatus that sign language information and text message are mutually changed |
| CN105068657B (en) * | 2015-08-19 | 2019-01-15 | 北京百度网讯科技有限公司 | The recognition methods of gesture and device |
| CN105227765B (en) * | 2015-09-10 | 2019-04-26 | 三星电子（中国）研发中心 | Interactive approach and system in communication process |
| CN105489088A (en) * | 2016-01-13 | 2016-04-13 | 宋纪元 | Voice bionic sign language bidirectional translation system |
| CN111160047A (en) * | 2018-11-08 | 2020-05-15 | 北京搜狗科技发展有限公司 | Data processing method and device and data processing device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004114107A1 (en) * | 2003-06-20 | 2004-12-29 | Nadeem Mohammad Qadir | Human-assistive wearable audio-visual inter-communication apparatus. |
| CN102193633A (en) * | 2011-05-25 | 2011-09-21 | 广州畅途软件有限公司 | dynamic sign language recognition method for data glove |
| JP2012252581A (en) * | 2011-06-03 | 2012-12-20 | Kyushu Institute Of Technology | Sign language recognition method and apparatus thereof |
| CN103116576A (en) * | 2013-01-29 | 2013-05-22 | 安徽安泰新型包装材料有限公司 | Voice and gesture interactive translation device and control method thereof |
| CN103246891A (en) * | 2013-05-28 | 2013-08-14 | 重庆邮电大学 | Chinese sign language recognition method based on kinect |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7565295B1 (en) * | 2003-08-28 | 2009-07-21 | The George Washington University | Method and apparatus for translating hand gestures |
| CN104049753B (en) * | 2014-06-09 | 2017-06-20 | 百度在线网络技术（北京）有限公司 | Realize the method and apparatus that sign language information and text message are mutually changed |
-
2014
- 2014-06-09 CN CN201410253678.0A patent/CN104049753B/en active Active
- 2014-12-23 WO PCT/CN2014/094708 patent/WO2015188607A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004114107A1 (en) * | 2003-06-20 | 2004-12-29 | Nadeem Mohammad Qadir | Human-assistive wearable audio-visual inter-communication apparatus. |
| CN102193633A (en) * | 2011-05-25 | 2011-09-21 | 广州畅途软件有限公司 | dynamic sign language recognition method for data glove |
| JP2012252581A (en) * | 2011-06-03 | 2012-12-20 | Kyushu Institute Of Technology | Sign language recognition method and apparatus thereof |
| CN103116576A (en) * | 2013-01-29 | 2013-05-22 | 安徽安泰新型包装材料有限公司 | Voice and gesture interactive translation device and control method thereof |
| CN103246891A (en) * | 2013-05-28 | 2013-08-14 | 重庆邮电大学 | Chinese sign language recognition method based on kinect |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015188607A1 (en) | 2015-12-17 |
| CN104049753A (en) | 2014-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104049753B (en) | Realize the method and apparatus that sign language information and text message are mutually changed | |
| WO2020062392A1 (en) | Signal processing device, signal processing method and related product | |
| WO2020169011A1 (en) | Human-computer system interaction interface design method | |
| CN107958455B (en) | Image definition appraisal procedure, device, computer equipment and storage medium | |
| CN103049761B (en) | Sign Language Recognition Method based on sign language glove and system | |
| CN107680589A (en) | Voice messaging exchange method, device and its equipment | |
| CN107240330A (en) | System that handwriting display method and system, the intelligence of practising handwriting practise handwriting terminal and intelligence is practised handwriting | |
| CN107728780A (en) | A kind of man-machine interaction method and device based on virtual robot | |
| CN102693047A (en) | Providing position information in a collaborative environment | |
| CN107767333A (en) | Method, equipment and the computer that U.S. face is taken pictures can storage mediums | |
| CN111107278B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN109324688A (en) | Exchange method and system based on visual human's behavioral standard | |
| CN109343695A (en) | Exchange method and system based on visual human's behavioral standard | |
| TW202001597A (en) | Device for sentiment feature extraction and method of the same | |
| CN110121719A (en) | Device, method and computer program product for deep learning | |
| CN204808234U (en) | Dot matrix digital pen is write to blank | |
| CN106527678A (en) | Social interaction equipment of mixed reality, system and head-mounted display equipment | |
| CN206210144U (en) | Gesture language-voice converts cap | |
| CN105022988B (en) | The recognition methods of electronics manuscript and device | |
| CN111104827A (en) | Image processing method and device, electronic equipment and readable storage medium | |
| Kumar et al. | Sixth sense technology | |
| CN105809612A (en) | Method of transforming image into expression and intelligent terminal | |
| CN107070784A (en) | A kind of 3D instant communicating systems based on WebGL and VR technologies | |
| CN108960191B (en) | Multi-mode fusion emotion calculation method and system for robot | |
| JP7479507B2 (en) | Image processing method and device, computer device, and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |