CN104049753A - Method and device for realizing mutual conversion between sign language information and text information - Google Patents
Method and device for realizing mutual conversion between sign language information and text information Download PDFInfo
- Publication number
- CN104049753A CN104049753A CN201410253678.0A CN201410253678A CN104049753A CN 104049753 A CN104049753 A CN 104049753A CN 201410253678 A CN201410253678 A CN 201410253678A CN 104049753 A CN104049753 A CN 104049753A
- Authority
- CN
- China
- Prior art keywords
- information
- sign language
- text message
- language information
- palm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Abstract
The invention discloses a method, a device and wearable equipment for realizing mutual conversion between sign language information and text information. The method comprises the steps that the sign language information sent by the wearable equipment is received by a conversion device, wherein the sign language information comprises the distance between a palm and the conversion device, height information of the palm and relative distance between fingers; the sign language information is processed by the conversion device to obtain corresponding position information, and the corresponding text information is obtained according to the position information; the text information is output by the conversion device. According to the method for realizing mutual conversion between the sign language information and the text information in the embodiment, the distance between the palm and the conversion device and the relative distance between fingers are obtained by a distance sensor of the wearable equipment, the height information of the palm is obtained by a height sensor, the amount of information required in a conversion process is reduced, the information processing efficiency and conversion efficiency are improved, the requirement on software and hardware equipment is lowered, other equipment is not needed, the implementation is easy, and the applicability is high.
Description
Technical field
The present invention relates to artificial intelligence recognition technology field, relate in particular to a kind of method, device and Wearable equipment that sign language information and text message are changed mutually of realizing.
Background technology
Sign language is to use gesture to make a gesture of measuring action, certain meaning or the word to form according to the change modeling image of gesture or syllable, and it is the main the vehicle of communication of deaf-mute.At present, to the identification of sign language, according to input mode, can be divided into based on Wearable equipment with based on traditional vision.Based on the recognition method of Wearable equipment, be mainly to carry out Sign Language Recognition by each joint angles information and the hand of the sensor measurement hand on Wearable equipment at track and the time sequence information etc. of spatial movement.Based on the recognition method of traditional vision, be mainly to identify by video information or the image information of camera collection gesture.
But, find that prior art at least exists following problem realizing inventor in process of the present invention: the recognition method based on traditional vision need to, by means of the first-class equipment of shooting, easily be subject to environmental impact, and the success ratio of identification be low; Based on the recognition method of Wearable equipment, need to obtain a large amount of finger-joint information by various sensors, then these finger-joint information are processed, high to soft hardware equipment requirement, information processing efficiency is low, realizes complicated.
Summary of the invention
The present invention is intended to solve at least to a certain extent one of technical matters in correlation technique.For this reason, one object of the present invention is to propose a kind of method that sign language information and text message are changed mutually that realizes.The method can improve information processing efficiency, improves conversion efficiency, reduces the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, and applicability is strong.
Second object of the present invention is to propose the another kind of method that sign language information and text message are changed mutually that realizes.
The 3rd object of the present invention is to propose a kind of device that sign language information and text message are changed mutually of realizing.
The 4th object of the present invention is to propose a kind of Wearable equipment.
To achieve these goals, the sign language information that realizes of first aspect present invention embodiment and the method that text message is changed mutually, comprise: conversion equipment receives the sign language information that Wearable equipment sends, described sign language information comprise the elevation information of distance between palm and described conversion equipment, palm and point between relative distance; Described conversion equipment is processed and is obtained corresponding positional information described sign language information, obtains corresponding text message according to described positional information; And described conversion equipment is exported described text message.
The sign language information that realizes of the embodiment of the present invention and the method that text message is changed mutually, obtain the relative distance between distance and the finger between palm and conversion equipment by the range sensor of Wearable equipment, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
To achieve these goals, the sign language information that realizes of second aspect present invention embodiment and the method that text message is changed mutually, comprise: Wearable equipment obtains sign language information, wherein, described sign language information comprises the relative distance between elevation information and the finger of distance between palm and described conversion equipment, palm; And described Wearable equipment processes described sign language information, and to the sign language information after conversion equipment transmission processing, so that described conversion equipment is exported corresponding text message according to described sign language information after treatment.
The sign language information that realizes of the embodiment of the present invention and the method that text message is changed mutually, obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
To achieve these goals, the sign language information that realizes of third aspect present invention embodiment and the device that text message is changed mutually, comprise: receiver module, the sign language information sending for receiving Wearable equipment, described sign language information comprise the elevation information of distance between palm and described device, palm and point between relative distance; Obtain module, obtain corresponding positional information for described sign language information is processed, obtain corresponding text message according to described positional information; And output module, for exporting described text message.
The sign language information that realizes of the embodiment of the present invention and the device that text message is changed mutually, obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
To achieve these goals, the Wearable equipment of fourth aspect present invention embodiment, comprising: obtain module, for obtaining sign language information, wherein, described sign language information comprises the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm; And processing module, for described sign language information is processed, and to the sign language information after conversion equipment transmission processing, so that described conversion equipment is exported corresponding text message according to described sign language information after treatment.
The Wearable equipment of the embodiment of the present invention, obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
Brief description of the drawings
Fig. 1 is the process flow diagram of realizing according to an embodiment of the invention the method that sign language information and text message change mutually.
Fig. 2 is the exemplary plot of sign language information according to an embodiment of the invention.
Fig. 3 is the process flow diagram of realizing in accordance with another embodiment of the present invention the method that sign language information and text message change mutually.
Fig. 4 is the structural representation of realizing according to an embodiment of the invention the device that sign language information and text message change mutually.
Fig. 5 is the structural representation of Wearable equipment according to an embodiment of the invention.
Embodiment
Describe embodiments of the invention below in detail, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has the element of identical or similar functions from start to finish.Be exemplary below by the embodiment being described with reference to the drawings, be intended to for explaining the present invention, and can not be interpreted as limitation of the present invention.
Below with reference to accompanying drawing, the sign language information that realizes of the embodiment of the present invention and method, device and the Wearable equipment that text message is changed are mutually described.
Fig. 1 is the process flow diagram of realizing according to an embodiment of the invention the method that sign language information and text message change mutually, and this embodiment is described from Wearable equipment.
As shown in Figure 1, realizing the method that sign language information and text message change mutually comprises the following steps:
S101, Wearable equipment obtains sign language information, and wherein, sign language information comprises the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm.
In an embodiment of the present invention, Wearable equipment can obtain sign language information corresponding to gesture that user makes by various sensors.Particularly, Wearable equipment can obtain the relative distance between distance and ten fingers between left and right palm and conversion equipment by range sensor, can obtain by height sensor the elevation information of left and right palm.
More specifically, available L represents the distance of the left hand palm and conversion equipment, R represents the distance of the right hand palm and conversion equipment, LH represents the elevation information (being the average height of 5 fingers of left hand) of the left hand palm, and RH represents the elevation information (being the average height of 5 fingers of the right hand) of the right hand palm.L1 represents left hand thumb, and L2 represents left index finger, and L3 represents left hand middle finger, and L4 represents the left hand third finger, and L5 represents left hand little finger, and R1 represents hand thumb, and R2 represents right hand forefinger, and R3 represents right hand middle finger, and R4 represents right ring finger, and R5 represents right hand little finger.The available 10*10 of distance between 10 fingers or the matrix-vector of 5*5 represent.Adopt the mode of matrix-vector to represent data, facilitate subsequent operation.
S102, Wearable equipment is processed sign language information, and to the sign language information after conversion equipment transmission processing, so that conversion equipment is exported corresponding text message according to sign language information after treatment.
In an embodiment of the present invention, Wearable equipment can amplify the sign language information obtaining, and then encodes and compresses, and the processing such as then stores.After sign language information is processed, Wearable equipment can communicate by the modes such as NFC (near-field communication), WIFI (Wireless Fidelity), infrared ray, sound wave and conversion equipment, and to the sign language information after conversion equipment transmission processing, so that conversion equipment is exported corresponding text message according to sign language information after treatment.
The sign language information that realizes of the embodiment of the present invention and the method that text message is changed mutually, obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
Fig. 2 is the process flow diagram of realizing in accordance with another embodiment of the present invention the method that sign language information and text message change mutually, and this embodiment is described from conversion equipment side.
As shown in Figure 2, realizing the method that sign language information and text message change mutually comprises the following steps:
S201, conversion equipment receives the sign language information that Wearable equipment sends, and sign language information comprises the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm.
In an embodiment of the present invention, conversion equipment can communicate by the modes such as NFC (near-field communication), WIFI (Wireless Fidelity), infrared ray, sound wave and Wearable equipment.Conversion equipment can receive the sign language information that Wearable equipment sends, and wherein, sign language information can comprise the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm.Particularly, Wearable equipment can obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, can obtain by height sensor the elevation information of palm.
S202, conversion equipment is processed and is obtained corresponding positional information sign language information, obtains corresponding text message according to positional information.
In an embodiment of the present invention, because user's arm length, finger length, height etc. might not be identical, therefore need to collect multiple users' information, then therefrom extract feature as sample information, set up conversion table with this.Wherein, conversion table can comprise the positional information of text message and the conversion of sign language information thereof.This positional information can be coordinate information corresponding to gesture that user makes.Receive at conversion equipment after the sign language information of Wearable equipment transmission, conversion equipment can be processed and obtain corresponding coordinate information sign language information, then inquires about and obtain text message corresponding to this coordinate information in conversion table.
For example: suppose that the distance between palm and conversion equipment is 50 centimetres, the corresponding data of gesture that user makes can be expressed as L, R, LH, the data that the distance matrix of RH=(50,45,80,130) and 10 fingers comprises are as shown in table 1.
The data that table 1 distance matrix comprises
| ? | R1 | R2 | R3 | R4 | R5 |
| L1 | 60 | 59 | 60 | 60 | 60 |
| L2 | 60 | 59 | 60 | 60 | 60 |
| L3 | 60 | 59 | 60 | 60 | 60 |
| L4 | 60 | 59 | 60 | 60 | 60 |
| L5 | 60 | 59 | 60 | 60 | 60 |
According to above coordinate information, can the query conversion table text message corresponding with it, finally can obtain text message " I ", as shown in Figure 3.Similarly, adopt aforesaid way to obtain text message " love " and " you " according to coordinate information corresponding to another two gestures.It should be noted that, above numerical value and unit are only example.
S203, conversion equipment output text message.
In an embodiment of the present invention, conversion equipment can comprise display screen, can export text message or voice output text message by display screen.
As can be seen here, the sign language information adopting in the present embodiment only comprises this three class of relative distance between elevation information and the finger of distance between palm and conversion equipment, palm, with respect to other conversion regimes, the data volume that the conversion regime adopting in the present embodiment adopts is less, therefore, the treatment effeciency of data is high, and the conversion efficiency between information is higher, being particularly useful for the scene that requirement of real-time is higher, there is urgent unexpected situation in for example deaf-mute.
In an embodiment of the present invention, conversion equipment can also be converted to corresponding sign language information by the text message of user's input.Particularly, conversion equipment can obtain the text to be converted of user's input, then obtains the positional information corresponding with text to be converted according to conversion table, then according to this positional information, exports the sign language information corresponding with text to be converted by display screen.For example: in the time that the TV programme media of TV station need to add programme televised live that link is expressed in sign language, can be by the material (text to be converted) of presiding over human needs oral account be input in conversion equipment, then obtain corresponding positional information according to conversion table, again according to positional information, export the action message of virtual portrait by display screen, thereby allow illiterate deaf-mute can understand the information of media releasing, save the time cost that human translation becomes sign language, made that deaf-mute is can be as ordinary people timely obtains real-time information.
The sign language information that realizes of the embodiment of the present invention and the method that text message is changed mutually, obtain the relative distance between distance and the finger between palm and conversion equipment by the range sensor of Wearable equipment, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
Above-described embodiment can also be applied to concrete information search scene.For instance, when the deaf-mute user inquiry data of wanting to surf the Net, but when input method that can be not traditional, now, he only need choose the position of word input on computer screen is in search box, on wearing, Wearable equipment carries out sign language operation, and sign language information is sent to computer, and computer is herein conversion equipment.Computer expert crosses the pre-stored conversion table of inquiry, obtains corresponding text message, can show that at search box user thinks the text of input.Deaf-mute user can carry out by the method the input of search word, and searches for required data.
In order to realize above-described embodiment, the present invention also proposes a kind of device that sign language information and text message are changed mutually of realizing.
As shown in Figure 4, realizing the device that sign language information and text message change mutually comprises: receiver module 110, obtain module 120 and output module 130.
The sign language information that receiver module 110 sends for receiving Wearable equipment, sign language information comprise the elevation information of distance, palm between palm and device and point between relative distance.
In an embodiment of the present invention, conversion equipment can communicate by the modes such as NFC (near-field communication), WIFI (Wireless Fidelity), infrared ray, sound wave and Wearable equipment.Receiver module 110 can receive the sign language information that Wearable equipment sends, and wherein, sign language information can comprise the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm.Particularly, Wearable equipment can obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, can obtain by height sensor the elevation information of palm.
Obtain module 120 and obtain corresponding positional information for sign language information is processed, obtain corresponding text message according to positional information.
In an embodiment of the present invention, because user's arm length, finger length, height etc. might not be identical, therefore need to collect multiple users' information, then therefrom extract feature as sample information, set up conversion table so that set up module 140 based on sample information.Wherein, conversion table can comprise the positional information of text message and the conversion of sign language information thereof.This positional information can be coordinate information corresponding to gesture that user makes.Receive at receiver module 110 after the sign language information of Wearable equipment transmission, obtaining module 120 can process and obtain corresponding coordinate information sign language information, then inquires about and obtain text message corresponding to this coordinate information in conversion table.For example: suppose that the distance between palm and conversion equipment is 50 centimetres, the corresponding data of gesture that user makes can be expressed as L, R, LH, the data that the distance matrix of RH=(50,45,80,130) and 10 fingers comprises are as shown in table 1.
The data that table 1 distance matrix comprises
| ? | R1 | R2 | R3 | R4 | R5 |
| L1 | 60 | 59 | 60 | 60 | 60 |
| L2 | 60 | 59 | 60 | 60 | 60 |
| L3 | 60 | 59 | 60 | 60 | 60 |
| L4 | 60 | 59 | 60 | 60 | 60 |
| L5 | 60 | 59 | 60 | 60 | 60 |
According to above coordinate information, can the query conversion table text message corresponding with it, finally can obtain text message " I ", as shown in Figure 2.Similarly, adopt aforesaid way to obtain text message " love " and " you " according to coordinate information corresponding to another two gestures.It should be noted that, above numerical value and unit are only example.
Output module 130 is for exporting text message.
In an embodiment of the present invention, conversion equipment can comprise display screen, and output module 130 can be exported text message or voice output text message by display screen.
As can be seen here, the sign language information adopting in the present embodiment only comprises this three class of relative distance between elevation information and the finger of distance between palm and conversion equipment, palm, with respect to other conversion regimes, the data volume that the conversion regime adopting in the present embodiment adopts is less, therefore, the treatment effeciency of data is high, and the conversion efficiency between information is higher, being particularly useful for the scene that requirement of real-time is higher, there is urgent unexpected situation in for example deaf-mute.
In addition, realizing device that sign language information and text message change mutually also can comprise and set up module 140.
Set up module 140 for before obtaining corresponding text message in acquisition module 120 according to positional information, set up conversion table based on sample information, in conversion table, comprise the positional information of text message and the conversion of sign language information thereof.
In an embodiment of the present invention, conversion equipment can also be converted to corresponding sign language information by the text message of user's input.Particularly, obtain the text to be converted that module 120 can obtain user's input, then obtain the positional information corresponding with text to be converted according to conversion table, then according to this positional information, output module 130 is exported the sign language information corresponding with text to be converted by display screen.For example: in the time that the TV programme media of TV station need to add programme televised live that link is expressed in sign language, can be by the material (text to be converted) of presiding over human needs oral account be input in conversion equipment, then obtain corresponding positional information according to conversion table, again according to positional information, export the action message of virtual portrait by display screen, thereby allow illiterate deaf-mute can understand the information of media releasing, real-time, save the time cost that human translation becomes sign language, made that deaf-mute is can be as ordinary people timely obtains real-time information.
The sign language information that realizes of the embodiment of the present invention and the device that text message is changed mutually, obtain the relative distance between distance and the finger between palm and conversion equipment by the range sensor of Wearable equipment, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
In order to realize above-described embodiment, the present invention also proposes a kind of Wearable equipment.As shown in Figure 5, Wearable equipment comprises: obtain module 210 and processing module 220.
Obtain module 210 for obtaining sign language information, wherein, sign language information comprises the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm.
In an embodiment of the present invention, obtain module 210 and can obtain sign language information corresponding to gesture that user makes by various sensors.Particularly, obtain module 210 and can obtain the relative distance between distance and ten fingers between left and right palm and conversion equipment by range sensor, can obtain by height sensor the elevation information of left and right palm.
More specifically, available L represents the distance of the left hand palm and conversion equipment, R represents the distance of the right hand palm and conversion equipment, LH represents the elevation information (being the average height of 5 fingers of left hand) of the left hand palm, and RH represents the elevation information (being the average height of 5 fingers of the right hand) of the right hand palm.L1 represents left hand thumb, and L2 represents left index finger, and L3 represents left hand middle finger, and L4 represents the left hand third finger, and L5 represents left hand little finger, and R1 represents hand thumb, and R2 represents right hand forefinger, and R3 represents right hand middle finger, and R4 represents right ring finger, and R5 represents right hand little finger.The available 10*10 of distance between 10 fingers or the matrix-vector of 5*5 represent.Adopt the mode of matrix-vector to represent data, facilitate subsequent operation.
Processing module 220 is for sign language information is processed, and to the sign language information after conversion equipment transmission processing, so that conversion equipment is exported corresponding text message according to sign language information after treatment.
In an embodiment of the present invention, processing module 220 can be amplified the sign language information obtaining, and then encodes and compresses, and the processing such as then stores.After sign language information is processed, processing module 220 can communicate by the modes such as NFC (near-field communication), WIFI (Wireless Fidelity), infrared ray, sound wave and conversion equipment, and to the sign language information after conversion equipment transmission processing, so that conversion equipment is exported corresponding text message according to sign language information after treatment.
The Wearable equipment of the embodiment of the present invention, obtain the relative distance between distance and the finger between palm and conversion equipment by range sensor, height sensor obtains the elevation information of palm, greatly reduce the information content needing in transfer process, improved information processing efficiency, improved conversion efficiency, and reduce the requirement to soft hardware equipment, and need to, by other equipment, not realize simply, applicability is strong.
In the description of this instructions, the description of reference term " embodiment ", " some embodiment ", " example ", " concrete example " or " some examples " etc. means to be contained at least one embodiment of the present invention or example in conjunction with specific features, structure, material or the feature of this embodiment or example description.In this manual, to the schematic statement of above-mentioned term not must for be identical embodiment or example.And, specific features, structure, material or the feature of description can one or more embodiment in office or example in suitable mode combination.In addition,, not conflicting in the situation that, those skilled in the art can carry out combination and combination by the feature of the different embodiment that describe in this instructions or example and different embodiment or example.
In addition, term " first ", " second " be only for describing object, and can not be interpreted as instruction or hint relative importance or the implicit quantity that indicates indicated technical characterictic.Thus, at least one this feature can be expressed or impliedly be comprised to the feature that is limited with " first ", " second ".In description of the invention, the implication of " multiple " is at least two, for example two, and three etc., unless otherwise expressly limited specifically.
Any process of otherwise describing in process flow diagram or at this or method are described and can be understood to, represent to comprise that one or more is for realizing module, fragment or the part of code of executable instruction of step of specific logical function or process, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can be not according to order shown or that discuss, comprise according to related function by the mode of basic while or by contrary order, carry out function, this should be understood by embodiments of the invention person of ordinary skill in the field.
The logic and/or the step that in process flow diagram, represent or otherwise describe at this, for example, can be considered to the sequencing list of the executable instruction for realizing logic function, may be embodied in any computer-readable medium, use for instruction execution system, device or equipment (as computer based system, comprise that the system of processor or other can and carry out the system of instruction from instruction execution system, device or equipment instruction fetch), or use in conjunction with these instruction execution systems, device or equipment.With regard to this instructions, " computer-readable medium " can be anyly can comprise, device that storage, communication, propagation or transmission procedure use for instruction execution system, device or equipment or in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wirings, portable computer diskette box (magnetic device), random access memory (RAM), ROM (read-only memory) (ROM), the erasable ROM (read-only memory) (EPROM or flash memory) of editing, fiber device, and portable optic disk ROM (read-only memory) (CDROM).In addition, computer-readable medium can be even paper or other the suitable medium that can print described program thereon, because can be for example by paper or other media be carried out to optical scanning, then edit, decipher or process in electronics mode and obtain described program with other suitable methods if desired, be then stored in computer memory.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple steps or method can realize with being stored in software or the firmware carried out in storer and by suitable instruction execution system.For example, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: there is the discrete logic for data-signal being realized to the logic gates of logic function, there is the special IC of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is can carry out the hardware that instruction is relevant by program to complete, described program can be stored in a kind of computer-readable recording medium, this program, in the time carrying out, comprises step of embodiment of the method one or a combination set of.
In addition, the each functional unit in each embodiment of the present invention can be integrated in a processing module, can be also that the independent physics of unit exists, and also can be integrated in a module two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and also can adopt the form of software function module to realize.If described integrated module realizes and during as production marketing independently or use, also can be stored in a computer read/write memory medium using the form of software function module.
The above-mentioned storage medium of mentioning can be ROM (read-only memory), disk or CD etc.Although illustrated and described embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, amendment, replacement and modification.
Claims (12)
1. realize the method that sign language information and text message are changed mutually, it is characterized in that, comprising:
Conversion equipment receives the sign language information that Wearable equipment sends, described sign language information comprise the elevation information of distance between palm and described conversion equipment, palm and point between relative distance;
Described conversion equipment is processed and is obtained corresponding positional information described sign language information, obtains corresponding text message according to described positional information; And
Described conversion equipment is exported described text message.
2. method according to claim 1, it is characterized in that, described obtain corresponding text message according to described positional information before, also comprise: set up conversion table based on sample information, in described conversion table, comprise the positional information of text message and sign language information thereof conversion;
Describedly obtain corresponding text message according to described positional information, comprising: according to conversion table described in described place information inquiry, obtain corresponding text message.
3. method according to claim 1 and 2, is characterized in that, described conversion equipment is exported described text message, comprising:
Described conversion equipment is exported text message described in described text message or voice output by display screen.
4. method according to claim 2, is characterized in that, also comprises:
Described conversion equipment obtains the text to be converted of user's input, obtains the positional information corresponding with described text to be converted based on described conversion table; And
According to described positional information, export the sign language information corresponding with described text to be converted by display screen.
5. realize the method that sign language information and text message are changed mutually, it is characterized in that, comprising:
Wearable equipment obtains sign language information, wherein, described sign language information comprise the elevation information of distance between palm and described conversion equipment, palm and point between relative distance; And
Described Wearable equipment is processed described sign language information, and to the sign language information after conversion equipment transmission processing, so that described conversion equipment is exported corresponding text message according to described sign language information after treatment.
6. method according to claim 5, is characterized in that, described Wearable equipment obtains sign language information, comprising:
Described Wearable equipment obtains the relative distance between distance and the finger between palm and described conversion equipment by range sensor, and obtains the elevation information of palm by height sensor.
7. realize the device that sign language information and text message are changed mutually, it is characterized in that, comprising:
Receiver module, the sign language information sending for receiving Wearable equipment, described sign language information comprise the elevation information of distance between palm and described device, palm and point between relative distance;
Obtain module, obtain corresponding positional information for described sign language information is processed, obtain corresponding text message according to described positional information; And
Output module, for exporting described text message.
8. device according to claim 7, it is characterized in that, also comprise: set up module, be used for: before described acquisition module obtains corresponding text message according to described positional information, set up conversion table based on sample information, in described conversion table, comprise the positional information of text message and the conversion of sign language information thereof;
Wherein, described acquisition module, specifically for: according to conversion table described in described place information inquiry, obtain corresponding text message.
9. according to the device described in claim 7 or 8, it is characterized in that, described output module, specifically for:
Export text message described in described text message or voice output by display screen.
10. device according to claim 8, is characterized in that, described acquisition module, also for: obtain the text to be converted of user input, obtain the positional information corresponding with described text to be converted based on described conversion table;
Described output module, also, for the described positional information that obtains according to described acquisition module, exports the sign language information corresponding with described text to be converted by display screen.
11. 1 kinds of Wearable equipment, is characterized in that, comprising:
Obtain module, for obtaining sign language information, wherein, described sign language information comprises the relative distance between elevation information and the finger of distance between palm and conversion equipment, palm; And
Processing module, for described sign language information is processed, and to the sign language information after conversion equipment transmission processing, so that described conversion equipment is exported corresponding text message according to described sign language information after treatment.
12. Wearable equipment according to claim 11, is characterized in that, described acquisition module, specifically for:
Obtain the relative distance between distance and the finger between palm and described conversion equipment by range sensor, and obtain the elevation information of palm by height sensor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410253678.0A CN104049753B (en) | 2014-06-09 | 2014-06-09 | Realize the method and apparatus that sign language information and text message are mutually changed |
| PCT/CN2014/094708 WO2015188607A1 (en) | 2014-06-09 | 2014-12-23 | Method and apparatus for implementing mutual conversion between sign language information and text information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410253678.0A CN104049753B (en) | 2014-06-09 | 2014-06-09 | Realize the method and apparatus that sign language information and text message are mutually changed |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104049753A true CN104049753A (en) | 2014-09-17 |
| CN104049753B CN104049753B (en) | 2017-06-20 |
Family
ID=51502719
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410253678.0A Active CN104049753B (en) | 2014-06-09 | 2014-06-09 | Realize the method and apparatus that sign language information and text message are mutually changed |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104049753B (en) |
| WO (1) | WO2015188607A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105068657A (en) * | 2015-08-19 | 2015-11-18 | 北京百度网讯科技有限公司 | Gesture identification method and device |
| WO2015188607A1 (en) * | 2014-06-09 | 2015-12-17 | 百度在线网络技术（北京）有限公司 | Method and apparatus for implementing mutual conversion between sign language information and text information |
| CN105227765A (en) * | 2015-09-10 | 2016-01-06 | 三星电子（中国）研发中心 | Interactive approach in communication process and system |
| CN105489088A (en) * | 2016-01-13 | 2016-04-13 | 宋纪元 | Voice bionic sign language bidirectional translation system |
| CN111160047A (en) * | 2018-11-08 | 2020-05-15 | 北京搜狗科技发展有限公司 | Data processing method and device and data processing device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004114107A1 (en) * | 2003-06-20 | 2004-12-29 | Nadeem Mohammad Qadir | Human-assistive wearable audio-visual inter-communication apparatus. |
| CN102193633A (en) * | 2011-05-25 | 2011-09-21 | 广州畅途软件有限公司 | dynamic sign language recognition method for data glove |
| JP2012252581A (en) * | 2011-06-03 | 2012-12-20 | Kyushu Institute Of Technology | Sign language recognition method and apparatus thereof |
| CN103116576A (en) * | 2013-01-29 | 2013-05-22 | 安徽安泰新型包装材料有限公司 | Voice and gesture interactive translation device and control method thereof |
| CN103246891A (en) * | 2013-05-28 | 2013-08-14 | 重庆邮电大学 | Chinese sign language recognition method based on kinect |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7565295B1 (en) * | 2003-08-28 | 2009-07-21 | The George Washington University | Method and apparatus for translating hand gestures |
| CN104049753B (en) * | 2014-06-09 | 2017-06-20 | 百度在线网络技术（北京）有限公司 | Realize the method and apparatus that sign language information and text message are mutually changed |
-
2014
- 2014-06-09 CN CN201410253678.0A patent/CN104049753B/en active Active
- 2014-12-23 WO PCT/CN2014/094708 patent/WO2015188607A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004114107A1 (en) * | 2003-06-20 | 2004-12-29 | Nadeem Mohammad Qadir | Human-assistive wearable audio-visual inter-communication apparatus. |
| CN102193633A (en) * | 2011-05-25 | 2011-09-21 | 广州畅途软件有限公司 | dynamic sign language recognition method for data glove |
| JP2012252581A (en) * | 2011-06-03 | 2012-12-20 | Kyushu Institute Of Technology | Sign language recognition method and apparatus thereof |
| CN103116576A (en) * | 2013-01-29 | 2013-05-22 | 安徽安泰新型包装材料有限公司 | Voice and gesture interactive translation device and control method thereof |
| CN103246891A (en) * | 2013-05-28 | 2013-08-14 | 重庆邮电大学 | Chinese sign language recognition method based on kinect |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015188607A1 (en) * | 2014-06-09 | 2015-12-17 | 百度在线网络技术（北京）有限公司 | Method and apparatus for implementing mutual conversion between sign language information and text information |
| CN105068657A (en) * | 2015-08-19 | 2015-11-18 | 北京百度网讯科技有限公司 | Gesture identification method and device |
| CN105068657B (en) * | 2015-08-19 | 2019-01-15 | 北京百度网讯科技有限公司 | The recognition methods of gesture and device |
| CN105227765A (en) * | 2015-09-10 | 2016-01-06 | 三星电子（中国）研发中心 | Interactive approach in communication process and system |
| CN105489088A (en) * | 2016-01-13 | 2016-04-13 | 宋纪元 | Voice bionic sign language bidirectional translation system |
| CN111160047A (en) * | 2018-11-08 | 2020-05-15 | 北京搜狗科技发展有限公司 | Data processing method and device and data processing device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015188607A1 (en) | 2015-12-17 |
| CN104049753B (en) | 2017-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943860B (en) | Model training method, text intention recognition method and text intention recognition device | |
| CN108416003A (en) | A kind of picture classification method and device, terminal, storage medium | |
| CN104049753A (en) | Method and device for realizing mutual conversion between sign language information and text information | |
| CN106875460A (en) | A kind of picture countenance synthesis method and terminal | |
| CN111209423B (en) | Image management method and device based on electronic album and storage medium | |
| CN102779509A (en) | Voice processing equipment and voice processing method | |
| CN112990390B (en) | Training method of image recognition model, and image recognition method and device | |
| CN111950570B (en) | Target image extraction method, neural network training method and device | |
| CN112184548A (en) | Image super-resolution method, device, equipment and storage medium | |
| CN109034148A (en) | One kind is based on character image identification audio reading method and its device | |
| CN110544287B (en) | Picture allocation processing method and electronic equipment | |
| CN105335434B (en) | Log management method and device and electronic equipment | |
| CN116580211B (en) | Key point detection method, device, computer equipment and storage medium | |
| US20230135661A1 (en) | Image processing method and apparatus for smart pen, and electronic device | |
| CN116543076B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN113192537A (en) | Awakening degree recognition model training method and voice awakening degree obtaining method | |
| CN112488157A (en) | Dialog state tracking method and device, electronic equipment and storage medium | |
| CN115659959B (en) | Image text error correction method and device, electronic equipment and storage medium | |
| CN102567631A (en) | Interactive simulation electronic pet system of virtual pet | |
| WO2022161025A1 (en) | Voiceprint recognition method and apparatus, electronic device, and readable storage medium | |
| CN114462539A (en) | Training method of content classification model, and content classification method and device | |
| US11403534B2 (en) | Acquiring entity webpage link based on topological relationship graph | |
| CN111159472B (en) | Multimodal chat technique | |
| CN114610911A (en) | Multi-mode knowledge intrinsic representation learning method, device, equipment and storage medium | |
| CN114065168A (en) | Information processing method, intelligent terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |