WO2016026440A1

WO2016026440A1 - Glove for use in collecting data for sign language recognition

Info

Publication number: WO2016026440A1
Application number: PCT/CN2015/087521
Authority: WO
Inventors: 王犇; 姜小花; 罗红; 任骝; 张建杰; 徐魁; 陈彦霖; 周正宇; 郭文蔚
Original assignee: 博世（中国）投资有限公司
Priority date: 2014-08-20
Filing date: 2015-08-19
Publication date: 2016-02-25
Also published as: CN105353866A

Abstract

A glove for use in collecting data for sign language recognition. The glove comprises: multiple azimuth sensors (11) arranged on the glove at positions corresponding to the phalanges (101) and the metacarpal bones (102) of the hand and used for sensing postures of the hand; and, a height sensor (12) arranged on the data glove and used for sensing data for calculating the height at which the hand is located. The glove collects comprehensive data for gesture determination, thus allowing improved accuracy in gesture determination.

Description

Gloves for collecting data for sign language recognition

The present application claims the priority of the Chinese Patent Application No. 201410410413.7, filed on Aug. 20, 2014, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of data processing, and in particular to a glove for collecting data for sign language recognition.

Background technique

At present, the communication between deaf and normal people requires normal people to read the deaf and mute dumb words. For a normal person who does not understand the mute or gesture of deaf people, how to understand the meaning of deaf-mute people through gestures becomes a problem of communication between the two.

There are currently data gloves designed specifically for deaf people. By setting the azimuth angle of the hand and the azimuth of each phalanx on the data glove, the angle of bending between the phalanx of each node is calculated and sent to the central computer for processing. The central computer recognizes the sign language and outputs the meaning of the sign language in the form of voice or text through, for example, a speaker or a display, thereby achieving the purpose of communication between the normal person and the deaf person.

The present invention will provide a new way for the above device to accurately express the meaning of the sign language of deaf people.

Summary of the invention

One of the technical problems solved by one aspect of the present invention is to collect more comprehensive data for sign language recognition, thereby making sign language recognition more accurate.

According to an embodiment of the present invention, there is provided a glove for collecting data for sign language recognition, comprising: a plurality of azimuths for sensing a posture of a hand placed on a glove corresponding to a position of a phalanx and a metacarpal bone of the hand Sensor; placed on the data glove for sensing the height of the hand used to calculate The height sensor of the data.

According to an embodiment of the invention, the azimuth sensor placed on the glove is used to sense azimuth data of the phalanx and metacarpal of the hand.

According to an embodiment of the invention, the glove further comprises: a control unit for collecting data of the plurality of azimuth sensors and height sensor sensing, wherein the data is used to determine the meaning of the gesture.

According to an embodiment of the invention, the glove further comprises: an output unit, configured to output the meaning of the collected gesture in the form of voice or text.

According to an embodiment of the invention, the height sensor is an air pressure sensor.

According to an embodiment of the invention, the azimuth sensor placed on the glove corresponding to the metacarpal bone of the hand is placed at a position corresponding to the two metacarpals.

According to an embodiment of the invention, the bag is provided in the glove for fixing the azimuth sensor.

According to an embodiment of the invention, the bag is provided on the outside of the glove for fixing the azimuth sensor.

According to one embodiment of the invention, the azimuth sensor is placed on the glove only at a position other than the index finger, the middle finger, the ring finger, and the first phalanx of the little finger near the fingertip of the phalane of the hand.

According to an embodiment of the present invention, the size of the portion of the glove corresponding to each of the phalanges and palms matches the size of the phalanx and palm of the man or woman.

The inventors have found that the accuracy of identifying the sign language of deaf people in the prior art is low because the basic data collected is not comprehensive. The prior art only collects the azimuth related data of the hand and the azimuth related data of each phalanx, but the inventors have found that these azimuths sometimes do not necessarily accurately reflect the meaning of the deaf and mute sign language, resulting in accurate sign language. The rate is low. The glove for collecting basic data in the embodiment of the present invention compensates for this defect by collecting highly correlated data on the basis of collecting azimuth related data, and improves the determination accuracy.

DRAWINGS

Figure 1 is a structural view of a hand bone.

2 is a schematic diagram of parameters required by the inventors to define sign language requirements.

3a-b are schematic illustrations of gloves, respectively, when sign language recognition is performed on the outside and inside of a glove in accordance with a first embodiment of the present invention.

4a-b are schematic illustrations of gloves, respectively, when sign language recognition is performed on the outside and inside of a glove in accordance with a second embodiment of the present invention.

Figures 5a-b are schematic illustrations of gloves, respectively, when sign language recognition is performed on the outside and inside of a glove in accordance with a third embodiment of the present invention.

Figures 6a-b are schematic illustrations of gloves, respectively, when sign language recognition is performed on the outside and inside of a glove in accordance with a fourth embodiment of the present invention.

7a-b are structural block diagrams of a glove when sign language recognition is performed outside and inside the glove in accordance with an embodiment of the present invention.

Figures 8a-d show four schematic views of the attachment of an azimuth sensor to a glove, respectively.

detailed description

Some preferred embodiments of the invention are described below with reference to the drawings.

Figure 1 is a structural view of a hand bone. As shown in Figure 1, there are three elongate bones connected by joints on five fingers, called the phalanx 101, in which the last phalanx of the thumb is located in the palm of the hand, because of its range of motion and the metacarpal of the palm of the hand. The range of activity is not well correlated and can be considered as the last phalanx 101 of the thumb. The last section of the index finger, middle finger, ring finger, and little finger of the hand refers to the four elongated bones connected by the joint, called the metacarpal bone 102. The metacarpal bone 102 is located in the palm of the hand, and the position and angle of the palm can be known through its position. Since the four metacarpals 102 are fixed in the palm of the hand, when the sign language is used, the positions of the four metacarpals are almost constant, and they are on each axis in the three-axis (for example, front, rear, left and right, up and down) coordinate systems. Azimuth allows the position and angle of the entire palm to be calculated from the position and angle of one of the metacarpals.

As shown in FIG. 2, in characterizing the gesture in the sign language, as long as the azimuth angle α of the palm (ie, the angle with respect to the gravity line 1003, the azimuth angle α of the palm, that is, the azimuth angle of the metacarpal bone 102, can of course also pass The azimuth of the plurality of metacarpals 102 is averaged. The bending angles β2, β3 between adjacent phalanges 101 on each finger, and the bending between the last phalanx 101 and the metacarpal 102 adjacent to the metacarpal 102. The angle β1 can be determined. That is to say, when the azimuth angle α and the bending angles β2, β3, and β1 of the finger of the hand are determined, the gesture of the sign language is determined, and the meaning represented by the sign language is determined. However, the present invention finds that in the sign language, the hand is placed on the chest Do an action, do the same thing with the hand above the head, that is, the gestures made by the hands are the same, the positions are different, and sometimes the meanings are different. Here, the posture of the hand refers to various postures made when the height of the hand is not considered. In this way, the glove of the existing sign language recognition can judge the meaning of the sign language only by the gesture of the hand, and it may be wrong.

Embodiments of the present invention introduce a hand height indicator. As shown in FIG. 2, the height sensor 12 is placed on the back of the glove of the present invention for sensing the height H of the hand. Of course, the height sensor 12 can also be placed at other positions of the glove as long as the height of the glove can be measured. can. This height is a relative height, for example, relative to the height of the person's waist. By calculating the height of the hand relative to the waist, the glove of the present invention can determine the height of the hand relative to other parts of the user's body, thus enabling the user's gesture. Read more accurately. That is to say, the meaning of the gesture of one sign language is determined by the gesture of the above hand and the height H of the hand, thereby improving the accuracy of determining the meaning of the sign language. A gesture is a complex of gestures and heights of a hand that can correspond to a certain meaning in sign language.

In addition, as shown in FIG. 2, a plurality of azimuth sensors 11 are placed on the glove at positions corresponding to the phalanx and the metacarpal bone for collecting data on the azimuth angles of the phalanx and metacarpal bones to calculate the azimuth angles of the respective phalanx and metacarpal bones. Wherein, the bending angles β2 and β3 between the adjacent phalanges 101 of each finger can be obtained by the respective azimuth angles of the adjacent phalanxes, and the bending angle β1 of the last phalanx adjacent to the metacarpal bone and the metacarpal bone can be from the last The azimuth of the phalanx and the metacarpal bone is derived.

The above azimuth data generally refers to all data that can be used to calculate the azimuth of the carrier, such as carrier angular velocity, acceleration, etc., and the azimuth of the carrier can be derived. The azimuth data can be obtained by a three-axis microgyroscope, a three-axis micro-acceleration sensor and a three-axis geomagnetic sensor, wherein the three azimuth sensors can be used individually or in combination, and the specific usage is as follows:

In the first embodiment, the azimuth sensor may include only the above-described three-axis microgyroscope.

In the second embodiment, the azimuth sensor may include only the above-described three-axis micro acceleration sensor.

In a third embodiment, the azimuth angle sensor comprises: a three-axis microgyroscope and a three-axis micro-acceleration sensor for measuring angular rates in three coordinate axes and measuring accelerations in the three coordinate axes, respectively . In this way, an azimuth angle γ _a can be calculated by the angular rate, and an azimuth angle γ _b can also be calculated by the acceleration, and the final azimuth angle γ=kγa+(1-k)γb can be calculated by weighting ( Where 0≦k≦1). The premise of this is that the three-axis micro gyroscope and the three-axis micro-acceleration sensor use the same three-axis coordinate system. The triaxial micro-acceleration sensor is characterized by noise sensitivity, but since it is not affected by the previous frame results, there is no drift in results. The triaxial microgyroscope is characterized by insensitivity to noise, but as the result is affected by the previous frame, the resulting drift occurs and an initial azimuth is required. Therefore, this approach concentrates the advantages of the two methods, and achieves a beneficial effect that is neither sensitive to noise nor susceptible to the influence of the previous frame, compared to the prior art.

In the fourth embodiment, the azimuth sensor includes a three-axis geomagnetic sensor in addition to the above-described three-axis microgyroscope and three-axis micro acceleration sensor. The height sensor 12 of the present invention is an air pressure sensor, although it can of course be implemented with other height sensors. In the implementation of the air pressure sensor, it senses the external air pressure, the ground pressure of different heights is different, and the height of the hand can be calculated by the air pressure. The aforementioned height H can be calculated by subtracting the absolute height of the waist relative to the sea level from the absolute height of the hand relative to the sea level, so that the height of the hand relative to other parts of the body can be determined to determine the meaning of the gesture. In use, before the user gestures, the gloved hand is first at the waist, the absolute height of the waist is measured, and then the corresponding gesture is made. When the height value is required, the relative height of the hand is equal to the absolute height of the hand minus The absolute height of the waist is derived. In this way, the relative height of the hand making the gesture can be calculated.

The meaning of the gesture determined by the glove of the present invention can be outputted by voice through the speaker unit on the glove, or can be displayed in a word by the display on the glove. It can also be output by other devices so that deaf people can communicate with normal people.

3a-3b are schematic views of the glove 1 when the sign language recognition is performed outside the glove and the sign language recognition is performed in the glove, respectively, according to the first embodiment of the present invention. The glove 1 of the present embodiment includes 16 azimuth sensors 11a-11o, 11q and a height sensor 12. 15 azimuth sensors 11a-11o are placed on the glove corresponding to the 15 phalanx 101, wherein the azimuth sensors 11a-11o are placed at the 15 phalanx positions of the hand, and the azimuth sensor 11q is placed at the corresponding metacarpal position. The height sensor 12 is used to sense data of the height of the hand. In FIG. 3a, the control unit 13 receives the data sensed by the plurality of azimuth sensors and height sensors. As shown in FIG. 7a, the control unit 13 is coupled with a transceiver module 135. The transceiver module 135 sends the data sensed by the plurality of azimuth sensors and height sensors to the external processor 201 to determine a gesture as shown in FIG. 2. The determined gesture is converted into speech and then passed through the output unit 202 such as a speaker Output in the form of a device or display.

In FIG. 3b, an output unit 202 is coupled to the control unit 13 for converting the meaning of the gesture determined by the control unit 13 as shown in FIG. 2 into a speech or text output, the principle of which is shown in FIG. 7b. .

Although an azimuth sensor is placed on the glove corresponding to all of the phalanges as shown in Figures 3a-b, in practice, the azimuth sensor may be placed only on the glove corresponding to a portion of the phalanx. When there is only a position azimuth sensor corresponding to a specific portion of the finger bone on the glove, only the bending angle between adjacent phalanges in the specific part of the phalanx, the last phalanx and the metacarpal bone in the specific part of the phalanx is The bending angle, the height of the hand, and the azimuth of the hand determine the gesture.

In Figures 3a-3b, the azimuth sensor 11q is placed only at the position corresponding to the metacarpal bone connected to the middle finger on the glove. The azimuth sensor is placed only at a position corresponding to one of the metacarpals because the difference in azimuth between the metacarpal bones is not as pronounced as the difference between the azimuth angles of the phalanx when the human hand performs various postures, so only in the Positioning the azimuth sensor at a position corresponding to a metacarpal bone can save costs. Of course, the azimuth sensor placed on the glove corresponding to the metacarpal bone can also be placed at a position corresponding to more than one metacarpal bone. In this way, the azimuth angle of each of the at least two metacarpals can be obtained, and the average angle of the various angles is taken as the azimuth of the hand, which can make the azimuth of the hand more accurate and reduce only When the azimuth sensor is placed at a position corresponding to a metacarpal bone, the azimuth angle between the metacarpal bones actually has a slight difference in gesture recognition error. Of course, it is also possible to place azimuth sensors on the four metacarpals, such as the azimuth sensor 11p-s shown in Figures 4a-4b. Alternatively, an azimuth sensor can be placed on the glove at a position corresponding to two or three metacarpals. Preferably, the azimuth sensor is placed on the glove corresponding to the two metacarpals, as shown in the fourth embodiment of the present invention, as shown in Figures 6a-6b, which reduces the placement of the azimuth only at a position corresponding to one metacarpal. The error caused by the sensor maximizes cost savings.

Figures 5a-5b are schematic illustrations of a glove in accordance with a third embodiment of the present invention. The difference from the first embodiment is that the azimuth sensor placed on the glove corresponding to the position of the phalanx is placed only on the position of the phalanx except the position of the four-finger phalanx, except for the thumb. Index finger, middle finger, ring finger and little finger. That is, the azimuth sensors 11b-e in Figures 3a-3b are removed. The present invention finds that when the human hand makes various gestures, the index finger, the middle finger, and the nameless The degree of bending between the finger and the fingertip of the little finger and the corresponding fingertip to the second phalanx is relatively fixed, and the influence of the opponent's posture is not significant, while the other adjacent phalanx or the last phalanx and the adjacent metacarpal bone The degree of curvature varies greatly, and the posture of the hand is mainly determined by it. Therefore, the azimuth sensor that removes the fingertips of the index finger, the middle finger, the ring finger, and the little finger can also accurately determine the posture of the hand. Therefore, in this embodiment, by removing the azimuth sensor at the fingertip phalanx position of the index finger, the middle finger, the ring finger, and the little finger, the effect of saving the cost and substantially achieving the accuracy of the same determination gesture can be achieved.

7a-b are structural block diagrams of a glove when sign language recognition is performed outside and inside the glove in accordance with an embodiment of the present invention. Fig. 7a generally shows the situation of Figs. 3a, 4a, 5a, 6a, and Fig. 7b shows the situation of Figs. 3b, 4b, 5b, 6b.

There are a number of ways in which the azimuth sensor 11 can be secured to the glove. As shown in Fig. 8a, a pocket 199 is provided at the inner side of the glove for fixing the azimuth sensor 11 for accommodating the azimuth sensor 11. As shown in Figure 8b, the azimuth sensor 11 is bonded to the inner wall of the glove. As shown in Fig. 8c, a pocket 199 is provided at the outer side of the glove for fixing the azimuth sensor 11 for accommodating the azimuth sensor 11. As shown in Figure 8d, the azimuth sensor 11 is bonded to the outer wall of the glove. There are other ways to fix it.

In addition, the size of the portion of the glove 1 corresponding to each of the phalanx and the palm is matched with the size of the phalanx and palm of the man or woman, thereby forming the glove 1 suitable for the man or the woman, respectively, thereby avoiding the size of the hand of the man or the woman. The inconsistency brings about the problem that the azimuth sensor or the height sensor senses the data of the wrong position.

Although the invention is described herein with reference to the specific embodiments, the scope of the invention is not limited to the details shown. Various modifications may be made to these details without departing from the basic principles of the invention, and such modifications are intended to fall within the scope of the invention.

Claims

A glove (1) for collecting data for sign language recognition, comprising:

a plurality of azimuth sensors (11, 11a-11s) for sensing the posture of the hand placed on the glove corresponding to the phalanx and metacarpal bone of the hand;

A height sensor (12) placed on the glove for sensing data for calculating the height of the hand.
The glove (1) according to claim 1, wherein the azimuth sensor placed on the glove is used to sense azimuth data of the phalanx and metacarpal of the hand.
The glove (1) according to claim 1, characterized in that the glove (1) further comprises: a control unit (13) for collecting data of the plurality of azimuth sensors and height sensor sensing, The data is used to determine the meaning of the gesture.
The glove (1) according to claim 3, characterized in that the glove (1) further comprises an output unit for outputting the meaning of the collected gesture in the form of a voice or a text.
The glove (1) according to claim 1, characterized in that the height sensor is an air pressure sensor.
The glove (1) according to claim 1, wherein the azimuth sensor placed on the glove corresponding to the metacarpal bone of the hand is placed at a position corresponding to the two metacarpals.
The glove (1) according to claim 1, wherein the glove is provided with a pocket for fixing the azimuth sensor.
A glove (1) according to claim 1 wherein said glove is outside A bag for fixing the azimuth sensor is provided.
The glove (1) according to claim 2, wherein the glove is only at a position other than the position of the index finger, the middle finger, the ring finger, and the first finger phalanx of the little finger corresponding to the finger keel of the hand. Place the above azimuth sensor.
The glove (1) according to claim 1, wherein a size of a portion of the glove (1) corresponding to each of the phalanx and the palm is matched to a size of a phalanx or a palm of a man or a woman.