CN101430603A

CN101430603A - Portable and practical gesture language recognition and sounding apparatus

Info

Publication number: CN101430603A
Application number: CNA2008102290412A
Authority: CN
Inventors: 王斐; 闻时光; 谢志勇; 吴洁; 何兴
Original assignee: Northeastern University China
Current assignee: Northeastern University China
Priority date: 2008-11-26
Filing date: 2008-11-26
Publication date: 2009-05-13

Abstract

The invention relates to a portable utility-typed sign language recognition vocal device which comprises three parts of a finger bending acquisition glove, a single chip and a voice circuit. The finger bending acquisition glove sends voltage signals which are generated by the finger bending degree according to the action of fingers and voltage signals which are generated by the acceleration of the hand movement to a simulation input port of the single chip. The simulation and the digital conversion are carried out on the voltage signals generated from the finger bending degree and the voltage signals generated from the acceleration of the hand movement by the single chip. The data processing is carried out on digital signals obtained by the conversion to give the kind information of the current sign language. Thus, the voice circuit is driven to vocalize. The portable utility-typed sign language recognition vocal device is beneficial for improving the living, studying and working conditions of deaf-mute disabled, so that normal people can provide better services for the disabled, and the deaf-mute disabled, especially deaf-mute people with low education level can communicate with normal people by sign language.

Description

A kind of portable and practical gesture language recognition and sounding apparatus

Technical field

The invention belongs to the Robotics field, particularly relate to a kind of portable and practical gesture language recognition and sounding apparatus.

Background technology

Sign language is the language that the deaf disability people uses.It is to be aided with the more stable expression system of expressing one's feelings posture and constituting by the action of hand shape, is a kind of by the special language that moves and vision is communicated.Yet sign language is a huge and complicated language system, and it obviously is unpractical allowing most of normal persons grasp and using direct the interchange with the deaf disability people of sign language.Communication between deaf-mute and the normal person at present only only limits to do means such as translation with the normal person who understands sign language, limited the normal person that is ignorant of sign language understanding to a great extent, brought great inconvenience for the daily life of deaf disability people, working and learning the deaf disability people.

The present invention will help to improve deaf disability people's life study and work condition, make the normal person provide better service for them, also can make and especially make the deaf-mute and the deaf-mute that schooling is lower use sign language to exchange with the normal person.

Summary of the invention

In order to help to exchange better between deaf-mute and the normal person, the invention provides a kind of portable and practical gesture language recognition and sounding apparatus.

This device is gathered gloves, single-chip microcomputer by the finger flexibility, and sound circuit three parts are formed, and wherein points flexibility and gathers the analog input port that the voltage signal of gloves connects single-chip microcomputer, and the SPI interface of sound circuit connects the SPI interface of single-chip microcomputer.

The finger flexibility is gathered gloves and is comprised gloves, first ring, second ring, tinsel, slide rheostat, spring, noose and acceleration transducer, wherein fixing first near the finger tip in each of gloves above the finger encircles, fix second ring near finger root, one one metal wire connects first ring, second ring, slide rheostat slip terminal and spring successively, slide rheostat is fixed on the gloves, tinsel outer wrapping noose, noose is fixed on first ring and the second ring place, on the back of the hand of gloves acceleration transducer is installed.

Sound circuit adopts the sound chip circuit can store the sound bite that multistage records in advance.

Single-chip microcomputer carries out the analog to digital conversion to the analog voltage signal of each finger of collecting, obtain the crooked information of digitized finger, and by simulation to analog acceleration signal, be converted to chirokinesthetic digitizing acceleration information carrying out analog to digital, single-chip microcomputer carries out record to each finger flexibility Information Monitoring and acceleration change information, corresponding informance with the collection of pre-defined finger flexibility compares then, find out and the current finger flexibility acquired signal predefined gesture kind the most close, drive pronunciation circuit then and provide corresponding voice signal with acceleration signal.The control method of single-chip microcomputer is carried out A, initialization sound circuit and analog-digital converter as follows; B, gather the voltage signal that produces by the degree of crook of thumb, forefinger, middle finger, the third finger, little finger of toe respectively; The voltage signal that C, the chirokinesthetic acceleration of collection produce; D, the voltage signal that thumb, forefinger, middle finger, the third finger, little finger of toe are produced, the voltage signal that chirokinesthetic acceleration produces are made difference with predefined hand signal respectively and are asked quadratic sum to compare difference then; E, find out and a predefined hand signal of the value minimum of the quadratic sum that voltage signal that the voltage signal that thumb, forefinger, middle finger, the third finger, little finger of toe produce, chirokinesthetic acceleration produce differs; F, driving sound circuit provide the sound that meets the gesture kind.

Principle of work of the present invention is when the deaf-mute is with gloves to do the sign language gesture, finger is in case of bending, and fix at first ring place owing to tinsel this moment, tinsel can move freely in the noose that is fixed in the finger joint, middle part and the second ring place simultaneously, so the time first the ring and second the ring between tinsel be elongated, this moment, spring was in elongation state, as long as finger is in case of bending, tinsel length between first ring and second ring just can not return to state of nature, and be elongated owing to tinsel this moment, the slip terminal of slide rheostat also slides along the direction of tinsel elongation simultaneously, changed the resistance of slide rheostat, thereby variation has also appearred in the voltage between the slip terminal of slide rheostat and slide rheostat one end, again with this voltage signal input single-chip microcomputer, single-chip microcomputer carries out the analog to digital conversion to the analog voltage signal of each finger of collecting, obtain the crooked information of digitized finger, and be converted to chirokinesthetic digitizing acceleration information by analog to digital to the simulating signal of acceleration transducer output, single-chip microcomputer carries out record to the information and the acceleration change information of each finger flexibility collection, corresponding informance with predefined gesture compares then, find out the pre-defined finger flexibility collection the most close, drive sound circuit then and provide corresponding voice signal with the collection of current finger flexibility.

Description of drawings

Fig. 1 points synoptic diagram in the raw;

Fig. 2 is that finger is in the case of bending synoptic diagram;

Fig. 3 is the synoptic diagram that the finger flexibility is gathered gloves and acceleration transducer;

Fig. 4 is the single chip circuit schematic diagram;

Fig. 5 is that the finger flexibility is gathered the gloves circuit diagram;

Fig. 6 is sound circuit figure.

Among Fig. 1: 1 first ring, 2 second rings, 3 tinsels, 4 slide rheostat slip terminals, 5 slide rheostats, 6 nooses, 7 springs;

Among Fig. 3: 8 acceleration transducers, 9 gloves.

Embodiment

This device is gathered gloves, single-chip microcomputer C8051F026 by the finger flexibility, sound circuit ISD4004 three parts are formed, wherein point flexibility and gather the analog input port that the voltage signal of gloves connects single-chip microcomputer, the SPI interface of sound circuit connects the SPI interface of single-chip microcomputer.

The finger flexibility is gathered gloves such as Fig. 1, Fig. 2 and shown in Figure 3ly gather gloves in the finger flexibility and comprise gloves 9, first ring 1, second ring 2, tinsel 3, slide rheostat 5, spring 7, noose 6 and acceleration transducer 8, wherein fix first near the finger tip above the finger and encircle 1 in each of gloves 9, fix second ring 2 near finger root, one one metal wire connects first ring 1 successively, second ring 2, slide rheostat slip terminal 4 and spring 7, slide rheostat 5 is fixed on the gloves 9, tinsel 3 outer wrapping nooses 6, noose 6 is fixed on first ring, 1 and second ring, 2 places, and acceleration transducer 8 is installed on the back of the hand of gloves 9.The model of acceleration transducer 8 is MMA7260QT.

Single chip circuit is gathered being connected as Fig. 4 of gloves circuit with the finger flexibility, finger flexibility shown in Figure 5 is gathered the THUMB interface of gloves circuit and the THUMB interface of single chip circuit links to each other, the finger flexibility gathers the FOREFINGER interface of gloves circuit and the FOREFINGER interface of single chip circuit links to each other, the finger flexibility gathers the MIDDLEFINGER interface of gloves circuit and the MIDDLEFINGER interface of single chip circuit links to each other, the finger flexibility gathers the RINGFINGER interface of gloves circuit and the RINGFINGER interface of single chip circuit links to each other, the finger flexibility gathers the LITTLEFINGER interface of gloves circuit and the LITTLEFINGER interface of single chip circuit links to each other, the finger flexibility gathers the ACCERLATE_X interface of gloves circuit and the ACCERLATE_X interface of single chip circuit links to each other, the finger flexibility gathers the ACCERLATE_Y interface of gloves circuit and the ACCERLATE_Y interface of single chip circuit links to each other, and the finger flexibility gathers the ACCERLATE_Z interface of gloves circuit and the ACCERLATE_Z interface of single chip circuit links to each other

Being connected as the SPI_SCK interface of Fig. 4, single chip circuit shown in Figure 6 and the SCLK interface of sound circuit of single chip circuit and sound circuit links to each other, the MISO interface of single chip circuit and the MISO interface of sound circuit link to each other, the MOSI interface of single chip circuit and the MOSI interface of sound circuit link to each other, and the NSS interface of single chip circuit and the CS interface of sound circuit link to each other.20 pin of single chip circuit chips U2 are connected to the INT port of sound circuit.

Program circuit is as follows:

1, initialization ISD4004 sound circuit;

2, initialization analog-digital converter;

3, gather the voltage signal of thumb flexibility;

4, gather the voltage signal of forefinger flexibility;

5, gather the voltage signal of middle finger flexibility;

6, gather the voltage signal of nameless flexibility;

7, gather the voltage signal of streblomicrodactyly degree;

8, gather the voltage signal of chirokinesthetic acceleration;

9, the voltage signal of thumb, forefinger, middle finger, the third finger, the voltage signal of little finger of toe generation, the generation of chirokinesthetic acceleration being made difference with predefined hand signal respectively asks quadratic sum to compare difference then;

10, find out and a predefined hand signal of the value minimum of the quadratic sum that voltage signal that the voltage signal that thumb, forefinger, middle finger, the third finger, little finger of toe produce, chirokinesthetic acceleration produce differs;

11, drive sound circuit, provide the sound that meets the gesture kind;

12, change step 3.

Claims

1, a kind of portable and practical gesture language recognition and sounding apparatus, comprise sound circuit, single-chip microcomputer and finger flexibility are gathered gloves, it is characterized in that: the finger flexibility is gathered gloves will be sent to the analog input port of single-chip microcomputer by the voltage signal that the voltage signal of pointing the degree of crook generation and chirokinesthetic acceleration produce according to the action of pointing, the voltage signal that single-chip microcomputer will be produced by the voltage signal and the chirokinesthetic acceleration of finger degree of crook generation carries out the conversion of simulating signal to digital signal, the digital signal that is converted to is carried out data processing, provide current sign language kind of information, and then the driving sound circuit carries out sounding.

2, a kind of portable and practical gesture language recognition and sounding apparatus according to claim 1, it is characterized in that pointing flexibility collection gloves and comprise gloves, first ring, second ring, tinsel, slide rheostat, spring, noose and acceleration transducer, wherein fixing first near the finger tip in each of gloves above the finger encircles, fix second ring near finger root, one one metal wire connects first ring successively, second ring, slide rheostat slip terminal and spring, slide rheostat is fixed on the gloves, tinsel outer wrapping noose, noose is fixed on first ring and the second ring place, on the back of the hand of gloves acceleration transducer is installed.

3, the control method of the described portable and practical gesture language recognition and sounding apparatus of claim 1 is characterized in that: carry out A, initialization sound circuit and analog-digital converter as follows; B, gather the voltage signal that produces by the degree of crook of thumb, forefinger, middle finger, the third finger, little finger of toe respectively; The voltage signal that C, the chirokinesthetic acceleration of collection produce; D, the voltage signal that thumb, forefinger, middle finger, the third finger, little finger of toe are produced, the voltage signal that chirokinesthetic acceleration produces are made difference with predefined hand signal respectively and are asked quadratic sum to compare difference then; E, find out and a predefined hand signal of the value minimum of the quadratic sum that voltage signal that the voltage signal that thumb, forefinger, middle finger, the third finger, little finger of toe produce, chirokinesthetic acceleration produce differs; F, driving sound circuit provide the sound that meets the gesture kind.