Vision auxiliary eyeglasses and image-recognizing method thereof
Technical field
The invention belongs to make ophthalmic patient instrument or the method and technology neck that Zhong not feel to replace direct vision
Territory, concrete for a kind of vision auxiliary eyeglasses and image-recognizing method thereof.
Background technology
It is that visual disorder refers to, due to the congenital or reason day after tomorrow, cause visual organ (eyeball optic nerve, brain
Optic centre) structure or function occur part or all of obstacle, through treatment the most to external world things cannot (or
Very difficult) make visual recognition.According to relevant regulations, vision does not reaches 0.3, or visual field person within 20 ° is
Visual disorder.Different according to obstacle degree, visual disorder can be divided into two classes: two eye vision measured values exist
More than 0.03 do not reach 0.3 or its visual field within 20 ° for amblyopia;Two eye vision measured values do not reach 0.03
For total blindness.Amblyopia crowd generally can utilize vision to carry out daily life, but has certain barrier in terms of depending on thing
Hinder, it is generally required to observe things by optical aid or special multiplying arrangement.But amblyopia itself is also
There is very big difference: existing shortage is relief, to light sensitive, it is impossible to identification color, also have the visual field
The narrowest.
Sense of vision accessory refers to visually impaired person to be helped to improve equipment or the dress of visual capacity by visual pathway
Put, be divided into again optics, non-optical, electronic viewing aid three class.Optical visual aid is relatively common, have hand-held,
Stand magnifier, spectacle, monotubular, binoculars etc..Optical visual aid has and easily uses, carries
The features such as convenience, price are low, are also that the main visual acuity aid that low visual acuity patient uses has;But it there is also
The limitation used, as amplification is low, reading range is little, and life-time service can cause posture bad, meeting
Affected by light source.Non-optical visual acuity aid, refers to improve visual effect by the environment around improving.
As: the leaflet of amplification is to change the size of reading thing, and the irradiator of high intensity is to increase contrast, high right
The differentiation etc. of local article it is beneficial to than the object of degree.Electronic viewing aid is a kind of electronic video device, can be by
The file read, picture, observation article etc. by photographic lens, image is sent on screen for
Person browses.
In summary, existing electronic viewing aid typically uses the mode of magnified image to make visually impaired person see
Clear extraneous things, although disclosure satisfy that use requirement to a certain extent, but such electronic viewing aid one
There is the shortcoming of structure complicated (needing internal or external display screen) in aspect, on the other hand, regards for some
Feel that for obstacle person, the image of amplification is still not enough so that it sees extraneous things clearly.
Summary of the invention
In view of this, it is an object of the invention to provide a kind of vision auxiliary eyeglasses and image-recognizing method thereof,
Can reality scene at Real-time Collection wearer's finger pointed location, and by image procossing by reality scene
Interior information feeds back to wearer by modes such as voices, reaches to assist the purpose of vision.
For reaching above-mentioned purpose, the present invention provides following technical scheme:
Present invention firstly provides a kind of vision auxiliary eyeglasses, including spectacle frame, the upper installation of described spectacle frame sets
There is the photographic head for wearer's pointed location is taken pictures, enter for the image that described photographic head is shot
The image processor of row image procossing and setting for processing result image being fed back to the man-machine interaction of wearer
Standby;Described photographic head and human-computer interaction device all electrically connect with described image processor, and described man-machine interaction
Equipment includes earphone or the bone conduction earphone being worn on wearer ear.
Further, described human-computer interaction device also includes the micro-vibrator being arranged on described spectacle frame.
The invention allows for the image-recognizing method of a kind of vision auxiliary eyeglasses described above, including wearer
Finger identification method and wearer's finger indication area image recognition methods;
Described wearer's finger identification method comprises the steps:
1) a wherein finger of wearer stretches out and points at the regional location needing to identify, described photographic head
Wearer's hand and indication region thereof are imaged, and by the image transmitting of shooting to described image processor;
2) described image processor identifies the images of gestures profile of the whole hand of wearer;
3) if taking on described images of gestures profile and doing and vertically do ray, the ray on each point is two
Bar, and be positioned at a ray of described images of gestures profile and be crossed to form one section with described images of gestures profile
Line segment;Gather the length data of line segment, and when the length growth of line segment or the speed of shortening are more than the valve set
During value, this images of gestures contour area is then regarded as wearer's finger position district by described image processor
Territory;
4) zoom in or out region, described wearer's finger position according to preset requirement, and by its with prestore
Wearer's finger-image skeleton pattern in described image processor contrasts;
5) if contrast identifies successfully, then the contrast frequency of failure resets, and finds out in described images of gestures profile
Finger tip position, and successful for contrast information is fed back to wearer by human-computer interaction device;If contrast
Failure, then the contrast frequency of failure adds 1, if the contrast frequency of failure is less than set point number, then repeats step 3) and
Step 4), if the contrast frequency of failure is equal to set point number, pass through human-computer interaction device by contrasting failed information
Feed back to wearer, and according to wearer's order fulfillment image recognition or repetition step 1) to step 4);
Finger fingertip pointed location region described in described wearer's finger indication area image recognition methods identification
Image information, and this image information is fed back to wearer by described human-computer interaction device.
Further, described step 2) in, use recognizer based on the degree of depth or recognizer based on gray scale
Identify the images of gestures profile of the whole hand of wearer.
The beneficial effects of the present invention is:
The vision auxiliary eyeglasses of the present invention, is imaged wearer's hand and neighboring area by photographic head,
The fingertip location then thrusted out one's fingers by wearer finger identification method identification wearer, utilizes existing figure
As identification technology carries out Treatment Analysis to the image in finger tip indication region, and the result after analyzing and processing is passed through
Earphone or bone conduction earphone feed back to wearer, allow a wearer to correct evaluator finger tip indication article, keep away
Exempted from existing electronic viewing aid such as and still used image feedback and the defect that causes user not see, i.e. this
Bright vision auxiliary eyeglasses can reality scene at Real-time Collection wearer's finger pointed location, and by figure
As processing, the information in reality scene is fed back to wearer by modes such as voices, reach to assist the mesh of vision
, it is adaptable to visual deterioration, goes down;Achromatopsia, color weakness, antimetropia, the sight impaired individuals such as presbyopia rather than complete
Blind person.
Accompanying drawing explanation
In order to make the purpose of the present invention, technical scheme and beneficial effect clearer, the present invention provides the most attached
Figure illustrates:
Fig. 1 is the structural representation of vision auxiliary eyeglasses embodiment of the present invention;
Fig. 2 is the structural representation of images of gestures profile;
Fig. 3 is that the structural representation taking a little and doing ray on images of gestures profile (is only labelled with and is positioned at gesture
Ray in image outline);
Fig. 4 is that ray is crossed to form structural representation during line segment with images of gestures profile;
Fig. 5 is the structural representation of the line segment length change of finger region;
Fig. 6 is to be carried out with the wearer's finger-image skeleton pattern prestored in region, wearer's finger position
The schematic diagram of contrast;
Fig. 7 is use state during vision auxiliary eyeglasses identification traffic lights or the stop sign information using the present embodiment
With reference to figure;
Fig. 8 is the use state reference map during vision auxiliary eyeglasses identification automobile using the present embodiment;
Use shape when Fig. 9 is to use the word on the vision auxiliary eyeglasses identification books of the present embodiment or newspaper
State is with reference to figure;
Detailed description of the invention
The invention will be further described with specific embodiment below in conjunction with the accompanying drawings, so that those skilled in the art
Member can be better understood from the present invention and can be practiced, but illustrated embodiment is not as a limitation of the invention.
As it is shown in figure 1, be the structural representation of vision auxiliary eyeglasses embodiment of the present invention.Regarding of the present embodiment
Feel auxiliary eyeglasses, including spectacle frame 1, spectacle frame 1 is installed and is provided with for clapping wearer's pointed location
According to photographic head 2, for photographic head 2 shooting image carry out image procossing image processor 3 and for
Processing result image is fed back to the human-computer interaction device 4 of wearer.Photographic head 2 and human-computer interaction device 4 are equal
Electrically connect with image processor 3, and human-computer interaction device 4 includes the earphone or the bone that are worn on wearer ear
Conduction earphone, when wearer's audition is normal, then uses earphone can meet use requirement;If wearer has
During dysaudia, then need to wear bone conduction earphone.
Further, human-computer interaction device 4 also includes the micro-vibrator being arranged on spectacle frame, can be shaken by micro-
The information of finger identification success or failure is fed back to wearer by the different vibrating modes of dynamic device.
The method that the vision auxiliary eyeglasses using the present embodiment carries out image recognition below is described in detail.
The image-recognizing method of the present embodiment vision auxiliary eyeglasses, including wearer's finger identification method and wearing
Person's finger indication area image recognition methods;
Wherein, wearer's finger identification method comprises the steps:
1) a wherein finger of wearer stretches out and points at the regional location needing to identify, photographic head 2 is right
Wearer's hand and indication region thereof image, and by the image transmitting of shooting to image processor 3;
2) image processor 3 identifies the images of gestures profile of the whole hand of wearer, as in figure 2 it is shown, existing
The method of the images of gestures profile of the whole hand of recognizable wearer having has multiple, as used based on the degree of depth
Recognizer or recognizer based on gray scale identify the images of gestures profile of the whole hand of wearer, this
Embodiment uses recognizer based on the degree of depth to identify the images of gestures profile of the whole hand of wearer;
3) if taking on images of gestures profile and doing and vertically do ray, the ray on each point is two,
And the ray being positioned at images of gestures profile is crossed to form one section of line segment, such as Fig. 3 with images of gestures profile
Shown in Fig. 4;Gather the length data of line segment, and when the length growth of line segment or the speed of shortening are more than setting
During fixed threshold values, this images of gestures contour area is then regarded as wearer's finger position by image processor
Region, as shown in Figure 5;
4) zoom in or out region, wearer's finger position according to preset requirement, and by its be pre-stored in figure
As the wearer's finger-image skeleton pattern in processor contrasts, as shown in Figure 6;
5) if contrast identifies successfully, then the contrast frequency of failure resets, and finds out the finger tip in images of gestures profile
Position, and successful for contrast information is fed back to wearer by human-computer interaction device 4;If contrast is lost
Lose, then the contrast frequency of failure adds 1, if the contrast frequency of failure is less than set point number, then repeats step 3) and step
Rapid 4), if the contrast frequency of failure is equal to set point number, information failed for contrast is anti-by human-computer interaction device
Feed wearer, and according to wearer's order fulfillment image recognition or repetition step 1) to step 4);
The set point number value of the present embodiment is 5, in use, and may at other fingers not extended out
Can there is projection, at this high spot, the length rate of change of line segment can be more than the threshold values set, now image
Processor 3 can be by images of gestures profile the band of position of this projection and wearing of being pre-stored in image processor
Person's finger-image skeleton pattern contrasts, and contrast then can be failed;By limiting the frequency of failure as 5 times, one
Aspect can avoid enter into the endless loop of circulation contrast, on the other hand can fully take into account 5 fingers and all can carry out
Fully contrast, and then realize the comprehensive contrast to gesture image outline, certainly, this set point number also can set
Being set to 6 times and more than 6 times, its principle is suitable, is not repeated.
The image letter in wearer's finger indication area image recognition methods identification finger fingertip pointed location region
Breath, and this image information is fed back to wearer by human-computer interaction device 4, wherein wearer's finger indication
Area image recognition methods can use existing multiple image-recognizing method to realize, and these recognition methodss all can
The correct information identifying finger indication article, is not repeated.
The vision auxiliary eyeglasses of the present embodiment, is imaged wearer's hand and neighboring area by photographic head,
The fingertip location then thrusted out one's fingers by wearer finger identification method identification wearer, utilizes existing figure
As identification technology carries out Treatment Analysis to the image in finger tip indication region, and the result after analyzing and processing is passed through
Earphone or bone conduction earphone feed back to wearer, allow a wearer to correct evaluator finger tip indication article, keep away
Exempted from existing electronic viewing aid such as and still used image feedback and the defect that causes user not see, i.e. this reality
Execute example vision auxiliary eyeglasses can reality scene at Real-time Collection wearer's finger pointed location, and pass through
Information in reality scene is fed back to wearer by modes such as voices by image procossing, reaches to assist vision
Purpose, it is adaptable to visual deterioration, goes down;Achromatopsia, color weakness, antimetropia, the sight impaired individuals such as presbyopia rather than
Total blindness person.
Embodiment described above is only the preferred embodiment lifted by absolutely proving the present invention, the present invention's
Protection domain is not limited to this.Equivalent that those skilled in the art are made on the basis of the present invention substitute or
Conversion, all within protection scope of the present invention.Protection scope of the present invention is as the criterion with claims.