CN103605199A - Imaging device and method - Google Patents
Imaging device and method Download PDFInfo
- Publication number
- CN103605199A CN103605199A CN201310390329.9A CN201310390329A CN103605199A CN 103605199 A CN103605199 A CN 103605199A CN 201310390329 A CN201310390329 A CN 201310390329A CN 103605199 A CN103605199 A CN 103605199A
- Authority
- CN
- China
- Prior art keywords
- eyes
- parameter
- lens module
- convergence
- line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The invention discloses an imaging device and an imaging method. The device comprises an adjustable lens module used for imaging of an object of observation of eyes; a sight line detection module used for detecting a convergence parameter of the eyes at present; a parameter generation module used for generating an imaging parameter of the adjustable lens module based on the convergence parameter, the imaging parameter including an optical axis direction parameter; and a lens adjustment module used for adjusting the adjustable lens module based on the imaging parameter. The device and the method of an embodiment of the invention changes an actual convergence point of sight lines of the eyes by automatically detecting the convergence parameter of the eyes and adjusting the optical axis direction of the adjustable lens module between the eyes and the object based on the convergence parameter, thereby enabling a user to see an object nearby clearly in a relatively comfortable manner.
Description
Technical field
The present invention relates to technical field of imaging, relate in particular to a kind of imaging device and formation method.
Background technology
The screen size of mobile device and portability are a pair of insoluble contradiction always, although that screen resolution can be accomplished is very high, due to screen size limitations, cannot show a lot of information under normal circumstances.If can allow user with more in-plant use mobile device, can show abundanter information.
Yet in daily life, for farsightedness and the normal user of diopter, be generally difficult to see clearly very in-plant object; For myopia user, often can face again a problem, exactly when not being with correcting spectacle lens, right and left eyes can be seen respectively very near object (for example mobile phone screen) clearly, but the image of right and left eyes cannot be assembled; And while putting on correcting spectacle lens, cannot see very near object clearly again (as shown in Fig. 2-3 in the Japanese patent application that publication number is JP2007219462A).Although, the imaging parameters such as focal length of existing adjustable eyeglass by change self is (as adjusted to 0 positive number even to myopia by eyeglass diopter, farsightedness is adjusted to positive number larger when seeing at a distance by eyeglass diopter), can solve the problem of seeing very near object clearly, but because eyes sight line convergence angle is excessive and cannot assemble, cause user in this case to watch with eyes, have a strong impact on user and experience.
Although recorded in the Japanese patent application that above-mentioned publication number is JP2007219462A by a prism apparatus being set on common correction of refractive errors glasses, help the convergence (seeing the example shown in Fig. 2-4 of this patented claim) of two an eye line, but its use is very inconvenient, user experiences not good.
If can detect in real time the position of eyes of user blinkpunkt, and according to the optical axis of the next adaptive adjustment eyeglass in blinkpunkt position, make the object that user watches attentively can be focused at the position that user can comfortablely watch, can address the above problem, improve user and experience.
Summary of the invention
The technical problem to be solved in the present invention is: a kind of imaging device and formation method are provided, and with when user sees close objects, auxiliary eyes sight line is assembled automatically, makes the object nearby of seeing clearly that user can be more comfortable, improves user and experiences.
For achieving the above object, first aspect, the invention provides a kind of imaging device, comprising:
Adjustable lens module, for the object of observation imaging to eyes;
Line-of-sight detection module, for detection of the convergence parameter of current eyes;
Parameter generation module, for generate the imaging parameters of described adjustable lens module according to described convergence parameter, described imaging parameters comprises optical axis direction parameter;
Lens adjustment module, for adjusting described adjustable lens module according to described imaging parameters.
In conjunction with first aspect, in the possible implementation of the second, described convergence parameter comprises the convergence angle number of degrees of eyes;
Described line-of-sight detection module comprises:
Convergence angle detecting unit, for detection of the convergence angle number of degrees of current eyes.
In conjunction with first aspect, in the third possible implementation, described convergence parameter comprises that the focusing of eye sight line is to the distance of eyes;
Described line-of-sight detection module comprises:
Focusing, apart from detecting unit, arrives the distance of eyes for detection of the focusing of current eye sight line.
In conjunction with the third possible implementation of first aspect, in the 4th kind of possible embodiment, described focusing comprises apart from detecting unit:
Image capture device, for gathering the image presenting at the bottom of eye;
Adjustable imaging device, for carrying out the adjusting of the imaging parameters of light path between described image capture device and eyes so that described image capture device obtains image the most clearly;
Image processing equipment, processes for the image that described image capture device is obtained, according to described in obtaining during picture rich in detail described in the imaging parameters of light path between image capture device and eyes, calculate the focusing of eye sight line to the distance of eyes.
In conjunction with the 4th kind of possible implementation of first aspect, in the 5th kind of possible embodiment, described adjustable imaging device comprises:
Lens unit, in the light path between eyes and described image capture device, self focal length position adjustable and/or in light path is adjustable.
In conjunction with the 4th or the 5th kind of possible implementation of first aspect, in the 6th kind of possible embodiment, described adjustable imaging device comprises:
Curved surface spectrophotometric unit, the image transfer that the ，Jiang eyeground, position of pupil presents when corresponding eyes optical axis direction is different is respectively to described image capture device.
In conjunction with any the possible implementation in the 4th to the 6th kind of first aspect, in the 7th kind of possible embodiment, described focusing also comprises apart from detecting unit:
Device for projecting, for to eyeground projected spot pattern.
In conjunction with the third possible implementation of first aspect, in the 8th kind of possible embodiment, described focusing comprises apart from detecting unit:
Eyes optical axis tracking equipment, for obtaining the optical axis direction parameter of eyes;
The degree of depth is obtained equipment, watches the depth information of scene for obtaining eyes;
Focusing is apart from computing equipment, for obtaining the focusing of eye sight line according to the optical axis direction parameter of described eyes, the imaging parameters of adjustable lens module and the depth information of scene to the distance of eyes.
In conjunction with any in second to the 8th kind of possible implementation of first aspect, first aspect, in the 9th kind of possible embodiment, described convergence parameter comprises the practical convergence angle of two an eye line;
Described line-of-sight detection module comprises:
Convergence angle acquiring unit, for obtaining the practical convergence angle of described two an eye line.
In conjunction with any in second to the 8th kind of possible implementation of first aspect, first aspect, in the tenth kind of possible embodiment, described convergence parameter comprises that the convergent point of two an eye line is to the distance of eyes;
Described line-of-sight detection module comprises:
Convergent point distance acquiring unit, for obtaining the convergent point of described two an eye line to the distance of eyes.
In conjunction with any in second to the tenth kind of possible implementation of first aspect, first aspect, in the 11 kind of possible embodiment, described lens adjustment module is adjusted the optical axis direction of described adjustable lens module for adjust the mode of the attitude of described adjustable lens module by machinery.
In conjunction with any in second to the 11 kind of possible implementation of first aspect, first aspect, in the 12 kind of possible embodiment, described lens adjustment module is for adjusting the optical axis direction of described adjustable lens module by adjusting the inside of described adjustable lens module and/or the mode of external structure.
In conjunction with any in second to the 12 kind of possible implementation of first aspect, first aspect, in the 13 kind of possible embodiment, described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens is adjustable.
In conjunction with any in second to the 13 kind of possible implementation of first aspect, first aspect, in the 14 kind of possible embodiment, described parameter generation module comprises:
Threshold decision unit, for judging whether current convergence parameter and the upper one convergence parameter constantly obtaining belong in the threshold range of same setting;
Parameter generating unit, for described current convergence parameter with on a convergence parameter constantly not in same threshold range time, generate the imaging parameters of described adjustable lens module.
In conjunction with any in second to the 14 kind of possible implementation of first aspect, first aspect, in the 15 kind of possible embodiment, the imaging parameters of described adjustable lens module also comprises the dioptric parameter of adjustable lens module.
In conjunction with the 15 kind of possible implementation of first aspect, in the 16 kind of possible implementation, described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens diopter adjustable, at least a slice lens is adjustable.
Second aspect, the present invention also provides a kind of formation method, comprising:
Line-of-sight detection step, for detection of the convergence parameter of current eyes;
Parameter generates step, and for generate the imaging parameters of adjustable lens module according to described convergence parameter, described imaging parameters comprises optical axis direction parameter; Wherein, described adjustable lens module is for the object of observation imaging to eyes;
Lens adjustment step, for adjusting described adjustable lens module according to described imaging parameters.
In conjunction with second aspect, in the possible implementation of the second, described convergence parameter comprises the convergence angle number of degrees of eyes.
In conjunction with the possible implementation of the second of second aspect, in the third possible implementation, described line-of-sight detection step comprises:
Detect the convergence angle number of degrees of current eyes.
In conjunction with second aspect, in the 4th kind of possible implementation, described convergence parameter comprises that the focusing of eye sight line is to the distance of eyes.
In conjunction with the 4th kind of possible implementation of second aspect, in the 5th kind of possible implementation, described line-of-sight detection step comprises:
Detect the focusing of current eye sight line to the distance of eyes.
In conjunction with the 5th kind of possible implementation of second aspect, in the 6th kind of possible implementation, the focusing of the current eye sight line of described detection comprises to the step of the distance of eyes:
Gather the image presenting at the bottom of eye;
Carry out the adjusting of the imaging parameters of light path between image capture position and eyes until collect image the most clearly;
The described image collecting is processed, according to described in obtaining during picture rich in detail described in the imaging parameters of light path between image capture position and eyes, calculate the focusing of eye sight line to the distance of eyes.
The 6th kind of possible implementation in conjunction with second aspect, in the 7th kind of possible implementation, described in carry out the imaging parameters of light path between image capture position and eyes adjusting comprise: regulate the focal length of the lens unit in light path between eyes and image capture position and/or the position in light path.
In conjunction with the 6th or the 7th kind of possible implementation of second aspect, in the 8th kind of possible implementation, described in carry out the imaging parameters of light path between image capture position and eyes adjusting comprise:
The image transfer that when corresponding eyes optical axis direction is different respectively, the ，Jiang eyeground, position of pupil presents is to described image capture device.
In conjunction with the 6th, the 7th or the 8th kind of possible implementation of second aspect, in the 9th kind of possible implementation, the focusing of described detection eye sight line also comprises to the step of the distance of eyes:
To eyeground projected spot pattern.
In conjunction with the 5th kind of possible implementation of second aspect, in the tenth kind of possible implementation, state the focusing that detects current eye sight line and comprise to the step of the distance of eyes:
Obtain the optical axis direction parameter of eyes;
Obtain eyes and watch the depth information of scene;
According to the optical axis direction parameter of described eyes, the imaging parameters of adjustable lens module and the depth information of described scene, obtain the focusing of eye sight line to the distance of eyes.
In conjunction with any in ten kinds of possible implementations of the second to the of second aspect, second aspect, in the 11 kind of possible implementation, described convergence parameter comprises the practical convergence angle of two an eye line.
In conjunction with the 11 kind of possible implementation of second aspect, in the 12 kind of possible implementation, described line-of-sight detection step comprises:
Obtain the practical convergence angle of described two an eye line.
In conjunction with any in ten kinds of possible implementations of the second to the of second aspect, second aspect, in the 13 kind of possible implementation, described convergence parameter comprises that the convergent point of two an eye line is to the distance of eyes.
In conjunction with the 13 kind of possible implementation of second aspect, in the 14 kind of possible implementation, described line-of-sight detection step comprises:
Obtain the convergent point of described two an eye line to the distance of eyes.
In conjunction with any in 14 kinds of possible implementations of the second to the of second aspect, second aspect, in the 15 kind of possible implementation, described lens adjustment step comprises:
The mode of adjusting the attitude of described adjustable lens module by machinery is adjusted the optical axis direction of described adjustable lens module.
In conjunction with any in 15 kinds of possible implementations of the second to the of second aspect, second aspect, in the 16 kind of possible implementation, described lens adjustment step comprises:
By adjusting the inside of described adjustable lens module and/or the mode of external structure, adjust the optical axis direction of described adjustable lens module.
In conjunction with any in 16 kinds of possible implementations of the second to the of second aspect, second aspect, in the 17 kind of possible implementation, described parameter generates step and comprises:
Judge whether current convergence parameter and the upper one convergence parameter constantly obtaining belong in the threshold range of same setting;
Described current convergence parameter with on a convergence parameter constantly not in same threshold range time, generate the imaging parameters of described adjustable lens module.
In conjunction with any in 17 kinds of possible implementations of the second to the of second aspect, second aspect, in the 18 kind of possible implementation, the imaging parameters of described adjustable lens module also comprises the dioptric parameter of adjustable lens module.
The device and method of the embodiment of the present invention is by automatically detecting the convergence parameter of eyes, and assemble according to this optical axis direction that parameter regulates adjustable lens module between eyes and object, thereby the practical convergence point that changes eye sight line, makes user just can see nearer object clearly in comparatively comfortable mode.In addition, the device and method of the application of the invention embodiment, can be so that user can more closely carry out obtaining of information on information presentation device, therefore, in the scope that information presentation device can be differentiated at eyes of user, closely time, can show abundanter information.
Accompanying drawing explanation
Fig. 1 is the structural representation block diagram of a kind of imaging device of the embodiment of the present invention;
Fig. 2 a is the imaging schematic diagram of a kind of imaging device of the embodiment of the present invention;
Fig. 2 b is another imaging schematic diagram of a kind of imaging device of the embodiment of the present invention;
Fig. 3 is the application schematic diagram of a kind of imaging device of the embodiment of the present invention;
Fig. 4 is the application schematic diagram of the another kind of imaging device of the embodiment of the present invention;
Fig. 5 a is that a kind of focusing of imaging device of the embodiment of the present invention is apart from the structured flowchart of detecting unit;
Fig. 5 b is that a kind of another kind of focusing of imaging device of the embodiment of the present invention is apart from the structured flowchart of detecting unit;
Fig. 5 c is the spot pattern schematic diagram that the focusing of a kind of imaging device of the embodiment of the present invention is used apart from detecting unit;
Fig. 5 d is the eye fundus image schematic diagram with spot pattern that the focusing of a kind of imaging device of the embodiment of the present invention photographs apart from detecting unit;
Fig. 5 e is that a kind of focusing of imaging device of the embodiment of the present invention is apart from the light path schematic diagram of detecting unit eye imaging;
Fig. 5 f is that the focusing of a kind of imaging device of the embodiment of the present invention obtains eyes focusing to the schematic diagram of the distance of eyes apart from detecting unit according to the known imaging parameters of system;
Fig. 6 is that the eyes focusing of a kind of imaging device of the embodiment of the present invention detection system of counting is applied in the schematic diagram on glasses;
Fig. 7 is that the focusing of the another kind of imaging device of the embodiment of the present invention is applied in the schematic diagram on glasses apart from detecting unit;
Fig. 8 is the structured flowchart of parameter generation module of a kind of imaging device of the embodiment of the present invention;
Fig. 9 is the process flow diagram of a kind of formation method of the embodiment of the present invention.
Embodiment
Method of the present invention and device by reference to the accompanying drawings and embodiment be described in detail as follows.
Resolution when resolution when human eye is positioned at nearby for same object is positioned at a distance than it is high, therefore for display device display surface size limited (as mobile phone), need again to show in the situation of more more rich contents, by the more close user's of display surface of display device eyes setting, the resolution of displaying contents can be increased and increase abundanter content.Yet human eye, when seeing very closer object, needs eye muscle tensioning on the one hand, make pupil to close inside eyes, this makes eyes be easy to fatigue; On the other hand, the convergence of human eye is limited in one's ability, likely cannot assemble to described very in-plant object for two.Therefore, as shown in Figure 1, the embodiment of the present invention provides a kind of imaging device 100, comprising:
Adjustable lens module 110, for the object of observation imaging to eyes;
Line-of-sight detection module 120, for detection of the convergence parameter of current eyes;
Parameter generation module 130, for generate the imaging parameters of described adjustable lens module according to described convergence parameter, described imaging parameters comprises optical axis direction parameter;
Lens adjustment module 140, for adjusting described adjustable lens module according to described imaging parameters.
In embodiments of the present invention, adjustable lens module 110 is arranged between user's eyes and the object of observation, when the optical axis direction parameter of adjustable lens module 110 changes, the direction of visual lines of eyes is through changing after described adjustable lens module 110, therefore by detecting the convergence parameter of current eyes, in the time need to adjusting the convergence of eyes, by regulating the optical axis direction parameter of described adjustable lens module 110 to help user's two an eye line to assemble, can be so that user can comparatively cosily closely watch the displaying contents of object or display device, improving user experiences.Meanwhile, further, the displaying contents on display device can comprise more abundanter information, meets user's demand.
In a kind of possible embodiment of the embodiment of the present invention, described imaging device 100 can be the devices portable, easy to use such as glasses (comprising: frame eyeglasses, contact lenses, safety goggles etc.), the eyeglass that described adjustable lens module 110 is glasses.Especially for originally just having the ametropia eyes problem that waits, need to wear as the user of correction of refractive errors glasses, device of the present invention can directly be realized on described correction of refractive errors glasses, when user's eyes are corrected, help user cosily closer object to be carried out the convergence of sight line.
Certainly, in other possible embodiment of the embodiment of the present invention, other optical device that described imaging device can also be used in conjunction with for the eyes such as: helmet eyepiece etc. and user.
As shown in Figure 2 a, for in-plant object 210, although actual sight line 240 focusings of user's eyes 220 after described adjustable lens module 231 effects are in object 210 positions, but two eye axles 250 are but assembled in position far away, so make picture 210a that user feels the object 210 seen at this compared with distant positions place.
As shown in Figure 2 b, in the present embodiment, described imaging device 230 is glasses to a kind of possible application scenarios of the imaging device 230 of the embodiment of the present invention, the eyeglass that described adjustable lens module 231 is described glasses.By Fig. 2 b, can be found out, described in the nearer object 210(the present embodiment of user's reading distance, object 210 is mobile phone) time, the optical axis of its eyes does not need described object 210 places to assemble again, but is focused at from the farther position of eyes, sees the picture 210a of object 210.Be that user does not need the inner side of the optical axis direction by the eyes adjusting of extremely requiring great effort just can complete the convergence of sight line, reduce user's sense of fatigue, improved user's experience.
In a kind of possible embodiment of the embodiment of the present invention, described convergence parameter can be:
The convergence angle number of degrees of eyes (convergence angle is the angle of two eye axles, angle b as shown in Figure 2 a);
The practical convergence angle of two an eye line (be the angle shown in Fig. 2 a a);
The focusing of eye sight line arrives the distance of eyes (as the distance of 210 to two place planes of object in Fig. 2 a; Or user, not over against the object of observation in the situation that, this distance can also be that object is to the distance of any eye); Or
The convergent point of two an eye line to the distance of eyes (as the distance of 210a to two the place plane of picture of object in Fig. 2 a; Or user, not over against the object of observation in the situation that, this distance can also be the distance that looks like any eye of object).
Described adjustable lens module 110 in the embodiment of the present invention is by changing self Structure Attitude or the position circulation way (comprising the direction of propagation) that changes light, and it can be for consisting of the adjustable lens of monolithic imaging parameters, also can form for the lens combination consisting of multi-disc lens or can also be for comprising the optical system of lens and other optical device.
In a kind of possible embodiment of the embodiment of the present invention, the attitude of described lens adjustment module can regulate, as shown in Figure 3, and in the present embodiment, the eyeglass 321 and the picture frame 322 that by a rotation axis 323, connect glasses 320, make the described eyeglass 321 can left-right rotation.Therefore the mode that, the lens adjustment module of the embodiment of the present invention (not shown in Fig. 3) is adjusted the attitude of described adjustable lens module (being eyeglass 321) by machinery is adjusted the optical axis direction of described adjustable lens module.Certainly, in other embodiment of the embodiment of the present invention, except regulating the attitude of described adjustable lens module, in order to reach better viewing effect, its distance apart from eyes 310 positions also can regulate.
In a kind of possible embodiment of the embodiment of the present invention, the inner structure of described lens adjustment module can regulate; The inner structure here comprises: variation has occurred for inner molecular structure or arrangement, and variation etc. has occurred for position or proportion between a plurality of parts that inside comprises;
Or the external structure of described lens adjustment module can regulate; The external structure here mainly refers to the shape of lens adjustment module etc.;
Or the inner structure of described lens adjustment module and external structure can regulate.
For example: in some possible embodiments of the embodiment of the present invention, described adjustable lens module 110 can comprise electronics adjustable lens, if US publication is liquid or the liquid crystal lens of announcing in the patent of US20070211207A1 and US4572616A, by the liquid in lens or liquid crystal, control, thereby change fast the imaging parameters such as shape, refractive index of lens.For the occasion on the portable wearable devices such as glasses by application of installation of the present invention, adopt the electronics adjustable lens of monolithic can, so that the volume of device is less, weight is lighter, to be easy to carry as described adjustable lens module 110; And described electronics adjustable lens is applied to the Empower electronics Focusable glasses that the mode on glasses has had coml application ，Ru Pixeloptics company to release.
In addition, for example, in some prior aries, the medium that can comprise at least two kinds of refractive index differences in the eyeglass of lens, can mutually not mix, by the interfacial shape of at least two kinds of different mediums described in changing, also can change the imaging parameters such as optical axis direction of described adjustable lens module.
Therefore, as shown in Figure 4, in a kind of possible embodiment, the eyeglass 411 of described glasses 410 is by the mode of its shape adjustment wedgewise is adjusted to its optical axis direction, and the sight line of eyes 420 is adjusted after described eyeglass 411.Or, in other embodiments, can also be by the shape adjustment of eyeglass 411 being become (but not being by mechanical adjusting) shown in Fig. 3 adjust its optical axis direction.Except two kinds of shapes shown in above-mentioned Fig. 3 and Fig. 4, described eyeglass 411 is possible the shape that the adjustable biconvex lens of optical axis direction, printing opacity flat board etc. can play refractive power effect, by regulating, can be so that its direction of visual lines to eyes plays inside convergence or to the refractive power effect of external diffusion.
Except above-mentioned electronics adjustable lens, in a kind of possible embodiment of the embodiment of the present invention, the lens combination that can also adopt multi-disc lens to form forms described adjustable lens module 110, such as by change multi-disc lens optical axis angle, the optical axis eccentric setting of a plurality of lens and the modes such as position between multi-disc lens of changing are regulated to the imaging parameters of described adjustable lens module 110, optical axis direction parameter particularly, wherein, in described multi-disc lens, can be also partly or entirely adjustable lens.For example: described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens is adjustable.
In addition, because user is when seeing near objects, also likely exist and need to compare to glasses optical systems such as crystalline lenses the adjusting of effort, the diopter that changes eye optical system just can be seen object nearby clearly, or or even arrived the limit of adjusting, but can not see the problems such as object nearby clearly, therefore preferably, also because regulating the dioptric parameter of adjustable lens module according to above-mentioned convergence parameter, so that user is except convergence sight line that can be pleasant, can also be pleasant focus on in-plant object.That is,, in a kind of possible embodiment of the embodiment of the present invention, the imaging parameters of described adjustable lens module also comprises the dioptric parameter of adjustable lens module.The dioptric parameter here also comprises the parameters such as the curvature of lens in adjustable lens module and refractive index.The adjusting of described dioptric parameter is for example also included within above, in described process of adjustable lens module being carried out to imaging parameters adjusting (, the external structure that the curvature of lens is lens, the inner structure that the refractive index of lens is lens), repeats no more herein.
In addition, when described adjustable lens module comprises multi-disc lens, can be wherein the optical axis direction of a slice lens diopter adjustable, at least a slice lens adjustable (optical axis direction and the diopter that can be also same a slice lens are here simultaneously adjustable) at least.Or, also can realize on the basis that changes adjustable lens module optical axis direction parameter, the relative position adjustment between multi-disc lens is changed to the dioptric parameter of described adjustable lens module.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described parameter generation module comprises:
Threshold decision unit, for judging that current convergence parameter and the upper one convergence parameter constantly obtaining are whether in the threshold range of same setting;
Parameter generating unit, for described current convergence parameter with on a convergence parameter constantly not in same threshold range time, generate the imaging parameters of described adjustable lens module.
For example, take that to assemble focusing that parameter is eye sight line be example to the distance of eyes, set a plurality of threshold ranges and be respectively: be less than 40mm, 40～50mm, 50～70mm, 70～100mm, 100～150mm, 150mm～200mm and be greater than 200mm.
When upper one constantly described focusing to the distance of eyes, be 55mm, focusing is 60mm to the distance of eyes described in current time, the two all, in the threshold range of 50～70mm, can not regulate the imaging parameters of described adjustable lens module; When upper one constantly described focusing to the distance of eyes, be 55mm, when described in current time, focusing is 80mm to the distance of eyes, the two regulates imaging parameters according to current convergence parameter, so that user is better experienced not in same threshold range.In the present embodiment, only when having greatly changed, convergence parameter just the imaging parameters of adjustable lens module is changed, do not need adjustable lens module to regulate too frequently on the one hand, can substantially meet on the other hand user's needs yet, improve user's experience.
Certainly, those skilled in the art can know, in a kind of possible embodiment of the embodiment of the present invention, also can assemble parameter to current each that obtain, generates corresponding imaging parameters and adjustable lens module is regulated.
In a kind of possible embodiment of the embodiment of the present invention, can pass through the imaging parameters that the look-up table table of the corresponding relation of imaging parameters (the predefined convergence parameter with) generates the adjustable lens module corresponding with described convergence parameter; Or, in other possible embodiment, also can obtain the imaging parameters corresponding with described convergence parameter by on-the-spot calculating.
In a kind of possible embodiment of the embodiment of the present invention, described line-of-sight detection module comprises: convergence angle detecting unit, and for detection of the convergence angle number of degrees of current eyes.
In a kind of possible embodiment, described convergence angle detecting unit can comprise:
Respectively with two sight tracking device that eyes are corresponding of user, for following the tracks of the optical axis direction (as the content that can record for the patent that publication number is WO2005077258A) of every eyes of active user;
Computing module, for according to the optical axis direction of described eyes, obtains the convergence angle number of degrees of described eyes.
The convergence angle number of degrees of eyes of user by the convergence angle detecting unit of the embodiment of the present invention, detected, and become corresponding imaging parameters next life according to these convergence angle number of degrees, change the practical convergence position of user's sight line, help user cosily to watch object nearby.
In a kind of possible embodiment of the embodiment of the present invention, the focusing that described convergence parameter is eye sight line is to the distance of eyes.
In this embodiment, described line-of-sight detection module comprises: focusing, apart from detecting unit, arrives the distance of eyes for detection of the focusing of current eye sight line.
In one embodiment, the optical parametric of light path between image capture device and eyes during picture rich in detail that described focusing presents according to the imaging surface that collects eyes apart from detecting unit, obtains the focusing position of described eye sight line.What in the present embodiment, described focusing can be in the focusing detection system shown in Fig. 5 a-5f, Fig. 6, Fig. 7 apart from detecting unit is a kind of.
As shown in Figure 5 a, described focusing comprises apart from detecting unit 500:
This focusing is carried out analyzing and processing apart from detecting unit 500 by the image at the bottom of eye, the optical parametric of eyes when obtaining described image capture device 510 and obtaining picture rich in detail, just can calculate the current focusing position of eyes, for further realizing the operation of eyes self-adaptation, provide basis.
Here the image that " eyeground " presents is mainly the image presenting on retina, and it can be the image on eyeground self, or can be for projecting the image of other object on eyeground.The eyes here can be human eye, can be also the eyes of other animal.
As shown in Figure 5 b, in a kind of possible embodiment of the embodiment of the present invention, described image capture device 510 is minisize pick-up head, in the possible embodiment of the another kind of the embodiment of the present invention, described image capture device 510 is use sense photoimaging device directly, as devices such as CCD or CMOS.
In a kind of possible embodiment of the embodiment of the present invention, described adjustable imaging device 520 comprises: lens unit 521, in the light path between eyes and described image capture device 510, self focal length position adjustable and/or in light path is adjustable.By this lens unit 521, make from eyes adjustable to the equivalent focal length of the light path described image capture device 510, the adjusting of scioptics unit 521, makes described image capture device 510 in some positions of lens unit 521 or obtains eyeground image the most clearly during state.In the present embodiment, the adjusting that described lens unit 521 can be real-time continuously in testing process.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described lens unit 521 is: focal length adjustable lens, and for by regulating self refractive index and/or the shape adjustment that completes self focal length.Be specially: 1) by least curvature of one side of the adjustable lens of focusing, focus, for example, in the cavity that Double-layered transparent layer forms, increase or reduce the focus curvature of adjustable lens of liquid medium; 2) by changing the refractive index of focal length adjustable lens, focus, for example in focal length adjustable lens, be filled with particular fluid crystalline medium, by the voltage of adjustable liquid crystal display medium counter electrode, adjust the arrangement mode of liquid crystal media, thereby change the refractive index of focal length adjustable lens.
In the possible embodiment of the another kind of the embodiment of the present invention, described lens unit 521 comprises: the lens combination that multi-disc lens form, and for regulating relative position between lens combination lens to complete the adjustment of lens combination self focal length.
Except above-mentioned two kinds by regulating the characteristic of lens unit 521 self to change the light path parameter of system, can also be by regulating the position of described lens unit 521 in light path to change the light path parameter of system.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, in order not affect the viewing experience of user to the object of observation, and for make system can portable application on Wearable equipment, described adjustable imaging device 520 also comprises: light-dividing device 522, be used to form between eyes and the object of observation and eyes and image capture device 510 between light bang path.Can fold light path like this, reduce the volume of system, not affect as far as possible other experience of user simultaneously.
Preferably, in the present embodiment, described light-dividing device comprises: the first spectrophotometric unit, between eyes and the object of observation, the light for viewed in transmittance object to eyes, transmits eyes to the light of image capture device.
Described the first spectrophotometric unit can be spectroscope, light splitting optical waveguide (comprising optical fiber) or other applicable light-dividing device.
In a kind of possible embodiment of the embodiment of the present invention, the image processing equipment 530 of described system comprises light path calibration module, calibrates, such as the alignment etc. of carrying out light path light axis, with the precision that guarantees to measure for the light path to system.
In a kind of possible embodiment of the embodiment of the present invention, described image processing equipment 530 comprises:
In the present embodiment, by adjustable imaging device 520, make described image capture device 510 can obtain image the most clearly, but need to find this image the most clearly by described image analysis module 531, now just can be by calculating the focusing of eye sight line to the distance of eyes according to described image the most clearly and the known light path parameter of system.。
In a kind of possible embodiment of the embodiment of the present invention, preferably, described system also comprises: grenade instrumentation 540, and for to eyeground projected spot.In a possible embodiment, can carry out by micro projector the function of this grenade instrumentation of sight line.
Here the hot spot of projection can not have specific pattern only for illuminating eyeground.
In the preferred a kind of embodiment of the embodiment of the present invention, the hot spot of described projection comprises the pattern of feature rich.The feature rich of pattern can be so that detect raising accuracy of detection.Be the exemplary plot of a spot pattern 550 as shown in Figure 5 c, this pattern can be formed by spot pattern maker, for example frosted glass; Fig. 5 d is depicted as the image on the eyeground photographing when having spot pattern 550 projection.
In order not affect normally watching of eyes, preferred, described hot spot is the sightless infrared light spot of eyes.
Now, in order to reduce the interference of other spectrum:
The exit facet of described grenade instrumentation can be provided with eyes invisible light transmission filter.
The plane of incidence of described image capture device is provided with eyes invisible light transmission filter.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image processing equipment 530 also comprises:
The characteristic self-adaptation of the image that for example described projection control module 534 can obtain according to image capture device 510 is adjusted brightness.Here the characteristic of image comprises the contrast of characteristics of image and textural characteristics etc.
Here, control a kind of special situation of projected spot brightness of described grenade instrumentation for opening or closing grenade instrumentation, for example user continues to watch attentively when some and can periodically close described grenade instrumentation; When enough become clear in user eyeground, can close light emitting source only utilizes eyeground information to detect the current sight line focusing of eyes to the distance of eyes.
In addition, described projection control module 534 can also be controlled according to surround lighting the projected spot brightness of grenade instrumentation.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described image processing equipment 530 also comprises: image calibration module 533, for carrying out the calibration of eye fundus image, obtains the benchmark image that at least one image presenting with eyeground is corresponding.
Image and described benchmark image that described image analysis module 531 obtains image capture device 530 carry out comparing calculation, image the most clearly described in acquisition.Here, described image the most clearly can be that obtain and image described benchmark image difference minimum.In the present embodiment, by existing image processing algorithm, calculate the difference of image and the benchmark image of current acquisition, for example, use the automatic focus algorithm of classical phase difference value.
In the present embodiment, the known imaging parameters of described light path comprises fixing imaging parameters and real time imagery parameter, wherein real time imagery parameter be while obtaining picture rich in detail described in the parameter information of lens unit, this parameter information can described in obtaining during picture rich in detail real time record obtain.
After obtaining the known imaging parameters of light path, just can calculate eyes focusing to the distance of eyes, be specially:
Fig. 5 e is depicted as eye imaging schematic diagram, in conjunction with the lens imaging formula in classical optical theory, by Fig. 5 e, can obtain formula (1):
D wherein
oand d
ebe respectively real image on the current object of observation 5010 of eyes and retina 5020 to the distance of eyes equivalent lens 5030, f
efor the equivalent focal length of eyes equivalent lens 5030, the optical axis direction that X is eyes (being the direction of sight line).
Fig. 5 f is depicted as according to system known optical parameter and obtains eyes focusing to the schematic diagram of the distance of eyes, in Fig. 5 f, hot spot 5040 scioptics unit 521 can become a virtual image (not shown in Fig. 5 f), suppose that this virtual image is x(intermediate quantity apart from lens distance, not shown in Fig. 5 f), in conjunction with formula (1), can obtain following system of equations:
D wherein
pfor the optical equivalence distance of hot spot 5040 to lens unit 521, d
ifor the optical equivalence distance of lens unit 521 to eyes equivalent lens 5030, f
pfor the focal length value of lens unit 521, d
ifor the distance of described eyes equivalent lens 5030 to lens unit 521, d
i+ x is that the described virtual image is to the distance between eyes equivalent lens 5030.
By (1) and (2), can draw current object of observation 5010(eyes focusing) to the distance d of eyes equivalent lens 5030
oas shown in formula (3):
Distance according to the above-mentioned object of observation calculating 5010 to eyes.
It can be the imaging device of the embodiment of the present invention that the focusing that is illustrated in figure 6 a kind of possible embodiment of the embodiment of the present invention is applied in glasses 400(the glasses 400 here apart from detecting unit 600) on embodiment, it comprises the content of the record of Fig. 5 b illustrated embodiment, be specially: as seen from Figure 6, in the present embodiment, on glasses 400 right sides (being not limited to this), the focusing of integrated present embodiment is apart from detecting unit 600, and it comprises:
Minisize pick-up head 610, its effect is identical with the image capture device of recording in Fig. 5 b embodiment, the sight line of normally watching object in order not affect user, it is arranged at the right outside side of glasses 200;
The first spectroscope 620, its effect is identical with the first spectrophotometric unit of recording in Fig. 5 b embodiment, with certain inclination angle, be arranged at the intersection point place of eyes 200 direction of gaze and camera 610 incident directions, viewed in transmittance object enters the light of eyes 200 and reflects eyes to the light of camera 610;
Focal length adjustable lens 630, its effect is identical with the focal length adjustable lens of recording in Fig. 5 b embodiment, between described the first spectroscope 620 and camera 610, carries out in real time the adjustment of focal length value, make when certain focal length value, described camera 610 can photograph eyeground image the most clearly.
In the present embodiment, described image processing equipment is not expressed in Fig. 6, and its function is identical with the image processing equipment shown in Fig. 5 b.
Due to generally, the brightness on eyeground is inadequate, therefore, is preferably thrown light in eyeground, in the present embodiment, by a light emitting source 640, is thrown light in eyeground.In order not affect user's experience, preferred light emitting source 640 be eyes invisible light here, preferably on eyes 200 impacts not quite and camera 610 again than more sensitive near infrared light light emitting source.
In the present embodiment, described light emitting source 640 is positioned at the spectacle frame outside on right side, therefore need to complete by second spectroscope 650 light that described light emitting source 640 sends to the transmission on eyeground together with described the first spectroscope 620.In present embodiment, before described the second spectroscope 650 is positioned at again the plane of incidence of camera 610, so it also needs transmission eyeground to the light of the second spectroscope 650.
Can find out, in the present embodiment, experience and improve the collection sharpness of camera 610 in order to improve user, described the first spectroscope 620 preferably can have high to infrared reflectivity, high to transmission of visible light characteristic.For example can towards a side of eyes 200, infrared reflection film be set at the first spectroscope 620 and realize above-mentioned characteristic.
As seen from Figure 6, due in the present embodiment, described focusing is positioned at the eyeglass of glasses 600 away from a side of eyes 200 apart from detecting unit 600, therefore carry out eyes optical parametric while calculating, eyeglass also can be regarded as to a part for eyes, now do not needed to know the optical characteristics of eyeglass.
In other embodiment of the embodiment of the present invention, described focusing may be positioned at the eyeglass of glasses 400 near a side of eyes 200 apart from detecting unit 600, now, need to obtain in advance the optical property parameter of eyeglass, and calculate focusing apart from time, consider the influence factor of eyeglass.
The light that light emitting source sends by the reflection of the reflection of the second spectroscope 650, the projection of focal length adjustable lens 630 and the first spectroscope 620 after again the eyeglass of transmitted through glasses 400 enter eyes of user, and finally arrive on the retina on eyeground; The light path that camera 610 forms through described the first spectroscope 620, focal length adjustable lens 630 and the second spectroscope 650 photographs the image on eyeground through the pupil of eyes 200.
Be illustrated in figure 7 the another kind of embodiment focusing of the embodiment of the present invention apart from the structural representation of detecting unit 700.As seen from Figure 7, present embodiment is similar to the embodiment shown in Fig. 6, comprise minisize pick-up head 710, the second spectroscope 720, focal length adjustable lens 730, difference is, grenade instrumentation 740 is in the present embodiment the grenade instrumentation 740 of projected spot pattern, and as curved surface spectrophotometric unit, has replaced the first spectroscope in Fig. 6 embodiment by a curved surface spectroscope 750.
The image transfer that when having adopted curved surface spectroscope 750 here corresponding eyes optical axis direction is different respectively, the position ，Jiang eyeground of pupil presents is to image capture device.Camera can photograph the imaging that eyeball all angles are mixed stack like this, but due to only have eyeground part by pupil can be on camera blur-free imaging, other parts can be out of focus and cannot blur-free imaging, thereby can not form severe jamming to the imaging of eyeground part, the feature of eyeground part still can detect.Therefore, compare with the embodiment shown in Fig. 6, present embodiment can well obtain the image on eyeground when eye gaze different directions, makes the focusing of present embodiment wider apart from the detecting unit scope of application, and accuracy of detection is higher.
In the another kind of embodiment of the embodiment of the present invention, described focusing comprises apart from detecting unit:
Eyes optical axis tracking equipment, for obtaining the optical axis direction parameter of eyes;
The degree of depth is obtained equipment, watches the depth information of scene for obtaining eyes;
Focusing is apart from computing equipment, for obtaining the focusing of eye sight line according to the optical axis direction parameter of described eyes, the imaging parameters of adjustable lens module and the depth information of scene to the distance of eyes.
In the present embodiment, by eyes optical axis tracking equipment and the degree of depth, obtaining equipment acquisition above-mentioned parameter is prior art, in present embodiment, repeats no more.According to the imaging parameters of the optical axis direction parameter of described eyes and adjustable lens module, can obtain the direction of visual lines of eyes reality.The imaging parameters of adjustable lens module described here is optical axis direction parameter, in some cases, described imaging parameters also likely comprises the dioptric parameter of described adjustable lens module, according to these parameters, by the formula of geometrical optics, those skilled in the art can derive the direction of visual lines of described eyes reality easily.According to the depth information of this actual direction of visual lines and described scene, can obtain the focusing position of eye sight line again, and and then obtain the focusing of eye sight line to the distance of eyes.
In a kind of possible embodiment of the embodiment of the present invention, described line-of-sight detection module comprises:
Convergence angle acquiring unit, for obtaining the practical convergence angle of described two an eye line.
Described convergence angle acquiring unit can obtain the convergence angle number of degrees of described eyes or the focusing of eye sight line to the distance of eyes by the line-of-sight detection module described in embodiment above, and then in conjunction with the imaging parameters of described adjustable lens module, by calculating the practical convergence angle of described two an eye line.
In a kind of possible embodiment of the embodiment of the present invention, described line-of-sight detection module comprises:
Convergent point distance acquiring unit, for obtaining the convergent point of described two an eye line to the distance of eyes.
Similarly, described convergent point distance acquiring unit can obtain the convergence angle number of degrees of described eyes or the focusing of eye sight line to the distance of eyes by the line-of-sight detection module described in embodiment above, and then in conjunction with the imaging parameters of described adjustable lens module, by calculating the convergent point of described two an eye line to the distance of eyes.
The structural representation of a kind of parameter generation module 800 that Fig. 8 provides for the embodiment of the present invention, the specific embodiment of the invention does not limit the specific implementation of parameter generation module 800.As shown in Figure 8, this parameter generation module 800 can comprise:
Processor (processor) 810, communication interface (Communications Interface) 820, storer (memory) 830 and communication bus 840.Wherein:
Particularly, program 832 can comprise program code, and described program code comprises computer-managed instruction.
Storer 830, for depositing program 832.Storer 830 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.
Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the correspondence in aforementioned means embodiment, does not repeat them here.
By embodiment recited above, the embodiment of the present invention can be comparatively cosily to from eye distance the object close to focus and assemble, improve user and experience.
As shown in Figure 9, the embodiment of the present invention also provides a kind of formation method, comprising:
S110: line-of-sight detection step, for detection of the convergence parameter of current eyes;
S120: parameter generates step, for generate the imaging parameters of adjustable lens module according to described convergence parameter, described imaging parameters comprises optical axis direction parameter; Wherein, described adjustable lens module is for the object of observation imaging to eyes;
S130: lens adjustment step, for adjust described adjustable lens module according to described imaging parameters.
In embodiments of the present invention, adjustable lens module is arranged between user's eyes and the object of observation, when the optical axis direction parameter of adjustable lens module changes, the direction of visual lines of eyes will change through after described adjustable lens module, therefore by detecting the convergence parameter of current eyes, in the time need to adjusting the convergence of eyes, by regulating the optical axis direction parameter of described adjustable lens module to help user's two an eye line to assemble, can be so that user can comparatively cosily closely watch the displaying contents of object or display device, improving user experiences.Meanwhile, further, the displaying contents on display device can comprise more abundanter information, meets user's demand.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described convergence parameter comprises following one or more:
The convergence angle number of degrees of eyes;
The focusing of eye sight line is to the distance of eyes;
The practical convergence angle of two an eye line;
The convergent point of two an eye line is to the distance of eyes.
Therefore, described step S110 is specially one or more the step in the above-mentioned parameter that obtains current eyes.The step of obtaining above-mentioned each parameter can be with reference to the functional description of each detecting unit in said apparatus embodiment.Wherein, the focusing of detection eye sight line specifically comprises to the step of the distance of eyes:
Gather the image presenting at the bottom of eye;
Carry out the adjusting of the imaging parameters of light path between image capture position and eyes until collect image the most clearly;
The described image collecting is processed, according to described in obtaining during picture rich in detail described in the imaging parameters of light path between image capture position and eyes, calculate the focusing of eye sight line to the distance of eyes.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described in carry out the imaging parameters of light path between image capture position and eyes adjusting comprise: regulate the focal length of the lens unit in light path between eyes and image capture position and/or the position in light path.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described in carry out the imaging parameters of light path between image capture position and eyes adjusting comprise:
The image transfer that when corresponding eyes optical axis direction is different respectively, the ，Jiang eyeground, position of pupil presents is to described image capture device.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, the focusing of described detection eye sight line also comprises to the step of the distance of eyes:
To eyeground projected spot pattern.
Preferably, in the possible embodiment of the another kind of the embodiment of the present invention, the focusing of the current eye sight line of described detection comprises to the step of the distance of eyes:
Obtain the optical axis direction parameter of eyes;
Obtain eyes and watch the depth information of scene;
According to the optical axis direction parameter of described eyes, the imaging parameters of adjustable lens module and the depth information of described scene, obtain the focusing of eye sight line to the distance of eyes.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described lens adjustment step comprises:
The mode of adjusting the attitude of described adjustable lens module by machinery is adjusted the optical axis direction of described adjustable lens module.
Preferably, in the possible embodiment of the another kind of the embodiment of the present invention, described lens adjustment step comprises:
By adjusting the inside of described adjustable lens module and/or the mode of external structure, adjust the optical axis direction of described adjustable lens module.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens is adjustable.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described parameter generates step and comprises:
Judge whether current convergence parameter and the upper one convergence parameter constantly obtaining belong in the threshold range of same setting;
Described current convergence parameter with on a convergence parameter constantly not in same threshold range time, generate the imaging parameters of described adjustable lens module.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, the imaging parameters of described adjustable lens module also comprises the dioptric parameter of adjustable lens module.
Preferably, in a kind of possible embodiment of the embodiment of the present invention, described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens diopter adjustable, at least a slice lens is adjustable.
The embodiment of above steps is identical with the description of the function of respective modules in said apparatus embodiment or unit, repeats no more herein.
Those of ordinary skills can recognize, unit and the method step of each example of describing in conjunction with embodiment disclosed herein, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds scope of the present invention.
If described function usings that the form of SFU software functional unit realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium.Understanding based on such, the part that technical scheme of the present invention contributes to prior art in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CDs.
Above embodiment is only for illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (34)
1. an imaging device, is characterized in that, comprising:
Adjustable lens module, for the object of observation imaging to eyes;
Line-of-sight detection module, for detection of the convergence parameter of current eyes;
Parameter generation module, for generate the imaging parameters of described adjustable lens module according to described convergence parameter, described imaging parameters comprises optical axis direction parameter;
Lens adjustment module, for adjusting described adjustable lens module according to described imaging parameters.
2. device as claimed in claim 1, is characterized in that, described convergence parameter comprises the convergence angle number of degrees of eyes;
Described line-of-sight detection module comprises:
Convergence angle detecting unit, for detection of the convergence angle number of degrees of current eyes.
3. device as claimed in claim 1, is characterized in that, described convergence parameter comprises that the focusing of eye sight line is to the distance of eyes;
Described line-of-sight detection module comprises:
Focusing, apart from detecting unit, arrives the distance of eyes for detection of the focusing of current eye sight line.
4. device as claimed in claim 3, is characterized in that, described focusing comprises apart from detecting unit:
Image capture device, for gathering the image presenting at the bottom of eye;
Adjustable imaging device, for carrying out the adjusting of the imaging parameters of light path between described image capture device and eyes so that described image capture device obtains image the most clearly;
Image processing equipment, processes for the image that described image capture device is obtained, according to described in obtaining during picture rich in detail described in the imaging parameters of light path between image capture device and eyes, calculate the focusing of eye sight line to the distance of eyes.
5. device as claimed in claim 4, is characterized in that, described adjustable imaging device comprises:
Lens unit, in the light path between eyes and described image capture device, self focal length position adjustable and/or in light path is adjustable.
6. device as claimed in claim 4, is characterized in that, described adjustable imaging device comprises:
Curved surface spectrophotometric unit, the image transfer that the ，Jiang eyeground, position of pupil presents when corresponding eyes optical axis direction is different is respectively to described image capture device.
7. device as claimed in claim 4, is characterized in that, described focusing also comprises apart from detecting unit:
Device for projecting, for to eyeground projected spot pattern.
8. device as claimed in claim 3, is characterized in that, described focusing comprises apart from detecting unit:
Eyes optical axis tracking equipment, for obtaining the optical axis direction parameter of eyes;
The degree of depth is obtained equipment, watches the depth information of scene for obtaining eyes;
Focusing is apart from computing equipment, for obtaining the focusing of eye sight line according to the optical axis direction parameter of described eyes, the imaging parameters of adjustable lens module and the depth information of scene to the distance of eyes.
9. the device as described in any one in claim 1 to 8, is characterized in that, described convergence parameter comprises the practical convergence angle of two an eye line;
Described line-of-sight detection module comprises:
Convergence angle acquiring unit, for obtaining the practical convergence angle of described two an eye line.
10. the device as described in any one in claim 1 to 8, is characterized in that, described convergence parameter comprises that the convergent point of two an eye line is to the distance of eyes;
Described line-of-sight detection module comprises:
Convergent point distance acquiring unit, for obtaining the convergent point of described two an eye line to the distance of eyes.
11. devices as claimed in claim 1, is characterized in that, described lens adjustment module is adjusted the optical axis direction of described adjustable lens module for adjust the mode of the attitude of described adjustable lens module by machinery.
12. devices as claimed in claim 1, is characterized in that, described lens adjustment module is for adjusting the optical axis direction of described adjustable lens module by adjusting the inside of described adjustable lens module and/or the mode of external structure.
13. devices as claimed in claim 1, is characterized in that, described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens is adjustable.
14. devices as described in any one in claim 1 to 13, is characterized in that, described parameter generation module comprises:
Threshold decision unit, for judging whether current convergence parameter and the upper one convergence parameter constantly obtaining belong in the threshold range of same setting;
Parameter generating unit, for described current convergence parameter with on a convergence parameter constantly not in same threshold range time, generate the imaging parameters of described adjustable lens module.
15. devices as described in claim 1 or 14, is characterized in that, the imaging parameters of described adjustable lens module also comprises the dioptric parameter of adjustable lens module.
16. devices as claimed in claim 15, is characterized in that, described adjustable lens module comprises multi-disc lens, and wherein at least the optical axis direction of a slice lens diopter adjustable, at least a slice lens is adjustable.
17. 1 kinds of formation methods, is characterized in that, comprising:
Line-of-sight detection step, for detection of the convergence parameter of current eyes;
Parameter generates step, and for generate the imaging parameters of adjustable lens module according to described convergence parameter, described imaging parameters comprises optical axis direction parameter; Wherein, described adjustable lens module is for the object of observation imaging to eyes;
Lens adjustment step, for adjusting described adjustable lens module according to described imaging parameters.
18. methods as claimed in claim 17, is characterized in that, described convergence parameter comprises the convergence angle number of degrees of eyes.
19. methods as claimed in claim 18, is characterized in that, described line-of-sight detection step comprises:
Detect the convergence angle number of degrees of current eyes.
20. methods as claimed in claim 17, is characterized in that, described convergence parameter comprises that the focusing of eye sight line is to the distance of eyes.
21. methods as claimed in claim 20, is characterized in that, described line-of-sight detection step comprises:
Detect the focusing of current eye sight line to the distance of eyes.
22. methods as claimed in claim 21, is characterized in that, the focusing of the current eye sight line of described detection comprises to the step of the distance of eyes:
Gather the image presenting at the bottom of eye;
Carry out the adjusting of the imaging parameters of light path between image capture position and eyes until collect image the most clearly;
The described image collecting is processed, according to described in obtaining during picture rich in detail described in the imaging parameters of light path between image capture position and eyes, calculate the focusing of eye sight line to the distance of eyes.
23. methods as claimed in claim 22, it is characterized in that, described in carry out the imaging parameters of light path between image capture position and eyes adjusting comprise: regulate the focal length of the lens unit in light path between eyes and image capture position and/or the position in light path.
24. methods as claimed in claim 22, is characterized in that, described method also comprises:
The image transfer that when corresponding eyes optical axis direction is different respectively, the ，Jiang eyeground, position of pupil presents is to described image capture device.
25. methods as claimed in claim 22, is characterized in that, the focusing of described detection eye sight line also comprises to the step of the distance of eyes:
To eyeground projected spot pattern.
26. methods as claimed in claim 21, is characterized in that, the focusing of the current eye sight line of described detection comprises to the step of the distance of eyes:
Obtain the optical axis direction parameter of eyes;
Obtain eyes and watch the depth information of scene;
According to the optical axis direction parameter of described eyes, the imaging parameters of adjustable lens module and the depth information of described scene, obtain the focusing of eye sight line to the distance of eyes.
27. methods as described in any one in claim 17 to 26, is characterized in that, described convergence parameter comprises the practical convergence angle of two an eye line.
28. methods as claimed in claim 27, is characterized in that, described line-of-sight detection step comprises:
Obtain the practical convergence angle of described two an eye line.
29. methods as described in any one in claim 17 to 26, is characterized in that, described convergence parameter comprises that the convergent point of two an eye line is to the distance of eyes.
30. methods as claimed in claim 29, is characterized in that, described line-of-sight detection step comprises:
Obtain the convergent point of described two an eye line to the distance of eyes.
31. methods as claimed in claim 17, is characterized in that, described lens adjustment step comprises:
The mode of adjusting the attitude of described adjustable lens module by machinery is adjusted the optical axis direction of described adjustable lens module.
32. methods as claimed in claim 17, is characterized in that, described lens adjustment step comprises:
By adjusting the inside of described adjustable lens module and/or the mode of external structure, adjust the optical axis direction of described adjustable lens module.
33. methods as described in any one in claims 1 to 32, is characterized in that, described parameter generates step and comprises:
Judge whether current convergence parameter and the upper one convergence parameter constantly obtaining belong in the threshold range of same setting;
Described current convergence parameter with on a convergence parameter constantly not in same threshold range time, generate the imaging parameters of described adjustable lens module.
34. the method for claim 1, is characterized in that, the imaging parameters of described adjustable lens module also comprises the dioptric parameter of adjustable lens module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310390329.9A CN103605199B (en) | 2013-08-30 | 2013-08-30 | Imaging device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310390329.9A CN103605199B (en) | 2013-08-30 | 2013-08-30 | Imaging device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103605199A true CN103605199A (en) | 2014-02-26 |
| CN103605199B CN103605199B (en) | 2016-09-28 |
Family
ID=50123439
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310390329.9A Active CN103605199B (en) | 2013-08-30 | 2013-08-30 | Imaging device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103605199B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156069A (en) * | 2014-08-15 | 2014-11-19 | 北京智谷睿拓技术服务有限公司 | Object picking method and device and user equipment |
| CN105072436A (en) * | 2015-08-28 | 2015-11-18 | 胡东海 | Automatic adjustment method and adjustment device of virtual reality and augmented reality imaging depth-of-field |
| CN105607380A (en) * | 2016-03-29 | 2016-05-25 | 京东方科技集团股份有限公司 | Liquid crystal lens, display device and driving method thereof |
| WO2017181590A1 (en) * | 2016-04-19 | 2017-10-26 | 京东方科技集团股份有限公司 | Display device and display method |
| CN107526165A (en) * | 2016-06-15 | 2017-12-29 | 威亚视觉科技股份有限公司 | Head-mounted personal multimedia system, visual auxiliary device and related glasses |
| CN108399903A (en) * | 2018-03-27 | 2018-08-14 | 京东方科技集团股份有限公司 | A kind of adjusting method and device, head-up display system of image space |
| WO2023125088A1 (en) * | 2021-12-30 | 2023-07-06 | 比亚迪股份有限公司 | Display apparatus, vehicle, and control method for vehicle |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1084728A (en) * | 1992-06-02 | 1994-04-06 | 佳能株式会社 | Optical devices with line-of-sight detection device |
| JPH09218376A (en) * | 1996-02-09 | 1997-08-19 | Sharp Corp | Stereoscopic display device |
| US20070014552A1 (en) * | 2004-02-17 | 2007-01-18 | Yoshinobu Ebisawa | Eyeshot detection device using distance image sensor |
| JP2007219462A (en) * | 2006-02-20 | 2007-08-30 | Tomohiro Tega | Ready-made reading glasses |
| CN101589327A (en) * | 2007-09-26 | 2009-11-25 | 松下电器产业株式会社 | Beam scan type display device, its display method, program, and integrated circuit |
| CN101641963A (en) * | 2007-03-12 | 2010-02-03 | 佳能株式会社 | Head mounted image-sensing display device and composite image generating apparatus |
| US20100134495A1 (en) * | 2008-11-28 | 2010-06-03 | Canon Kabushiki Kaisha | Mixed reality presentation system and brightness adjustment method of virtual light source |
| WO2011136137A1 (en) * | 2010-04-28 | 2011-11-03 | 富士フイルム株式会社 | Stereoscopic image pickup device and control method therefor |
| JP2012085106A (en) * | 2010-10-12 | 2012-04-26 | Sony Corp | Image processing apparatus, image processing method, and program |
| CN203012240U (en) * | 2011-10-07 | 2013-06-19 | 精工爱普生株式会社 | Virtual image display device |
-
2013
- 2013-08-30 CN CN201310390329.9A patent/CN103605199B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1084728A (en) * | 1992-06-02 | 1994-04-06 | 佳能株式会社 | Optical devices with line-of-sight detection device |
| US5579079A (en) * | 1992-06-02 | 1996-11-26 | Canon Kabushiki Kaisha | Optical apparatus equipped with sight line detector |
| JPH09218376A (en) * | 1996-02-09 | 1997-08-19 | Sharp Corp | Stereoscopic display device |
| US20070014552A1 (en) * | 2004-02-17 | 2007-01-18 | Yoshinobu Ebisawa | Eyeshot detection device using distance image sensor |
| JP2007219462A (en) * | 2006-02-20 | 2007-08-30 | Tomohiro Tega | Ready-made reading glasses |
| CN101641963A (en) * | 2007-03-12 | 2010-02-03 | 佳能株式会社 | Head mounted image-sensing display device and composite image generating apparatus |
| CN101589327A (en) * | 2007-09-26 | 2009-11-25 | 松下电器产业株式会社 | Beam scan type display device, its display method, program, and integrated circuit |
| US20100134495A1 (en) * | 2008-11-28 | 2010-06-03 | Canon Kabushiki Kaisha | Mixed reality presentation system and brightness adjustment method of virtual light source |
| WO2011136137A1 (en) * | 2010-04-28 | 2011-11-03 | 富士フイルム株式会社 | Stereoscopic image pickup device and control method therefor |
| JP2012085106A (en) * | 2010-10-12 | 2012-04-26 | Sony Corp | Image processing apparatus, image processing method, and program |
| CN203012240U (en) * | 2011-10-07 | 2013-06-19 | 精工爱普生株式会社 | Virtual image display device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156069A (en) * | 2014-08-15 | 2014-11-19 | 北京智谷睿拓技术服务有限公司 | Object picking method and device and user equipment |
| CN104156069B (en) * | 2014-08-15 | 2017-04-12 | 北京智谷睿拓技术服务有限公司 | Object picking method and device and user equipment |
| CN105072436A (en) * | 2015-08-28 | 2015-11-18 | 胡东海 | Automatic adjustment method and adjustment device of virtual reality and augmented reality imaging depth-of-field |
| CN105607380A (en) * | 2016-03-29 | 2016-05-25 | 京东方科技集团股份有限公司 | Liquid crystal lens, display device and driving method thereof |
| WO2017181590A1 (en) * | 2016-04-19 | 2017-10-26 | 京东方科技集团股份有限公司 | Display device and display method |
| US10690990B2 (en) | 2016-04-19 | 2020-06-23 | Boe Technology Group Co., Ltd. | Display device and display method |
| CN107526165A (en) * | 2016-06-15 | 2017-12-29 | 威亚视觉科技股份有限公司 | Head-mounted personal multimedia system, visual auxiliary device and related glasses |
| CN107526165B (en) * | 2016-06-15 | 2022-08-26 | 威亚视觉科技股份有限公司 | Head-mounted personal multimedia system, visual auxiliary device and related glasses |
| CN108399903A (en) * | 2018-03-27 | 2018-08-14 | 京东方科技集团股份有限公司 | A kind of adjusting method and device, head-up display system of image space |
| WO2023125088A1 (en) * | 2021-12-30 | 2023-07-06 | 比亚迪股份有限公司 | Display apparatus, vehicle, and control method for vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103605199B (en) | 2016-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103424891B (en) | Imaging device and method | |
| CN103431840B (en) | Eye optical parameter detecting system and method | |
| CN103439801B (en) | Sight protectio imaging device and method | |
| CN103499885B (en) | Imaging device and method | |
| CN103499886B (en) | Imaging device and method | |
| CN103605208A (en) | Content projection system and method | |
| CN103500331B (en) | Based reminding method and device | |
| US10194793B2 (en) | Imaging for local scaling | |
| US11474358B2 (en) | Systems and methods for retinal imaging and tracking | |
| CN103605199A (en) | Imaging device and method | |
| CN103353663B (en) | Imaging adjusting apparatus and method | |
| CN106030382B (en) | Method for optimizing an optical lens apparatus of a wearer | |
| CN103604412B (en) | Localization method and locating device | |
| US20160148049A1 (en) | Image collection with increased accuracy | |
| CN103558909A (en) | Interactive projection display method and interactive projection display system | |
| KR101300671B1 (en) | Method for measuring parameter for manufacturing spectacle lens, and device for implementing the same | |
| CN103630116B (en) | Image acquisition localization method and image acquisition locating device | |
| CN103475893A (en) | Device and method for picking object in three-dimensional display | |
| CN103530623B (en) | Information observational technique and information observation device | |
| JP6332392B2 (en) | Spectacle lens design method, spectacle lens manufacturing method, spectacle lens selection device, and spectacle lens selection method | |
| US20190004281A1 (en) | Head mounted display device | |
| US20230057524A1 (en) | Eyeglass devices and related methods | |
| JP2011048327A (en) | Method for selection of spectacle lens and system for selection of spectacle lens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |