Summary of the invention
Embodiment of the present invention proposes a kind of head-mounted display apparatus, can identify user's vision situation automatically, makes the user can clearly see the displayed map picture of head mounted display.
Embodiment of the present invention has also proposed a kind of picture adjustment methods that is applied to head-mounted display apparatus, can identify user's vision situation automatically, makes the user can clearly see the displayed map picture of head mounted display.
The technical scheme of embodiment of the present invention comprises:
A kind of head-mounted display apparatus comprises vision detection module, image adjustment module and display module, wherein:
The vision detection module for the fundus imaging of taking the user, sends the image adjustment order based on captured fundus imaging state to the image adjustment module; And in the display properties dynamic adjustments process of display module, determine the optimum focusing parameter of user's fundus imaging;
The image adjustment module is used for according to described image adjustment order the display properties of display module being carried out dynamic adjustments;
Display module be used for to receive picture signal, and the display properties during based on described optimum focusing parameter presents described picture signal to this user.
Described vision detection module comprises miniature fundus photography unit and image microprocessing unit, wherein:
Miniature fundus photography unit is for the fundus imaging of taking the user;
The image microprocessing unit, whether fundus imaging that be used for to analyze this user is clear, if unintelligible then send the image adjustment order to the image adjustment module; And in the display properties dynamic adjustments process of display module, utilize the automatic focus mode to determine the optimum focusing parameter of user's fundus imaging.
Described display module comprises variable lens;
The image adjustment module is used for according to described image adjustment order the curvature of described variable lens being adjusted, and/or regulates the number of the variable lens in the display module.
Further comprise the iris identification module; This iris identification module comprises miniature imaging unit and operation processing unit;
The miniature imaging unit, the iris feature information that is used for taking the user;
Operation processing unit is used for preserving user's iris feature, and the captured iris feature information in miniature imaging unit is carried out matching operation with the client iris feature of preserving, and identifies with the identity to the user.
Display module is further used for sending vision detected image signal to the vision detection module;
The vision detection module is used for taking this vision detected image signal in the imaging on user optical fundus, and sends the image adjustment order based on the image formation state of this vision detected image signal on the user optical fundus to the image adjustment module.
The image microprocessing unit, be used for the optimum focusing parameter that basis grey scale change between the pixel of this user's of display properties dynamic adjustments process of display module fundus imaging concerns to determine user's fundus imaging, perhaps determine the optimum focusing parameter of user's fundus imaging according to the view data power spectrum of this user's fundus imaging in the display properties dynamic adjustments process that is evaluated at display module.
Operation processing unit, the display properties of display module carries out related preservation with captured client iris characteristic information when being further used for described optimum focusing parameter;
The iris identification module is further used for after identifying this user's identity, and the display properties of display module sends to the image adjustment module in the time of will be corresponding to this user's optimum focusing parameter.
A kind of picture adjustment methods that is applied to head-mounted display apparatus, this method comprises:
Take user's fundus imaging, based on captured fundus imaging state the display properties of display module is carried out dynamic adjustments, and in the display properties dynamic adjustments process of display module, determine the optimum focusing parameter of user's fundus imaging;
Receive picture signal;
The display properties of display module presents described picture signal during based on described optimum focusing parameter.
Describedly based on captured fundus imaging state the display properties of display module is carried out dynamic adjustments, and determines that in the display properties dynamic adjustments process of display module the optimum focusing parameter of user's fundus imaging comprises:
Whether the fundus imaging of analyzing this user is clear, if unintelligible then the display properties of display module is carried out dynamic adjustments; And in the display properties adjustment process of display module, utilize the automatic focus mode to determine the optimum focusing parameter of user's fundus imaging.
This method further comprises:
Take user's iris feature information;
The iris feature information of taking and the client iris feature of preserving are carried out matching operation, identify with the identity to this user, and the display properties of display module carries out related preservation with captured client iris characteristic information during with described optimum focusing parameter.
Describedly determine that in the display properties dynamic adjustments process of display module the optimum focusing parameter of user's fundus imaging comprises:
Concern to determine the optimum focusing parameter of user's fundus imaging according to grey scale change between the pixel of this user's fundus imaging in the display properties dynamic adjustments process of display module, perhaps determine the optimum focusing parameter of user's fundus imaging according to the view data power spectrum of this user's fundus imaging in the display properties dynamic adjustments process that is evaluated at display module.
Display module sends vision detected image signal in advance;
Described shooting user's fundus imaging, carry out dynamic adjustments based on captured fundus imaging state to the display properties of display module and comprise:
Take this vision detected image signal in the imaging on user optical fundus, and at the image formation state on user optical fundus the display properties of display module is carried out dynamic adjustments based on this vision detected image signal.
From technique scheme as can be seen, in embodiment of the present invention, head-mounted display apparatus comprises vision detection module, image adjustment module and display module, wherein: the vision detection module, be used for taking user's fundus imaging, send the image adjustment order based on captured fundus imaging state to the image adjustment module; And in the display properties dynamic adjustments process of display module, determine the optimum focusing parameter of user's fundus imaging; The image adjustment module is used for according to described image adjustment order the display properties of display module being carried out dynamic adjustments; Display module be used for to receive picture signal, and the display properties during based on described optimum focusing parameter presents described picture signal to this user.This shows, use after the embodiment of the present invention, can identify user's vision situation automatically, make the user can clearly see the displayed map picture of head mounted display, realized showing at the self adaptation of user's eyesight status.
And, can significantly improve convenience and the ease for use of head-mounted display apparatus, make different vision levels with using embodiment of the present invention easily per family.
In addition, embodiment of the present invention is by iris coupling identification mode storage user's systematic parameter set information, and according to the storage the systematic parameter set information carry out system initialization, and when the user initially uses, can show that situation and iris mate the storage system set information according to the rectification of user's vision situation, thereby need not to correct again user's vision situation in the follow-up use.
The specific embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, the present invention is described in further detail below in conjunction with accompanying drawing.
In embodiment of the present invention, a kind of solution of head mounted display of adaptive user vision is proposed.This scheme will realize adapting to the wear-type spectacle product of user's vision by optical fundus retinography technology and automatic focus technology regulation technology.
The present invention proposes a kind of technic relization scheme of novelty, make user's head mounted display can identify user's vision situation automatically, make the user can clearly see the displayed map picture of head mounted display.
Fig. 1 is the head-mounted display apparatus structure chart according to embodiment of the present invention.
As shown in Figure 1, this device comprises vision detection module 101, image adjustment module 102 and display module 103, wherein:
Vision detection module 101 for the fundus imaging of taking the user, sends the image adjustment order based on captured fundus imaging state to the image adjustment module; And in the display properties dynamic adjustments process of display module, determine the optimum focusing parameter of user's fundus imaging;
Image adjustment module 102 is used for according to described image adjustment order the display properties of display module being carried out dynamic adjustments;
Display module 103 be used for to receive picture signal, and the display properties during based on described optimum focusing parameter presents described picture signal to this user.
Vision detection module 101 passes through shooting user's fundus imaging detection user's vision state, and sends the image adjustment orders based on captured fundus imaging state to image adjustment module 102.
Image adjustment module 102 is by receiving the image adjustment order that user's vision detection module 101 provides, the displayed map that display properties by dynamic adjustments display module 103 provides display module 103 looks like to regulate accordingly, display module 103 looks like to be shown to the user with the displayed map through regulating, thereby makes the user can see displaying contents clearly.
Particularly, vision detection module 101 can comprise miniature fundus photography unit and image microprocessing unit.
Miniature fundus photography unit is for the fundus imaging of taking the user;
The image microprocessing unit, whether fundus imaging that be used for to analyze this user is clear, if unintelligible then send the image adjustment orders to image adjustment module 102; And in the display properties dynamic adjustments process of display module 103, utilize the automatic focus mode to determine the optimum focusing parameter of user's fundus imaging.
The realization of the passive type automatic focus technology in camera field at present is to operate with the focal adjustment of control camera by the definition of software analysis method evaluation map picture.Typical automatic focus sensor is that (Charge-Coupled Device CCD), is used to the contrast of calculating the real screen element that data are provided to charge-coupled image sensor.The wall scroll pixel band that CCD normally is made up of 100 or 200 pixels.As long as the light of scene shines this pixel band, microprocessor is namely checked the value of each pixel, and checks the strength difference between neighbor.If scene is outside focus, then neighbor has closely similar intensity.The microprocessor moving lens checks that again the pixel of CCD is increase or diminishes with the strength difference of understanding between neighbor.Then, microprocessor can be searched for the focusing parameter that has the intensity difference different time between neighbor, i.e. optimum focusing parameter.
Particularly, display module 103 at first presents vision detected image signal to the user, and this vision detected image signal of the miniature fundus photography unit photographs in the vision detection module 101 is at user's fundus imaging then.
Whether this image of image microprocessing unit real-time analysis in the vision detection module 101 is clear, if unclear to the 102 transmission image adjustment orders of image adjustment module.Driver element in the image adjustment module 102 carries out corresponding adjusting according to this image adjustment order to the display properties of display module 103, thereby realizes the displayed map image sharpness of display module 103 is carried out dynamic adjustments.
In the display properties dynamic adjustment process of display module 103, this vision detected image signal at the definition of user's fundus imaging also in dynamic adjustment.When the image microprocessing unit utilizes self-focusing principle, when searching the optimum focusing parameter (this vision detected image signal is when the definition of user's fundus imaging is the highest), image adjustment module 102 is also adjusted to the display properties of display module 103 and be suitable for the optimum state that the user watches simultaneously, thereby the wear-type that has realized the adaptive user vision shows.
Display module 103 can receive and show image display signal.Display module 103 can comprise left eye display unit and right eye display unit, corresponds respectively to user's right and left eyes.Display module 103 is left eye shows signal and right eye shows signal with the picture signal form dividing processing by appointment that receives, and respectively left eye shows signal and right eye shows signal is shown to user's right and left eyes respectively respectively by left eye display unit and right eye display unit.
In embodiment of the present invention, can be by the nuance of control left eye shows signal and right eye shows signal, the effect that the user is produced watch the 3 D stereo interface, thus realize that 3 D stereo shows.
Miniature fundus photography unit in the vision detection module 101 can be similar to a computerized optometry system, by launch a branch of specific optical signal to the human eye retina, pass cornea, crystalline lens, eyeball organs such as aqueous humor project the eyeball retina at last, again in the respective optical system of reflected back instrument, received by CCD, and optical signal is converted into the signal of telecommunication.Whether vision detection module 101 can adopt various optometry means to come the fundus imaging of analysis user clear.Optometry is to check the retrobulbar gathering situation of light incident, and it is standard with the emmetropia state, measures the different degree of being examined between eye and emmetropia of poly-scattered error.
Image microprocessing unit in the vision detection module 101 is analyzed the eye fundus image that receives on the CCD, specific analytical method is similar to the automatic focus principle in the photographic art, whether clear by the eye fundus image that the software algorithm evaluation receives, then drive the variation of optical texture of display modules 103 to carry out feedback regulation by image adjustment unit 102 as unintelligible.Distinct image has the better pictures contrast than the image that has certain fuzzy quantity, can utilize the grey scale change between each pixel to concern to come analysis image whether to reach good focusing on the algorithm.Also can estimate the power spectrum of view data, when piece image presents clearly structure and edge, its autocorrelator trace top is narrow and high, if it is image blurring, then the autocorrelator trace top is wide and low, therefore can be by seeking the most sharp-pointed state of image autocorrelator trace as the best optics configuration state of system.
Be evaluated as when fuzzy such as: the eye fundus image that receives when vision detection module 101, then can drive the display light line structure slightly microvariations takes place, again eye fundus image is estimated, and the fog-level of twice image before and after the contrast.If fog-level increases, then drive the display light line structure in the other direction and change, up to finding the optimal light line structure, and optimal light line structure relevant parameter is carried out record.
Display module 103 preferably includes variable lens;
Image adjustment module 102 is used for according to described image adjustment order the curvature of described variable lens being adjusted, and/or regulates the number of the variable lens in the display module 103.
Preferably, this device may further include the iris identification module.
This iris identification module comprises miniature imaging unit and operation processing unit;
The miniature imaging unit, the iris feature information that is used for taking the user;
Operation processing unit is used for preserving user's iris feature, and the captured iris feature information in miniature imaging unit is carried out matching operation with the client iris feature of preserving, and identifies with the identity to the user.
Iris recognition technology is a kind of human-body biological recognition technology.The outside drawing of eye is made of sclera, iris, pupil three parts.Sclera is the white portion of eyeball periphery, accounts for 30% of the gross area; Eye center is the pupil part, accounts for 5%; Iris has comprised the abundantest texture information between sclera and pupil, occupy 65%.Seeing in appearance, be made of many gland nests, gauffer, pigmented spots etc., is one of particular structure in the human body.The formation of iris is determined that by gene human body gene is expressed form, physiology, color and the total outward appearance that has determined iris.The people grows by about eight months, and iris is just grown basically and arrived sufficient size, has entered metastable period.Unless the anomalous condition of seldom seeing, health or mentally big wound just may cause outside the change on the appearance of iris, the iris pattern can keep the few of variation of many decades.On the other hand, iris is outside visible, but belongs to interior tissue again simultaneously, is positioned at facies posterior corneae.Change appearance of iris, need very fine surgical operation, and will emit VI danger.The height uniqueness of iris, stability and the characteristics that can not change are that iris can be used as the material base that identity is differentiated.In comprising all biological identification technologies of fingerprint, iris identification is that current application is the most convenient and a kind of accurately.
Iris recognition technology is widely regarded as the biological identification technology that 21st century has development prospect most, the application in multiple fields such as following security protection, national defence, ecommerce, and also Bi Ran meeting is attached most importance to iris recognition technology.This trend now begins to display in the various application of all parts of the world gradually, and market application foreground is boundless.
Iris identification foreign study mechanism mainly contains Iridian, the Iriteck of the U.S. and the companies such as Jiris of Korea S.Iridian company grasps the iris identification core algorithm, is maximum professional iris recognition technology and the product supplier in the whole world at present, it and LG, Panasonic, enterprises such as OKI, NEC cooperate (as
BM-ET300,
Deng product), provide the iris identification core algorithm with authorization, support that the affiliate produces iris authentication system.The core technology of Iridian also comprises image processing protocol and data standard
Identified server
Developing instrument and iris recognition camera are first-class.
Preferably, operation processing unit, the display properties of display module carries out related preservation with captured client iris characteristic information when being further used for described optimum focusing parameter;
The iris identification module is further used for after identifying this user's identity, and the display properties of display module sends to the image adjustment module in the time of will be corresponding to this user's optimum focusing parameter.
Fig. 2 is the head-mounted display apparatus operation chart according to embodiment of the present invention.
As shown in Figure 2, the user is with this head-mounted display apparatus, opening power, and the iris identification module is at first started working, and takes user's iris feature and carries out the matching analysis, to search the related setting information that whether has this user.
Suppose that the user uses this head-mounted display apparatus for the first time, then system will create new user's operation parameter information automatically, and begin to guide the user to carry out self adaptation vision demonstration rectification flow process.This moment, user's vision detection module was started working, miniature fundus photography unit begins to obtain in real time fundus imaging information and passes to the image microprocessing unit in real time to be analyzed, the driver module that the image microprocessing unit is coordinated in the image adjustment module carries out image adjustment in real time, when the image microprocessing unit finds optimum focusing parameter (being that image is the most clear at user's fundus imaging) by algorithm, regulating system stops, and note the state parameter of system's this moment and this user's iris feature information, store as this specific user's the parameter that arranges.At this moment, user's vision detection module and image adjustment module quit work, and display module begins normal the reception and display image signals.
The user when using this headset equipment next time, the iris identification module identifies user's iris information and accesses its exclusive system default parameter, and carry out the initializing set of system according to this parameter, begin the image information for user's clear display then, thereby need not to correct again user's vision situation in the follow-up use.
This head-mounted display apparatus can provide the equipment combined effect with multiple picture signal, realization is browsed video signal, these equipment can include, but are not limited to: functional mobile phone, smart mobile phone, palm PC, PC (PC), panel computer or PDA(Personal Digital Assistant), the high in the clouds processor, etc.
Though more than enumerated the instantiation that picture signal provides equipment in detail, those skilled in the art can recognize that these are enumerated only is purposes of illustration, and are not used in the protection domain that limits embodiment of the present invention.
Based on above-mentioned labor, embodiment of the present invention has also proposed a kind of picture adjustment methods that is applied to head-mounted display apparatus.
Fig. 3 is the picture adjustment methods flow chart that is applied to head-mounted display apparatus according to embodiment of the present invention.
As shown in Figure 3, this method comprises:
Step 301: take user's fundus imaging, based on captured fundus imaging state the display properties of display module is carried out dynamic adjustments, and in the display properties dynamic adjustments process of display module, determine the optimum focusing parameter of user's fundus imaging.
Here be to correct step at user's self adaptation vision demonstration.The user can receive vision detected image signal from display module, take this vision detected image signal then in the imaging on user optical fundus, and at the image formation state on user optical fundus the display properties of display module is carried out dynamic adjustments based on this vision detected image signal.
Here, whether the fundus imaging that can analyze this user is clear, if unintelligible then the display properties of display module is carried out dynamic adjustments.In the display properties dynamic adjustment process of display module, this vision detected image signal at the definition of user's fundus imaging also in dynamic adjustment.In the display properties adjustment process of display module, can utilize the automatic focus mode to determine the optimum focusing parameter of user's fundus imaging.
Particularly, can be according in the display properties dynamic adjustments process of display module, grey scale change concerns to determine the optimum focusing parameter of user's fundus imaging between the pixel of this user's fundus imaging, perhaps determine the optimum focusing parameter (namely this vision detected image signal is the highest at the definition of user's fundus imaging) of user's fundus imaging according to the view data power spectrum of this user's fundus imaging in the display properties dynamic adjustments process that is evaluated at display module, the display properties of display module is adjusted to and is suitable for the optimum state that the user watches at this moment, thereby the wear-type that has realized the adaptive user vision shows.
Step 302: receive picture signal.
Here, beginning is to user's normal play picture signal (such as video signal).Display module can receive picture signal from various image signal sources.
Step 303: the display properties of display module presents described picture signal during based on described optimum focusing parameter.
Display module can present picture signal based on the display properties of display module when the optimum focusing parameter after various image signal sources receive picture signals.
This method further comprises:
Take user's iris feature information;
The iris feature information of taking and the client iris feature of preserving are carried out matching operation, identify with the identity to this user, and the display properties of display module carries out related preservation with captured client iris characteristic information during with described optimum focusing parameter.
In fact, can specifically implement the head-mounted display apparatus that embodiment of the present invention proposes by various ways.
In sum, in embodiment of the present invention, head-mounted display apparatus comprises vision detection module, image adjustment module and display module, wherein: the vision detection module, be used for taking user's fundus imaging, send the image adjustment order based on captured fundus imaging state to the image adjustment module; And in the display properties dynamic adjustments process of display module, determine the optimum focusing parameter of user's fundus imaging; The image adjustment module is used for according to described image adjustment order the display properties of display module being carried out dynamic adjustments; Display module be used for to receive picture signal, and the display properties during based on described optimum focusing parameter presents described picture signal to this user.This shows, use after the embodiment of the present invention, can identify user's vision situation automatically, make the user can clearly see the displayed map picture of head mounted display, realized showing at the self adaptation of user's eyesight status.
And, can significantly improve convenience and the ease for use of head-mounted display apparatus, make the usefulness of different vision levels can use embodiment of the present invention easily per family.
In addition, embodiment of the present invention is by iris coupling identification mode storage user's systematic parameter set information, and according to the storage the systematic parameter set information carry out system initialization, and when the user initially uses, can show that situation and iris mate the storage system set information according to the rectification of user's vision situation, thereby need not to correct again user's vision situation in the follow-up use.
The above is preferred embodiment of the present invention only, is not for limiting protection scope of the present invention.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.