CN106445167A - Monocular vision field self-adaptive adjustment method and device and wearable visual device - Google Patents

Monocular vision field self-adaptive adjustment method and device and wearable visual device Download PDF

Info

Publication number
CN106445167A
CN106445167A CN201610915186.2A CN201610915186A CN106445167A CN 106445167 A CN106445167 A CN 106445167A CN 201610915186 A CN201610915186 A CN 201610915186A CN 106445167 A CN106445167 A CN 106445167A
Authority
CN
China
Prior art keywords
distance
interpupillary distance
eye
measurement data
focal length
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610915186.2A
Other languages
Chinese (zh)
Other versions
CN106445167B (en
Inventor
袁冬生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN201610915186.2A priority Critical patent/CN106445167B/en
Publication of CN106445167A publication Critical patent/CN106445167A/en
Application granted granted Critical
Publication of CN106445167B publication Critical patent/CN106445167B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The invention discloses a monocular vision field self-adaptive adjustment method and device and a wearable visual device. The method includes the steps that the pupil distance of a to-be-detected user is obtained by an eye tracking device additionally arranged in the wearable visual device, wherein the eye tracking device can move in a telescopic mode in a preset moving area; according to the pupil distance, an optical element, corresponding to the pupil distance, in the wearable visual device and/or a display image of a display screen are subjected to self-adaptive adjustment. The technical problem that in the prior art, the pupil distance of a user using a wearable visual device cannot be matched with the wearable visual device easily is solved.

Description

The adaptive auxiliary tone adjusting method of simple eye visual field and device, wear-type visual device
Technical field
The present invention relates to computer realm, in particular to a kind of adaptive auxiliary tone adjusting method of simple eye visual field and device, head Wear formula visual device.
Background technology
With developing rapidly for virtual reality technology (VR), worn with Oculus Rift, Cardboard, Gear VR etc. Formula visual device (HMD), refers mainly to VR glasses, is that the VR game of carrier is constantly risen, its bring game player before institute not Some degrees of verisimilitude, so that game player can be immersed in gaming world completely, with very strong substitution sense.However, mesh The maximum problem of front VR game is：Game player occur during game experiencing uncomfortable, for example：It is dizzy, nauseous, Wherein, a more important reason is that in the HMD device that wears and VR game, two built-in cameras lack and game The interpupillary distance of player is adapted to well.Not exclusively VR plays, when user carries out other activities using HMD device, for example：See When TV programme, film is seen, can also there are the problems referred to above.
The number for obtaining after being investigated for sample size crowd according to the U.S. is it has been found that everyone interpupillary distance changes from 52 Millimeter is to 78 millimeters, and wherein, the average interpupillary distance of male is 64.7 millimeters, and the average interpupillary distance of women is 62.3 millimeters.Thus It can be seen that, interpupillary distance varies with each individual.
When the interpupillary distance of user is difficult to mate with the eyeglass of HMD device, will produce and wear interpupillary distance during common spectacles Mismatch equally, user will feel that fatigue easily occur in significant discomfort, eye muscle and vision.However, current HMD device passes through The modes such as knob, support the interpupillary distance value of manual adjustment eyeglass, but generally require artificially to differentiate the picture corresponding to current interpupillary distance value Whether face effect reaches most preferably, and this is not a good solution for domestic consumer.In addition, if HMD device is not inconsistent with user interpupillary distance itself for the picture that user's right and left eyes show, then equally will also result in the bad experience of user. By taking VR game as an example, when the spacing between the interpupillary distance of game player and two built-in cameras in game is mismatched, if game In two built-in cameras spacing more than game player interpupillary distance, it will produce a volume rendering visual field being exaggerated, hold Easily cause the visual fatigue of player；If conversely, game in two built-in cameras the interpupillary distance for being smaller than game player, depending on The third dimension on boundary greatly will weaken.And the SDK (SDK) of VR game at present is all using human eye interpupillary distance average (63.5 millimeters), used as the spacing of two built-in cameras, it is good that such setting does not ensure that all VR game players obtain Game experiencing.
As can be seen here, the interpupillary distance matching scheme of current HMD device, shows in equipment optical element (eyeglass) and picture During all cannot be solved well.
At present, the interpupillary distance measuring method being usually used in correlation technique is cornea optical reflection method, widely used pupil in reality Distance meter is all to carry out interpupillary distance measurement according to the design principle of cornea optical reflection method, and its measuring principle substantially and step are as follows：
The first step, by the sighting target for being illuminated by light source (i.e. inspection light, during optometry, guiding is detected the icon that personnel watch attentively Or image), using the optical system imaging in centrometer；
Second step, centrometer nose volume pad is placed horizontally at the positive middle part of detected personnel's nasion, so that being imaged on of sighting target Detected personnel's dead ahead；
3rd step, make being imaged at detected personnel particular job distance at the moment of sighting target；
4th step, when the binocular fixation sighting target of detected personnel, its left eye and the optical axis of right eye intersect at above-mentioned specific Operating distance at；
5th step, due to the substantial amounts of light of the corneal reflex of human eye, light is by the left eye in detected personnel and cornea of right eye A reflective spot (virtual image) is respectively formed on surface；
6th step, observer can observe the reading hairspring (machine on the rule of centrometer by eyepiece Tool device) and the two reflective spots, overlapped with reflective spot by mobile reading hairspring so that reading hairspring shelters from corneal reflex Light (i.e. the virtual image), now the position of two hairsprings just correspond to two corneas position, so as to realize hairspring, cornea, the virtual image three One line of point；
7th step, now just detected personnel's left eye and right eye can be calculated by the scale difference of two reading hairsprings Distance between cornea；
8th step, the cornea due to human eye are in the middle of pupil, thus just can obtain being detected the interpupillary distance of personnel.
In addition, the distance of the pupil center of the one of eyes of personnel to bridge of the nose center line is detected by measurement, just Monocular interpupillary distance can be obtained, monocular interpupillary distance can more accurately reflect the interpupillary distance information of detected personnel；In addition, by changing The distance of the sighting target imaging that mentions in above-mentioned steps, can also obtain being detected the near of personnel and with interpupillary distance and far use interpupillary distance, lead to In the case of often, closely can be slightly less than with interpupillary distance and far use interpupillary distance.
It is widely used based on the centrometer of cornea optical reflection method, although being counted as accurately again easily interpupillary distance measurement side Method, but said method need set up observer exist precondition under can realize, when interpupillary distance detection not as One special detection, but user using HMD device viewing VR image before pretreatment operation when, cornea optical reflection method will show Must be very clumsy, its specific defect is：
(1) personnel for assisting detection interpupillary distance are needed, and needs to understand basic measurement knowledge；
(2) need to detect the aid of interpupillary distance, for example：Centrometer or interpupillary distance meter；
(3) if using the aid such as interpupillary distance meter or interpupillary distance meter, in addition it is also necessary to guarantee that the intensity of illumination for detecting environment is suitable, So as to clearly view the corneal reflection of detected personnel；
These defects, for a user for needing using HMD device, are totally unfavorable.In order to avoid measuring pupil Away from the cost for being spent, the game player for carrying out VR game especially with HMD device, it is more likely that can directly using and obtain Poor VR experience, or even abandon using VR equipment.
In sum, general at present interpupillary distance detection method extremely relies on testing staff and auxiliary detection instrument can Realize, for hope is immediately using the user of HMD device experience VR image, such mode of operation is difficult to receive.
In addition to the interpupillary distance detection method of above-mentioned introduction, another more conventional interpupillary distance detection method be eye dynamic with Track technology.Eye-tracking technology (or Visual Trace Technology) has extraordinary application prospect in terms of VR.Eye-tracking refers to lead to Cross the position of point of fixation or the motion of eyeball opposing headers for measuring eyes and realize to oculomotor tracking.Set in HMD By using eye-tracking technology in standby, the current direction of visual lines of usertracking user can be obtained, suitable so as to provide the user The VR image (being different from head tracking technology) that joins.
Eye-tracking technology can be further divided into again：Based on software with based on two kinds of different methods of hardware.It is based on The eye-tracking technology of software, is obtained the image of face or human eye, is then realized in image using software first with video camera The positioning of face and human eye and tracking, watch position so as to estimate user attentively on screen, and this method is for image procossing Algorithm have higher requirement, and precision is relatively low；Hardware based eye-tracking technology, generally uses the eye that can lock eyes Motion tracking device, continuously records sight line change by intake from the infrared ray of eye cornea and pupillary reflex, so as to reach note The purpose of record analysis eye tracking process, its precision is higher.Also, hardware based eye-tracking technology generally requires user and wears Go up the special helmet or head fixing bracket is used, be very suitable for the use scene of VR.
In hardware based eye-tracking technology, the implementation " pupil-corneal reflex vector method " of extensive utilization includes Following process step：
The fixing eye-tracking device of the first step, utilization obtains the image of eyeball；
Second step, by the light source coaxial with eye-tracking device, obtain bright pupil image；
3rd step, by the light source cheap with eye-tracking device, obtain dark pupil image；
4th step, pass through by bright pupil image and dark pupil image overlay difference, so as to obtain relatively sharp pupil image；
5th step, obtain the light spot position of cornea transmitting using fixing eye-tracking device, and obtain with reference to pupil position To cornea transmitting vector；
6th step, the direction of visual lines (angle) of estimation user vectorial by cornea transmitting.
Eye-tracking technology can obtain the sight line movement of user and direction, be applied in HMD device, solution suitable Join sex chromosome mosaicism with：As the VR image required for the change of game player's sight line changes, for example：Game player's head is keeping not In the case of dynamic, eyeball is moved, then the VR image that sees also is moved).However, the method still cannot solve user Interpupillary distance and HMD device itself be adapted to sex chromosome mosaicism, even if being capable of the sight line situation of user in real, also cannot avoid due to pupil Away from being difficult to be adapted to caused image distortion, fuzzy in turn result in user dizzy, nauseous.
For above-mentioned problem, effective solution is not yet proposed at present.
Content of the invention
A kind of adaptive auxiliary tone adjusting method of simple eye visual field and device, wear-type visual device is embodiments provided, with At least solve what user's interpupillary distance and the wear-type visual device of wear-type visual device used in correlation technique were difficult to be adapted in itself Technical problem.
A kind of one side according to embodiments of the present invention, there is provided the adaptive auxiliary tone adjusting method of simple eye visual field, including：
The monocular interpupillary distance of user to be detected is obtained using the eye-tracking device for increasing newly in wear-type visual device, wherein, Eye-tracking device carries out scalability movement in default moving area；According to monocular interpupillary distance in wear-type visual device with It is whole that the display picture of the corresponding optical element of monocular interpupillary distance and/or display screen carries out adaptive auxiliary tone.
Alternatively, obtaining monocular interpupillary distance using eye-tracking device includes：Obtain near with interpupillary distance pair with user to be detected The first focal length for answering and with user to be detected far with corresponding second focal length of interpupillary distance；By equidistant for default moving area division For multiple Moving Units, control eye-tracking device to move in default turnover zone, multiple Moving Units are traveled through, is obtained respectively Take first group measurement data corresponding with the first focal length and second group measurement data corresponding with the second focal length；To first group of survey Amount data and second group of measurement data carry out validity check, filter out measurement data to be calculated；Using measurement to be calculated Data ask for monocular interpupillary distance.
Alternatively, obtaining is included with corresponding first focal length of interpupillary distance and second focal length corresponding with remote interpupillary distance near： First distance, second distance and threeth distance are obtained respectively, and wherein, the first distance is the center of display screen and optical element The distance between, centered on second distance position with the distance between simple eye, the 3rd distance for sighting target with the distance between simple eye； When measurement closely with interpupillary distance triggering the 3rd distance choose the first numerical value when, using the first numerical value, the value of the first distance and second away from From the first focal length of exploitation；And when measurement far chooses second value with the 3rd distance of interpupillary distance triggering, using the second number Second focal length of exploitation of value, the value of the first distance and second distance.
Alternatively, by equidistant for default moving area, multiple Moving Units are divided into, control eye-tracking device is default Move in moving area, travel through multiple Moving Units, obtain respectively with first group of measurement data and with second group of measurement Data include：Control display screen exports sighting target image；Optical element is adjusted to the first focal length；Measuring process：Control eye dynamic with Track device is measured to simple eye sight line data on current location；Judge step：When pendulous frequency reaches threshold value, judge Whether optical element is adjusted to the second focal length, if it is not, then optical element is adjusted to the second focal length, and secondary measuring After number resets, measuring process is back to, if it is, entering statistic procedure；When pendulous frequency is not up to threshold value, sight line is recorded Data, control eye-tracking device moves ahead and a Moving Unit adds 1 by pendulous frequency, is back to measuring process, wherein, threshold value It is to be determined by the quantity of initial position and multiple Moving Units；Statistic procedure：When optical element is adjusted to the first focal length, right Measure the sight line data for obtaining every time to be counted, obtain first group of measurement data；And, when optical element is adjusted to second Jiao Away from when, count to measuring the sight line data for obtaining every time, obtain second group of measurement data.
Alternatively, validity check is carried out to first group of measurement data and second group of measurement data, filters out to be calculated Measurement data includes：Every number in first group of measurement data and second group of measurement data is judged successively using default method of calibration According to whether meeting normal distribution；Reject from first group of measurement data and second group of measurement data and do not meet the invalid of normal distribution Data, obtain measurement data to be calculated.
Alternatively, according to monocular interpupillary distance optical element is carried out adaptive auxiliary tone whole including：The 4th distance is obtained, wherein, the Four distances are the distance between center and the axis of wear-type visual device of optical element；According to monocular interpupillary distance and It is whole that difference between four distances carries out adaptive auxiliary tone to optical element.
Alternatively, carry out to optical element according to monocular interpupillary distance that adaptive auxiliary tone is whole also to be included：Obtain user to be detected current The type identification of the application program for using；When monocular interpupillary distance and the 4th distance carry out mathematic interpolation, determined according to type identification Interpupillary distance is used with interpupillary distance or far near.
Alternatively, according to monocular interpupillary distance display picture is carried out adaptive auxiliary tone whole including：The 5th distance is obtained, wherein, the Five distances are the distance between center and the axis of wear-type visual device of display picture；According to monocular interpupillary distance and It is whole that difference between five distances carries out adaptive auxiliary tone to display picture.
Alternatively, carry out to display picture according to monocular interpupillary distance that adaptive auxiliary tone is whole also to be included：Obtain user to be detected current The type identification of the application program for using；When monocular interpupillary distance and the 5th distance carry out mathematic interpolation, determined according to type identification Interpupillary distance is used with interpupillary distance or far near.
Another aspect according to embodiments of the present invention, additionally provides a kind of adaptive auxiliary tone engagement positions of simple eye visual field, including：
Acquisition module, for obtaining the list of user to be detected using the eye-tracking device for increasing newly in wear-type visual device Eye pupil is away from wherein, eye-tracking device carries out scalability movement in default moving area；Adjusting module, for according to list Eye pupil carries out adaptive away from the display picture to optical element corresponding with monocular interpupillary distance and/or display screen in wear-type visual device Auxiliary tone is whole.
Alternatively, acquisition module includes：First acquisition unit, corresponding closely with interpupillary distance with user to be detected for obtaining First focal length and with user to be detected far with corresponding second focal length of interpupillary distance；Second acquisition unit, for by default movement Region is equidistant to be divided into multiple Moving Units, and control eye-tracking device is moved in default moving area, is traveled through many Individual Moving Unit, obtains first group measurement data corresponding with the first focal length and second group survey corresponding with the second focal length respectively Amount data；Verification unit, for carrying out validity check to first group of measurement data and second group of measurement data, filters out and waits to count The measurement data of calculation；Computing unit, for asking for monocular interpupillary distance using measurement data to be calculated.
Alternatively, first acquisition unit includes：Subelement is obtained, for obtaining the first distance, second distance and the respectively Three distances, wherein, the first distance is the distance between display screen and center of optical element, position centered on second distance With the distance between simple eye, the 3rd distance for sighting target with the distance between simple eye；Computation subunit, for closely using interpupillary distance when measurement When triggering the 3rd distance and choosing the first numerical value, using the exploitation the of the first numerical value, the value of the first distance and second distance One focal length；And when measurement far chooses second value with the 3rd distance of interpupillary distance triggering, using second value, the taking of the first distance Value and second focal length of exploitation of second distance.
Alternatively, second acquisition unit includes：Control subelement, exports sighting target image for control display screen；Adjustment Unit, for adjusting optical element to the first focal length；Measurement subelement, for controlling eye-tracking device in current location Simple eye sight line data are measured；Whether judgment sub-unit, for when pendulous frequency reaches threshold value, judging optical element Adjusted to the second focal length, if it is not, then optical element is adjusted to the second focal length, and after resetting pendulous frequency, return Measurement subelement is back to, if it is, entering statistics subelement；When pendulous frequency is not up to threshold value, sight line data, control is recorded Eye-tracking device processed moves ahead and a Moving Unit adds 1 by pendulous frequency, is back to measurement subelement, wherein, threshold value be by The quantity of initial position and multiple Moving Units determines；Statistics subelement, for when optical element is adjusted to the first focal length, Count to measuring the sight line data for obtaining every time, obtain first group of measurement data；And, when optical element is adjusted to second During focal length, count to measuring the sight line data for obtaining every time, obtain second group of measurement data.
Alternatively, verification unit includes：Verification subelement, for judging first group of measurement successively using default method of calibration Whether each data in data and second group of measurement data meet normal distribution；Subelement is processed, for from first group of measurement The invalid data for not meeting normal distribution is rejected in data and second group of measurement data, obtains measurement data to be calculated.
Alternatively, adjusting module includes：3rd acquiring unit, for obtaining the 4th distance, wherein, the 4th distance is optics The distance between the center of element and axis of wear-type visual device；First adjustment unit, for according to simple eye pupil It is whole that difference between the 4th distance carries out adaptive auxiliary tone to optical element.
Alternatively, adjusting module also includes：4th acquiring unit, the application journey currently used for obtaining user to be detected The type identification of sequence；First determining unit, for when monocular interpupillary distance and the 4th distance carry out mathematic interpolation, according to type identification Determining to select, interpupillary distance is closely used with interpupillary distance or far.
Alternatively, adjusting module includes：5th acquiring unit, for obtaining the 5th distance, wherein, the 5th distance is for showing The distance between the center of picture and axis of wear-type visual device；Second adjustment unit, for according to simple eye pupil It is whole that difference between the 5th distance carries out adaptive auxiliary tone to display picture.
Alternatively, adjusting module also includes：6th acquiring unit, the application journey currently used for obtaining user to be detected The type identification of sequence；Second determining unit, for when monocular interpupillary distance and the 5th distance carry out mathematic interpolation, according to type identification Determining to select, interpupillary distance is closely used with interpupillary distance or far.
Another aspect according to embodiments of the present invention, additionally provides a kind of wear-type visual device, including：
Control chip and eye-tracking device, wherein, control chip includes：The adaptive auxiliary tone of above-mentioned simple eye visual field is self-contained Put.
Alternatively, the said equipment also includes：Hurdle and adjusting apparatus are intercepted, wherein, adjusting apparatus are used installed in intercepting on hurdle Self-adaptative adjustment is carried out in the position to optical element.
In embodiments of the present invention, using in wear-type visual device increase newly carry out in default moving area scalable Property movement eye-tracking device obtain user to be detected monocular interpupillary distance mode, by the monocular interpupillary distance that gets to wearing To carry out adaptive auxiliary tone whole for the display picture of optical element corresponding with monocular interpupillary distance and/or display screen in formula visual device, reaches User is avoided in the case of it cannot learn with measurement interpupillary distance, because there is nausea, dizziness etc. using wear-type visual device The purpose of untoward reaction, it is achieved thereby that strengthening the convenience that user's interpupillary distance is adapted to wear-type visual device, reduces operation multiple Miscellaneous degree, lifts the technique effect of Consumer's Experience, and then solves user's interpupillary distance of wear-type visual device used in correlation technique It is difficult to, with wear-type visual device, the technical problem that is adapted in itself.
Description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, this Bright schematic description and description is used for explaining the present invention, does not constitute inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the structural representation of wear-type visual device according to embodiments of the present invention；
Fig. 2 is addition HMD device floor map of the eyeglass from after adaption function according to the preferred embodiment of the invention；
Fig. 3 is the flow chart of the adaptive auxiliary tone adjusting method of simple eye visual field according to embodiments of the present invention；
Fig. 4 is the schematic diagram for obtaining user's sight line data procedures according to the preferred embodiment of the invention；
Fig. 5 is the focal length by adjusting liquid zoom lens according to the preferred embodiment of the invention adjusting sighting target position Schematic diagram；
Fig. 6 is the flow chart of interpupillary distance measurement process according to the preferred embodiment of the invention；
Fig. 7 is the schematic diagram of monocular interpupillary distance calculating process according to the preferred embodiment of the invention；
Fig. 8 is that picture according to the preferred embodiment of the invention is adapted to process schematic certainly；
Fig. 9 is the structured flowchart of the adaptive auxiliary tone engagement positions of simple eye visual field according to embodiments of the present invention；
Figure 10 is the structured flowchart of the adaptive auxiliary tone engagement positions of simple eye visual field according to the preferred embodiment of the invention.
Specific embodiment
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention Accompanying drawing, is clearly and completely described to the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only The embodiment of a present invention part, rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people The every other embodiment obtained under the premise of creative work is not made by member, should all belong to the model of present invention protection Enclose.
It should be noted that description and claims of this specification and the term " first " in above-mentioned accompanying drawing, " Two " be etc. for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that so using Data can exchange in the appropriate case, so as to embodiments of the invention described herein can with except here diagram or Order beyond those of description is implemented.Additionally, term " comprising " and " having " and their any deformation, it is intended that cover Lid is non-exclusive to be included, and for example, the process, method, system, product or the equipment that contain series of steps or unit are not necessarily limited to Those steps that clearly lists or unit, but may include clearly not list or for these processes, method, product Or intrinsic other steps of equipment or unit.
At present, when user carries out VR correlation experience using HMD device, easily because being difficult between interpupillary distance and HMD device fit Join, so as to cause user the untoward reaction such as nauseous, dizzy occur.Moreover, now widely used interpupillary distance measuring method does not possess Independence, need to rely on auxiliary testing tool and tester (observer).
According to embodiments of the present invention, there is provided a kind of embodiment of wear-type visual device.Pupil is substituted using HMD device Away from survey tool and the function of gauger, and by the loop of self feed back, using the result of interpupillary distance measurement, user's visual field is carried out Adjustment from adaptation.
Fig. 1 is the structural representation of wear-type visual device according to embodiments of the present invention.As shown in figure 1, being set using HMD " instrument " that standby optical element and display screen are measured as interpupillary distance, on this basis by using existing eye-tracking skill Art, is embedded in eye in HMD device and moves follow-up mechanism (which is used for following the trail of and recording the sight line of human eye) as in interpupillary distance measurement process " observer ".The HMD device can be included but is not limited to lower component：
(1)A0:The outer shield of HMD device, is responsible for shielding interference of the external environment light to user；
(2)A1:Small-sized mechanical-stretching platform；
(3)A2:The dynamic follow-up mechanism of eye is (for example：Eye tracker), it is responsible for catching user's sight line using eye-tracking technology；Eye is dynamic Follow-up mechanism is attached to mechanical-stretching platform；
(4)A3:The regional extent that the dynamic follow-up mechanism of eye is moved in HMD device by telescopic platform；
(5)A4:Display screen, is responsible for showing VR image frame；
(6)A5:It is arranged on optical element in display screen and user's eyes (for example：Eyeglass), responsible secondary imaging；Its choosing It is liquid zoom lens, the distance of the image that sees so as to adjustment user；
(7)A6:The obstruct hurdle of light tight material, it is to avoid the image of left and right sides display screen is interfered with each other；
(8)A7:The dynamic upper limit of follow-up mechanism moving range of eye is l 1 with the distance of the rear end of display screen to A0；
(9)A8:The front end of display screen is l2 with hurdle is intercepted to the distance of A0.
The instrument for being measured as interpupillary distance by HMD device itself, and tester is used as by the eye-tracking device being implanted into (observer), so as to complete the measurement of interpupillary distance.On this basis, the interpupillary distance value for measurement being obtained feeds back to HMD device, so as to right The position of optical element (eyeglass) and display picture in HMD device is adjusted.Interpupillary distance measurement uses the survey of single interpupillary distance The mode (i.e. left eye is measured respectively with the interpupillary distance of right eye) of amount, it is to avoid the interpupillary distance measurement for causing as user's interpupillary distance is asymmetric As a result error is produced.In addition, also the near of user being measured respectively using liquid zoom lens with interpupillary distance and far uses interpupillary distance, so as to user When different experience are carried out using HMD device, being adaptive selected suitable interpupillary distance type carries out feedback adjustment.
The measurement of interpupillary distance is completed in itself using HMD device and the adaptation of visual field is completed by self feed back, it is achieved that complete Close loop maneuver.Closed loop is also known as feedback control system, and which refers to the measured value of feedback control system output is default with desired Value is compared, and thus produces a deviation signal, and is adjusted control using this deviation signal, so that the survey of output Value is infinitely close to expected value.Close loop maneuver refers to adjust the position of eyeglass and picture by the interpupillary distance value for measuring, entirely The flow process of visual field adaptation is without the need for manpower intervention, and passes through feedback and voluntarily complete, and then user just can after HMD device is worn Access optimal Consumer's Experience.
During being preferable to carry out, eyeglass can be completed by adding the machinery for drawing optical element (eyeglass) A5 From be adapted to.Fig. 2 is addition HMD device floor map of the eyeglass from after adaption function according to the preferred embodiment of the invention. As shown in Fig. 2 machinery A9 is respectively mounted in the obstruct hurdle both sides of HMD device, to realize position relative to left and right optical element The record that puts and adjustment.
According to embodiments of the present invention, there is provided a kind of embodiment of the adaptive auxiliary tone adjusting method of simple eye visual field, explanation is needed It is can to execute in the such as computer system of one group of computer executable instructions the step of the flow process of accompanying drawing is illustrated, And, although show logical order in flow charts, but in some cases, can be executed with the order being different from herein Shown or described step.
Fig. 3 is the flow chart of the adaptive auxiliary tone adjusting method of simple eye visual field according to embodiments of the present invention, as shown in figure 3, the party Method comprises the steps：
Step S30, obtains the simple eye pupil of user to be detected using the eye-tracking device for increasing newly in wear-type visual device Away from wherein, eye-tracking device carries out scalability movement in default moving area；
Step S32, and/or shows to optical element corresponding with monocular interpupillary distance in wear-type visual device according to monocular interpupillary distance It is whole that the display picture of display screen carries out adaptive auxiliary tone.
By above-mentioned steps, carrying out in default moving area of increasing newly in wear-type visual device can be adopted scalable Property movement eye-tracking device obtain user to be detected monocular interpupillary distance mode, by the monocular interpupillary distance that gets to wearing To carry out adaptive auxiliary tone whole for the display picture of optical element corresponding with monocular interpupillary distance and/or display screen in formula visual device, reaches User is avoided in the case of it cannot learn with measurement interpupillary distance, because there is nausea, dizziness etc. using wear-type visual device The purpose of untoward reaction, it is achieved thereby that strengthening the convenience that user's interpupillary distance is adapted to wear-type visual device, reduces operation multiple Miscellaneous degree, lifts the technique effect of Consumer's Experience, and then solves user's interpupillary distance of wear-type visual device used in correlation technique It is difficult to, with wear-type visual device, the technical problem that is adapted in itself.
Alternatively, in step s 30, obtaining monocular interpupillary distance using eye-tracking device can include step performed below：
Step S300, obtains with user to be detected closely with corresponding first focal length of interpupillary distance and remote with user to be detected With corresponding second focal length of interpupillary distance；
Step S302, is divided into multiple Moving Units by equidistant for default moving area, and control eye-tracking device is pre- If moving in moving area, multiple Moving Units are traveled through, obtaining first group measurement data corresponding with the first focal length respectively And second group measurement data corresponding with the second focal length；
Step S304, carries out validity check to first group of measurement data and second group of measurement data, filters out to be calculated Measurement data；
Step S306, asks for monocular interpupillary distance using measurement data to be calculated.
Fig. 4 is the schematic diagram for obtaining user's sight line data procedures according to the preferred embodiment of the invention.As shown in figure 4, During interpupillary distance measurement, by the effect of control instruction, the movement for adjusting telescopic platform and Jiao for determining liquid zoom lens Away from sight line data, i.e. the user's eyes sight line for collecting and counting the user that the dynamic follow-up mechanism of eye is collected moves tracking with respect to eye The visual angle of device, finally asks for monocular interpupillary distance.
Alternatively, in step S300, obtain first focal length corresponding with interpupillary distance is closely used and use interpupillary distance corresponding with remote Second focal length can include step performed below：
Step S3000, obtains the first distance, second distance and the 3rd distance respectively, wherein, the first distance for display screen with The distance between center of optical element, centered on second distance position with the distance between simple eye, the 3rd distance be regarding Mark with the distance between simple eye；
Step S3001, when measurement closely with interpupillary distance triggering the 3rd distance choose the first numerical value when, using the first numerical value, first First focal length of exploitation of the value of distance and second distance；And when measurement far chooses second with the 3rd distance of interpupillary distance triggering During numerical value, using second focal length of exploitation of second value, the value of the first distance and second distance.
As the technical scheme provided by the embodiment of the present invention is needed to the near with interpupillary distance and far being entered with interpupillary distance respectively of user Row measurement, accordingly, it would be desirable to sighting target when measuring to interpupillary distance observed by user carry out at a distance with closely between switching.In order to The purpose is realized, Fig. 5 is the focal length by adjusting liquid zoom lens according to the preferred embodiment of the invention adjusting sighting target position The schematic diagram that puts.As shown in figure 5, liquid zoom lens can be selected as the primary optics in HMD device, by adjustment The focal length of liquid zoom lens is adjusting the distance of sighting target.The adjustment of focal length is controlled the control of chip, and focal length is concrete Computing formula is：
Wherein, d1 is the distance between display screen and center of optical element, d2 be center of optical element and eyes of user it Between distance, d0 be sighting target (i.e. the image of display screen be imaged by optical element after enter human eye image) and human eye between Distance, in conjunction with the usual nearly use for adopting of human body, far (is commonly used to closely use with interpupillary distance and far in measurement human eye with operating distance During interpupillary distance, the distance between sighting target seen by person and human eye), the final 30cm and 300cm that chooses is taken as two of variable d0 Value, can obtain the two values of optical element focus controlling so as to us：
Wherein, the dimension of formula for centimetre.Therefore, control of the control chip to optical element focal length, just in f1 and f2 two Switch between individual parameter.
Alternatively, in step s 302, multiple Moving Units are divided into equidistant for default moving area, control eye dynamic with Track device is moved in default moving area, travels through multiple Moving Units, obtain respectively with first group of measurement data and Step performed below can be included with second group of measurement data：
Step S3020, control display screen exports sighting target image；
Step S3021, optical element is adjusted to the first focal length；
Step S3022, control eye-tracking device is measured to simple eye sight line data on current location；
Step S3023, when pendulous frequency reaches threshold value, judges whether optical element is adjusted to the second focal length, such as Really no, then optical element is adjusted to the second focal length, and after resetting pendulous frequency, step S3022 is back to, if it is, Step S3024 is then entered；When pendulous frequency is not up to threshold value, sight line data are recorded, control eye-tracking device moves ahead one Pendulous frequency is simultaneously added 1 by Moving Unit, is back to step S3022, wherein, threshold value be by initial position and multiple Moving Units Quantity determines；
Step S3024, when optical element is adjusted to the first focal length, unites to measuring the sight line data for obtaining every time Meter, obtains first group of measurement data；And, when optical element is adjusted to the second focal length, to measuring the sight line number for obtaining every time According to being counted, second group of measurement data is obtained.
Alternatively, in step s 304, validity check is carried out to first group of measurement data and second group of measurement data, sieve Selecting measurement data to be calculated can include step performed below：
Step S3040, is judged in first group of measurement data and second group of measurement data successively using default method of calibration Whether each data meets normal distribution；
Step S3041, rejects from first group of measurement data and second group of measurement data and does not meet the invalid of normal distribution Data, obtain measurement data to be calculated.
Interpupillary distance measurement is aimed at：The near of the left and right eyes of user is far carried out with monocular interpupillary distance and respectively with monocular interpupillary distance Measurement, Fig. 6 is the flow chart of interpupillary distance measurement process according to the preferred embodiment of the invention.As shown in fig. 6, the flow process can include Following process step：
Step S602, starts interpupillary distance measurement procedure, and display screen exports sighting target image；
Step S604, optical element is (for example：Eyeglass) adjust to f1 focal length；
Step S606, starts eye-tracking device；
Step S608, judges whether pendulous frequency reaches predetermined threshold value (for example：10 times)；If it is, continuing executing with step Rapid S616；If it is not, then continuing executing with step S610；
Step S610, adjusts mechanical-stretching platform position；
Step S612- step S614, measures respectively and records when the visual angle of front left and right eyes；Pendulous frequency adds 1, returns To step S608；
After measuring and record when the visual angle of front left and right eyes, just eye-tracking dress can be multiplied by by visual angle tan The distance (i.e. d5, in figure is not shown) for putting current distance human eye is just obtained the interpupillary distance of human eye.
Step S616, judges whether eyeglass is adjusted to f2 focal length；If it is, continuing executing with step S618；If No, then continue executing with step S624；
Step S618, is calculated 2*2*10 group interpupillary distance data；
Due to needing to be measured with far carrying out 10 times respectively with interpupillary distance with interpupillary distance near, and need to measure left and right eyes Monocular interpupillary distance, therefore, needs altogether to be calculated 2*2*10 group interpupillary distance data, and then obtains best suiting user by statistical analysiss The numerical value of true interpupillary distance.
Step S620, rejects invalid data, i.e., according to the t verification that statistically more commonly uses, (also known as student t is examined Test) to each data judging, whether which meets normal distribution successively, if do not meet just be distributed very much, the data are confirmed as no Effect data；
Step S622, the valid data that will obtain through screening, by geometric average (after all of valid data multiplication again Evolution) calculation statistics output images of left and right eyes interpupillary distance；
Specifically, Fig. 7 is the schematic diagram of monocular interpupillary distance calculating process according to the preferred embodiment of the invention.As shown in fig. 7, It is d3 to depend on the initial distance between the eye-tracking device of mechanical-stretching platform and user's eyes.Eye-tracking device can be A3 is moved in region, thus can be obtained, its between user's eyes beeline be d4.
Obtain due to needing the measurement to interpupillary distance to carry out statistics by 10 measurement results, accordingly, it would be desirable to by eye-tracking The distance (d3-d4) that device can be moved carries out 9 deciles, and each decile is set as the minimum of mechanical-stretching platform in control chip Moving Unit, along with eye-tracking device does not start the position before movement, constitutes 10 measurement positions, so as to obtain 10 surveys Amount result.
After eye-tracking device completes measurement every time, current images of left and right eyes the regarding with respect to eye-tracking device of user is sent Angular data θ L, θ R is to control chip.Control chip sends a control signal to machinery after receiving measurement data and being recorded Telescopic platform so as to move a minimum Moving Unit again towards human eye direction.
Eye-tracking device is measured every time to perspective data θ L, θ R for obtaining, the images of left and right eyes interpupillary distance of user is respectively：
DL=tan θL*d5
DR=tan θR*d5
Wherein：
d5=d4+ Δ d*n (n=0,1 ..., 9)
Δ d=(d3-d4)/9
Nearly use and the remote 2*2*10 group data with interpupillary distance for images of left and right eyes, is all calculated list using said method Eye pupil is away from result, you can obtains 4 groups of results, is respectively：Left eye closely with interpupillary distance, left eye far with interpupillary distance, right eye closely with interpupillary distance and Right eye far uses interpupillary distance.
Consider eye-tracking technology that eye-tracking device is adopted still deficient in stability in the market, and user Self-disciplining can not necessarily be kept during measurement interpupillary distance, it is understood that there may be close one's eyes or the situation for watching sighting target attentively is not concentrated, Therefore, it is also desirable to simply be screened to the 4 groups of data for obtaining：The data volume for obtaining in view of statistics is less, is verified using t Invalid data is rejected by criterion, then obtains, by geometric average, the interpupillary distance result for measuring.
Step S624- step S626, determines that eyeglass is adjusted to f2 focal length, and pendulous frequency zero is emptied.
It should be noted that above-mentioned calculating and screening statistic processess all can be completed in control chip.
Alternatively, in step s 32, carry out to optical element according to monocular interpupillary distance that adaptive auxiliary tone is whole can be included following hold Row step：
Step S320, obtains the 4th distance, and wherein, the 4th distance is visually set with wear-type for the center of optical element The distance between standby axis；
Step S321, carries out adaptive auxiliary tone according to the difference between monocular interpupillary distance and the 4th distance to optical element whole.
By taking left eyeglass as an example, machinery records the center of left eyeglass and intercepts the distance between hurdle A6 d6.When After control chip calculating, statistics screening obtain left eye interpupillary distance DL of user, mathematic interpolation is carried out with d6, and the process of difference is tied Fruit is sent to machinery A9, and wherein, the absolute value of difference is used for determining the displacement of machinery, the sign symbol of difference For determining the moving direction of machinery, to be finally reached the adaptation purpose certainly of eyeglass.
Alternatively, in step s 32, according to monocular interpupillary distance optical element is carried out adaptive auxiliary tone whole can also include following Execution step：
Step S322, obtains the type identification of the currently used application program of user to be detected；
Step S323, when monocular interpupillary distance and the 4th distance carry out mathematic interpolation, is determined according to type identification and is used near Interpupillary distance or far use interpupillary distance.
Before above-mentioned adapting operation is carried out, control chip can get the type of current active program by HMD device Mark, so as to determine that the DL value for carrying out mathematic interpolation with d6 is far to use interpupillary distance with interpupillary distance or closely.
Current active program be current receive response and by operating system be judged to be user be being currently used should With program, for example：When office word is current active program, the quick key operation of such as ctrl+c and ctrl+v just may be used It is responsive in word application program, without being replicated or pasting in ppt, its reason is：Windows operating system is The application program that is being currently used is determined to be word and not ppt.The above-mentioned type mark can include：Currently live in VR equipment Jump program can make user using closely using interpupillary distance, and in VR equipment, current active program can make user using far using interpupillary distance；Type identification Definition can complete in HMD device, and reserve standard interface for application program identification itself type, for example：Film is broadcast Put, the application program such as main interface operation can be designated using closely using interpupillary distance, and the broad VR game of some scenes can then be marked Knowledge is to use far to use interpupillary distance.
Alternatively, in step s 32, carry out to display picture according to monocular interpupillary distance that adaptive auxiliary tone is whole can be included following hold Row step：
Step S324, obtains the 5th distance, and wherein, the 5th distance is visually set with wear-type for the center of display picture The distance between standby axis；
Step S325, carries out adaptive auxiliary tone according to the difference between monocular interpupillary distance and the 5th distance to display picture whole.
Due to being currently based on the application program of VR exploitation, particularly VR plays, the built-in Softcam of the software that SDK gives tacit consent to Spacing be 63.5mm, which may not meet the interpupillary distance truth of all users, therefore for show picture be also required to carry out Adaptation.Fig. 8 is that picture according to the preferred embodiment of the invention is adapted to process schematic certainly.As shown in figure 8, by taking right eye as an example, right In display screen, centre distance d7 of image is not inconsistent with the right eye interpupillary distance DR value of user, it is therefore desirable to according to image in right display screen Image in right display screen is offset by difference between centre distance d7 and the right eye interpupillary distance DR value of user to the left, wherein, d7 value It is that by the initial pixel point abscissa x0 when front right display screen, (i.e. image is loading pixel line by line, carrying out in control chip Initial position during display, the coordinate of the initial position be with respect to the coordinate figure of display screen), the acquiescence width w1 of image, aobvious The fixed range d8 of display screen width w2 and display screen away from center line is calculated：
And the adjustment for picture is adapted to, it is only necessary to after processing the difference of d7 and DR by control chip, control is sent Signal is to display screen so as to change the coordinate position of initial pixel point, and the image for rescaning out is to be adapted to the use The image effect at family, i.e.,：
x’0=x0-d7+DR
Alternatively, in step s 32, according to monocular interpupillary distance display picture is carried out adaptive auxiliary tone whole can also include following Execution step：
Step S326, obtains the type identification of the currently used application program of user to be detected；
Step S327, when monocular interpupillary distance and the 5th distance carry out mathematic interpolation, is determined according to type identification and is used near Interpupillary distance or far use interpupillary distance.
Similarly, before above-mentioned adapting operation is carried out, control chip can get current active program by HMD device Type identification and judged.
According to embodiments of the present invention, there is provided a kind of embodiment of the adaptive auxiliary tone engagement positions of simple eye visual field, the simple eye visual field Adaptive auxiliary tone engagement positions are applied in above-mentioned control chip.Fig. 9 is that the adaptive auxiliary tone of simple eye visual field according to embodiments of the present invention is whole The structured flowchart of device, as shown in figure 9, the device includes：Acquisition module 10, for using increasing newly in wear-type visual device Eye-tracking device obtains the monocular interpupillary distance of user to be detected, and wherein, eye-tracking device is carried out in default moving area can Expansion moving；Adjusting module 20, for according to monocular interpupillary distance to optics corresponding with monocular interpupillary distance in wear-type visual device It is whole that the display picture of element and/or display screen carries out adaptive auxiliary tone.
Alternatively, Figure 10 is the structured flowchart of the adaptive auxiliary tone engagement positions of simple eye visual field according to the preferred embodiment of the invention, As shown in Figure 10, acquisition module 10 can include：First acquisition unit 100, for obtain with user to be detected closely use interpupillary distance Corresponding first focal length and with user to be detected far with corresponding second focal length of interpupillary distance；Second acquisition unit 102, for inciting somebody to action Default moving area is equidistant to be divided into multiple Moving Units, and control eye-tracking device is moved in default moving area Dynamic, multiple Moving Units are traveled through, obtains first group measurement data corresponding with the first focal length and corresponding with the second focal length respectively Second group of measurement data；Verification unit 104, for carrying out effectiveness inspection to first group of measurement data and second group of measurement data Test, filter out measurement data to be calculated；Computing unit 106, for asking for monocular interpupillary distance using measurement data to be calculated.
Alternatively, first acquisition unit 100 includes：Obtain subelement (not shown), for respectively obtain first away from With a distance from, second distance and the 3rd, wherein, the first distance is the distance between display screen and center of optical element, the Centered on two distances position with the distance between simple eye, the 3rd distance for sighting target with the distance between simple eye；Computation subunit (figure Not shown in), for when measurement closely chooses the first numerical value with the 3rd distance of interpupillary distance triggering, using the first numerical value, the first distance Value and second distance the first focal length of exploitation；And when measurement far chooses second value with the 3rd distance of interpupillary distance triggering When, using second focal length of exploitation of second value, the value of the first distance and second distance.
Alternatively, second acquisition unit 102 can include：Control subelement (not shown), for control display screen Output sighting target image；Adjustment subelement (not shown), for adjusting optical element to the first focal length；Measurement subelement (not shown), for controlling eye-tracking device to measure simple eye sight line data on current location；Judge son Unit (not shown), for when pendulous frequency reaches threshold value, judging whether optical element is adjusted to the second focal length, If it is not, then optical element is adjusted to the second focal length, and after resetting pendulous frequency, be back to measurement subelement, if It is then to enter statistics subelement；When pendulous frequency is not up to threshold value, sight line data are recorded, control eye-tracking device moves ahead Pendulous frequency is simultaneously added 1 by one Moving Unit, is back to measurement subelement, wherein, threshold value be by initial position and multiple movements The quantity of unit determines；Statistics subelement (not shown), for when optical element is adjusted to the first focal length, to each The sight line data that measurement is obtained are counted, and obtain first group of measurement data；And, when optical element is adjusted to the second focal length When, count to measuring the sight line data for obtaining every time, obtain second group of measurement data.
Alternatively, verification unit 104 can include：Verification subelement (not shown), for using default verification side Method judges whether each data in first group of measurement data and second group of measurement data meet normal distribution successively；Process son single First (not shown), does not meet the invalid of normal distribution for rejecting from first group of measurement data and second group of measurement data Data, obtain measurement data to be calculated.
Alternatively, as shown in Figure 10, adjusting module 20 can include：3rd acquiring unit 200, for obtain the 4th away from From wherein, the 4th distance is the distance between center and the axis of wear-type visual device of optical element；First adjusts Whole unit 202, whole for carrying out adaptive auxiliary tone according to the difference between monocular interpupillary distance and the 4th distance to optical element.
Alternatively, as shown in Figure 10, adjusting module 20 can also include：4th acquiring unit 204, to be detected for obtaining The type identification of the currently used application program of user；First determining unit 206, for carrying out with the 4th distance in monocular interpupillary distance During mathematic interpolation, determined to select according to type identification and interpupillary distance is closely used with interpupillary distance or far.
Alternatively, as shown in Figure 10, adjusting module 20 can include：5th acquiring unit 208, for obtain the 5th away from From wherein, the 5th distance is the distance between center and the axis of wear-type visual device of display picture；Second adjusts Whole unit 210, whole for carrying out adaptive auxiliary tone according to the difference between monocular interpupillary distance and the 5th distance to display picture.
Alternatively, as shown in Figure 10, adjusting module 20 can also include：6th acquiring unit 212, to be detected for obtaining The type identification of the currently used application program of user；Second determining unit 214, for carrying out with the 5th distance in monocular interpupillary distance During mathematic interpolation, determined to select according to type identification and interpupillary distance is closely used with interpupillary distance or far.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and does not have in certain embodiment The part of detailed description, may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed technology contents, can pass through other Mode is realized.Wherein, device embodiment described above is only the schematically such as division of the unit, Ke Yiwei A kind of division of logic function, can have other dividing mode when actually realizing, such as multiple units or component can in conjunction with or Person is desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown or discussed is mutual Between coupling direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of unit or module by some interfaces Connect, can be electrical or other forms.
The unit that illustrates as separating component can be or may not be physically separate, aobvious as unit The part for showing can be or may not be physical location, you can be located at a place, or can also be distributed to multiple On unit.Some or all of unit therein can be selected according to the actual needs to realize the purpose of this embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list Unit both can be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is realized and as independent production marketing or use using in the form of SFU software functional unit When, can be stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially The part in other words prior art being contributed or all or part of the technical scheme can be in the form of software products Embody, the computer software product is stored in a storage medium, use so that a computer including some instructions Equipment (can be personal computer, server or the network equipment etc.) execute the whole of each embodiment methods described of the present invention or Part steps.And aforesaid storage medium includes：USB flash disk, read only memory (ROM, Read-Only Memory), random access memory are deposited Reservoir (RAM, Random Access Memory), portable hard drive, magnetic disc or CD etc. are various can be with store program codes Medium.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications also should It is considered as protection scope of the present invention.

Claims (20)

1. the adaptive auxiliary tone adjusting method of a kind of simple eye visual field, it is characterised in that include：
The monocular interpupillary distance of user to be detected is obtained using the eye-tracking device for increasing newly in wear-type visual device, wherein, described Eye-tracking device carries out scalability movement in default moving area；
And/or shown to optical element corresponding with the monocular interpupillary distance in the wear-type visual device according to the monocular interpupillary distance It is whole that the display picture of display screen carries out adaptive auxiliary tone.
2. method according to claim 1, it is characterised in that the monocular interpupillary distance is obtained using the eye-tracking device Including：
Obtain with the user to be detected near with corresponding first focal length of interpupillary distance and with the user to be detected far use pupil Away from corresponding second focal length；
Multiple Moving Units are divided into by equidistant for the default moving area, control the eye-tracking device described default Move in moving area, the plurality of Moving Unit is traveled through, obtains first group survey corresponding with first focal length respectively Amount data and second group measurement data corresponding with second focal length；
Validity check is carried out to first group of measurement data and second group of measurement data, filters out measurement to be calculated Data；
The monocular interpupillary distance is asked for using the measurement data to be calculated.
3. method according to claim 2, it is characterised in that obtain first focal length corresponding with the nearly use interpupillary distance And include with remote corresponding second focal length of interpupillary distance：
First distance, second distance and threeth distance are obtained respectively, and wherein, first distance is display screen and optical element The distance between center, the second distance is that the center is the distance between simple eye with described, the described 3rd away from From the distance between simple eye with described for sighting target；
When measuring the nearly interpupillary distance triggering the 3rd distance and choosing the first numerical value, using first numerical value, described the First focal length described in the exploitation of the value of one distance and the second distance；And far institute is triggered with interpupillary distance when measurement is described When stating the 3rd distance selection second value, using the second value, the value of first distance and the second distance Second focal length described in exploitation.
4. method according to claim 2, it is characterised in that by equidistant for the default moving area be divided into described many Individual Moving Unit, controls the eye-tracking device to move in the default moving area, travels through the plurality of movement Unit, is obtained with first group of measurement data respectively and is included with second group of measurement data：
Control display screen exports sighting target image；
Optical element is adjusted to first focal length；
Measuring process：The eye-tracking device is controlled to measure the simple eye sight line data on current location；
Judge step：When pendulous frequency reaches threshold value, whether adjusted to described second focal length of the optical element is judged, If it is not, then adjusting the optical element to second focal length, and after resetting the pendulous frequency, it is back to described Measuring process, if it is, enter statistic procedure；When the pendulous frequency is not up to the threshold value, the sight line number is recorded According to controlling the eye-tracking device to move ahead and a Moving Unit add 1 by the pendulous frequency, be back to the measurement step Suddenly, wherein, the threshold value is determined by the quantity of the initial position and the plurality of Moving Unit；
The statistic procedure：When the optical element is adjusted to first focal length, to measuring the sight line for obtaining every time Data are counted, and obtain first group of measurement data；And, when the optical element is adjusted to second focal length, Count to measuring the sight line data for obtaining every time, obtain second group of measurement data.
5. method according to claim 2, it is characterised in that to first group of measurement data and second group of measurement Data carry out validity check, and filtering out the measurement data to be calculated includes：
Every number in first group of measurement data and second group of measurement data is judged successively using default method of calibration According to whether meeting normal distribution；
The invalid number for not meeting the normal distribution is rejected from first group of measurement data and second group of measurement data According to obtaining the measurement data to be calculated.
6. method according to claim 1, it is characterised in that according to the monocular interpupillary distance optical element is carried out from Adaptation adjustment includes：
The 4th distance is obtained, wherein, the 4th distance is visually set with the wear-type for the center of the optical element The distance between standby axis；
Adaptive auxiliary tone is carried out to the optical element according to the difference between the monocular interpupillary distance and the 4th distance whole.
7. method according to claim 6, it is characterised in that according to the monocular interpupillary distance optical element is carried out from Adaptation adjustment also includes：
Obtain the type identification of the currently used application program of the user to be detected；
When the monocular interpupillary distance carries out mathematic interpolation with the 4th distance, determined to select according to the type identification and closely use pupil Away from or far use interpupillary distance.
8. method according to claim 1, it is characterised in that according to the monocular interpupillary distance display picture is carried out from Adaptation adjustment includes：
The 5th distance is obtained, wherein, the 5th distance is visually set with the wear-type for the center of the display picture The distance between standby axis；
Adaptive auxiliary tone is carried out to the display picture according to the difference between the monocular interpupillary distance and the 5th distance whole.
9. method according to claim 8, it is characterised in that according to the monocular interpupillary distance display picture is carried out from Adaptation adjustment also includes：
Obtain the type identification of the currently used application program of the user to be detected；
When the monocular interpupillary distance carries out mathematic interpolation with the 5th distance, determined to select according to the type identification and closely use pupil Away from or far use interpupillary distance.
10. adaptive auxiliary tone engagement positions of a kind of simple eye visual field, it is characterised in that include：
Acquisition module, for obtaining the simple eye pupil of user to be detected using the eye-tracking device for increasing newly in wear-type visual device Away from wherein, the eye-tracking device carries out scalability movement in default moving area；
Adjusting module, for according to the monocular interpupillary distance to light corresponding with the monocular interpupillary distance in the wear-type visual device It is whole that the display picture of element and/or display screen carries out adaptive auxiliary tone.
11. devices according to claim 10, it is characterised in that the acquisition module includes：
First acquisition unit, is treated with corresponding first focal length of interpupillary distance and with described with the near of the user to be detected for obtaining Detection user far uses corresponding second focal length of interpupillary distance；
Second acquisition unit, for being divided into multiple Moving Units by equidistant for the default moving area, controls the eye to move Tracks of device is moved in the default moving area, is traveled through the plurality of Moving Unit, is obtained respectively and described first The corresponding first group of measurement data of focal length and second group measurement data corresponding with second focal length；
Verification unit, for carrying out validity check to first group of measurement data and second group of measurement data, screening Go out measurement data to be calculated；
Computing unit, for asking for the monocular interpupillary distance using the measurement data to be calculated.
12. devices according to claim 11, it is characterised in that the first acquisition unit includes：
Subelement is obtained, for obtaining the first distance, second distance and the 3rd distance respectively, wherein, first distance is aobvious The distance between display screen and center of optical element, the second distance be the center and described simple eye between Distance, the 3rd distance is the distance between simple eye with described for sighting target；
Computation subunit, for when the nearly interpupillary distance triggering the described 3rd is measured apart from the first numerical value of selection, using described First focal length described in the exploitation of the first numerical value, the value of first distance and the second distance；And when measurement institute Remote interpupillary distance triggering the described 3rd is stated apart from when second value is chosen, using the second value, the value of first distance With the second focal length described in the exploitation of the second distance.
13. devices according to claim 11, it is characterised in that the second acquisition unit includes：
Control subelement, exports sighting target image for control display screen；
Adjustment subelement, for adjusting optical element to first focal length；
Measurement subelement, for controlling the eye-tracking device to survey the simple eye sight line data on current location Amount；
Judgment sub-unit, for when pendulous frequency reaches threshold value, judging the optical element whether adjusted to described Two focal lengths, if it is not, then the optical element is adjusted to second focal length, and after resetting the pendulous frequency, return The measurement subelement is back to, if it is, entering statistics subelement；When the pendulous frequency is not up to the threshold value, note Record the sight line data, control the eye-tracking device to move ahead and a Moving Unit the pendulous frequency is added 1, be back to The measurement subelement, wherein, the threshold value is determined by the quantity of the initial position and the plurality of Moving Unit；
The statistics subelement, for when the optical element is adjusted to first focal length, to measuring the institute for obtaining every time State sight line data to be counted, obtain first group of measurement data；And, when the optical element is adjusted to described second Jiao Away from when, count to measuring the sight line data for obtaining every time, obtain second group of measurement data.
14. devices according to claim 11, it is characterised in that the verification unit includes：
Verification subelement, for judging first group of measurement data and second group of measurement successively using default method of calibration Whether each data in data meet normal distribution；
Process subelement, for from first group of measurement data and second group of measurement data reject do not meet described just The invalid data of state distribution, obtains the measurement data to be calculated.
15. devices according to claim 10, it is characterised in that the adjusting module includes：
3rd acquiring unit, for obtain the 4th distance, wherein, described 4th distance for the optical element center with The distance between axis of the wear-type visual device；
First adjustment unit, for entering to the optical element according to the difference between the monocular interpupillary distance and the 4th distance The adaptive auxiliary tone of row is whole.
16. devices according to claim 15, it is characterised in that the adjusting module also includes：
4th acquiring unit, for obtaining the type identification of the currently used application program of the user to be detected；
First determining unit, for when the monocular interpupillary distance carries out mathematic interpolation with the 4th distance, according to the type Mark determines to select closely uses interpupillary distance with interpupillary distance or far.
17. devices according to claim 10, it is characterised in that the adjusting module includes：
5th acquiring unit, for obtain the 5th distance, wherein, described 5th distance for the display picture center with The distance between axis of the wear-type visual device；
Second adjustment unit, for entering to the display picture according to the difference between the monocular interpupillary distance and the 5th distance The adaptive auxiliary tone of row is whole.
18. devices according to claim 17, it is characterised in that the adjusting module also includes：
6th acquiring unit, for obtaining the type identification of the currently used application program of the user to be detected；
Second determining unit, for when the monocular interpupillary distance carries out mathematic interpolation with the 5th distance, according to the type Mark determines to select closely uses interpupillary distance with interpupillary distance or far.
19. a kind of wear-type visual device, it is characterised in that include：Control chip and the eye-tracking device, wherein, The control chip includes：Device any one of claim 10 to 18.
20. devices according to claim 19, it is characterised in that the equipment also includes：Hurdle and adjusting apparatus are intercepted,
Wherein, the adjusting apparatus are arranged on and intercept on hurdle, for carrying out self-adaptative adjustment to the position of optical element.
CN201610915186.2A 2016-10-20 2016-10-20 Simple eye visual field is adaptive to match method of adjustment and device, wear-type visual device Active CN106445167B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610915186.2A CN106445167B (en) 2016-10-20 2016-10-20 Simple eye visual field is adaptive to match method of adjustment and device, wear-type visual device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610915186.2A CN106445167B (en) 2016-10-20 2016-10-20 Simple eye visual field is adaptive to match method of adjustment and device, wear-type visual device

Publications (2)

Publication Number Publication Date
CN106445167A true CN106445167A (en) 2017-02-22
CN106445167B CN106445167B (en) 2019-09-20

Family

ID=58175790

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610915186.2A Active CN106445167B (en) 2016-10-20 2016-10-20 Simple eye visual field is adaptive to match method of adjustment and device, wear-type visual device

Country Status (1)

Country Link
CN (1) CN106445167B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106803950A (en) * 2017-03-02 2017-06-06 深圳晨芯时代科技有限公司 A kind of VR all-in-ones and its image adjusting method
CN106990847A (en) * 2017-04-06 2017-07-28 小派科技（上海）有限责任公司 A kind of virtual implementing helmet and the method for adjusting virtual implementing helmet interpupillary distance
CN107462992A (en) * 2017-08-14 2017-12-12 深圳创维新世界科技有限公司 A kind of adjusting method for wearing display device, device and wear display device
CN107562213A (en) * 2017-10-27 2018-01-09 网易（杭州）网络有限公司 Detection method, device and the wear-type visual device of visual fatigue state
WO2018214431A1 (en) * 2017-05-22 2018-11-29 歌尔科技有限公司 Method and apparatus for presenting scene using virtual reality device, and virtual reality apparatus
WO2019085487A1 (en) * 2017-10-30 2019-05-09 华为技术有限公司 Display apparatus and method and device for adjusting image display of the display apparatus
CN109856802A (en) * 2019-04-17 2019-06-07 京东方科技集团股份有限公司 Interpupillary distance adjusting method, device and virtual display device
WO2019109318A1 (en) * 2017-12-07 2019-06-13 深圳市柔宇科技有限公司 Head-mounted display device and adjustment control method therefor
CN110648369A (en) * 2019-09-23 2020-01-03 京东方科技集团股份有限公司 Calibration method and device for sight line calculation model parameters
TWI688254B (en) * 2018-12-11 2020-03-11 宏碁股份有限公司 Stereoscopic display device and parameter calibration method thereof
US10823970B2 (en) 2018-08-23 2020-11-03 Apple Inc. Head-mounted electronic display device with lens position sensing
WO2021082798A1 (en) * 2019-10-31 2021-05-06 华为技术有限公司 Head-mounted display device
CN113177434A (en) * 2021-03-30 2021-07-27 青岛小鸟看看科技有限公司 Virtual reality system fixation rendering method and system based on monocular tracking
US12061345B2 (en) 2018-08-23 2024-08-13 Apple Inc. Head-mounted electronic display device with lens position sensing

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060072206A1 (en) * 2004-10-01 2006-04-06 Takashi Tsuyuki Image display apparatus and image display system
CN102944935A (en) * 2012-11-13 2013-02-27 京东方科技集团股份有限公司 Binocular head-wearing display device and method thereof for adjusting image spacing
CN104871068A (en) * 2012-12-20 2015-08-26 微软技术许可有限责任公司 Auto-stereoscopic augmented reality display
WO2016077508A1 (en) * 2014-11-12 2016-05-19 Microsoft Technology Licensing, Llc System for automatic eye tracking calibration of head mounted display device
CN105653227A (en) * 2016-03-22 2016-06-08 北京全景思维科技有限公司 Head-mounted virtual reality display device and method for tracking focal length of eyeballs
WO2016105281A1 (en) * 2014-12-26 2016-06-30 Koc University Near-to-eye display device
CN105974588A (en) * 2016-06-14 2016-09-28 深圳市金立通信设备有限公司 Method for adjusting pupil distance of VR glasses, and VR glasses thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060072206A1 (en) * 2004-10-01 2006-04-06 Takashi Tsuyuki Image display apparatus and image display system
CN102944935A (en) * 2012-11-13 2013-02-27 京东方科技集团股份有限公司 Binocular head-wearing display device and method thereof for adjusting image spacing
CN104871068A (en) * 2012-12-20 2015-08-26 微软技术许可有限责任公司 Auto-stereoscopic augmented reality display
WO2016077508A1 (en) * 2014-11-12 2016-05-19 Microsoft Technology Licensing, Llc System for automatic eye tracking calibration of head mounted display device
WO2016105281A1 (en) * 2014-12-26 2016-06-30 Koc University Near-to-eye display device
CN105653227A (en) * 2016-03-22 2016-06-08 北京全景思维科技有限公司 Head-mounted virtual reality display device and method for tracking focal length of eyeballs
CN105974588A (en) * 2016-06-14 2016-09-28 深圳市金立通信设备有限公司 Method for adjusting pupil distance of VR glasses, and VR glasses thereof

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106803950A (en) * 2017-03-02 2017-06-06 深圳晨芯时代科技有限公司 A kind of VR all-in-ones and its image adjusting method
CN106990847A (en) * 2017-04-06 2017-07-28 小派科技（上海）有限责任公司 A kind of virtual implementing helmet and the method for adjusting virtual implementing helmet interpupillary distance
WO2018214431A1 (en) * 2017-05-22 2018-11-29 歌尔科技有限公司 Method and apparatus for presenting scene using virtual reality device, and virtual reality apparatus
CN107462992B (en) * 2017-08-14 2020-09-18 深圳创维新世界科技有限公司 Method and device for adjusting head-mounted display equipment and head-mounted display equipment
CN107462992A (en) * 2017-08-14 2017-12-12 深圳创维新世界科技有限公司 A kind of adjusting method for wearing display device, device and wear display device
CN107562213A (en) * 2017-10-27 2018-01-09 网易（杭州）网络有限公司 Detection method, device and the wear-type visual device of visual fatigue state
WO2019085487A1 (en) * 2017-10-30 2019-05-09 华为技术有限公司 Display apparatus and method and device for adjusting image display of the display apparatus
US11115648B2 (en) 2017-10-30 2021-09-07 Huawei Technologies Co., Ltd. Display device, and method and apparatus for adjusting image presence on display device
WO2019109318A1 (en) * 2017-12-07 2019-06-13 深圳市柔宇科技有限公司 Head-mounted display device and adjustment control method therefor
US12061345B2 (en) 2018-08-23 2024-08-13 Apple Inc. Head-mounted electronic display device with lens position sensing
US11726338B2 (en) 2018-08-23 2023-08-15 Apple Inc. Head-mounted electronic display device with lens position sensing
US11126004B2 (en) 2018-08-23 2021-09-21 Apple Inc. Head-mounted electronic display device with lens position sensing
US10823970B2 (en) 2018-08-23 2020-11-03 Apple Inc. Head-mounted electronic display device with lens position sensing
US10812785B2 (en) 2018-12-11 2020-10-20 Acer Incorporated Stereoscopic display device and parameter calibration method thereof
TWI688254B (en) * 2018-12-11 2020-03-11 宏碁股份有限公司 Stereoscopic display device and parameter calibration method thereof
CN109856802A (en) * 2019-04-17 2019-06-07 京东方科技集团股份有限公司 Interpupillary distance adjusting method, device and virtual display device
US11301039B2 (en) 2019-09-23 2022-04-12 Beijing Boe Optoelectronics Technology Co., Ltd. Method and device for calculating parameters of gaze-point calculation model
CN110648369B (en) * 2019-09-23 2022-07-19 京东方科技集团股份有限公司 Calibration method and device for sight line calculation model parameters
CN110648369A (en) * 2019-09-23 2020-01-03 京东方科技集团股份有限公司 Calibration method and device for sight line calculation model parameters
WO2021082798A1 (en) * 2019-10-31 2021-05-06 华为技术有限公司 Head-mounted display device
CN113177434A (en) * 2021-03-30 2021-07-27 青岛小鸟看看科技有限公司 Virtual reality system fixation rendering method and system based on monocular tracking
WO2022205769A1 (en) * 2021-03-30 2022-10-06 青岛小鸟看看科技有限公司 Virtual reality system foveated rendering method and system based on single eyeball tracking
US11715176B2 (en) 2021-03-30 2023-08-01 Qingdao Pico Technology Co, Ltd. Foveated rendering method and system of virtual reality system based on monocular eyeball tracking

Also Published As

Publication number Publication date
CN106445167B (en) 2019-09-20

Similar Documents

Publication Publication Date Title
CN106445167A (en) Monocular vision field self-adaptive adjustment method and device and wearable visual device
AU2004325004B2 (en) Method for designing spectacle lenses taking into account an individual's head and eye movement
CN103424891B (en) Imaging device and method
US20190235624A1 (en) Systems and methods for predictive visual rendering
CN103558909B (en) Interaction projection display packing and interaction projection display system
US7090348B2 (en) Method for designing spectacle lenses taking into account an individual's head and eye movement
US20170092007A1 (en) Methods and Devices for Providing Enhanced Visual Acuity
CN111511318A (en) Digital treatment correcting glasses
CN103501406B (en) Image collecting system and image collecting method
CN104090371B (en) A kind of 3D glasses and 3D display systems
CN103605208A (en) Content projection system and method
CN105992965A (en) Stereoscopic display responsive to focal-point shift
JP6332392B2 (en) Spectacle lens design method, spectacle lens manufacturing method, spectacle lens selection device, and spectacle lens selection method
CN103431840A (en) System and method for detecting optical parameters of eyes
JP7165994B2 (en) Methods and devices for collecting eye measurements
CN106526867A (en) Image picture display control method, image picture display control device and head wearing type display equipment
Tatler et al. Eye movement recordings in natural settings
Dunn Required accuracy of gaze tracking for varifocal displays
CN203882018U (en) 3D glasses and 3D display system
JPH08266465A (en) Simulation apparatus for eye optical system
EP4171350B1 (en) Method and device for determining at least one astigmatic effect of at least one eye
US11892366B2 (en) Method and system for determining at least one optical parameter of an optical lens
EP4220282A1 (en) Determining a lens shape for producing an optical lens for an eye of a person
US20230190093A1 (en) Methods for determining an ophthalmic lens and associated optometry device
Buapong et al. A Low-Complexity and Efficient VR-Based System with Infrared Image Processing for Assessing the Angle of Ocular Misalignment in Strabismus Patients

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant