CN106371578B - Nearly eye display control method and device - Google Patents

Nearly eye display control method and device Download PDF

Info

Publication number
CN106371578B
CN106371578B CN201510941273.0A CN201510941273A CN106371578B CN 106371578 B CN106371578 B CN 106371578B CN 201510941273 A CN201510941273 A CN 201510941273A CN 106371578 B CN106371578 B CN 106371578B
Authority
CN
China
Prior art keywords
eyeground
subgraph
moment
display
fundus imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510941273.0A
Other languages
Chinese (zh)
Other versions
CN106371578A (en
Inventor
杜琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhigu Ruituo Technology Services Co Ltd
Original Assignee
Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhigu Ruituo Technology Services Co Ltd filed Critical Beijing Zhigu Ruituo Technology Services Co Ltd
Priority to CN201510941273.0A priority Critical patent/CN106371578B/en
Publication of CN106371578A publication Critical patent/CN106371578A/en
Application granted granted Critical
Publication of CN106371578B publication Critical patent/CN106371578B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The invention relates to a kind of nearly eye display control method and devices, wherein the nearly eye display control method includes: to obtain the corresponding fundus imaging of t moment, and the fundus imaging includes the superposition of eyeground subgraph and the display subgraph shown on eyeground;Obtain t+1 moment corresponding eyeground subgraph;According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, t+1 moment content to be displayed is carried out in the display control on eyeground.The stabilization that the program realizes nearly eye is shown.

Description

Nearly eye display control method and device
Technical field
This application involves field of display technology, more particularly to a kind of nearly eye display control method and device.
Background technique
In recent years, nearly eye display technology continues to develop, and becomes one of best presentation mode of virtual reality.Since nearly eye is aobvious Show that there are magnification at high multiple, therefore, the small movement such as near-eye display device and/or user's head may all bring display picture Significant shake results even in user and generates the discomforts such as giddy to influence the viewing impression of user.
Summary of the invention
The brief overview about the application is given below, in order to provide the basic of some aspects about the application Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form, Taking this as a prelude to a more detailed description discussed later.
The application provides a kind of nearly eye display control method and device.
In a first aspect, the embodiment of the present application provides a kind of nearly eye display control method, comprising:
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes eyeground subgraph and shows on eyeground aobvious Show the superposition of subgraph;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, when carrying out t+1 Content to be displayed is carved in the display control on eyeground.
It is optionally, described according at least to described in conjunction with any nearly eye display control method provided by the embodiments of the present application The eyeground subgraph of the fundus imaging of t moment and the t+1 moment carries out t+1 moment content to be displayed on eyeground Display control, comprising: according at least to the fundus imaging of the t moment, included by the fundus imaging for determining the t moment The t relative position information of eyeground subgraph and display subgraph;According at least to the t relative position information and the t+ The eyeground subgraph at 1 moment carries out t+1 moment content to be displayed in the display control on eyeground.
It is optionally, described according at least to described in conjunction with any nearly eye display control method provided by the embodiments of the present application The eyeground subgraph of t relative position information and the t+1 moment carries out t+1 moment content to be displayed in the aobvious of eyeground Show control, comprising: according at least to the eyeground subgraph of the t relative position information and the t+1 moment, determine described The t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;The t+1 moment content to be displayed is controlled to exist The t+1 shows that subregion is shown.
It is optionally, described according at least to described in conjunction with any nearly eye display control method provided by the embodiments of the present application The fundus imaging of t moment determines that eyeground subgraph is opposite with the display t of subgraph in the fundus imaging of the t moment Location information, comprising: eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph;Root The t relative position information of eyeground subgraph and display subgraph in the fundus imaging of the t moment is determined according to separating resulting.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the separation is described Eyeground subgraph included by the fundus imaging of t moment and display subgraph, comprising: separated according at least to eyeground characteristic information Eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.
It is optionally, described according at least to eyeground in conjunction with any nearly eye display control method provided by the embodiments of the present application It is described before characteristic information separates eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph Method further include: obtain the eyeground characteristic information.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the separation is described Eyeground subgraph included by the fundus imaging of t moment and display subgraph, comprising: according at least to eyeground with reference to subgraph point Eyeground subgraph included by fundus imaging corresponding from the t moment and display subgraph.
It is optionally, described according at least to eyeground in conjunction with any nearly eye display control method provided by the embodiments of the present application Before separating eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph with reference to subgraph, institute State method further include: obtain the eyeground with reference to subgraph.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the eyeground refers to subgraph Eyeground subgraph as being the t+1 moment.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the separation is described Eyeground subgraph included by the fundus imaging of t moment and display subgraph, comprising: corresponding according at least to the t moment Fundus imaging included by the corresponding source contents of display subgraph, separate included by the corresponding fundus imaging of the t moment Eyeground subgraph and display subgraph.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the acquisition t moment pair Before the fundus imaging answered, the method also includes: determine that direction of visual lines remains unchanged.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the determining direction of visual lines It remains unchanged, comprising: it falls into one in response to the difference of t moment and t+1 moment corresponding direction of visual lines and allows disparity range, Determine that direction of visual lines remains unchanged.
Second aspect, the embodiment of the present application also provides a kind of nearly eye display control units, comprising:
One fundus imaging obtains module, and for obtaining the corresponding fundus imaging of t moment, the fundus imaging includes eyeground The superposition of subgraph and the display subgraph shown on eyeground;
Bottom image collection module at a glance, for obtaining t+1 moment corresponding eyeground subgraph;
One display control module, for according at least to the t moment fundus imaging and the eyeground at the t+1 moment Subgraph carries out t+1 moment content to be displayed in the display control on eyeground.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the display control module It include: a relative position information acquisition submodule, for the fundus imaging according at least to the t moment, when determining the t The t relative position information of eyeground subgraph included by the fundus imaging at quarter and display subgraph;One display control submodule, For the eyeground subgraph according at least to the t relative position information and the t+1 moment, the progress t+1 moment waits showing Show content in the display control on eyeground.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the display control submodule Block includes: a display subregion determination unit, for according at least to the t relative position information and the t+1 moment Eyeground subgraph determines that the t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;One display control Unit processed shows that subregion is shown in the t+1 for controlling the t+1 moment content to be displayed.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the relative position information Acquisition submodule includes: a separation processing unit, for separating of eyeground included by the fundus imaging of the t moment Image and display subgraph;One relative position information acquiring unit, for determining the eyeground of the t moment according to separating resulting The t relative position information of eyeground subgraph and display subgraph in imaging.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the separation processing unit It include: the first separating treatment subelement, for separating the corresponding fundus imaging of the t moment according at least to eyeground characteristic information Included eyeground subgraph and display subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, described device further include: one Eyeground characteristic information obtains module, for obtaining the eyeground characteristic information.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the separation processing unit It include: one second separating treatment subelement, for separating the corresponding eyeground of the t moment with reference to subgraph according at least to eyeground The included eyeground subgraph of imaging and display subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, described device further include: one Eyeground obtains module with reference to subgraph, for obtaining the eyeground with reference to subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the eyeground refers to subgraph Eyeground subgraph as being the t+1 moment.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the separation processing unit It include: a third separating treatment subelement, for according at least to of display included by the corresponding fundus imaging of the t moment The corresponding source contents of image separate eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, described device further include: one Direction of visual lines determining module for determining that direction of visual lines remains unchanged, and triggers the fundus imaging according to definitive result and obtains Module, the eyeground subgraph obtain module and/or the display control module.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the direction of visual lines is determined Module includes: that a direction of visual lines determines submodule, for the difference in response to t moment and t+1 moment corresponding direction of visual lines It is different to fall into one and allow disparity range, determine that direction of visual lines remains unchanged, and the fundus imaging is triggered according to definitive result and is obtained Module, the eyeground subgraph obtain module and/or the display control module.
The third aspect, the embodiment of the present application also provides another nearly eye display control units, comprising:
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface with And the memory completes mutual communication by the communication bus;
The memory is for storing at least one instruction;At least one instruction makes the processor execute following operation:
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes eyeground subgraph and shows on eyeground aobvious Show the superposition of subgraph;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, when carrying out t+1 Content to be displayed is carved in the display control on eyeground.
Technical solution provided by the embodiments of the present application can obtain and when according at least to the fundus imaging and t+1 of t moment The eyeground subgraph at quarter carries out the display control at t+1 moment, so that t+1 moment near-eye display device projects the aobvious of eyeground Show that subgraph changes in the relative position of the display subregion on eyeground, counteracts and show subregion phase caused by the two relative motion To the variation of the relative position on eyeground, be equivalent to different moments project eyeground display subgraph display subregion with respect to eyeground Position substantially even completely it is constant, be conducive to improve user viewing comfort level, improve user experience.The application is such as close The situations such as relative motion occur for eye display equipment and human eye, it can be achieved that stabilization of the source contents on eyeground is shown, and can not depended on used Property measuring unit (Inertial measurement unit, abbreviation IMU) hardware, improve the flexibility and general of scheme implementation Adaptive.
By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application Advantage will be apparent from.
Detailed description of the invention
The application can be by reference to being better understood, wherein in institute below in association with description given by attached drawing Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings:
Fig. 1 is a kind of flow chart of nearly eye display control method provided by the embodiments of the present application;
Fig. 2 is a kind of example of fundus imaging provided by the embodiments of the present application;
Fig. 3 is the logic diagram of the first nearly eye display control unit provided by the embodiments of the present application;
Fig. 4 is the logic diagram of second provided by the embodiments of the present application close display control unit;
Fig. 5 is the logic diagram of the third nearly eye display control unit provided by the embodiments of the present application.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear, And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with Just the understanding to the embodiment of the present application is helped to improve.
Specific embodiment
It is described in detail hereinafter in connection with exemplary embodiment of the attached drawing to the application.It rises for clarity and conciseness See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from For those skilled in the art of present disclosure, this development is only routine task.
Here, also it should be noted is that, in order to avoid having obscured the application because of unnecessary details, in attached drawing and It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.
(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.
Stabilization, which is shown, is generally based on the realization of motion-sensing element, such as installs IMU hardware on the display device, passes through IMU Angular speed and acceleration of measurement display equipment etc., the motion information of display equipment are determined according to measurement result, and aobvious according to this Show that the motion information of equipment controls the display of subsequent source contents, so that the content of subsequent display counteracts the movement because showing equipment Bring float, to realize that stablizing for display picture shows.Present inventor is in the mistake for practicing the embodiment of the present application It is found in journey, although can offset the shake of display picture to a certain extent based on IMU, it relies on IMU hardware and is to be directed to Display equipment itself carries out showing that the stabilization of picture is shown in the case of moving, and in nearly eye display field, in addition to nearly eye Display equipment may occur outside movement, human body head is it can also happen that movement;If near-eye display device and human eye there is no Relative motion, even if then the two may all move, but apparently with regard to user, display subgraph can't be shaken;Conversely, If relative motion occurs for near-eye display device and human eye, apparently with regard to user, relative jitter may occur for display subgraph, by This may cause user and watches discomfort, influence user experience.For this purpose, the embodiment of the present application for nearly eye display field provide it is anti- Tremble display solution.
Fig. 1 is a kind of flow chart of nearly eye display control method provided by the embodiments of the present application.The embodiment of the present application provides The executing subject of nearly eye display control method can be a certain nearly eye display control unit, the nearly eye display control unit can be But it is not limited to relate in the application processes such as content presentation, video playing carry out content by executing the nearly eye display control method Display control.The equipment form of expression of the nearly eye display control unit is unrestricted, such as the nearly eye display control unit It can be a certain independent component, the component and near-eye display device match hop communication;Alternatively, the display control unit can be used as certain One functional module is integrated in a near-eye display device;The near-eye display device may include but be not limited to Helmet Mounted Display, intelligence Energy glasses etc..Specifically as shown in Figure 1, a kind of nearly eye display control method provided by the embodiments of the present application includes:
S101: obtaining the corresponding fundus imaging of t moment, and the fundus imaging includes eyeground subgraph and shows on eyeground Display subgraph superposition.
S102: t+1 moment corresponding eyeground subgraph is obtained.
It, can be by the projection optics system of near-eye display device by source contents in technical solution provided by the embodiments of the present application Light project the eyeground of human eye to be imaged, then the image on eyeground is obtained by the camera of near-eye display device, should The image on the eyeground got under situation might as well be known as fundus imaging, as shown in Fig. 2, the fundus imaging obtained is eyeground itself Throw light image formed by eyeground that (might as well be known as eyeground subgraph) and source contents is imaged (might as well be known as display subgraph Picture) superposition, that is, the fundus imaging be eyeground subgraph and show subgraph superposition.
In practical application, can get certain moment (t moment might as well be expressed as) corresponding fundus imaging and with the moment Adjacent one is in corresponding eyeground subgraph of rear moment (might as well be expressed as the t+1 moment), wherein it is described it is adjacent be opposite Concept, such as two adjacent moments can refer to the moment for shorter two of time interval, alternatively, two adjacent moments can be in corresponding source Consecutive frame in appearance determines alternatively, two adjacent moments can be actually needed according to user, the embodiment of the present application to this and it is unlimited System;The corresponding fundus imaging of t moment got is eyeground subgraph and the superposition for showing subgraph, the t+1 got Moment corresponding eyeground subgraph is the image on eyeground itself.
S103: according at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, t is carried out Display control of+1 moment content to be displayed on eyeground.
Nearly eye show application process in, if between near-eye display device and human eye eyeground occur relative motion (including One of near-eye display device and human eye eyeground move, alternatively, both near-eye display device and human eye eyeground are sent out Life moves and the two is not opposing stationary), then the relative motion can cause display subgraph with respect to the shake on eyeground, to influence The display of content then needs to carry out the stabilization display control of image.
And if there is no relative motion, (including the two is in static shape between near-eye display device and human eye eyeground State, alternatively, the two is respectively at motion state but the two is opposing stationary) in the case of, the projection of different moments near-eye display device Display subgraph to eyeground is remained unchanged in the relative position of the display subregion on eyeground, in consideration of it, can be according at least to t when The fundus imaging and the eyeground subgraph at t+1 moment at quarter carry out the display control at t+1 moment (including when according to the t The fundus imaging at quarter and the eyeground subgraph at the t+1 moment carry out t+1 moment content to be displayed in the display control on eyeground System, alternatively, the fundus imaging of the t moment and the eyeground subgraph at the t+1 moment are believed in conjunction with other auxiliary references Breath carries out t+1 moment content to be displayed in the display control on eyeground) so that t+1 moment near-eye display device projects eye The display subgraph at bottom falls into the variation of the relative position of the display subregion on eyeground and permissible range or even remains unchanged, and thus one Determine display subregion caused by counteracting the two relative motion in degree to change with respect to the relative position on eyeground, realizes source contents Stabilization on eyeground is shown.
As it can be seen that technical solution provided by the embodiments of the present application, can obtain and the fundus imaging according at least to t moment and The eyeground subgraph at t+1 moment carries out the display control at t+1 moment, so that t+1 moment near-eye display device projects eye The display subgraph at bottom changes in the relative position of the display subregion on eyeground, counteracts display caused by the two relative motion Region with respect to eyeground relative position change, be equivalent to different moments project eyeground display subgraph display subregion phase It is substantially even completely constant to the position on eyeground, be conducive to the comfort level for improving user's viewing, improve user experience.The application exists The situations such as relative motion occur for near-eye display device and human eye, it can be achieved that stabilization of the source contents on eyeground is shown, and stabilization Display control can not depend on IMU hardware, improve the flexibility and universality of scheme implementation.
Optionally, the fundus imaging and the eyeground subgraph at the t+1 moment according at least to the t moment, T+1 moment content to be displayed is carried out in the display control on eyeground, comprising: according at least to the fundus imaging of the t moment, really The relative position information of eyeground subgraph included by the fundus imaging of the fixed t moment and display subgraph (might as well be known as T relative position information);According at least to the eyeground subgraph of the t relative position information and the t+1 moment, carry out Display control of the t+1 moment content to be displayed on eyeground.Included by fundus imaging of the program according at least to the t moment Eyeground subgraph and display subgraph t relative position information and the eyeground subgraph at the t+1 moment, carry out the T+1 moment content to be displayed may make the t+1 moment to project the display subgraph on eyeground with respect to eye in the display control on eyeground The display subregion at bottom projects the change in location for showing subregion on the opposite eyeground of display subgraph on eyeground with t moment For very little even without changing, the relative motion that can be offset between near-eye display device and human eye eyeground to a certain extent may Caused by show the offset of sub-window position, thus improve the stability that nearly eye shows image.
Wherein, the relative position letter of eyeground subgraph included by the corresponding fundus imaging of any moment and display subgraph Breath, can through but not limited to eyeground subgraph point and display subgraph eyeground show subregion in respective point between Translation (Translation), scaling (Scaling) rotate Relative Transformations relationships such as (Rotation) to express, that is to say, that It can be by constructing the transformation square of the point and display subgraph of eyeground subgraph between the respective point in the display subregion on eyeground The relative positional relationship of battle array, the eyeground Lai Fanying subgraph and display subgraph between the display subregion on eyeground, the transformation Matrix may include but be not limited to translation transformation matrix, scale transformation matrix, rotational transformation matrix etc..It might as well be to reflect eyeground It is illustrated for the transformation matrix of relative position information between image and the corresponding display subregion of display subgraph.
For example, the translation transformation matrix can join according to eyeground subgraph display subregion corresponding with display subgraph The relative movement component for examining the different reference axis of coordinate system is constructed, such as certain point [x, y, z, 1] in the subgraph of eyeground and aobvious Show that certain point [x', y', z', 1] in subregion in the mobile component of three reference axis is respectively dx=Tx, dy=Ty, dz=Tz, That is:
X'=x+Tx, y'=y+Ty, z'=z+Tz................................ (1)
Then, the translation transformation relationship between respective point can be expressed as follows:
In another example the scale transformation matrix can be according to eyeground subgraph display subregion corresponding with display subgraph Opposite zoom degree is constructed, such as in certain point [x, y, z, 1] and display subregion in the subgraph of eyeground certain point [x', y', Z', 1] it is respectively Sx, Sy and Sz in the coordinate value scaling of three reference axis, the coordinate value of respective point meets:
X'=x*Sx, y'=y*Sy, z'=z*Sz................................ (3)
Then, the scale transformation relationship between respective point can be expressed as follows:
For another example the rotational transformation matrix can be according to eyeground subgraph display subregion corresponding with display subgraph Relative rotation angle is constructed, for might as well being rotated around X-axis, certain point in the subgraph of eyeground and certain point in display subregion X axis coordinate it is constant, Y axis coordinate and Z axis coordinate rotate θ degree around X-axis, and the positive direction of rotation is clockwise (along rotation Axis negative direction is seen to origin), then the rotation transformation relationship between respective point can be expressed as follows:
It should be noted that the building side of the transformation matrixs such as translation transformation matrix, scale transformation matrix, rotational transformation matrix Formula is the prior art, and the example of the above building mode is only the example of optional building mode, should not be construed as implementing the application The limitation of example technical solution essence.
It, can be according at least to the t relative position information and the t+ after obtaining the t relative position information The eyeground subgraph at 1 moment carries out t+1 moment content to be displayed in the display control on eyeground, so that the t+1 moment projects To eyeground display subgraph with respect to the display subregion on eyeground, project the opposite eye of the display subgraph on eyeground with t moment The change in location very little (i.e. variation degree be less than preset allow variation range) of the display subregion at bottom is even without becoming Change;Specific display control method can determine according to actual needs, and implementation is very flexible.
For example, the content to be displayed at adjustment t+1 moment can be corresponded to after obtaining the t relative position information, with into The display control at row t+1 moment, source contents that such as can be to be shown to the t+1 moment according to the t relative position information (It+1)Before correctionIt is corrected display control:
(It+1)After correction=(It+1)Before correction·E...............(6)
Alternatively, the projection of adjustment t+1 moment content to be displayed can be corresponded to after obtaining the t relative position information PTZ (Pan-tilt-zoom) parameter, such as can be according to the t relative position information to the source of t+1 moment content to be displayed Projection P TZ parameter (pt+1)Before correctionIt is corrected display control:
(Pt+1)After correction=(Pt+1)Before correction·E..................(7)
E indicates the t relative position information in above-mentioned formula (6) and (7), can be used but is not limited to the transformation square Battle array, the transformation matrix may include but be not limited to above-mentioned formula (2), (4), form shown in (5).
Still optionally further, the eyeground subgraph according at least to the t relative position information and the t+1 moment Picture carries out t+1 moment content to be displayed in the display control on eyeground, comprising: according at least to the t relative position information and The eyeground subgraph at the t+1 moment determines the display subregion on the relatively described eyeground of t+1 moment content to be displayed (t+1 might as well be known as and show subregion);Control the t+1 moment content to be displayed the t+1 show subregion into Row display.The program can determine institute according at least to the eyeground subgraph of the t relative position information and the t+1 moment The t+1 for stating the relatively described eyeground of t+1 moment content to be displayed shows subregion, by adjusting projection parameter, adjustment optical path Etc. one or more means, the t+1 that the t+1 moment content to be displayed projects opposite eyeground is shown into sub-district Domain, in this way, the t+1 show subregion and t moment project the opposite eyeground of the display subgraph on eyeground t show it is sub The change in location very little in region can be offset between near-eye display device and human eye eyeground to a certain extent even without changing The offset of display sub-window position that may cause of relative motion, improve the stability that nearly eye shows image.
In technical solution provided by the embodiments of the present application, eyeground included by the corresponding fundus imaging of the t moment The method of determination of relative position information between image and display subgraph is very flexible, and the application is not intended to limit this.
Optionally, the fundus imaging according at least to the t moment, in the fundus imaging for determining the t moment The t relative position information of eyeground subgraph and display subgraph, comprising: the fundus imaging institute of the separation t moment Including eyeground subgraph and display subgraph;Eyeground subgraph in the fundus imaging of the t moment is determined according to separating resulting The t relative position information of picture and display subgraph.In a certain fundus imaging, between eyeground subgraph and display subgraph Separate mode is very flexible, and the embodiment of the present application is not intended to limit this.Optionally, it is shown due to eyeground subgraph and on eyeground Show that the feature difference of subgraph is larger, therefore using the display feature of eyeground subgraph, display at least one of subgraph, Can eyeground subgraph to a certain fundus imaging and display subgraph separate, and determine eyeground subgraph and display subgraph Relative position information, thus improve fundus imaging separation efficiency and accuracy.
For example, eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph, It include: to separate eyeground subgraph included by the corresponding fundus imaging of the t moment according at least to eyeground characteristic information and show Show subgraph.The eyeground of human eye usually has known relatively stable feature (such as retina textural characteristics), these stabilizations Feature can be used as the eyeground characteristic information, the feature for the display subgraph that eyeground shows is projected with near-eye display device Usually differ greatly, therefore, can be separated according at least to the eyeground characteristic information eyeground subgraph in a certain fundus imaging and Show subgraph.The program can make full use of the characteristic information on eyeground to carry out eyeground image subsection and display subgraph in fundus imaging Separation.Wherein, the characteristic information on the eyeground can obtain in advance, i.e., described to appoint according at least to characteristic information separation in eyeground is described Before eyeground subgraph included by one moment corresponding fundus imaging and display subgraph, further includes: it is special to obtain the eyeground Reference breath, and the acquisition modes of the eyeground characteristic information are very flexible, such as the eye of human eye general character can be obtained to external equipment Bottom feature is as the eyeground characteristic information, alternatively, can be extracted by carrying out common feature to several eyeground subgraphs to obtain Described eyeground characteristic information, etc., the embodiment of the present application comparison are not intended to limit.
In another example eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph Picture, comprising: separate eyeground subgraph included by the corresponding fundus imaging of the t moment with reference to subgraph according at least to eyeground With display subgraph.The eyeground is using the eyeground subgraph as reference picture with reference to subgraph, that is to say, that not to eye Can shoot the image on eyeground in the case where bottom projection display content, the image on the eyeground shot in this way be eyeground itself at Picture is not superimposed external display content.After obtaining the eyeground with reference to subgraph, it can be referred to according at least to the eyeground Subgraph carries out the separation of the fundus imaging of any moment, such as can be used but be not limited to fundus imaging and eyeground with reference to subgraph The methods of subtract each other and to be separated.The eyeground is very flexible with reference to the acquisition modes of subgraph, can such as show projecting to eyeground The image that eyeground is shot before content refers to the corresponding eyeground of any moment as described in subgraph separation according at least to eyeground described in Before the included eyeground subgraph of imaging and display subgraph, further includes: obtain the eyeground with reference to subgraph;Alternatively, can Using the eyeground subgraph of the user obtained in advance as the eyeground with reference to subgraph, etc., the embodiment of the present application to this not Limitation.The program can divide eyeground subgraph in fundus imaging and display subgraph with reference to subgraph according at least to eyeground From.Still optionally further, the eyeground is the eyeground subgraph at the t+1 moment, program reusable institute with reference to subgraph State the t+1 moment eyeground subgraph carry out the t moment fundus imaging separation, improve efficiency.
For another example eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph Picture, comprising: according at least to the corresponding source contents of display subgraph included by the corresponding fundus imaging of the t moment, separation Eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.Source contents are through near-eye display device It projects and forms a display subgraph on eyeground behind the eyeground of human eye, show there is association between subgraph and source contents, therefore, The program can at least make full use of the characteristic of source contents to realize eyeground subgraph and the separation for showing subgraph in fundus imaging.
It should be noted that above-mentioned eyeground characteristic information, eyeground are with reference to two kinds or two in subgraph, corresponding source contents Kind of information above is also in combination with getting up, collectively as the separation foundation of fundus imaging, to improve the accuracy of fundus imaging separation.
In conjunction with any technical solution provided by the embodiments of the present application, still optionally further, the acquisition t moment is corresponding Fundus imaging before, the method also includes: determine that direction of visual lines remains unchanged.Wherein, the detection of the direction of visual lines of human eye Method is the prior art, and the embodiment of the present application repeats no more.If no change has taken place as time goes by human eye sight direction Or no change has taken place substantially, illustrates that the constant probability in human eye concern direction is larger, under the situation, passes through the embodiment of the present application The stabilization that the technical solution of offer carries out near-eye image is shown, can effectively offset the relative motion on near-eye display device and eyeground, The comfort level of human eye viewing is improved, improves user experience, more preferably meets user demand.The determining direction of visual lines remains unchanged and is A opposite probability, it may include the stringent constant situation of direction of visual lines, the variation that may also comprise the direction of visual lines of different moments exist The situation for centainly allowing disparity range, such as falls into an appearance in response to the difference of t moment and t+1 moment corresponding direction of visual lines Perhaps disparity range determines that direction of visual lines remains unchanged, to improve the flexibility and universality of scheme realization.If human eye sight side To there is larger change as time goes by, illustrate that the probability for paying close attention to direction change is larger, at this point, prior art progress can be used Display adjusts the aobvious of itself concern by the change of direction of visual lines without executing stabilization display control to meet user Show that the nearly eye of content shows demand.
It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and Any restriction should not be constituted to the implementation process of the application specific embodiment.
Fig. 3 is the logic diagram of the first nearly eye display control unit provided by the embodiments of the present application.As shown in figure 3, this Apply for the nearly eye display control unit that embodiment provides can include: a fundus imaging obtains module 31, the at a glance acquisition of bottom image Module 32 and a display control module 33.
Fundus imaging obtains module 31 for obtaining the corresponding fundus imaging of t moment, and the fundus imaging includes eyeground The superposition of subgraph and the display subgraph shown on eyeground.
Eyeground subgraph obtains module 32 for obtaining t+1 moment corresponding eyeground subgraph.
Display control module 33 is used for fundus imaging and the eyeground at the t+1 moment according at least to the t moment Subgraph carries out t+1 moment content to be displayed in the display control on eyeground.
Technical solution provided by the embodiments of the present application can obtain and when according at least to the fundus imaging and t+1 of t moment The eyeground subgraph at quarter carries out the display control at t+1 moment, so that t+1 moment near-eye display device projects the aobvious of eyeground Show that subgraph changes in the relative position of the display subregion on eyeground, counteracts and show subregion phase caused by the two relative motion To the variation of the relative position on eyeground, be equivalent to different moments project eyeground display subgraph display subregion with respect to eyeground Position substantially even completely it is constant, be conducive to improve user viewing comfort level, improve user experience.The application is such as close The situations such as relative motion occur for eye display equipment and human eye, it can be achieved that stabilization of the source contents on eyeground is shown, and can not depend on IMU Hardware improves the flexibility and universality of scheme implementation.
The nearly eye display control unit can but be not limited to relate to pass through in the application processes such as content presentation, video playing Execute the display control that the nearly eye display control method carries out content, module, submodule, unit or sub-unit in described device Working mechanism and datail description can be found in the corresponding record of embodiment of the method, the application repeats no more.The nearly eye display control The equipment form of expression of device processed is unrestricted, such as the nearly eye display control unit can be a certain independent component, the portion Part and near-eye display device match hop communication;Alternatively, the display control unit, which can be used as a certain functional module, is integrated in a nearly eye It shows in equipment;The near-eye display device may include but be not limited to Helmet Mounted Display, intelligent glasses etc..
Optionally, as shown in figure 4, the display control module 33 includes: 331 He of a relative position information acquisition submodule One display control submodule 332.Relative position information acquisition submodule 331 be used for according at least to the t moment eyeground at Picture determines eyeground subgraph included by the fundus imaging of the t moment and shows the t relative position information of subgraph; Display control submodule 332 is used for the eyeground subgraph according at least to the t relative position information and the t+1 moment, T+1 moment content to be displayed is carried out in the display control on eyeground.Fundus imaging institute of the program according at least to the t moment Including eyeground subgraph and display subgraph t relative position information and the eyeground subgraph at the t+1 moment, into Row t+1 moment content to be displayed may make the t+1 moment to project the display subgraph phase on eyeground in the display control on eyeground To the display subregion on eyeground, the position for showing subregion on the opposite eyeground of the display subgraph on eyeground is projected with t moment It varies less even without changing, the relative motion between near-eye display device and human eye eyeground can be offset to a certain extent Thus the offset for the display sub-window position that may cause improves the stability that nearly eye shows image.
Still optionally further, the display control submodule 332 includes: that a display subregion determination unit 3321 and one is aobvious Show control unit 3322.Show that subregion determination unit 3321 is used for according at least to the t relative position information and the t The eyeground subgraph at+1 moment determines that the t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion; Display control unit 3322 shows that subregion is shown in the t+1 for controlling the t+1 moment content to be displayed. The program can determine the t+1 according at least to the eyeground subgraph of the t relative position information and the t+1 moment The t+1 on the relatively described eyeground of moment content to be displayed shows subregion, by adjusting projection parameter, adjustment optical path etc. it is a kind of or The t+1 that the t+1 moment content to be displayed projects opposite eyeground is shown subregion, in this way, institute by multiple means It states t+1 and shows that subregion and t moment project the position of the t display subregion on the opposite eyeground of the display subgraph on eyeground It varies less even without changing, the relative motion between near-eye display device and human eye eyeground can be offset to a certain extent The offset for the display sub-window position that may cause improves the stability that nearly eye shows image.
Optionally, the relative position information acquisition submodule 331 includes: a separation processing unit 3311 and an opposite position Set information acquisition unit 3312.Separation processing unit 3311 is for separating included by the fundus imaging of the t moment Eyeground subgraph and display subgraph;Relative position information acquiring unit 3312 is for when determining the t according to separating resulting The t relative position information of eyeground subgraph and display subgraph in the fundus imaging at quarter.The program can using eyeground subgraph, Show the display feature of at least one of subgraph, can eyeground subgraph to a certain fundus imaging and display subgraph divide From, and determine eyeground subgraph and show the relative position information of subgraph, thus improve the efficiency and standard of fundus imaging separation True property.
Optionally, the separation processing unit 3311 includes: the first separating treatment subelement 33111.First separating treatment Subelement 33111 is used to separate eyeground included by the corresponding fundus imaging of the t moment according at least to eyeground characteristic information Subgraph and display subgraph.Still optionally further, the nearly eye display control unit may also include that an eyeground characteristic information obtains Modulus block 34, eyeground characteristic information obtain module 34 for obtaining the eyeground characteristic information.The program can make full use of eyeground Characteristic information carry out fundus imaging in eyeground image subsection and display subgraph separation.
Optionally, the separation processing unit 3311 includes: the second separating treatment subelement 33112.Second separating treatment Subelement 33112 is used to separate eye included by the corresponding fundus imaging of the t moment with reference to subgraph according at least to eyeground Bottom image and display subgraph.Further, optionally, the nearly eye display control unit may also include that an eyeground with reference to son Image collection module 35, eyeground obtain module 35 for obtaining the eyeground with reference to subgraph with reference to subgraph, and the program can be extremely It is few that eyeground subgraph in fundus imaging and display subgraph are separated with reference to subgraph according to eyeground.Alternatively, optionally, institute State eyeground subgraph of the eyeground with reference to subgraph for the t+1 moment.
Optionally, the separation processing unit 3311 includes: third separating treatment subelement 33113.Third separating treatment Subelement 33113 is used for according at least in the corresponding source of display subgraph included by the corresponding fundus imaging of the t moment Hold, separates eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.The program can at least fill Divide the separation that eyeground subgraph and display subgraph in fundus imaging are realized using the characteristic of source contents.
It should be noted that above-mentioned eyeground characteristic information, eyeground are with reference to two kinds or two in subgraph, corresponding source contents Kind of information above is also in combination with getting up, collectively as the separation foundation of fundus imaging, to improve the accuracy of fundus imaging separation.
In conjunction with any technical solution provided by the embodiments of the present application, optionally, the nearly eye display control unit is also wrapped It includes: a direction of visual lines determining module 36.Direction of visual lines determining module 36 is for determining that direction of visual lines remains unchanged, and according to determination As a result it triggers the fundus imaging and obtains module, eyeground subgraph acquisition module and/or the display control module.Into one Optionally, the direction of visual lines determining module 36 includes: that a direction of visual lines determines submodule 361 to step.Direction of visual lines determines submodule Block 361, which is used to fall into one in response to the difference of t moment and t+1 moment corresponding direction of visual lines, allows disparity range, determines Direction of visual lines remains unchanged, and triggers the fundus imaging according to definitive result and obtain module, eyeground subgraph acquisition mould Block and/or the display control module.If no change has taken place as time goes by or does not have substantially in human eye sight direction It changes, illustrates that the constant probability in human eye concern direction is larger, under the situation, pass through technical side provided by the embodiments of the present application The stabilization that case carries out near-eye image is shown, can effectively offset the relative motion on near-eye display device and eyeground, improves human eye viewing Comfort level, improve user experience, more preferably meet user demand.If there is larger change as time goes by human eye sight direction Become, illustrates that the probability for paying close attention to direction change is larger, shown at this point, the prior art can be used, it is aobvious without executing stabilization Show control, with meet user by direction of visual lines change come adjust itself concern display content nearly eye display demand.
Fig. 5 is the structural block diagram of the third nearly eye display control unit provided by the embodiments of the present application, and the application is specifically real Example is applied not limit the specific implementation of nearly eye display control unit 500.As shown in figure 5, nearly eye display control unit 500 may include:
Processor (Processor) 510,520, memory communication interface (Communications Interface) (Memory) 530 and communication bus 540.Wherein:
Processor 510, communication interface 520 and memory 530 complete mutual communication by communication bus 540.
Communication interface 520, for being communicated with equipment, the external light source etc. such as with communication function.
Processor 510 can specifically execute in any of the above-described display control method embodiment for executing program 532 Correlation step.
For example, program 532 may include program code, said program code includes computer operation instruction.
Processor 510 may be a central processing unit (Central Processing Unit, abbreviation CPU), or special Determine integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or is configured to implement One or more integrated circuits of the embodiment of the present application.
Memory 530, for storing program 532.Memory 530 may include random access memory (Random Access Memory, abbreviation RAM), it is also possible to it further include nonvolatile memory (Non-volatile memory), such as extremely A few magnetic disk storage.
For example, in an optional implementation manner, following steps can be performed by executing program 532 in processor 510: obtaining Take the corresponding fundus imaging of t moment, the fundus imaging includes eyeground subgraph and the display subgraph that shows on eyeground Superposition;Obtain t+1 moment corresponding eyeground subgraph;According at least to the t moment fundus imaging and the t+1 when The eyeground subgraph at quarter carries out t+1 moment content to be displayed in the display control on eyeground.
In other optional implementations, processor 510 can also carry out other above-mentioned any realities by executing program 532 The step of example refers to is applied, details are not described herein.
In program 532 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule, Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment Description, details are not described herein.
In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality Apply the superiority and inferiority of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to The record of correlation method embodiment, details are not described herein.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps. And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), deposits at random Various Jie that can store program code such as access to memory (Random Access Memory, abbreviation RAM), magnetic or disk Matter.
In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again Combination nova should be regarded as the equivalent scheme of the application.Meanwhile in the description above to the application specific embodiment, for a kind of reality The feature that the mode of applying is described and/or shown can be made in one or more other embodiments in a manner of same or similar With, be combined with the feature in other embodiment, or substitution other embodiment in feature.
It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when using herein, but simultaneously It is not excluded for the presence or additional of one or more other features, element, step or component.
Finally, it should be noted that embodiment of above is merely to illustrate the application, and it is not the limitation to the application, it is related The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be by right It is required that limiting.

Claims (10)

1. a kind of nearly eye display control method characterized by comprising
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes that eyeground subgraph and the display shown on eyeground are sub The superposition of image;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, the progress t+1 moment is waited for Content is shown in the display control on eyeground, so that t+1 moment near-eye display device projects the display subgraph on eyeground in eye The relative position variation of the display subregion at bottom, it is opposite with respect to eyeground to counteract display subregion caused by the two relative motion Change in location.
2. the method according to claim 1, wherein the fundus imaging according at least to the t moment and The eyeground subgraph at the t+1 moment carries out t+1 moment content to be displayed in the display control on eyeground, comprising:
According at least to the fundus imaging of the t moment, eyeground subgraph included by the fundus imaging of the t moment is determined With the t relative position information of display subgraph;
According at least to the eyeground subgraph of the t relative position information and the t+1 moment, the progress t+1 moment waits showing Show content in the display control on eyeground.
3. according to the method described in claim 2, it is characterized in that, described according at least to the t relative position information and institute The eyeground subgraph at t+1 moment is stated, carries out t+1 moment content to be displayed in the display control on eyeground, comprising:
According at least to the eyeground subgraph of the t relative position information and the t+1 moment, the t+1 moment is determined The t+1 on the relatively described eyeground of content to be displayed shows subregion;
It controls the t+1 moment content to be displayed and shows that subregion is shown in the t+1.
4. according to the method in claim 2 or 3, which is characterized in that the eyeground according at least to the t moment at Picture determines the t relative position information of eyeground subgraph and display subgraph in the fundus imaging of the t moment, comprising:
Separate eyeground subgraph included by the fundus imaging of the t moment and display subgraph;
Determine that the t of eyeground subgraph and display subgraph is with respect to position in the fundus imaging of the t moment according to separating resulting Confidence breath.
5. according to the method described in claim 4, it is characterized in that, the fundus imaging institute of the separation t moment Including eyeground subgraph and display subgraph, comprising:
Eyeground subgraph and display included by the corresponding fundus imaging of the t moment are separated according at least to eyeground characteristic information Subgraph.
6. a kind of nearly eye display control unit characterized by comprising
One fundus imaging obtains module, and for obtaining the corresponding fundus imaging of t moment, the fundus imaging includes eyeground subgraph As and eyeground show display subgraph superposition;
Bottom image collection module at a glance, for obtaining t+1 moment corresponding eyeground subgraph;
One display control module, for the fundus imaging and the eyeground subgraph at the t+1 moment according at least to the t moment Picture carries out t+1 moment content to be displayed in the display control on eyeground, so that t+1 moment near-eye display device projects eye The display subgraph at bottom changes in the relative position of the display subregion on eyeground, counteracts display caused by the two relative motion Region changes with respect to the relative position on eyeground.
7. device according to claim 6, which is characterized in that the display control module includes:
One relative position information acquisition submodule, for the fundus imaging according at least to the t moment, when determining the t The t relative position information of eyeground subgraph included by the fundus imaging at quarter and display subgraph;
One display control submodule, for the eyeground subgraph according at least to the t relative position information and the t+1 moment Picture carries out t+1 moment content to be displayed in the display control on eyeground.
8. device according to claim 7, which is characterized in that the display control submodule includes:
One display subregion determination unit, for the eyeground according at least to the t relative position information and the t+1 moment Subgraph determines that the t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;
One display control unit shows that subregion is shown in the t+1 for controlling the t+1 moment content to be displayed Show.
9. device according to claim 7 or 8, which is characterized in that the relative position information acquisition submodule includes:
One separation processing unit, for separating eyeground subgraph and display included by the fundus imaging of the t moment Subgraph;
One relative position information acquiring unit, eyeground in the fundus imaging for determining the t moment according to separating resulting The t relative position information of image and display subgraph.
10. a kind of nearly eye display control unit characterized by comprising
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface and institute It states memory and completes mutual communication by the communication bus;
The memory is for storing at least one instruction;At least one instruction makes the processor execute following operation:
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes that eyeground subgraph and the display shown on eyeground are sub The superposition of image;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, the progress t+1 moment is waited for Content is shown in the display control on eyeground, so that t+1 moment near-eye display device projects the display subgraph on eyeground in eye The relative position variation of the display subregion at bottom, it is opposite with respect to eyeground to counteract display subregion caused by the two relative motion Change in location.
CN201510941273.0A 2015-12-16 2015-12-16 Nearly eye display control method and device Active CN106371578B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510941273.0A CN106371578B (en) 2015-12-16 2015-12-16 Nearly eye display control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510941273.0A CN106371578B (en) 2015-12-16 2015-12-16 Nearly eye display control method and device

Publications (2)

Publication Number Publication Date
CN106371578A CN106371578A (en) 2017-02-01
CN106371578B true CN106371578B (en) 2019-04-16

Family

ID=57880692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510941273.0A Active CN106371578B (en) 2015-12-16 2015-12-16 Nearly eye display control method and device

Country Status (1)

Country Link
CN (1) CN106371578B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102499634A (en) * 2011-10-26 2012-06-20 中国科学院光电技术研究所 Living human eye retina dynamic imaging device with image stabilizing function and method
CN103309582A (en) * 2012-03-08 2013-09-18 阿里巴巴集团控股有限公司 Image stabilization display method of terminal device, and terminal device with image stabilization display function
CN103677269A (en) * 2013-12-11 2014-03-26 小米科技有限责任公司 Method and device for displaying content and terminal device
CN103885181A (en) * 2012-12-19 2014-06-25 辉达公司 Near-eye Parallax Barrier Display
WO2015035822A1 (en) * 2013-09-13 2015-03-19 Beijing Zhigu Rui Tuo Tech Co., Ltd Pickup of objects in three-dimensional display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102499634A (en) * 2011-10-26 2012-06-20 中国科学院光电技术研究所 Living human eye retina dynamic imaging device with image stabilizing function and method
CN103309582A (en) * 2012-03-08 2013-09-18 阿里巴巴集团控股有限公司 Image stabilization display method of terminal device, and terminal device with image stabilization display function
CN103885181A (en) * 2012-12-19 2014-06-25 辉达公司 Near-eye Parallax Barrier Display
WO2015035822A1 (en) * 2013-09-13 2015-03-19 Beijing Zhigu Rui Tuo Tech Co., Ltd Pickup of objects in three-dimensional display
CN103677269A (en) * 2013-12-11 2014-03-26 小米科技有限责任公司 Method and device for displaying content and terminal device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于人眼视觉特性的三维显示技术;王书路等;《中国激光》;20140228;第41卷(第2期);第1至8页

Also Published As

Publication number Publication date
CN106371578A (en) 2017-02-01

Similar Documents

Publication Publication Date Title
JP7026214B2 (en) Head-mounted display tracking system
US10674142B2 (en) Optimized object scanning using sensor fusion
CN110320999B (en) Method and system for deep learning of three-dimensional (3D) gaze prediction
CN112639577B (en) Prediction and current limiting adjustment based on application rendering performance
CN108364319B (en) Dimension determination method and device, storage medium and equipment
EP3462283B1 (en) Image display method and device utilized in virtual reality-based apparatus
CN109791433A (en) Prediction type central fovea virtual reality system
CN110050250A (en) The synchronous image regulation of display
CN110351480B (en) Image processing method and device for electronic equipment and electronic equipment
KR20180091033A (en) Image display method, method for manufacturing irregular screen having curved surface, and head-mounted display device
US20170076461A1 (en) Image Presentation Control Methods and Image Presentation Control Apparatuses
CN109389545A (en) Image processing apparatus, method and storage medium
US20210185293A1 (en) Depth data adjustment based on non-visual pose data
CN108259770A (en) Image processing method, device, storage medium and electronic equipment
JP7491300B2 (en) Information processing device, information processing method, and computer-readable recording medium
CN109840946A (en) Virtual objects display methods and device
US10891714B2 (en) Error concealment for a head-mountable device
CN107749955B (en) Panoramic camera posture self-adaptive photometric adjustment method and system and portable terminal
US20230047470A1 (en) Information processing apparatus, information processing method, and computer-readable recording medium
KR20170100371A (en) Apparatus and method of stereo scopic 3d contents creation and display
CN106371578B (en) Nearly eye display control method and device
CN108027646B (en) Anti-shaking method and device for terminal display
US10783704B2 (en) Dense reconstruction for narrow baseline motion observations
CN104298350B (en) information processing method and wearable electronic equipment
CN106371577B (en) Nearly eye display control method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant