CN106371578B - Nearly eye display control method and device - Google Patents
Nearly eye display control method and device Download PDFInfo
- Publication number
- CN106371578B CN106371578B CN201510941273.0A CN201510941273A CN106371578B CN 106371578 B CN106371578 B CN 106371578B CN 201510941273 A CN201510941273 A CN 201510941273A CN 106371578 B CN106371578 B CN 106371578B
- Authority
- CN
- China
- Prior art keywords
- eyeground
- subgraph
- moment
- display
- fundus imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention relates to a kind of nearly eye display control method and devices, wherein the nearly eye display control method includes: to obtain the corresponding fundus imaging of t moment, and the fundus imaging includes the superposition of eyeground subgraph and the display subgraph shown on eyeground;Obtain t+1 moment corresponding eyeground subgraph;According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, t+1 moment content to be displayed is carried out in the display control on eyeground.The stabilization that the program realizes nearly eye is shown.
Description
Technical field
This application involves field of display technology, more particularly to a kind of nearly eye display control method and device.
Background technique
In recent years, nearly eye display technology continues to develop, and becomes one of best presentation mode of virtual reality.Since nearly eye is aobvious
Show that there are magnification at high multiple, therefore, the small movement such as near-eye display device and/or user's head may all bring display picture
Significant shake results even in user and generates the discomforts such as giddy to influence the viewing impression of user.
Summary of the invention
The brief overview about the application is given below, in order to provide the basic of some aspects about the application
Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the application.It is not intended to determine the pass of the application
Key or pith, nor intended limitation scope of the present application.Its purpose only provides certain concepts in simplified form,
Taking this as a prelude to a more detailed description discussed later.
The application provides a kind of nearly eye display control method and device.
In a first aspect, the embodiment of the present application provides a kind of nearly eye display control method, comprising:
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes eyeground subgraph and shows on eyeground aobvious
Show the superposition of subgraph;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, when carrying out t+1
Content to be displayed is carved in the display control on eyeground.
It is optionally, described according at least to described in conjunction with any nearly eye display control method provided by the embodiments of the present application
The eyeground subgraph of the fundus imaging of t moment and the t+1 moment carries out t+1 moment content to be displayed on eyeground
Display control, comprising: according at least to the fundus imaging of the t moment, included by the fundus imaging for determining the t moment
The t relative position information of eyeground subgraph and display subgraph;According at least to the t relative position information and the t+
The eyeground subgraph at 1 moment carries out t+1 moment content to be displayed in the display control on eyeground.
It is optionally, described according at least to described in conjunction with any nearly eye display control method provided by the embodiments of the present application
The eyeground subgraph of t relative position information and the t+1 moment carries out t+1 moment content to be displayed in the aobvious of eyeground
Show control, comprising: according at least to the eyeground subgraph of the t relative position information and the t+1 moment, determine described
The t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;The t+1 moment content to be displayed is controlled to exist
The t+1 shows that subregion is shown.
It is optionally, described according at least to described in conjunction with any nearly eye display control method provided by the embodiments of the present application
The fundus imaging of t moment determines that eyeground subgraph is opposite with the display t of subgraph in the fundus imaging of the t moment
Location information, comprising: eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph;Root
The t relative position information of eyeground subgraph and display subgraph in the fundus imaging of the t moment is determined according to separating resulting.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the separation is described
Eyeground subgraph included by the fundus imaging of t moment and display subgraph, comprising: separated according at least to eyeground characteristic information
Eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.
It is optionally, described according at least to eyeground in conjunction with any nearly eye display control method provided by the embodiments of the present application
It is described before characteristic information separates eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph
Method further include: obtain the eyeground characteristic information.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the separation is described
Eyeground subgraph included by the fundus imaging of t moment and display subgraph, comprising: according at least to eyeground with reference to subgraph point
Eyeground subgraph included by fundus imaging corresponding from the t moment and display subgraph.
It is optionally, described according at least to eyeground in conjunction with any nearly eye display control method provided by the embodiments of the present application
Before separating eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph with reference to subgraph, institute
State method further include: obtain the eyeground with reference to subgraph.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the eyeground refers to subgraph
Eyeground subgraph as being the t+1 moment.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the separation is described
Eyeground subgraph included by the fundus imaging of t moment and display subgraph, comprising: corresponding according at least to the t moment
Fundus imaging included by the corresponding source contents of display subgraph, separate included by the corresponding fundus imaging of the t moment
Eyeground subgraph and display subgraph.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the acquisition t moment pair
Before the fundus imaging answered, the method also includes: determine that direction of visual lines remains unchanged.
In conjunction with any nearly eye display control method provided by the embodiments of the present application, optionally, the determining direction of visual lines
It remains unchanged, comprising: it falls into one in response to the difference of t moment and t+1 moment corresponding direction of visual lines and allows disparity range,
Determine that direction of visual lines remains unchanged.
Second aspect, the embodiment of the present application also provides a kind of nearly eye display control units, comprising:
One fundus imaging obtains module, and for obtaining the corresponding fundus imaging of t moment, the fundus imaging includes eyeground
The superposition of subgraph and the display subgraph shown on eyeground;
Bottom image collection module at a glance, for obtaining t+1 moment corresponding eyeground subgraph;
One display control module, for according at least to the t moment fundus imaging and the eyeground at the t+1 moment
Subgraph carries out t+1 moment content to be displayed in the display control on eyeground.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the display control module
It include: a relative position information acquisition submodule, for the fundus imaging according at least to the t moment, when determining the t
The t relative position information of eyeground subgraph included by the fundus imaging at quarter and display subgraph;One display control submodule,
For the eyeground subgraph according at least to the t relative position information and the t+1 moment, the progress t+1 moment waits showing
Show content in the display control on eyeground.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the display control submodule
Block includes: a display subregion determination unit, for according at least to the t relative position information and the t+1 moment
Eyeground subgraph determines that the t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;One display control
Unit processed shows that subregion is shown in the t+1 for controlling the t+1 moment content to be displayed.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the relative position information
Acquisition submodule includes: a separation processing unit, for separating of eyeground included by the fundus imaging of the t moment
Image and display subgraph;One relative position information acquiring unit, for determining the eyeground of the t moment according to separating resulting
The t relative position information of eyeground subgraph and display subgraph in imaging.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the separation processing unit
It include: the first separating treatment subelement, for separating the corresponding fundus imaging of the t moment according at least to eyeground characteristic information
Included eyeground subgraph and display subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, described device further include: one
Eyeground characteristic information obtains module, for obtaining the eyeground characteristic information.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the separation processing unit
It include: one second separating treatment subelement, for separating the corresponding eyeground of the t moment with reference to subgraph according at least to eyeground
The included eyeground subgraph of imaging and display subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, described device further include: one
Eyeground obtains module with reference to subgraph, for obtaining the eyeground with reference to subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the eyeground refers to subgraph
Eyeground subgraph as being the t+1 moment.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the separation processing unit
It include: a third separating treatment subelement, for according at least to of display included by the corresponding fundus imaging of the t moment
The corresponding source contents of image separate eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, described device further include: one
Direction of visual lines determining module for determining that direction of visual lines remains unchanged, and triggers the fundus imaging according to definitive result and obtains
Module, the eyeground subgraph obtain module and/or the display control module.
In conjunction with any nearly eye display control unit provided by the embodiments of the present application, optionally, the direction of visual lines is determined
Module includes: that a direction of visual lines determines submodule, for the difference in response to t moment and t+1 moment corresponding direction of visual lines
It is different to fall into one and allow disparity range, determine that direction of visual lines remains unchanged, and the fundus imaging is triggered according to definitive result and is obtained
Module, the eyeground subgraph obtain module and/or the display control module.
The third aspect, the embodiment of the present application also provides another nearly eye display control units, comprising:
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface with
And the memory completes mutual communication by the communication bus;
The memory is for storing at least one instruction;At least one instruction makes the processor execute following operation:
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes eyeground subgraph and shows on eyeground aobvious
Show the superposition of subgraph;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, when carrying out t+1
Content to be displayed is carved in the display control on eyeground.
Technical solution provided by the embodiments of the present application can obtain and when according at least to the fundus imaging and t+1 of t moment
The eyeground subgraph at quarter carries out the display control at t+1 moment, so that t+1 moment near-eye display device projects the aobvious of eyeground
Show that subgraph changes in the relative position of the display subregion on eyeground, counteracts and show subregion phase caused by the two relative motion
To the variation of the relative position on eyeground, be equivalent to different moments project eyeground display subgraph display subregion with respect to eyeground
Position substantially even completely it is constant, be conducive to improve user viewing comfort level, improve user experience.The application is such as close
The situations such as relative motion occur for eye display equipment and human eye, it can be achieved that stabilization of the source contents on eyeground is shown, and can not depended on used
Property measuring unit (Inertial measurement unit, abbreviation IMU) hardware, improve the flexibility and general of scheme implementation
Adaptive.
By the detailed description below in conjunction with attached drawing to the alternative embodiment of the application, the these and other of the application
Advantage will be apparent from.
Detailed description of the invention
The application can be by reference to being better understood, wherein in institute below in association with description given by attached drawing
Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following
It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated
The alternative embodiment of application and the principle and advantage for explaining the application.In the accompanying drawings:
Fig. 1 is a kind of flow chart of nearly eye display control method provided by the embodiments of the present application;
Fig. 2 is a kind of example of fundus imaging provided by the embodiments of the present application;
Fig. 3 is the logic diagram of the first nearly eye display control unit provided by the embodiments of the present application;
Fig. 4 is the logic diagram of second provided by the embodiments of the present application close display control unit;
Fig. 5 is the logic diagram of the third nearly eye display control unit provided by the embodiments of the present application.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear,
And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with
Just the understanding to the embodiment of the present application is helped to improve.
Specific embodiment
It is described in detail hereinafter in connection with exemplary embodiment of the attached drawing to the application.It rises for clarity and conciseness
See, does not describe all features of actual implementation mode in the description.It should be understood, however, that developing any this reality
Much decisions specific to embodiment must be made during embodiment, to realize the objectives of developer, example
Such as, meet restrictive condition those of related to system and business, and these restrictive conditions may be with embodiment not
It changes together.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from
For those skilled in the art of present disclosure, this development is only routine task.
Here, also it should be noted is that, in order to avoid having obscured the application because of unnecessary details, in attached drawing and
It is merely depicted in explanation with according to the closely related apparatus structure of the scheme of the application and/or processing step, and is omitted pair
With the application relationship is little, expression and description of component known to persons of ordinary skill in the art and processing.
(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application
Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous
Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.
Stabilization, which is shown, is generally based on the realization of motion-sensing element, such as installs IMU hardware on the display device, passes through IMU
Angular speed and acceleration of measurement display equipment etc., the motion information of display equipment are determined according to measurement result, and aobvious according to this
Show that the motion information of equipment controls the display of subsequent source contents, so that the content of subsequent display counteracts the movement because showing equipment
Bring float, to realize that stablizing for display picture shows.Present inventor is in the mistake for practicing the embodiment of the present application
It is found in journey, although can offset the shake of display picture to a certain extent based on IMU, it relies on IMU hardware and is to be directed to
Display equipment itself carries out showing that the stabilization of picture is shown in the case of moving, and in nearly eye display field, in addition to nearly eye
Display equipment may occur outside movement, human body head is it can also happen that movement;If near-eye display device and human eye there is no
Relative motion, even if then the two may all move, but apparently with regard to user, display subgraph can't be shaken;Conversely,
If relative motion occurs for near-eye display device and human eye, apparently with regard to user, relative jitter may occur for display subgraph, by
This may cause user and watches discomfort, influence user experience.For this purpose, the embodiment of the present application for nearly eye display field provide it is anti-
Tremble display solution.
Fig. 1 is a kind of flow chart of nearly eye display control method provided by the embodiments of the present application.The embodiment of the present application provides
The executing subject of nearly eye display control method can be a certain nearly eye display control unit, the nearly eye display control unit can be
But it is not limited to relate in the application processes such as content presentation, video playing carry out content by executing the nearly eye display control method
Display control.The equipment form of expression of the nearly eye display control unit is unrestricted, such as the nearly eye display control unit
It can be a certain independent component, the component and near-eye display device match hop communication;Alternatively, the display control unit can be used as certain
One functional module is integrated in a near-eye display device;The near-eye display device may include but be not limited to Helmet Mounted Display, intelligence
Energy glasses etc..Specifically as shown in Figure 1, a kind of nearly eye display control method provided by the embodiments of the present application includes:
S101: obtaining the corresponding fundus imaging of t moment, and the fundus imaging includes eyeground subgraph and shows on eyeground
Display subgraph superposition.
S102: t+1 moment corresponding eyeground subgraph is obtained.
It, can be by the projection optics system of near-eye display device by source contents in technical solution provided by the embodiments of the present application
Light project the eyeground of human eye to be imaged, then the image on eyeground is obtained by the camera of near-eye display device, should
The image on the eyeground got under situation might as well be known as fundus imaging, as shown in Fig. 2, the fundus imaging obtained is eyeground itself
Throw light image formed by eyeground that (might as well be known as eyeground subgraph) and source contents is imaged (might as well be known as display subgraph
Picture) superposition, that is, the fundus imaging be eyeground subgraph and show subgraph superposition.
In practical application, can get certain moment (t moment might as well be expressed as) corresponding fundus imaging and with the moment
Adjacent one is in corresponding eyeground subgraph of rear moment (might as well be expressed as the t+1 moment), wherein it is described it is adjacent be opposite
Concept, such as two adjacent moments can refer to the moment for shorter two of time interval, alternatively, two adjacent moments can be in corresponding source
Consecutive frame in appearance determines alternatively, two adjacent moments can be actually needed according to user, the embodiment of the present application to this and it is unlimited
System;The corresponding fundus imaging of t moment got is eyeground subgraph and the superposition for showing subgraph, the t+1 got
Moment corresponding eyeground subgraph is the image on eyeground itself.
S103: according at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, t is carried out
Display control of+1 moment content to be displayed on eyeground.
Nearly eye show application process in, if between near-eye display device and human eye eyeground occur relative motion (including
One of near-eye display device and human eye eyeground move, alternatively, both near-eye display device and human eye eyeground are sent out
Life moves and the two is not opposing stationary), then the relative motion can cause display subgraph with respect to the shake on eyeground, to influence
The display of content then needs to carry out the stabilization display control of image.
And if there is no relative motion, (including the two is in static shape between near-eye display device and human eye eyeground
State, alternatively, the two is respectively at motion state but the two is opposing stationary) in the case of, the projection of different moments near-eye display device
Display subgraph to eyeground is remained unchanged in the relative position of the display subregion on eyeground, in consideration of it, can be according at least to t when
The fundus imaging and the eyeground subgraph at t+1 moment at quarter carry out the display control at t+1 moment (including when according to the t
The fundus imaging at quarter and the eyeground subgraph at the t+1 moment carry out t+1 moment content to be displayed in the display control on eyeground
System, alternatively, the fundus imaging of the t moment and the eyeground subgraph at the t+1 moment are believed in conjunction with other auxiliary references
Breath carries out t+1 moment content to be displayed in the display control on eyeground) so that t+1 moment near-eye display device projects eye
The display subgraph at bottom falls into the variation of the relative position of the display subregion on eyeground and permissible range or even remains unchanged, and thus one
Determine display subregion caused by counteracting the two relative motion in degree to change with respect to the relative position on eyeground, realizes source contents
Stabilization on eyeground is shown.
As it can be seen that technical solution provided by the embodiments of the present application, can obtain and the fundus imaging according at least to t moment and
The eyeground subgraph at t+1 moment carries out the display control at t+1 moment, so that t+1 moment near-eye display device projects eye
The display subgraph at bottom changes in the relative position of the display subregion on eyeground, counteracts display caused by the two relative motion
Region with respect to eyeground relative position change, be equivalent to different moments project eyeground display subgraph display subregion phase
It is substantially even completely constant to the position on eyeground, be conducive to the comfort level for improving user's viewing, improve user experience.The application exists
The situations such as relative motion occur for near-eye display device and human eye, it can be achieved that stabilization of the source contents on eyeground is shown, and stabilization
Display control can not depend on IMU hardware, improve the flexibility and universality of scheme implementation.
Optionally, the fundus imaging and the eyeground subgraph at the t+1 moment according at least to the t moment,
T+1 moment content to be displayed is carried out in the display control on eyeground, comprising: according at least to the fundus imaging of the t moment, really
The relative position information of eyeground subgraph included by the fundus imaging of the fixed t moment and display subgraph (might as well be known as
T relative position information);According at least to the eyeground subgraph of the t relative position information and the t+1 moment, carry out
Display control of the t+1 moment content to be displayed on eyeground.Included by fundus imaging of the program according at least to the t moment
Eyeground subgraph and display subgraph t relative position information and the eyeground subgraph at the t+1 moment, carry out the
T+1 moment content to be displayed may make the t+1 moment to project the display subgraph on eyeground with respect to eye in the display control on eyeground
The display subregion at bottom projects the change in location for showing subregion on the opposite eyeground of display subgraph on eyeground with t moment
For very little even without changing, the relative motion that can be offset between near-eye display device and human eye eyeground to a certain extent may
Caused by show the offset of sub-window position, thus improve the stability that nearly eye shows image.
Wherein, the relative position letter of eyeground subgraph included by the corresponding fundus imaging of any moment and display subgraph
Breath, can through but not limited to eyeground subgraph point and display subgraph eyeground show subregion in respective point between
Translation (Translation), scaling (Scaling) rotate Relative Transformations relationships such as (Rotation) to express, that is to say, that
It can be by constructing the transformation square of the point and display subgraph of eyeground subgraph between the respective point in the display subregion on eyeground
The relative positional relationship of battle array, the eyeground Lai Fanying subgraph and display subgraph between the display subregion on eyeground, the transformation
Matrix may include but be not limited to translation transformation matrix, scale transformation matrix, rotational transformation matrix etc..It might as well be to reflect eyeground
It is illustrated for the transformation matrix of relative position information between image and the corresponding display subregion of display subgraph.
For example, the translation transformation matrix can join according to eyeground subgraph display subregion corresponding with display subgraph
The relative movement component for examining the different reference axis of coordinate system is constructed, such as certain point [x, y, z, 1] in the subgraph of eyeground and aobvious
Show that certain point [x', y', z', 1] in subregion in the mobile component of three reference axis is respectively dx=Tx, dy=Ty, dz=Tz,
That is:
X'=x+Tx, y'=y+Ty, z'=z+Tz................................ (1)
Then, the translation transformation relationship between respective point can be expressed as follows:
In another example the scale transformation matrix can be according to eyeground subgraph display subregion corresponding with display subgraph
Opposite zoom degree is constructed, such as in certain point [x, y, z, 1] and display subregion in the subgraph of eyeground certain point [x', y',
Z', 1] it is respectively Sx, Sy and Sz in the coordinate value scaling of three reference axis, the coordinate value of respective point meets:
X'=x*Sx, y'=y*Sy, z'=z*Sz................................ (3)
Then, the scale transformation relationship between respective point can be expressed as follows:
For another example the rotational transformation matrix can be according to eyeground subgraph display subregion corresponding with display subgraph
Relative rotation angle is constructed, for might as well being rotated around X-axis, certain point in the subgraph of eyeground and certain point in display subregion
X axis coordinate it is constant, Y axis coordinate and Z axis coordinate rotate θ degree around X-axis, and the positive direction of rotation is clockwise (along rotation
Axis negative direction is seen to origin), then the rotation transformation relationship between respective point can be expressed as follows:
It should be noted that the building side of the transformation matrixs such as translation transformation matrix, scale transformation matrix, rotational transformation matrix
Formula is the prior art, and the example of the above building mode is only the example of optional building mode, should not be construed as implementing the application
The limitation of example technical solution essence.
It, can be according at least to the t relative position information and the t+ after obtaining the t relative position information
The eyeground subgraph at 1 moment carries out t+1 moment content to be displayed in the display control on eyeground, so that the t+1 moment projects
To eyeground display subgraph with respect to the display subregion on eyeground, project the opposite eye of the display subgraph on eyeground with t moment
The change in location very little (i.e. variation degree be less than preset allow variation range) of the display subregion at bottom is even without becoming
Change;Specific display control method can determine according to actual needs, and implementation is very flexible.
For example, the content to be displayed at adjustment t+1 moment can be corresponded to after obtaining the t relative position information, with into
The display control at row t+1 moment, source contents that such as can be to be shown to the t+1 moment according to the t relative position information
(It+1)Before correctionIt is corrected display control:
(It+1)After correction=(It+1)Before correction·E...............(6)
Alternatively, the projection of adjustment t+1 moment content to be displayed can be corresponded to after obtaining the t relative position information
PTZ (Pan-tilt-zoom) parameter, such as can be according to the t relative position information to the source of t+1 moment content to be displayed
Projection P TZ parameter (pt+1)Before correctionIt is corrected display control:
(Pt+1)After correction=(Pt+1)Before correction·E..................(7)
E indicates the t relative position information in above-mentioned formula (6) and (7), can be used but is not limited to the transformation square
Battle array, the transformation matrix may include but be not limited to above-mentioned formula (2), (4), form shown in (5).
Still optionally further, the eyeground subgraph according at least to the t relative position information and the t+1 moment
Picture carries out t+1 moment content to be displayed in the display control on eyeground, comprising: according at least to the t relative position information and
The eyeground subgraph at the t+1 moment determines the display subregion on the relatively described eyeground of t+1 moment content to be displayed
(t+1 might as well be known as and show subregion);Control the t+1 moment content to be displayed the t+1 show subregion into
Row display.The program can determine institute according at least to the eyeground subgraph of the t relative position information and the t+1 moment
The t+1 for stating the relatively described eyeground of t+1 moment content to be displayed shows subregion, by adjusting projection parameter, adjustment optical path
Etc. one or more means, the t+1 that the t+1 moment content to be displayed projects opposite eyeground is shown into sub-district
Domain, in this way, the t+1 show subregion and t moment project the opposite eyeground of the display subgraph on eyeground t show it is sub
The change in location very little in region can be offset between near-eye display device and human eye eyeground to a certain extent even without changing
The offset of display sub-window position that may cause of relative motion, improve the stability that nearly eye shows image.
In technical solution provided by the embodiments of the present application, eyeground included by the corresponding fundus imaging of the t moment
The method of determination of relative position information between image and display subgraph is very flexible, and the application is not intended to limit this.
Optionally, the fundus imaging according at least to the t moment, in the fundus imaging for determining the t moment
The t relative position information of eyeground subgraph and display subgraph, comprising: the fundus imaging institute of the separation t moment
Including eyeground subgraph and display subgraph;Eyeground subgraph in the fundus imaging of the t moment is determined according to separating resulting
The t relative position information of picture and display subgraph.In a certain fundus imaging, between eyeground subgraph and display subgraph
Separate mode is very flexible, and the embodiment of the present application is not intended to limit this.Optionally, it is shown due to eyeground subgraph and on eyeground
Show that the feature difference of subgraph is larger, therefore using the display feature of eyeground subgraph, display at least one of subgraph,
Can eyeground subgraph to a certain fundus imaging and display subgraph separate, and determine eyeground subgraph and display subgraph
Relative position information, thus improve fundus imaging separation efficiency and accuracy.
For example, eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph,
It include: to separate eyeground subgraph included by the corresponding fundus imaging of the t moment according at least to eyeground characteristic information and show
Show subgraph.The eyeground of human eye usually has known relatively stable feature (such as retina textural characteristics), these stabilizations
Feature can be used as the eyeground characteristic information, the feature for the display subgraph that eyeground shows is projected with near-eye display device
Usually differ greatly, therefore, can be separated according at least to the eyeground characteristic information eyeground subgraph in a certain fundus imaging and
Show subgraph.The program can make full use of the characteristic information on eyeground to carry out eyeground image subsection and display subgraph in fundus imaging
Separation.Wherein, the characteristic information on the eyeground can obtain in advance, i.e., described to appoint according at least to characteristic information separation in eyeground is described
Before eyeground subgraph included by one moment corresponding fundus imaging and display subgraph, further includes: it is special to obtain the eyeground
Reference breath, and the acquisition modes of the eyeground characteristic information are very flexible, such as the eye of human eye general character can be obtained to external equipment
Bottom feature is as the eyeground characteristic information, alternatively, can be extracted by carrying out common feature to several eyeground subgraphs to obtain
Described eyeground characteristic information, etc., the embodiment of the present application comparison are not intended to limit.
In another example eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph
Picture, comprising: separate eyeground subgraph included by the corresponding fundus imaging of the t moment with reference to subgraph according at least to eyeground
With display subgraph.The eyeground is using the eyeground subgraph as reference picture with reference to subgraph, that is to say, that not to eye
Can shoot the image on eyeground in the case where bottom projection display content, the image on the eyeground shot in this way be eyeground itself at
Picture is not superimposed external display content.After obtaining the eyeground with reference to subgraph, it can be referred to according at least to the eyeground
Subgraph carries out the separation of the fundus imaging of any moment, such as can be used but be not limited to fundus imaging and eyeground with reference to subgraph
The methods of subtract each other and to be separated.The eyeground is very flexible with reference to the acquisition modes of subgraph, can such as show projecting to eyeground
The image that eyeground is shot before content refers to the corresponding eyeground of any moment as described in subgraph separation according at least to eyeground described in
Before the included eyeground subgraph of imaging and display subgraph, further includes: obtain the eyeground with reference to subgraph;Alternatively, can
Using the eyeground subgraph of the user obtained in advance as the eyeground with reference to subgraph, etc., the embodiment of the present application to this not
Limitation.The program can divide eyeground subgraph in fundus imaging and display subgraph with reference to subgraph according at least to eyeground
From.Still optionally further, the eyeground is the eyeground subgraph at the t+1 moment, program reusable institute with reference to subgraph
State the t+1 moment eyeground subgraph carry out the t moment fundus imaging separation, improve efficiency.
For another example eyeground subgraph included by the fundus imaging of the separation t moment and display subgraph
Picture, comprising: according at least to the corresponding source contents of display subgraph included by the corresponding fundus imaging of the t moment, separation
Eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.Source contents are through near-eye display device
It projects and forms a display subgraph on eyeground behind the eyeground of human eye, show there is association between subgraph and source contents, therefore,
The program can at least make full use of the characteristic of source contents to realize eyeground subgraph and the separation for showing subgraph in fundus imaging.
It should be noted that above-mentioned eyeground characteristic information, eyeground are with reference to two kinds or two in subgraph, corresponding source contents
Kind of information above is also in combination with getting up, collectively as the separation foundation of fundus imaging, to improve the accuracy of fundus imaging separation.
In conjunction with any technical solution provided by the embodiments of the present application, still optionally further, the acquisition t moment is corresponding
Fundus imaging before, the method also includes: determine that direction of visual lines remains unchanged.Wherein, the detection of the direction of visual lines of human eye
Method is the prior art, and the embodiment of the present application repeats no more.If no change has taken place as time goes by human eye sight direction
Or no change has taken place substantially, illustrates that the constant probability in human eye concern direction is larger, under the situation, passes through the embodiment of the present application
The stabilization that the technical solution of offer carries out near-eye image is shown, can effectively offset the relative motion on near-eye display device and eyeground,
The comfort level of human eye viewing is improved, improves user experience, more preferably meets user demand.The determining direction of visual lines remains unchanged and is
A opposite probability, it may include the stringent constant situation of direction of visual lines, the variation that may also comprise the direction of visual lines of different moments exist
The situation for centainly allowing disparity range, such as falls into an appearance in response to the difference of t moment and t+1 moment corresponding direction of visual lines
Perhaps disparity range determines that direction of visual lines remains unchanged, to improve the flexibility and universality of scheme realization.If human eye sight side
To there is larger change as time goes by, illustrate that the probability for paying close attention to direction change is larger, at this point, prior art progress can be used
Display adjusts the aobvious of itself concern by the change of direction of visual lines without executing stabilization display control to meet user
Show that the nearly eye of content shows demand.
It will be understood by those skilled in the art that in any of the above-described method of the application specific embodiment, each step
Serial number size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, and
Any restriction should not be constituted to the implementation process of the application specific embodiment.
Fig. 3 is the logic diagram of the first nearly eye display control unit provided by the embodiments of the present application.As shown in figure 3, this
Apply for the nearly eye display control unit that embodiment provides can include: a fundus imaging obtains module 31, the at a glance acquisition of bottom image
Module 32 and a display control module 33.
Fundus imaging obtains module 31 for obtaining the corresponding fundus imaging of t moment, and the fundus imaging includes eyeground
The superposition of subgraph and the display subgraph shown on eyeground.
Eyeground subgraph obtains module 32 for obtaining t+1 moment corresponding eyeground subgraph.
Display control module 33 is used for fundus imaging and the eyeground at the t+1 moment according at least to the t moment
Subgraph carries out t+1 moment content to be displayed in the display control on eyeground.
Technical solution provided by the embodiments of the present application can obtain and when according at least to the fundus imaging and t+1 of t moment
The eyeground subgraph at quarter carries out the display control at t+1 moment, so that t+1 moment near-eye display device projects the aobvious of eyeground
Show that subgraph changes in the relative position of the display subregion on eyeground, counteracts and show subregion phase caused by the two relative motion
To the variation of the relative position on eyeground, be equivalent to different moments project eyeground display subgraph display subregion with respect to eyeground
Position substantially even completely it is constant, be conducive to improve user viewing comfort level, improve user experience.The application is such as close
The situations such as relative motion occur for eye display equipment and human eye, it can be achieved that stabilization of the source contents on eyeground is shown, and can not depend on IMU
Hardware improves the flexibility and universality of scheme implementation.
The nearly eye display control unit can but be not limited to relate to pass through in the application processes such as content presentation, video playing
Execute the display control that the nearly eye display control method carries out content, module, submodule, unit or sub-unit in described device
Working mechanism and datail description can be found in the corresponding record of embodiment of the method, the application repeats no more.The nearly eye display control
The equipment form of expression of device processed is unrestricted, such as the nearly eye display control unit can be a certain independent component, the portion
Part and near-eye display device match hop communication;Alternatively, the display control unit, which can be used as a certain functional module, is integrated in a nearly eye
It shows in equipment;The near-eye display device may include but be not limited to Helmet Mounted Display, intelligent glasses etc..
Optionally, as shown in figure 4, the display control module 33 includes: 331 He of a relative position information acquisition submodule
One display control submodule 332.Relative position information acquisition submodule 331 be used for according at least to the t moment eyeground at
Picture determines eyeground subgraph included by the fundus imaging of the t moment and shows the t relative position information of subgraph;
Display control submodule 332 is used for the eyeground subgraph according at least to the t relative position information and the t+1 moment,
T+1 moment content to be displayed is carried out in the display control on eyeground.Fundus imaging institute of the program according at least to the t moment
Including eyeground subgraph and display subgraph t relative position information and the eyeground subgraph at the t+1 moment, into
Row t+1 moment content to be displayed may make the t+1 moment to project the display subgraph phase on eyeground in the display control on eyeground
To the display subregion on eyeground, the position for showing subregion on the opposite eyeground of the display subgraph on eyeground is projected with t moment
It varies less even without changing, the relative motion between near-eye display device and human eye eyeground can be offset to a certain extent
Thus the offset for the display sub-window position that may cause improves the stability that nearly eye shows image.
Still optionally further, the display control submodule 332 includes: that a display subregion determination unit 3321 and one is aobvious
Show control unit 3322.Show that subregion determination unit 3321 is used for according at least to the t relative position information and the t
The eyeground subgraph at+1 moment determines that the t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;
Display control unit 3322 shows that subregion is shown in the t+1 for controlling the t+1 moment content to be displayed.
The program can determine the t+1 according at least to the eyeground subgraph of the t relative position information and the t+1 moment
The t+1 on the relatively described eyeground of moment content to be displayed shows subregion, by adjusting projection parameter, adjustment optical path etc. it is a kind of or
The t+1 that the t+1 moment content to be displayed projects opposite eyeground is shown subregion, in this way, institute by multiple means
It states t+1 and shows that subregion and t moment project the position of the t display subregion on the opposite eyeground of the display subgraph on eyeground
It varies less even without changing, the relative motion between near-eye display device and human eye eyeground can be offset to a certain extent
The offset for the display sub-window position that may cause improves the stability that nearly eye shows image.
Optionally, the relative position information acquisition submodule 331 includes: a separation processing unit 3311 and an opposite position
Set information acquisition unit 3312.Separation processing unit 3311 is for separating included by the fundus imaging of the t moment
Eyeground subgraph and display subgraph;Relative position information acquiring unit 3312 is for when determining the t according to separating resulting
The t relative position information of eyeground subgraph and display subgraph in the fundus imaging at quarter.The program can using eyeground subgraph,
Show the display feature of at least one of subgraph, can eyeground subgraph to a certain fundus imaging and display subgraph divide
From, and determine eyeground subgraph and show the relative position information of subgraph, thus improve the efficiency and standard of fundus imaging separation
True property.
Optionally, the separation processing unit 3311 includes: the first separating treatment subelement 33111.First separating treatment
Subelement 33111 is used to separate eyeground included by the corresponding fundus imaging of the t moment according at least to eyeground characteristic information
Subgraph and display subgraph.Still optionally further, the nearly eye display control unit may also include that an eyeground characteristic information obtains
Modulus block 34, eyeground characteristic information obtain module 34 for obtaining the eyeground characteristic information.The program can make full use of eyeground
Characteristic information carry out fundus imaging in eyeground image subsection and display subgraph separation.
Optionally, the separation processing unit 3311 includes: the second separating treatment subelement 33112.Second separating treatment
Subelement 33112 is used to separate eye included by the corresponding fundus imaging of the t moment with reference to subgraph according at least to eyeground
Bottom image and display subgraph.Further, optionally, the nearly eye display control unit may also include that an eyeground with reference to son
Image collection module 35, eyeground obtain module 35 for obtaining the eyeground with reference to subgraph with reference to subgraph, and the program can be extremely
It is few that eyeground subgraph in fundus imaging and display subgraph are separated with reference to subgraph according to eyeground.Alternatively, optionally, institute
State eyeground subgraph of the eyeground with reference to subgraph for the t+1 moment.
Optionally, the separation processing unit 3311 includes: third separating treatment subelement 33113.Third separating treatment
Subelement 33113 is used for according at least in the corresponding source of display subgraph included by the corresponding fundus imaging of the t moment
Hold, separates eyeground subgraph included by the corresponding fundus imaging of the t moment and display subgraph.The program can at least fill
Divide the separation that eyeground subgraph and display subgraph in fundus imaging are realized using the characteristic of source contents.
It should be noted that above-mentioned eyeground characteristic information, eyeground are with reference to two kinds or two in subgraph, corresponding source contents
Kind of information above is also in combination with getting up, collectively as the separation foundation of fundus imaging, to improve the accuracy of fundus imaging separation.
In conjunction with any technical solution provided by the embodiments of the present application, optionally, the nearly eye display control unit is also wrapped
It includes: a direction of visual lines determining module 36.Direction of visual lines determining module 36 is for determining that direction of visual lines remains unchanged, and according to determination
As a result it triggers the fundus imaging and obtains module, eyeground subgraph acquisition module and/or the display control module.Into one
Optionally, the direction of visual lines determining module 36 includes: that a direction of visual lines determines submodule 361 to step.Direction of visual lines determines submodule
Block 361, which is used to fall into one in response to the difference of t moment and t+1 moment corresponding direction of visual lines, allows disparity range, determines
Direction of visual lines remains unchanged, and triggers the fundus imaging according to definitive result and obtain module, eyeground subgraph acquisition mould
Block and/or the display control module.If no change has taken place as time goes by or does not have substantially in human eye sight direction
It changes, illustrates that the constant probability in human eye concern direction is larger, under the situation, pass through technical side provided by the embodiments of the present application
The stabilization that case carries out near-eye image is shown, can effectively offset the relative motion on near-eye display device and eyeground, improves human eye viewing
Comfort level, improve user experience, more preferably meet user demand.If there is larger change as time goes by human eye sight direction
Become, illustrates that the probability for paying close attention to direction change is larger, shown at this point, the prior art can be used, it is aobvious without executing stabilization
Show control, with meet user by direction of visual lines change come adjust itself concern display content nearly eye display demand.
Fig. 5 is the structural block diagram of the third nearly eye display control unit provided by the embodiments of the present application, and the application is specifically real
Example is applied not limit the specific implementation of nearly eye display control unit 500.As shown in figure 5, nearly eye display control unit
500 may include:
Processor (Processor) 510,520, memory communication interface (Communications Interface)
(Memory) 530 and communication bus 540.Wherein:
Processor 510, communication interface 520 and memory 530 complete mutual communication by communication bus 540.
Communication interface 520, for being communicated with equipment, the external light source etc. such as with communication function.
Processor 510 can specifically execute in any of the above-described display control method embodiment for executing program 532
Correlation step.
For example, program 532 may include program code, said program code includes computer operation instruction.
Processor 510 may be a central processing unit (Central Processing Unit, abbreviation CPU), or special
Determine integrated circuit (Application Specific Integrated Circuit, abbreviation ASIC), or is configured to implement
One or more integrated circuits of the embodiment of the present application.
Memory 530, for storing program 532.Memory 530 may include random access memory (Random
Access Memory, abbreviation RAM), it is also possible to it further include nonvolatile memory (Non-volatile memory), such as extremely
A few magnetic disk storage.
For example, in an optional implementation manner, following steps can be performed by executing program 532 in processor 510: obtaining
Take the corresponding fundus imaging of t moment, the fundus imaging includes eyeground subgraph and the display subgraph that shows on eyeground
Superposition;Obtain t+1 moment corresponding eyeground subgraph;According at least to the t moment fundus imaging and the t+1 when
The eyeground subgraph at quarter carries out t+1 moment content to be displayed in the display control on eyeground.
In other optional implementations, processor 510 can also carry out other above-mentioned any realities by executing program 532
The step of example refers to is applied, details are not described herein.
In program 532 specific implementation of each step may refer to corresponding steps in above-described embodiment, module, submodule,
Corresponding description in unit, details are not described herein.It is apparent to those skilled in the art that for the convenience of description
With it is succinct, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment
Description, details are not described herein.
In the application the various embodiments described above, the serial number and/or sequencing of embodiment are merely convenient of description, do not represent reality
Apply the superiority and inferiority of example.It all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to it
The associated description of his embodiment.The associated description of implementation principle or process in relation to device, equipment or system embodiment, reference can be made to
The record of correlation method embodiment, details are not described herein.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps.
And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), deposits at random
Various Jie that can store program code such as access to memory (Random Access Memory, abbreviation RAM), magnetic or disk
Matter.
In the embodiments such as the device of the application, method, system, it is clear that each component (system, subsystem, module, submodule
Block, unit, subelement etc.) or each step can decompose, combine and/or decompose after reconfigure.These decompose and/or again
Combination nova should be regarded as the equivalent scheme of the application.Meanwhile in the description above to the application specific embodiment, for a kind of reality
The feature that the mode of applying is described and/or shown can be made in one or more other embodiments in a manner of same or similar
With, be combined with the feature in other embodiment, or substitution other embodiment in feature.
It should be emphasized that term "comprises/comprising" refers to the presence of feature, element, step or component when using herein, but simultaneously
It is not excluded for the presence or additional of one or more other features, element, step or component.
Finally, it should be noted that embodiment of above is merely to illustrate the application, and it is not the limitation to the application, it is related
The those of ordinary skill of technical field can also make a variety of changes in the case where not departing from spirit and scope
And modification, therefore all equivalent technical solutions also belong to the scope of the application, the scope of patent protection of the application should be by right
It is required that limiting.
Claims (10)
1. a kind of nearly eye display control method characterized by comprising
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes that eyeground subgraph and the display shown on eyeground are sub
The superposition of image;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, the progress t+1 moment is waited for
Content is shown in the display control on eyeground, so that t+1 moment near-eye display device projects the display subgraph on eyeground in eye
The relative position variation of the display subregion at bottom, it is opposite with respect to eyeground to counteract display subregion caused by the two relative motion
Change in location.
2. the method according to claim 1, wherein the fundus imaging according at least to the t moment and
The eyeground subgraph at the t+1 moment carries out t+1 moment content to be displayed in the display control on eyeground, comprising:
According at least to the fundus imaging of the t moment, eyeground subgraph included by the fundus imaging of the t moment is determined
With the t relative position information of display subgraph;
According at least to the eyeground subgraph of the t relative position information and the t+1 moment, the progress t+1 moment waits showing
Show content in the display control on eyeground.
3. according to the method described in claim 2, it is characterized in that, described according at least to the t relative position information and institute
The eyeground subgraph at t+1 moment is stated, carries out t+1 moment content to be displayed in the display control on eyeground, comprising:
According at least to the eyeground subgraph of the t relative position information and the t+1 moment, the t+1 moment is determined
The t+1 on the relatively described eyeground of content to be displayed shows subregion;
It controls the t+1 moment content to be displayed and shows that subregion is shown in the t+1.
4. according to the method in claim 2 or 3, which is characterized in that the eyeground according at least to the t moment at
Picture determines the t relative position information of eyeground subgraph and display subgraph in the fundus imaging of the t moment, comprising:
Separate eyeground subgraph included by the fundus imaging of the t moment and display subgraph;
Determine that the t of eyeground subgraph and display subgraph is with respect to position in the fundus imaging of the t moment according to separating resulting
Confidence breath.
5. according to the method described in claim 4, it is characterized in that, the fundus imaging institute of the separation t moment
Including eyeground subgraph and display subgraph, comprising:
Eyeground subgraph and display included by the corresponding fundus imaging of the t moment are separated according at least to eyeground characteristic information
Subgraph.
6. a kind of nearly eye display control unit characterized by comprising
One fundus imaging obtains module, and for obtaining the corresponding fundus imaging of t moment, the fundus imaging includes eyeground subgraph
As and eyeground show display subgraph superposition;
Bottom image collection module at a glance, for obtaining t+1 moment corresponding eyeground subgraph;
One display control module, for the fundus imaging and the eyeground subgraph at the t+1 moment according at least to the t moment
Picture carries out t+1 moment content to be displayed in the display control on eyeground, so that t+1 moment near-eye display device projects eye
The display subgraph at bottom changes in the relative position of the display subregion on eyeground, counteracts display caused by the two relative motion
Region changes with respect to the relative position on eyeground.
7. device according to claim 6, which is characterized in that the display control module includes:
One relative position information acquisition submodule, for the fundus imaging according at least to the t moment, when determining the t
The t relative position information of eyeground subgraph included by the fundus imaging at quarter and display subgraph;
One display control submodule, for the eyeground subgraph according at least to the t relative position information and the t+1 moment
Picture carries out t+1 moment content to be displayed in the display control on eyeground.
8. device according to claim 7, which is characterized in that the display control submodule includes:
One display subregion determination unit, for the eyeground according at least to the t relative position information and the t+1 moment
Subgraph determines that the t+1 on the relatively described eyeground of t+1 moment content to be displayed shows subregion;
One display control unit shows that subregion is shown in the t+1 for controlling the t+1 moment content to be displayed
Show.
9. device according to claim 7 or 8, which is characterized in that the relative position information acquisition submodule includes:
One separation processing unit, for separating eyeground subgraph and display included by the fundus imaging of the t moment
Subgraph;
One relative position information acquiring unit, eyeground in the fundus imaging for determining the t moment according to separating resulting
The t relative position information of image and display subgraph.
10. a kind of nearly eye display control unit characterized by comprising
One processor, a communication interface, a memory and a communication bus;The processor, the communication interface and institute
It states memory and completes mutual communication by the communication bus;
The memory is for storing at least one instruction;At least one instruction makes the processor execute following operation:
The corresponding fundus imaging of t moment is obtained, the fundus imaging includes that eyeground subgraph and the display shown on eyeground are sub
The superposition of image;
Obtain t+1 moment corresponding eyeground subgraph;
According at least to the fundus imaging and the eyeground subgraph at the t+1 moment of the t moment, the progress t+1 moment is waited for
Content is shown in the display control on eyeground, so that t+1 moment near-eye display device projects the display subgraph on eyeground in eye
The relative position variation of the display subregion at bottom, it is opposite with respect to eyeground to counteract display subregion caused by the two relative motion
Change in location.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510941273.0A CN106371578B (en) | 2015-12-16 | 2015-12-16 | Nearly eye display control method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510941273.0A CN106371578B (en) | 2015-12-16 | 2015-12-16 | Nearly eye display control method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106371578A CN106371578A (en) | 2017-02-01 |
CN106371578B true CN106371578B (en) | 2019-04-16 |
Family
ID=57880692
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510941273.0A Active CN106371578B (en) | 2015-12-16 | 2015-12-16 | Nearly eye display control method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106371578B (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102499634A (en) * | 2011-10-26 | 2012-06-20 | 中国科学院光电技术研究所 | Living human eye retina dynamic imaging device with image stabilizing function and method |
CN103309582A (en) * | 2012-03-08 | 2013-09-18 | 阿里巴巴集团控股有限公司 | Image stabilization display method of terminal device, and terminal device with image stabilization display function |
CN103677269A (en) * | 2013-12-11 | 2014-03-26 | 小米科技有限责任公司 | Method and device for displaying content and terminal device |
CN103885181A (en) * | 2012-12-19 | 2014-06-25 | 辉达公司 | Near-eye Parallax Barrier Display |
WO2015035822A1 (en) * | 2013-09-13 | 2015-03-19 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Pickup of objects in three-dimensional display |
-
2015
- 2015-12-16 CN CN201510941273.0A patent/CN106371578B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102499634A (en) * | 2011-10-26 | 2012-06-20 | 中国科学院光电技术研究所 | Living human eye retina dynamic imaging device with image stabilizing function and method |
CN103309582A (en) * | 2012-03-08 | 2013-09-18 | 阿里巴巴集团控股有限公司 | Image stabilization display method of terminal device, and terminal device with image stabilization display function |
CN103885181A (en) * | 2012-12-19 | 2014-06-25 | 辉达公司 | Near-eye Parallax Barrier Display |
WO2015035822A1 (en) * | 2013-09-13 | 2015-03-19 | Beijing Zhigu Rui Tuo Tech Co., Ltd | Pickup of objects in three-dimensional display |
CN103677269A (en) * | 2013-12-11 | 2014-03-26 | 小米科技有限责任公司 | Method and device for displaying content and terminal device |
Non-Patent Citations (1)
Title |
---|
基于人眼视觉特性的三维显示技术;王书路等;《中国激光》;20140228;第41卷(第2期);第1至8页 |
Also Published As
Publication number | Publication date |
---|---|
CN106371578A (en) | 2017-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7026214B2 (en) | Head-mounted display tracking system | |
US10674142B2 (en) | Optimized object scanning using sensor fusion | |
CN110320999B (en) | Method and system for deep learning of three-dimensional (3D) gaze prediction | |
CN112639577B (en) | Prediction and current limiting adjustment based on application rendering performance | |
CN108364319B (en) | Dimension determination method and device, storage medium and equipment | |
EP3462283B1 (en) | Image display method and device utilized in virtual reality-based apparatus | |
CN109791433A (en) | Prediction type central fovea virtual reality system | |
CN110050250A (en) | The synchronous image regulation of display | |
CN110351480B (en) | Image processing method and device for electronic equipment and electronic equipment | |
KR20180091033A (en) | Image display method, method for manufacturing irregular screen having curved surface, and head-mounted display device | |
US20170076461A1 (en) | Image Presentation Control Methods and Image Presentation Control Apparatuses | |
CN109389545A (en) | Image processing apparatus, method and storage medium | |
US20210185293A1 (en) | Depth data adjustment based on non-visual pose data | |
CN108259770A (en) | Image processing method, device, storage medium and electronic equipment | |
JP7491300B2 (en) | Information processing device, information processing method, and computer-readable recording medium | |
CN109840946A (en) | Virtual objects display methods and device | |
US10891714B2 (en) | Error concealment for a head-mountable device | |
CN107749955B (en) | Panoramic camera posture self-adaptive photometric adjustment method and system and portable terminal | |
US20230047470A1 (en) | Information processing apparatus, information processing method, and computer-readable recording medium | |
KR20170100371A (en) | Apparatus and method of stereo scopic 3d contents creation and display | |
CN106371578B (en) | Nearly eye display control method and device | |
CN108027646B (en) | Anti-shaking method and device for terminal display | |
US10783704B2 (en) | Dense reconstruction for narrow baseline motion observations | |
CN104298350B (en) | information processing method and wearable electronic equipment | |
CN106371577B (en) | Nearly eye display control method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |