CN106162153A

CN106162153A - Display control method and device

Info

Publication number: CN106162153A
Application number: CN201510158440.4A
Authority: CN
Inventors: 周梁
Original assignee: Beijing Zhigu Ruituo Technology Services Co Ltd
Current assignee: Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date: 2015-04-03
Filing date: 2015-04-03
Publication date: 2016-11-23
Anticipated expiration: 2035-04-03
Also published as: CN106162153B

Abstract

The embodiment of the present application discloses a kind of display control method and device, described method includes: show according to the first display device or the first depth of view information of source contents to be shown, determining the second depth of view information of described source contents, described second depth of view information is different from described first depth of view information；Control the second display device and show, according to the second image distance, the Part II that described source contents is corresponding with described second depth of view information, described second image distance is different from the first image distance in the depth direction, described first image distance is described first display device focusing display image distance about Part I, and described Part I is the part that described source contents is corresponding with described first depth of view information.The application improves depth resolution and/or the depth bounds of clear display of overall display image.

Description

Display control method and device

Technical field

The application relates to Display Technique field, particularly relates to a kind of display control method and device.

Background technology

Image procossing includes the aspects such as image acquisition and image show.Along with image processing techniques Constantly progressive, image acquisition resolution and image display resolution have and significantly promote, but from From the point of view of the trend of technology development, it is limited to the factor such as equipment cost, data processing amount, single figure As the image acquisition ability of sensor is higher than the image display capability of single display device, gather figure The resolution of picture higher than display image resolution, such as, gather image depth resolution or Field depth will be far above the depth resolution of display image or field depth, and the two less mates, The quality of display image has the space of improvement further.

Summary of the invention

The brief overview about the application given below, in order to provide about the application's Basic comprehension in terms of some.Should be appreciated that this general introduction is not exhaustive about the application Property general introduction.It is not intended to determine the key of the application or pith, is not to be intended to limit Determine scope of the present application.Its purpose is only to provide some concept in simplified form, makees with this For the preamble in greater detail discussed after a while.

The embodiment of the present application provides a kind of display control method and device.

On the one hand, the embodiment of the present application provides a kind of display control method, including:

Show according to the first display device or the first depth of view information of source contents to be shown, determine Second depth of view information of described source contents, described second depth of view information and described first depth of view information Different；

Control the second display device and show described source contents and described second scape according to the second image distance Deeply convinceing the Part II that breath is corresponding, described second image distance is different from the first image distance in the depth direction, Described first image distance is described first display device focusing display image distance about Part I, institute Stating Part I is the part that described source contents is corresponding with described first depth of view information.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described control Make the second display device and show described source contents and described second depth of view information according to the second image distance Corresponding Part II, including: adjust described second display device according to described second image distance Focusing imaging area；Control described second display device and show described second in described focusing imaging area Part.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, according to institute State the second image distance and adjust the focusing imaging surface of described second display device, including: by mobile institute State the position of the second display device and/or change the optical projection parameter of described second display device, The focusing imaging area of described second display device is adjusted to the one-tenth corresponding with described second image distance As district.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described the One display device includes: the first light field display device.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described the Two display devices include: near-eye display device.

In conjunction with the embodiment of the present application provide any one display control method, optionally, described closely Eye display device includes: nearly eye field display device.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described light Learn projection parameter and include at least one of: the radius of the sub-lens of nearly eye field display device, The focal length of sub-lens of nearly eye field display device, the display screen of described nearly eye field display device Distance between the lenslet arrays of described near-eye display device.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described also Including: obtain the depth information of described source contents；Determine described according at least to described depth information First depth of view information.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described side Method also includes: obtain the depth of field display capability information of described first display device；According at least to institute State depth information and determine described first depth of view information, including: according to described first display device Depth of field display capability information and the depth information of described source contents, determine described first depth of view information.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described scape Deep display capability information includes at least one of: degree of depth indication range information, focusing show picture Away from distributed intelligence.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described side Method also includes: according to described first depth of view information, described source contents is carried out down-sampling, obtains institute State Part I；Described Part I is sent to described first display device.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described side Method also includes: according to described second depth of view information, described source contents is carried out down-sampling, obtains institute State Part II；Described Part II is sent to described second display device.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described the One depth of view information is included at least two first weight focusings of described depth direction Discrete Distribution； Described second depth of view information is included at least one second weight of described depth direction Discrete Distribution Focusing；Described at least one second weight focusing at least one depth location, Jie Yusuo State between the depth location of at least two first weight focusings.

Any one display control method provided in conjunction with the embodiment of the present application, optionally, described the One depth of view information and described second depth of view information non-overlapping copies on described depth direction.

On the other hand, the embodiment of the present application provides a kind of display control unit, including:

One second depth of view information determines module, for showing or to be shown according to the first display device The first depth of view information of source contents, determine the second depth of view information of described source contents, described Two depth of view information are different from described first depth of view information；

One display control module, shows described for controlling the second display device according to the second image distance The Part II that source contents is corresponding with described second depth of view information, described second image distance is in degree of depth side Upwards different from the first image distance, described first image distance is that described first display device is about first The focusing display image distance divided, described Part I is described source contents and described first depth of view information Corresponding part.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described aobvious Show that control module includes: a focusing imaging area adjusts submodule, for according to described second image distance Adjust the focusing imaging area of described second display device；One display controls submodule, is used for controlling Described second display device shows described Part II in described focusing imaging area.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described right Burnt imaging area adjusts submodule and includes: a focusing imaging area adjustment unit, for by mobile institute State the position of the second display device and/or change the optical projection parameter of described second display device, The focusing imaging area of described second display device is adjusted to the one-tenth corresponding with described second image distance As district.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described the One display device includes: the first light field display device.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described the Two display devices include: near-eye display device.

In conjunction with the embodiment of the present application provide any one display control unit, optionally, described closely Eye display device includes: nearly eye field display device.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described light Learn projection parameter and include at least one of: the radius of the sub-lens of nearly eye field display device, The focal length of sub-lens of nearly eye field display device, the display screen of described nearly eye field display device Distance between the lenslet arrays of described near-eye display device.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described dress Put and also include: a Depth Information Acquistion module, for obtaining the depth information of described source contents； One first depth of view information determines module, for determining described first according at least to described depth information Depth of view information.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described dress Put and also include: a depth of field display capability information acquisition module, be used for obtaining described first display and set Standby depth of field display capability information；Described first depth of view information determines that module includes: one first scape Deeply convince that breath determines submodule, for the depth of field display capability information according to described first display device With the depth information of described source contents, determine described first depth of view information.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described scape Deep display capability information includes at least one of: degree of depth indication range information, focusing show picture Away from distributed intelligence.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described dress Put and also include: one first sampling module, be used for according to described first depth of view information in described source Hold and carry out down-sampling, obtain described Part I；One first sending module, for described the One display device sends described Part I.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described dress Put and also include: one second sampling module, be used for according to described second depth of view information in described source Hold and carry out down-sampling, obtain described Part II；One second sending module, for described the Two display devices send described Part II.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described the One depth of view information is included at least two first weight focusings of described depth direction Discrete Distribution； Described second depth of view information is included at least one second weight of described depth direction Discrete Distribution Focusing；Described at least one second weight focusing at least one depth location, Jie Yusuo State between the depth location of at least two first weight focusings.

Any one display control unit provided in conjunction with the embodiment of the present application, optionally, described the One depth of view information and described second depth of view information non-overlapping copies on described depth direction.

The technical scheme that the embodiment of the present application provides, can control the second display device according to described the Two image distances show the Part II that described source contents is corresponding with described second depth of view information, and described First display device shows described source contents and described first depth of field letter according to described first image distance The Part I that breath is corresponding, so, is equivalent to by described second display device described first Display device display capabilities in the depth direction supplements, and is i.e. existed by the second display device The scape of the described first not shown described source contents of display device is shown on different depth locations Deeply convince breath, be conducive to showing the more depth information of described source contents, improve overall display figure As depth resolution and/or clear shown in depth bounds, and then improve display quality.

By below in conjunction with the accompanying drawing detailed description to the alternative embodiment of the application, the application's The advantage of these and other will be apparent from.

Accompanying drawing explanation

The application can be by with reference to obtaining below in association with the description given by accompanying drawing more preferably Understanding, employ same or analogous reference the most in all of the figs to represent identical Or similar parts.Described accompanying drawing is included in this specification together with detailed description below In and form the part of this specification, and be used for being further illustrated by the application can Select embodiment and explain the principle and advantage of the application.In the accompanying drawings:

A kind of display control method flow chart that Fig. 1 provides for the embodiment of the present application；

The depth of field display capability information of the first display device that Fig. 2 provides for the embodiment of the present application Example；

The light path example of a kind of light field display device that Fig. 3 provides for the embodiment of the present application；

The application example of the light depth of field display gain that Fig. 4 provides for the embodiment of the present application；

A kind of light field display light path example that Fig. 5 a provides for the embodiment of the present application；

The another kind of light field display light path example that Fig. 5 b provides for the embodiment of the present application；

A kind of application example showing control that Fig. 6 a provides for the embodiment of the present application；

A kind of application example showing control that Fig. 6 b provides for the embodiment of the present application；

The logic diagram of a kind of display control unit that Fig. 7 provides for the embodiment of the present application；

The logic diagram of the another kind of display control unit that Fig. 8 provides for the embodiment of the present application；

The logic diagram of another display control unit that Fig. 9 provides for the embodiment of the present application.

It will be appreciated by those skilled in the art that the element in accompanying drawing is only used to simple and clear For the sake of and illustrate, and be not necessarily drawn to scale.Such as, some element in accompanying drawing Size may be exaggerated relative to other elements, in order to be favorably improved the embodiment of the present application Understanding.

Detailed description of the invention

Hereinafter in connection with accompanying drawing, the one exemplary embodiment of the application is described in detail.For Clear and simple and clear for the sake of, all features of actual embodiment are not the most described. It should be understood, however, that must make a lot during developing any this practical embodiments Decision specific to embodiment, in order to realize the objectives of developer, such as, meet Those restrictive conditions relevant to system and business, and these restrictive conditions may be with really Execute the difference of mode and change.Additionally, it also should be appreciated that, although development is likely It is extremely complex and time-consuming, but for the those skilled in the art having benefited from present disclosure, This development is only routine task.

Here, also need to explanation a bit, in order to avoid obscuring because of unnecessary details The application, merely depict closely-related with the scheme according to the application in the drawings and in the description Apparatus structure and/or process step, and eliminate little with the application relation, this area Parts known to those of ordinary skill and the expression of process and description.

Below in conjunction with the accompanying drawings (label identical in some accompanying drawings represent identical element) and implement Example, is described in further detail the detailed description of the invention of the application.Following example are used for Bright the application, but it is not limited to scope of the present application.

It will be understood by those skilled in the art that terms such as " first ", " second " in the application It is only used for distinguishing different step, equipment or module etc., neither represents any particular technology implication, The inevitable logical order between them is not indicated that yet.

The flow chart of a kind of display control method that Fig. 1 provides for the embodiment of the present application.The application The executive agent of the display control method that embodiment provides can be a certain display control unit, described Display control unit can be by performing this display control method during image, video etc. show Carry out image display to control.The equipment form of expression of described display control unit is unrestricted, example If described display control unit can be a certain independent parts, these parts show with at least two respectively Show that equipment (such as at least one first display device, at least one second display device etc.) coordinates Communication；Or, described display control unit can be integrated in a display as a certain functional module and set In standby (the second display device as described in the present application), this is not limiting as by the embodiment of the present application. Concrete as it is shown in figure 1, a kind of display control method that the embodiment of the present application provides includes:

S101: show according to the first display device or the first depth of view information of source contents to be shown, Determine the second depth of view information of described source contents, described second depth of view information and described first depth of field Information is different.

Described first display device is to have 3D or the equipment of class 3D display capabilities.Described source Content is the image information with certain depth distribution, in the range of described depth profile relatively certain Certain depth scope (the referred to as depth of field) before and after one focusing imaging surface all can blur-free imaging.Optional , described source contents may include but be not limited to the light field image with the distribution of certain depth of field, described In the depth of field distribution of light field image, these multiple heavy focusings of Discrete Distribution, the plurality of heavy right Focus in the depth direction in non-uniform Distribution, the heavily focusing in the region that the such as degree of depth is nearer The distribution comparatively dense of point, the distribution of the heavy focusing in degree of depth region farther out is sparse.Each heavy The corresponding focusing imaging plane of focusing, the corresponding certain depth of field distribution of each focusing imaging plane, It is to say, be distributed before and after each focusing imaging plane one section can the depth bounds of blur-free imaging, The depth of field of different focus imaging plane may be different.

Can show according to the first display device or the first depth of view information of source contents to be shown, really Second depth of view information of fixed described source contents, described second depth of view information and described first depth of field letter Breath difference, such as, can determine in the field depth of described source contents that a certain subrange is described First depth of view information, another subrange is described second depth of view information.

S102: control the second display device and show described source contents and described the according to the second image distance The Part II that two depth of view information are corresponding, described second image distance in the depth direction with the first image distance Difference, described first image distance is described first display device focusing display picture about Part I Away from, described Part I is the part that described source contents is corresponding with described first depth of view information.

The content that described first display device shows, may be in the display of described first display device A certain depth bounds imaging before and after screen, the application by described first display device about described The focusing display image distance of a part is referred to as the first image distance.Described second can be determined in the depth direction Image distance, wherein, described second image distance and described first image distance relative position in the depth direction Relation, meets described first depth of view information and the relative depth relationships of described second depth of view information, For example, it is assumed that the degree of depth of the most described second depth of view information of described first depth of view information is farther out, then The distance of the display screen of described first image distance and described first display device, less than described second picture Away from the distance with the display screen of described first display device, say, that human eye is from described first When the opposite side of the display screen of display device watches image, described first image distance and the distance of human eye More remote with the distance of human eye than described second image distance, thus allow human eye impression in depth direction distribution The image information of different depth.

Optionally, described control the second display device according to the second image distance show described source contents with The Part II that described second depth of view information is corresponding, including: adjust institute according to described second image distance State the focusing imaging area of the second display device；Control described second display device to focus into described As district shows described Part II.Described focusing imaging area is that described second display device clearly becomes The region of picture, adjusts the focusing imaging area of described second display device according to described second image distance, Make the distance of focusing imaging surface distance human eye of described focusing imaging area as close possible to even etc. In described second image distance, the certain depth scope before and after focusing imaging surface is can the district of blur-free imaging Territory, imaging area of i.e. focusing, after completing the adjustment of described focusing imaging area, can control described Second display device shows described source contents and described second depth of field letter in described focusing imaging area The Part II that breath is corresponding.Use the program that described second display device can be made with described second In the focusing imaging area that image distance is corresponding, in showing the described first not shown described source of display device Hold the part of other depth of view information corresponding, the most in the depth direction to described first display device Display capabilities supplement, improve the depth resolution of overall display image, and then improve Display quality.

Further, optionally, the right of described second display device is adjusted according to described second image distance Burnt imaging surface, including: position and/or change by mobile described second display device are described The optical projection parameter of the second display device, adjusts the focusing imaging area of described second display device Whole is the imaging area corresponding with described second image distance.Such as, can be at described first display device Second display device described in couple positioned opposite, by adjusting described second display device and described the The relative position of one display device, and/or adjust described second display device phase relative to human eye To position, and/or it is a kind of or many to adjust the focal length of lens of described second display device, radius etc. Plant optical projection parameter so that the focusing imaging area of described second display device is as far as possible with described Second image distance coupling, the image distance corresponding to imaging surface of the focusing in imaging area of focusing as described in make As close possible to the most described second image distance.Such as, described can be made by above-mentioned adjustment The focusing imaging area of two display devices is positioned on the focusing imaging surface at described second image distance place, with Show a certain clearly 2D image corresponding with the second depth of view information；The most such as, by above-mentioned Adjustment can make corresponding to the most described second image distance in focusing imaging area of described second display device Focusing imaging surface be symmetric, there is the picture material of certain depth scope with clear display. Use the program can realize the focusing imaging area to described second display device simply, quickly adjust Whole, scheme has preferable universality.

Optionally, the determination mode of described first depth of view information is very flexible, such as, can obtain The depth information of described source contents, determines described first depth of field letter according at least to described depth information Breath.The depth information of described source contents reflects the different piece of described source contents at depth direction On distribution, therefore, can be according at least to the depth information of described source contents, at described source contents Depth profile in the range of determine that a certain subrange is as described first depth of view information so that described The source contents Part I corresponding with described first depth of view information is on described first display device Clearly shown.The program determines described first depth of field according to the depth information of described source contents Information, scheme the most easily realizes.

Further alternative, described display control method also includes: obtains described first display and sets Standby depth of field display capability information.Under this situation, can be according to the depth of field of described first display device Display capability information and the depth information of described source contents, determine described first depth of view information.Its In, described depth of field display capability information may include but be not limited at least one of: the degree of depth shows Range information, the distributed intelligence of focusing display image distance.Described degree of depth indication range information represents phase To a certain depth bounds before and after the display screen of the first display device, the first display device can be at this The content of depth bounds display different depth information, such as, as in figure 2 it is shown, relative first light For the display screen of field display device, before and after this display screen, each depth bounds is this first light field The degree of depth indication range of display device.The distributed intelligence of described focusing display image distance represents first In the degree of depth indication range of display device, can the imaging surface (imaging surface of i.e. focusing) of blur-free imaging The quantity of corresponding image distance (i.e. focusing display image distance) and distribution thereof, at the first display device Degree of depth indication range in exist multiple focusing display image distance when, the plurality of focusing show Showing that image distance typically exhibits non-uniform Distribution in the depth direction, such as, a certain first light field shows Equipment have 5 focusing display image distances, be respectively distributed to this light field display device display screen S0, The depth location of each S1 and the depth location of each S2 before and after this display screen before and after this display screen. Described depth of field display capability information can obtain from described first display device, or, can be from other Mode obtains the depth of field display capability information of described first display device in advance, and the program is by described The depth information of content and the depth of field display capability information of described first display device, collectively as The foundation that described first depth of view information determines, can make described first depth of view information determined more preferable Adaptive with the ability of described first display device.In actual applications, it may be determined that described source contents In the depth sub-range corresponding with the depth of field ability information of described first display device, for described One depth of view information, or, can be according to the depth of field display capability information pair of described first display device The information of the partial depth subrange of described source contents carries out the polymerization of depth direction, thus obtains Described first depth of view information adaptive with the depth of field display capability information of described first display device.

Optionally, described first display device and described second display device can be same type of Display device, described first display device and as described in the second display device be projection 3D show Show equipment or be light field display device etc.；Or, described first display device and described second Display device can be different types of display device, if described first display device is traditional binocular Stereoscopic vision 3D display device or projection 3D display device, and described second display device is Near-eye display device or light field display device etc..System buildup is very flexible, can meet various The practical application request changed, the light field image degree of depth as shown in use light field display device to realize is empty Between superposition realize depth resolution gain, can improve to a certain extent light field image display effect Really, and the characteristics such as the light field image flexible display in certain weight focusing range can be played.

Different from traditional display device, light field display device can be provided with at neighbouring display screen One lenslet arrays, as it is shown on figure 3, described lenslet arrays is alternatively referred to as microlens array, Including the sub-lens (or referred to as lenticule) of multiple array distribution, from the light warp of display screen At least one sub-lens in described lenslet arrays changes the direction of propagation, after the direction of propagation changes Light converge through the eyes (similar lens) of user with imaging on the retina of user.Aobvious Display screen includes multiple viewing area, includes multiple display pixel and a viewing area in a viewing area Territory is corresponding with a sub-lens, say, that in light field display device, and lenslet arrays is with aobvious It is the corresponding relation presenting one-to-many between the display pixel of display screen, can be multiple aobvious by display screen Show the information of pixel display image to be displayed same local different visual angles, thus can realize light field figure As abundant display characteristic.

If without the lenslet arrays of light field display device and direct viewing image, it is seen that Image is usual and unintelligible.If watching image, the possibility watched through described lenslet arrays Heavy focus image for the distribution of a certain depth of field in space.It is to say, light field image has necessarily Heavy focusing range, in this heavy focusing range, the different depth of field may corresponding different heavily focusing figures Picture, if through lenslet arrays watch, the most every width weight focus image be the most all a pair clearly 2D image.

In an optional application scenarios, the first display device and the second display device are oppositely arranged, As shown in Figure 4, described first display device is the first light field display device, described second display Equipment is nearly eye field display device, for showing that the light of light field image is through described nearly eye field Display device pools picture on human eye optical fundus.Described nearly eye field display device can include but not limit In perspective (See-through) light field display intelligent glasses, described perspective light field display Brilliant Eyes Mirror includes lenslet arrays and perspective display screen, and described perspective display screen can generally be had an X-rayed aobvious Display screen, it is also possible to regional area is perspective display screen, and region as corresponding in user's visual line of sight is Perspective display screen.User can see and the through the lenslet arrays of intelligent glasses and perspective display screen At least one weight focus image that two depth of view information are corresponding, additionally, user also can show through the first light field Show the lenslet arrays of equipment see with display screen corresponding with the first depth of view information at least another Weight focus image, described first light field display device and described nearly eye field display device show respectively The imaging light of two shown or two groups weight focus images converges on user optical fundus, forms degree of depth side The light field image that the widest depth of field is distributed or depth resolution is higher.Or, nearly eye shows and sets Standby projection source can also be positioned at beyond the user visual field, its display with the second depth of view information pair The field information of at least one weight focus image answered, by the lenslet arrays of near-eye display device After refraction, it is reflected into human eye by user's pellicle mirror (Beam Splitter) at the moment；This Outward, user also can see and first through the lenslet arrays of the first light field display device and display screen At least another heavy focus image that depth of view information is corresponding, described first light field display device and described The imaging light of two or the two groups weight focus images that nearly eye field display device shows respectively exists User optical fundus is converged, and forms the light that on depth direction, the wider depth of field is distributed or depth resolution is higher Field picture.

Optionally, according to described first depth of view information, described source contents can be carried out down-sampling, To described Part I；Send described Part I to described first display device, use the party Case advantageously reduces data volume mutual between display control unit and the first display device.Certainly, Described source contents also can be sent to described first display device by display control unit, by described One display device carries out down-sampling according to described first depth of view information to described source contents, thus obtains To described Part I to be shown.

Optionally, also according to described second depth of view information, described source contents can be carried out down-sampling, Obtain described Part II；Sending described Part II to described second display device, using should Scheme advantageously reduces data volume mutual between display control unit and the first display device.Its In, described Part II can be a 2D image clearly, and display control unit is according to described Second image distance controls the second display device, is different from the first display device in the depth direction clear Second image distance of the first image distance of imaging, presents this 2D image, increases the most in the depth direction Add the content of actual clear display, improve depth resolution.Or, described Part II Can also be the light field subimage of certain depth distribution, display control unit be according to described second picture Away from controlling the second display device, described second display device is made to be different from first in the depth direction Second image distance of the first image distance of display device blur-free imaging, shows corresponding light field subimage, Thus be conducive to the larger range of depth of field of actual displayed in the depth direction, improve depth resolution.

Below might as well be with display device for light field display device (if the first display device is the first light Field display device, the second display device is nearly eye field display device) as a example by, in described source Hold down-sampling implementation in the depth direction to be illustrated.

(S1) corresponding relation between image distance and the blur circle of light field display device is determined.

One optional light path of light field display device as shown in Figure 5 a, aobvious through light field display device The light that display screen sends picture point after lenslet arrays converges (might as well be referred to as with the distance of human eye Image distance) it is expressed as W, a son corresponding with lenslet arrays in the display screen of light field display device Including multiple display pixel in the imaging region of lens, the plurality of display pixel distribution is multiple In the blur circle of different radii, a display content can be regarded as in a blur circle in the imaging of human eye Each display pixel display light is at the storage effect of human eye.Dispersive spot radius might as well represent with d, D usually shows the integral multiple of pixel diameter.The corresponding relation such as following formula that W and d exists:

\frac{1}{W} = \frac{1}{L - u} = \frac{1}{\frac{1}{\frac{1}{f} - \frac{1}{v} (1 + \frac{d}{A})} - L} . . . (1)

Wherein, A is the radius of the sub-lens of light field display device, and f is light field display device The focal length of sub-lens, L is the eyes of user pupil lenslet arrays plane to light field display device Distance, v is the display screen lenslet arrays to this light field display device of light field display device Between distance, u be real image that light field display device is corresponding or the virtual image to sub-lens center away from From (real image be on the occasion of, the virtual image is negative value).

According to formula (1), Dispersive spot radius d takes different centrifugal pumps d_i(i=1,2,3....) can distinguish Obtain image distance W corresponding with each Dispersive spot radius, be expressed as W_i(i=1,2,3...).

Said method is universal method.Use said method can obtain the first light field display device Corresponding relation (the first corresponding relation might as well be referred to as) between image distance and blur circle, or, can Obtain the corresponding relation between image distance and the blur circle of nearly eye field display device and (might as well be referred to as Two corresponding relations).

(S2) depth information of source contents is obtained, according to the portion of the depth information of described source contents Divide depth sub-range that the image distance of light field display device carries out the polymerization of depth direction, adopt under obtaining The corresponding relation of sample.

An image distance in the corresponding relation of the down-sampling obtained, may be in described corresponding relation It is positioned at the meansigma methods of multiple image distances in the range of certain depth, accordingly, in the correspondence of down-sampling A Dispersive spot radius in relation, may be corresponding multiple blur circles half in described corresponding relation The meansigma methods in footpath.The image distance of the corresponding relation of down-sampling is a value or is discrete several values, Be equivalent to determine in the weight focusing range of light field display device one or discrete several heavy right Focus, needs the content combining source images to determine the heavy focus image corresponding with these heavy focusings.

Such as, according to described first depth of view information of described source contents, described first light field can be shown Show that the image distance of equipment carries out the polymerization of depth direction, obtain the first corresponding relation of down-sampling.Really The fixed heavy focus image corresponding with the heavy focusing that described first depth of view information includes, is institute State Part I corresponding with described first depth of view information in source contents.

The most such as, can be according to described second depth of view information of described source contents to described nearly eye field The image distance of display device carries out the polymerization of depth direction, obtains the second corresponding relation of down-sampling. The heavy focus image corresponding with the heavy focusing that described second depth of view information includes determined, is Part II corresponding with described second depth of view information in described source contents.

(S3) determine according to the corresponding relation after down-sampling and source contents needs carry out down-sampling Region, and adopt under the source contents part that the region needing to carry out down-sampling determined is corresponding is carried out Sample processes.

As shown in Figure 5 b, according to imaging formula and triangle geometrical relationship, available following relation Formula:

\frac{1}{U} + \frac{1}{V} + \frac{1}{F} . . . (1)

\frac{1}{v} + \frac{1}{L - V} = \frac{1}{f} . . . (2)

\frac{H}{h} = \frac{U}{v} . . . (3)

\frac{d_{i} - h}{h^{'}} = \frac{L - V}{v} . . . (4)

Wherein, U, V, L are respectively eyeball lens to retina, to being shown as picture, and To the distance of lenslet arrays, F, f are respectively the focal length of eyeball and sub-lens, and v is that son is saturating Lens array is to the distance of display screen matrix, and H, h, h' are respectively certain object on the retina, Invent the imaging size in image planes, and i-th sub-lens correspondence imaging region, d_iIt is i-th Individual sub-lens is to the distance of reference point, and this reference point can be image any point, and it is saturating that this sentences eyeball To simplify calculating as a example by mirror optical axis and display screen intersection point, according to formula (1) to (4), can obtain:

h^{'} = \frac{(d_{i} U - LH) (v - f)}{fU} + \frac{Hv}{U} . . . (5)

Therefore any point for imaging on retina (assumes that this point is to eyeball optical center of lens distance For H, this point is equivalent to certain pixel of corresponding described source contents, and H is equivalent to being somebody's turn to do of correspondence The phase para-position of the reference point that the most described source contents of pixel is corresponding with described eyeball optical center of lens Confidence ceases), its h' on i-th sub-lens correspondence imaging region can be calculated, Its imaging point position on i-th sub-lens correspondence imaging region is obtained to map.

Said method is the universal method determining h' and H corresponding relation.Determine with down-sampling after The depth information of the described source contents that a certain image distance in a certain corresponding relation is corresponding, according to described The depth information of source contents and the corresponding relation of content, it is deep with determine to obtain described source contents The part that degree information is corresponding.By many for the picture district of the described source contents correspondence retina image-forming obtained Individual, carry out according to the method described above being calculated on the most corresponding the plurality of imaging region H', it may be determined that certain viewing area (the first viewing area might as well be referred to as) of display screen, It is the viewing area of the described source contents that impact obtains to described first viewing area, determines and one Other regions in addition to described first viewing area in the whole viewing area that sub-lens is corresponding (the second viewing area might as well be referred to as), the portion of corresponding described second viewing area of described source contents It is divided into the part needing to carry out down-sampling, such as to this part according to the disperse corresponding with this image distance Radius of circle square carry out down-sampling, so that the part after described source contents down-sampling is at this picture Present on the heavy focus image of corresponding heavy focusing similar focus partial content clearly and The visual effect that non-focusing partial content is fuzzy.Correspond on the first light field display device, can be true A certain image distance W calmly and in the first corresponding relation of down-sampling_it(such as described first image distance) is right The depth information (such as described first depth of view information) of the described source images answered, according to described source figure The depth information of picture and the corresponding relation of content, can obtain the institute corresponding with the depth information determined State the content (such as described Part I) of source images.Such as, the described source images that can will obtain Content correspondence retina image-forming as multiple points in district, be calculated according to the method described above H' on the most corresponding the plurality of imaging region, it may be determined that the viewing area a1 of display screen, Obtain the region of the content that viewing area a1 is the described source images that impact obtains, determine and one The viewing area a2 that sub-lens is corresponding, the part of described source contents correspondence viewing area a2 is for needing The part of down-sampling to be carried out, such as to this part according to this image distance W_itCorresponding blur circle Radius (might as well be expressed as d_it) square carry out down-sampling, so that the image after down-sampling exists Similar focusing partial content is presented clear on the heavy focus image of the heavy focusing that this image distance is corresponding The visual effect that clear rather than focusing partial content obscures.

Correspond on the display device of nearly eye field, can be according to the depth information of described source images and interior The corresponding relation held, obtains the content of the described source images corresponding with described second depth of view information (such as described Part II), such as, can be by the content correspondence view of the described source images of acquisition Multiple points in the picture district of film imaging, carry out being calculated the plurality of difference according to the method described above The corresponding h' on imaging region, it may be determined that the viewing area b1 of display screen, obtains viewing area B1 is the region of the content of the described source images that impact obtains, and determines corresponding with a sub-lens Viewing area b2, the part of described source contents correspondence viewing area b2 carries out down-sampling for needs Part, to this part according to the Dispersive spot radius corresponding with a certain image distance (such as the second image distance) Square carry out down-sampling, so that the image after down-sampling is in heavy focusing corresponding to this image distance Heavy focus image on present that similar focusing partial content is clear rather than focusing partial content mould The visual effect stuck with paste.

In actual application, optionally, by adjusting one or more of nearly eye field display device Optical projection parameter so that the image distance of the focusing imaging surface of described nearly eye field display device to the greatest extent may be used Can be close to the most described second image distance, optionally, described optical projection parameter can include but It is not limited at least one of: the radius of sub-lens of nearly eye field display device, nearly eye field The focal length of the sub-lens of display device, described nearly eye field display device display screen to described closely Distance between the lenslet arrays of eye display device, meets following relation between different parameters:

\frac{1}{{W_{it}}^{'}} = \frac{1}{L^{'} - u^{'}} = \frac{1}{\frac{1}{\frac{1}{f^{'}} - \frac{1}{v^{'}} (1 + \frac{d^{'}}{A^{'}})} - L^{'}} . . . (6)

Wherein, W_it' it is the second image distance, A' is the radius of the sub-lens of nearly eye field display device, F' is the focal length of the sub-lens of nearly eye field display device, and L' is that eyes of user pupil is to nearly eye Distance between the lenslet arrays of field display device, v' is the display of nearly eye field display device Screen is to the distance between the lenslet arrays of near-eye display device, and u' is that nearly eye field shows and sets Standby corresponding real image or the virtual image are to the distance (real image be on the occasion of, the virtual image is negative value) at sub-lens center.

After above-mentioned process, the first light field display device is in focusing corresponding to described first image distance Imaging area clearly shows described Part I, and nearly eye field display device is in described second image distance pair The focusing imaging area answered clearly shows described Part II, described Part I and described second Point realize depth of field superposition in the depth direction, thereby increase the interior of actual displayed on depth direction Hold, improve the depth resolution of entirety display.

Below the application scenarios of the technical scheme that the embodiment of the present application provides is illustrated.

As shown in Figure 6 a, this scene can be set (1) optional application scenarios by the second display Standby display in the depth direction supplements the depth resolution improving the first display device.Specifically For, described first depth of view information is included at least two of described depth direction Discrete Distribution One weight focusing；Described second depth of view information is included in described depth direction Discrete Distribution at least One second weight focusing；Described at least one second weight focusing at least one degree of depth position Put, between the depth location of described at least two first weight focusings.The program is equivalent to Second picture being different from the first image distance is determined in the degree of depth indication range of the first display device Away from, control the second display device in the second image distance, show respective depth information (the second depth of field letter Breath) content (Part II).

Such as, human eye watches image at distance the first display device L, and relative first display sets There are 5 focusing display image distances in standby degree of depth indication range, are respectively distributed to this light field and show and set Each S2 before and after the depth location of each S1 and this display screen before and after standby display screen, this display screen Depth location.Owing to the ability of the human eye perception scene depth of field is limited, generally distance human eye The nearest, the width of the single depth of field plane that human eye can resolve is the narrowest, and this width is along with distance Increase and strengthen.In the scene shown in Fig. 6 a, the focusing imaging surface of the first display device With the distance of human eye relatively far away from, human eye in the depth of field analytical range relative narrower of this segment distance, This makes to show this ellipse object iff by the first display device, and this ellipse object is deeply The field depth that each several part of degree is likely not to have by each focusing imaging surface of the first display device is complete All standing, it is possible to cause clear end to end, the middle part of this ellipse object in the depth direction to obscure Deng.And use the technical scheme that the embodiment of the present application provides, can be at least one of S2 and S1 Depth location determines one second image distance J, corresponding in the second image distance by controlling the second display device Focusing imaging area on the clear middle part showing this ellipse object, thus to the first display device Degree of depth display capabilities is supplemented, and improves the depth resolution of overall display, and then improves Display quality.

(2) another optional application scenarios is as shown in Figure 6 b, and this scene can be by the second display Equipment display in the depth direction supplements the display depth range extending the first display device. Specifically, described first depth of view information and described second depth of view information are on described depth direction Non-overlapping copies.The program is equivalent to determine one outside the degree of depth indication range of the first display device Second image distance, controls the second display device and shows respective depth information (second in the second image distance Depth of view information) content (Part II), say, that in the scene shown in Fig. 6 b, Ellipse object is positioned at the part outside the first display device degree of depth indication range, only shows by first Show that equipment possibly cannot clearly show.And use the technical scheme that the embodiment of the present application provides, can At least one depth location outside the first display device degree of depth indication range determines one second picture Away from J, by controlling the second display device on the focusing imaging area that the second image distance is corresponding, clearly Show this ellipse object be positioned at the degree of depth indication range of the first display device outside part, thus The degree of depth display capabilities of the first display device is supplemented, has been widened overall clear display Depth bounds, and then improve display quality.

It will be understood by those skilled in the art that any of the above-described side in the application detailed description of the invention In method, the sequence number size of each step is not meant to the priority of execution sequence, the execution of each step Order should determine with its function and internal logic, and should be to the reality of the application detailed description of the invention Process of executing constitutes any restriction.

The logic diagram of a kind of display control unit that Fig. 7 provides for the embodiment of the present application.Such as figure Shown in 7, a kind of display control unit that the embodiment of the present application provides includes: one second depth of field letter Breath determines module 71 and a display control module 72.

Second depth of view information determines that module 71 is for showing or to be shown according to the first display device The first depth of view information of source contents, determine the second depth of view information of described source contents, described Two depth of view information are different from described first depth of view information.

Display control module 72 shows described for controlling the second display device according to the second image distance The Part II that source contents is corresponding with described second depth of view information, described second image distance is in degree of depth side Upwards different from the first image distance, described first image distance is that described first display device is about first The focusing display image distance divided, described Part I is described source contents and described first depth of view information Corresponding part.

Described display control unit can be by performing this display during image, video etc. show Control method carries out image display and controls.The equipment form of expression of described display control unit is not subject to Limit, the most described display control unit can be a certain independent parts, these parts respectively with extremely Few two display devices are (such as at least one first display device, at least one second display device Deng) coordinate communication；Or, described display control unit can be integrated in as a certain functional module In one display device (the second display device as described in the present application), the embodiment of the present application is to this It is not limiting as.

Optionally, as shown in Figure 8, described display control module 72 includes: a focusing imaging District adjusts submodule 721 and a display controls submodule 722.Focusing imaging area adjusts submodule 721 for adjusting the focusing imaging area of described second display device according to described second image distance；Aobvious Show that control submodule 722 is aobvious in described focusing imaging area for controlling described second display device Show described Part II.Use the program can make described second display device with described second picture In corresponding focusing imaging area, show the described first not shown described source contents of display device The part of other depth of view information corresponding, the most in the depth direction to described first display device Display capabilities supplements, and improves the depth resolution of overall display image, and then improves Display quality.

Optionally, adjustment submodule 721 in described focusing imaging area includes: a focusing imaging area is adjusted Whole unit 7211.Focusing imaging area adjustment unit 7211 is for by mobile described second display The position of equipment and/or change the optical projection parameter of described second display device, by described The focusing imaging area of two display devices is adjusted to the imaging area corresponding with described second image distance.Use The program can realize the focusing imaging area to described second display device simply, quickly adjust, Scheme has preferable universality.

Optionally, described first display device and described second display device can be same type of Display device, described first display device and as described in the second display device be projection 3D show Show equipment or be light field display device etc.；Or, described first display device and described second Display device can be different types of display device, if described first display device is tradition 3D Display device or projection 3D display device, and described second display device is near-eye display device Or light field display device etc..System buildup is very flexible, can meet diversified actual application need Asking, the light field image deep space superposition as shown in use light field display device to realize realizes deeply Degree resolution gain, can improve the display effect of light field image to a certain extent, and can play light The characteristics such as the field picture flexible display in certain weight focusing range.Described near-eye display device can Include but not limited to nearly eye field display device, under this situation, optionally, described optical projection Parameter includes at least one of: the radius of sub-lens of nearly eye field display device, nearly eye The focal length of sub-lens of display device, described nearly eye field display device display screen to described Distance between the lenslet arrays of near-eye display device.The program can realize showing nearly eye field Show effective adjustment of the focusing imaging area of equipment.

Optionally, described display control unit also includes: Depth Information Acquistion module 73 He One first depth of view information determines module 74.Depth Information Acquistion module 73 is used for obtaining described source The depth information of content；First depth of view information determines that module 74 is for according at least to the described degree of depth Information determines described first depth of view information.The program determines according to the depth information of described source contents Described first depth of view information, scheme the most easily realizes.

Optionally, described display control unit also includes: a depth of field display capability information obtains mould Block 75.Depth of field display capability information acquisition module 75 is for obtaining described first display device Depth of field display capability information.Under this situation, described first depth of view information determines that module 74 can be wrapped Include: one first depth of view information determines that submodule 741, the first depth of view information determine submodule 741 Deep for the depth of field display capability information according to described first display device and described source contents Degree information, determines described first depth of view information.Optionally, described depth of field display capability information bag Include at least one of: degree of depth indication range information, focusing show the distributed intelligence of image distance.Should The depth information of described content and the depth of field display capabilities of described first display device are believed by scheme Breath, the foundation determined collectively as described first depth of view information, described first determined can be made Depth of view information is more preferably adaptive with the ability of described first display device.

Optionally, described display control unit also includes: one first sampling module 76 and one One sending module 77.First sampling module 76 is used for according to described first depth of view information described Source contents carries out down-sampling, obtains described Part I；First sending module 77 is for institute State the first display device and send described Part I.The program is used to advantageously reduce display control Data volume mutual between device and the first display device.

Optionally, described display control unit also includes: one second sampling module 78 and one Two sending modules 79.Second sampling module 78 is used for according to described second depth of view information described Source contents carries out down-sampling, obtains described Part II；Second sending module 79 is for institute State the second display device and send described Part II.The program is used to advantageously reduce display control The interaction data amount that device and the second display are standby between setting.

Optionally, described first depth of view information is included in described depth direction Discrete Distribution at least Two first weight focusings；Described second depth of view information is included in described depth direction Discrete Distribution At least one second weight focusing；At least one at least one the second weight focusing described Depth location, between the depth location of described at least two first weight focusings.The program Can be supplemented by the display in the depth direction of the second display device and improve the first display device Depth resolution.

Optionally, described first depth of view information and described second depth of view information are at described depth direction Upper non-overlapping copies.The program can supplement by the display in the depth direction of the second display device Extend the display depth range of the first display device.

The structured flowchart of another display control unit that Fig. 9 provides for the embodiment of the present application, this The specific implementation of display control unit 900 is not limited by application specific embodiment.As Shown in Fig. 9, display control unit 900 may include that

Processor (Processor) 910, communication interface (Communications Interface) 920, memorizer (Memory) 930 and communication bus 940.Wherein:

Processor 910, communication interface 920 and memorizer 930 are by communication bus 940 Complete mutual communication.

Communication interface 920, for such as to have the equipment of communication function, external light source etc. logical Letter.

Processor 910, is used for the program that performs 932, specifically can perform any of the above-described light field and adopt Correlation step in collection control method embodiment.

Such as, program 932 can include that program code, described program code include that computer is grasped Instruct.

Processor 910 is probably a central processing unit (Central Processing Unit, letter Claim CPU), or specific integrated circuit (Application Specific Integrated Circuit, It is called for short ASIC), or it is configured to implement the one or more integrated electricity of the embodiment of the present application Road.

Memorizer 930, is used for program of depositing 932.Memorizer 930 may comprise random access memory Memorizer (Random Access Memory is called for short RAM), it is also possible to also include non-volatile Property memorizer (Non-volatile memory), for example, at least one disk memory.

Such as, in the optional implementation of one, processor 910 is by performing program 932 Following steps can be performed: show according to the first display device or the first scape of source contents to be shown Deeply convinceing breath, determine the second depth of view information of described source contents, described second depth of view information is with described First depth of view information is different；Control the second display device and show described source contents according to the second image distance The Part II corresponding with described second depth of view information, described second image distance in the depth direction with First image distance is different, and described first image distance is right about Part I of described first display device Burnt display image distance, described Part I is that described source contents is corresponding with described first depth of view information Part.In other optional implementations, processor 910 also may be used by performing program 932 Perform the step that other any embodiment above-mentioned are mentioned, do not repeat them here.

In program 932, each step implements the corresponding step that may refer in above-described embodiment Suddenly, corresponding in module, submodule, unit description, do not repeat them here.Art Technical staff is it can be understood that arrive, for convenience and simplicity of description, and the equipment of foregoing description With the specific works process of module, the corresponding process being referred in preceding method embodiment describes, Do not repeat them here.

In the application the various embodiments described above, the sequence number of embodiment and/or sequencing are the most just In description, do not represent the quality of embodiment.Description to each embodiment all emphasizes particularly on different fields, certain Individual embodiment does not has the part described in detail, may refer to the associated description of other embodiments.Relevant The enforcement principle of device, equipment or system embodiment or the associated description of process, can be found in corresponding The record of embodiment of the method, does not repeats them here.

Those of ordinary skill in the art are it is to be appreciated that combine the embodiments described herein and retouch The unit of each example stated and method step, it is possible to electronic hardware or computer software and Being implemented in combination in of electronic hardware.These functions perform with hardware or software mode actually, Depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can be to often Individual specifically should being used for uses different methods to realize described function, but this realization is not It is considered as beyond scope of the present application.

If described function realizes and as independent product pin using the form of SFU software functional unit When selling or use, can be stored in a computer read/write memory medium.Based on such Understand, part that prior art is contributed by the technical scheme of the application the most in other words or The part of this technical scheme of person can embody with the form of software product, this computer software Product is stored in a storage medium, including some instructions with so that a computer equipment (can be personal computer, server, or the network equipment etc.) performs the application, and each is real Execute all or part of step of method described in example.And aforesaid storage medium includes: USB flash disk, shifting Dynamic hard disk, read only memory (Read-Only Memory is called for short ROM), random access memory are deposited Reservoir (Random Access Memory is called for short RAM), magnetic disc or CD etc. are various can To store the medium of program code.

In the embodiments such as the device of the application, method, system, it is clear that each parts (system, Subsystem, module, submodule, unit, subelement etc.) or each step be can decompose, group Reconfigure after closing and/or decomposing.These decompose and/or reconfigure and should be regarded as the application's Equivalents.Meanwhile, in description to the application specific embodiment above, real for one The mode of executing describes and/or the feature that illustrates can be in same or similar mode one or more Other embodiment individual uses, combined with the feature in other embodiment, or substitute it Feature in its embodiment.

It should be emphasized that term " includes/comprises " referring to when using feature, key element, step herein Rapid or the existence of assembly, but be not precluded from one or more further feature, key element, step or The existence or additional of assembly.

Last it is noted that embodiment of above is merely to illustrate the application, and not to this The restriction of application, about the those of ordinary skill of technical field, without departing from spirit herein In the case of scope, it is also possible to make a variety of changes and modification, the technology of the most all equivalents Scheme falls within the category of the application, and the scope of patent protection of the application should be defined by the claims.

Claims

1. a display control method, it is characterised in that including:

Method the most according to claim 1, it is characterised in that described control second shows Show according to the second image distance, equipment shows that described source contents is corresponding with described second depth of view information Two parts, including:

The focusing imaging area of described second display device is adjusted according to described second image distance；

Control described second display device and show described Part II in described focusing imaging area.

Method the most according to claim 2, it is characterised in that according to described second picture Away from adjust described second display device focusing imaging surface, including:

By moving the position of described second display device and/or changing described second display device Optical projection parameter, the focusing imaging area of described second display device is adjusted to and described The imaging area that two image distances are corresponding.

4. according to the arbitrary described method of claim 1-3, it is characterised in that described first Display device includes: the first light field display device.

5. according to the arbitrary described method of claim 1-4, it is characterised in that described second Display device includes: near-eye display device.

6. a display control unit, it is characterised in that including:

Device the most according to claim 6, it is characterised in that described display controls mould Block includes:

One focusing imaging area adjusts submodule, for adjusting described second according to described second image distance The focusing imaging area of display device；

One display controls submodule, is used for controlling described second display device in described focusing imaging District shows described Part II.

Device the most according to claim 7, it is characterised in that described focusing imaging area Adjustment submodule includes:

One focusing imaging area adjustment unit, for the position by mobile described second display device And/or change the optical projection parameter of described second display device, by described second display device Focusing imaging area be adjusted to the imaging area corresponding with described second image distance.

9. according to the arbitrary described device of claim 6-8, it is characterised in that described first Display device includes: the first light field display device.

10. according to the arbitrary described device of claim 6-9, it is characterised in that described second Display device includes: near-eye display device.