CN106973283A - A kind of method for displaying image and device - Google Patents
A kind of method for displaying image and device Download PDFInfo
- Publication number
- CN106973283A CN106973283A CN201710201673.7A CN201710201673A CN106973283A CN 106973283 A CN106973283 A CN 106973283A CN 201710201673 A CN201710201673 A CN 201710201673A CN 106973283 A CN106973283 A CN 106973283A
- Authority
- CN
- China
- Prior art keywords
- image
- dimensional
- observation
- delta data
- view
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/144—Processing image signals for flicker reduction
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a kind of method for displaying image and device, wherein, this method includes：The observation delta data of user is obtained, observation delta data is produced by the motion of user；Judge whether observation delta data meets predetermined threshold value, if so, being handled based on observation delta data the first two dimensional image, obtain the second two dimensional image, the first two dimensional image is carried out rendering generation by the first 3-D view；The second two dimensional image is shown, it is handled the image of display according to the observation delta data of user, and when observation data variation is little, by the way of image procossing and display, the viewing experience degree of user preferably, and need not carry out three-dimensional rendering, time saving power saving to every two field picture.
Description
Technical field
The present invention relates to computer graphics and technical field of image processing, in particular to a kind of image display side
Method and device.
Background technology
Image rendering, refers to the generating process from the fine arts resource to image.Image rendering is mainly used in game, figure 3D
Demonstrate (such as real estate 3D demonstrations), the field such as virtual emulation.Especially in virtual reality (Virtual Reality, VR) technology
In, image rendering extensive use.VR technologies, are to generate a kind of simulated environment using computer, are a kind of Multi-source Information Fusions
, the system emulation of interactive Three-Dimensional Dynamic what comes into a driver's and entity behavior user is immersed in the environment.In addition, user can be with
Itself vision to external world, the sense of hearing are closed by wearing VR aobvious (such as VR glasses, the VR helmets), one kind is produced in above-mentioned
Sensation in virtual environment.
In correlation technique, for the original 3D of every frame (3-Dimensional, three-dimensional) image, GPU (Graphics
Processing Unit, graphics processor) life can be rendered based on visual angle and observation station position with VR aobvious users
Into 2D (2-Dimensional, two dimension) image, then the 2D images of generation are carried out by the VR aobvious upper amplifying devices set
Amplification, in order to which user experiences virtual scene by the 2D images after amplification.
Inventor has found under study for action, the method for displaying image in correlation technique, for the detail section in 3D rendering (such as
One fine rule), when occurring minor variations at the visual angle of user and/or observation station, GPU is rasterized to 2D figures by the detail section
As after, by VR it is aobvious observe is then the detail section that flashes, so as to cause the Experience Degree of user poor.
The content of the invention
In view of this, it is an object of the invention to provide a kind of method for displaying image and device, become according to the observation of user
Change data to handle the image of display, and when observation delta data is little, by the way of image procossing and display, use
The viewing experience degree at family is preferable.
In a first aspect, the embodiments of the invention provide a kind of method for displaying image, methods described includes：
The observation delta data of user is obtained, the observation delta data is produced by the motion of the user；
Judge whether the observation delta data meets predetermined threshold value, if so, based on the observation delta data to first
Two dimensional image is handled, and obtains the second two dimensional image, and first two dimensional image is carried out rendering generation by the first 3-D view；
Show second two dimensional image.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the first of first aspect, wherein, also
Including：When judging that the observation delta data does not meet predetermined threshold value, the second 3-D view is rendered to the 3rd two dimensional image,
Second 3-D view is the corresponding 3-D view of present frame.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of second of first aspect, wherein, institute
Stating observation delta data includes one or both of observation angle change information and observation position change information, described to be based on institute
State observation delta data to handle the first two dimensional image, obtain the second two dimensional image, including：
The observation angle change information and/or the observation position change information are converted into image translation parameter, and/
Or, the observation angle change information and/or the observation position change information are converted into image rotation parameter；
First two dimensional image is handled using described image translation parameters and/or described image rotation parameter,
Obtain second two dimensional image.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the third of first aspect, wherein, will
First 3-D view renders generation first two dimensional image, including：
The first three-dimensional foreground of extract real-time image from first 3-D view；
The first three-dimensional foreground image rendering is generated into the first two-dimensional foreground image；
The first two-dimensional foreground image and the first two-dimensional background image are superimposed, first two dimensional image is obtained, it is described
First two-dimensional background image is generated by the first three-dimensional background image rendering in first 3-D view.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 4th of first aspect kind, wherein, will
First 3-D view renders generation first two dimensional image, including：
The first three-dimensional foreground image in first 3-D view is rendered, the first two-dimensional foreground image is generated,
The first three-dimensional background image in first 3-D view is rendered, the first two-dimensional background image is generated；Wherein, it is described
First two-dimensional foreground image and the first two-dimensional background image constitute first two dimensional image；
It is described that the first two dimensional image is handled based on the observation delta data, the second two dimensional image is obtained, including：
The first two-dimensional background image is handled based on the observation delta data, the second two-dimensional background figure is obtained
Picture；
The second two-dimensional background image and the first two-dimensional foreground image are superimposed, the second two dimensional image is obtained.
Second aspect, the embodiment of the present invention additionally provides a kind of image display device, and described device includes：
Acquisition module, the observation delta data for obtaining user, the observation delta data by the user motion
Produce；
Processing module, for judging whether the observation delta data meets predetermined threshold value, if so, being become based on the observation
Change data to handle the first two dimensional image, obtain the second two dimensional image, first two dimensional image is by the first 3-D view
Progress renders generation；
Display module, for showing second two dimensional image.
With reference to second aspect, the embodiments of the invention provide the possible embodiment of the first of second aspect, wherein, institute
State processing module to be additionally operable to, when judging that the observation delta data does not meet predetermined threshold value, the second 3-D view is rendered to
3rd two dimensional image, second 3-D view is the corresponding 3-D view of present frame.
With reference to second aspect, the embodiments of the invention provide the possible embodiment of second of second aspect, wherein, institute
Stating processing module includes：
Converting unit, for the observation angle change information in the observation delta data and/or the observation to be changed
Observation position change information in data is converted to image translation parameter, and/or, by the observation angle change information and/or
The observation position change information is converted to image rotation parameter；
Processing unit, for two-dimentional to described first using described image translation parameters and/or described image rotation parameter
Image is handled, and obtains second two dimensional image.
With reference to second aspect, the embodiments of the invention provide the possible embodiment of the third of second aspect, wherein, also
Including generation module, the generation module includes：
Extraction unit, for the first three-dimensional foreground of extract real-time image from first 3-D view；
Rendering unit, for the first three-dimensional foreground image rendering to be generated into the first two-dimensional foreground image；
Superpositing unit, for being superimposed the first two-dimensional foreground image and the first two-dimensional background image, obtains described first
Two dimensional image, the first two-dimensional background image is generated by the first three-dimensional background image rendering in first 3-D view.、
With reference to second aspect, the embodiments of the invention provide the possible embodiment of the 4th of second aspect kind, wherein, also
Including rendering module；
The rendering module, for being rendered to the first three-dimensional foreground image in first 3-D view, generation
First two-dimensional foreground image, is rendered to the first three-dimensional background image in first 3-D view, the two dimension of generation first
Background image；Wherein, the first two-dimensional foreground image and the first two-dimensional background image constitute first two dimensional image；
The processing module, is additionally operable to handle the first two-dimensional background image based on the observation delta data, obtained
To the second two-dimensional background image；The second two-dimensional background image and the first two-dimensional foreground image are superimposed, the two or two is obtained
Tie up image.
Method for displaying image in method for displaying image and device, with correlation technique provided in an embodiment of the present invention, with
When minor variations occur for the visual angle at family and/or observation station, GPU is rasterized to 2D images by the detail section in 3D rendering,
What user observed is the image of flicker, so as to cause the Experience Degree of user is poor to compare, its observation for obtaining user first becomes
Change data, observation delta data is produced by the motion of user, then judges whether observation delta data meets predetermined threshold value, if
It is that the first two dimensional image is handled based on observation delta data, the second two dimensional image is obtained, the first two dimensional image is by first
3-D view carries out rendering generation, finally shows the second two dimensional image, and it observes figure of the delta data to display according to user's
As being handled, and observe delta data it is little when, using image procossing and by the way of showing, the viewing experience degree of user compared with
It is good, and without being rendered to every two field picture, time saving power saving.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be attached to what is used required in embodiment
Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, therefore is not construed as pair
The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other related accompanying drawings.
Fig. 1 shows a kind of flow chart for method for displaying image that the embodiment of the present invention is provided；
Fig. 2 shows the flow chart for another method for displaying image that the embodiment of the present invention is provided；
Fig. 3 shows the flow chart for another method for displaying image that the embodiment of the present invention is provided；
Fig. 4 shows a kind of structural representation for image display device that the embodiment of the present invention is provided；
Fig. 5 shows the structural representation of processing module in a kind of image display device that the embodiment of the present invention is provided；
Fig. 6 shows the structural representation of generation module in a kind of image display device that the embodiment of the present invention is provided.
Main element symbol description：
11st, acquisition module；22nd, processing module；33rd, display module；44th, generation module；221st, converting unit；222nd, handle
Unit；441st, extraction unit；442nd, rendering unit；443rd, superpositing unit.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
Middle accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only
It is a part of embodiment of the invention, rather than whole embodiments.The present invention being generally described and illustrated herein in the accompanying drawings is real
Applying the component of example can be arranged and be designed with a variety of configurations.Therefore, it is of the invention to what is provided in the accompanying drawings below
The detailed description of embodiment is not intended to limit the scope of claimed invention, but is merely representative of the selected reality of the present invention
Apply example.Based on embodiments of the invention, the institute that those skilled in the art are obtained on the premise of creative work is not made
There is other embodiment, belong to the scope of protection of the invention.
In view of the method for displaying image in correlation technique, for the detail section (such as one fine rule) in 3D rendering,
When minor variations occur for the visual angle of user and/or observation station, GPU can also rasterize the detail section to 2D images, pass through VR
What head was shown is then the detail section of flicker, so as to cause the Experience Degree of user poor.Based on this, the embodiment of the present invention
There is provided a kind of method for displaying image and device, when observation delta data is little, by the way of image procossing and display, use
The viewing experience degree at family is preferable.
The flow chart of method for displaying image provided in an embodiment of the present invention shown in Figure 1, methods described is specifically included
Following steps：
S101, the observation delta data for obtaining user, observation delta data are produced by the motion of user；
Specifically, being mainly used in VR application scenarios in view of the method for displaying image that the embodiment of the present invention is provided
In, the simulated environment that VR is simulated will be experienced by virtual reality device in the embodiment of the present invention.In VR, based on user's
The change by observation visual angle and/or observation position is produced is moved, and above-mentioned change is changeable.Due to the GPU in correlation technique
(Graphics Processing Unit, graphics processor) all can be based on new visual angle and observation station again for every two field picture
2D images are generated, and magnifying glass is both provided with greatly in view of virtual reality device, the magnifying glass can be amplified to screen, that is, be anticipated
It is clear that taste the comparison that a little small change can also be seen on screen.So, rendered and shown for the detail section in 3D models
After showing, it will produce scintigram picture, the viewing experience degree of user will be further largely effected on after amplification.Therefore, the present invention is implemented
The method for displaying image that example is provided obtains the observation delta data produced by the motion of user.
Wherein, above-mentioned observation delta data mostlys come from the change of observation angle and the change of observation position.In addition, with
The motion at family can be body kinematics, can also be head movement, can also be eye movement, can also be with reference to above-mentioned body
Motion, head movement, oculomotor motion, it is contemplated that the method for displaying image that the embodiment of the present invention is provided can adapt in
Different virtual scenes, therefore, does not do specific limitation at this to motion mode.
S102, judge observation delta data whether meet predetermined threshold value, if so, based on observation delta data to first two dimension
Image is handled, and obtains the second two dimensional image, and the first two dimensional image is carried out rendering generation by the first 3-D view；
S103, the second two dimensional image of display.
Specifically, for the above-mentioned observation delta data got, will be according to predetermined threshold value to this in the embodiment of the present invention
Observation delta data contrasted, if the observation delta data meets predetermined threshold value, will based on observe delta data to by
The first two dimensional image that first 3-D view render generation is handled, to obtain meeting the second X-Y scheme of display condition
Picture.
Wherein, in the embodiment of the present invention, different predetermined threshold values can be set according to the different demands of different user, examined again
Consider and the change that delta data is derived mainly from observation angle and observation position observed in the embodiment of the present invention, then, predetermined threshold value
Can be that observation angle change information is 5 degree and/or observation position change information is 1 centimetre, etc., the embodiment of the present invention is to this
Specific limitation is not done.
In addition, the concrete application scene of the method for displaying image provided with reference to the embodiment of the present invention, observes delta data
Meet predetermined threshold value to refer to, in user's slight jitter, visual angle and/or observation station are by slight change, if this slight change
Meet predetermined threshold value, in order to avoid 3D renders the flashing state that detail section is brought, present example is by previous frame corresponding
The first two dimensional image that one 3-D view renders generation is handled, and directly obtains the second two dimensional image in present frame, and pass through
Virtual reality device shows second two dimensional image.
Wherein, the size of above-mentioned the first two dimensional image for rendering generation is the display set according to above-mentioned virtual reality device
What the FOV (Field of View, the angle of visual field) of screen was determined, and in order to preferably realize the processing to first two dimensional image, its
Size needs FOV scopes one bigger.
Show in addition, above-mentioned virtual reality device can be VR, can also be that other have the equipment of virtual reality function.
Method for displaying image provided in an embodiment of the present invention, and the method for displaying image in correlation technique, in regarding for user
When minor variations occur for angle and/or observation station, GPU is rasterized to 2D images by the detail section in 3D rendering, Yong Huguan
What is measured is the image of flicker, so as to cause the Experience Degree of user is poor to compare, it obtains the observation delta data of user first,
Observe delta data to be produced by the motion of user, then judge whether observation delta data meets predetermined threshold value, if so, based on sight
Survey delta data to handle the first two dimensional image, obtain the second two dimensional image, the first two dimensional image is by the first 3-D view
Progress renders generation, finally shows the second two dimensional image, its according to the observation delta data of user to the image of display at
Reason, and when observation delta data is little, by the way of image procossing and display, the viewing experience degree of user is preferable, and nothing
Every two field picture need to be rendered, time saving power saving.
The method for displaying image that the embodiment of the present invention is provided also is judging that observing delta data does not meet predetermined threshold value
When, the second 3-D view is rendered to the 3rd two dimensional image, the second 3-D view is the corresponding 3-D view of present frame.
Specifically, in the embodiment of the present invention, the observation delta data of acquisition is contrasted according to predetermined threshold value, if
Contrast obtains the observation delta data and does not meet predetermined threshold value, then, will not for corresponding second 3-D view of present frame
Obtained two dimensional image is rendered based on previous frame again to be shown, but re-starts and renders, to generate the 3rd two dimensional image.
In order to preferably be handled above-mentioned first two dimensional image to obtain the second two dimensional image, above-mentioned S102 processing
Process realizes that flow chart shown in Figure 2, methods described also includes especially by following steps：
S201, observation angle change information and/or observation position change information be converted into image translation parameter, and/or,
Observation angle change information and/or observation position change information are converted into image rotation parameter；
S202, using image translation parameter and/or image rotation parameter the first two dimensional image is handled, obtain second
Two dimensional image.
Specifically, the method for displaying image that the embodiment of the present invention is provided can become the observation angle observed in delta data
Change information and/or observation position change information is converted to image translation parameter, and/or the observation angle that will be observed in delta data
Change information and/or observation position change information are converted to image rotation parameter, wherein, above-mentioned image translation parameter and image rotation
It is the necessary condition handled the first two dimensional image to turn parameter.
Wherein, transformational relation for convenience of description between observation delta data and image parameter is next flat with image
Shifting parameter corresponds to the change of observation position, and the change that image rotation parameter corresponds to observation angle is further illustrated, root
According to the first corresponding relation and image rotation parameter between the image translation parameter and observation position change information pre-set with
The first two dimensional image that the second corresponding relation between observation angle information renders generation to previous frame carries out shear treatment so that
The second obtained two dimensional image is sheared consistent with the indication range of virtual reality device, because the shearing of picture is occurred only at gently
When micro- shake, so while the distortion of 2D figures will not be perceived by the user caused by observation change, i.e. present invention implementation
The method for displaying image that example is provided is eliminated by the flashing state that user's slight jitter is brought, the viewing experience degree of user
More preferably.
In addition, it can be seen from above-mentioned first corresponding relation and the second corresponding relation, being possible to be changed according to observation position and believing
The first two dimensional image that breath and/or observation angle change information are obtained for rendering is translated and/or rotated, and based on virtual
The indication range of real world devices is sheared to translation and/or postrotational first two dimensional image, you can obtain the second X-Y scheme
Picture.
In addition, the method for displaying image that is provided of the embodiment of the present invention can be with after processing obtains the second two dimensional image
Anti- distortion processing is carried out to second two dimensional image, with the second two dimensional image after being handled, and by second two dimensional image
Further shown.
It is suitable for spherical display, simply spherical display is without anti-distortion correction.
The distortion distortion of image caused by eyes in order to avoid lens close to user, the embodiment of the present invention is being schemed
Before display, will also anti-distortion processing be carried out to the second two dimensional image.Wherein, above-mentioned anti-distortion processing can be abnormal by one kind
Become and correct another distortion.Such as, for VR aobvious, if generating " pillow-type " distortion through lens image, the present invention is implemented
The image of distortion will be distorted in example to carry out anti-distortion processing using " barrel shape ", obtain normal image.
The concrete application scene of the method for displaying image provided in view of the embodiment of the present invention, the embodiment of the present invention is carried
The display methods of confession can be applied not only to static scene, additionally it is possible to which, suitable for dynamic scene, for static scene, the present invention is real
Applying example can render to entire image, and for dynamic scene, the embodiment of the present invention can be by the motion in entire image
Prospect, which is separated, individually to be rendered, for the static background in entire image, and the embodiment of the present invention directly carries out wash with watercolours to it
Dye.The flow chart for the method for displaying image that inventive embodiments shown in Figure 3 are provided, by including dynamic prospect and the static back of the body
The 3-D view of scape renders comprising the following steps that for generation two dimensional image：
S301, the first three-dimensional foreground of extract real-time image from the first 3-D view；
S302, by the first three-dimensional foreground image rendering generate the first two-dimensional foreground image；
S303, the first two-dimensional foreground image of superposition and the first two-dimensional background image, obtain the first two dimensional image, the first two dimension
Background image is generated by the first three-dimensional background image rendering in the first 3-D view.
, can be by specifically, the method for displaying image that the embodiment of the present invention is provided is in the case of comprising moving object
Moving object is individually rendered, and is then superimposed with static scene, solves the situation for including moving object in scene.
Wherein, in the embodiment of the present invention, the first three-dimensional foreground of extract real-time image first from the first 3-D view, then
First three-dimensional foreground image rendering is generated into the first two-dimensional foreground image, the first two-dimensional foreground image and the first two dimension is finally superimposed
Background image, obtains the first two dimensional image, the first two-dimensional background image is by the first three-dimensional background image in the first 3-D view
Render generation.
Furthermore, it is contemplated that when the method for displaying image that the embodiment of the present invention is provided acts on dynamic scene, prospect should
It is real time kinematics, then, using the one or three in method the first 3-D view of extraction of image procossing in the embodiment of the present invention
Foreground image is tieed up, and the three-dimensional foreground image is rendered, it is also contemplated that background will not be moved substantially, therefore, the present invention is real
Apply in example, the first three-dimensional background image in the first 3-D view will directly be rendered, finally carry out prospect rendering result
The superposition rendered with background, obtains the first last two dimensional image.It can be seen that, the method for displaying image that the embodiment of the present invention is provided
It is applicable not only to static scene and applies also for dynamic scene, practicality is more preferably.
What deserves to be explained is, the method for displaying image that the embodiment of the present invention is provided renders obtained based on aforesaid way
One two dimensional image, if the observation delta data of user meets predetermined threshold value, the first two dimensional image obtained to rendering is carried out
Shear treatment uses to obtain the second two dimensional image, that is, and is first folded the first two-dimensional foreground image and the first two-dimensional background image
Plus the processing mode sheared again.In addition, the embodiment of the present invention can also be used first by the first two-dimensional background image according to the one or two
The mode of dimension image cut into the second two dimensional image is sheared (at using identical translation parameters and rotation parameter
Reason), then the first two-dimensional background image after shearing and the first two-dimensional foreground image are overlapped again, the second X-Y scheme is obtained
Picture.The first two dimension is carried on the back specifically, the method for displaying image that the embodiment of the present invention is provided will be primarily based on observation delta data
Scape image is handled, and obtains the second two-dimensional background image, and the second two-dimensional background image and the first two-dimensional foreground are then superimposed again
Image is to obtain the second two dimensional image.It can be seen that, the method for displaying image applicability that the embodiment of the present invention is provided is stronger.
Method for displaying image provided in an embodiment of the present invention, and the method for displaying image in correlation technique, in regarding for user
When minor variations occur for angle and/or observation station, GPU is rasterized to 2D images by the detail section in 3D rendering, Yong Huguan
What is measured is the image of flicker, so as to cause the Experience Degree of user is poor to compare, it obtains the observation delta data of user first,
Observe delta data to be produced by the motion of user, then judge whether observation delta data meets predetermined threshold value, if so, based on sight
Survey delta data to handle the first two dimensional image, obtain the second two dimensional image, the first two dimensional image is by the first 3-D view
Progress renders generation, finally shows the second two dimensional image, its according to the observation delta data of user to the image of display at
Reason, and when observation delta data is little, by the way of image procossing and display, the viewing experience degree of user is preferable, and nothing
Every two field picture need to be rendered, time saving power saving.
The embodiment of the present invention additionally provides a kind of image display device, and described device user performs above-mentioned image display side
Method, referring to Fig. 4, described device includes：
Acquisition module 11, the observation delta data for obtaining user, observation delta data is produced by the motion of user；
Processing module 22, for judging whether observation delta data meets predetermined threshold value, if so, based on observation delta data
First two dimensional image is handled, the second two dimensional image is obtained, the first two dimensional image is carried out rendering life by the first 3-D view
Into；
Display module 33, for showing the second two dimensional image.
Processing module 22 in the image display device that the embodiment of the present invention is provided also is being judged to observe delta data
When not meeting predetermined threshold value, the second 3-D view is rendered to the 3rd two dimensional image, the second 3-D view is that present frame is corresponding
3-D view.
In order to preferably be handled above-mentioned first two dimensional image to obtain the second two dimensional image, referring to Fig. 5, above-mentioned place
Reason module 22 includes：
Converting unit 221, for will observe in the observation angle change information in delta data and/or observation delta data
Observation position change information be converted to image translation parameter, and/or, observation angle change information and/or observation position are become
Change information and be converted to image rotation parameter；
Processing unit 222, at using image translation parameter and/or image rotation parameter to the first two dimensional image
Reason, obtains the second two dimensional image.
In addition, the image display device that the embodiment of the present invention is provided can also handle processing module 22 obtain second
Two dimensional image carries out anti-distortion processing, the second two dimensional image after being handled, and second two dimensional image is sent to display
Module 33 is shown.
The concrete application scene of the image display device provided in view of the embodiment of the present invention, the embodiment of the present invention is carried
The display device of confession can be applied not only to static scene, additionally it is possible to which, suitable for dynamic scene, for static scene, the present invention is real
Applying example can render to entire image, and for dynamic scene, the embodiment of the present invention can be by the motion in entire image
Prospect, which is separated, individually to be rendered, for the static background in entire image, and the embodiment of the present invention directly carries out wash with watercolours to it
Dye.The image display device that inventive embodiments are provided also includes generation module 44, and referring to Fig. 6, the generation module 44 includes：
Extraction unit 441, for the first three-dimensional foreground of extract real-time image from the first 3-D view；
Rendering unit 442, for the first three-dimensional foreground image rendering to be generated into the first two-dimensional foreground image；
Superpositing unit 443, for being superimposed the first two-dimensional foreground image and the first two-dimensional background image, obtains the first X-Y scheme
Picture, the first two-dimensional background image is generated by the first three-dimensional background image rendering in the first 3-D view.
What deserves to be explained is, the image display device that the embodiment of the present invention is provided renders obtained based on aforesaid way
One two dimensional image, if the observation delta data of user meets predetermined threshold value, the first two dimensional image obtained to rendering is carried out
Shear treatment uses to obtain the second two dimensional image, that is, and is first folded the first two-dimensional foreground image and the first two-dimensional background image
Plus the processing mode sheared again.In addition, the embodiment of the present invention can also be used first by the first two-dimensional background image according to the one or two
The mode of dimension image cut into the second two dimensional image is sheared (at using identical translation parameters and rotation parameter
Reason), then the first two-dimensional background image after shearing and the first two-dimensional foreground image are overlapped again, the second X-Y scheme is obtained
Picture.
Specifically, the image display device that the embodiment of the present invention is provided also includes rendering module, the rendering module is used for
The first three-dimensional foreground image in first 3-D view is rendered, the first two-dimensional foreground image is generated, to the first graphics
The first three-dimensional background image as in is rendered, and generates the first two-dimensional background image；Wherein, the first two-dimensional foreground image and
One two-dimensional background image constitutes the first two dimensional image；
Processing module, is additionally operable to handle the first two-dimensional background image based on observation delta data, obtains the two or two
Tie up background image；The second two-dimensional background image and the first two-dimensional foreground image are superimposed, the second two dimensional image is obtained.
It can be seen that, the image display device applicability that the embodiment of the present invention is provided is stronger.
Image display device provided in an embodiment of the present invention, and the method for displaying image in correlation technique, in regarding for user
When minor variations occur for angle and/or observation station, GPU is rasterized to 2D images by the detail section in 3D rendering, Yong Huguan
What is measured is the image of flicker, so as to cause the Experience Degree of user is poor to compare, it obtains the observation delta data of user first,
Observe delta data to be produced by the motion of user, then judge whether observation delta data meets predetermined threshold value, if so, based on sight
Survey delta data to handle the first two dimensional image, obtain the second two dimensional image, the first two dimensional image is by the first 3-D view
Progress renders generation, finally shows the second two dimensional image, its according to the observation delta data of user to the image of display at
Reason, and when observation delta data is little, by the way of image procossing and display, the viewing experience degree of user is preferable, and nothing
Every two field picture need to be rendered, time saving power saving.
The computer program product for the progress method for displaying image that the embodiment of the present invention is provided, including store program generation
The computer-readable recording medium of code, the instruction that described program code includes can be used for performing described in previous methods embodiment
Method, implements and can be found in embodiment of the method, will not be repeated here.
The image display device that the embodiment of the present invention is provided for the specific hardware in equipment or can be installed on equipment
On software or firmware etc..The technique effect of the device that the embodiment of the present invention is provided, its realization principle and generation and foregoing side
Method embodiment is identical, to briefly describe, and device embodiment part does not refer to part, refers in corresponding in preceding method embodiment
Hold.It is apparent to those skilled in the art that, for convenience and simplicity of description, system described above, device
With the specific work process of unit, the corresponding process in above method embodiment is may be referred to, be will not be repeated here.
, can be by others side in embodiment provided by the present invention, it should be understood that disclosed apparatus and method
Formula is realized.Device embodiment described above is only schematical, for example, the division of the unit, only one kind are patrolled
Collect function to divide, there can be other dividing mode when actually realizing, in another example, multiple units or component can combine or can
To be integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or discussed each other
Coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some communication interfaces
Connect, can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in the embodiment that the present invention is provided can be integrated in a processing unit, also may be used
To be that unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined in individual accompanying drawing, then it further need not be defined and explained in subsequent accompanying drawing, in addition, term " the
One ", " second ", " the 3rd " etc. are only used for distinguishing description, and it is not intended that indicating or implying relative importance.
Finally it should be noted that：Embodiment described above, is only the embodiment of the present invention, to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that：Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent substitution is carried out to which part technical characteristic；And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical scheme of the embodiment of the present invention.The protection in the present invention should all be covered
Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
1. a kind of method for displaying image, it is characterised in that including：
The observation delta data of user is obtained, the observation delta data is produced by the motion of the user；
Judge whether the observation delta data meets predetermined threshold value, if so, based on the observation delta data to the first two dimension
Image is handled, and obtains the second two dimensional image, and first two dimensional image is carried out rendering generation by the first 3-D view；
Show second two dimensional image.
2. according to the method described in claim 1, it is characterised in that also include：
When judging that the observation delta data does not meet predetermined threshold value, the second 3-D view is rendered to the 3rd two dimensional image,
Second 3-D view is the corresponding 3-D view of present frame.
3. according to the method described in claim 1, it is characterised in that the observation delta data includes observation angle change information
One or both of with observation position change information, it is described based on the observation delta data to the first two dimensional image at
Reason, obtains the second two dimensional image, including：
The observation angle change information and/or the observation position change information are converted into image translation parameter, and/or,
The observation angle change information and/or the observation position change information are converted into image rotation parameter；
First two dimensional image is handled using described image translation parameters and/or described image rotation parameter, obtained
Second two dimensional image.
4. according to the method described in claim 1, it is characterised in that first 3-D view is rendered into generation the described 1st
Image is tieed up, including：
The first three-dimensional foreground of extract real-time image from first 3-D view；
The first three-dimensional foreground image rendering is generated into the first two-dimensional foreground image；
The first two-dimensional foreground image and the first two-dimensional background image are superimposed, first two dimensional image, described first is obtained
Two-dimensional background image is generated by the first three-dimensional background image rendering in first 3-D view.
5. according to the method described in claim 1, it is characterised in that first 3-D view is rendered into generation the described 1st
Image is tieed up, including：
The first three-dimensional foreground image in first 3-D view is rendered, the first two-dimensional foreground image is generated, to institute
The the first three-dimensional background image stated in the first 3-D view is rendered, and generates the first two-dimensional background image；Wherein, described first
Two-dimensional foreground image and the first two-dimensional background image constitute first two dimensional image；
It is described that the first two dimensional image is handled based on the observation delta data, the second two dimensional image is obtained, including：
The first two-dimensional background image is handled based on the observation delta data, the second two-dimensional background image is obtained；
The second two-dimensional background image and the first two-dimensional foreground image are superimposed, the second two dimensional image is obtained.
6. a kind of image display device, it is characterised in that including：
Acquisition module, the observation delta data for obtaining user, the observation delta data is produced by the motion of the user；
Processing module, for judging whether the observation delta data meets predetermined threshold value, if so, based on the observation change number
Handled according to the first two dimensional image, obtain the second two dimensional image, first two dimensional image is carried out by the first 3-D view
Render generation；
Display module, for showing second two dimensional image.
7. device according to claim 6, it is characterised in that the processing module is additionally operable to, judges that the observation becomes
When change data do not meet predetermined threshold value, the second 3-D view is rendered to the 3rd two dimensional image, second 3-D view is to work as
The corresponding 3-D view of previous frame.
8. device according to claim 6, it is characterised in that the processing module includes：
Converting unit, for by it is described observation delta data in observation angle change information and/or the observation delta data
In observation position change information be converted to image translation parameter, and/or, by the observation angle change information and/or described
Observation position change information is converted to image rotation parameter；
Processing unit, for utilizing described image translation parameters and/or described image rotation parameter to first two dimensional image
Handled, obtain second two dimensional image.
9. device according to claim 6, it is characterised in that also including generation module, the generation module includes：
Extraction unit, for the first three-dimensional foreground of extract real-time image from first 3-D view；
Rendering unit, for the first three-dimensional foreground image rendering to be generated into the first two-dimensional foreground image；
Superpositing unit, for being superimposed the first two-dimensional foreground image and the first two-dimensional background image, obtains first two dimension
Image, the first two-dimensional background image is generated by the first three-dimensional background image rendering in first 3-D view.
10. device according to claim 6, it is characterised in that also including rendering module；
The rendering module, for being rendered to the first three-dimensional foreground image in first 3-D view, generation first
Two-dimensional foreground image, is rendered to the first three-dimensional background image in first 3-D view, generates the first two-dimensional background
Image；Wherein, the first two-dimensional foreground image and the first two-dimensional background image constitute first two dimensional image；
The processing module, is additionally operable to handle the first two-dimensional background image based on the observation delta data, obtains the
Two two-dimensional background images；The second two-dimensional background image and the first two-dimensional foreground image are superimposed, the second X-Y scheme is obtained
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710201673.7A CN106973283A (en) | 2017-03-30 | 2017-03-30 | A kind of method for displaying image and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710201673.7A CN106973283A (en) | 2017-03-30 | 2017-03-30 | A kind of method for displaying image and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106973283A true CN106973283A (en) | 2017-07-21 |
Family
ID=59335596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710201673.7A Pending CN106973283A (en) | 2017-03-30 | 2017-03-30 | A kind of method for displaying image and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106973283A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109756728A (en) * | 2019-01-02 | 2019-05-14 | 京东方科技集团股份有限公司 | Image display method and apparatus, electronic equipment, computer readable storage medium |
| CN109978945A (en) * | 2019-02-26 | 2019-07-05 | 浙江舜宇光学有限公司 | A kind of information processing method and device of augmented reality |
| CN110019583A (en) * | 2017-08-29 | 2019-07-16 | 深圳市掌网科技股份有限公司 | A kind of environment methods of exhibiting and system based on virtual reality |
| CN110351480A (en) * | 2019-06-13 | 2019-10-18 | 歌尔科技有限公司 | Image processing method, device and electronic equipment for electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105120246A (en) * | 2015-10-14 | 2015-12-02 | 成都智控科技有限公司 | Virtual reality system based on video monitoring |
| CN105404393A (en) * | 2015-06-30 | 2016-03-16 | 指点无限（美国）有限公司 | Low-latency virtual reality display system |
| CN105847785A (en) * | 2016-05-09 | 2016-08-10 | 上海乐相科技有限公司 | Image processing method, device and system |
-
2017
- 2017-03-30 CN CN201710201673.7A patent/CN106973283A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105404393A (en) * | 2015-06-30 | 2016-03-16 | 指点无限（美国）有限公司 | Low-latency virtual reality display system |
| CN105120246A (en) * | 2015-10-14 | 2015-12-02 | 成都智控科技有限公司 | Virtual reality system based on video monitoring |
| CN105847785A (en) * | 2016-05-09 | 2016-08-10 | 上海乐相科技有限公司 | Image processing method, device and system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110019583A (en) * | 2017-08-29 | 2019-07-16 | 深圳市掌网科技股份有限公司 | A kind of environment methods of exhibiting and system based on virtual reality |
| CN110019583B (en) * | 2017-08-29 | 2021-01-05 | 深圳市掌网科技股份有限公司 | Environment display method and system based on virtual reality |
| CN109756728A (en) * | 2019-01-02 | 2019-05-14 | 京东方科技集团股份有限公司 | Image display method and apparatus, electronic equipment, computer readable storage medium |
| US10971108B2 (en) | 2019-01-02 | 2021-04-06 | Beijing Boe Optoelectronics Technology Co., Ltd. | Image display method and apparatus, electronic device, VR device, and non-transitory computer readable storage medium |
| CN109756728B (en) * | 2019-01-02 | 2021-12-07 | 京东方科技集团股份有限公司 | Image display method and apparatus, electronic device, computer-readable storage medium |
| CN109978945A (en) * | 2019-02-26 | 2019-07-05 | 浙江舜宇光学有限公司 | A kind of information processing method and device of augmented reality |
| CN109978945B (en) * | 2019-02-26 | 2021-08-31 | 浙江舜宇光学有限公司 | Augmented reality information processing method and device |
| CN110351480A (en) * | 2019-06-13 | 2019-10-18 | 歌尔科技有限公司 | Image processing method, device and electronic equipment for electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112150638B (en) | Virtual object image synthesis method, device, electronic equipment and storage medium | |
| CN106502427B (en) | Virtual reality system and scene presenting method thereof | |
| US20160267720A1 (en) | Pleasant and Realistic Virtual/Augmented/Mixed Reality Experience | |
| US11577159B2 (en) | Realistic virtual/augmented/mixed reality viewing and interactions | |
| CN109660783B (en) | Virtual reality parallax correction | |
| KR101947650B1 (en) | Apparatus and method for generating learning image in game engine-based machine learning | |
| US20160163063A1 (en) | Mixed-reality visualization and method | |
| US20170154460A1 (en) | Viewing frustum culling method and device based on virtual reality equipment | |
| CN103810353A (en) | Real scene mapping system and method in virtual reality | |
| CN106973283A (en) | A kind of method for displaying image and device | |
| JP7201869B1 (en) | Generate new frames with rendered and unrendered content from the previous eye | |
| CN106056663A (en) | Rendering method for enhancing reality scene, processing module and reality enhancement glasses | |
| WO2015090421A1 (en) | Method and system for providing information associated with a view of a real environment superimposed with a virtual object | |
| CN109801379A (en) | General augmented reality glasses and its scaling method | |
| CN109598796A (en) | Real scene is subjected to the method and apparatus that 3D merges display with dummy object | |
| JP2017016577A (en) | Information processor, and control method, and program, for the same | |
| JP6844210B2 (en) | Visual saliency map generator, visual saliency map generation method and program | |
| CN114026603B (en) | Rendering computer-generated real text | |
| CN106204703A (en) | Three-dimensional scene models rendering intent and device | |
| US8896631B2 (en) | Hyper parallax transformation matrix based on user eye positions | |
| TWI694355B (en) | Tracking system, tracking method for real-time rendering an image and non-transitory computer-readable medium | |
| CN108986228B (en) | Method and device for displaying interface in virtual reality | |
| WO2017173583A1 (en) | Terminal display anti-shake method and apparatus | |
| CN110097644B (en) | Expression migration method, device and system based on mixed reality and processor | |
| CN112017126A (en) | Enhanced local contrast |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180209 Address after: 100000 Beijing Chaoyang District City West Lin and crafts Road No. 5 in the 5 gate 301. Applicant after: Rao Xingyuan Address before: 100080 underground CB101-063, No. 8, courtyard No. 1, Zhongguancun East Road, Haidian District, Beijing Applicant before: Beijing dazzle House Technology Co., Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170721 |