CN106412562A - Method and system for displaying stereoscopic content in three-dimensional scene - Google Patents
Method and system for displaying stereoscopic content in three-dimensional scene Download PDFInfo
- Publication number
- CN106412562A CN106412562A CN201510465790.5A CN201510465790A CN106412562A CN 106412562 A CN106412562 A CN 106412562A CN 201510465790 A CN201510465790 A CN 201510465790A CN 106412562 A CN106412562 A CN 106412562A
- Authority
- CN
- China
- Prior art keywords
- picture
- dimensional scenic
- camera
- texture
- quadrangle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000009877 rendering Methods 0.000 claims abstract description 36
- 230000000007 visual effect Effects 0.000 claims abstract description 20
- 239000011159 matrix material Substances 0.000 claims description 38
- 239000007787 solid Substances 0.000 claims description 5
- 230000000694 effects Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
Landscapes
- Image Generation (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method and system for displaying stereoscopic content in a three-dimensional scene, wherein the method for displaying the stereoscopic content in the three-dimensional scene comprises: acquiring a stereoscopic picture of an stereoscopic image, wherein the stereoscopic picture comprises a left picture and a right picture, and acquiring the left and right images of the three-dimensional scene by rendering the left picture or the right picture respectively; and displaying the stereoscopic image in the three-dimensional scene according to the left and right image of the three-dimensional scene. The method and system views 3D images in the 3D scene, enrich the display content in the 3D scene, and enhance the visual impact of the stereoscopic display.
Description
Technical field
The present invention relates to technical field of image processing, in more particularly, to a kind of three-dimensional scenic, show solid
The method of content and its system.
Background technology
Image is the picture being caught actual picture and produced by imaging devices such as camera, video cameras
Or video.With people for image requirement more and more higher it is often desirable that seeing stereo-picture,
Stereo-picture refers to there is the content that two pictures carrying alternate position spike represent left and right eyes viewing, profit
Observer is allowed to produce the image with depth preception effect with right and left eyes parallax.
In prior art, for assuming three-dimensional (hereinafter referred to as：3D) the stereopsis effect of scene, generally
By disposing two cameras, generate disparity map.Disparity map passes through 3D display device, such as 3D eye
Mirror or bore hole 3D screen, right and left eyes disparity map are shown to respectively left eye and the right eye of beholder,
Realize the display of stereopsis effect.
Inventor finds under study for action, and currently available technology is also not carried out viewing in 3D scene
3D rendering, i.e. the function of 3D picture or 3D video.
Content of the invention
Show the method for stereo content and its system in the three-dimensional scenic that the present invention provides it is achieved that
Watch 3D rendering in 3D scene, enrich the display content in 3D scene, enhance stereoscopic display
Visual impact.
In a first aspect, the present invention provides a kind of method showing stereo-picture in three-dimensional scenic, institute
The method of stating includes：
Obtain the stereotome of described stereo-picture, wherein, described stereotome includes left figure picture
And right figure picture；
It is utilized respectively described left figure picture or right figure picture, render acquisition three-dimensional scenic left figure and right figure；
Left figure according to described three-dimensional scenic and right figure, the described stereo-picture in display three-dimensional scenic.
Alternatively, described render acquisition three-dimensional scenic left figure using described left figure picture, concrete wrap
Include：
Described left figure picture is loaded as left figure texture；
Described left figure texture is labelled in described three-dimensional scenic and is used for determining that described stereotome shows
Position and the quadrangle in region；
Render the described three-dimensional scenic left figure of acquisition using left camera.
Alternatively, described render acquisition three-dimensional scenic right figure using described right figure picture, concrete wrap
Include：
Described left figure picture is replaced with described right figure picture；
Described right figure picture is loaded as right figure texture；
Described right figure texture is labelled in described three-dimensional scenic and is used for determining that described stereotome shows
Position and the quadrangle in region；
Render the described three-dimensional scenic right figure of acquisition using right camera.
Alternatively, described render acquisition three-dimensional scenic right figure using described right figure picture, concrete wrap
Include；
Described right figure picture is loaded as right figure texture；
Described right figure texture is labelled in three-dimensional scenic and is used for determining described stereotome display location
Quadrangle with region；
Render the described three-dimensional scenic right figure of acquisition using right camera.
Alternatively, described render acquisition three-dimensional scenic left figure using described left figure picture, concrete wrap
Include：
Described right figure picture is replaced with described left figure picture；
Described left figure picture is loaded as left figure texture；
Described left figure texture is labelled in three-dimensional scenic and is used for determining described stereotome display location
Quadrangle with region；
Render the described three-dimensional scenic left figure of acquisition using left camera.
Alternatively, described being rendered using left camera obtains three-dimensional scenic left figure, specifically includes：
According to the position of described left camera, direction and visual angle, generate the projection matrix of left camera；
The projection matrix of described left camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the first coordinate to screen；
By interpolation, by each pixel projection of the described left figure texture being labelled on described quadrangle,
Generate the first image projecting on screen；
Each summit of remaining object in described three-dimensional scenic is multiplied by the throwing of described left camera
Shadow matrix, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects to screen
On the second image；
Using the described first image projecting on screen generating and described second image as described
Three-dimensional scenic left figure.
Alternatively, described being rendered using right camera obtains three-dimensional scenic right figure, specifically includes：
According to the position of described right camera, direction and visual angle, generate projection matrix；
The projection matrix of described right camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the second coordinate to screen；
By interpolation, by each pixel projection of the described right figure texture being labelled on described quadrangle；
Generate the 3rd image projecting on screen；
Each summit of remaining object in three-dimensional scenic is multiplied by the projection square of described right camera
Battle array, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects on screen
4th image；
Using described 3rd image projecting on screen generating and described 4th image as described
Three-dimensional scenic right figure.
Alternatively, described stereo-picture includes three-dimensional video-frequency；
Methods described also includes：
Described three-dimensional video-frequency is decoded, and generates the stereo-picture of each frame of video.
In second aspect, the present invention also provides the system showing stereo content in a kind of three-dimensional scenic,
Described system includes：
Stereo-picture acquiring unit, for obtaining the stereotome of stereo-picture, wherein, stereogram
Piece includes left figure picture and right figure picture；
Stereoscopic display position and area determination unit, for determine described stereotome display location and
Region, and hold described left figure picture or the right figure picture that patch is loaded as texture；
Left camera, holds for basis and is affixed on described stereoscopic display position and area determination unit and adds
Carry the described left figure picture for left figure texture, render acquisition three-dimensional scenic left figure；
Right camera, holds for basis and is affixed on described stereoscopic display position and area determination unit and adds
Carry the described right figure picture for right figure texture, render acquisition three-dimensional scenic right figure；
Display unit, for by described render acquisition three-dimensional scenic left figure or right figure show respectively to use
The right and left eyes at family.
Alternatively, described left camera specifically for：
According to the position of described left camera, direction and visual angle, generate the projection matrix of left camera；
The projection matrix of described left camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the first coordinate to screen,
By interpolation, by each pixel projection of the described left figure texture being labelled on described quadrangle,
Generate the first image projecting on screen；
Each summit of remaining object in described three-dimensional scenic is multiplied by the throwing of described left camera
Shadow matrix, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects to screen
On the second image；
Using the described first image projecting on screen generating and described second image as described
The left figure of three-dimensional scenic.
Alternatively, described right camera specifically for：
According to the position of described right camera, direction and visual angle, generate projection matrix；
The projection matrix of described right camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the second coordinate to screen；
By interpolation, by each pixel projection of the described right figure texture being labelled on described quadrangle,
Generate the 3rd image projecting on screen；
Each summit of remaining object in three-dimensional scenic is multiplied by the projection square of described right camera
Battle array, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects on screen
4th image；
Using described 3rd image projecting on screen generating and described 4th image as described
The right figure of three-dimensional scenic.
Alternatively, described system also includes：
Loading unit, for being loaded as left figure texture or right figure by described left figure picture or right figure picture
Texture.
Alternatively, described stereo-picture includes three-dimensional video-frequency；
Described system, also includes：
Stereotome signal generating unit, for decoding to described three-dimensional video-frequency, and generates each frame of video
Stereotome.
In embodiments of the present invention, by obtaining the stereotome of described stereo-picture, it is utilized respectively
Left figure picture in stereotome or right figure picture, render acquisition three-dimensional scenic left figure and right figure；And
Left figure according to described three-dimensional scenic and right figure, the described stereo-picture in display three-dimensional scenic, real
Show viewing 3D rendering in 3D scene, enriched the display content in 3D scene, enhance
The visual impact of stereoscopic display.
Brief description
Fig. 1 is the method flow schematic diagram showing stereo content in embodiment of the present invention 3D scene；
Fig. 2 shows the method flow diagram of 3D picture for the embodiment of the present invention in 3D scene；
Fig. 3 is the system structure diagram showing stereo content in embodiment of the present invention 3D scene.
Specific embodiment
The present invention is described in detail with reference to the accompanying drawings and examples.
If it should be noted that not conflicting, each in the embodiment of the present invention and embodiment is special
Levy and can be combined with each other, all within protection scope of the present invention.In addition, though illustrating in system
In figure has carried out functional unit division, shows logical order in flow charts, but in some feelings
Under condition, can be with different from the dividing elements in system, or the order execution in flow chart is shown
Or the step of description.
Show that the method for stereo-picture is briefly retouched in the 3D scene of the embodiment of the present invention below
State.In embodiments of the present invention, when generating the left figure of 3D scene, the left figure of 3D rendering is made
Paste in the 3 d space for texture；When generating the right figure of 3D scene, the right figure of 3D rendering is made
Replace left figure for texture to paste in the 3 d space.So in the left and right in figure of 3D scene, show respectively
The left figure of 3D rendering and right figure are it is achieved that watch the function of 3D rendering in the 3D scene.
Below in conjunction with the accompanying drawings the embodiment of the present invention is further elaborated.
Fig. 1 is the method flow schematic diagram showing stereo content in embodiment of the present invention 3D scene,
As shown in figure 1, the method for the embodiment of the present invention, comprise the following steps：
S11, obtains the stereotome of described stereo-picture, wherein, described stereotome includes left figure
Picture and right figure picture.
In embodiments of the present invention, stereo-picture can include stereotome or three-dimensional video-frequency, its
In, when stereo-picture is for stereotome, directly stereotome can be read from storage medium,
And from stereotome intercept stereotome left-half, obtain left figure picture, from stereotome
Upper intercepting right half part, obtains right figure picture.When stereo-picture is for three-dimensional video-frequency, it is situated between from storage
Three-dimensional video-frequency is read in matter, and the file format according to three-dimensional video-frequency, select corresponding decoder,
Three-dimensional video-frequency is decoded, and generates the stereotome of each frame, a left side half for each frame stereotome
, as left figure picture, the right half part of each frame stereotome is as right figure picture for part.
S13, is utilized respectively described left figure picture or right figure picture, render acquisition 3D scene left figure and
Right figure；
In embodiments of the present invention, acquisition 3D scene left figure can be rendered first with left figure picture,
Then left figure picture is replaced with right figure picture, render acquisition 3D scene right figure using right figure picture.
Acquisition 3D scene right figure can also be rendered first with right figure picture, then right figure picture be replaced with
Left figure picture, renders acquisition 3D scene left figure using left figure picture.
It is understood that in embodiments of the present invention, render and make image meet 3D scene
In the stage, render and can have various software, render the process being to generate image from model using software.
Wherein, model is the description with the language of strict difinition or data structure for three-dimensional body, it
Including geometry, viewpoint, texture and illumination information.Image is digital picture or bitmap images.
In embodiments of the present invention, acquisition 3D scene left figure, concrete bag are rendered using left figure picture
Include：Described left figure picture is loaded as left figure texture, described left figure texture is labelled in 3D scene
For determining the quadrangle of stereotome display location and region, render acquisition 3D using left camera
Scene left figure.
In embodiments of the present invention, after obtaining 3D scene left figure, in order to obtain 3D scene right figure,
Then need for described left figure picture to replace with right figure picture, render acquisition 3D field using right figure picture
Scape right figure.Wherein, render acquisition 3D scene right figure using right figure picture, specifically include：Will be described
Right figure picture is loaded as right figure texture, described right figure texture is labelled in 3D scene be used for determining vertical
Body picture display location and the quadrangle in region, render acquisition 3D scene right figure using right camera.
Render acquisition 3D scene left figure using left camera in embodiments of the present invention, specifically include：
According to the position of described left camera, direction and visual angle, generate the projection matrix of left camera；
Each apex coordinate that the projection matrix of described left camera is multiplied by described quadrangle generates
Each summit of described quadrangle projects the first coordinate to screen；
By interpolation, by each pixel projection of the left figure texture being labelled on described quadrangle, generate
Project to the first image on screen；
Each summit of remaining object in 3D scene is multiplied by the projection matrix of described left camera,
By rendering pipeline, remaining object in described three-dimensional scenic is generated second projecting on screen
Image；
Using the described first image projecting on screen generating and described second image as 3D field
The left figure of scape.
In embodiments of the present invention, acquisition 3D scene right figure, concrete bag are rendered using right camera
Include：
According to the position of described right camera, direction and visual angle, generate projection matrix；
Each apex coordinate that the projection matrix of described right camera is multiplied by described quadrangle generates
Each summit of described quadrangle projects the second coordinate to screen；
By interpolation, by each pixel projection of the right figure texture being labelled on described quadrangle, generate
Project to the 3rd image on screen；
Each summit of remaining object in 3D scene is multiplied by the projection matrix of described right camera,
By rendering pipeline, remaining object in described three-dimensional scenic is generated the 4th projecting on screen
Image；
Using described 3rd image projecting on screen generating and described 4th image as 3D field
The right figure of scape.
In embodiments of the present invention, before left camera renders the left figure of acquisition 3D scene, need
Left figure picture is loaded as left figure texture, and is labelled in 3D scene and is used for determining that stereotome shows
Position and the quadrangle in region, specifically include：Left figure picture is used 3D rendering interface (such as
Opengl interface or Direct 3D interface) pass to image processor (Graphics Processing
Unit, referred to as：), GPU and by GPU it is loaded as left figure texture；Then left figure loading being obtained
Four summits of texture are tied in 3D scene and are used for determining stereotome display location and region
Each summit of quadrangle.
It is understood that in embodiments of the present invention, interpolation is the reality being formed sensor devices
Border pixel, by built-in software, according to the pixel of actual exposed image, according to certain computing
Mode is calculated, and produces new pixel, and inserts it into the neighbouring space of original pixel
Place, thus realize the purpose that increased pixel total amount and increase picture element density.The calculating side of interpolation
Formula has a lot, and the more commonly used has picture element interpolation algorithm, bilinear interpolation algorithm, bicubic interpolation
Algorithm and four kinds of fractal algorithm.Wherein, picture element interpolation algorithm is a kind of simplest interpolation algorithm,
This mode is when picture amplifies, and the pixel lacking is passed through directly using immediate original therewith
The color of pixel generates that is to say, that indiscriminately imitating the pixel on side.When picture expands, X to be increased
Pixel at point, because the B point in this two valid pixels of X point and A, B is closest, therefore X
Point can directly indiscriminately imitate the pixel of B point, so that arriving the effect of X point generation as B point.This
Algorithm is simple, and therefore quickly, but result would generally produce and be evident that sawtooth the speed of process.
Bilinear interpolation algorithm, refers to that each pixel of the image exporting is four Pixel calcualtings in artwork
Result, because it is computing from four pixels of artwork, therefore this algorithm is largely
Eliminate crenellated phenomena, and effect is also relatively good.Bicubic interpolation algorithm is that bilinear interpolation is calculated
The modified algorithm of method, each pixel of its output image is the result of 16 Pixel calcualtings of artwork,
Because effect is good, arithmetic speed is not also slow, thus this interpolation method is a kind of very common algorithm,
It is widely used on image editing software, printer driver and digital camera.Fractal algorithm has infinitely
Details and self similarity feature, it figure can be made to amplify anyway it appears that all with former
Figure is much like, the image effect therefore obtaining, and compares apparent, sharper with other algorithms,
But it is numerous and jumbled a lot of computationally also to contrast other algorithms.In embodiments of the present invention, this area
Technical staff can select specific algorithm, here is omitted according to actual needs.
S15, the left figure according to described 3D scene and right figure, the described solid in display 3D scene
Image.
In embodiments of the present invention, the left and right figure of the 3D obtaining in S13 scene is passed to 3D to show
Equipment, the left and right figure of 3D scene is respectively displayed on the right and left eyes of user；Due to whole 3D scene
Left figure in render be 3D picture left figure, be the right figure of 3D picture in the right figure of 3D scene,
Achieve the effect watching 3D picture in 3D scene.
In embodiments of the present invention, for three-dimensional video-frequency, due to three-dimensional video-frequency can be decoded as multiple
Frame, and the left and right picture of each two field picture can be used to generate the left and right figure in 3D scene, thus
Can be implemented in and show three-dimensional video-frequency in 3D scene it is achieved that user watches 3D in 3D scene
The function of film.
In embodiments of the present invention, by obtaining the stereotome of described stereo-picture, it is utilized respectively
Left figure picture in stereotome or right figure picture, render acquisition 3D scene left figure and right figure；And
Left figure according to described 3D scene and right figure, the described stereo-picture in display 3D scene, realize
Watch 3D rendering in 3D scene, enrich the display content in 3D scene, enhance vertical
The visual impact that body shows.
With reference to specific embodiment, taking in 3D scene, show 3D picture as a example the present invention is made
Step illustrates further.
Fig. 2 shows the method flow diagram of 3D picture for the embodiment of the present invention in 3D scene, such as schemes
Shown, the method comprises the following steps：
S21, setting left and right camera in 3D scene,
Wherein, show to realize 3D, need the camera of setting in 3D scene is carried out accordingly
Parameter setting, including adjustable visual angle, remote/nearly face, fusion face etc. parameter, the camera of setting
Including left camera and right camera, the number of camera can be one or more, left camera
For rendering 3D scene left figure, right camera is used for rendering 3D scene right figure.
S22, places a quadrangle in 3D scene,
Wherein, this quadrangle is used for determining display location and the region of stereotome.
S23, before left camera renders left figure, the left figure of stereotome is loaded as left figure texture
It is attached on the quadrangle of step S22, this step specifically includes (not shown)：
S231, reads 3D picture (image is arranged as left and right figure, upper figure below etc.) from storage medium,
In the present embodiment taking left and right figure as a example；
S232, intercepts the left-half of 3D picture in step S231, generates left figure picture；
S233, the left figure picture in step S232 is loaded as left figure texture；
3D rendering interface wherein can be used, such as, opengl interface or Direct 3D interface,
Left figure picture in step S232 is passed to GPU (GPU), and is loaded as by GPU
Left figure texture；
S234, four summits of the left figure texture in step S233 is tied to the quadrangle of S22
Each summit；
S24, renders whole 3D scene left figure by left camera, specifically includes (not shown)：
S241, according to the position of the left camera in step S21, direction and visual angle etc., generates and throws
Shadow matrix；
S242, each summit that the projection matrix in step S241 is multiplied by quadrangle in S22 is sat
Mark, generates each summit of described quadrangle and projects to the first coordinate on screen；
S243 is by interpolation, by each pixel projection of the left figure texture being attached on quadrangle, raw
Become to project to the first image on screen；
S244, the left side that each summit of other objects in 3D scene is multiplied by step S241 is taken the photograph
As head projection matrix, by rendering pipeline, remaining object in described three-dimensional scenic is generated projection
The second image on screen；
S245, using the first image projecting on screen generating and the second image as whole 3D
The left figure of scene；
S25, is rendered before right figure by right camera, and the right figure picture of stereotome is loaded as line
Reason is attached on the quadrangle of S22, replaces the left figure texture in S23；This step specifically includes (figure
Not shown in)：
S251, intercepts the right half part of 3D picture in step S231, generates right figure picture；
S252, the right figure picture in step S251 is loaded as right figure texture；
3D rendering interface wherein can be used, such as, opengl interface or Direct 3D interface,
Right figure picture in step S252 is passed to GPU (GPU), and is loaded as by GPU
Right figure texture；
S253, four summits of the right figure texture in step S252 is tied to the quadrangle of S22
Each summit；
S26：Render the right figure of whole 3D scene by right camera；Specifically include that (in figure is not shown
Go out)：
S261, according to the position of the right camera in step S21, direction and visual angle etc., generates and throws
Shadow matrix；
S262, each summit that the projection matrix in step S261 is multiplied by quadrangle in S22 is sat
Mark, generates each summit of described quadrangle and projects to the second coordinate on screen；
S263 is by interpolation, by each pixel projection of the right figure texture being attached on quadrangle, raw
Become to project to the 3rd image on screen；
S264, the right side that each summit of other objects in 3D scene is multiplied by step S261 is taken the photograph
As head projection matrix, by rendering pipeline, remaining object in described three-dimensional scenic is generated projection
The 4th image on screen；
S265, using the 3rd image projecting on screen generating and the 4th image as whole 3D
The right figure of scene；
S27, by S25, the left and right figure of the 3D scene generating in S26 passes to 3D display device；
In embodiments of the present invention, by 3D display device, the left and right figure of 3D scene is respectively displayed on
The right and left eyes of user；Due to render in the left figure of whole 3D scene be 3D picture left figure, 3D
It is the right figure of 3D picture in the right figure of scene it is achieved that watching the effect of 3D picture in 3D scene
Really.
In embodiments of the present invention, when 3D rendering is for three-dimensional video-frequency, obtain 3D scene rendering
Left and right figure before, need stereoscopic video file according to its video file format, from corresponding
Decoder, is decoded to 3D video, and generates the stereotome of each frame in video, and this stands
Body picture includes rendering the left and right picture of the left and right figure obtaining 3D scene.Using stereotome
Left and right picture renders the embodiment of the left and right figure obtaining 3D scene as described in above-described embodiment,
This repeats no more.
It should be noted that in embodiments of the present invention, first generating the left figure of 3D scene, or
There is no the precedence relationship of certainty between the right figure first generating 3D scene, but need to ensure generating 3D
Adopt the left figure texture of the left figure picture in stereotome during the left figure of scene, generate 3D scene
The right figure texture of the right figure picture in stereotome is adopted during right figure.
Fig. 3 is the system structure diagram showing stereo content in embodiment of the present invention 3D scene,
As shown in figure 3, described system includes：
Stereo-picture acquiring unit 31, for obtaining the stereotome of stereo-picture, wherein, three-dimensional
Picture includes left figure picture and right figure picture；
Stereoscopic display position and area determination unit 32, for determining stereotome display location and area
Domain, and hold described left figure picture or the right figure picture that patch is loaded as texture；
Left camera 33, for according to hold be affixed on described stereoscopic display position and area determination unit and
It is loaded as the described left figure picture of left figure texture, render acquisition 3D scene left figure；
Right camera 34, for according to hold be affixed on described stereoscopic display position and area determination unit and
It is loaded as the described right figure picture of right figure texture, render acquisition 3D scene right figure；
Display unit 35, for by described render acquisition 3D scene left figure or right figure show respectively to
The right and left eyes of user.
In embodiments of the present invention, stereo-picture acquiring unit 31 can obtain needs from memory
The stereotome of display or three-dimensional video-frequency, and the solid generating from stereotome or three-dimensional video-frequency decoding
The left and right picture of stereotome is obtained in picture.
Stereoscopic display position and area determination unit 32, in 3D scene in placement, obtain rendering
Before figure about 3D scene, a left side for the stereotome that stereo-picture acquiring unit 31 can be obtained
Right figure piece obtains texture after loading, and texture is labelled on this unit.
Left camera 33 is used for rendering acquisition 3D scene left figure, specifically for：
According to the position of described left camera, direction and visual angle, generate the projection matrix of left camera；
The projection matrix of described left camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the first coordinate to screen；
By interpolation, by each pixel projection of the left figure texture being labelled on described quadrangle, generate
Project to the first image on screen；
Each summit of remaining object in 3D scene is multiplied by the projection matrix of described left camera,
By rendering pipeline, remaining object in described three-dimensional scenic is generated second projecting on screen
Image；
Using the described first image projecting on screen generating and described second image as 3D field
The left figure of scape.
Left camera 34 is used for rendering acquisition 3D scene right figure, specifically for：
According to the position of described right camera, direction and visual angle, generate projection matrix；
The projection matrix of described right camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the second coordinate to screen；
By interpolation, by each pixel projection of the right figure texture being labelled on described quadrangle, generate
Project to the 3rd image on screen；
Each summit of remaining object in 3D scene is multiplied by the projection matrix of described right camera,
By rendering pipeline, remaining object in described three-dimensional scenic is generated the 4th projecting on screen
Image；
Using described 3rd image projecting on screen generating and described 4th image as 3D field
The right figure of scape.
In embodiments of the present invention, described system also includes：
Loading unit 36, for being loaded as left figure texture or the right side by described left figure picture or right figure picture
Figure texture.
Wherein, loading unit can be graphic process unit GPU, can pass through 3D rendering interface, than
As, opengl interface or other Direct 3D interfaces, left and right picture is passed to loading unit 36,
Left and right picture is loaded as respectively by left and right figure texture by loading unit 36；
In embodiments of the present invention, when described stereo-picture includes three-dimensional video-frequency, described system,
Also include：
Stereotome signal generating unit 37, for decoding to described three-dimensional video-frequency, and generates each video
The stereotome of frame.
In embodiments of the present invention, for different video file formats, stereotome signal generating unit
Different Video Decoders can be selected, real to realize the video file to different video file format
Now decode.
It should be noted that showing the system of stereo content in 3D scene in the embodiment of the present invention
The contents such as the information exchange between middle unit, implementation procedure, due to implementing with the inventive method
Example is based on same design, and the particular content in embodiment of the method is equally applicable.In the embodiment of the present invention
Unit can realize as single hardware or software, and can use as needed
Individually hardware or software are realizing the combination of the function of unit.
In embodiments of the present invention, by obtaining the stereotome of described stereo-picture, using solid
Left figure picture in picture or right figure picture, render acquisition 3D scene left figure or right figure respectively；And
Left figure according to described 3D scene and right figure, the described stereo-picture in display 3D scene, realize
Watch 3D rendering in 3D scene, enrich the display content in 3D scene, enhance vertical
The visual impact that body shows.
The foregoing is only embodiments of the present invention, not thereby limit the scope of the claims of the present invention,
Equivalent structure or equivalent flow conversion that every utilization description of the invention and accompanying drawing content are made, or
Directly or indirectly it is used in other related technical fields, all include the patent in the present invention in the same manner and protect
In the range of shield.
Claims (13)
1. show the method for stereo-picture in a kind of three-dimensional scenic it is characterised in that methods described
Including：
Obtain the stereotome of described stereo-picture, wherein, described stereotome includes left figure picture
And right figure picture；
It is utilized respectively described left figure picture or right figure picture, render acquisition three-dimensional scenic left figure and right figure；
Left figure according to described three-dimensional scenic and right figure, the described stereo-picture in display three-dimensional scenic.
2. method according to claim 1 it is characterised in that described using described left figure
Picture, renders acquisition three-dimensional scenic left figure, specifically includes：
Described left figure picture is loaded as left figure texture；
Described left figure texture is labelled in described three-dimensional scenic and is used for determining that described stereotome shows
Position and the quadrangle in region；
Render the described three-dimensional scenic left figure of acquisition using left camera.
3. method according to claim 2 it is characterised in that described using described right figure
Picture, renders acquisition three-dimensional scenic right figure, specifically includes：
Described left figure picture is replaced with described right figure picture；
Described right figure picture is loaded as right figure texture；
Described right figure texture is labelled in described three-dimensional scenic and is used for determining that described stereotome shows
Position and the quadrangle in region；
Render the described three-dimensional scenic right figure of acquisition using right camera.
4. method according to claim 1 it is characterised in that it is characterized in that, described
Using described right figure picture, render acquisition three-dimensional scenic right figure, specifically include；
Described right figure picture is loaded as right figure texture；
Described right figure texture is labelled in three-dimensional scenic and is used for determining described stereotome display location
Quadrangle with region；
Render the described three-dimensional scenic right figure of acquisition using right camera.
5. method according to claim 4 it is characterised in that described using described left figure
Picture, renders acquisition three-dimensional scenic left figure, specifically includes：
Described right figure picture is replaced with described left figure picture；
Described left figure picture is loaded as left figure texture；
Described left figure texture is labelled in three-dimensional scenic and is used for determining described stereotome display location
Quadrangle with region；
Render the described three-dimensional scenic left figure of acquisition using left camera.
6. as requested the method described in 2 or 5 it is characterised in that described using left camera
Render acquisition three-dimensional scenic left figure, specifically include：
According to the position of described left camera, direction and visual angle, generate the projection matrix of left camera；
The projection matrix of described left camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the first coordinate to screen；
By interpolation, by each pixel projection of the described left figure texture being labelled on described quadrangle,
Generate the first image projecting on screen；
Each summit of remaining object in described three-dimensional scenic is multiplied by the throwing of described left camera
Shadow matrix, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects to screen
On the second image；
Using the described first image projecting on screen generating and described second image as described
Three-dimensional scenic left figure.
7. as requested the method described in 3 or 4 it is characterised in that described using right camera
Render acquisition three-dimensional scenic right figure, specifically include：
According to the position of described right camera, direction and visual angle, generate projection matrix；
The projection matrix of described right camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the second coordinate to screen；
By interpolation, by each pixel projection of the described right figure texture being labelled on described quadrangle；
Generate the 3rd image projecting on screen；
Each summit of remaining object in three-dimensional scenic is multiplied by the projection square of described right camera
Battle array, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects on screen
4th image；
Using described 3rd image projecting on screen generating and described 4th image as described
Three-dimensional scenic right figure.
8. the method according to any one of claim 1-7 is it is characterised in that described solid
Image includes three-dimensional video-frequency；
Methods described also includes：
Described three-dimensional video-frequency is decoded, and generates the stereo-picture of each frame of video.
9. show the system of stereo content in a kind of three-dimensional scenic it is characterised in that described system
Including：
Stereo-picture acquiring unit, for obtaining the stereotome of stereo-picture, wherein, stereogram
Piece includes left figure picture and right figure picture；
Stereoscopic display position and area determination unit, for determine described stereotome display location and
Region, and hold described left figure picture or the right figure picture that patch is loaded as texture；
Left camera, holds for basis and is affixed on described stereoscopic display position and area determination unit and adds
Carry the described left figure picture for left figure texture, render acquisition three-dimensional scenic left figure；
Right camera, holds for basis and is affixed on described stereoscopic display position and area determination unit and adds
Carry the described right figure picture for right figure texture, render acquisition three-dimensional scenic right figure；
Display unit, for by described render acquisition three-dimensional scenic left figure or right figure show respectively to use
The right and left eyes at family.
10. system according to claim 9 is it is characterised in that described left camera is concrete
For：
According to the position of described left camera, direction and visual angle, generate the projection matrix of left camera；
The projection matrix of described left camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the first coordinate to screen,
By interpolation, by each pixel projection of the described left figure texture being labelled on described quadrangle,
Generate the first image projecting on screen；
Each summit of remaining object in described three-dimensional scenic is multiplied by the throwing of described left camera
Shadow matrix, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects to screen
On the second image；
Using the described first image projecting on screen generating and described second image as described
The left figure of three-dimensional scenic.
11. systems according to claim 9 are it is characterised in that described right camera is concrete
For：
According to the position of described right camera, direction and visual angle, generate projection matrix；
The projection matrix of described right camera is multiplied by each apex coordinate of described quadrangle, generates
Each summit of described quadrangle projects the second coordinate to screen；
By interpolation, by each pixel projection of the described right figure texture being labelled on described quadrangle,
Generate the 3rd image projecting on screen；
Each summit of remaining object in three-dimensional scenic is multiplied by the projection square of described right camera
Battle array, by rendering pipeline, remaining object in described three-dimensional scenic is generated and projects on screen
4th image；
Using described 3rd image projecting on screen generating and described 4th image as described
The right figure of three-dimensional scenic.
12. systems according to any one of claim 9-11 are it is characterised in that described system
System also includes：
Loading unit, for being loaded as left figure texture or right figure by described left figure picture or right figure picture
Texture.
13. systems according to any one of claim 9-12 are it is characterised in that described stand
Body image includes three-dimensional video-frequency；
Described system, also includes：
Stereotome signal generating unit, for decoding to described three-dimensional video-frequency, and generates each frame of video
Stereotome.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510465790.5A CN106412562B (en) | 2015-07-31 | 2015-07-31 | The method and its system of stereo content are shown in three-dimensional scenic |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510465790.5A CN106412562B (en) | 2015-07-31 | 2015-07-31 | The method and its system of stereo content are shown in three-dimensional scenic |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106412562A true CN106412562A (en) | 2017-02-15 |
| CN106412562B CN106412562B (en) | 2019-10-25 |
Family
ID=58008319
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510465790.5A Expired - Fee Related CN106412562B (en) | 2015-07-31 | 2015-07-31 | The method and its system of stereo content are shown in three-dimensional scenic |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106412562B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358659A (en) * | 2017-07-21 | 2017-11-17 | 福建星网视易信息系统有限公司 | More pictures fusion display methods and storage device based on 3D technology |
| CN107657665A (en) * | 2017-08-29 | 2018-02-02 | 深圳依偎控股有限公司 | A kind of edit methods and system based on 3D pictures |
| CN109725728A (en) * | 2018-12-29 | 2019-05-07 | 三星电子（中国）研发中心 | A kind of the display modification method and device of AR equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101742348A (en) * | 2010-01-04 | 2010-06-16 | 中国电信股份有限公司 | Rendering method and system |
| CN102508405A (en) * | 2011-11-02 | 2012-06-20 | 天津理工大学 | Direct passive stereo realization device for cubic screen and correction method for image |
| CN102523473A (en) * | 2011-12-01 | 2012-06-27 | 中兴通讯股份有限公司 | Three-dimensional interface display device, method and terminal |
| CN103024414A (en) * | 2012-12-06 | 2013-04-03 | 福建天晴数码有限公司 | Three dimensional (3D) display method based on WinXP system |
| CN103269423A (en) * | 2013-05-13 | 2013-08-28 | 浙江大学 | Expandable three-dimensional display remote video communication method |
| CN104581128A (en) * | 2014-12-29 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Head-mounted display device and method for displaying external image information therein |
| CN104616243A (en) * | 2015-01-20 | 2015-05-13 | 北京大学 | Effective GPU three-dimensional video fusion drawing method |
| CN204408544U (en) * | 2014-12-29 | 2015-06-17 | 青岛歌尔声学科技有限公司 | A kind of head-wearing display device |
-
2015
- 2015-07-31 CN CN201510465790.5A patent/CN106412562B/en not_active Expired - Fee Related
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101742348A (en) * | 2010-01-04 | 2010-06-16 | 中国电信股份有限公司 | Rendering method and system |
| CN102508405A (en) * | 2011-11-02 | 2012-06-20 | 天津理工大学 | Direct passive stereo realization device for cubic screen and correction method for image |
| CN102523473A (en) * | 2011-12-01 | 2012-06-27 | 中兴通讯股份有限公司 | Three-dimensional interface display device, method and terminal |
| CN103024414A (en) * | 2012-12-06 | 2013-04-03 | 福建天晴数码有限公司 | Three dimensional (3D) display method based on WinXP system |
| CN103269423A (en) * | 2013-05-13 | 2013-08-28 | 浙江大学 | Expandable three-dimensional display remote video communication method |
| CN104581128A (en) * | 2014-12-29 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Head-mounted display device and method for displaying external image information therein |
| CN204408544U (en) * | 2014-12-29 | 2015-06-17 | 青岛歌尔声学科技有限公司 | A kind of head-wearing display device |
| CN104616243A (en) * | 2015-01-20 | 2015-05-13 | 北京大学 | Effective GPU three-dimensional video fusion drawing method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107358659A (en) * | 2017-07-21 | 2017-11-17 | 福建星网视易信息系统有限公司 | More pictures fusion display methods and storage device based on 3D technology |
| CN107657665A (en) * | 2017-08-29 | 2018-02-02 | 深圳依偎控股有限公司 | A kind of edit methods and system based on 3D pictures |
| CN109725728A (en) * | 2018-12-29 | 2019-05-07 | 三星电子（中国）研发中心 | A kind of the display modification method and device of AR equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106412562B (en) | 2019-10-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11076142B2 (en) | Real-time aliasing rendering method for 3D VR video and virtual three-dimensional scene | |
| US10540818B2 (en) | Stereo image generation and interactive playback | |
| US11663778B2 (en) | Method and system for generating an image of a subject from a viewpoint of a virtual camera for a head-mountable display | |
| KR102214827B1 (en) | Method and apparatus for providing augmented reality | |
| JP4861309B2 (en) | Ghost artifact reduction for rendering 2.5D graphics | |
| KR20200052846A (en) | Data processing systems | |
| US8094148B2 (en) | Texture processing apparatus, method and program | |
| JP2008090617A (en) | Device, method and program for creating three-dimensional image | |
| JP2010033367A (en) | Information processor and information processing method | |
| CA2927046A1 (en) | Method and system for 360 degree head-mounted display monitoring between software program modules using video or image texture sharing | |
| CN114897754B (en) | Generating new frames using rendered content and non-rendered content from previous perspectives | |
| JP2006293931A (en) | Method and program for creating multi-viewpoint image for displaying three-dimensional image | |
| WO2015196791A1 (en) | Binocular three-dimensional graphic rendering method and related system | |
| WO2013108285A1 (en) | Image recording device, three-dimensional image reproduction device, image recording method, and three-dimensional image reproduction method | |
| US12100106B2 (en) | Stereoscopic rendering of virtual 3D objects | |
| US20230283759A1 (en) | System and method for presenting three-dimensional content | |
| JPH07296185A (en) | Three-dimensional image display device | |
| WO2012140397A2 (en) | Three-dimensional display system | |
| US20230106679A1 (en) | Image Processing Systems and Methods | |
| CN106412562A (en) | Method and system for displaying stereoscopic content in three-dimensional scene | |
| KR101208767B1 (en) | Stereoscopic image generation method, device and system using circular projection and recording medium for the same | |
| KR102558294B1 (en) | Device and method for capturing a dynamic image using technology for generating an image at an arbitray viewpoint | |
| KR20170065208A (en) | Method and apparatus for processing 3-dimension image, and graphic processing unit | |
| JP4214528B2 (en) | Pseudo stereoscopic image generation apparatus, pseudo stereoscopic image generation program, and pseudo stereoscopic image display system | |
| CN114513646A (en) | Method and device for generating panoramic video in three-dimensional virtual scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180712 Address after: 518000 Room 201, building A, 1 front Bay Road, Shenzhen Qianhai cooperation zone, Shenzhen, Guangdong Applicant after: SUPERD Co.,Ltd. Address before: 518000 Guangdong Shenzhen Baoan District Xixiang Street Gonghe Industrial Road West hair B District Xu Sheng research and development building 11 story 1113U Applicant before: TRONXYZ TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20191025 |