CN109068124A - A kind of naked eye 3D interactive approach and system for Guangdong opera - Google Patents

A kind of naked eye 3D interactive approach and system for Guangdong opera Download PDF

Info

Publication number
CN109068124A
CN109068124A CN201811139852.3A CN201811139852A CN109068124A CN 109068124 A CN109068124 A CN 109068124A CN 201811139852 A CN201811139852 A CN 201811139852A CN 109068124 A CN109068124 A CN 109068124A
Authority
CN
China
Prior art keywords
pel
image
space
naked eye
coordinate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811139852.3A
Other languages
Chinese (zh)
Inventor
樊燚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hang Kai Technology Co Ltd
Original Assignee
Hangzhou Hang Kai Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hang Kai Technology Co Ltd filed Critical Hangzhou Hang Kai Technology Co Ltd
Priority to CN201811139852.3A priority Critical patent/CN109068124A/en
Publication of CN109068124A publication Critical patent/CN109068124A/en
Pending legal-status Critical Current

Links

Abstract

The present invention relates to 3D display field, especially a kind of naked eye 3D interactive approach and system for Guangdong opera.Its method includes the following steps: that data processing unit receives the Guangdong opera performing image that image viewing unit obtains, and Guangdong opera performing image is made of multiple pels;Data processing unit by the three-dimensional vertices coordinate of pel successively from pel space, world space, observation space, cut out spatial alternation into naked eye display space, and then obtain pipeline renders after image;Data processing unit obtains single width depth image according to the image after pipeline renders, and according to single width range image integration multi-view image, and controls naked eye display unit and show to multi-view image progress naked eye.The present invention has broken the form of traditional Guangdong opera stage performance, by obtaining the image of performing artist, and the image is handled and finally carries out stereoscopic display on naked eye display unit, provides strong approach for the propagation of Guangdong opera, traditional culture has been carried forward, people's lives are enriched.

Description

A kind of naked eye 3D interactive approach and system for Guangdong opera
Technical field
The present invention relates to 3D display field, especially a kind of naked eye 3D interactive approach and system for Guangdong opera.
Background technique
Guangdong opera, also known as " Guangdong full-scale drama " or " full-scale drama ", one of Guangdong traditional opera are originated from southern drama, with being popular in the south of the Five Ridges The area settlement Deng Yueren.Start to occur in Guangdong, Guangxi between since Ming Dynasty's Jiajin Year year, is to mix to sing that thought is done dozen, musician dubs in background music, stage The art of acting of dress ornament, abstract body.Each trade of Guangdong opera has respectively unique dress ornament dressing.Guangdong opera name is listed in 2006 Within first 518 Lists of National Intangible Cultural Heritage that May 20 announced.On September 30th, 2009, Guangdong opera obtains joint Educational, Scientific and Cultural Organization of state affirmative, is included in World Immaterial Heritages register.
But impact of the present young man by pop culture, traditional culture this kind of for Guangdong opera are all less liked. And the reason of causing such case, mainly has traditional Guangdong opera only to be performed on the stage of reality, people see under stage It sees.Number rareness is not enough watched in promotion efficiency, fades from memory people gradually, especially teenager due to not vivid interaction significantly Reduce interest.
Summary of the invention
For the defects in the prior art, the present invention provides a kind of naked eye 3D interactive approach and system for Guangdong opera, purport In overcome the deficiencies in the prior art.
To achieve the goals above, in a first aspect, a kind of naked eye 3D interactive approach for Guangdong opera provided by the invention, institute State the naked eye 3D interaction systems for being suitable for being directed to Guangdong opera for the naked eye 3D interactive approach of Guangdong opera, the naked eye 3D for Guangdong opera Interaction systems include image viewing unit, data processing unit and naked eye display unit, and the naked eye 3D for Guangdong opera is interacted Method includes the following steps:
The data processing unit receives the Guangdong opera performing image that described image observation unit obtains, the Guangdong opera performance figure As being made of multiple pels;
After the three-dimensional vertices coordinate of the pel is obtained pipeline renders by spatial alternation by the data processing unit Image;The spatial alternation includes world space transformation, observation space transformation, cuts out spatial alternation and display space transformation;
The data processing unit obtains single width depth image according to the image after the pipeline renders, and according to the list Amplitude deepness image synthesizes multi-view image, and the control naked eye display unit carries out naked eye to the multi-view image and shows Show.
As a kind of preferred embodiment of the application, by the three-dimensional vertices coordinate of the pel from pel spatial alternation It is specifically included when into world space:
It verifies described in the pel with the presence or absence of subgraph member;
If there is no subgraph members for the pel, using the three-dimensional vertices coordinate of the pel as the position in world space Coordinate;
If there are subgraph members for the pel, the three-dimensional vertices of the pel are passed through into transformation matrix MmodelDetermine world's sky Between position coordinates i.e.:
Wherein px, py, pzRespectively position of the pel in world space, θ are the angle of rotary shaft, kx, ky, kzRespectively Scaling.
As a kind of preferred embodiment of the application, the three-dimensional vertices coordinate of the pel is being converted from world space It is specifically included when to observation space:
The three-dimensional vertices of the pel are passed through into transformation matrix MviewObservation space is transformed to i.e. from world space:
Wherein tx, ty, tzIt is the position coordinates of image viewing unit in world space ,-t respectivelyx,-ty,-tzIndicate image Observation unit moves on to the inverse process in world space, and θ is the angle of rotary shaft.
As a kind of preferred embodiment of the application, the three-dimensional vertices coordinate of the pel is being converted from observation space To being specifically included when cutting out space:
Obtain the coordinate range Near of the nearest image of described image observation unit, the coordinate range Far of farthest image, view Angle FOV;
Utilize projection matrix MfrustumCalculate the height ratio Aspect of image i.e.:
Three-dimensional vertices coordinate and the projection matrix MfrustumProduct the three-dimensional vertices coordinate of the pel can be obtained It is transformed to from observation space and cuts out space PclipCoordinate i.e.:
Wherein, x, y, z are respectively the three-dimensional vertices coordinate of pel.
As a kind of preferred embodiment of the application, by the three-dimensional vertices coordinate of the pel from cutting out spatial alternation It is specifically included when to display space:
Obtain pixel wide pixelwidth, the pixels tall pixelheight of naked eye display unit;
According to screen map formula by the three-dimensional vertices coordinate of pel from spatial alternation is cut out to display space, it may be assumed that
Wherein, the screenxIt is the three-dimensional vertices coordinate of pel from cutting out abscissa of the spatial alternation to display space, The screenyIt is the three-dimensional vertices coordinate of pel from cutting out ordinate of the spatial alternation to display space.
Second aspect, a kind of naked eye 3D interaction systems for Guangdong opera provided by the present invention are described for the naked of Guangdong opera Eye 3D interaction systems include image viewing unit, data processing unit and naked eye display unit:
The data processing unit receives the Guangdong opera performing image that described image observation unit obtains, the Guangdong opera performance figure As being made of multiple pels;
After the three-dimensional vertices coordinate of the pel is obtained pipeline renders by spatial alternation by the data processing unit Image;The spatial alternation includes world space transformation, observation space transformation, cuts out spatial alternation and display space transformation;
The data processing unit obtains single width depth image according to the image after the pipeline renders, and according to the list Amplitude deepness image synthesizes multi-view image, and the control naked eye display unit carries out naked eye to the multi-view image and shows Show.
As a kind of preferred embodiment of the application, by the three-dimensional vertices coordinate of the pel from pel spatial alternation It is specifically included when into world space:
It verifies described in the pel with the presence or absence of subgraph member;
If there is no subgraph members for the pel, using the three-dimensional vertices coordinate of the pel as the position in world space Coordinate;
If there are subgraph members for the pel, the three-dimensional vertices of the pel are passed through into transformation matrix MmodelDetermine world's sky Between position coordinates i.e.:
Wherein px, py, pzRespectively position of the pel in world space, θ are the angle of rotary shaft, kx, ky, kzRespectively Scaling.
As a kind of preferred embodiment of the application, the three-dimensional vertices coordinate of the pel is being converted from world space It is specifically included when to observation space:
The three-dimensional vertices of the pel are passed through into transformation matrix MviewObservation space is transformed to i.e. from world space:
Wherein tx, ty, tzIt is the position coordinates of image viewing unit in world space ,-t respectivelyx,-ty,-tzIndicate image Observation unit moves on to the inverse process in world space, and θ is the angle of rotary shaft.
As a kind of preferred embodiment of the application, the three-dimensional vertices coordinate of the pel is being converted from observation space To being specifically included when cutting out space:
Obtain the coordinate range Near of the nearest image of described image observation unit, the coordinate range Far of farthest image, view Angle FOV;
Utilize projection matrix MfrustumCalculate the height ratio Aspect of image i.e.:
Three-dimensional vertices coordinate and the projection matrix MfrustumProduct the three-dimensional vertices coordinate of the pel can be obtained It is transformed to from observation space and cuts out space PclipCoordinate i.e.:
Wherein, x, y, z are respectively the three-dimensional vertices coordinate of pel.
As a kind of preferred embodiment of the application, by the three-dimensional vertices coordinate of the pel from cutting out spatial alternation It is specifically included when to display space:
Obtain pixel wide pixelwidth, the pixels tall pixelheight of naked eye display unit;
According to screen map formula by the three-dimensional vertices coordinate of pel from spatial alternation is cut out to display space, it may be assumed that
Wherein, the screenxIt is the three-dimensional vertices coordinate of pel from cutting out abscissa of the spatial alternation to display space, The screenyIt is the three-dimensional vertices coordinate of pel from cutting out ordinate of the spatial alternation to display space.
The beneficial effects of the present invention are: a kind of naked eye 3D interactive approach and system for Guangdong opera provided by the present invention, The form for having broken traditional Guangdong opera stage performance by obtaining the image of performing artist, and is handled finally naked the image Stereoscopic display is carried out on eye display unit, strong approach is provided for the propagation of Guangdong opera, has carried forward traditional culture, enriched people's Life.
Detailed description of the invention
Fig. 1 is the flow chart of the naked eye 3D interactive approach for Guangdong opera of first embodiment of the invention;
Fig. 2 is the block diagram of the naked eye 3D interaction systems for Guangdong opera of third embodiment of the invention.
Specific embodiment
Specific embodiments of the present invention are described more fully below, it should be noted that the embodiments described herein is served only for illustrating Illustrate, is not intended to restrict the invention.In the following description, in order to provide a thorough understanding of the present invention, a large amount of spies are elaborated Determine details.It will be apparent, however, to one skilled in the art that: this hair need not be carried out using these specific details It is bright.In other instances, in order to avoid obscuring the present invention, well known circuit, software or method are not specifically described.
Throughout the specification, meaning is referred to " one embodiment ", " embodiment ", " example " or " example " : a particular feature, structure, or characteristic described in conjunction with this embodiment or example is comprised at least one embodiment of the invention. Therefore, the phrase " in one embodiment ", " in embodiment ", " example " occurred in each place of the whole instruction Or " example " is not necessarily all referring to the same embodiment or example.Furthermore, it is possible in any suitable combination and or sub-portfolio will be specific Feature, structure or characteristic combine in one or more embodiment or examples.In addition, those of ordinary skill in the art should manage Solution, diagram is provided to the purpose of explanation provided herein, and diagram is not necessarily drawn to scale.
As shown in Figure 1, shown by the first embodiment of the present invention one be directed to Guangdong opera naked eye 3D interactive approach, the needle Naked eye 3D interaction systems for Guangdong opera are suitable for the naked eye 3D interactive approach of Guangdong opera, the naked eye 3D for Guangdong opera is interacted System includes image viewing unit, data processing unit and naked eye display unit, the naked eye 3D interactive approach for Guangdong opera Include the following steps:
S101, the data processing unit receive the Guangdong opera performing image that described image observation unit obtains, the Guangdong opera Performing image is made of multiple pels.
It, can be with using the depth camera specifically, described image observation unit includes but is not limited to more depth cameras Image when to Guangdong opera performing artist performance is captured, then described image is uploaded to data processing unit, described to handle Unit includes but is not limited to image processor (GPU), and element of the present invention is existing element, the advantage is that cost It is cheap, it is conducive to realize.
The three-dimensional vertices coordinate of the pel is obtained pipeline renders by spatial alternation by S102, the data processing unit Image afterwards;The spatial alternation includes world space transformation, observation space transformation, cuts out spatial alternation and display space change It changes.
Specifically, successively converting from pel space, cut out space output is apex coordinate after converting projection process With the information such as the color of vertex correspondence and relevant texture coordinate.Above-mentioned processing mode is to carry out illumination calculation, three-dimensional vertices The complicated and essential process of one of transformation of coordinates.And vertex shader must can not when carrying out vertex transformation Few, first process which realizes is that the apex coordinate in pel space is transformed into using clip space coordinate system as standard Space in.
S103, the data processing unit according to after the pipeline renders image obtain single width depth image, and according to The single width range image integration multi-view image, and the control naked eye display unit are naked to multi-view image progress Eye display.
Specifically, the naked eye display unit includes but is not limited to naked eye display, the naked eye display W is existing skill Art obtains the depth map of depth camera using Shader in order not to cause to obscure with regard to no longer being repeated in present specification, Depth camera is general camera and screen post-processing effect co- controlling, and the help of tinter is needed to obtain the depth of image Information.Screen post-processing refers to after rendering entire scene, phase chance obtains that treated screen picture, we are to this Image carries out various operations, realizes screen special efficacy such as obtaining the depth of field, motion blur etc..It here is using at the later period behind the scenes Reason obtains depth map.
A naked eye 3D interactive approach for being directed to Guangdong opera, described naked for Guangdong opera shown by the second embodiment of the present invention Eye 3D interactive approach is suitable for the naked eye 3D interaction systems for Guangdong opera, and the naked eye 3D interaction systems for Guangdong opera include figure As observation unit, data processing unit and naked eye display unit, the naked eye 3D interactive approach for Guangdong opera includes following step It is rapid:
S201, the data processing unit receive the Guangdong opera performing image that described image observation unit obtains, the Guangdong opera Performing image is made of multiple pels.
Specific, the data of processing are the Guangdong opera performing images obtained from image viewing unit, are needed in the next steps Projective transformation operation is carried out to pel, the geometry stage realizes the task of apex coordinate projective transformation to screen space.Geometry Stage is responsible for the work such as vertex transformation, projective transformation and the screen map of geological information.Due to the data of the phase process It is quite huge, be not suitable for CPU processing therefore the data processing work in the stage using GPU operation.
The three-dimensional vertices coordinate of the pel is obtained pipeline renders by spatial alternation by S202, the data processing unit Image afterwards;The spatial alternation includes world space transformation, observation space transformation, cuts out spatial alternation and display space change It changes.
(1) by the three-dimensional vertices coordinate of the pel from pel spatial alternation to world space in when specifically include:
It verifies described in the pel with the presence or absence of subgraph member;
If there is no subgraph members for the pel, using the three-dimensional vertices coordinate of the pel as the position in world space Coordinate;
If there are subgraph members for the pel, the three-dimensional vertices of the pel are passed through into transformation matrix MmodelDetermine world's sky Between position coordinates i.e.:
Wherein px, py, pzRespectively position of the pel in world space, θ are the angle of rotary shaft, kx, ky, kzRespectively Scaling.
(2) it is specifically included when the three-dimensional vertices coordinate of the pel is transformed to observation space from world space:
The three-dimensional vertices of the pel are passed through into transformation matrix MviewObservation space is transformed to i.e. from world space:
Wherein tx, ty, tzIt is the position coordinates of image viewing unit in world space ,-t respectivelyx,-ty,-tzIndicate image Observation unit moves on to the inverse process in world space, and θ is the angle of rotary shaft.
(3) it is specifically included when transforming to and cutting out space the three-dimensional vertices coordinate of the pel from observation space:
Obtain the coordinate range Near of the nearest image of described image observation unit, the coordinate range Far of farthest image, view Angle FOV;
Utilize projection matrix MfrustumCalculate the height ratio Aspect of image i.e.:
Three-dimensional vertices coordinate and the projection matrix MfrustumProduct the three-dimensional vertices coordinate of the pel can be obtained It is transformed to from observation space and cuts out space PclipCoordinate i.e.:
Wherein, x, y, z are respectively the three-dimensional vertices coordinate of pel.
(4) by the three-dimensional vertices coordinate of the pel from being specifically included when cutting out spatial alternation to display space:
Obtain pixel wide pixelwidth, the pixels tall pixelheight of naked eye display unit;
According to screen map formula by the three-dimensional vertices coordinate of pel from spatial alternation is cut out to display space, it may be assumed that
Wherein, the screenxIt is the three-dimensional vertices coordinate of pel from cutting out abscissa of the spatial alternation to display space, The screenyIt is the three-dimensional vertices coordinate of pel from cutting out ordinate of the spatial alternation to display space.
S203, the data processing unit according to after the pipeline renders image obtain single width depth image, and according to The single width range image integration multi-view image, and the control naked eye display unit are naked to multi-view image progress Eye display.
Specifically, in order to realize that screen post-processes effect, it is necessary first to add a script in Unity, work as obtaining The rendering texture of forth screen calls Shader to carry out image using the function Graphics.Bilt provided in Unity later The processing in later period, wherein the work of the part Shader is exactly to carry out the processing work of picture, for example blur, the images such as Gaussian Blur Operation, finally on rendering texture display to screen.
Depth texture is substantially a rendering texture in Unity, stores high-precision texture value, rather than color Value.The depth value of texture in Unity is normalized, and for range between 0 and 1, the distribution of the depth value is that presentation is non-linear 's.The depth value of depth camera is from the device coordinate after the transformed normalization in vertex in Dnity.Depth texture Pixel value then corresponded to the Z value of apex coordinate in device coordinate, but due to the Z ∈ [- 1,1] after normalization, it is therefore desirable to Carry out [- 1,1] between conversion i.e.:
D=0.5*Zndc+0.5
Wherein, d indicates the pixel value of depth texture, ZndcIndicate the Z value in normalized device coordinate.
As shown in Fig. 2, shown by the third embodiment of the present invention one be directed to Guangdong opera naked eye 3D interaction systems, the needle Naked eye 3D interaction systems to Guangdong opera include image viewing unit 100, data processing unit 200 and naked eye display unit 300, institute It states image viewing unit 100 and the data processing unit 200 communicates to connect, described image observation unit 100 and the naked eye Display unit 300 communicates to connect.
In the present embodiment, the data processing unit 200 receives the Guangdong opera that described image observation unit 100 obtains and performs figure Picture, the Guangdong opera performing image are made of multiple pels.
Specific, the data of processing are the Guangdong opera performing images obtained from image viewing unit 100, are needed in the next steps Projective transformation operation is carried out to pel, the geometry stage realizes the task of apex coordinate projective transformation to screen space.It is several What is responsible for the work such as vertex transformation, projective transformation and the screen map of geological information in the stage.Due to the number of the phase process According to quite huge, be not suitable for CPU processing therefore the data processing work in the stage uses GPU operation.
In the present embodiment, the data processing unit 200 by the three-dimensional vertices coordinate of the pel successively from pel space, World space, observation space cut out spatial alternation into naked eye display space, and then obtain the image after pipeline renders.
(1) by the three-dimensional vertices coordinate of the pel from pel spatial alternation to world space in when specifically include:
It verifies described in the pel with the presence or absence of subgraph member;
If there is no subgraph members for the pel, using the three-dimensional vertices coordinate of the pel as the position in world space Coordinate;
If there are subgraph members for the pel, the three-dimensional vertices of the pel are passed through into transformation matrix MmodelDetermine world's sky Between position coordinates i.e.:
Wherein px, py, pzRespectively position of the pel in world space, θ are the angle of rotary shaft, kx, ky, kzRespectively Scaling.
(2) it is specifically included when the three-dimensional vertices coordinate of the pel is transformed to observation space from world space:
The three-dimensional vertices of the pel are passed through into transformation matrix MviewObservation space is transformed to i.e. from world space:
Wherein tx, ty, tzIt is the position coordinates of image viewing unit 100 in world space ,-t respectivelyx,-ty,-tzIndicate figure As observation unit 100 moves on to the inverse process in world space, θ is the angle of rotary shaft.
(3) it is specifically included when transforming to and cutting out space the three-dimensional vertices coordinate of the pel from observation space:
Obtain the coordinate range Near of the nearest image of described image observation unit 100, the coordinate range of farthest image Far, visual angle FOV;
Utilize projection matrix MfrustumCalculate the height ratio Aspect of image i.e.:
Three-dimensional vertices coordinate and the projection matrix MfrustumProduct the three-dimensional vertices coordinate of the pel can be obtained It is transformed to from observation space and cuts out space PclipCoordinate i.e.:
Wherein, x, y, z are respectively the three-dimensional vertices coordinate of pel.
(4) by the three-dimensional vertices coordinate of the pel from being specifically included when cutting out spatial alternation to display space:
Obtain pixel wide pixelwidth, the pixels tall pixelheight of naked eye display unit 300;
According to screen map formula by the three-dimensional vertices coordinate of pel from spatial alternation is cut out to display space, it may be assumed that
Wherein, the screenxIt is the three-dimensional vertices coordinate of pel from cutting out abscissa of the spatial alternation to display space, The screenyIt is the three-dimensional vertices coordinate of pel from cutting out ordinate of the spatial alternation to display space.
In the present embodiment, the data processing unit 200 obtains single width depth map according to the image after the pipeline renders Picture, and according to the single width range image integration multi-view image, and the naked eye display unit 300 is controlled to the multiple views Image carries out naked eye and shows.
Specifically, in order to realize that screen post-processes effect, it is necessary first to add a script in Unity, work as obtaining The rendering texture of forth screen calls Shader to carry out image using the function Graphics.Bi1t provided in Unity later The processing in later period, wherein the work of the part Shader is exactly to carry out the processing work of picture, for example blur, the images such as Gaussian Blur Operation, finally on rendering texture display to screen.
Depth texture is substantially a rendering texture in Unity, stores high-precision texture value, rather than color Value.The depth value of texture in Unity is normalized, and for range between 0 and 1, the distribution of the depth value is that presentation is non-linear 's.The depth value of depth camera is from the device coordinate after the transformed normalization in vertex in Dnity.Depth texture Pixel value then corresponded to the Z value of apex coordinate in device coordinate, but due to the Z ∈ [- 1,1] after normalization, it is therefore desirable to Carry out [- 1,1] between conversion i.e.:
D=0.5*Zndc+0.5
Wherein, d indicates the pixel value of depth texture, ZndcIndicate the Z value in normalized device coordinate.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extent Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into Row equivalent replacement;And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution The range of scheme should all cover within the scope of the claims and the description of the invention.

Claims (10)

1. a kind of naked eye 3D interactive approach for Guangdong opera, the naked eye 3D interactive approach for Guangdong opera is suitable for being directed to Guangdong opera Naked eye 3D interaction systems, the naked eye 3D interaction systems for Guangdong opera include image viewing unit, data processing unit and Naked eye display unit, which is characterized in that the naked eye 3D interactive approach for Guangdong opera includes the following steps:
The data processing unit receives the Guangdong opera performing image that described image observation unit obtains, the Guangdong opera performing image by Multiple pels are constituted;
The three-dimensional vertices coordinate of the pel is obtained the image after pipeline renders by the data processing unit by spatial alternation; The spatial alternation includes world space transformation, observation space transformation, cuts out spatial alternation and display space transformation;
The data processing unit obtains single width depth image according to the image after the pipeline renders, and deep according to the single width It spends image and synthesizes multi-view image, and the control naked eye display unit carries out naked eye to the multi-view image and shows.
2. the naked eye 3D interactive approach according to claim 1 for Guangdong opera, which is characterized in that by the three of the pel Tie up apex coordinate from pel spatial alternation to world space in when specifically include:
It verifies described in the pel with the presence or absence of subgraph member;
If the pel is sat there is no subgraph member using the three-dimensional vertices coordinate of the pel as the position in world space Mark;
If there are subgraph members for the pel, the three-dimensional vertices of the pel are passed through into transformation matrix MmodelDetermine world space Position coordinates are i.e.:
Wherein px, py, pzRespectively position of the pel in world space, θ are the angle of rotary shaft, kx, ky, kzRespectively scale Ratio.
3. the naked eye 3D interactive approach according to claim 2 for Guangdong opera, which is characterized in that by the three of the pel Dimension apex coordinate specifically includes when transforming to observation space from world space:
The three-dimensional vertices of the pel are passed through into transformation matrix MviewObservation space is transformed to i.e. from world space:
Wherein tx, ty, tzIt is the position coordinates of image viewing unit in world space ,-t respectivelyx,-ty,-tzIndicate image viewing Unit moves on to the inverse process in world space, and θ is the angle of rotary shaft.
4. the naked eye 3D interactive approach according to claim 3 for Guangdong opera, which is characterized in that by the three of the pel Dimension apex coordinate is transformed to from observation space to be specifically included when cutting out space:
Obtain coordinate range Near, the coordinate range Far of farthest image, visual angle of the nearest image of described image observation unit FOV;
Utilize projection matrix MfrustumCalculate the height ratio Aspect of image i.e.:
Three-dimensional vertices coordinate and the projection matrix MfrustumProduct the three-dimensional vertices coordinate of the pel can be obtained from Spatial alternation is to cutting out space PclipCoordinate i.e.:
Wherein, x, y, z are respectively the three-dimensional vertices coordinate of pel.
5. the naked eye 3D interactive approach according to claim 4 for Guangdong opera, which is characterized in that by the three of the pel Dimension apex coordinate when cutting out spatial alternation to display space from specifically including:
Obtain pixel wide pixelwidth, the pixels tall pixelheight of naked eye display unit;
According to screen map formula by the three-dimensional vertices coordinate of pel from spatial alternation is cut out to display space, it may be assumed that
Wherein, the screenxIt is the three-dimensional vertices coordinate of pel from cutting out abscissa of the spatial alternation to display space, it is described screenyIt is the three-dimensional vertices coordinate of pel from cutting out ordinate of the spatial alternation to display space.
6. a kind of naked eye 3D interaction systems for Guangdong opera, which is characterized in that the naked eye 3D interaction systems packet for Guangdong opera Include image viewing unit, data processing unit and naked eye display unit:
The data processing unit receives the Guangdong opera performing image that described image observation unit obtains, the Guangdong opera performing image by Multiple pels are constituted;
The three-dimensional vertices coordinate of the pel is obtained the image after pipeline renders by the data processing unit by spatial alternation; The spatial alternation includes world space transformation, observation space transformation, cuts out spatial alternation and display space transformation;
The data processing unit obtains single width depth image according to the image after the pipeline renders, and deep according to the single width It spends image and synthesizes multi-view image, and the control naked eye display unit carries out naked eye to the multi-view image and shows.
7. the naked eye 3D interaction systems according to claim 6 for Guangdong opera, which is characterized in that by the three of the pel Tie up apex coordinate from pel spatial alternation to world space in when specifically include:
It verifies described in the pel with the presence or absence of subgraph member;
If the pel is sat there is no subgraph member using the three-dimensional vertices coordinate of the pel as the position in world space Mark;
If there are subgraph members for the pel, the three-dimensional vertices of the pel are passed through into transformation matrix MmodelDetermine world space Position coordinates are i.e.:
Wherein px, py, pzRespectively position of the pel in world space, θ are the angle of rotary shaft, kx, ky, kzRespectively scale Ratio.
8. the naked eye 3D interaction systems according to claim 7 for Guangdong opera, which is characterized in that by the three of the pel Dimension apex coordinate specifically includes when transforming to observation space from world space:
The three-dimensional vertices of the pel are passed through into transformation matrix MviewObservation space is transformed to i.e. from world space:
Wherein tx, ty, tzIt is the position coordinates of image viewing unit in world space ,-t respectivelyx,-ty,-tzIndicate image viewing Unit moves on to the inverse process in world space, and θ is the angle of rotary shaft.
9. the naked eye 3D interaction systems according to claim 8 for Guangdong opera, which is characterized in that by the three of the pel Dimension apex coordinate is transformed to from observation space to be specifically included when cutting out space:
Obtain coordinate range Near, the coordinate range Far of farthest image, visual angle of the nearest image of described image observation unit FOV;
Utilize projection matrix MfrustumCalculate the height ratio Aspect of image i.e.:
Three-dimensional vertices coordinate and the projection matrix MfrustumProduct the three-dimensional vertices coordinate of the pel can be obtained from Spatial alternation is to cutting out space PclipCoordinate i.e.:
Wherein, x, y, z are respectively the three-dimensional vertices coordinate of pel.
10. the naked eye 3D interaction systems according to claim 9 for Guangdong opera, which is characterized in that by the pel Three-dimensional vertices coordinate when cutting out spatial alternation to display space from specifically including:
Obtain pixel wide pixelwidth, the pixels tall pixelheight of naked eye display unit;
According to screen map formula by the three-dimensional vertices coordinate of pel from spatial alternation is cut out to display space, it may be assumed that
Wherein, the screenxIt is the three-dimensional vertices coordinate of pel from cutting out abscissa of the spatial alternation to display space, it is described screenyIt is the three-dimensional vertices coordinate of pel from cutting out ordinate of the spatial alternation to display space.
CN201811139852.3A 2018-09-28 2018-09-28 A kind of naked eye 3D interactive approach and system for Guangdong opera Pending CN109068124A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811139852.3A CN109068124A (en) 2018-09-28 2018-09-28 A kind of naked eye 3D interactive approach and system for Guangdong opera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811139852.3A CN109068124A (en) 2018-09-28 2018-09-28 A kind of naked eye 3D interactive approach and system for Guangdong opera

Publications (1)

Publication Number Publication Date
CN109068124A true CN109068124A (en) 2018-12-21

Family

ID=64766727

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811139852.3A Pending CN109068124A (en) 2018-09-28 2018-09-28 A kind of naked eye 3D interactive approach and system for Guangdong opera

Country Status (1)

Country Link
CN (1) CN109068124A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177467A (en) * 2013-03-27 2013-06-26 四川长虹电器股份有限公司 Method for creating naked eye 3D (three-dimensional) subtitles by using Direct 3D technology
CN105513112A (en) * 2014-10-16 2016-04-20 北京畅游天下网络技术有限公司 Image processing method and device
US20170206625A1 (en) * 2016-01-18 2017-07-20 Advanced Micro Devices, Inc. Method and apparatus to accelerate rendering of graphics images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177467A (en) * 2013-03-27 2013-06-26 四川长虹电器股份有限公司 Method for creating naked eye 3D (three-dimensional) subtitles by using Direct 3D technology
CN105513112A (en) * 2014-10-16 2016-04-20 北京畅游天下网络技术有限公司 Image processing method and device
US20170206625A1 (en) * 2016-01-18 2017-07-20 Advanced Micro Devices, Inc. Method and apparatus to accelerate rendering of graphics images

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
常龙: "基于HTML5_WebGL的3D图形库的设计与实现", 《东南大学工程硕士学位论文》 *
廖明: "人眼立体视觉空间与虚拟三维空间的几何映射关系理论分析", 《计算机工程与科学》 *
黄南海: "3D图形引擎系统的研究与实现", 《武汉理工大学学位论文》 *

Similar Documents

Publication Publication Date Title
US11748840B2 (en) Method for efficient re-rendering objects to vary viewports and under varying rendering and rasterization parameters
US10902663B2 (en) Method and apparatus for displaying 2D application interface in virtual reality device
Regan et al. Priority rendering with a virtual reality address recalculation pipeline
KR101922482B1 (en) Varying effective resolution by screen location by changing active color sample count within multiple render targets
US6249289B1 (en) Multi-purpose high resolution distortion correction
CN101968890B (en) 360-degree full-view simulation system based on spherical display
US20080246760A1 (en) Method and apparatus for mapping texture onto 3-dimensional object model
CN101189643A (en) 3D image forming and displaying system
WO2021135320A1 (en) Video generation method and apparatus, and computer system
CN105224288B (en) Binocular three-dimensional method for rendering graph and related system
US11790610B2 (en) Systems and methods for selective image compositing
CN106558017B (en) Spherical display image processing method and system
US20120256906A1 (en) System and method to render 3d images from a 2d source
CN103136793A (en) Live-action fusion method based on augmented reality and device using the same
US20200302579A1 (en) Environment map generation and hole filling
WO2004049262A1 (en) Open gl
US20120013616A1 (en) Computer graphics video synthesizing device and method, and display device
US20200118253A1 (en) Environment map generation and hole filling
CN102572391A (en) Method and device for genius-based processing of video frame of camera
US9401044B1 (en) Method for conformal visualization
CN102737410B (en) Display methods and device of a kind of three-dimensional pel in two-dimentional picture and text compile broadcast system
CN109068124A (en) A kind of naked eye 3D interactive approach and system for Guangdong opera
JP2001222726A (en) Method and device for image processing
CN113486941A (en) Live image training sample generation method, model training method and electronic equipment
JP2009064355A (en) Program, information storage medium, and image producing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181221