CN101562755B - Method for producing 3D video by plane video - Google Patents

Method for producing 3D video by plane video Download PDF

Info

Publication number
CN101562755B
CN101562755B CN2009100277117A CN200910027711A CN101562755B CN 101562755 B CN101562755 B CN 101562755B CN 2009100277117 A CN2009100277117 A CN 2009100277117A CN 200910027711 A CN200910027711 A CN 200910027711A CN 101562755 B CN101562755 B CN 101562755B
Authority
CN
China
Prior art keywords
video
image
series
image series
view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2009100277117A
Other languages
Chinese (zh)
Other versions
CN101562755A (en
Inventor
林晓森
尤志翔
徐秀兵
刘磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuxi Jingxiang Digital Technology Co Ltd
Original Assignee
Wuxi Jingxiang Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuxi Jingxiang Digital Technology Co Ltd filed Critical Wuxi Jingxiang Digital Technology Co Ltd
Priority to CN2009100277117A priority Critical patent/CN101562755B/en
Publication of CN101562755A publication Critical patent/CN101562755A/en
Application granted granted Critical
Publication of CN101562755B publication Critical patent/CN101562755B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention relates to a method for producing a 3D video from a plane video, in particular to the method which increase effects, when a plane video is converted to a 3D video; wherein, a N-path 3D image matching with N visual angles is formed by the technology for converting the plane video to the 3D video; meanwhile, a 3D computer animation technology is adopted to generate a model of a 3D object and a N-path views with N visual angles are shot by N visual videos to form corresponding N-path mask views; N-path 3D computer animation views are superimposed to the N-path 3D views converted from the plain video views by the N-path mask code views to generate N-path composite views; finally the N-path composite views are synthesized into a 3D video. The invention has the following advantages: based on the technology for converting the plane video to the 3D video, a 3D video generated by a 3D computer animation is superimposed and the final synthesized 3D video features good 3D effect.

Description

A kind of method of making the 3D video by planar video
Technical field
The present invention relates to a kind of method of making the 3D video, especially a kind of method that in planar video commentaries on classics 3D video, increases effect by planar video.
Background technology
The generation of 3D video has several different methods, and wherein computer 3D cartoon making and planar video commentaries on classics 3D video is present important method.It is the result of the approximate solution of an ill-conditioning problem that planar video changes the 3D video technique, and the 3D effect that therefore changes the 3D video is subjected to the influence of video scene content, and changeing the 3D visual effect under some scene may be also imperfect.Combine if computer 3D cartoon technique and planar video are changeed the 3D video technique, can strengthen the 3D effect of making the 3D video by planar video.
Summary of the invention
The objective of the invention is to overcome the deficiencies in the prior art, a kind of method of being made the 3D video by planar video is provided, the 3D video that adopts this method to generate, both included the 3D visual effect after planar video changes the 3D video, include the 3D visual effect that adopts computer 3D cartoon technique to generate again, can improve the visual effect of 3D video greatly.
According to technical scheme provided by the invention, a kind of method by planar video making 3D video comprises the steps:
Step 1, take out a frame from planar video, be referred to as former figure, the length of supposing this frame is X, and wide is Y; Specify the depth value of X * Y pixel on the described former figure, form an image that is called depth map;
Step 2, adopt the rendering intent based on depth map, described former figure and depth map are generated be applicable to that specification is the image at N virtual visual angle of N view three-dimensional display, each image size is X * Y, is called the A image series;
Step 3, generation specification are the 3D rendering of N view, are called the B image series;
Step 4, for the B image series, the mask value of specifying its each pixel is P or Q, P ≠ Q: the pixel value of the point that described 3D model object is covered is labeled as P, and other are labeled as Q; Forming size is the mask image of X * Y, is called the C image series;
Step 5, utilize N road C image series as mask with the B image series A image series that is added to: promptly pixel value is that the point of P is got the pixel value of corresponding points on the B image series on the mask image, otherwise gets the pixel value of corresponding points on the A image series; Obtain N road composograph, be called the D image series, as a frame of 3D video;
Step 6, produce each frame of 3D video, form every frame and have the frame series of N road view, be called the E series of frames with step 1 to the method for step 5;
Step 7, the E series of frames synthesized the 3D video that is applicable to N view three-dimensional display specification.
Described B image series can be a frame of one section specification 3D video that is the N view.
Described B image series can be the image that is generated by following method: adopt computer 3D cartoon technique, make 3D model object; In virtual 3D scene, take pictures with N virtual video camera of coupling N view three-dimensional display parameter, generate the image at N virtual visual angle, each image size is X * Y.
Described B image series can be to be the 3D rendering of N view by the specification that plane picture changes into.
N is the positive integer more than or equal to 2.
Advantage of the present invention is: change at planar video on the basis of 3D video, the 3D video that has superposeed and adopted computer 3D animation to generate makes final synthetic 3D video have good 3D effect.
Description of drawings
Fig. 1 is the schematic diagram of the method for the invention.
Fig. 2 is former figure and depth map.
Fig. 3 is the A image series.
Fig. 4 is the B image series.
Fig. 5 is the C image series.
Fig. 6 is the D image series.
Embodiment
The invention will be further described below in conjunction with drawings and Examples.
The present invention adopts planar video to change the N road commentaries on classics 3D view that the 3D video technique generates N visual angle of coupling; Adopt computer 3D cartoon technique simultaneously, make the model of 3D object, take the N road view at N visual angle of coupling, and generate N corresponding mask view with N virtual video camera; With N road mask view the computer 3D animation view N road that is added in N road is changeed on the 3D view at last, generate the synthetic view in N road.At last with the synthetic 3D video of the synthetic view in N road.Wherein, N is the positive integer more than or equal to 2.
The method of the invention can be applicable to make the 3D video by planar video, also can be applicable to by plane picture making 3D picture.
The description of following technical scheme is the 3D video of 3 views based on design specification.As shown in Figure 1, step is as follows:
(1) from planar video, takes out a frame, be referred to as former figure, shown in Fig. 2 (a).The length of supposing this frame is 800, and wide is 600; Specify the depth value of 800 * 600 pixels on the described former figure, form an image that is called depth map, shown in Fig. 2 (b).
(2) employing is based on the rendering intent (Depth Image based Rendering) of depth map, described former figure and depth map generation are applicable to that specification is the image at 3 virtual visual angles of 3 view three-dimensional displays, as shown in Figure 3, (a) (b) (c) is respectively view 1, view 2, view 3.Each image size is 800 * 600, is called the A image series.
(3) adopt computer 3D cartoon technique, make 3D model object; In virtual 3D scene, take pictures with 3 virtual video cameras of coupling N view three-dimensional display parameter, generate the image at 3 virtual visual angles, as shown in Figure 4, (a) (b) (c) is respectively computer 3D view 1, computer 3D view 2, computer 3D view 3.Each image size is 800 * 600, is called the B image series.This step can be made of 3D model development storehouses such as computer 3D tools commonly used or OpenGL.Described B image series also can be a certain frame in one section specification 3D video that is 3 views, can also be to be the 3D rendering of 3 views by the specification that plane picture changes into.
(4) for the B image series, the mask value of specifying its each pixel is P or Q, P ≠ Q: the pixel value of the point that described 3D model object is covered is labeled as P, and other are labeled as Q; Such as getting P is 1, and Q is 0.Form size and be 800 * 600 mask image, be called the C image series, as shown in Figure 5, (a) (b) (c) is respectively mask image 1, mask image 2, mask image 3.
(5) utilize 3 road C image series as mask with the B image series A image series that is added to: promptly pixel value is that 1 point is got the pixel value of corresponding points on the B image series on the mask image, otherwise gets the pixel value of corresponding points on the A image series; Obtain 3 road composographs, be called the D image series, as a frame of 3D video, as shown in Figure 6, (a) (b) (c) is respectively composograph 1, composograph 2, composograph 3.
(6) produce each frame of 3D video with step 1 to the method for step 5, form every frame and have the frame series of 3 road views, be called the E series of frames;
(7) the E series of frames is synthesized the 3D video that is applicable to 3 view three-dimensional display specifications.

Claims (1)

1. a method of making the 3D video by planar video is characterized in that described method comprises the steps:
Step 1, take out a frame from planar video, be referred to as former figure, the length of supposing this frame is X, and wide is Y; Specify the depth value of X * Y pixel on the described former figure, form an image that is called depth map;
Step 2, adopt the rendering intent based on depth map, described former figure and depth map are generated be applicable to that specification is the image at N virtual visual angle of N view three-dimensional display, each image size is X * Y, is called the A image series; N is the positive integer more than or equal to 2;
Step 3, generation specification are the 3D rendering of N view, are called the B image series;
Step 4, for the B image series, the mask value of specifying its each pixel is P or Q, the pixel value of the point that the 3D model object in P ≠ Q:B image series is covered is labeled as P, other are labeled as Q; Forming size is the mask image of X * Y, is called the C image series;
Step 5, utilize N road C image series as mask with the B image series A image series that is added to: promptly pixel value is that the point of P is got the pixel value of corresponding points on the B image series on the mask image, otherwise gets the pixel value of corresponding points on the A image series; Obtain N road composograph, be called the D image series, as a frame of 3D video;
Step 6, produce each frame of 3D video, form every frame and have the frame series of N road view, be called the E series of frames with step 1 to the method for step 5;
Step 7, the E series of frames synthesized the 3D video that is applicable to N view three-dimensional display specification;
In step 3, described B image series is a frame of one section specification 3D video that is the N view;
Perhaps, described B image series is the image that is generated by following method: adopt computer 3D cartoon technique, make 3D model object; In virtual 3D scene, take pictures with N virtual video camera of coupling N view three-dimensional display parameter, generate the image at N virtual visual angle, each image size is X * Y;
Perhaps, described B image series is to be the 3D rendering of N view by the specification that plane picture changes into.
CN2009100277117A 2009-05-19 2009-05-19 Method for producing 3D video by plane video Expired - Fee Related CN101562755B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009100277117A CN101562755B (en) 2009-05-19 2009-05-19 Method for producing 3D video by plane video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009100277117A CN101562755B (en) 2009-05-19 2009-05-19 Method for producing 3D video by plane video

Publications (2)

Publication Number Publication Date
CN101562755A CN101562755A (en) 2009-10-21
CN101562755B true CN101562755B (en) 2010-09-01

Family

ID=41221341

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009100277117A Expired - Fee Related CN101562755B (en) 2009-05-19 2009-05-19 Method for producing 3D video by plane video

Country Status (1)

Country Link
CN (1) CN101562755B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3136717A4 (en) * 2014-04-22 2017-12-13 Nippon Telegraph and Telephone Corporation Video display device, video projection device, dynamic illusion presentation device, video generation device, method thereof, data construct, and program
CN107343206B (en) * 2017-08-11 2019-12-24 北京铂石空间科技有限公司 Video generation method, device, medium and electronic equipment supporting multi-view viewing
CN112235559B (en) * 2020-10-14 2021-09-14 贝壳找房(北京)科技有限公司 Method, device and system for generating video

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1281569A (en) * 1997-12-05 2001-01-24 动力数字深度研究有限公司 Improved image conversion and encoding techniques
US6466208B1 (en) * 1999-12-20 2002-10-15 Silicon Integrated Systems Corporation Apparatus and method for adjusting 3D stereo video transformation
CN1567385A (en) * 2003-06-19 2005-01-19 邓兴峰 Panoramic reconstruction method of three dimensional image from two dimensional image
CN1706201A (en) * 2002-11-25 2005-12-07 三洋电机株式会社 Stereoscopic video providing method and stereoscopic video display
CN101287143A (en) * 2008-05-16 2008-10-15 清华大学 Method for converting flat video to tridimensional video based on real-time dialog between human and machine

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1281569A (en) * 1997-12-05 2001-01-24 动力数字深度研究有限公司 Improved image conversion and encoding techniques
US6466208B1 (en) * 1999-12-20 2002-10-15 Silicon Integrated Systems Corporation Apparatus and method for adjusting 3D stereo video transformation
CN1706201A (en) * 2002-11-25 2005-12-07 三洋电机株式会社 Stereoscopic video providing method and stereoscopic video display
CN1567385A (en) * 2003-06-19 2005-01-19 邓兴峰 Panoramic reconstruction method of three dimensional image from two dimensional image
CN101287143A (en) * 2008-05-16 2008-10-15 清华大学 Method for converting flat video to tridimensional video based on real-time dialog between human and machine

Also Published As

Publication number Publication date
CN101562755A (en) 2009-10-21

Similar Documents

Publication Publication Date Title
CN102592275B (en) Virtual viewpoint rendering method
CN105262958B (en) A kind of the panorama feature splicing system and its method of virtual view
CN103810685A (en) Super resolution processing method for depth image
WO2007148219A3 (en) Methods and systems for converting 2d motion pictures for stereoscopic 3d exhibition
CN102724531B (en) A kind of two-dimensional video turns the method and system of 3 D video
KR20110093828A (en) Method and system for encoding a 3d image signal, encoded 3d image signal, method and system for decoding a 3d image signal
CN112019828B (en) Method for converting 2D (two-dimensional) video into 3D video
CN105913488B (en) A kind of three-dimensional point cloud fast reconstructing method based on three-dimensional mapping table
CN102447925A (en) Method and device for synthesizing virtual viewpoint image
CN112651881B (en) Image synthesizing method, apparatus, device, storage medium, and program product
Do et al. GPU-accelerated real-time free-viewpoint DIBR for 3DTV
KR101340598B1 (en) Method for generating a movie-based, multi-viewpoint virtual reality and panoramic viewer using 3d surface tile array texture mapping
CN102937968A (en) Double-eye 3D (three-dimensional) realizing method and system based on Canvas
CN103177467A (en) Method for creating naked eye 3D (three-dimensional) subtitles by using Direct 3D technology
CN101562755B (en) Method for producing 3D video by plane video
Bleyer et al. Temporally consistent disparity maps from uncalibrated stereo videos
CN104715468A (en) Naked-eye 3D content creation improving method based on Unity 3D
CN105578172B (en) Bore hole 3D image display methods based on Unity3D engines
CN102316354A (en) Parallelly processable multi-view image synthesis method in imaging technology
CN102521876B (en) A kind of method and system realizing 3D user interface stereoeffect
CN112634127B (en) Unsupervised stereo image redirection method
CN112040141A (en) Video production method based on three-dimensional reconstruction and virtual reality
CN109272445B (en) Panoramic video stitching method based on spherical model
JP4320271B2 (en) 3D image display method
CN101695140A (en) Object-based virtual image drawing method of three-dimensional/free viewpoint television

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100901

Termination date: 20130519