WO2012115293A1 - Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d) - Google Patents

Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d) Download PDF

Info

Publication number
WO2012115293A1
WO2012115293A1 PCT/KR2011/001297 KR2011001297W WO2012115293A1 WO 2012115293 A1 WO2012115293 A1 WO 2012115293A1 KR 2011001297 W KR2011001297 W KR 2011001297W WO 2012115293 A1 WO2012115293 A1 WO 2012115293A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
white
black
images
effect
Prior art date
Application number
PCT/KR2011/001297
Other languages
English (en)
Korean (ko)
Inventor
홍순호
김광욱
이대희
최광식
Original Assignee
(주)스튜디오 로프트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)스튜디오 로프트 filed Critical (주)스튜디오 로프트
Priority to PCT/KR2011/001297 priority Critical patent/WO2012115293A1/fr
Publication of WO2012115293A1 publication Critical patent/WO2012115293A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues

Definitions

  • the present invention relates to a method of converting a 2D animation into a 3D image by a 3D stereoscopic conversion method, and a method of stereoscopically working a 2D animation into a 3D animation.
  • a stereoscopic image is artificially displayed by displaying two images, which are taken separately from the left and right eye visual positions, respectively.
  • the present invention has been invented to solve the above problems, and its object is to convert a general two-dimensional image material, preferably a 2D animation into a 3D animation.
  • a depth map refers to a contrast image showing a depth value of an object on a 2D image. It is a map of the reference image to indicate the part far from the viewer.
  • the portions near the viewing side are white, the far portions are black, and each position is expressed in a gradient manner of white and black according to the perspective from the viewing side. 1 and 9 are exemplarily referred to.
  • the depth map of the original lamp, etc. is shown in white because the convex part of the original lamp, etc. corresponds to the closest part when looking at the original lamp, and is based on the most blocked part of the original lamp.
  • a method of converting a 2D image into a 3D stereoscopic image in which a highlight portion that receives the most light is white and a portion that does not receive light is displayed in white and a black gradation method in the 2D image.
  • Forming a lighting layer Forming a depth map layer in which the portion closest to the viewing side is displayed in white, and the portion furthest from the viewing side is in black, displayed in a gradient manner of white and black; Based on the white and black gradation values of the depth map, the pixel of the image for the right eye image is shifted to the left, and the pixels of the image for the left eye image are shifted to the right. It relates to a method of converting a 2D image into a 3D stereoscopic image, which is moved to the largest range of the predetermined range, and the black portion is moved to the smallest range of the predetermined range.
  • the present invention may provide a minimum blur effect to a portion closest to a focal length to the left and right eye images, and include a maximum blur effect to a portion farthest from the focal length.
  • 1 is a magnified depth map image of a 2D image of a circular shape.
  • FIG. 2 is a light effect applied to a 2D image of a circular shape, which is divided into pixels.
  • FIG. 3 is an image divided before the lighting effect is applied to a cylindrical 2D image, and is divided into pixels.
  • FIG. 4 is an image in which the image of FIG. 2 is arranged side by side.
  • FIG. 5 is an image in which a displacement map effect is applied and pixels of an image are shifted based on the depth map of FIG. 1.
  • 6 to 9 are images showing a depth map generation process by a mask.
  • FIG. 10 is a view for explaining the principle that a stereoscopic image is projected onto a flat film to form a 2D image.
  • 11 is a view showing a state of seeing an object with both eyes.
  • 12 is a view for explaining the principle of making the right eye and left eye images.
  • 13 is a flowchart showing a method of converting a 2D animation of the present invention into a 3D animation.
  • the method for converting the schematic 2D animation of the present invention to 3D animation is as follows. Extract the target images from the original image, increase the size only larger than HD (e.g. 3840 x 2160), leaving the resolution of the old film (e.g. 640 x 480) (resize). Print the extracted and resized image directly on the drawing paper, and correct the pencil lines and color parts on the printed image. Scan the corrected image at high resolution using a scanner, FULL HE ) for 3D TV. Therefore, scan at the appropriate resolution, eg 1920 x 1080. Scanned image files can be loaded from a computer image editing program such as Photoshop or After Effects.Nuke.Cinema 4D to insert image lighting effects using separate layers. This will be explained in detail below.
  • a computer image editing program such as Photoshop or After Effects.Nuke.Cinema 4D to insert image lighting effects using separate layers. This will be explained in detail below.
  • a depth script and a depth map are generated based on the image file scanned at the high resolution.
  • the depth map will be described in detail below.
  • a displacement map effect is generated to generate left and right eye images, which will be described in detail below.
  • the left and right eye images are corrected and subsequently a stereoscopic image is generated and stored as a 3D animation image.
  • an illumination layer of the present invention Depth map layer; And a representative example of implementing pixel movement as an example.
  • a feature of the present invention is to add a lighting effect using a gradation to implement a three-dimensional effect on a 2D image.
  • a lighting effect using a gradation to implement a three-dimensional effect on a 2D image.
  • I could not think of inserting lighting effects, but simply shadowed them.
  • the inventors of the present invention have found that the insertion of the lighting effect enables proper implementation of the three-dimensional effect. Accordingly, the inventors have applied the effect of the lighting to further increase the three-dimensional effect in the 2D animation.
  • the method of applying this lighting effect was implemented by the method introduced in detail below. Thus, the lighting effect was applied to the solid surface, which is a characteristic of 2D animation, to create a change in color.
  • Such addition of the lighting effect of the method using the gradation of the present invention allows the three-dimensional (volume) to be properly alive. However, if the effect of the lighting is too strong there is a risk of changing the original slow, it is preferably taking the way to maximize the feeling of the original by giving a lighting effect of less than 50%.
  • 2 is an exemplary diagram to add a lighting effect of the method using a gradient.
  • FIG. 2 reference may be made to an example in which a lighting effect is added.
  • Image overlays that have finished layer separation or finished resolution enhancement, create one or more layers in Photoshop, and highlight the highlights with a brush to apply a white overlay effect.
  • the darker shadows ("shadows" in this specification do not mean the shadows of the actual image, but the darker areas that are opposite to the direction the light is coming from).
  • the highlight and darkening shadows are selected by considering the direction of illumination from the target image.
  • the boundary between the highlight and the shadow portion gives a feather effect, making the gradation smooth and natural. Wherein the feather value is preferably 4-6. Transparency was applied to the layer so that this effect was applied quietly.
  • the transparency value is 50%. Referring to FIG.
  • FIG. 2 expresses the lighting effect on the 2D image of the energy lamp by utilizing the gradation.
  • the brush effect described above was created using a mask and a pentle, which are basic functions of a video effects program (After effects. This method works even if the layers of the original source are not separated. I created a solid layer on top of the original source image and masked the highlights or shadows with a pen. At this point, the mask line is precisely cut with a knife, but the edge outline is smoothed and made natural as described above. For example, it was a feather value of 4-6. 6 to 9 may be referred to.
  • FIG. 6 is an example of a depth map made in this manner. 1 shows a depth map with respect to an original light etc. as already demonstrated.
  • a 2D picture is not seen in three dimensions because it reflects the three-dimensional surface on the two-dimensional plane (film in FIG. 10) as shown in FIG.
  • the reason why a person feels things three-dimensionally is because they observe things with the eyes of two people (FIG. 11). Therefore, to express a picture in three dimensions requires two pictures viewed from two viewpoints such as the human eye. If there is an original image, as shown in FIG. 12, creating a left eye image is an image of turning the original to the right, and a right eye image of an image of turning the original to the left. But because you can't actually turn it, you have to move the pixels left and right.
  • the movement distance should be the largest when viewed only with the left and right eyes, respectively, and the part of the object farthest from both eyes will have the smallest movement distance. Therefore, when making an image of the right eye viewed from the right eye and the left eye viewed from the left eye, move the part closest to the eye more and move the part farthest farther away. Since the close part is black and the dark part is far from the eyes, when creating the right and left eye images using the depth map, the degree of pixel movement is increased by moving the white part by using the created depth map and by moving the dark part by less. By the three-dimensional effect can be implemented (applied with the display map effect), the generation of these left and right eye images is described further below.
  • the original images to which the lighting effect is applied are arranged side by side.
  • the left eye image was placed on the right side and the right eye image on the left side.
  • a depth map of the corresponding image (depth map of FIG. 1) is placed under the image, and then a displacement map effect is applied to the original images arranged left and right.
  • the displacement map affected by the depth map moved the original pixels.
  • the bright pixels in the depth map were shifted to the left by giving a positive value to the left eye image.
  • Bright pixels in the depth map were shifted to the right by giving a negative value to the original to be the left eye image on the right. That is, as shown in FIG. 5, the pixels of the right eye image move to the left and the pixels of the left eye image move to the right.
  • the direction in which light colors move and the direction in which dark colors do not differ is different, but the distance moved is a lot of light colors and dark colors move slightly.
  • Lens Blur In order to maximize the sense of distance (depth), the present invention considers the addition of lens blur. The closer to the focal length, the sharper the distance from the focal point and the greater the blurring value, and the pixel movement caused by the depth map. The added three-dimensional effect is further maximized by blurring.
  • the lens blur is applied to the left eye and right eye images, the bright part receives the most blur and the dark part receives the less blur due to the influence of Thamesblind. If you check Invert in the option of the lens blur, The blurring value is the smallest, and the blurring value of the dark part becomes larger.
  • the air (atmosphere) expression can also maximize the sense of distance (depth). In general, the distance between objects is expressed simply by spreading them from side to side.
  • One of the methods used to draw animated backgrounds is to express organisms affected by light in the air. For example, there is sunlight that leaks through a window. You can add a layer of organisms affected by light to maximize the distance (depth). The expression of the layer is invisible, but the difference in depth with and without the layer is visible.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente invention porte sur un procédé de conversion d'une image bidimensionnelle en une image tridimensionnelle, de façon à permettre la visualisation d'une image stéréoscopique, et, plus particulièrement, sur un procédé de création d'images d'œil gauche et d'œil droit par l'intermédiaire d'un effet d'éclairage et d'un effet de déplacement à l'aide d'une carte de profondeur en plus d'un effet de flou d'objectif.
PCT/KR2011/001297 2011-02-24 2011-02-24 Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d) WO2012115293A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2011/001297 WO2012115293A1 (fr) 2011-02-24 2011-02-24 Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2011/001297 WO2012115293A1 (fr) 2011-02-24 2011-02-24 Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d)

Publications (1)

Publication Number Publication Date
WO2012115293A1 true WO2012115293A1 (fr) 2012-08-30

Family

ID=46721054

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/001297 WO2012115293A1 (fr) 2011-02-24 2011-02-24 Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d)

Country Status (1)

Country Link
WO (1) WO2012115293A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050063582A1 (en) * 2003-08-29 2005-03-24 Samsung Electronics Co., Ltd. Method and apparatus for image-based photorealistic 3D face modeling
US20070216765A1 (en) * 2006-03-16 2007-09-20 Wong Earl Q Simple method for calculating camera defocus from an image scene
US20100197395A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Visual target tracking

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050063582A1 (en) * 2003-08-29 2005-03-24 Samsung Electronics Co., Ltd. Method and apparatus for image-based photorealistic 3D face modeling
US20070216765A1 (en) * 2006-03-16 2007-09-20 Wong Earl Q Simple method for calculating camera defocus from an image scene
US20100197395A1 (en) * 2009-01-30 2010-08-05 Microsoft Corporation Visual target tracking

Similar Documents

Publication Publication Date Title
KR20120095059A (ko) 2ｄ 이미지를 3ｄ 입체 이미지로 전환시키는 방법
JP7283513B2 (ja) 映像表示装置、映像投影装置、それらの方法、プログラム
JP2010154422A (ja) 画像処理装置
CN103426163B (zh) 用于渲染受影响的像素的系统和方法
EP2306744B1 (fr) Procédé et système pour l'utilisation de couches d'images pré-existantes d'une image bidimensionnelle pour créer une image stéréoscopique
US8351689B2 (en) Apparatus and method for removing ink lines and segmentation of color regions of a 2-D image for converting 2-D images into stereoscopic 3-D images
EP2306745B1 (fr) Procédé et système pour la création de profondeur et de volume dans une image planaire 2D
US20090219383A1 (en) Image depth augmentation system and method
EP1771014A1 (fr) Procede et dispositif de creation d'image stereoscopique
US8094148B2 (en) Texture processing apparatus, method and program
JP2007506167A (ja) ３次元的奥行き効果を有するイメージ表示法用の３次元イメージ・パターンの生成方法および３次元イメージ・パターンを表示する装置
KR20030029649A (ko) 화상 변환 및 부호화 기술
US11398007B2 (en) Video generation device, video generation method, program, and data structure
EP2437220A1 (fr) Procédé et système de censure du contenu d'images tridimensionnelles
JP2016511888A (ja) イメージ形成における及びイメージ形成に関する改良
CN109510975B (zh) 一种视频图像的提取方法、设备及系统
JP2012079291A (ja) プログラム、情報記憶媒体及び画像生成システム
KR20200129657A (ko) 혼합현실 환경의 동적인 3차원 현실데이터 구동을 위한 실사기반의 전방위 3d 모델 비디오 시퀀스 획득 방법
EP3057316B1 (fr) Génération d'imagerie tridimensionnelle en complément du contenu existant
JP2007086716A (ja) 画像表示システム、画像表示方法、符号化方法及び立体表示用印刷物
US8786681B1 (en) Stereoscopic conversion
CN105282534B (zh) 用于嵌入立体图像的系统及方法
CN106412562B (zh) 三维场景中显示立体内容的方法及其系统
US9118902B1 (en) Stereoscopic conversion
WO2012115293A1 (fr) Procédé de conversion d'image bidimensionnelle (2d) en image tridimensionnelle (3d)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11859082

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17-12-2013)

122 Ep: pct application non-entry in european phase

Ref document number: 11859082

Country of ref document: EP

Kind code of ref document: A1