WO2011040653A1 - Photography apparatus and method for providing a 3d object - Google Patents
Photography apparatus and method for providing a 3d object Download PDFInfo
- Publication number
- WO2011040653A1 WO2011040653A1 PCT/KR2009/005585 KR2009005585W WO2011040653A1 WO 2011040653 A1 WO2011040653 A1 WO 2011040653A1 KR 2009005585 W KR2009005585 W KR 2009005585W WO 2011040653 A1 WO2011040653 A1 WO 2011040653A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- user
- face
- unit
- face image
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/755—Deformable models or variational models, e.g. snakes or active contours
- G06V10/7557—Deformable models or variational models, e.g. snakes or active contours based on appearance, e.g. active appearance models [AAM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Definitions
- the present invention relates to a photographic apparatus for providing a three-dimensional object for providing a caricature of the three-dimensional object by overlapping the user face image and a method of providing the same.
- a sticker photographing device is a device for outputting a photograph of a user input by an image input device in the form of a sticker. Furthermore, various two-dimensional objects have been provided to decorate and decorate the surroundings of the photographed photograph.
- the conventional sticker photo device provides a two-dimensional object, and the user has to manually adjust the size of the two-dimensional object.
- the conventional sticker photo device is formed in two dimensions has a disadvantage that falls in reality.
- the technical problem to be solved by the present invention is a photographic apparatus and a method for providing a three-dimensional object that overlaps the three-dimensional object in the face image of the user in the moving reality.
- the technical problem to be solved by the present invention is a sticker photo device and a method for providing a three-dimensional object moving in accordance with the user's movement by applying a variety of three-dimensional objects to their faces in real time to be.
- a photographic apparatus for providing a 3D object includes: an image input device configured to receive a face image of a user in real time;
- a preprocessing unit converting the input face image of the user into a binary image
- a position coordinate detector for detecting position coordinates of an eye, nose, mouth, and face contour in a face image of the user converted into the binary image
- a position coordinate corrector for correcting the coordinates detected by the face coordinate detector
- a position coordinate storage unit for storing face coordinates corrected by the position coordinate corrector
- a position coordinate loading unit for loading face coordinates into a face image of a user input by the image input apparatus
- a face coordinate calculator for calculating a face coordinate loading unit and a position at which the user moves
- An AAM Active Appearance Models
- a three-dimensional object loading unit loading and overlapping the three-dimensional object on the face image of the user to which the polygon is applied;
- An image storage unit storing the overlapped 3D object and a user image
- an image output unit configured to output a 3D object and a user image stored in the storage unit.
- the photographic apparatus for providing a 3D object according to the above feature may further include a 3D object DB for providing a 3D object for loading through the 3D object loading unit.
- the photographic apparatus for providing a 3D object may further include an email transmission unit configured to transmit an email as a 3D object stored in the image storage unit and a user image.
- the image storage unit In the photographic apparatus for providing a 3D object according to the feature, the image storage unit generates and stores a bitmap image of the overlapped 3D object and the user image.
- the photographic apparatus for providing a 3D object may include a soft copy output unit and a hard copy output unit configured to output a 3D object and a user image stored in the storage unit.
- a method of providing a 3D object of a photographic apparatus comprising: a first step of inputting a face image of a user through an image input apparatus;
- the preprocessing of the second step may include converting a face image of the user input into a contrast image and converting the image converted into the contrast image into a binary image; Characterized in that made.
- the method of providing a 3D object of the photographic apparatus according to the above aspect may further include correcting the position coordinates of the eye, nose, mouth, and face contour after the third step.
- the method of providing a 3D object of the photographing apparatus according to the above aspect is characterized in that the position and angle of the face are changed by applying the polygon of the sixth step.
- the method of providing a 3D object of the photographic apparatus according to the above feature may include storing the 3D object image overlapped with the face image of the user as a bitmap image in the eighth step.
- the present invention has the effect of overlapping the three-dimensional object on the user's face image to give a sense of reality as actually worn by moving the three-dimensional object as the user moves.
- the present invention has the advantage that the user does not have to adjust the size of the three-dimensional object is overlapped by the face coordinates.
- FIG. 1 is a block diagram showing the configuration of a photographic apparatus for providing a three-dimensional object according to the present invention.
- FIG. 2 is a block diagram illustrating an image storage unit and an image output unit of a photographic apparatus for providing a 3D object according to the present invention.
- FIG. 3 is a flowchart illustrating a 3D object providing method of a photo device according to the present invention.
- FIG. 4 is a view showing a state in which a polygon is applied to a face image of a user in a method of providing a 3D object of a photo device according to the present invention.
- FIG. 5 is a view showing the result obtained by the photographic apparatus for providing a three-dimensional object according to the present invention.
- AAM module 210 position coordinate detection unit
- AAM adaptation unit 340 3D object loading unit
- bitmap image generator 413 bitmap image storage unit
- FIG. 1 is a block diagram showing a configuration of a photographic apparatus for providing a 3D object according to the present invention
- Figure 2 is a block diagram showing an image storage unit and an image output unit of a photographic apparatus for providing a 3D object according to the present invention.
- a photographic apparatus for providing a 3D object may include an image input apparatus 110, a preprocessor 120, a position coordinate detector 210, and a position coordinate beam.
- the government 220 the position coordinate storage unit 230, the position coordinate loading unit 310, the position coordinate calculation unit 320, the AAM adaptor 330, the three-dimensional object loading unit 340, three-dimensional object DB ( 350, the rendering unit 360, the image storage unit 410, and the image output unit 420.
- the image input device 110 inputs a face image of the user in real time.
- the image input device 110 refers to a device capable of inputting an image, such as a CCD camera and a CMOS camera, and is not limited to the above-described CCD camera and CMOS camera.
- the preprocessor 120 converts a face image of the user input through the image input device 110 into a binary image.
- the preprocessor 120 converts the input image into a binary image to facilitate detection of position coordinates of the input face image of the user.
- the position coordinate detector 210 detects the position coordinates of the eyes, nose, mouth, and face contour in the face image of the user converted into the binary image.
- the position coordinate corrector 220 corrects the coordinates detected by the face coordinate detector 210.
- the position coordinate detector 210 and the position coordinate corrector 220 are included in the AAM module and detect the position coordinates of the eyes, nose, mouth and face contour in the face image of the user by the AAM algorithm.
- the position coordinate storage unit 230 stores face coordinates corrected by the position coordinate correcting unit 220.
- the position coordinate loading unit 310 loads face coordinates in the face image of the user input from the image input apparatus 110.
- the position coordinate calculator 320 calculates a position at which the face coordinate loading unit 310 and the user move.
- the AAM adaptor 330 applies a polygon based on the coordinates detected in the face image of the user.
- the 3D object loading unit 340 loads and overlaps the 3D object on the face image of the user to which the polygon is applied. At this time, by overlapping the three-dimensional object on the user's face image, the user's face overlapped with the three-dimensional object is expressed as wearing a character mask.
- the 3D object DB 350 provides a 3D object for loading through the 3D object loading unit 310.
- the 3D object DB is stored including a variety of characters.
- the rendering unit 360 renders the 3D object overlapped with the face image of the user.
- rendering means that the angle and direction of the overlapping 3D object according to the movement of the user's face also move together with the movement of the user's face.
- the image storage unit 410 stores the overlapped 3D object and the user image.
- the image storage unit 410 may include a storage coordinate checking unit 411 for checking image storage coordinates, a bitmap image generator 412 for generating a face image of the user and an overlapping three-dimensional object as a bitmap; And a bitmap image storage unit 413 for storing a face image of the bitmapped user and an overlapping three-dimensional object generated by the bitmap image generator.
- the image output unit 420 outputs the 3D object and the user face image stored in the image storage unit 410.
- the image output unit 420 is an email transmission unit 421 for transmitting an email to the three-dimensional object and the user image stored in the image storage unit 410, and the three-dimensional object and the user image stored in the image storage unit And a hard copy output unit 422 and a soft copy output unit 423 for outputting.
- FIG. 3 is a flowchart illustrating a 3D object providing method of a photo device according to the present invention
- FIG. 4 is a view illustrating a polygon applied to a face image of a user in the 3D object providing method of the photo device according to the present invention.
- a face image of the user is input through the image input device (S510).
- the face image of the user is preprocessed (S520).
- the preprocessing converts the input face image of the user into a contrast image, and converts the image converted to the contrast image to a binary image.
- the position coordinates of the eyes, nose, mouth, and face contour are detected and stored in the face image of the user (S530).
- the position coordinates of the eyes, nose, mouth, and face contour may be changed in the face image of the user, and thus the position coordinates of the eyes, nose, mouth, and face contour may be corrected again.
- face image motion information of the user which is input for each frame through the image input apparatus, is obtained (S540).
- face image motion information of the user which is input for each frame through the image input apparatus, is obtained (S540).
- the position coordinates are loaded and calculated from the face image of the user moving for each frame (S550).
- the position coordinates are calculated in the face image of the user.
- a polygon is applied to the face image of the user whose position coordinate is calculated (S560).
- the position and angle of the face may be changed by tracking with a polygon applied to the face image of the user.
- the 3D object is overlapped and rendered on the face image of the user to which the polygon is applied (S570).
- the 3D object overlapped with the face image of the user is stored and output (S580).
- the 3D object image overlapped with the face image of the user is generated and stored as a bitmap image.
- FIG. 5 is a view showing the result obtained by the photographic apparatus for providing a three-dimensional object according to the present invention.
- a drawing photographed using an embodiment of the present invention overlaps a 3D object to a user in the real world, so that the 3D object is worn by a real user regardless of the direction in which the user looks. You can see the same movement.
- the sticker photo device is a device that outputs a picture of a user input by an image input device in the form of a sticker. Furthermore, various two-dimensional objects have been provided so that the user can decorate and decorate the surroundings of the photographed picture. Due to the lack of development, domestic and exports are decreasing, and new technological introduction is urgently needed.
- the conventional sticker photo device has a problem in that a user needs to directly adjust the size of the two-dimensional object by providing a two-dimensional object, and the conventional sticker photo device is formed in two dimensions and has a disadvantage in reality.
- the 3D object is overlaid on the user's face image, so that the 3D object moves as the user moves and gives a realistic feeling as if the user wears the present invention.
- the advantage is that you do not have to resize the object.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Artificial Intelligence (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to a photography apparatus and to a method for providing a 3D object, and more particularly, to a photography apparatus and to a method for providing a 3D object, wherein the photography apparatus comprises: an image input device for receiving an input of a facial image of a user in real time; a preprocessing unit for converting the inputted facial image of the user into a binary image; a face coordinate extraction unit for extracting coordinates of the eyes, nose, mouth, and facial contour from the facial image of the user converted into the binary image; a position coordinate compensation unit for compensating for the coordinates extracted by the face coordinate extraction unit; a position coordinate storage unit for storing the facial coordinates compensated for by the position coordinate compensation unit; a position coordinate loading unit for loading the facial coordinates in the facial image of the user inputted from the image input apparatus; a facial coordinate calculation unit for calculating, with the facial coordinate loading unit, a position to which the user moves; an AAM adaptation unit for applying a polygon by means of the coordinates extracted from the facial image of the user; a 3D object loading unit for loading and overlapping a 3D object on the facial image of the user with the applied polygon; a rendering unit for rendering the 3D object overlapped on the facial image of the user; an image storage unit for storing the overlapped 3D object and a user image; and an image output unit for outputting the 3D object and the user image stored in the image storage unit.
Description
본 발명은 3차원 객체의 캐리커쳐를 사용자 얼굴영상에 오버래핑하여 제공하는 3차원 객체를 제공하는 사진 장치 및 그 제공 방법에 관한 것이다.The present invention relates to a photographic apparatus for providing a three-dimensional object for providing a caricature of the three-dimensional object by overlapping the user face image and a method of providing the same.
일반적으로 스티커 사진 장치는 영상 입력 장치에 의해 입력되는 사용자의 사진을 스티커 형식으로 출력해주는 장치로써, 더 나아가 사용자가 촬영된 사진 주변을 장식하고 꾸밀 수 있도록 다양한 2차원 객체를 제공되어 왔다.In general, a sticker photographing device is a device for outputting a photograph of a user input by an image input device in the form of a sticker. Furthermore, various two-dimensional objects have been provided to decorate and decorate the surroundings of the photographed photograph.
그러나, 종래의 스티커 사진 장치는 2차원 객체를 제공하여 사용자가 직접 2차원 객체의 크기 조절을 해야하는 번거로움이 있다. However, the conventional sticker photo device provides a two-dimensional object, and the user has to manually adjust the size of the two-dimensional object.
또한, 종래의 스티커 사진 장치는 2차원으로 형성되어 현실감에 떨어지는 단점이 있다. In addition, the conventional sticker photo device is formed in two dimensions has a disadvantage that falls in reality.
또한, 스티커 사진 장치의 발전이 미비하여 내수 및 수출을 감소하고 있는 추세여서 새로운 기술적 도입이 절실히 필요하다. In addition, since the development of the sticker photo device is insufficient, the domestic and export trends are declining. Therefore, a new technical introduction is urgently needed.
본 발명이 해결하고자 하는 기술적 과제는 움직이는 현실 모습에 있는 사용자의 얼굴영상에 3차원 객체를 오버래핑하는 3차원 객체를 제공하는 사진 장치 및 그 제공 방법이다.The technical problem to be solved by the present invention is a photographic apparatus and a method for providing a three-dimensional object that overlaps the three-dimensional object in the face image of the user in the moving reality.
또한, 본 발명이 해결하고자 하는 기술적 과제는 다양한 3차원 객체를 실시간으로 자신의 얼굴에 적용시켜 현실 세계와 가상 세계가 사용자의 움직임에 따라 같이 움직이는 3차원 객체를 제공하는 스티커 사진 장치 및 그 제공 방법이다. In addition, the technical problem to be solved by the present invention is a sticker photo device and a method for providing a three-dimensional object moving in accordance with the user's movement by applying a variety of three-dimensional objects to their faces in real time to be.
본 발명의 한 특징에 따른 3차원 객체를 제공하는 사진 장치는 실시간으로 사용자의 얼굴영상을 입력 받는 영상 입력 장치와;According to an aspect of the present invention, a photographic apparatus for providing a 3D object includes: an image input device configured to receive a face image of a user in real time;
상기 입력된 사용자의 얼굴영상을 이진영상으로 변환하는 전처리부와;A preprocessing unit converting the input face image of the user into a binary image;
상기 이진 영상으로 변환된 사용자의 얼굴영상에서 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 검출하는 위치 좌표 검출부와;A position coordinate detector for detecting position coordinates of an eye, nose, mouth, and face contour in a face image of the user converted into the binary image;
상기 얼굴 좌표 검출부에서 검출된 좌표를 보정하는 위치 좌표 보정부와;A position coordinate corrector for correcting the coordinates detected by the face coordinate detector;
상기 위치 좌표 보정부에서 보정된 얼굴 좌표를 저장하는 위치 좌표 저장부와;A position coordinate storage unit for storing face coordinates corrected by the position coordinate corrector;
상기 영상 입력 장치에서 입력되는 사용자의 얼굴영상에 얼굴 좌표를 로딩하는 위치 좌표 로딩부와;A position coordinate loading unit for loading face coordinates into a face image of a user input by the image input apparatus;
상기 얼굴 좌표 로딩부와 사용자가 움직이는 위치를 계산하는 얼굴 좌표 계산부와;A face coordinate calculator for calculating a face coordinate loading unit and a position at which the user moves;
상기 사용자의 얼굴영상에 검출된 좌표에 의해 폴리곤을 적용하는 AAM(Active Appearance Models) 적응부와;An AAM (Active Appearance Models) adaptor adapted to apply polygons by the coordinates detected in the face image of the user;
상기 폴리곤을 적용한 사용자의 얼굴영상에 3차원 객체를 로딩하여 오버래핑하는 3차원 객체 로딩부와;A three-dimensional object loading unit loading and overlapping the three-dimensional object on the face image of the user to which the polygon is applied;
상기 사용자의 얼굴영상에 오버래핑한 3차원 객체를 랜더링하는 랜더링부와;A rendering unit for rendering the 3D object overlapped with the face image of the user;
상기 오버래핑된 3차원 객체 및 사용자 영상을 저장하는 이미지 저장부; 및 An image storage unit storing the overlapped 3D object and a user image; And
상기 저장부에 저장된 3차원 객체 및 사용자 영상을 출력하는 이미지 출력부;로 구성하는 것을 특징으로 한다.And an image output unit configured to output a 3D object and a user image stored in the storage unit.
상기 특징에 따른 3차원 객체를 제공하는 사진 장치는 상기 3차원 객체 로딩부를 통해 로딩하기 위해 3차원 객체를 제공하는 3차원 객체DB를 더 포함하여 구성하는 것을 특징으로 한다.The photographic apparatus for providing a 3D object according to the above feature may further include a 3D object DB for providing a 3D object for loading through the 3D object loading unit.
상기 특징에 따른 3차원 객체를 제공하는 사진 장치는 상기 이미지 저장부에 저장된 3차원 객체 및 사용자 영상으로 이메일로 전달하는 이메일 전송부를 더 포함하여 구성하는 것을 특징으로 한다.The photographic apparatus for providing a 3D object according to the above feature may further include an email transmission unit configured to transmit an email as a 3D object stored in the image storage unit and a user image.
상기 특징에 따른 3차원 객체를 제공하는 사진 장치는 상기 이미지 저장부는 오버래핑된 3차원 객체 및 사용자 영상을 비트맵(Bitmap)이미지를 생성하여 저장하는 것을 특징으로 한다.In the photographic apparatus for providing a 3D object according to the feature, the image storage unit generates and stores a bitmap image of the overlapped 3D object and the user image.
상기 특징에 따른 3차원 객체를 제공하는 사진 장치는 상기 이미지 출력부는 저장부에 저장된 3차원 객체 및 사용자 영상을 출력하는 소프트 카피 출력부 및 하드 카피 출력부를 포함하는 것을 특징으로 한다.The photographic apparatus for providing a 3D object according to the above features may include a soft copy output unit and a hard copy output unit configured to output a 3D object and a user image stored in the storage unit.
본 발명의 또 다른 특징에 따른 사진 장치의 3차원 객체 제공방법은 영상 입력 장치를 통해 사용자의 얼굴영상을 입력하는 제1 단계와;According to still another aspect of the present invention, there is provided a method of providing a 3D object of a photographic apparatus, comprising: a first step of inputting a face image of a user through an image input apparatus;
상기 사용자의 얼굴영상을 전처리하는 제2 단계와;A second step of preprocessing the face image of the user;
상기 사용자의 얼굴영상에서 눈, 코, 입, 얼굴 윤곽의 위치 좌표를 검출하여 저장하는 제3 단계와;A third step of detecting and storing position coordinates of an eye, a nose, a mouth, and a face contour in the face image of the user;
상기 영상 입력 장치를 통해 프레임별로 입력되는 사용자의 얼굴영상 모션정보를 얻는 제4 단계와;Obtaining a face image motion information of a user input for each frame through the image input device;
상기 프레임별로 움직이는 사용자의 얼굴영상에서 위치 좌표를 로딩하여 계산하는 제5 단계와;A fifth step of loading and calculating position coordinates from a face image of the user moving for each frame;
상기 위치 좌표가 계산되는 사용자의 얼굴영상에 폴리곤을 적용하는 제6 단계와;Applying a polygon to a face image of a user whose position coordinates are calculated;
상기 폴리곤을 적용한 사용자의 얼굴영상에 3차원 객체를 오버래핑하여 랜더링하는 제7 단계; 및 A seventh step of overlapping and rendering a 3D object on the face image of the user to which the polygon is applied; And
상기 사용자의 얼굴영상과 오버래핑된 3차원 객체를 저장하고 출력하는 제8 단계;로 이루어지는 것을 특징으로 한다.And an eighth step of storing and outputting the 3D object overlapped with the face image of the user.
상기 특징에 따른 사진 장치의 3차원 객체 제공방법은 상기 제2 단계의 전처리는 입력 받은 사용자의 얼굴영상을 명암 영상으로 변환하는 단계 및 상기 명암 영상으로 변환한 영상을 이진 영상으로 변환하는 단계;로 이루어지는 것을 특징으로 한다.In the method of providing a 3D object of a photographic apparatus according to the above feature, the preprocessing of the second step may include converting a face image of the user input into a contrast image and converting the image converted into the contrast image into a binary image; Characterized in that made.
상기 특징에 따른 사진 장치의 3차원 객체 제공방법은 상기 제3 단계 이후에 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 보정하는 단계를 더 포함하는 것을 특징으로 한다.The method of providing a 3D object of the photographic apparatus according to the above aspect may further include correcting the position coordinates of the eye, nose, mouth, and face contour after the third step.
상기 특징에 따른 사진 장치의 3차원 객체 제공방법은 상기 제6 단계의 폴리곤 적용으로 얼굴의 위치 및 각도를 변경하는 것을 특징으로 한다.The method of providing a 3D object of the photographing apparatus according to the above aspect is characterized in that the position and angle of the face are changed by applying the polygon of the sixth step.
상기 특징에 따른 사진 장치의 3차원 객체 제공방법은 상기 제8 단계에서 사용자의 얼굴영상과 오버래핑된 3차원 객체 영상을 비트맵 이미지로 저장하는 것을 특징으로 한다.The method of providing a 3D object of the photographic apparatus according to the above feature may include storing the 3D object image overlapped with the face image of the user as a bitmap image in the eighth step.
이러한 본 발명의 특징에 따르면, According to this feature of the invention,
본 발명은 사용자 얼굴영상에 3차원 객체를 오버래핑하여 사용자가 움직이는 대로 3차원 객체가 움직여 실제로 착용한 것과 같은 현실감을 주는 효과가 있다. The present invention has the effect of overlapping the three-dimensional object on the user's face image to give a sense of reality as actually worn by moving the three-dimensional object as the user moves.
또한, 본 발명은 얼굴 좌표에 의해 3차원 객체가 오버래핑되어 사용자가 객체의 크기를 조절하지 않아도 되는 장점이 있다.In addition, the present invention has the advantage that the user does not have to adjust the size of the three-dimensional object is overlapped by the face coordinates.
도 1은 본 발명에 따른 3차원 객체를 제공하는 사진 장치의 구성을 나타낸 블럭도이다. 1 is a block diagram showing the configuration of a photographic apparatus for providing a three-dimensional object according to the present invention.
도 2는 본 발명에 따른 3차원 객체를 제공하는 사진 장치의 이미지 저장부 및 이미지 출력부를 나타낸 블록도이다. 2 is a block diagram illustrating an image storage unit and an image output unit of a photographic apparatus for providing a 3D object according to the present invention.
도 3은 본 발명에 따른 사진 장치의 3차원 객체 제공방법을 나타낸 흐름도이다.3 is a flowchart illustrating a 3D object providing method of a photo device according to the present invention.
도 4는 본 발명에 따른 사진 장치의 3차원 객체 제공방법에서 사용자의 얼굴영상에 폴리곤을 적용한 모습을 나타낸 도면이다. 4 is a view showing a state in which a polygon is applied to a face image of a user in a method of providing a 3D object of a photo device according to the present invention.
도 5는 본 발명에 따른 3차원 객체를 제공하는 사진장치에 의해 얻어진 결과물을 나타낸 도면이다. 5 is a view showing the result obtained by the photographic apparatus for providing a three-dimensional object according to the present invention.
<도면의 주요부분에 대한 부호의 설명><Description of the symbols for the main parts of the drawings>
110 : 영상 입력 장치 120 : 전처리부110: image input device 120: preprocessor
200 : AAM 모듈 210 : 위치 좌표 검출부200: AAM module 210: position coordinate detection unit
220 : 위치 좌표 보정부 230 : 위치 좌표 저장부220: position coordinate correction unit 230: position coordinate storage unit
310 : 위치 좌표 로딩부 320 : 위치 좌표 계산부310: position coordinate loading unit 320: position coordinate calculation unit
330 : AAM 적응부 340 : 3차원 객체 로딩부330: AAM adaptation unit 340: 3D object loading unit
350 : 3차원 객체 DB 360 : 랜더링부350: three-dimensional object DB 360: rendering unit
410 : 이미지 저장부 411 : 저장 좌표 확인부410: image storage unit 411: storage coordinate check unit
412 : 비트맵 이미지 생성부 413 : 비트맵 이미지 저장부412: bitmap image generator 413: bitmap image storage unit
420 : 이미지 출력부 421 : 이메일 전송부420: Image output unit 421: Email transmission unit
422 : 하드카피 출력부 423 : 소프트카피 출력부422: hard copy output unit 423: soft copy output unit
이하, 본 발명의 바람직한 실시 예를 첨부한 도면을 참고로 하여 상세하게 설명한다.Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail.
도 1은 본 발명에 따른 3차원 객체를 제공하는 사진 장치의 구성을 나타낸 블록도이고, 도 2는 본 발명에 따른 3차원 객체를 제공하는 사진 장치의 이미지 저장부 및 이미지 출력부를 나타낸 블록도이다. 1 is a block diagram showing a configuration of a photographic apparatus for providing a 3D object according to the present invention, Figure 2 is a block diagram showing an image storage unit and an image output unit of a photographic apparatus for providing a 3D object according to the present invention. .
도 1 및 도 2에 도시한 바와 같이, 본 발명의 실시 예에 따른 3차원 객체를 제공하는 사진 장치는 영상 입력 장치(110), 전처리부(120), 위치 좌표 검출부(210), 위치 좌표 보정부(220), 위치 좌표 저장부(230), 위치 좌표 로딩부(310), 위치 좌표 계산부(320), AAM 적응부(330), 3차원 객체 로딩부(340), 3차원 객체 DB(350), 랜더링부(360), 이미지 저장부(410), 및 이미지 출력부(420)로 구성한다. As shown in FIG. 1 and FIG. 2, a photographic apparatus for providing a 3D object according to an exemplary embodiment of the present invention may include an image input apparatus 110, a preprocessor 120, a position coordinate detector 210, and a position coordinate beam. The government 220, the position coordinate storage unit 230, the position coordinate loading unit 310, the position coordinate calculation unit 320, the AAM adaptor 330, the three-dimensional object loading unit 340, three-dimensional object DB ( 350, the rendering unit 360, the image storage unit 410, and the image output unit 420.
여기서, 영상 입력 장치(110)는 실시간으로 사용자의 얼굴영상을 입력한다. 이때, 상기 영상 입력 장치(110)은 CCD 카메라 및 CMOS 카메라와 같이 영상을 입력할 수 있는 장치를 의미하며, 이에 상기에서 언급한 CCD 카메라 및 CMOS 카메라에만 한정하지 아니한다. Here, the image input device 110 inputs a face image of the user in real time. In this case, the image input device 110 refers to a device capable of inputting an image, such as a CCD camera and a CMOS camera, and is not limited to the above-described CCD camera and CMOS camera.
여기서, 전처리부(120)는 상기 영상 입력 장치(110)를 통해 입력된 사용자의 얼굴영상을 이진 영상으로 변환한다. 이때 상기 전처리부(120)은 입력된 사용자의 얼굴영상의 위치 좌표 검출을 용이하게 하도록 이진 영상으로 변환한다. Here, the preprocessor 120 converts a face image of the user input through the image input device 110 into a binary image. In this case, the preprocessor 120 converts the input image into a binary image to facilitate detection of position coordinates of the input face image of the user.
여기서, 위치 좌표 검출부(210)는 상기 이진 영상으로 변환된 사용자의 얼굴영상에서 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 검출한다. Here, the position coordinate detector 210 detects the position coordinates of the eyes, nose, mouth, and face contour in the face image of the user converted into the binary image.
여기서, 위치 좌표 보정부(220)는 상기 얼굴 좌표 검출부(210)에서 검출된 좌표를 보정한다. 이때, 상기 위치 좌표 검출부(210) 및 위치 좌표 보정부(220)은 AAM 모듈에 포함되며, AAM 알고리즘에 의해 사용자의 얼굴영상에서 눈, 코, 입 및 얼굴 윤곽의 위치좌표를 검출한다. Here, the position coordinate corrector 220 corrects the coordinates detected by the face coordinate detector 210. In this case, the position coordinate detector 210 and the position coordinate corrector 220 are included in the AAM module and detect the position coordinates of the eyes, nose, mouth and face contour in the face image of the user by the AAM algorithm.
여기서, 위치 좌표 저장부(230)는 상기 위치 좌표 보정부(220)에서 보정된 얼굴 좌표를 저장한다.Here, the position coordinate storage unit 230 stores face coordinates corrected by the position coordinate correcting unit 220.
여기서, 위치 좌표 로딩부(310)는 상기 영상 입력 장치(110)에서 입력되는 사용자의 얼굴영상에 얼굴 좌표를 로딩한다.Here, the position coordinate loading unit 310 loads face coordinates in the face image of the user input from the image input apparatus 110.
여기서, 위치 좌표 계산부(320)는 상기 얼굴 좌표 로딩부(310)와 사용자가 움직이는 위치를 계산한다.Here, the position coordinate calculator 320 calculates a position at which the face coordinate loading unit 310 and the user move.
여기서, AAM 적응부(330)는 상기 사용자의 얼굴영상에 검출된 좌표에 의해 폴리곤을 적용한다. Here, the AAM adaptor 330 applies a polygon based on the coordinates detected in the face image of the user.
여기서, 3차원 객체 로딩부(340)는 상기 폴리곤을 적용한 사용자의 얼굴영상에 3차원 객체를 로딩하여 오버래핑한다. 이때, 3차원 객체를 사용자의 얼굴영상에 오버래핑하여, 3차원 객체가 오버래핑된 사용자의 얼굴은 캐릭터 마스크를 착용한 것과 같이 표현된다. Here, the 3D object loading unit 340 loads and overlaps the 3D object on the face image of the user to which the polygon is applied. At this time, by overlapping the three-dimensional object on the user's face image, the user's face overlapped with the three-dimensional object is expressed as wearing a character mask.
여기서, 3차원 객체 DB(350)는 상기 3차원 객체 로딩부(310)를 통해 로딩하기 위해 3차원 객체를 제공한다. 이때, 상기 3차원 객체 DB는 다양한 캐릭터를 포함하여 저장한다. Here, the 3D object DB 350 provides a 3D object for loading through the 3D object loading unit 310. At this time, the 3D object DB is stored including a variety of characters.
여기서, 랜더링부(360)는 상기 사용자의 얼굴영상에 오버래핑한 3차원 객체를 랜더링한다. 이때, 랜더링이란 사용자의 얼굴 움직임에 따라 오버래핑된 3차원 객체가 보이는 각도 및 방향 역시 사용자의 얼굴이 움직임에 따라 도 함께 움직이는 것을 의미 한다. Here, the rendering unit 360 renders the 3D object overlapped with the face image of the user. In this case, rendering means that the angle and direction of the overlapping 3D object according to the movement of the user's face also move together with the movement of the user's face.
여기서, 이미지 저장부(410)는 상기 오버래핑된 3차원 객체 및 사용자 영상을 저장한다. 이때, 상기 이미지 저장부(410)는 이미지 저장 좌표를 확인하는 저장좌표 확인부(411)와, 사용자의 얼굴영상 및 오버래핑한 3차원 객체를 비트맵으로 생성하는 비트맵 이미지 생성부(412)와, 상기 비트맵 이미지 생성부에서 생성한 비트맵화된 사용자의 얼굴영상 및 오버래핑한 3차원 객체를 저장하는 비트맵 이미지 저장부(413)를 포함한다. Here, the image storage unit 410 stores the overlapped 3D object and the user image. The image storage unit 410 may include a storage coordinate checking unit 411 for checking image storage coordinates, a bitmap image generator 412 for generating a face image of the user and an overlapping three-dimensional object as a bitmap; And a bitmap image storage unit 413 for storing a face image of the bitmapped user and an overlapping three-dimensional object generated by the bitmap image generator.
여기서, 이미지 출력부(420)는 상기 이미지 저장부(410)에 저장된 3차원 객체 및 사용자 얼굴영상을 출력한다. Here, the image output unit 420 outputs the 3D object and the user face image stored in the image storage unit 410.
이때, 상기 이미지 출력부(420)는 상기 이미지 저장부(410)에 저장된 3차원 객체 및 사용자 영상으로 이메일로 전달하는 이메일 전송부(421)와, 이미지 저장부에 저장된 3차원 객체 및 사용자 영상을 출력하는 하드 카피 출력부(422) 및 소프트 카피 출력부(423)를 포함한다. At this time, the image output unit 420 is an email transmission unit 421 for transmitting an email to the three-dimensional object and the user image stored in the image storage unit 410, and the three-dimensional object and the user image stored in the image storage unit And a hard copy output unit 422 and a soft copy output unit 423 for outputting.
도 3은 본 발명에 따른 사진 장치의 3차원 객체 제공방법을 나타낸 흐름도이고, 도 4는 본 발명에 따른 사진 장치의 3차원 객체 제공방법에서 사용자의 얼굴영상에 폴리곤을 적용한 모습을 나타낸 도면이다. 3 is a flowchart illustrating a 3D object providing method of a photo device according to the present invention, and FIG. 4 is a view illustrating a polygon applied to a face image of a user in the 3D object providing method of the photo device according to the present invention.
도3 및 도 4에 도시한 바와 같이, 본 발명의 실시 예에 따른 사진장치의 3차원 객체 제공방법은 먼저, 영상 입력 장치를 통해 사용자의 얼굴영상을 입력한다(S510). 3 and 4, in the method for providing a 3D object in the photo device according to the embodiment of the present invention, first, a face image of the user is input through the image input device (S510).
이어서, 상기 사용자의 얼굴영상을 전처리 한다(S520). 이때, 상기 전처리는 입력 받은 사용자의 얼굴영상을 명암 영상으로 변환하고, 상기 명암 영상으로 변환한 영상을 이진 영상으로 변환한다. Subsequently, the face image of the user is preprocessed (S520). In this case, the preprocessing converts the input face image of the user into a contrast image, and converts the image converted to the contrast image to a binary image.
이어서, 상기 사용자의 얼굴영상에서 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 검출하여 저장한다(S530). 이때, 사용자의 얼굴영상에서 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표가 바뀔수 있어 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 다시 보정할 수 있다. Subsequently, the position coordinates of the eyes, nose, mouth, and face contour are detected and stored in the face image of the user (S530). In this case, the position coordinates of the eyes, nose, mouth, and face contour may be changed in the face image of the user, and thus the position coordinates of the eyes, nose, mouth, and face contour may be corrected again.
이어서, 상기 영상 입력 장치를 통해 프레임별로 입력되는 사용자의 얼굴영상 모션정보를 얻는다(S540). 이때, 사용자 얼굴영상의 모션정보를 얻음으로써 사용자의 움직임에 따라 3차원 객체의 움직임을 이용하게 한다. Subsequently, face image motion information of the user, which is input for each frame through the image input apparatus, is obtained (S540). At this time, by obtaining the motion information of the user's face image to use the movement of the three-dimensional object in accordance with the user's movement.
이어서, 상기 프레임별로 움직이는 사용자의 얼굴영상에서 위치 좌표를 로딩하여 계산한다(S550). 이때, 사용자의 얼굴영상의 움직임에 따라 3차원 객체가 동시에 움직여야 하기 때문에 사용자의 얼굴영상에 위치 좌표를 계산한다. Subsequently, the position coordinates are loaded and calculated from the face image of the user moving for each frame (S550). In this case, since the 3D object must move simultaneously according to the movement of the face image of the user, the position coordinates are calculated in the face image of the user.
이어서, 상기 위치 좌표가 계산되는 사용자의 얼굴영상에 폴리곤을 적용 한다(S560). 이때, 상기 사용자의 얼굴영상에 적용된 폴리곤(Polygon)으로 트래킹하여 얼굴의 위치 및 각도를 변경할 수 있다. Subsequently, a polygon is applied to the face image of the user whose position coordinate is calculated (S560). At this time, the position and angle of the face may be changed by tracking with a polygon applied to the face image of the user.
이어서, 상기 폴리곤을 적용한 사용자의 얼굴영상에 3차원 객체를 오버래핑(Overlapping)하여 랜더링한다(S570).Subsequently, the 3D object is overlapped and rendered on the face image of the user to which the polygon is applied (S570).
마지막으로, 상기 사용자의 얼굴영상과 오버래핑된 3차원 객체를 저장하고 출력한다(S580). 이때, 상기 사용자의 얼굴영상과 오버래핑된 3차원 객체 영상을 비트맵 이미지로 생성하여 저장한다. Finally, the 3D object overlapped with the face image of the user is stored and output (S580). At this time, the 3D object image overlapped with the face image of the user is generated and stored as a bitmap image.
도 5는 본 발명에 따른 3차원 객체를 제공하는 사진장치에 의해 얻어진 결과물을 나타낸 도면이다.5 is a view showing the result obtained by the photographic apparatus for providing a three-dimensional object according to the present invention.
도 5에 도시한 바와 같이, 본 발명의 실시 예를 이용하여 촬영된 도면은 3차원 객체를 현실 세계에 있는 사용자에게 오버래핑하여, 사용자가 바라보는 방향과 무관하게 3차원 객체는 실제 사용자가 착용한 것과 동일하게 움직이는 모습을 알 수 있다. As shown in FIG. 5, a drawing photographed using an embodiment of the present invention overlaps a 3D object to a user in the real world, so that the 3D object is worn by a real user regardless of the direction in which the user looks. You can see the same movement.
이상에서 설명한 바와 같이, 본 발명의 상세한 설명에서는 본 발명의 바람직한 실시 예에 관하여 설명하였으나, 본 발명이 속하는 기술분야에서 통상의 지식을 가진 자라면 본 발명의 범주에서 벗어나지 않는 한도 내에서 여러 가지 변형이 가능함은 물론이다. 따라서 본 발명의 권리 범위는 설명된 실시 예에 국한되어 정해져서는 안되며, 후술하는 청구범위뿐만 아니라, 이와 균등한 것들에 의해 정해져야 한다.As described above, in the detailed description of the present invention has been described with respect to preferred embodiments of the present invention, those skilled in the art to which the present invention pertains various modifications without departing from the scope of the present invention Of course this is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents thereof, as well as the following claims.
스티커 사진 장치는 영상 입력 장치에 의해 입력되는 사용자의 사진을 스티커 형식으로 출력해주는 장치로써, 더 나아가 사용자가 촬영된 사진 주변을 장식하고 꾸밀 수 있도록 다양한 2차원 객체를 제공되어 왔으나, 스티커 사진 장치의 발전이 미비하여 내수 및 수출을 감소하고 있는 추세여서 새로운 기술적 도입이 절실히 필요하다.The sticker photo device is a device that outputs a picture of a user input by an image input device in the form of a sticker. Furthermore, various two-dimensional objects have been provided so that the user can decorate and decorate the surroundings of the photographed picture. Due to the lack of development, domestic and exports are decreasing, and new technological introduction is urgently needed.
가령, 종래의 스티커 사진 장치는 2차원 객체를 제공하여 사용자가 직접 2차원 객체의 크기 조절을 해야하는 번거로움이 있으며, 또한, 종래의 스티커 사진 장치는 2차원으로 형성되어 현실감에 떨어지는 단점이 있다. For example, the conventional sticker photo device has a problem in that a user needs to directly adjust the size of the two-dimensional object by providing a two-dimensional object, and the conventional sticker photo device is formed in two dimensions and has a disadvantage in reality.
이러한 면에서, 사용자 얼굴영상에 3차원 객체를 오버래핑하여 사용자가 움직이는 대로 3차원 객체가 움직여 실제로 착용한 것과 같은 현실감을 주는 효과가 있으며, 본 발명은 얼굴 좌표에 의해 3차원 객체가 오버래핑되어 사용자가 객체의 크기를 조절하지 않아도 되는 장점이 있다.In this respect, the 3D object is overlaid on the user's face image, so that the 3D object moves as the user moves and gives a realistic feeling as if the user wears the present invention. The advantage is that you do not have to resize the object.
이와 같이, 스티커 사진 장치에 3차원 객체를 도입하여 더욱 현실감있는 영상 기술을 제공함으로써 스티커 사진 장치의 내수 및 수출을 증대시킬수 있는 기대를 높일 수 있는 측면에서 필요한 발명이라고 할 수 있습니다.As such, it is a necessary invention in terms of raising expectations for increasing domestic and export of sticker photographic devices by providing more realistic imaging technology by introducing three-dimensional objects into sticker photographic devices.
Claims (10)
- 실시간으로 사용자의 얼굴영상을 입력 받는 영상 입력 장치와;An image input device for receiving a face image of a user in real time;상기 입력된 사용자의 얼굴영상을 이진영상으로 변환하는 전처리부와;A preprocessing unit converting the input face image of the user into a binary image;상기 이진 영상으로 변환된 사용자의 얼굴영상에서 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 검출하는 위치 좌표 검출부와;A position coordinate detector for detecting position coordinates of an eye, nose, mouth, and face contour in a face image of the user converted into the binary image;상기 얼굴 좌표 검출부에서 검출된 좌표를 보정하는 위치 좌표 보정부와;A position coordinate corrector for correcting the coordinates detected by the face coordinate detector;상기 위치 좌표 보정부에서 보정된 얼굴 좌표를 저장하는 위치 좌표 저장부와;A position coordinate storage unit for storing face coordinates corrected by the position coordinate corrector;상기 영상 입력 장치에서 입력되는 사용자의 얼굴영상에 얼굴 좌표를 로딩하는 위치 좌표 로딩부와;A position coordinate loading unit for loading face coordinates into a face image of a user input by the image input apparatus;상기 얼굴 좌표 로딩부와 사용자가 움직이는 위치를 계산하는 얼굴 좌표 계산부와;A face coordinate calculator to calculate a face coordinate loading unit and a position at which the user moves;상기 사용자의 얼굴영상에 검출된 좌표에 의해 폴리곤을 적용하는 AAM(Active Appearance Models) 적응부와;An AAM (Active Appearance Models) adaptor adapted to apply polygons by the coordinates detected in the face image of the user;상기 폴리곤을 적용한 사용자의 얼굴영상에 3차원 객체를 로딩하여 오버래핑하는 3차원 객체 로딩부와;A three-dimensional object loading unit loading and overlapping the three-dimensional object on the face image of the user to which the polygon is applied;상기 사용자의 얼굴영상에 오버래핑한 3차원 객체를 랜더링하는 랜더링부와;A rendering unit for rendering the 3D object overlapped with the face image of the user;상기 오버래핑된 3차원 객체 및 사용자 영상을 저장하는 이미지 저장부; 및 An image storage unit storing the overlapped 3D object and a user image; And상기 저장부에 저장된 3차원 객체 및 사용자 영상을 출력하는 이미지 출력부;로 구성하는 것을 특징으로 하는 3차원 객체를 제공하는 사진 장치.And an image output unit configured to output a 3D object and a user image stored in the storage unit.
- 제1항에 있어서, The method of claim 1,상기 3차원 객체 로딩부를 통해 로딩하기 위해 3차원 객체를 제공하는 3차원 객체DB를 더 포함하여 구성하는 것을 특징으로 하는 3차원 객체를 제공하는 사진 장치. And a 3D object DB for providing a 3D object for loading through the 3D object loading unit.
- 제1항에 있어서, The method of claim 1,상기 이미지 저장부에 저장된 3차원 객체 및 사용자 영상으로 이메일로 전달하는 이메일 전송부를 더 포함하여 구성하는 것을 특징으로 하는 3차원 객체를 제공하는 사진 장치. And a 3D object stored in the image storage unit and an e-mail transmission unit for transmitting an e-mail as a user image.
- 제1항에 있어서, The method of claim 1,상기 이미지 저장부는 오버래핑된 3차원 객체 및 사용자 영상을 비트맵(Bitmap)이미지를 생성하여 저장하는 것을 특징으로 하는 3차원 객체를 제공하는 사진 장치. And the image storage unit generates and stores a bitmap image of the overlapped 3D object and the user image.
- 제1항에 있어서, The method of claim 1,상기 이미지 출력부는 저장부에 저장된 3차원 객체 및 사용자 영상을 출력하는 소프트 카피 출력부 및 하드 카피 출력부를 포함하는 것을 특징으로하는 3차원 객체를 제공하는 사진 장치. And the image output unit includes a soft copy output unit and a hard copy output unit to output a 3D object and a user image stored in a storage unit.
- 영상 입력 장치를 통해 사용자의 얼굴영상을 입력하는 제1 단계와;A first step of inputting a face image of a user through an image input device;상기 사용자의 얼굴영상을 전처리하는 제2 단계와;A second step of preprocessing the face image of the user;상기 사용자의 얼굴영상에서 눈, 코, 입, 얼굴 윤곽의 위치 좌표를 검출하여 저장하는 제3 단계와;A third step of detecting and storing position coordinates of an eye, a nose, a mouth, and a face contour in the face image of the user;상기 영상 입력 장치를 통해 프레임별로 입력되는 사용자의 얼굴영상 모션정보를 얻는 제4 단계와;Obtaining a face image motion information of a user input for each frame through the image input device;상기 프레임별로 움직이는 사용자의 얼굴영상에서 위치 좌표를 로딩하여 계산하는 제5 단계와;A fifth step of loading and calculating position coordinates from a face image of the user moving for each frame;상기 위치 좌표가 계산되는 사용자의 얼굴영상에 폴리곤을 적용하는 제6 단계와;Applying a polygon to a face image of a user whose position coordinates are calculated;상기 폴리곤을 적용한 사용자의 얼굴영상에 3차원 객체를 오버래핑하여 랜더링하는 제7 단계; 및 A seventh step of overlapping and rendering a 3D object on the face image of the user to which the polygon is applied; And상기 사용자의 얼굴영상과 오버래핑된 3차원 객체를 저장하고 출력하는 제8 단계;로 이루어지는 것을 특징으로 하는 사진 장치의 3차원 객체 제공방법.And an eighth step of storing and outputting the three-dimensional object overlapped with the face image of the user.
- 제6항에 있어서, The method of claim 6,상기 제2 단계의 전처리는 입력 받은 사용자의 얼굴영상을 명암 영상으로 변환하는 단계 및 상기 명암 영상으로 변환한 영상을 이진 영상으로 변환하는 단계;로 이루어지는 것을 특징으로 하는 사진 장치의 3차원 객체 제공방법.The preprocessing of the second step includes converting a face image of the user input into a contrast image and converting the image converted into the contrast image into a binary image. 3D object providing method of a photographic apparatus .
- 제6항에 있어서, The method of claim 6,상기 제3 단계 이후에 눈, 코, 입, 및 얼굴 윤곽의 위치 좌표를 보정하는 단계를 더 포함하는 것을 특징으로 하는 사진 장치의 3차원 객체 제공방법 And correcting the position coordinates of the eye, nose, mouth, and face contour after the third step.
- 제6항에 있어서, The method of claim 6,상기 제6 단계의 폴리곤 적용으로 얼굴의 위치 및 각도를 변경하는 것을 특징으로 하는 사진 장치의 3차원 객체 제공방법.3. The method of claim 3, wherein the position and angle of the face are changed by applying the polygon of the sixth step.
- 제6항에 있어서, The method of claim 6,상기 제8 단계에서 사용자의 얼굴영상과 오버래핑된 3차원 객체 영상을 비트맵 이미지로 저장하는 것을 특징으로 하는 사진 장치의 3차원 객체 제공방법.And a three-dimensional object image overlapped with the face image of the user in the eighth step as a bitmap image.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2009-0092750 | 2009-09-30 | ||
KR1020090092750A KR101050364B1 (en) | 2009-09-30 | 2009-09-30 | Photo device for providing a three-dimensional object and a method of providing the same |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011040653A1 true WO2011040653A1 (en) | 2011-04-07 |
Family
ID=43826442
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2009/005585 WO2011040653A1 (en) | 2009-09-30 | 2009-09-30 | Photography apparatus and method for providing a 3d object |
Country Status (2)
Country | Link |
---|---|
KR (1) | KR101050364B1 (en) |
WO (1) | WO2011040653A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101466815B1 (en) * | 2012-09-25 | 2014-12-03 | 정영선 | The apparatus of homepage with wedding fitting |
KR101823035B1 (en) * | 2015-12-16 | 2018-02-01 | 남기원 | Compensation value-sharing system based social and method of the same |
KR102068489B1 (en) | 2018-03-30 | 2020-01-22 | (주)온넷시스템즈코리아 | 3d object creation apparatus |
KR102082894B1 (en) * | 2018-07-09 | 2020-02-28 | 에스케이텔레콤 주식회사 | Apparatus and method for displaying object and program stored in computer-readable medium for performing the same |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999063490A1 (en) * | 1998-06-01 | 1999-12-09 | Tricorder Technolgy Plc | 3d image processing method and apparatus |
KR20080111325A (en) * | 2007-06-18 | 2008-12-23 | 에스케이 텔레콤주식회사 | Method and system for modeling face in three dimension by means of aam, and apparatus applied to the same |
KR20090000635A (en) * | 2007-03-12 | 2009-01-08 | 주식회사 케이티 | 3d face modeling system and method considering the individual's preferences for beauty |
-
2009
- 2009-09-30 WO PCT/KR2009/005585 patent/WO2011040653A1/en active Application Filing
- 2009-09-30 KR KR1020090092750A patent/KR101050364B1/en active IP Right Grant
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1999063490A1 (en) * | 1998-06-01 | 1999-12-09 | Tricorder Technolgy Plc | 3d image processing method and apparatus |
KR20090000635A (en) * | 2007-03-12 | 2009-01-08 | 주식회사 케이티 | 3d face modeling system and method considering the individual's preferences for beauty |
KR20080111325A (en) * | 2007-06-18 | 2008-12-23 | 에스케이 텔레콤주식회사 | Method and system for modeling face in three dimension by means of aam, and apparatus applied to the same |
Also Published As
Publication number | Publication date |
---|---|
KR20110035155A (en) | 2011-04-06 |
KR101050364B1 (en) | 2011-07-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2013105715A1 (en) | Device and method for controlling rotation of displayed image | |
WO2020171621A1 (en) | Method of controlling display of avatar and electronic device therefor | |
WO2020162673A1 (en) | Electronic device for providing avatar animation and method thereof | |
WO2019050360A1 (en) | Electronic device and method for automatic human segmentation in image | |
WO2013129792A1 (en) | Method and portable terminal for correcting gaze direction of user in image | |
WO2011139070A2 (en) | Method and apparatus for recognizing location of user | |
EP3909233A1 (en) | Electronic device for stabilizing image and method for operating same | |
WO2020130281A1 (en) | Electronic device and method for providing avatar based on emotion state of user | |
WO2018012928A1 (en) | User authentication method using face recognition and device therefor | |
WO2020256471A1 (en) | Method and device for generating speech video on basis of machine learning | |
WO2017090986A1 (en) | Electronic apparatus and method for controlling electronic apparatus thereof | |
EP3776296A1 (en) | Apparatus and method for recognizing an object in electronic device | |
WO2020249076A1 (en) | Face calibration method and electronic device | |
WO2014088125A1 (en) | Image photographing device and method for same | |
WO2020197070A1 (en) | Electronic device performing function according to gesture input and operation method thereof | |
WO2011040653A1 (en) | Photography apparatus and method for providing a 3d object | |
WO2019139404A1 (en) | Electronic device and method for processing image of same | |
WO2019039870A1 (en) | Electronic device capable of controlling image display effect, and method for displaying image | |
WO2021251534A1 (en) | Method, apparatus, and system for providing real-time broadcasting platform using motion and face capturing | |
WO2020085718A1 (en) | Method and device for generating avatar on basis of corrected image | |
WO2019098421A1 (en) | Object reconstruction device using motion information and object reconstruction method using same | |
WO2019066370A1 (en) | Electronic device for controlling camera on basis of external light, and control method therefor | |
WO2019164287A1 (en) | Electronic device and method for providing augmented reality object therefor | |
WO2016021830A1 (en) | Method and device for correcting motion information collected by nui device | |
WO2022050742A1 (en) | Method for detecting hand motion of wearable augmented reality device by using depth image and wearable augmented reality device capable of detecting hand motion by using depth image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09850085 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02/07/2012) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09850085 Country of ref document: EP Kind code of ref document: A1 |