WO2011040653A1

WO2011040653A1 - Photography apparatus and method for providing a 3d object

Info

Publication number: WO2011040653A1
Application number: PCT/KR2009/005585
Authority: WO
Inventors: 김상국
Original assignee: 주식회사 한울네오텍
Priority date: 2009-09-30
Filing date: 2009-09-30
Publication date: 2011-04-07
Also published as: KR20110035155A; KR101050364B1

Abstract

The present invention relates to a photography apparatus and to a method for providing a 3D object, and more particularly, to a photography apparatus and to a method for providing a 3D object, wherein the photography apparatus comprises: an image input device for receiving an input of a facial image of a user in real time; a preprocessing unit for converting the inputted facial image of the user into a binary image; a face coordinate extraction unit for extracting coordinates of the eyes, nose, mouth, and facial contour from the facial image of the user converted into the binary image; a position coordinate compensation unit for compensating for the coordinates extracted by the face coordinate extraction unit; a position coordinate storage unit for storing the facial coordinates compensated for by the position coordinate compensation unit; a position coordinate loading unit for loading the facial coordinates in the facial image of the user inputted from the image input apparatus; a facial coordinate calculation unit for calculating, with the facial coordinate loading unit, a position to which the user moves; an AAM adaptation unit for applying a polygon by means of the coordinates extracted from the facial image of the user; a 3D object loading unit for loading and overlapping a 3D object on the facial image of the user with the applied polygon; a rendering unit for rendering the 3D object overlapped on the facial image of the user; an image storage unit for storing the overlapped 3D object and a user image; and an image output unit for outputting the 3D object and the user image stored in the image storage unit.

Description

Photo device for providing a three-dimensional object and a method of providing the same

The present invention relates to a photographic apparatus for providing a three-dimensional object for providing a caricature of the three-dimensional object by overlapping the user face image and a method of providing the same.

In general, a sticker photographing device is a device for outputting a photograph of a user input by an image input device in the form of a sticker. Furthermore, various two-dimensional objects have been provided to decorate and decorate the surroundings of the photographed photograph.

However, the conventional sticker photo device provides a two-dimensional object, and the user has to manually adjust the size of the two-dimensional object.

In addition, the conventional sticker photo device is formed in two dimensions has a disadvantage that falls in reality.

In addition, since the development of the sticker photo device is insufficient, the domestic and export trends are declining. Therefore, a new technical introduction is urgently needed.

The technical problem to be solved by the present invention is a photographic apparatus and a method for providing a three-dimensional object that overlaps the three-dimensional object in the face image of the user in the moving reality.

In addition, the technical problem to be solved by the present invention is a sticker photo device and a method for providing a three-dimensional object moving in accordance with the user's movement by applying a variety of three-dimensional objects to their faces in real time to be.

According to an aspect of the present invention, a photographic apparatus for providing a 3D object includes: an image input device configured to receive a face image of a user in real time;

A preprocessing unit converting the input face image of the user into a binary image;

A position coordinate detector for detecting position coordinates of an eye, nose, mouth, and face contour in a face image of the user converted into the binary image;

A position coordinate corrector for correcting the coordinates detected by the face coordinate detector;

A position coordinate storage unit for storing face coordinates corrected by the position coordinate corrector;

A position coordinate loading unit for loading face coordinates into a face image of a user input by the image input apparatus;

A face coordinate calculator for calculating a face coordinate loading unit and a position at which the user moves;

An AAM (Active Appearance Models) adaptor adapted to apply polygons by the coordinates detected in the face image of the user;

A three-dimensional object loading unit loading and overlapping the three-dimensional object on the face image of the user to which the polygon is applied;

A rendering unit for rendering the 3D object overlapped with the face image of the user;

An image storage unit storing the overlapped 3D object and a user image; And

And an image output unit configured to output a 3D object and a user image stored in the storage unit.

The photographic apparatus for providing a 3D object according to the above feature may further include a 3D object DB for providing a 3D object for loading through the 3D object loading unit.

The photographic apparatus for providing a 3D object according to the above feature may further include an email transmission unit configured to transmit an email as a 3D object stored in the image storage unit and a user image.

In the photographic apparatus for providing a 3D object according to the feature, the image storage unit generates and stores a bitmap image of the overlapped 3D object and the user image.

The photographic apparatus for providing a 3D object according to the above features may include a soft copy output unit and a hard copy output unit configured to output a 3D object and a user image stored in the storage unit.

According to still another aspect of the present invention, there is provided a method of providing a 3D object of a photographic apparatus, comprising: a first step of inputting a face image of a user through an image input apparatus;

A second step of preprocessing the face image of the user;

A third step of detecting and storing position coordinates of an eye, a nose, a mouth, and a face contour in the face image of the user;

Obtaining a face image motion information of a user input for each frame through the image input device;

A fifth step of loading and calculating position coordinates from a face image of the user moving for each frame;

Applying a polygon to a face image of a user whose position coordinates are calculated;

A seventh step of overlapping and rendering a 3D object on the face image of the user to which the polygon is applied; And

And an eighth step of storing and outputting the 3D object overlapped with the face image of the user.

In the method of providing a 3D object of a photographic apparatus according to the above feature, the preprocessing of the second step may include converting a face image of the user input into a contrast image and converting the image converted into the contrast image into a binary image; Characterized in that made.

The method of providing a 3D object of the photographic apparatus according to the above aspect may further include correcting the position coordinates of the eye, nose, mouth, and face contour after the third step.

The method of providing a 3D object of the photographing apparatus according to the above aspect is characterized in that the position and angle of the face are changed by applying the polygon of the sixth step.

The method of providing a 3D object of the photographic apparatus according to the above feature may include storing the 3D object image overlapped with the face image of the user as a bitmap image in the eighth step.

According to this feature of the invention,

The present invention has the effect of overlapping the three-dimensional object on the user's face image to give a sense of reality as actually worn by moving the three-dimensional object as the user moves.

In addition, the present invention has the advantage that the user does not have to adjust the size of the three-dimensional object is overlapped by the face coordinates.

1 is a block diagram showing the configuration of a photographic apparatus for providing a three-dimensional object according to the present invention.

2 is a block diagram illustrating an image storage unit and an image output unit of a photographic apparatus for providing a 3D object according to the present invention.

3 is a flowchart illustrating a 3D object providing method of a photo device according to the present invention.

4 is a view showing a state in which a polygon is applied to a face image of a user in a method of providing a 3D object of a photo device according to the present invention.

5 is a view showing the result obtained by the photographic apparatus for providing a three-dimensional object according to the present invention.

110: image input device 120: preprocessor

200: AAM module 210: position coordinate detection unit

220: position coordinate correction unit 230: position coordinate storage unit

310: position coordinate loading unit 320: position coordinate calculation unit

330: AAM adaptation unit 340: 3D object loading unit

350: three-dimensional object DB 360: rendering unit

410: image storage unit 411: storage coordinate check unit

412: bitmap image generator 413: bitmap image storage unit

420: Image output unit 421: Email transmission unit

422: hard copy output unit 423: soft copy output unit

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail.

1 is a block diagram showing a configuration of a photographic apparatus for providing a 3D object according to the present invention, Figure 2 is a block diagram showing an image storage unit and an image output unit of a photographic apparatus for providing a 3D object according to the present invention. .

As shown in FIG. 1 and FIG. 2, a photographic apparatus for providing a 3D object according to an exemplary embodiment of the present invention may include an image input apparatus 110, a preprocessor 120, a position coordinate detector 210, and a position coordinate beam. The government 220, the position coordinate storage unit 230, the position coordinate loading unit 310, the position coordinate calculation unit 320, the AAM adaptor 330, the three-dimensional object loading unit 340, three-dimensional object DB ( 350, the rendering unit 360, the image storage unit 410, and the image output unit 420.

Here, the image input device 110 inputs a face image of the user in real time. In this case, the image input device 110 refers to a device capable of inputting an image, such as a CCD camera and a CMOS camera, and is not limited to the above-described CCD camera and CMOS camera.

Here, the preprocessor 120 converts a face image of the user input through the image input device 110 into a binary image. In this case, the preprocessor 120 converts the input image into a binary image to facilitate detection of position coordinates of the input face image of the user.

Here, the position coordinate detector 210 detects the position coordinates of the eyes, nose, mouth, and face contour in the face image of the user converted into the binary image.

Here, the position coordinate corrector 220 corrects the coordinates detected by the face coordinate detector 210. In this case, the position coordinate detector 210 and the position coordinate corrector 220 are included in the AAM module and detect the position coordinates of the eyes, nose, mouth and face contour in the face image of the user by the AAM algorithm.

Here, the position coordinate storage unit 230 stores face coordinates corrected by the position coordinate correcting unit 220.

Here, the position coordinate loading unit 310 loads face coordinates in the face image of the user input from the image input apparatus 110.

Here, the position coordinate calculator 320 calculates a position at which the face coordinate loading unit 310 and the user move.

Here, the AAM adaptor 330 applies a polygon based on the coordinates detected in the face image of the user.

Here, the 3D object loading unit 340 loads and overlaps the 3D object on the face image of the user to which the polygon is applied. At this time, by overlapping the three-dimensional object on the user's face image, the user's face overlapped with the three-dimensional object is expressed as wearing a character mask.

Here, the 3D object DB 350 provides a 3D object for loading through the 3D object loading unit 310. At this time, the 3D object DB is stored including a variety of characters.

Here, the rendering unit 360 renders the 3D object overlapped with the face image of the user. In this case, rendering means that the angle and direction of the overlapping 3D object according to the movement of the user's face also move together with the movement of the user's face.

Here, the image storage unit 410 stores the overlapped 3D object and the user image. The image storage unit 410 may include a storage coordinate checking unit 411 for checking image storage coordinates, a bitmap image generator 412 for generating a face image of the user and an overlapping three-dimensional object as a bitmap; And a bitmap image storage unit 413 for storing a face image of the bitmapped user and an overlapping three-dimensional object generated by the bitmap image generator.

Here, the image output unit 420 outputs the 3D object and the user face image stored in the image storage unit 410.

At this time, the image output unit 420 is an email transmission unit 421 for transmitting an email to the three-dimensional object and the user image stored in the image storage unit 410, and the three-dimensional object and the user image stored in the image storage unit And a hard copy output unit 422 and a soft copy output unit 423 for outputting.

3 is a flowchart illustrating a 3D object providing method of a photo device according to the present invention, and FIG. 4 is a view illustrating a polygon applied to a face image of a user in the 3D object providing method of the photo device according to the present invention.

3 and 4, in the method for providing a 3D object in the photo device according to the embodiment of the present invention, first, a face image of the user is input through the image input device (S510).

Subsequently, the face image of the user is preprocessed (S520). In this case, the preprocessing converts the input face image of the user into a contrast image, and converts the image converted to the contrast image to a binary image.

Subsequently, the position coordinates of the eyes, nose, mouth, and face contour are detected and stored in the face image of the user (S530). In this case, the position coordinates of the eyes, nose, mouth, and face contour may be changed in the face image of the user, and thus the position coordinates of the eyes, nose, mouth, and face contour may be corrected again.

Subsequently, face image motion information of the user, which is input for each frame through the image input apparatus, is obtained (S540). At this time, by obtaining the motion information of the user's face image to use the movement of the three-dimensional object in accordance with the user's movement.

Subsequently, the position coordinates are loaded and calculated from the face image of the user moving for each frame (S550). In this case, since the 3D object must move simultaneously according to the movement of the face image of the user, the position coordinates are calculated in the face image of the user.

Subsequently, a polygon is applied to the face image of the user whose position coordinate is calculated (S560). At this time, the position and angle of the face may be changed by tracking with a polygon applied to the face image of the user.

Subsequently, the 3D object is overlapped and rendered on the face image of the user to which the polygon is applied (S570).

Finally, the 3D object overlapped with the face image of the user is stored and output (S580). At this time, the 3D object image overlapped with the face image of the user is generated and stored as a bitmap image.

As shown in FIG. 5, a drawing photographed using an embodiment of the present invention overlaps a 3D object to a user in the real world, so that the 3D object is worn by a real user regardless of the direction in which the user looks. You can see the same movement.

As described above, in the detailed description of the present invention has been described with respect to preferred embodiments of the present invention, those skilled in the art to which the present invention pertains various modifications without departing from the scope of the present invention Of course this is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents thereof, as well as the following claims.

The sticker photo device is a device that outputs a picture of a user input by an image input device in the form of a sticker. Furthermore, various two-dimensional objects have been provided so that the user can decorate and decorate the surroundings of the photographed picture. Due to the lack of development, domestic and exports are decreasing, and new technological introduction is urgently needed.

For example, the conventional sticker photo device has a problem in that a user needs to directly adjust the size of the two-dimensional object by providing a two-dimensional object, and the conventional sticker photo device is formed in two dimensions and has a disadvantage in reality.

In this respect, the 3D object is overlaid on the user's face image, so that the 3D object moves as the user moves and gives a realistic feeling as if the user wears the present invention. The advantage is that you do not have to resize the object.

As such, it is a necessary invention in terms of raising expectations for increasing domestic and export of sticker photographic devices by providing more realistic imaging technology by introducing three-dimensional objects into sticker photographic devices.

Claims

An image input device for receiving a face image of a user in real time;

A preprocessing unit converting the input face image of the user into a binary image;

A position coordinate detector for detecting position coordinates of an eye, nose, mouth, and face contour in a face image of the user converted into the binary image;

A position coordinate corrector for correcting the coordinates detected by the face coordinate detector;

A position coordinate storage unit for storing face coordinates corrected by the position coordinate corrector;

A position coordinate loading unit for loading face coordinates into a face image of a user input by the image input apparatus;

A face coordinate calculator to calculate a face coordinate loading unit and a position at which the user moves;

An AAM (Active Appearance Models) adaptor adapted to apply polygons by the coordinates detected in the face image of the user;

A three-dimensional object loading unit loading and overlapping the three-dimensional object on the face image of the user to which the polygon is applied;

A rendering unit for rendering the 3D object overlapped with the face image of the user;

An image storage unit storing the overlapped 3D object and a user image; And

And an image output unit configured to output a 3D object and a user image stored in the storage unit.
The method of claim 1,

And a 3D object DB for providing a 3D object for loading through the 3D object loading unit.
The method of claim 1,

And a 3D object stored in the image storage unit and an e-mail transmission unit for transmitting an e-mail as a user image.
The method of claim 1,

And the image storage unit generates and stores a bitmap image of the overlapped 3D object and the user image.
The method of claim 1,

And the image output unit includes a soft copy output unit and a hard copy output unit to output a 3D object and a user image stored in a storage unit.
A first step of inputting a face image of a user through an image input device;

A second step of preprocessing the face image of the user;

A third step of detecting and storing position coordinates of an eye, a nose, a mouth, and a face contour in the face image of the user;

Obtaining a face image motion information of a user input for each frame through the image input device;

A fifth step of loading and calculating position coordinates from a face image of the user moving for each frame;

Applying a polygon to a face image of a user whose position coordinates are calculated;

A seventh step of overlapping and rendering a 3D object on the face image of the user to which the polygon is applied; And

And an eighth step of storing and outputting the three-dimensional object overlapped with the face image of the user.
The method of claim 6,

The preprocessing of the second step includes converting a face image of the user input into a contrast image and converting the image converted into the contrast image into a binary image. 3D object providing method of a photographic apparatus .
The method of claim 6,

And correcting the position coordinates of the eye, nose, mouth, and face contour after the third step.
The method of claim 6,

3. The method of claim 3, wherein the position and angle of the face are changed by applying the polygon of the sixth step.
The method of claim 6,

And a three-dimensional object image overlapped with the face image of the user in the eighth step as a bitmap image.