WO2022045470A1

WO2022045470A1 - Method for generating three-dimensional modelding of two-dimensional image through virtual grid network

Info

Publication number: WO2022045470A1
Application number: PCT/KR2020/017622
Authority: WO
Inventors: 윤기식
Original assignee: 윤기식
Priority date: 2020-08-25
Filing date: 2020-12-04
Publication date: 2022-03-03
Also published as: KR102303566B1

Abstract

The present invention relates to a method for generating three-dimensional modeling of a two-dimensional image through a virtual grid network. The method comprises: a two-dimensional image extraction step of capturing images of a plurality of planes of an object to be captured a plurality of times and removing background images from the captured images that have been captured; a step of superimposing a plurality of two-dimensional images obtained by capturing images of the same plane, and extracting an intermediate value of error values that occur in the plurality of superimposed two-dimensional images, so as to generate two-dimensional object images; a step of generating a virtual grid network and attaching the virtual grid network to the two-dimensional object images; and performing curve interpolation on a first unit grid and a second unit grid, which are superimposed at the boundary of the plurality of two-dimensional object images to which the virtual grid network has been attached, so as to generate a three-dimensional object image, so that two-dimensional images obtained by capturing images of the object to be captured may be easily and conveniently modeled into a three-dimensional image.

Description

How to create 3D modeling of 2D image through virtual grid network

In the present invention, in modeling a two-dimensional image into a three-dimensional image, a virtual grid network that performs curve interpolation using a grid network to correct disturbances that may occur when a plurality of two-dimensional images are overlapped. It relates to a method for generating a three-dimensional model of a two-dimensional image.

As is well known, fields such as virtual reality, augmented reality, etc., as well as exhibitions and e-commerce on the Internet, exposing an object as a three-dimensional image so that a user can perceive it as a real object are increasing.

In order to recognize an object as a three-dimensional image in this way, the object can be created as a three-dimensional image by photographing the object from various angles and modeling the photographed two-dimensional image in three dimensions.

In the conventional case, various two-dimensional images are created by photographing an object at different focal lengths in various directions, or by setting reference points in each part of the object and extending the reference points with lines to form an image of the object. of the two-dimensional image was modeled as a three-dimensional image.

However, in this case, when a plurality of two-dimensional images taken from various angles of an object are overlapped, there is a problem in that each two-dimensional image is disturbed.

In addition, as photographing is performed with a plurality of cameras, an excessive cost is required to generate 3D modeling data, and thus, there is a problem in that it is difficult for a user to easily perform an operation.

In order to model a two-dimensional image of an object in three dimensions, the present invention relates to a two-dimensional image through a virtual grid network capable of generating a three-dimensional object image by attaching a temporary grid network and a virtual grid network to the two-dimensional image. To provide a 3D modeling creation method.

In addition, the present invention performs curved interpolation to match the corner surfaces of the unit grid or to match the contrast inside the unit grid in order to remove the disturbance that may occur between the images in the part where the two-dimensional images of the object to be photographed are overlapped. To provide a method for generating 3D modeling of 2D images through a virtual grid network that can be

The purpose of the embodiments of the present invention is not limited to the above-mentioned purpose, and other objects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. .

According to an embodiment of the present invention, a two-dimensional image extraction step of photographing a plurality of surfaces of an object to be photographed a plurality of times, and removing a background image from the photographed photographed image, and overlapping a plurality of the two-dimensional images obtained by photographing the same surface, generating a two-dimensional object image by extracting a median value from the error values formed in the plurality of overlapping two-dimensional images; creating a virtual grid network and joining the two-dimensional object image to the virtual grid; A two-dimensional image through a virtual grid network comprising the step of generating a three-dimensional object image by interpolating the curves of the first unit grid and the second unit grid overlapping at the boundary of the plurality of two-dimensional object images to which the network is attached. A three-dimensional modeling generation method may be provided.

In addition, according to an embodiment of the present invention, in the step of extracting the two-dimensional image, a temporary grid network is bonded to the photographed image, and the background image is selected based on the boundary between the non-curved surface and the curved surface formed in the temporary grid network. A method for generating a three-dimensional model of a two-dimensional image through a virtual grid network that separates them may be provided.

In addition, according to an embodiment of the present invention, the virtual grid network includes a plurality of black first unit grids and white second unit grids alternately arranged to form a two-dimensional image through a virtual grid network. A three-dimensional modeling generation method may be provided.

In addition, according to an embodiment of the present invention, in the step of generating the three-dimensional object image, the first unit grids are overlapped so that the edge surfaces of the plurality of first unit grids having curved edge surfaces are connected to each other, and the edge surface 2D through a virtual grid network including forming the three-dimensional object image for interpolating curves by overlapping the second unit grids so that the edge surfaces of the plurality of second unit grids formed with the curve are connected A method for generating a three-dimensional model of an image may be provided.

In addition, according to an embodiment of the present invention, in the step of generating the three-dimensional object image, a curve is formed by superimposing the second unit grids so that the light and dark coincide with the plurality of the second unit grids, the contrast of which is generated on the inner surface. A method for generating a three-dimensional model of a two-dimensional image through a virtual grid network including the step of forming the three-dimensional object image to be interpolated may be provided.

The present invention removes the background image of the object by attaching a temporary grid network to the two-dimensional image of the object, and attaching the virtual grid network formed of the first unit grid and the second unit grid to the two-dimensional object image, thereby creating an object. It can be easily modeled as a 3D image.

In addition, the present invention can effectively remove the disturbance between the two-dimensional images by interpolating each of the first and second unit grids with curves in the portion where the two-dimensional images of the object overlap.

1 is a flowchart illustrating a method for generating a three-dimensional model of a two-dimensional image through a virtual grid network according to an embodiment of the present invention.

2 is a diagram illustrating a virtual grid network of a method for generating a three-dimensional model of a two-dimensional image through a virtual grid network according to an embodiment of the present invention.

3 is a view for explaining a process of generating a three-dimensional model of a two-dimensional image through a virtual grid network according to an embodiment of the present invention.

Advantages and features of embodiments of the present invention, and methods of achieving them, will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the art to which the present invention pertains It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

In describing the embodiments of the present invention, if it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, the terms to be described later are terms defined in consideration of functions in an embodiment of the present invention, which may vary according to intentions or customs of users and operators. Therefore, the definition should be made based on the content throughout this specification.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating a method for generating a three-dimensional model of a two-dimensional image through a virtual grid network according to an embodiment of the present invention, and FIG. 2 is a two-dimensional view through a virtual grid network according to an embodiment of the present invention. It is a diagram illustrating a virtual grid network of a method for generating a three-dimensional modeling of an image, and FIG. 3 is a view for explaining a process of generating a three-dimensional model of a two-dimensional image through a virtual grid network according to an embodiment of the present invention.

Referring to FIG. 1 , the process of generating a two-dimensional image into a three-dimensional image using a virtual grid network will be described in detail with reference to FIGS. A two-dimensional image 120 extraction step of photographing and removing the background image 110 from the photographed photographed image 100 may be performed (step 210).

That is, when the photographing target 10 is photographed, the photographed image 100 including the background image 110 in which the photographing object 10 is located may be photographed and output, and this background image 110 is three-dimensional. Since it corresponds to unnecessary data in the process of modeling the object image 160 , the process of removing the background image 110 from the photographed image 100 may be preceded.

First, a plurality of two-dimensional images corresponding to each surface may be output by photographing a plurality of times in the front, rear, left surface, right surface, and upper surface of the object to be photographed 10 .

For example, as shown in Figure 3, when photographing the left foot of the human body, the front photographing toward the toe part, the left and right side photographing toward the peach bone part, the rear photographing toward the heel, and the upper part of the foot are photographed The upper photographing is performed, and a plurality of photographed images 100 photographing each part may be output.

In particular, in order to remove the background image 110 from the photographed image 100 of the foot, the process of bonding the temporary grid network 140 to the photographed image 100 may be performed.

Here, the temporary grid network 140 means that a plurality of black and white squares formed in a rectangle, a square, etc. are alternately arranged in a grid shape, and the plurality of squares are not limited to black and white, and a plurality of A plurality of colors of the quadrangle may be provided so that the four quadrilaterals are alternately arranged so that each quadrangle can be contrasted and distinguished.

When the temporary grid network 140 is attached to the photographed image 100 , the shape of the temporary grid network 140 may vary according to the shape of the object 10 to be photographed. The photographed image 100 in which the temporary grid network 140 is attached to the concave portion of the photographing target 10 may be exposed by being deformed into a concave shape of the temporary grid network 140 . That is, concave curves are formed in the temporary grid network 140 according to the concave shape of the object 10 , so that the shape of the object 10 to be photographed can be determined through the temporary grid network 140 .

For example, when the temporary grid network 140 is attached to the photographed image 100 in which a plurality of parts of the foot are captured, the temporary grid network 140 may be deformed and exposed according to the shape of the foot. In order to generate the two-dimensional image 120 of the foot, a temporary grid network 140 bonded to the photographed image 100 such as the front, rear, left and right sides of the foot may be used, but the background image in the photographed image 100 of the foot In order to remove the background image 110 by separating 110, in particular, it is possible to effectively determine the shape of the foot using the photographed image 100 obtained by taking the foot from above.

In detail, when the foot is photographed from the upper part, the photographed image 100 may include an image of the foot including the instep of the foot, the background image 110 , and the like. When the temporary grid network 140 is attached to the photographed image 100 as described above, the temporary grid network 141 located at the foot part is bent and exposed according to the shape of the foot, and the temporary grid network 141 located in the background part except for the foot part The grid network 140 may be exposed in the form of a rectangle, a square, or the like in which no curves are formed.

As described above, when the boundary between the curved and exposed temporary grid network 140 and the non-curved temporary grid network 140 is continuously separated, only the temporary grid network 140 in which the shape of the foot is expressed can be separated. , by easily separating and removing the background image 110 from the photographed image 100 , the two-dimensional image 120 can be derived.

Next, the two-dimensional object image 130 by superimposing a plurality of two-dimensional images 120 obtained by photographing the same surface of the object to be photographed, and extracting an intermediate value with respect to the error values formed in the plurality of overlapping secondary images 120 . ) may be performed (step 220).

The two-dimensional image 120 in which the background image 110 is removed from the photographed image 100 and only the shape of the photographing target 10 is exposed is that the photographing object 10 is photographed multiple times from various sides, and the photographing object ( 10), an error may occur in that the two-dimensional image 120 is not output in the same way depending on the shooting conditions such as vibration of the imaging device, light intensity at the time of shooting, and light intensity. there is.

In order to prevent such an error, a process of correcting an error between the plurality of two-dimensional images 120 may be performed.

For example, first, when a plurality of two-dimensional images 120 obtained by photographing a portion of an object 10 are superimposed and positioned, two-dimensional (2D) images can be exposed without interference between a plurality of overlapping two-dimensional images 120 . An image 120 is output. Next, the plurality of two-dimensional images 120 output in this way are positioned at coordinates formed along the XY axis, and the plurality of reference positions of the photographing target 10 exposed to each two-dimensional image 120 are XY expressed in terms of coordinates.

Then, in each two-dimensional image 120, a median value is derived from the XY position value that can be expressed differently for each reference position, and the position of the XY coordinates of the intermediate value to be derived is referenced to the shape of the imaging target 10. By connecting, the two-dimensional object image 130 in which the error value is corrected between the plurality of two-dimensional images 120 may be generated.

Next, a process of bonding the virtual grid network 150 to the two-dimensional object image 130 is performed (step 230).

Here, the virtual grid network 150 is provided with a plurality of black first unit grids 151 and white second unit grids 152 formed in a rectangle, a square, etc., similarly to the temporary grid network 140 . to be alternately arranged in a lattice form, the plurality of first unit grids 151 and second unit grids 152 are not limited to be formed in black and white, and the plurality of unit grids are alternately arranged to form the first unit The color of the unit grid may be formed so that the grid 151 and the second unit grid 152 can be distinguished from each other.

The virtual grid network 150 is bonded to the two-dimensional object image 130 so that the plurality of first unit grids 151 and the second unit grids 152 of the virtual grid network 150 are the shape of the object 10 to be photographed. By being deformed according to the , the shape of each part of the object 10 to be photographed may be exposed to the virtual grid 150 .

Next, a three-dimensional object image ( 160) is generated (step 240).

The two-dimensional object image 130 to which the virtual grid network 150 is attached is an image output by photographing the object 10 from one side, and in order to generate a three-dimensional object image 160, the object to be photographed (10) A process of forming a single image by correcting the two-dimensional object image 130 obtained by photographing each part is necessary.

To this end, when the two-dimensional object image 130 of each part is collected, a work of correcting or interpolating the part where the two-dimensional object image 130 overlaps may be performed.

That is, the first unit grids 151 are overlapped so that the edge surfaces of the plurality of first unit grids 151 in which the edge surfaces are curved are connected, and the plurality of second unit grids 152 in which the edge surfaces are formed in a curved shape. ) may be interpolated by overlapping the second unit grids 152 so that the edge surfaces of each are connected (step 241).

In detail, the edge surface of the first unit grid 151 or the second unit grid 152 formed at the right end of the two-dimensional object image 130 photographed from the upper surface of the left foot of the human body is from the instep of the left foot to that of the left foot. It may be formed in a curved shape in the right (or left) direction.

In addition, the edge surface of the first unit grid 151 or the second unit grid 152 formed at the left end of the two-dimensional object image 130 photographed from the right side of the left foot is in the instep direction from the right (or left) side of the left foot. may be formed in a curved shape.

In this way, when the two-dimensional object image 130 photographed from the upper surface and the two-dimensional object image 130 photographed from the right (or left) are combined, each two-dimensional object image 130 overlaps at the overlapping portion. As a result, disturbances occur between the respective two-dimensional object images 130 , which may cause a problem in that it is difficult to output the accurate three-dimensional object image 160 .

In order to eliminate this problem, the edge surface of the first unit grid 151 (or the second unit grid 152) formed at the right end of the two-dimensional object image 130 photographed from the upper surface of the left foot of the human body The edge surface of the first unit grid 151 (or the second unit grid 152 ) formed at the left end of the two-dimensional object image 130 photographed from the right side of the left foot may match. That is, the first unit grid 151 coincides with the first unit grids 151, and the second unit grid 152 matches the second unit grids 152 with the four trough surfaces of each corner. By interpolation, it is possible to correct the part where the secondary object image 130 photographed from the dorsal surface and the secondary object image 130 photographed from the right side of the foot overlap at the overlapping portion, thereby causing disturbance.

By interpolating the overlap generated at the boundary surface of each of the two-dimensional object images 130 taken from the front, rear, left, right, and upper surfaces of the left foot by the above-described curved interpolation, the two-dimensional object image 130 is obtained. Through this, the 3D object image 160 may be generated.

In addition, each of the two-dimensional object images 130 may be interpolated by overlapping the plurality of second unit grids 152 in which light and dark are generated on the inner surface so that the contrasts are matched (step 242). ).

In detail, the second unit grid 152 may be formed of white, etc., depending on the angle at which the photographing target 10 is photographed or the illuminance at the time of photographing, etc., light and dark are generated on the second unit grid 152 , the contrast may be exposed in the form of a gradation.

That is, the inner surface of the second unit grid 152 formed at the right end of the two-dimensional object image 130 photographed from the upper surface of the left foot of the human body is darkened from the top of the left foot to the right (or left) direction of the left foot. The setting may be formed to have a gradation of light and dark.

In addition, the inner surface of the second unit grid 152 formed at the left end of the two-dimensional object image 130 photographed from the right side of the left foot has a gradation of the contrast darkening in the instep direction from the right (or left) side of the left foot. can be formed.

The contrast of the inner surface of each of the second unit grids 152 has a difference in that the darkening direction is formed differently, but the second unit grid 152 of the two-dimensional object image 130 obtained by photographing the same part of the left foot. points are coincident.

Accordingly, the contrast of the inner surface of the second unit grid 152 formed at the right end of the two-dimensional object image 130 photographed from the upper surface of the left foot of the human body and the two-dimensional object image 130 photographed from the right surface of the left foot. By removing the light and dark inside the second unit grid 152 formed at the left end of each of the second unit grids 152, or based on the contrast of the inner surface of one second unit grid 152 By converting the contrast of the inner surface of the other second unit grid 152 to match each second unit grid 152, the secondary object image 130 photographed from the dorsal surface and the secondary object photographed from the right side of the foot A portion where the images 130 overlap may be interpolated with curves.

The two-dimensional object image 130 by interpolating the overlap generated at the boundary surface of each of the two-dimensional object images 130 photographed from the front, rear, left surface, right surface, and upper surface of the left foot by the curved interpolation as described above. ) through the three-dimensional object image 160 can be generated.

On the other hand, the modeling of the three-dimensional object image 160 for the part of the photographing target 10 in contact with the floor surface, such as the sole surface, can be generated using an actual grid network provided with a certain standard such as a grid paper.

Unlike the one in which the front, rear, left and right side surfaces, and upper surfaces of the foot are formed in a curved shape, it may be easy to grasp the shape of the sole surface based on the outer boundary of the sole surface.

Here, in the virtual grid network 150, it is easy to grasp the shape of the foot through the curved edge of the first unit grid 151 and the second unit grid 152, or the contrast formed on the inner surface thereof. The actual grid network such as , graph paper, etc. is provided so that the interval is standardized, so it is easy to actually model the shape of the sole surface.

Accordingly, water or ink is applied to the sole surface to contact the graph paper, or the sole surface is brought into contact with the graph paper applied with ink, etc., through the outer boundary of the sole surface exposed to the graph paper, etc. shape can be modeled.

In the above description, various embodiments of the present invention have been presented and described, but the present invention is not necessarily limited thereto. It will be readily appreciated that branch substitutions, transformations and alterations are possible.

In the present invention, in modeling a two-dimensional image into a three-dimensional image, a virtual grid network that performs curve interpolation using a grid network to correct disturbances that may occur when a plurality of two-dimensional images are overlapped. It can be used in the field of a method for generating a three-dimensional model of a two-dimensional image.

Claims

A two-dimensional image extraction step of photographing a plurality of surfaces of an object to be photographed multiple times and removing a background image from the photographed photographed image;

Generating a two-dimensional object image by superimposing a plurality of the two-dimensional images taken on the same plane, and extracting an intermediate value with respect to an error value formed in the plurality of overlapping two-dimensional images;

creating a virtual grid network and attaching it to the two-dimensional object image;

Generating a three-dimensional object image by interpolating a curve between the first unit grid and the second unit grid overlapping at the boundary of the plurality of two-dimensional object images to which the virtual grid network is attached

A method of generating a three-dimensional modeling of a two-dimensional image through a virtual grid network comprising a.
The method of claim 1,

The step of extracting the two-dimensional image,

By bonding a temporary grid network to the photographed image, the background image is separated based on the boundary between the non-curved surface and the curved surface formed in the temporary grid network.

A method of generating 3D modeling of a 2D image through a virtual grid network.
3. The method of claim 2,

The virtual grid network,

A plurality of black first unit grids and white second unit grids are alternately arranged and formed

A method of generating 3D modeling of a 2D image through a virtual grid network.
4. The method of claim 3,

The three-dimensional object image creation step is,

The first unit grids are overlapped so that the edge surfaces of the plurality of first unit grids having curved edge surfaces are connected, and the edge surfaces of the plurality of second unit grids having curved edge surfaces are connected to each other. Forming the three-dimensional object image for interpolating a curve by overlapping a second unit grid

A method of generating a three-dimensional modeling of a two-dimensional image through a virtual grid network comprising a.
5. The method according to claim 3 or 4,

The three-dimensional object image creation step is,

Forming the three-dimensional object image for interpolating a curve by overlapping the plurality of second unit grids, the second unit grids having the contrast on the inner surface, so that the contrasts match the second unit grids

A method of generating a three-dimensional modeling of a two-dimensional image through a virtual grid network comprising a.