KR20230105546A - Image scanning method, apparatus and system for 3d image modeling - Google Patents

Abstract

An image scanning method for 3D image modeling, comprising: a first image representing a 2D image of 3D content observed at a first position in a 3D coordinate system and a 2D image of the 3D content observed at a second position in the 3D coordinate system acquiring a second image; detecting a first boundary line indicating one boundary of the 3D content in the first image; detecting a second boundary line representing the one boundary in the second image; and determining a third boundary line representing the one boundary in 3D in the 3D coordinate system using the first boundary line and the second boundary line.
An apparatus according to an embodiment may be combined with hardware and controlled by a computer program stored in a medium to execute any one of the methods described above.

Description

Image scanning method, apparatus and system for 3D image modeling {IMAGE SCANNING METHOD, APPARATUS AND SYSTEM FOR 3D IMAGE MODELING}

The embodiments below relate to an image scanning method, apparatus, and system for 3D image modeling.

Artificial intelligence (AI) refers to a technology that artificially implements some or all of human learning abilities, reasoning abilities, and perception abilities using computer programs. In relation to artificial intelligence (AI), machine learning refers to learning to optimize parameters with given data using a model composed of multiple parameters. Such machine learning is classified into supervised learning, unsupervised learning, and reinforcement learning according to the form of learning data.

In general, designing data for artificial intelligence (AI) learning proceeds in the steps of data structure design, data collection, data refinement, data processing, data expansion, and data verification. To describe each step in more detail, data structure design is performed through ontology definition, classification system definition, and the like. Data collection is performed by collecting data through direct filming, web crawling, or associations/professional organizations. Data purification is performed by removing redundant data from collected data and de-identifying personal information. Data processing is performed by performing annotation and inputting metadata. Data extension is performed by performing ontology mapping and supplementing or extending the ontology as needed. In addition, data verification is performed by verifying validity according to the set target quality using various verification tools.

The following embodiments are intended to provide an image scanning method, apparatus, and system for 3D image modeling.

An image scanning method for 3D image modeling, comprising: a first image representing a 2D image of 3D content observed at a first position in a 3D coordinate system and a 2D image of the 3D content observed at a second position in the 3D coordinate system acquiring a second image; detecting a first boundary line indicating one boundary of the 3D content in the first image; detecting a second boundary line representing the one boundary in the second image; and determining a third boundary line representing the one boundary in 3D in the 3D coordinate system using the first boundary line and the second boundary line.

An apparatus according to an embodiment may be combined with hardware and controlled by a computer program stored in a medium to execute any one of the methods described above.

The following embodiments have an effect of efficiently providing an image scanning method, apparatus, and system for 3D image modeling.

1 is a flowchart illustrating an image scanning method for 3D image modeling according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a positional relationship between a target object and a plurality of cameras surrounding the target object according to an embodiment of the present invention.
3 is an exemplary diagram of a configuration of a device according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes can be made to the embodiments, the scope of rights of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents or substitutes to the embodiments are included within the scope of rights.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only, and may be modified and implemented in various forms. Therefore, the embodiments are not limited to the specific disclosed form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Although terms such as first or second may be used to describe various components, such terms should only be construed for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element.

It should be understood that when an element is referred to as being “connected” to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle.

Terms used in the examples are used only for descriptive purposes and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

In addition, in the description with reference to the accompanying drawings, the same reference numerals are given to the same components regardless of reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted.

The embodiments may be implemented in various types of products such as personal computers, laptop computers, tablet computers, smart phones, televisions, smart home appliances, intelligent vehicles, kiosks, and wearable devices.

1 is a flowchart illustrating an image scanning method for 3D image modeling according to an embodiment of the present invention.

2 is a conceptual diagram illustrating a positional relationship between a target object and a plurality of cameras surrounding the target object according to an embodiment of the present invention.

Hereinafter, a method of generating 3D content of a target object by performing an image scanning method for 3D image modeling according to an embodiment will be described with reference to FIGS. 2 and 3 .

First, the image processing device may obtain a first image and a second image of the target object (S110). The first image may be an image of the target object viewed at a first position on a 3D coordinate system. For example, when the 3D coordinate system is a real space, the first image may be a 2D image generated by photographing the target object with the first camera 321 located at any one position in the 3D coordinate system. For example, when the 3D coordinate system is a virtual 3D space, the first image may be a 2D image generated by photographing the target object with a virtual first camera located at any one position in the 3D coordinate system. Similarly, the second image may be an image of the target object viewed at a second location on a 3D coordinate system. For example, the second image may be a 2D image generated by photographing the target object with a second camera located at any one position in a 3D coordinate system.

In an embodiment, the first location and the second location are different from each other, and accordingly, images of objects expressed in the first image and the second image may be different from each other.

Next, the image processing device may detect the boundary of the target object in the first and second images (S120). An image processing device according to an embodiment may recognize an object in an image using an object recognition algorithm. Furthermore, the boundary of the target object appearing in the image may be detected by identifying the boundary of the recognized object using a boundary identification algorithm.

Meanwhile, the image processing device according to an embodiment may detect a boundary line of a target object in an image based on a user input. To this end, the image processing device according to an embodiment may display the first image on the display unit of the user terminal. Accordingly, the user can check the first image displayed on the display unit. In an embodiment, a user may input a user input for generating a first boundary line on the first image to the image processing device. Accordingly, the image processing device may obtain data indicating a first boundary line generated on the first image. For example, the image processing device may obtain data representing the first boundary line according to a user input for displaying a line segment on the display unit.

3 is an exemplary diagram of a configuration of a device according to an embodiment.

The processor 302 may control each component of the device 301 to perform an image processing method described below by controlling the operation of the device 301 .

In an embodiment, the processor 301 may generate a first image representing an image of 3D content viewed at a first location on a 3D coordinate system and a second image representing an image of 3D content viewed at a second location on the 3D coordinate system. can be obtained. The processor 110 detects a first boundary representing one boundary of the 3D content in a first image, detects a second boundary representing one boundary in a second image, and uses the first boundary and the second boundary to create a 3D image. A third boundary line representing one boundary in the coordinate system may be determined. Here, the third boundary line may be a virtual line expressed in a 3D coordinate system.

In another embodiment, the processor 301 may identify a target object included in the 3D content and obtain a first image and a second image in which the target object is expressed. The processor 301 may detect a boundary of the target object in the first image and the second image, and determine a virtual boundary in the 3D coordinate system using the detected boundary.

The memory 303 may store program data and temporary data for operation of the image processing device. Furthermore, the memory 303 may include 3D content data for performing an image processing method, 2D image data of 3D content generated at one location, and the like. Here, the 2D image data is additional information, such as positional information in the 3D coordinate system where the 2D image was created (e.g. positional information represented by x-axis, y-axis, and z-axis coordinates), camera information for generating the 2D image (e.g. angle of view, resolution , color format, direction information of the camera view angle, etc.).

The processor 302 may execute a program and control the device 301 . Codes of programs executed by the processor 302 may be stored in the memory 303 . The device 301 may be connected to an external device (eg, a personal computer or network) through an input/output device (not shown) and exchange data.

The embodiments described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic units (PLUs), microprocessors, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. The device can be commanded. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

As described above, although the embodiments have been described with limited drawings, those skilled in the art can apply various technical modifications and variations based on the above. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (3)

In the image scanning method for 3D image modeling,
Obtaining a first image representing a 2D image of 3D content observed at a first position in the 3D coordinate system and a second image representing a 2D image of the 3D content observed at a second position in the 3D coordinate system;
detecting a first boundary line indicating one boundary of the 3D content in the first image;
detecting a second boundary line representing the one boundary in the second image; and
and determining a third boundary representing the one boundary in 3D in the 3D coordinate system using the first boundary and the second boundary. According to claim 1,
Determining the third boundary line,
generating a first projection surface by projecting the first boundary line in a direction in which the 3D content is viewed from the first location;
generating a second projection surface by projecting the second boundary line in a direction in which the 3D content is viewed from the second location; and
and determining the third boundary line based on an intersection of the first projection surface and the second projection surface. According to claim 1,
The step of detecting the first boundary line,
displaying the first image on a user terminal;
expressing the first boundary line on a first image based on a user input; and
An image scanning method for 3D image modeling comprising the step of detecting the first boundary line according to the expression of the first boundary line.

Images