WO2023095956A1

WO2023095956A1 - Method, apparatus, and system for searching for and providing shape relationship information about 3d model

Info

Publication number: WO2023095956A1
Application number: PCT/KR2021/017581
Authority: WO
Inventors: 강경완; 윤덕현
Original assignee: 삼인이엔에스 주식회사
Priority date: 2021-11-26
Filing date: 2021-11-26
Publication date: 2023-06-01
Also published as: KR20230077841A

Abstract

A method, an apparatus, and a system for searching for and providing shape relationship information about a 3D model are provided. The method comprises the steps of: preprocessing the 3D model so as to extract information about coordinates for each point of the 3D model on the basis of a first interval; matching the extracted information about the coordinates for each point with information about a model identifier that includes each point, and recording same; constructing a space-based coordinate search engine having a data structure based on the record; and receiving a request for shape relationship information and a first search range setting through the constructed space-based coordinate search engine, so as to derive at least one adjacent search result model based on coordinate information about a search reference model for the received first search range, and providing, to a terminal, shape relationship information between the derived at least one search result model and the search reference model.

Description

Method, apparatus and system for retrieving and providing shape relation information of 3D model

The present invention relates to a shape comparison search of a 3D model, and more particularly, to a method, apparatus, and system for searching shape relation information by constructing shape relation information based on coordinate information extracted from a 3D model.

As the industrial structure changes with the development of digital technology, there is an increasing demand for the use of 3D models following the conventional 2D models.

However, there are many limitations in comparing and searching hundreds of thousands of various 3D model shapes in real time. Accordingly, a method for extracting the coordinates of a 3D model and retrieving model data was devised.

In this regard, Prior Art Document 1 relates to a 3D model data search, and discloses a configuration for searching and classifying a 3D model to search for a 3D model suitable for a specific purpose, but is applicable only to the entire 3D model. There is a problem in applying it to a large-capacity 3D model.

On the other hand, Prior Art Document 2 relates to 3D model integrated management, discloses a configuration for obtaining object information constituting a 3D model, storing it in a database, and providing the 3D model or object information stored in the database, However, this is also applicable only to the entire 3D model, so there is a problem in applying it to a large-capacity 3D model.

An object to be solved by the present invention is to provide a method, apparatus, and system for retrieving shape relation information such as adjacent models and similar models by constructing shape relation information based on coordinate information extracted from a 3D model.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

A method for retrieving and providing shape relation information of a 3D model in a server according to an aspect of the present invention for solving the above problems is to pre-process the 3D model for each point of the 3D model based on a first interval. extracting coordinate information; matching and recording coordinate information for each extracted point with model identifier information including each point; constructing a space-based coordinate search engine having a data structure based on the record; and receiving a request for shape relation information and setting a first search range through the configured space-based coordinate search engine, and deriving at least one adjacent search result model based on coordinate information of a search reference model for the received first search range, The method may include providing shape relation information between the derived at least one search result model and a search criterion model to a terminal.

An apparatus for retrieving and providing shape relation information of a 3D model according to an aspect of the present invention includes a memory; And a processor, wherein the processor preprocesses the 3D model to extract coordinate information for each point of the 3D model based on a first interval, and obtains coordinate information for each point extracted and coordinate information for each point Matching and recording model identifier information including, configuring a space-based coordinate search engine having a data structure based on the record, and receiving a shape relation information request and a first search range setting through the configured space-based coordinate search engine, , Deriving at least one adjacent search result model based on the coordinate information of the search reference model for the received first search range, and providing shape relation information between the derived at least one search result model and the search reference model to the terminal. can

A system for retrieving and providing shape relation information of a 3D model according to an aspect of the present invention includes: a terminal; and a server, wherein the server preprocesses the 3D model to extract coordinate information for each point of the 3D model based on a first interval, and obtains coordinate information for each point extracted and coordinate information for each point. Matching and recording model identifier information including, configuring a space-based coordinate search engine having a data structure based on the record, and receiving a shape relation information request and a first search range setting through the configured space-based coordinate search engine, , Deriving at least one adjacent search result model based on the coordinate information of the search reference model for the received first search range, and providing shape relation information between the derived at least one search result model and the search reference model to the terminal. It may include a processor that

Other specific details of the invention are included in the detailed description and drawings.

According to the present invention, it can have the following effects.

According to the present invention, it is possible to retrieve the shape relationship of the target 3D model from the server in real time or at high speed.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a block diagram illustrating a system for retrieving and providing shape relation information for a 3D model according to an embodiment of the present invention.

2 is a configuration block diagram of a server according to an embodiment of the present invention.

3 is a flowchart illustrating a method of retrieving and providing shape relation information of a 3D model according to an embodiment of the present invention.

4 is a flowchart illustrating a preprocessing process for a 3D model according to an embodiment of the present invention.

FIG. 5 is a diagram for explaining a preprocessing process related to FIG. 4 .

FIG. 6 is a diagram illustrating a data structure for constructing a space-based coordinate search engine in FIG. 3 .

7 is a flowchart illustrating a method for providing shape relation search results according to an embodiment of the present invention.

FIG. 8 is a diagram for explaining an operation of providing a shape relation search result of FIG. 3 .

Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, only these embodiments are intended to complete the disclosure of the present invention, and are common in the art to which the present invention belongs. It is provided to fully inform the person skilled in the art of the scope of the invention, and the invention is only defined by the scope of the claims.

Terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, "comprises" and/or "comprising" does not exclude the presence or addition of one or more other elements other than the recited elements. Like reference numerals throughout the specification refer to like elements, and “and/or” includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first element mentioned below may also be the second element within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention belongs. In addition, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless explicitly specifically defined.

The spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe a component's correlation with other components. Spatially relative terms should be understood as including different orientations of elements in use or operation in addition to the orientations shown in the drawings. For example, if you flip a component that is shown in a drawing, a component described as "below" or "beneath" another component will be placed "above" the other component. can Thus, the exemplary term “below” may include directions of both below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a system for retrieving and providing shape relation information for a 3D model according to an embodiment of the present invention. 2 is a block diagram of a server 150 according to an embodiment of the present invention.

Referring to FIG. 1 , a system for retrieving and providing shape relationship information for a 3D model (or three-dimensional model) according to an embodiment of the present invention includes a terminal 100 and a server 150. It can be. At this time, according to an embodiment, the system for retrieving and providing shape relation information for a 3D model includes one or more terminals 100 and server 150 shown in FIG. 1 in relation to performing operations according to the present invention. It may be configured by adding components.

The terminal 100 may request a search for shape relation information on the 3D model and output a search result according to the request. At this time, according to the embodiment, the terminal 100 may transmit or upload data on the target 3D model or a part thereof to the server 150 when requesting the shape relation information search.

The terminal 100 may be any one of a TV, a monitor, a signage, a PC, a laptop computer, a tablet PC, a smart phone, and a wearable device.

The terminal 100 may output a user interface provided by the server 150 in order to request a search for shape relationship information on the 3D model.

Depending on embodiments, a terminal for requesting a search for shape relation information on a 3D model and a terminal outputting a result of the search request may be different.

The terminal 100 provides various input and output interfaces, for example, a keyboard, a mouse, a stylus pen, a microphone, a speaker, and a display, in relation to a search request for shape relation information on the above-described 3D model and provision of a result according to the request. It may have or be connected with at least one of the like. According to an embodiment, the terminal 100 may recognize all or part of a 3D model that is a target of a search request or obtain related data through an image sensor.

The server 150 returns a search result of shape relationship information on the target 3D model in response to a search request for shape relationship information on all or part of the target 3D model input by the terminal 100 and the target 3D model. to provide.

At this time, the server 150 preprocesses the 3D model to obtain coordinate information for each point of the 3D model to be preprocessed, and refers to the coordinate information obtained in this way so that the point and the model identifier (ID) are matched. It is possible to construct a space-based coordinate search engine with a data structure.

Further, the server 150 may refer to information previously stored in a database (DB) in response to a search request of the terminal 100 and provide shape relation information of various models with respect to the target model as a search result.

Referring to FIG. 2 , the server 150 may include a memory 210 and a processor 220, wherein the memory 210 corresponds to the database (DB) described above. and store the calculated shape relationship between various 3D models and adjacent models by dividing them, and when the processor 220 receives a request for searching for shape relationship information on a target model from the terminal 100, the received In response to a search request, shape relationship information with neighboring model(s) belonging to a set search range from the memory 210 may be provided or controlled to be provided as a search result.

The server 150 may be called by various names such as a controller, a control device, and a computing device, and includes software and corresponding programs such as various programs for searching for shape relationship information on a 3D model according to the present invention and providing services related to results. It may include hardware that includes software.

In addition, the server 150 may provide a 3D model shape relationship information search service including the above search request and search result in the form of an application or web service. In the former case, the terminal 100 may download, install, and run the application provided by the server 150 to include various configurations related to the shape relation information search service of the 3D model according to the present invention.

As described above, the server 150 collects various 3D models in advance, calculates and stores shape relationship information between individual models of the corresponding 3D models, so that shape relationship information for a large-capacity 3D model is It can be serviced so that it can be quickly searched in real time.

3 is a flowchart illustrating a method of retrieving and providing shape relation information of a 3D model according to an embodiment of the present invention. 4 is a flowchart illustrating a preprocessing process for a 3D model according to an embodiment of the present invention. FIG. 5 is a diagram for explaining a preprocessing process related to FIG. 4 . FIG. 6 is a diagram illustrating a data structure for constructing a space-based coordinate search engine in FIG. 3 . 7 is a flowchart illustrating a method for providing shape relation search results according to an embodiment of the present invention. FIG. 8 is a diagram for explaining an operation of providing a shape relation search result of FIG. 3 .

For ease of understanding and description of the present invention, the flow charts of FIGS. 3, 4, and 6 are described based on the operation of the server 150 (or processor 220). At this time, FIG. 4 may be a detailed operation of the preprocessing process in FIG. 3 and FIG. 6 may be a detailed operation of the engine configuration and search process in FIG. 3 .

Referring to FIG. 3 , in operation 11, the server 150 may pre-process the 3D model and extract coordinate information for each point of the 3D model based on a first interval.

In operation 12, the server 150 matches the coordinate information for each point extracted through operation 11 with the model identifier information including each point, and records and stores the information as shown in FIG. 7, for example. .

Regarding

operations

11 and 12, referring to FIG. 3, a preprocessing operation by the server 150 will be described as follows.

In operation 21, the server 150 may extract coordinate information from the 3D model at regular intervals. For convenience, the predetermined interval in operation 21 is referred to as a first interval. The server 150 provides coordinate information for each point in the corresponding model (model identifier) at a first interval, for example, the coordinates of a face colliding with a ray in three axes, that is, x, y, and z directions. information can be extracted. Figure 5 (a) shows the result of extracting coordinate information according to operation 21.

In operation 22, the server 150 may determine whether the number of coordinate information extracted for the corresponding 3D model is less than a threshold value. Here, the threshold value may be arbitrarily set by the server 150 .

Operation 22 may be performed to secure accuracy or reliability of a preprocessing operation of the corresponding 3D model or a search result for shape relation information in the server 150 .

In operation 23, as a result of the determination in operation 22, if the number of extracted coordinates is less than the threshold value, the server 150 may extract additional coordinate information for the corresponding 3D model.

Extraction of such additional coordinate information may be performed as follows, for example. This is, for example, 1) when the size of the 3D model is smaller than the first interval, 2) when the 3D model has a complex shape or a model with a unique shape such as a thin pipe, 3) the corresponding 3 It may include a case where it is determined that the number of extracted coordinate information for the dimensional model is less than a predefined ratio compared to the size of the model bounding.

In the case of 1) above, the server 150 redesignates the corresponding 3D model by, for example, an interval smaller than the set bounding, that is, a second interval (smaller than the first interval). The coordinate information of can be extracted.

In the case of 2) above, the server 150 divides the 3D model into shape models capable of extracting coordinate information (sub-model identifier given), extracts coordinate information for the divided shape models, and then can be grouped for. Figure 5 (b) shows the result of additionally extracting coordinates from a complex model through the process of 2), for example.

In the case of 3) above, as shown in (c) of FIG. 5, the server 150 adds additional coordinates at regular intervals from vertices or edges constituting the 3D model. information can be extracted.

In operation 24, the server 150 may filter the extracted coordinate information. According to embodiments, the filtering may filter coordinate information extracted through redundant coordinate information, voxel sampling, and the like. When filtering is performed in this way, the number of initially extracted coordinate information, that is, the total number of extracted coordinate information may be reduced.

In operation 25, the server 150 may match, record, and store the ID of the corresponding model and the filtered coordinate information. 5(d) is an example of the matching-based recording. A plurality of points (including coordinate information) may be matched to one model identifier. Through this, the point can be identified through the model identifier and, conversely, the model identifier can be identified through the point.

In operation 13, the server 150 may construct a space-based coordinate search engine having a matching-based data structure in operation 12 above. Operations 11 to 13 may be repeatedly performed for various 3D models. Through this, the server 150 may provide shape relationship information search results for various target 3D models that are requested to search for shape relationship information through the terminal 100 . However, according to the embodiment, when the search results for the target 3D model requested for shape relation information search through the terminal 100 are not provided or are not sufficient, the above-described operations 11 to 13 are performed on the terminal 100. It can be performed in response to a search request of Data according to operations 11 to 13 for the corresponding 3D model performed in this way may be newly recorded and stored in the database DB.

In relation to operation 13, the server 150 constructs a space-based coordinate search engine. At this time, the operation may be performed based on the search engine data structure as shown in FIG. 6 .

Figure 6 (a) shows the data structure of the model ID, Figure 6 (b) shows the data structure of the point index. The data structure of the search engine can be formed by matching the data structure of the model ID shown in (a) of FIG. 6 with the data structure of the point index shown in (b) of FIG. 6 .

In the above, the space-based coordinate search engine can be configured based on the Kd-tree algorithm. The Kd-tree algorithm is a space partitioning data structure for structuring points in a k-dimensional space, and a binary search tree or a 3-dimensional search tree may be used. In the present invention, one example is the use of a 3D search tree, but is not limited thereto.

6, the entire model id and points have a separate data structure, each point is defined as a data structure consisting of x, y, z and model id index, and the model id is the model id and the extracted coordinate data It can be defined as a data structure composed of indexes. That is, since all coordinates have model id information, a model can be specified using a search result of the search engine, for example, an index of corresponding coordinates in a point list.

Meanwhile, in FIG. 6 , 'model id' may indicate a model identification code. This model id can be defined as, for example, an 8-digit combination of alphabets and numbers. 'Index' may indicate an identification number assigned to each of the model ids. Also, 'point index' may indicate an identification number assigned to each of the points included in the model.

In operation 14, when a shape relation information search request is received from the terminal 100 after operation 13, the server 150 uses the configured space-based coordinate search engine to search for the requested target search reference model and first search range. settings can be received. The server 150 may derive at least one adjacent search result model based on coordinate information of the search reference model with respect to the received first search range. The server 150 may provide shape relation information between the derived at least one search result model and a search reference model.

In relation to operation 14, the server 150 may perform an operation as shown in FIG. 7 to provide a shape relation information search result.

Referring to FIG. 7 , in

operations

31 and 32, when a search range is designated in the 3D model, the server 150 may search for a model id based on coordinate information within the designated search range.

At operation 33, server 150 may specify a search criteria model.

In operation 34, the server 150 may search for a neighboring model id based on the search criteria model.

In operation 35, the server 150 may provide search results, that is, shape relation information between a search reference model and an adjacent model within a search range.

In connection with operation 14, the server 150 may derive a search result for the location of the model at a high speed for searching based on coordinates. Accordingly, the server 150 may perform the following search. For example, the server 150 may search for a model id within a radius by searching for a coordinate reference range (radius). Also, the server 150 may search for at least one or more adjacent models based on model id. For example, when the server 150 performs a range search with a radius (or distance) d from all coordinates extracted from a corresponding model, the server 150 can identify all models existing within a radius d adjacent to the corresponding model.

In connection with operation 14, the search criterion model may be any one part among a plurality of parts constituting the 3D model. For example, referring to FIG. 8 , a model 810 may correspond to a search criterion model.

In relation to operation 14, the first search range may be set by the terminal, that is, an area to be searched and checked in the 3D model. For example, referring to FIG. 8 , a range 820 may correspond to the first search range. This search range may be automatically determined by settings of the server 150 or the terminal 100, and may be arbitrarily changed and set later by the user. Depending on the embodiment, the search range may be arbitrarily and automatically set with reference to the size of the search criterion model, the number of points in the search criterion model, and the like. The terminal 100 may arbitrarily change the search range after automatically setting it. According to an embodiment, when the search range by the terminal 100 is arbitrarily adjusted, the server 150 may provide a corresponding result in real time to provide convenience in setting the search range. In the process of providing results according to the adjustment of the search range, the provided result is a temporary result and may be different in form or amount of information from the result to be provided after the final search range is determined.

In operation 14, the search result model may indicate at least one part adjacent to the search criterion model within a search range. For example, referring to FIG. 8 , parts 830, 840, and 850 may correspond to a search result model. In the above, in particular, all coordinates of the first part 830 of the model are included in the search range, and the server 150 may recognize that all parts of the corresponding model are included in the search range.

That is, when the server 150 derives a plurality of adjacent search result models derived based on the coordinate information of the search reference model with respect to the received first search range, all coordinate information among the models is included in the search range. A distinction can be made between a model and a model that does not.

As shown in FIG. 8, according to the present invention, a 3D model image is provided for a region desired by the user, for example, a search range, instead of the entire large-size 3D model, and one is provided based on the search range. A search result may be selectively provided by searching for parts of the search reference model, that is, at least one or more parts disposed adjacent to the search reference model based on coordinate data included in the search reference model. In this case, according to an embodiment, a search criterion model may be arbitrarily selected according to designation of a search range. For example, the selected search criterion model may be determined as a part including the most point or coordinate information within the specified search range. Meanwhile, the search criterion model selected in this way may be changed and selected to other parts according to arbitrary adjustment of the designated search range.

Depending on the embodiment, referring to FIG. 8 , when a search criterion model is selected, a search range is automatically or manually set, and then information about at least one search result model adjacent to the search criterion model corresponding to the aforementioned search range. may be provided as a search result.

According to another embodiment, referring to FIG. 8 , if a search criterion model and a search range are specified, search results for at least one part adjacent to the specified search criterion model, that is, a search result model within the specified search range may be provided. can

Meanwhile, in relation to the above-described first search range, in the process of searching for a model that matches the coordinate data of the search reference model within the first search range R1 among the models stored in the server 150, the stored Model search may be performed by applying the second search range R2. This may be, for example, setting the 'R1<R2' relationship to be satisfied in order to minimize the case where the search ranges do not overlap in the corresponding process. For example, R2 may be 1.5 times R1. However, the present invention is not limited thereto.

According to an embodiment, when a plurality of adjacent search result models derived based on coordinate information of a search reference model are derived for the received first search range, the server 150 performs the above search result model for each derived search result model. Shape relationship information with the search reference model may be calculated, and a model adjoining the search reference model and a model overlapping the search reference model may be distinguished according to the calculation result.

Steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, implemented in a software module executed by hardware, or implemented by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any form of computer readable recording medium well known in the art to which the present invention pertains.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims

A method for retrieving and providing shape relation information of a 3D model in a server,

preprocessing the 3D model and extracting coordinate information for each point of the 3D model based on a first interval;

matching and recording coordinate information for each extracted point with model identifier information including each point;

constructing a space-based coordinate search engine having a data structure based on the record; and

Receiving a request for shape relation information and setting a first search range through the configured space-based coordinate search engine, deriving at least one search result model adjacent to the received first search range based on coordinate information of a search reference model; Providing shape relationship information between at least one derived search result model and a search reference model to a terminal,

A method for retrieving and providing shape relation information of a 3D model.
According to claim 1,

When the size of the 3D model is smaller than the first interval, extracting coordinate information of the 3D model at a second interval smaller than the set bounding,

A method for retrieving and providing shape relation information of a 3D model.
According to claim 2,

If the number of extracted coordinate information is less than the set threshold ratio compared to the bounding size of the 3D model, using vertices constituting the 3D model or additionally extracting coordinate information at regular intervals from the edge,

A method for retrieving and providing shape relation information of a 3D model.
In any one of claims 1 to 3,

The filtering is

Through coordinate information and voxel sampling duplicated in the extracted coordinate information,

A method for retrieving and providing shape relation information of a 3D model.
According to claim 1,

Receiving a changed second search range setting for the received first search range from the terminal; and

Deriving at least one search result model adjacent to the received second search range based on coordinate information of a search reference model, and providing shape relation information between the derived at least one search result model and the search reference model to a terminal. including,

A method for retrieving and providing shape relation information of a 3D model.
According to claim 1,

The search criterion model represents any one part of a plurality of parts constituting the three-dimensional model,

The first search range represents a range set as an area desired to be searched or confirmed in the 3D model by the terminal,

The search result model represents at least one or more parts adjacent to the search criterion model within the search range.

A method for retrieving and providing shape relation information of a 3D model.
According to claim 1,

When a plurality of adjacent search result models derived based on the coordinate information of a search reference model are derived for the received first search range, a model in which all coordinate information among the models is included in the search range and a model not included in the search range are determined. to distinguish,

A method for retrieving and providing shape relation information of a 3D model.
According to claim 1,

When a plurality of adjacent search result models derived based on coordinate information of a search reference model are derived for the received first search range, shape relation information with the search reference model is calculated for each search result model derived. So, according to the calculation result, distinguishing a model in contact with the search criterion model and a model overlapping the search criterion model,

A method for retrieving and providing shape relation information of a 3D model.
An apparatus for retrieving and providing shape relational information of a 3D model,

Memory; and

It includes a processor, the processor comprising:

The 3D model is preprocessed to extract coordinate information for each point of the 3D model based on a first interval, match the coordinate information for each extracted point with model identifier information including each point, and record , Configuring a space-based coordinate search engine having a data structure based on the record, receiving a request for shape relation information and setting a first search range through the configured space-based coordinate search engine, and searching for the received first search range Deriving at least one adjacent search result model based on coordinate information of the reference model, and providing shape relationship information between the derived at least one search result model and the search reference model to a terminal.

A device for retrieving and providing shape relation information of a 3D model.
A system for retrieving and providing shape relational information of a 3D model,

terminal; and

It includes a server, the server comprising:

The 3D model is preprocessed to extract coordinate information for each point of the 3D model based on a first interval, match the coordinate information for each extracted point with model identifier information including each point, and record , Configuring a space-based coordinate search engine having a data structure based on the record, receiving a request for shape relation information and setting a first search range through the configured space-based coordinate search engine, and searching for the received first search range A processor for deriving at least one adjacent search result model based on coordinate information of a reference model and providing shape relation information between the derived at least one search result model and a search reference model to the terminal,

A system for retrieving and providing information on the shape relation of a 3D model.