KR20230014604A - A method for processing a 3D intraoral model, and an apparatus for performing the same method - Google Patents

Abstract

According to embodiments, disclosed are a method and an apparatus for processing a three-dimensional (3D) oral cavity model. The disclosed method for processing a 3D oral cavity model includes the operations of: obtaining scan data obtained by scanning an object; generating an edge of a base based on the scan data; obtaining a gingival region from the scan data; and generating a mesh between the gingival region and the edge of the base, to connect the same, and obtaining tooth model data by generating the mesh using an auxiliary line at a position corresponding to the roof of a mouth.

Description

Method and apparatus for processing a 3D oral model {A method for processing a 3D intraoral model, and an apparatus for performing the same method}

The disclosed embodiments relate to methods and apparatus for processing three-dimensional oral models. Specifically, the disclosed embodiments relate to a method and apparatus for processing a three-dimensional oral model used to create a natural tooth model.

There are various fields in the dental treatment of patients. Orthodontic and prosthetic treatment are exemplified in the field of dental treatment. A model of the patient's teeth may be needed for orthodontic and prosthetic treatment. A tooth model can be an objective data showing a state before, during, and after orthodontic treatment. In addition, it is easy to directly observe parts that are difficult to directly observe due to the limited space in the oral cavity by making a tooth model. In addition, it is possible to accurately measure the space required for overcrowding, protrusion, and space elimination of teeth. In addition, when a doctor consults with a patient, it can be an objective data to show the patient's oral condition to help the patient's understanding. In addition, devices that are difficult to make directly in the patient's mouth can be modeled.

A patient's tooth model is created based on the scan data obtained by scanning the patient's oral cavity. At this time, in order to create a more natural tooth model, a method of processing an appropriate three-dimensional oral model using the scan data is required.

The disclosed embodiments relate to a method and apparatus for processing a three-dimensional oral model to create a natural tooth model.

A method of processing a 3D oral cavity model according to an embodiment includes an operation of acquiring scan data obtained by scanning an object, an operation of generating an edge of a base based on the scan data, and an operation of obtaining a gingival region from the scan data. , Creating and connecting a mesh between the gingival region and the edge of the base, and generating the mesh using an auxiliary line at a position corresponding to the palate to obtain tooth model data.

According to an embodiment, the operation of obtaining the tooth model data may include generating the auxiliary line at a position corresponding to the roof of the mouth in the gingival region and extending a boundary point of the gingival region corresponding to the roof of the mouth to the auxiliary line. It may include an operation to create a mesh.

Acquiring the tooth model data according to an embodiment may include mapping boundary points of the gingival region corresponding to the palate to points of the auxiliary line and generating a mesh based on the mapped points; and An operation of generating a mesh inside the line may be included.

According to one embodiment, the auxiliary line may include a curve or a parabola.

According to an embodiment, the obtaining of the tooth model data may include dividing the boundary of the gingival region into a plurality of regions so as to correspond to the sides of a polygon constituting the base, and points of each boundary region of the gingival region. An operation of generating points on the side of the base corresponding to each boundary area, and an operation of generating a mesh by mapping the points of each boundary area of the gingival region with the points of the side corresponding to each boundary area, so as to correspond to can include

According to an embodiment, the operation of acquiring the tooth model data may include mapping at least some of the points of the boundary region of the gingival region to points of the auxiliary line, with respect to the region corresponding to the palate, and mapping the mapped points to the points of the auxiliary line. An operation of generating a mesh based on the above, and an operation of generating a mesh inside the auxiliary line may be included.

According to an embodiment, the operation of obtaining the gingival region may include an operation of acquiring the gingival region by identifying a tooth portion and a gingival portion from the scan data and generating a gingival sidewall by extending the gingival portion. .

A data processing device for processing a three-dimensional oral cavity model according to an embodiment, comprising: a memory for storing one or more instructions; and a processor that executes one or more instructions stored in the memory, wherein the processor executes the one or more instructions to obtain scan data obtained by scanning the object, and create an edge of the base based on the scan data; , Obtaining a gingival region from the scan data, creating and connecting a mesh between the gingival region and the edge of the base, and obtaining tooth model data by generating the mesh using an auxiliary line at a position corresponding to the palate .

In the computer readable recording medium on which a program for performing a method of processing a three-dimensional oral cavity model by a data processing device is recorded according to an embodiment, the method of processing the three-dimensional oral cavity model comprises scan data obtained by scanning the oral cavity. Obtaining an operation, generating an edge of the base based on the scan data, obtaining a gingival region from the scan data, creating and connecting a mesh between the gingival region and the edge of the base, corresponding to the palate and obtaining tooth model data by generating the mesh using an auxiliary line at a position to do so.

According to the method and apparatus for processing a three-dimensional oral model according to the disclosed embodiment, it is possible to create a more natural tooth model.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention may be readily understood from the following detailed description in combination with the accompanying drawings, wherein reference numerals denote structural elements.
1 is a diagram for explaining a digital oral model processing system according to the disclosed embodiment.
2 is a reference diagram for explaining tooth model data to which a base is coupled according to an example.
3 is a block diagram illustrating a data processing device 100 according to an exemplary embodiment.
4 is a flowchart illustrating a method of processing a 3D mouth model in a data processing device according to an exemplary embodiment.
5 shows an example of a 3D oral model obtained by the data processing device 100 according to an example.
6 is a reference diagram for explaining an example of manually receiving an occlusal axis of scan data in the data processing device 100 according to an exemplary embodiment.
7 is a reference diagram for explaining an example of a method of generating a rim of an upper jaw base according to an embodiment.
8 is a reference diagram for explaining a method of obtaining a gingival region from scan data.
9 is a reference view for explaining a method of dividing a gingival region and a base into a plurality of regions and generating a mesh in an external region according to an embodiment.
10 is a reference diagram for explaining a method for generating a curve in a region corresponding to a position of the roof of the mouth according to an exemplary embodiment.
11 is a reference view for explaining a method of dividing a gingival region and a base into a plurality of regions and generating a mesh in an internal region according to an embodiment.
12 is a reference diagram for explaining a method of generating a mesh in units of each sub-region in a seventh region, which is an internal region, according to an embodiment.

This specification clarifies the scope of the present invention, explains the principles of the present invention, and discloses embodiments so that those skilled in the art can practice the present invention. The disclosed embodiments may be implemented in various forms.

Like reference numbers designate like elements throughout the specification. This specification does not describe all elements of the embodiments, and general content or overlapping content between the embodiments in the technical field to which the present invention belongs is omitted. The term 'part' (portion) used in the specification may be implemented as software or hardware, and according to embodiments, a plurality of 'parts' may be implemented as one element (unit, element), or a single 'unit'. It is also possible that section' includes a plurality of elements. Hereinafter, the working principle and embodiments of the present invention will be described with reference to the accompanying drawings.

In this specification, the image may include at least one tooth, or an image representing an oral cavity including at least one tooth (hereinafter referred to as 'oral image').

Also, in the present specification, an image may be a 2D image of an object or a 3D model or 3D image representing the object in three dimensions. Also, in this specification, an image may refer to data required to represent an object in 2D or 3D, eg, raw data obtained from at least one image sensor. Specifically, the raw data is data acquired to generate an oral image, and when scanning the oral cavity of a patient, which is an object, using an intraoral scanner, at least one image sensor included in the oral scanner It may be acquired data (eg, 2-dimensional data).

In this specification, an 'object' refers to teeth, gingiva, at least a portion of the oral cavity, and/or an artificial structure that can be inserted into the oral cavity (eg, an orthodontic device, an implant, an artificial tooth, an orthodontic aid tool inserted into the oral cavity, etc.) ) and the like. Here, the orthodontic device may include at least one of a bracket, an attachment, an orthodontic screw, a lingual orthodontic device, and a removable orthodontic retainer.

Hereinafter, embodiments will be described in detail with reference to the drawings.

1 is a diagram for explaining a digital oral model processing system according to the disclosed embodiment.

Referring to FIG. 1 , the digital mouth model processing system may include a scanning device 50 and a data processing device 100 .

The scanning device 50 is a device that scans an object, and the object may include any body or object to be scanned. For example, the object may include at least a part of the patient's body including the oral cavity or face, or a tooth model. The scanning device may include a handheld scanner that scans an object held in a user's hand, or a model scanner that scans an object by installing a tooth model and moving it around the installed tooth model.

For example, the oral scanner 51, which is a type of handheld scanner, may be inserted into the oral cavity and scan teeth in a non-contact manner, thereby obtaining an image of the oral cavity including at least one tooth. In addition, the intraoral scanner 51 may have a form capable of being drawn in and out of the oral cavity, and scans the inside of the patient's oral cavity using at least one image sensor (eg, an optical camera, etc.). The intraoral scanner 51 includes at least one of teeth, gingiva, and artificial structures (eg, orthodontic devices including brackets and wires, implants, artificial teeth, and orthodontic aids inserted into the oral cavity) that can be inserted into the oral cavity, which are objects. In order to image one surface, surface information of an object may be obtained as raw data. The intraoral scanner 51 is suitable for scanning the oral cavity as it is easily drawn in and out of the oral cavity, but it is also possible to scan body parts such as the patient's face using the intraoral scanner 51.

The scanning device 50 may acquire image data using a wide triangulation method, a confocal method, or other methods.

Image data obtained by the scanning device 50 may be transmitted to the data processing device 100 connected through a wired or wireless communication network.

The data processing device 100 is connected to the scanning device 50 through a wired or wireless communication network, receives a two-dimensional image obtained by scanning the oral cavity from the scanning device 50, and generates, processes, and displays an oral cavity image based on the received two-dimensional image. and/or any electronic device capable of transmitting.

Based on the two-dimensional image data received from the scanning device 50, the data processing device 100 generates at least one of information generated by processing the two-dimensional image data and an oral cavity image generated by processing the two-dimensional image data, and generates information and oral cavity images. Images can be displayed through the display.

The data processing device 100 may be a computing device such as a smart phone, a laptop computer, a desktop computer, a PDA, or a tablet PC, but is not limited thereto.

Also, the data processing device 100 may exist in the form of a server (or server device) for processing oral cavity images.

Also, the scan device 50 may transmit raw data obtained through scanning to the data processing device 100 as it is. In this case, the data processing device 100 may generate a 3D oral cavity image representing the oral cavity in 3D based on the received raw data. In addition, since the '3-dimensional oral image' can be generated by modeling the internal structure of the oral cavity in three dimensions based on the received raw data, a '3-dimensional oral model', 'digital oral model', or ' It may also be referred to as a 'three-dimensional oral image'. Hereinafter, a model or image representing the oral cavity in 2D or 3D will be collectively referred to as 'oral image'.

Also, the data processing device 100 may analyze, process, display, and/or transmit the generated oral cavity image to an external device.

As another example, the scan device 50 may acquire raw data through scanning, process the obtained raw data, generate an image corresponding to the oral cavity as an object, and transmit the image to the data processing device 100 . In this case, the data processing device 100 may analyze, process, display, and/or transmit the received image.

In the disclosed embodiment, the data processing device 100 is an electronic device capable of generating and displaying an oral cavity image 3-dimensionally representing an oral cavity including one or more teeth, which will be described in detail below.

According to an embodiment, when receiving raw data obtained by scanning the oral cavity from the scanning device 50, the data processing device 100 may process the received raw data to generate a 3D oral cavity model. The raw data received from the scanning device 50 may include a tooth portion representing teeth and a gingival portion representing gingiva. Accordingly, the 3D oral cavity model generated by the data processing device 100 may include a tooth portion representing teeth and a gingival portion representing gingiva.

According to an embodiment, the data processing device 100 may generate base-coupled tooth model data to be used for generating a tooth model based on an initial 3D oral model generated based on raw data. In the following description, for convenience, a three-dimensional oral model generated based on raw data will be referred to as scan data.

2 is a reference diagram for explaining tooth model data to which a base is coupled according to an example.

Referring to FIG. 2 , when a tooth model is made using only 5 million scan data obtained by scanning the oral cavity of a patient, the upper and lower jaws included in the scan data are separated as they are, so that accurate occlusion of the teeth cannot be known. Therefore, as shown in FIG. 2, in order to manufacture a tooth model in a form in which the articulation 221 can be attached to the tooth model 220, it is preferable to create the base 211 by combining the tooth model data 210 used to manufacture the tooth model.

The base for coupling the upper jaw structure and the lower jaw structure may exist in various forms. For example, the base includes a plate base type in which plates are formed on the roof of the mouth and the tongue, and a plateless base type in which the roof of the mouth and the tongue are opened.

In addition, the base has an ABO base 230 type according to the American Board of Orthodontics standards. Referring to FIG. 2 , the ABO base type includes an upper jaw base 231 and a lower jaw base 232 including the roof of the mouth, the upper jaw base has a heptagonal shape, and the lower jaw base has an oval anterior portion. In the embodiments described with reference to FIGS. 7 to 11, the ABO base type will be described as an example.

Returning to FIG. 1 , according to an exemplary embodiment, the data processing device 100 generates an edge of the base based on scan data and generates a mesh between the gingival region of the scan data and the edge of the base to obtain tooth model data 210. can In this case, the data processing device 100 may obtain tooth model data by generating a mesh using an auxiliary line at a position corresponding to the roof of the mouth.

According to an embodiment, the data processing device 100 may generate the mesh by generating an auxiliary line at a position corresponding to the roof of the mouth in the gingival region and extending a boundary point of the gingival region corresponding to the roof of the mouth to the auxiliary line.

According to an embodiment, when generating a mesh, the data processing device 100 maps boundary points of the gingival region corresponding to the roof of the mouth to points of an auxiliary line, generates a mesh based on the mapped points, and generates the mesh inside the auxiliary line. can do.

According to one embodiment, the auxiliary line may include a curve or a parabola.

According to an embodiment, the data processing device 100 divides the boundary of the gingival region into a plurality of regions corresponding to the sides of a polygon constituting the base, and each boundary region corresponds to points of each boundary region of the gingival region. A mesh may be generated by generating points on a side of a base corresponding to , and mapping points of each boundary area of the gingival region with points of a side corresponding to each boundary area.

When tooth model data generated by the data processing device 100 is provided to the tooth model manufacturing device 60, the tooth model manufacturing device 60 such as a 3D printer may generate a tooth model 220 based on the tooth model data 210.

3 is a block diagram illustrating a data processing device 100 according to an exemplary embodiment.

Referring to FIG. 3 , the data processing device 100 may include a communication interface 110 , a user interface 120 , a display 130 , a memory 140 and a processor 150 .

The communication interface 110 may perform communication with at least one external electronic device through a wired or wireless communication network. Specifically, the communication interface 110 may communicate with the scan device 50 under the control of the processor 160 . The communication interface 110 may perform communication with an external electronic device or server connected through a wired/wireless communication network under the control of a processor.

The communication interface 110 may communicate with an external electronic device (eg, intraoral scanner, server, or external medical device) through a wired or wireless communication network. Specifically, the communication interface includes at least one short-range communication module that performs communication according to communication standards such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), NFC/RFID, Wi-Fi Direct, UWB, or ZIGBEE. can do.

In addition, the communication interface 110 may further include a remote communication module that communicates with a server for supporting remote communication according to a telecommunication standard. Specifically, the communication interface 110 may include a remote communication module that performs communication through a network for internet communication. In addition, the communication interface may include a remote communication module that performs communication through a communication network conforming to communication standards such as 3G, 4G, and/or 5G.

In addition, the communication interface 110 may include at least one port for connecting to an external electronic device (eg, intraoral scanner, etc.) through a wired cable in order to communicate with the external electronic device. Accordingly, the communication interface 110 may perform communication with an external electronic device wired through at least one port.

The user interface 120 may receive a user input for controlling the data processing device. The user interface 120 includes a touch panel that detects a user's touch, a button that receives a user's push operation, and a user input including a mouse or keyboard for designating or selecting a point on a user interface screen. The device may include, but is not limited thereto.

Also, the user interface 120 may include a voice recognition device for voice recognition. For example, the voice recognition device may be a microphone, and the voice recognition device may receive a user's voice command or voice request. Accordingly, the processor may control an operation corresponding to the voice command or voice request to be performed.

The display 130 displays a screen. Specifically, the display 130 may display a predetermined screen according to the control of the processor 150 . Specifically, the display 130 may display a user interface screen including an oral cavity image generated based on data obtained by scanning the patient's oral cavity by the scanning device 50 . Alternatively, the display 130 may display a user interface screen including information related to the patient's dental treatment.

Memory 140 may store at least one instruction. Also, the memory 140 may store at least one instruction executed by the processor. Also, the memory may store at least one program executed by the processor 150 . Also, the memory 140 may store raw data received from the oral cavity scanner or oral cavity images representing the oral cavity in three dimensions.

According to an embodiment, the memory 140 may store a program for generating a three-dimensional oral model by processing raw data. A program for generating a three-dimensional oral model by processing raw data in this way may be downloaded from a server computer and stored therein.

According to an embodiment, the memory 140 may store a program for generating tooth model data based on a 3D oral model according to the method disclosed in the present disclosure. As such, a program for generating tooth model data may be downloaded and stored from a server computer.

The processor 150 executes at least one instruction stored in the memory 140 to control an intended operation to be performed. Here, at least one instruction may be stored in an internal memory included in the processor 150 or in the memory 140 included in the data processing device separately from the processor.

Specifically, the processor 150 may control at least one component included in the data processing apparatus so that an intended operation is performed by executing at least one instruction. Therefore, even if the processor performs certain operations as an example, it may mean that the processor controls at least one component included in the data processing apparatus so that the certain operations are performed.

According to an embodiment, the processor 150 acquires scan data obtained by scanning an object by executing one or more instructions stored in the memory 140, generates an edge of the base based on the scan data, obtains a gingival region from the scan data, and , Tooth model data may be obtained by generating and connecting a mesh between the boundary point of the gingival region and the edge of the base, and generating the mesh using an auxiliary line at a position corresponding to the palate.

According to an embodiment, the processor 150 executes one or more instructions stored in the memory 140 to generate an auxiliary line at a position corresponding to the roof of the mouth in the gingival region and extend a boundary point of the gingival region corresponding to the roof of the mouth to the auxiliary line to form a mesh. can create

According to an embodiment, the processor 150 executes one or more instructions stored in the memory 140 to map boundary points of the gingival region corresponding to the roof of the mouth to points of an auxiliary line, create a mesh based on the mapped points, and generate a mesh of the auxiliary line. You can create a mesh inside. According to an embodiment, the processor 150 divides the boundary of the gingival region into a plurality of regions so as to correspond to the sides of the polygon constituting the base by executing one or more instructions stored in the memory 140, and points of each boundary region of the gingival region Points are generated on the side of the base corresponding to each boundary region, and the points of each boundary region of the gingival region are mapped to the points of the side corresponding to each boundary region to generate a mesh. According to an embodiment, the processor 150 may obtain a gingival region by executing one or more instructions stored in the memory 140 to identify a tooth portion and a gingival portion from scan data, and to create a gingival sidewall by extending the gingival portion.

According to an example, the processor 150 internally includes at least one internal processor and a memory device (eg, RAM, ROM, etc.) for storing at least one of programs, instructions, signals, and data to be processed or used by the internal processor. It can be implemented in a form including.

Also, the processor 150 may include a graphic processing unit for graphic processing corresponding to video. Also, the processor may be implemented as a system on chip (SoC) in which a core and a GPU are integrated. Also, the processor may include multiple cores over a single core. For example, a processor may include a dual core, triple core, quad core, hexa core, octa core, deca core, dodeca core, hexadecimal core, and the like.

In the disclosed embodiment, the processor 150 may generate an oral cavity image based on the 2D image received from the scanning device 50 .

Specifically, under the control of the processor 150, the communication interface 110 may receive data obtained from the scan device 50, for example, raw data obtained through intraoral scanning. Also, the processor 150 may generate a 3D oral image representing the oral cavity in 3D based on the raw data received through the communication interface. For example, the intraoral scanner may include at least one camera in order to restore a 3D image according to the optical triangulation method, and in a specific embodiment, an L camera corresponding to a left field of view and a right eye An R camera corresponding to a right field of view may be included. In addition, the intraoral scanner may obtain L image data corresponding to the left field of view and R image data corresponding to the right field of view from the L camera and the R camera, respectively. Subsequently, the intraoral scanner (not shown) may transmit raw data including L image data and R image data to the communication interface of the data processing device 100 .

Then, the communication interface 110 transfers the received raw data to the processor, and the processor may generate an oral cavity image representing the oral cavity in three dimensions based on the received raw data.

Also, the processor 150 may control a communication interface to directly receive an oral cavity image representing the oral cavity in 3D from an external server, medical device, or the like. In this case, the processor may obtain a 3D oral image without generating a 3D oral image based on the raw data.

According to the disclosed embodiment, the processor 150 performing operations such as 'extraction', 'acquisition', and 'generation' means that the processor 150 executes at least one instruction to directly perform the above-described operations, as well as the above-mentioned operations. It may include controlling other components to perform actions.

In order to implement the embodiments disclosed in this disclosure, the data processing apparatus 100 may include only some of the components shown in FIG. 3 or may include more components than those shown in FIG. 3 .

In addition, the data processing device 100 may store and execute dedicated software linked to the intraoral scanner. Here, the dedicated software may be referred to as a dedicated program, a dedicated tool, or a dedicated application. When the data processing device 100 operates in conjunction with the scanning device 50, dedicated software stored in the data processing device 100 may be connected to the scanning device 50 to receive data acquired through intraoral scanning in real time. For example, there is dedicated software for processing data acquired through intraoral scanning in Medit's intraoral scanner products. Specifically, Medit produces and distributes software for processing, managing, using, and/or transmitting data obtained from intraoral scanners. Here, 'dedicated software' means a program, tool, or application that can operate in conjunction with an intraoral scanner, so that various intraoral scanners developed and sold by various manufacturers may be used in common. In addition, the above-described exclusive software may be produced and distributed separately from the intraoral scanner for performing the intraoral scan.

The data processing device 100 may download, store, and execute dedicated software for processing data acquired through intraoral scanning in Medit's intraoral scanner product from a server computer. The transmission software may perform one or more operations to acquire, process, store, and/or transmit the oral cavity image. Here, dedicated software may be stored in the processor. In addition, dedicated software may provide a user interface for use of data obtained from the intraoral scanner. Here, the user interface screen provided by dedicated software may include an oral cavity image generated according to the disclosed embodiment.

4 is a flowchart illustrating a method of processing a 3D mouth model in a data processing device according to an exemplary embodiment. The method of processing the 3D oral cavity model shown in FIG. 4 may be performed through the data processing device 100 .

Referring to FIG. 4 , in operation 410, the data processing device 100 may obtain scan data obtained by scanning the oral cavity.

The data processing device 100 receives raw data obtained by scanning the oral cavity of the patient or by scanning the tooth model from the scanning device 50, and processes the received raw data to obtain a three-dimensional oral model including teeth and gingiva. can Alternatively, the data processing device 100 may acquire raw data or a 3D oral model stored in the memory.

5 shows an example of a 3D oral model obtained by the data processing device 100 according to an example.

For example, when two-dimensional data is obtained using an intraoral scanner, the data processing device 100 may calculate coordinates of a plurality of illuminated surface points using a triangulation method. By scanning the surface of the object while moving using the intraoral scanner, coordinates of surface points may be accumulated as the amount of scan data increases. As a result of this image acquisition, a point cloud of vertices can be identified to indicate the extent of the surface. Points in the point cloud may represent actual measured points on the three-dimensional surface of the object. The surface structure can be approximated by forming a polygonal mesh in which adjacent vertices of the point cloud are connected by line segments. Polygonal meshes may be variously determined such as triangular, quadrangular, and pentagonal meshes. Relationships between polygons of the mesh model and neighboring polygons may be used to extract features of a tooth boundary, such as curvature, minimum curvature, edge, spatial relationship, and the like.

Referring to FIG. 5 , an area 501 of a 3D mouth model 500 may be composed of a plurality of vertices constituting a point cloud and a triangular mesh generated by connecting adjacent vertices with lines.

Referring to FIG. 5 , a three-dimensional mouth model 500 may include a tooth portion 510 and a gingival portion 520 . In the case of the tooth portion 510, since the tooth protrudes from the gingiva, the shape of the tooth exposed to the outside can be obtained by scanning while moving around the tooth using the scanning device 50. In the case of the gingival portion 520, the gingiva is a portion that exists between the teeth and other mucous membranes in the oral cavity, and the boundary between the gingiva and the mucous membrane is unclear, and especially the edge portion is a portion connected to other mucous membranes in the oral cavity. It's hard to do. Thus, a rough representation of the gingival portion 520 is shown. For convenience, the three-dimensional oral cavity model will be referred to as scan data below.

The next data processing device 100 may align the occlusion axes of the scan data obtained in this way.

According to an embodiment, the data processing device 100 may automatically align the occlusal axes of scan data.

According to an embodiment, the data processing device 100 may manually receive an occlusal axis of scan data through a user input.

6 is a reference diagram for explaining an example of manually receiving an occlusal axis of scan data in the data processing device 100 according to an exemplary embodiment.

Referring to FIG. 6 , the data processing device 100 may output a user interface 600 that allows scan data to be aligned with the occlusal surface in order to determine a base generation direction.

When the user selects a plurality of points, for example, three or four points in the scan data 500 from the user interface 600 output as described above, the data processing device 100 may align the occlusal surface based on the selected plurality of points. . Here, the lingual side and the buccal side in the scan data 500 may be distinguished. The occlusion axis of the scan data may be automatically calculated.

Returning to FIG. 4 again, in operation 420, the data processing device 100 may create an edge of the base based on the scan data.

The base may indicate a support structure connected to the upper and lower parts of the upper jaw and the lower jaw respectively to combine the upper and lower jaws of the patient in order to see the occlusal relationship between the upper and lower teeth of the patient. The base may include an upper jaw base connected to the upper jaw portion and a lower jaw base connected to the lower jaw portion.

7 is a reference diagram for explaining an example of a method of generating a rim of an upper jaw base according to an embodiment.

Referring to FIG. 7 , the data processing device 100 may calculate a bounding box 750 that is perpendicular to the occlusal axis of the scan data 500 and encloses the boundary of the scan data, and may generate an edge of the base extending by a predetermined distance from the bounding box 750. there is. For example, two vertexes 701 and 702 of the base may be created by descending vertically by a predetermined distance d from vertices at both ends of the base of the bounding box 750 . Here, the bottom surface of the bounding box 750 may refer to a surface generated in the lingual direction of the scan data. Based on the two vertices 701 and 702 generated as described above, the remaining vertices 703 to 707 may be obtained according to a predetermined angle. And, the rim of the base can be obtained according to the vertices 701-707.

In the example shown in FIG. 7, since the ABO base was taken as an example, the heptagonal base was described, but this is only an example. Even if the base has a different shape, if a bounding box can be created based on the scan data and the base can be created based on the bounding box, it can be seen that the base can be any number of polygons.

In addition, although the upper jaw base is taken as an example in FIG. 7 , it goes without saying that the lower jaw base can also be created in the same way.

In operation 430, the data processing device 100 may acquire the gingival region from the scan data.

8 is a reference diagram for explaining a method of obtaining a gingival region from scan data.

According to an example, the data processing device 100 may trim an edge of the gingival portion 520 of the scan data 500 and create a virtual side wall 530 connected to the gingival portion 520 . Since the scan data is composed of vertices, a virtual gingival sidewall 530 may be created by generating vertices constituting the sidewall to be connected to the gingival portion 520 . The data processing device 100 may acquire the gingival region 800 by extending the gingival sidewall 530 to the gingival portion 520 of the scan data 500 in this way.

The height of the gingival sidewall 530 to be created may vary according to the height of the gingival portion 520 included in the scan data 500 . For example, if the scan data 500 includes only a very shallow gingival portion 520, the height of the gingival side wall 530 should be relatively high. For example, if the scan data 500 includes the gingival portion 520 having a very high height, the height of the gingival sidewall 530 may be relatively low.

In the present disclosure, the term gingival region is used to indicate a portion connected to the edge of the base, which can be distinguished from the gingival portion 520 included in the scan data obtained by first scanning the oral cavity.

In operation 440, the data processing device 100 may obtain tooth model data by generating a mesh between the gingival region and the rim of the base (inside the rim of the base). At this time, the data processing device 100 calculates and creates the position of the auxiliary line inside the rim of the base (the position corresponding to the roof of the mouth), extends the gingival region (lingual region) corresponding to the roof of the mouth to the auxiliary line to create a mesh, and creates the auxiliary line. Tooth model data can be obtained by creating a mesh inside.

Hereinafter, a method of generating a mesh between the gingival region and the edge of the base will be described with reference to FIGS. 9 to 11 .

9 is a reference view for explaining a method of dividing a gingival region and a base into a plurality of regions and generating a mesh in an external region according to an embodiment.

Referring to FIG. 9 , the data processing device 100 may divide the area between the gingival area 800 and the base edge into a plurality of areas. Specifically, the data processing device 100 may divide into a plurality of regions by connecting vertices at the boundary of the gingival region 800 that are the shortest distance from each vertex of the N-gon constituting the base edge. Referring to FIG. 8 , the boundary of the gingival region 800 represents the most edge portion of the gingival region including the gingival sidewall, and represents a portion indicated by a dotted line in FIG. 9 . For example, as shown in FIG. 9 , when the figure constituting the base edge is a heptagon, it can be divided into seven regions by connecting the vertices of the gingival region 800 that are the shortest distance from each of the seven vertices. Referring to FIG. 9 , the vertex of the boundary of the gingival region 800 that is the shortest distance from vertex A of the base edge is vertex 506, the vertex of the boundary of the gingival region 800 that is the shortest distance from vertex B is vertex 413, and The vertex of the boundary of the gingival region 800 furthest away from vertex C is vertex 110, the vertex of the boundary of the gingival region 800 furthest away from vertex D is vertex 1746, and the vertex 800 the gingival region furthest away from vertex E The vertex of the boundary of is vertex 1581, the vertex of the boundary of the gingival region 800 that is the shortest distance from the vertex F is vertex 1343, and the vertex of the boundary of the gingival region 800 that is the shortest distance from the vertex G is vertex 1265.

The area between vertices A and B is area 1, the area between vertices B and C is area 2, the area between vertices C and D is area 3, the area between vertices D and E is area 4, and the area between vertices D and E is area 4. The area between and F can be defined as the 5th area, the area between the vertices F and G as the 6th area, and the area between the vertices G and A as the 7th area. Based on the gingival region 800, a seventh region corresponding to the position of the roof of the mouth may be represented as an internal region, and regions other than the internal region, from the first region to the sixth region, may be represented as external regions. The reason why the plurality of regions are divided into an external region and an internal region based on the region corresponding to the position of the roof of the mouth is that it is preferable to use a different mesh generation method due to the difference in the shape of the gingival region in each region. From Zone 1 to Zone 6 corresponding to the outer region, the gingival region is convex and the distance from the boundary of the gingival region to the base rim is relatively short, so a mesh is created by simply connecting points from the boundary of the gingival region to the base rim. can do. On the other hand, in zone 7 corresponding to the inner region, since the gingival region is concave, if a mesh is created by connecting points on the base edge in a straight line form, crumpled wrinkles may occur and the shape of the generated mesh may be unnatural. there is. Therefore, for zone 7 corresponding to the inner region, a method other than simple point connection is required to naturally generate a mesh.

For zones 1 to 6 corresponding to the outer region, a mesh is created by connecting each vertex of the boundary of the gingival region 800 and the point of the base edge. can create The boundary of the gingival region 800 may include a plurality of vertices. For example, in FIG. 9 , it can be seen that the boundary of the gingival region 800 is composed of a total of 1777 vertices from vertex 0 to vertex 1776 in the third region.

For example, zone 1 will be described as an example. The boundary of the gingival region 800 corresponding to the first zone is composed of vertices 413 to 506. Since vertex 506 corresponds to point A and vertex 413 corresponds to point B, the data processing unit 100 assigns points corresponding to vertices between vertices 506 and 413, from vertices 414 to 505, to the base border A and can be created between B. For example, 92 points can be created at even intervals between point A and point B. Also, the data processing device 100 may connect vertices existing on the boundary of the gingival region 800 and corresponding points on the base edge, and generate a mesh based on the point connections. Meshes may also be generated for the second to sixth zones, which are the remaining zones of the outer region, according to the mesh generation method in the first zone.

However, when the mesh is generated by simply connecting the vertices on the boundary of the gingival region and the points on the base edge for the seventh region corresponding to the inner region, the boundary of the gingival region of the anterior teeth has a concave shape, so that the gingiva of the anterior teeth When a mesh is created by connecting the vertices at the boundary of the region to the points of the linear base edge corresponding to the 7th zone, the mesh wrinkles in the part corresponding to the position of the roof of the mouth, which is very unnatural. can be created Therefore, it is necessary to generate a mesh in a different way for the seventh region corresponding to the inner region.

To this end, the data processing device 100 may divide and process the area corresponding to the seventh area into a plurality of sub areas so that a natural mesh can be generated in the area corresponding to the seventh area. In addition, the data processing device 100 may use auxiliary lines in order to use the area corresponding to the seventh area as a criterion for dividing the area into a plurality of sub areas. Such an auxiliary line may have a curved or parabolic shape. Such auxiliary lines may be generated according to various known curve generation techniques, and for example, a Bezier curve may be used.

10 is a reference diagram for explaining a method for generating a curve in a region corresponding to a position of the roof of the mouth according to an exemplary embodiment.

Referring to FIG. 10 , coordinates can be obtained by projecting scan data onto an xy coordinate plane. Next, find the midpoint of the section corresponding to the 7th zone of the base edge, that is, the section from A to G, draw a line from this midpoint to the boundary point of the scan data, and from the distance from this midpoint to the boundary point of the scan data Find the furthest vertex. For example, referring to FIG. 10 , among the distances from the midpoint to the boundary point of scan data in such a way as p1 from the midpoint, p2 from the midpoint, p3 from the midpoint, p4 from the midpoint, p5 from the midpoint, and p6 from the midpoint, the first distance We can find the vertex p3 corresponding to the far distance. In this case, in order to exclude the buccal side of the scan data, the case where there is a point where the line intersects, such as p6, is excluded.

In this way, the vertex p3 corresponding to the farthest distance is found, and the vertex p3 found in this way or a point within a certain distance d from the found vertex p3 can be set as the reference point p0. In addition, a curve extending from the set reference point p0 to a portion (lingual direction) corresponding to the seventh area of the base edge may be generated. In this case, a Bezier curve may be used as the shape of the curve.

11 is a reference view for explaining a method of dividing a gingival region and a base into a plurality of regions and generating a mesh in an internal region according to an embodiment.

Referring to FIG. 11 , the data processing device 100 may divide the area corresponding to the seventh area into a plurality of sub areas so that a natural mesh can be generated in the area corresponding to the seventh area. To this end, the data processing device 100 may generate a curve 1000 as described in FIG. 10 in a region corresponding to the position of the roof of the mouth.

Further, the data processing device 100 may identify vertices located at the boundary of the gingival region at the shortest distance from points H and I where the curve 1000 intersects the base edge. For example, the vertex at the boundary of the gingival region closest to point H is marked vertex 1100, and the vertex located at the boundary of the gingival region furthest from point I is marked vertex 610. For convenience, within zone 7, the area consisting of points A-I and vertices 506-610 is the first sub area, the area consisting of points H-G and vertices 1100-1265 is the second sub area, and the area between the boundary of the gingival area and the curve 1000 is The third sub area, the inner area of the curve 1000, can be divided into a fourth sub area.

Also, the data processing device 100 may generate a mesh in units of each sub-region constituting the seventh zone.

12 is a reference diagram for explaining a method of generating a mesh in units of each sub-region in a seventh region, which is an internal region, according to an embodiment.

Referring to FIG. 12 , the data processing device 100 may generate meshes for the first sub-region and the second sub-region in the same way as the method for generating meshes in the first to sixth regions corresponding to the outer regions. That is, the data processing device 100 generates as many points as the number of vertices included in the boundary of the gingival region corresponding to the first sub-region in the section between point A and point I of the base edge, and vertices at the boundary of the gingival region. Each of them is connected to the points created on the base edge, and a mesh can be created based on the point connection. The data processing device 100 may generate a mesh for the second sub-region in the same way.

Next, for the third sub-region, the data processing device 100 generates as many points as the number of vertices included in the boundary of the gingival region corresponding to the third sub-region in the 1000 section of the curve, and the gingival region corresponding to the third sub-region. Each of the vertices on the boundary of is connected to the points created on the curve 1000, and a mesh can be created based on the point connection.

Next, the data processing device 100 may generate an arbitrary mesh in the fourth sub-region, that is, in the region composed of the curve 1000 and the section between point H and point I of the base edge.

In this way, the data processing device 100 prepares a curve at a position corresponding to the roof of the mouth and generates a mesh based on the prepared curve, thereby creating a base having a smoother and softer curve without wrinkling in the area corresponding to the roof of the mouth. there is.

The oral cavity image processing method according to an embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable medium. In addition, an embodiment of the present disclosure may be a computer-readable storage medium in which one or more programs including at least one instruction for executing a method of processing an oral cavity image are recorded.

The computer readable storage medium may include program instructions, data files, data structures, etc. alone or in combination. Here, examples of computer-readable storage media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, floptical disks and Hardware devices configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like, may be included.

Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' may mean that the storage medium is a tangible device. Also, the 'non-temporary storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the oral cavity image processing method according to various embodiments disclosed in this document may be included in a computer program product and provided. A computer program product may be distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)). Alternatively, it may be distributed (eg, downloaded or uploaded) online through an application store (eg, play store, etc.) or directly between two user devices (eg, smartphones). Specifically, the computer program product according to the disclosed embodiment may include a storage medium on which a program including at least one instruction is recorded to perform the oral cavity image processing method according to the disclosed embodiment.

Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also within the scope of the present invention. belongs to

Claims (15)

In the method of processing the three-dimensional oral model,
Acquiring scan data obtained by scanning an object;
An operation of generating an edge of a base based on the scan data;
Obtaining a gingival region from the scan data;
Creating and connecting a mesh between the gingival region and the edge of the base, and generating the mesh using an auxiliary line at a position corresponding to the roof of the mouth to obtain tooth model data. According to claim 1,
The operation of obtaining the tooth model data,
Generating the auxiliary line at a position corresponding to the roof of the mouth in the gingival region and extending a boundary point of the gingival region corresponding to the roof of the mouth to the auxiliary line to generate the mesh. According to claim 2,
The operation of obtaining the tooth model data,
An operation of mapping boundary points of the gingival region corresponding to the palate to points of the auxiliary line and generating a mesh based on the mapped points; and
A three-dimensional oral model processing method comprising an operation of generating a mesh inside the auxiliary line. According to claim 1,
The auxiliary line is a three-dimensional oral model processing method comprising a curve or a parabola. According to claim 1,
The operation of obtaining the tooth model data,
Dividing the boundary of the gingival region into a plurality of regions to correspond to the sides of the polygon constituting the base;
An operation of generating points on the side of the base corresponding to each boundary region so as to correspond to the points of each boundary region of the gingival region; and
and generating a mesh by mapping points of each boundary region of the gingival region and points of a side corresponding to each boundary region. According to claim 5,
The operation of obtaining the tooth model data,
For an area corresponding to the palate, mapping at least some of the points of the boundary area of the gingival region to points of the auxiliary line, and generating a mesh based on the mapped points; and
A three-dimensional oral model processing method comprising an operation of generating a mesh inside the auxiliary line. According to claim 1,
The operation of obtaining the gingival region,
and acquiring the gingival region by identifying a tooth portion and a gingival portion from the scan data and generating a gingival sidewall by extending the gingival portion. In the data processing device for processing a three-dimensional oral model,
a memory that stores one or more instructions; and
a processor to execute one or more instructions stored in the memory;
By executing the one or more instructions, the processor:
obtaining scan data obtained by scanning the object;
Creating an edge of the base based on the scan data,
Obtaining a gingival region from the scan data;
A data processing device that generates and connects a mesh between the gingival region and an edge of the base, and obtains tooth model data by generating the mesh using an auxiliary line at a position corresponding to the palate. According to claim 8,
The processor executes the one or more instructions to obtain the tooth model data;
The data processing apparatus of claim 1 , wherein the mesh is generated by generating the auxiliary line at a position corresponding to the roof of the mouth in the gingival region and extending a boundary point of the gingival region corresponding to the roof of the mouth to the auxiliary line. According to claim 9,
The processor executes the one or more instructions to obtain the tooth model data;
Boundary points of the gingival region corresponding to the palate are mapped to points of the auxiliary line, and a mesh is generated based on the mapped points;
A data processing device that generates a mesh inside the auxiliary line. According to claim 8,
wherein the auxiliary line comprises a curve or a parabola. According to claim 8,
The processor executes the one or more instructions to obtain the tooth model data;
Dividing the boundary of the gingival region into a plurality of regions to correspond to the sides of the polygon constituting the base,
Creating points on the side of the base corresponding to each boundary region so as to correspond to the points of each boundary region of the gingival region;
The data processing apparatus of claim 1 , wherein a mesh is generated by mapping points of each boundary region of the gingival region and points of a side corresponding to each boundary region. According to claim 11,
The processor executes the one or more instructions to obtain the tooth model data;
For the region corresponding to the palate, at least some of the points of the boundary region of the gingival region are mapped to points of the auxiliary line, and a mesh is generated based on the mapped points;
A data processing device that generates a mesh inside the predetermined auxiliary line. According to claim 8,
The processor executes the one or more instructions to obtain the gingival region:
and acquiring the gingival region by identifying a tooth portion and a gingival portion from the scan data and generating a gingival sidewall by extending the gingival portion. A computer-readable recording medium on which a program for performing a method of processing a three-dimensional oral model by a data processing device is recorded, wherein the method of processing the three-dimensional oral model comprises:
Acquiring scan data obtained by scanning the oral cavity;
An operation of generating an edge of a base based on the scan data;
Obtaining a gingival region from the scan data;
A computer-readable recording medium comprising: generating and connecting a mesh between the gingiva region and an edge of the base, and obtaining tooth model data by generating the mesh using an auxiliary line at a position corresponding to the palate.

Images