KR102645173B1 - An intraoral image processing apparatus, and an intraoral image processing method - Google Patents

Abstract

The disclosed embodiments relate to an oral image processing method and an oral image processing device. The oral image processing method according to one embodiment includes acquiring three-dimensional oral data obtained by scanning the oral cavity including teeth, three-dimensional oral data obtaining a tooth area including teeth, obtaining a gingival area whose edge is a curve having a curvature smaller than the curvature of the edge of the tooth area, based on the tooth area, and finally selecting the tooth area and the gingival area. It may include the step of displaying as an area.

Description

An intraoral image processing apparatus, and an intraoral image processing method}

The disclosed embodiment relates to an oral image processing device and an oral image processing method, and specifically, to an oral image processing device and processing method for determining a selection area so that the expanded form of the gingival area selected from 3D scan data becomes natural. It's about.

Recently, a method of acquiring oral information of a patient by inserting a 3D scanner into the patient's oral cavity to obtain an image of the oral cavity has been used. By scanning the patient's oral cavity using a 3D scanner, 3D data on objects such as the patient's teeth, gums, and jawbone can be obtained, and the acquired 3D data is used for treatment or correction of teeth.

If you want to view the simulation results after scanning the patient's teeth and gingiva, showing only the teeth and gingiva data may not look good, so it is necessary to expand the gingiva to make it look good. Additionally, when creating a 3D tooth model using 3D scan data for orthodontic or prosthetic treatment, model data with expanded gingiva is required.

When expanding the gingival area selected in scan data, if the edges of the initially selected area of gingiva are not smooth, an angular shape will occur when the gingiva is expanded. Accordingly, the shape of the expanded gingiva may look unnatural. Therefore, a method of selecting the gingival area is needed so that when the selected gingival area is expanded, it has a gently curved shape without forming an angle. An example of an application related to a method of selecting (separating) the gingival area (gum area) from an oral scan image is the Korean published patent KR 2020-012055 (publication date: 2020.10.21).

The disclosed embodiment aims to provide a method of processing an oral image for determining the edge of the selected area so that it has a natural shape when the selected area is expanded in 3D scan data, and a device for performing the operation accordingly. .

A method of processing an oral image according to an embodiment includes acquiring 3D oral data obtained by scanning an oral cavity including teeth, obtaining a tooth area including the teeth from the 3D oral data, and obtaining the tooth area. Based on this, it may include obtaining a gingival area whose edge is a curve having a curvature smaller than the curvature of the edge of the tooth area, and displaying the tooth area and the gingival area as a final selection area.

Obtaining the tooth area according to an embodiment may include acquiring the tooth area by identifying scan data for teeth and scan data for gingiva included in the 3D oral data.

The step of acquiring the tooth area according to one embodiment includes, when the teeth are separated into individual tooth areas in the 3D oral data, combining the individual tooth areas into one area to obtain the tooth area. may include.

Obtaining the gingival area according to one embodiment includes obtaining a curve that is a predetermined distance away from the edge of the tooth area, and using some of the points included in the curve to determine the edge of the gingival area. It may include steps.

The oral image processing method according to one embodiment may further include displaying an object for setting the predetermined distance, and receiving a user input for the object to set the predetermined distance.

Obtaining the gingival area according to one embodiment may include determining the edge of the gingival area so that the edge of the gingival area has a curvature smaller than the curvature of the curve.

An oral image processing method according to an embodiment includes receiving a user input for selecting a palate area including scan data for the palate from the three-dimensional oral data, and selecting a lingual side of a tooth among the points included in the curve. and determining a first reference point and a second reference point for distinguishing the buccal side of the tooth, wherein the step of obtaining the gingival area includes points corresponding to the buccal side of the tooth among the points included in the curve. Based on this, it may include determining the edge of the gingival area.

An oral image processing method according to an embodiment includes obtaining a second palate area excluding a portion of the palate area based on a curve connecting the first reference point and the second reference point in the lingual area of the tooth. , and may further include displaying the second palate area as the final selection area.

The oral image processing method according to one embodiment may further include obtaining tooth model data corresponding to the final selection area by generating mesh data extending from an edge of the final selection area.

An oral image processing device according to an embodiment includes a display, a memory storing one or more instructions, and a processor, wherein the processor scans the oral cavity including teeth by executing the one or more instructions stored in the memory. Obtaining three-dimensional oral data, obtaining a tooth area including the teeth from the three-dimensional oral data, and based on the tooth area, having a curve having a curvature smaller than the curvature of the edge of the tooth area as an edge. The display can be controlled to acquire the gingival area and display the tooth area and the gingival area as the final selection area.

The oral image processing device and oral image processing method according to the disclosed embodiment may determine the edges of the selected area so that when the selected area in the 3D scan data is expanded, it has a gently curved shape without any angles. Accordingly, when the selected gingival area is expanded, it is possible to prevent an unnatural shape.

The present invention may be readily understood by combination of the following detailed description and accompanying drawings, where reference numerals refer to structural elements.
1 is a diagram for explaining an oral image processing system according to a disclosed embodiment.
Figure 2 is a diagram showing tooth model data to which a base is combined according to one embodiment.
FIGS. 3 and 4 are diagrams referenced to explain an operation in which an oral image processing device selects an area for generating tooth model data from scan data, according to an embodiment.
FIGS. 5A and 5B are diagrams referenced to explain a method of adjusting the range of a gingival area selected by an oral image processing device according to an embodiment.
FIGS. 6A and 6B are diagrams for explaining a method of selecting an area in scanned data using a selection tool, according to an embodiment.
FIGS. 7 to 8C are diagrams for explaining an operation of an oral image processing device selecting a region from scan data to include the palate region, according to an embodiment.
Figure 9 is a flowchart showing an oral image processing method according to an embodiment.
Figure 10 is a block diagram showing an oral image processing device according to an embodiment.

This specification clarifies the scope of rights of the present invention, explains the principles of the present invention, and discloses embodiments so that those skilled in the art can practice the present invention. The disclosed embodiments may be implemented in various forms.

Like reference numerals refer to like elements throughout the specification. This specification does not describe all elements of the embodiments, and general content or overlapping content between the embodiments in the technical field to which the present invention pertains is omitted. The term 'part' (portion) used in the specification may be implemented as software or hardware, and depending on the embodiment, a plurality of 'portions' may be implemented as a single element (unit, element) or as a single 'portion'. It is also possible for 'boo' to contain plural elements. Hereinafter, the operating principle and embodiments of the present invention will be described with reference to the attached drawings.

In this specification, an image may include an image representing at least one tooth or an oral cavity including at least one tooth (hereinafter referred to as an 'oral image').

Additionally, in this specification, an image may be a two-dimensional image of an object, a three-dimensional model or a three-dimensional image representing the object in three dimensions. Additionally, in this specification, an image may refer to data required to represent an object in two or three dimensions, for example, raw data obtained from at least one image sensor. Specifically, raw data is data acquired to create an oral image, and is acquired from at least one image sensor included in the 3D scanner when the inside of the oral cavity of the subject, a patient, is scanned using a 3D scanner. It can be data (for example, two-dimensional data).

In this specification, 'object' refers to teeth, gingiva, at least some areas of the oral cavity, and/or artificial structures that can be inserted into the oral cavity (e.g., orthodontic devices, implants, artificial teeth, orthodontic aids inserted into the oral cavity, etc. ), etc. may be included. Here, the correction device may include at least one of a bracket, an attachment, a correction screw, a lingual correction device, and a removable correction retainer.

Hereinafter, embodiments will be described in detail with reference to the drawings.

1 is a diagram for explaining an oral image processing system according to a disclosed embodiment.

Referring to FIG. 1, the oral image processing system includes a 3D scanner 10 and an oral image processing device 100.

The 3D scanner 10 according to one embodiment is a device that scans an object and is a medical device for acquiring images of the oral cavity. Additionally, the 3D scanner 10 may scan at least a part of the patient's body, such as the patient's face, or a tooth model in addition to the oral cavity.

In FIG. 1, the 3D scanner 10 is shown in the form of a handheld scanner that the user holds in his hand and scans an object, but the 3D scanner 10 is not limited to this, and the 3D scanner 10 installs a tooth model and scans while the installed tooth model moves. It may include forms such as a model scanner.

Specifically, the 3D scanner 10 may be a device for acquiring an image of the oral cavity including at least one tooth by being inserted into the oral cavity and scanning teeth in a non-contact manner. Additionally, the 3D scanner 10 may have a shape that allows insertion and extraction into the oral cavity, and scans the inside of the patient's oral cavity using at least one image sensor (eg, an optical camera, etc.). The 3D scanner 10 is an object, such as teeth inside the oral cavity, gingiva, and artificial structures that can be inserted into the oral cavity (e.g., orthodontic devices including brackets and wires, implants, artificial teeth, orthodontic auxiliary tools inserted into the oral cavity, etc. ), surface information about the object may be acquired as raw data.

Image data acquired from the 3D scanner 10 may be transmitted to the oral image processing device 100 connected through a wired or wireless communication network.

The oral image processing device 100 is connected to the 3D scanner 10 through a wired or wireless communication network, receives a two-dimensional image obtained by scanning the oral cavity from the 3D scanner 10, and generates data based on the received two-dimensional image. It can be any electronic device capable of generating, processing, displaying and/or transmitting oral images.

Based on the two-dimensional image data received from the three-dimensional scanner 10, the oral image processing device 100 may process the two-dimensional image data to generate information, or may process the two-dimensional image data to generate an oral image. Additionally, the oral image processing device 100 may display the generated information and oral image through the display 130.

The oral image processing device 100 may be a computing device such as a smart phone, laptop computer, desktop computer, PDA, or tablet PC, but is not limited thereto.

Additionally, the oral image processing device 100 may exist in the form of a server (or server device) for processing oral images.

Additionally, the 3D scanner 10 may transmit raw data obtained through an oral scan to the oral image processing device 100 as is or may partially process the raw data and transmit the raw data. In this case, the oral image processing device 100 may generate a 3D oral image representing the oral cavity in 3D based on the received raw data. The oral image processing device 100 according to one embodiment generates three-dimensional data (e.g., surface data, mesh data, etc.) that three-dimensionally represents the shape of the surface of the object, based on the received raw data. You can.

Additionally, since the '3D oral image' can be created by modeling the internal structure of the oral cavity in three dimensions based on the received raw data, it may also be called a '3D oral model'. Hereinafter, models or images representing the oral cavity in two or three dimensions will be collectively referred to as 'oral images'.

Additionally, the oral image processing device 100 may analyze, process, display, and/or transmit the generated oral image to an external device.

As another example, the 3D scanner 10 acquires raw data through an oral scan, processes the acquired raw data to generate an image corresponding to the oral cavity as an object, and transmits the raw data to the oral image processing device 100. Can be transmitted. In this case, the oral image processing device 100 may analyze, process, display, and/or transmit the received image.

In the disclosed embodiment, the oral image processing device 100 is an electronic device capable of generating and displaying an oral image three-dimensionally representing the oral cavity including one or more teeth, which will be described in detail below.

When the oral image processing device 100 according to one embodiment receives raw data of scanning the oral cavity from the 3D scanner 10, it processes the received raw data to create a 3D oral image (or 3D oral model). can be created. For convenience of explanation, the 3D oral image generated by the oral image processing device 100 will hereinafter be referred to as 'scan data'.

Raw data received from the 3D scanner 10 may include tooth data representing teeth and gingival data representing gingiva. Accordingly, scan data generated by the oral image processing device 100 may include a tooth area and a gingival area. Alternatively, raw data according to one embodiment may include data representing the palate, and accordingly, scan data may include the palate area. However, it is not limited to this.

According to one embodiment, when creating a tooth model using scan data, when the tooth model is created using the tooth area and some gingival areas 50 included in the scan data, the upper and lower jaw are separated and the teeth The exact occlusion becomes unknown. Accordingly, in order to create a tooth model in a form that can attach articulation for combining the upper and lower jaws, it is necessary to generate tooth model data 70 with the base combined. In order to generate tooth model data 70 to which the base is combined, the edge of the gingival area 55 selected in the scan data must be extended to the base 75. With reference to FIG. 2, a method of generating tooth model data by extending the edge of the gingival area to the base will be described.

Figure 2 is a diagram showing tooth model data to which a base is combined according to one embodiment.

The oral image processing device 100 according to one embodiment may generate tooth model data with a combined base using a tooth area and a partial gingival area selected from scan data. The oral image processing device 100 may expand the gingival area to the base by generating three-dimensional data (eg, mesh data) between the edge and the base of the selected gingival area.

At this time, if the edge of the gingival area selected in the scan data is not smooth, angled or concave shapes 211, 212, and 213 may be created in the expanded area included in the generated tooth model data 210. Accordingly, the generated tooth model data 210 may have an unnatural form.

On the other hand, if the edge of the gingival area selected in the scan data is smooth, the expanded area included in the generated tooth model data 220 may include a gently curved shape. Accordingly, the generated tooth model data 220 may be in a natural form.

Accordingly, when selecting a tooth area and a partial gingival area from scan data to generate tooth model data, it is necessary to select the gingival area so that the edges of the selected gingival area are smooth.

FIGS. 3 and 4 are diagrams referenced to explain an operation in which an oral image processing device selects an area for generating tooth model data from scan data, according to an embodiment.

The oral image processing device 100 according to an embodiment may generate scan data based on raw data acquired by the 3D scanner 10. Additionally, the oral image processing device 100 may visually output scan data 302 through the user interface screen 301. The user interface screen 301 may be the screen of the display 130 of FIG. 1 . The user interface screen 301 may include at least one menu to allow the user to analyze or process the scan data 302.

For example, the user interface screen 301 may include a region designation icon 310 that can designate a region in the scan data 302 to generate tooth model data.

When receiving a user input for selecting the area designation icon 310, the oral image processing device 100 can automatically select and display the area 320 for generating tooth model data from the scan data 302. . At this time, the selected area 320 may be displayed to be distinguished from the unselected area. For example, the selected area 320 may be highlighted and displayed in a different color from the unselected area, or the border of the area may be displayed to distinguish it. However, it is not limited to this.

When the oral image processing device 100 according to one embodiment receives a user input for selecting the region designation icon 310 of FIG. 3, it may obtain a tooth region including teeth from the scan data 302.

Referring to FIG. 4 , the oral image processing device 100 may obtain a tooth area 410 by segmenting the tooth area and the gingival area in the scan data 302. Segmenting the tooth area 410 and the gingival area in the scan data may mean dividing the teeth included in the scan data into the gingival area. The oral image processing device 100 may segment the tooth area 410 and the gingival area by identifying scan data for teeth and scan data for gingiva included in the scan data.

The oral image processing device 100 according to one embodiment may segment the tooth area and the gingival area in the scan data 302 using artificial intelligence (AI) without user input.

Meanwhile, when the teeth included in the tooth area are separated into individual tooth areas through segmentation, the oral image processing device 100 can obtain the tooth area 410 by combining the individual tooth areas into one area. there is.

When the tooth area 410 is acquired, the oral image processing device 100 may acquire the first gingival area 420 whose edge is the first curve 425 that is a predetermined distance away from the edge of the tooth area 410. there is. For example, the oral image processing device 100 may obtain a first curve 425 connecting vertices that are a predetermined distance away from each of the vertices included in the edge 415 of the tooth area 410. At this time, the predetermined distance may be adjusted based on user input. This will be described later with reference to FIGS. 5 and 6.

Meanwhile, when the first curve 425 is acquired, the oral image processing device 100 divides the area between the edge 415 of the tooth area 410 and the first curve 425 into the first gingival area 420. It can be obtained.

The oral image processing device 100 may generate the second curve 435 using some of the points included in the first curve 425. The second curve 435 may be an interpolation curve that connects some of the points included in the first curve 425 so that the curvature is smaller than that of the first curve 425.

Alternatively, the points included in the first curve 425 are grouped based on the x-axis coordinate value, and for each group, the point with the smallest z-axis coordinate value is selected among the points included in one group, and the selected points are connected. Thus, the second curve 435 can be generated. The oral image processing device 100 may acquire the area between the edge 415 of the tooth area 410 and the second curve 435 as the second gingival area 430.

Alternatively, the oral image processing device 100 smoothes the second curve 435, and defines the area between the edge 415 of the tooth area 410 and the smoothed second curve as the second gingival area. It can be obtained.

As shown in FIG. 3 , the oral image processing device 100 may display the tooth area and the second gingival area as the final selection area 320.

Accordingly, the edge of the gingival area included in the final selection area 320 may be formed with a gentle curve.

FIGS. 5A and 5B are diagrams referenced to explain a method of adjusting the range of a gingival area selected by an oral image processing device according to an embodiment.

Referring to FIG. 5A, the user interface screen 501 may include an object 510 that can adjust the distance from the edge of the tooth area to the edge of the first gingival area (or second gingival area). For example, the object 510 may include a scroll bar that can scroll left and right. As you scroll to the left, the distance from the edge of the tooth area to the edge of the first gingival area (or second gingival area) decreases, and as you scroll to the right, the distance from the edge of the tooth area to the edge of the first gingival area (or The distance to the edge of the second gingival region may increase.

As shown in FIG. 5A, when the scroll is located at the first point 521, the oral image processing device 100 creates a first curve whose edge is a first distance d1 from the edge of the tooth area. The gingival area can be acquired, and a second gingival area 531 whose edge is a curve obtained by interpolating the edge of the first gingival area can be obtained.

Meanwhile, as shown in FIG. 5B, when the scroll is located at the second point 522 located to the right of the first point, the oral image processing device 100 operates at a distance greater than the first distance d1 from the edge of the tooth area. It is possible to obtain a first gingival area whose edge is a curve separated by a second distance (d2), and to obtain a second gingival area 532 whose edge is a curve obtained by interpolating the edge of the first gingival area. Accordingly, the second gingival area 532 of Figure 5b becomes larger than the second gingival area 531 of Figure 5a.

Accordingly, the user can easily adjust the range of the gingival area using the scroll bar.

FIGS. 6A and 6B are diagrams for explaining a method of selecting an area in scanned data using a selection tool, according to an embodiment.

The oral image processing device 100 according to one embodiment may automatically select a tooth area and a partial gingival area, as described in FIGS. 3 to 5B, but is not limited thereto, and may select a region from scan data based on user input. You can select some areas. Alternatively, the oral image processing device 100 may automatically select some areas based on user input after the tooth area and some gingival areas are automatically selected.

The user interface screen 601 according to one embodiment may include at least one selection tool menu for selecting a partial area from scan data.

For example, referring to FIG. 6A, the selection tool menu may include a brush menu 610. When a user input for selecting the brush menu 610 is received, the oral image processing device 100 may display a brush icon 620 and items 630 for selecting the size of the brush. When one of the items is selected, the oral image processing device 100 may change the size of the brush icon 620 to the selected size. The oral image processing device 100 may select a partial area 640 based on a user input that moves the brush icon 620.

Additionally, referring to FIG. 6B, the selection tool menu may include a polygon selection menu 650. When the oral image processing device 100 receives a user input for selecting at least one point 661, 662, 663 included in the scan data while the polygon selection menu 650 is selected, the selected points 661 , 662, and 663) can be connected to create a polygon, and the inner area 660 of the polygon can be selected.

When some areas are selected from scan data based on user input using a selection tool, the oral image processing device 100 according to one embodiment generates a curve so that the edges of the selected area are gentle, and applies the generated curve to the selected area. It can be changed to the edge of the area.

FIGS. 7 to 8C are diagrams for explaining an operation of an oral image processing device selecting a region from scan data to include the palate region, according to an embodiment.

Referring to FIG. 7, scan data 710 according to one embodiment may include scan data for the palate. The oral image processing device 100 may select an area from the scan data 710 to include the palate area. At this time, whether to include the palate area may be determined based on user input. For example, the user can set the tooth model data to include the palate area through a menu or the like, or can additionally select the palate area using a selection tool such as a brush or polygon. However, it is not limited to this.

As shown in FIG. 7 , the oral image processing device 100 according to one embodiment may select and display a partial area 720 of the scan data 710 to include the palate area. An operation of the oral image processing device 100 according to an embodiment of selecting an area to include the palate area in scan data will be described in detail with reference to FIGS. 8A to 8C.

Referring to FIG. 8A , scan data 810 according to one embodiment may include the palate area 801. The oral image processing device 100 may acquire the tooth area 820 from the scan data 810. At this time, since the method of acquiring the tooth area 820 from the scan data 810 has been described in detail in FIG. 4, detailed description will be omitted.

When the tooth area 820 is acquired, the oral image processing device 100 may acquire a first gingival area 830 whose edge is the first curve 825 that is a predetermined distance away from the edge of the tooth area 820. there is. Since the method for obtaining the first gingival area 830 has been described in detail in FIG. 4, detailed description will be omitted.

When the first gingival area 830 is acquired, the oral image processing device 100 selects a first reference point and a first reference point for distinguishing the buccal side of the tooth from the lingual side of the tooth among the points included at the edge of the first gingival area 830. 2 A reference point can be determined.

For example, the oral image processing device 100 may acquire a bounding box 840 including scan data 810, as shown in FIG. 8B. At this time, the scan data 810 may be aligned so that the buccal direction of the teeth is located in a first direction (eg, upward) and the lingual side of the teeth is positioned in a second direction (eg, downward).

The oral image processing device 100 selects the two points closest to each of the lower two vertices B1 and B2 of the bounding box 840 among the points included at the edge of the first gingival area 830 as the first reference point ( It can be determined by b1) and the second reference point (b2).

The oral image processing device 100 selects some of the points included in the edge corresponding to the buccal side of the tooth between the first reference point (b1) and the second reference point (b2) among the edges 825 of the first gingival region 830. Based on this, the second curve 850 can be generated. The oral image processing device 100 may acquire the area from the edge of the tooth area 820 to the second curve 850 as the second gingival area 835.

In addition, the oral image processing device 100 generates a third curve 860 connecting the first reference point b1 and the second reference point b2 in the lingual area of the tooth, and based on the third curve 860, , the second palate area 870 excluding some areas of the palate area 801 can be obtained.

For example, as shown in FIG. 8C, palate area data located in the outer area of the third curve 860 based on the third curve 860 among the palate area 801 may be excluded from the selection area.

As shown in FIG. 8C, the oral image processing device 100 may display the tooth area 820, the second gingival area 835, and the second palate area 870 as the final selection area. Accordingly, the edge of the final selection area may have a gentle curve.

The oral image processing device 100 according to one embodiment may generate tooth model data based on the finally selected area. For example, the oral image processing device 100 may expand the gingival area to the base by generating mesh data between the base determined based on the final selected area and the edge of the final selected area.

At this time, since the edge of the final selected area has a gently curved shape, the expanded area may include a gently curved shape.

Figure 9 is a flowchart showing an oral image processing method according to an embodiment.

The oral image processing method shown in FIG. 9 may be performed by the oral image processing device 100.

Referring to FIG. 9, the oral image processing device 100 according to one embodiment may acquire 3D oral data (scan data) (S910).

The oral image processing device 100 receives raw data obtained by scanning the inside of the oral cavity including teeth or by scanning a tooth model using the 3D scanner 10, and performs a scan based on the received raw data. Data can be generated. Alternatively, the oral image processing device 100 may acquire scan data stored in memory.

The oral image processing device 100 may obtain a tooth area including teeth from scan data (S920).

For example, the oral image processing device 100 may obtain the tooth area by segmenting the tooth area and the gingival area in the scan data. Segmenting the tooth area and the gingival area in scan data may mean dividing the teeth included in the scan data into the gingival area. The oral image processing device 100 may segment the tooth area and the gingival area by identifying the scan data for the teeth and the scan data for the gingiva included in the scan data.

The oral image processing device 100 according to one embodiment may acquire the first gingival area based on the tooth area (S930).

When the tooth area is acquired, the oral image processing device 100 may acquire a first gingival area whose edge is a first curve that is a predetermined distance away from the edge of the tooth area. For example, the oral image processing device 100 may obtain a first curve connecting vertices that are a predetermined distance away from each of the vertices included in the edge of the tooth area. At this time, the predetermined distance may be adjusted based on user input.

The oral image processing device 100 according to one embodiment may acquire a second gingival area based on the first gingival area (S940).

For example, the oral image processing device 100 may generate a second curve using some of the points included in the edge (first curve) of the first gingival area. At this time, the second curve may be a curve that connects some of the points included in the first curve so that the curvature is smaller than that of the first curve. The second curve includes a gentler shape than the first curve.

The oral image processing device 100 may acquire the area between the edge of the tooth area and the second curve as the second gingival area.

The oral image processing device 100 according to one embodiment may display the tooth area and the second gingival area as the final selection area (S950).

Accordingly, the edge of the gingival area included in the final selection area may be formed with a gentle curve.

Figure 10 is a block diagram showing an oral image processing device according to an embodiment.

The oral image processing method shown in FIG. 9 may be performed using the oral image processing device 100. Accordingly, the method of processing an oral image shown in FIG. 9 may be a flowchart showing the operations of the oral image processing device 100.

Referring to FIG. 10 , the oral image processing device 100 may include a communication interface 110, a user interface 120, a display 130, a memory 140, and a processor 150.

The communication interface 110 may communicate with at least one external electronic device (eg, 3D scanner 10, a server, or an external medical device) through a wired or wireless communication network. The communication interface 110 may communicate with at least one external device under the control of the processor 150.

Specifically, the communication interface 110 is at least one short-distance communication device that performs communication according to communication standards such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC/RFID, Wifi Direct, UWB, or ZIGBEE. Can contain modules.

Additionally, the communication interface 110 may further include a long-distance communication module that communicates with a server to support long-distance communication according to long-distance communication standards. Specifically, the communication interface 110 may include a long-distance communication module that performs communication through a network for Internet communication. Additionally, the communication interface 110 may include a long-distance communication module that performs communication through a communication network compliant with communication standards such as 3G, 4G, and/or 5G.

Additionally, the communication interface 110 may include at least one port for connecting to an external electronic device (eg, a 3D scanner, etc.) via a wired cable in order to communicate with the external electronic device via a wired cable. Accordingly, the communication interface 110 can communicate with a wired external electronic device through at least one port.

The user interface 120 may receive user input for controlling the oral image processing device 100. The user interface 120 includes a touch panel that detects the user's touch, a button that receives the user's push operation, and a mouse or keyboard for specifying or selecting a point on the user interface screen. May include, but is not limited to, user input devices.

Additionally, the user interface 120 may include a voice recognition device for voice recognition. For example, the voice recognition device can be a microphone, and the voice recognition device can receive a user's voice command or voice request. Accordingly, the processor 150 may control the operation corresponding to the voice command or voice request to be performed.

The display 130 displays a screen. Specifically, the display 130 may display a predetermined screen under the control of the processor 150. Specifically, the display 130 may display a user interface screen including an oral image generated based on data obtained by scanning the patient's oral cavity with the 3D scanner 10. Alternatively, the display 130 may display a user interface screen including information related to the patient's dental treatment.

Memory 140 may store at least one instruction. Additionally, the memory 140 may store at least one instruction that the processor 150 executes. Additionally, the memory 140 may store at least one program that the processor 150 executes. Additionally, the memory 140 may store data received from the 3D scanner 10 (eg, raw data obtained through an oral scan, etc.). Alternatively, the memory 140 may store an oral image representing the oral cavity in three dimensions. Memory 140 according to one embodiment may include one or more instructions for deleting noise data from an oral image. Memory 140 according to one embodiment may include one or more instructions for performing the method disclosed in this disclosure for deleting noise data from an oral image.

The processor 150 executes at least one instruction stored in the memory 140 and controls the intended operation to be performed. Here, at least one instruction may be stored in the internal memory included in the processor 150 or in the memory 140 included in the data processing device separately from the processor.

Specifically, the processor 150 may execute at least one instruction and control at least one component included in the data processing device so that the intended operation is performed. Accordingly, even if the case in which the processor performs certain operations is used as an example, it may mean that the processor controls at least one component included in the data processing device so that certain operations are performed.

The processor 150 according to one embodiment generates scan data based on raw data obtained by scanning the oral cavity including teeth or scanning a tooth model by executing one or more instructions stored in the memory 140. can do. The processor 150 may obtain a tooth area including teeth from scan data by executing one or more instructions stored in the memory 140. The processor 150 may obtain the tooth area by segmenting the tooth area and the gingival area in the scan data.

The processor 150 may acquire the first gingival area based on the tooth area by executing one or more instructions stored in the memory 140. When the tooth area is acquired, the processor 150 may acquire a first gingival area whose edge is a first curve that is a predetermined distance away from the edge of the tooth area. For example, the processor 150 may obtain a first curve connecting vertices that are a predetermined distance away from each of the vertices included in the edge of the tooth area. The processor 150 may acquire a second gingival area based on the first gingival area by executing one or more instructions stored in the memory 140. The processor 150 may generate a second curve using some of the points included in the edge (first curve) of the first gingival area. At this time, the second curve may be a curve that connects some of the points included in the first curve so that the curvature is smaller than that of the first curve. The second curve has a gentler shape than the first curve.

The processor 150 may acquire the area between the edge of the tooth area and the second curve as the second gingival area.

The processor 150 may display the tooth area and the second gingival area as the final selection area.

The processor 150 executes one or more instructions stored in the memory 140, so that when selecting a region including the palate region in the scan data, the processor 150 selects a first reference point and a second reference point for distinguishing the buccal side of the tooth and the lingual side of the tooth. can be decided. The processor 150 generates a curve based on some of the points included in the edge corresponding to the buccal side of the tooth between the first reference point and the second reference point among the edges of the first gingival area, and based on the generated curve , the second gingival area can be obtained.

Additionally, the processor 150 determines the second palate region based on a curve connecting the first reference point and the second reference point in the lingual region of the tooth, and based on some of the points included in the edge of the second palatal region. Thus, a curve can be created, and a third palate region with the generated curve as an edge can be obtained.

The processor 150 may display the tooth area, the second gingival area, and the third palate area as the final selection area.

The processor 150 according to an example internally includes at least one internal processor and a memory element (e.g., RAM, ROM, etc.) for storing at least one of programs, instructions, signals, and data to be processed or used in the internal processor. ) can be implemented in a form including.

Additionally, the processor 150 may include a graphics processor (Graphic Processing Unit) for graphics processing corresponding to video. Additionally, the processor may be implemented as a System On Chip (SoC) that integrates a core and GPU. Additionally, the processor may include multiple cores or more than a single core. For example, the processor may include dual core, triple core, quad core, hexa core, octa core, deca core, dodeca core, hexa core, etc.

In the disclosed embodiment, the processor 150 may generate an oral image based on a two-dimensional image received from the three-dimensional scanner 10.

Specifically, under the control of the processor 150, the communication interface 110 may receive data obtained from the 3D scanner 10, for example, raw data obtained through an oral scan. Additionally, the processor 150 may generate a 3D oral image representing the oral cavity in 3D based on the raw data received from the communication interface 110. For example, in order to restore a 3D image according to the optical triangulation method, the 3D scanner 10 uses an L camera corresponding to the left field of view and an R camera corresponding to the right field of view. May include a camera. Additionally, the 3D scanner can acquire L image data corresponding to the left field of view and R image data corresponding to the right field of view from each of the L camera and the R camera. Continuing, the 3D scanner may transmit raw data including L image data and R image data to the communication interface 110 of the oral image processing device 100.

Then, the communication interface 110 transfers the received raw data to the processor 150, and the processor 150 can generate an oral image representing the oral cavity in three dimensions based on the received raw data.

Additionally, the processor 150 can control the communication interface 110 to directly receive an oral image representing the oral cavity in three dimensions from an external server, medical device, etc. In this case, the processor may acquire a 3D oral image without generating a 3D oral image based on raw data.

According to the disclosed embodiment, the processor 150 performing operations such as 'extraction', 'acquisition', and 'generation' means that the processor 150 directly performs the above-described operations by executing at least one instruction. Additionally, it may include controlling other components so that the above-described operations are performed.

In order to implement the embodiments disclosed in this disclosure, the oral image processing device 100 may include only some of the components shown in FIG. 10 or may include more components in addition to the components shown in FIG. 10. there is.

Additionally, the oral image processing device 100 can store and execute dedicated software linked to a 3D scanner. Here, dedicated software may be referred to as a dedicated program, dedicated tool, or dedicated application. When the oral image processing device 100 operates in conjunction with the 3D scanner 10, the dedicated software stored in the oral image processing device 100 is connected to the 3D scanner 10 to obtain data through an oral scan. Data can be received in real time. For example, Medit's i500 3D scanner product has dedicated software to process data obtained through intraoral scanning. Specifically, Medit produces and distributes 'Medit Link', software for processing, managing, using, and/or transmitting data acquired from a 3D scanner (e.g., i500). Here, 'dedicated software' refers to a program, tool, or application that can operate in conjunction with a 3D scanner, so it may be commonly used by various 3D scanners developed and sold by various manufacturers. Additionally, the above-described dedicated software can be produced and distributed separately from the 3D scanner that performs the intraoral scan.

The oral image processing device 100 can store and execute dedicated software corresponding to the i500 product. Transmission software may perform at least one operation to acquire, process, store, and/or transmit an oral image. Here, dedicated software may be stored in the processor. Additionally, dedicated software can provide a user interface for using data acquired from a 3D scanner. Here, the user interface screen provided by the dedicated software may include an oral image created according to the disclosed embodiment.

The method of processing oral images according to an embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. Additionally, an embodiment of the present disclosure may be a computer-readable storage medium on which one or more programs including at least one instruction for executing a method of processing oral images are recorded.

The computer-readable storage medium may include program instructions, data files, data structures, etc., singly or in combination. Here, examples of computer-readable storage media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and floptical disks. Magneto-optical media such as magneto-optical media, and hardware devices configured to store and perform program instructions such as ROM, RAM, flash memory, etc. may be included.

Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, ‘non-transitory storage medium’ may mean that the storage medium is a tangible device. Additionally, the 'non-transitory storage medium' may include a buffer where data is temporarily stored.

According to one embodiment, the oral image processing method according to various embodiments disclosed in this document may be included and provided in a computer program product. The computer program product may be distributed on a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)). Alternatively, it may be distributed (e.g., downloaded or uploaded) online, through an application store (e.g., Play Store, etc.) or directly between two user devices (e.g., smartphones). Specifically, the computer program product according to the disclosed embodiment may include a storage medium on which a program including at least one instruction for performing the method of processing an oral image according to the disclosed embodiment is recorded.

Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concept of the present invention defined in the following claims are also included in the scope of the present invention. belongs to

Claims (18)

In the oral image processing method,
Obtaining 3D oral data by scanning the oral cavity including teeth;
Obtaining a tooth area including the teeth from the 3D oral data;
determining a second curve based on the first curve at a predetermined distance from the edge of the tooth area;
Obtaining a second gingival area between the edge of the tooth area and the second curve among the first gingival areas included in the oral data; and
An oral image processing method comprising: displaying a final selection area including the second gingival area and the tooth area. According to paragraph 1,
The step of acquiring the tooth area is,
An oral image processing method comprising obtaining the tooth area by identifying scan data for teeth and scan data for gingiva included in the 3D oral data. According to paragraph 1,
The step of acquiring the tooth area is,
When the teeth are separated into individual tooth regions in the 3D oral data, an oral image processing method comprising combining the individual tooth regions into one region to obtain the tooth region. According to paragraph 1,
The step of obtaining the second gingival area is,
An oral image processing method comprising determining the second curve using some of the points included in the first curve. According to paragraph 1,
The above processing method is,
displaying an object for setting the predetermined distance; and
Oral image processing method further comprising receiving a user input regarding the object and setting the predetermined distance. According to paragraph 1,
The step of obtaining the second gingival area is,
Oral image processing method comprising determining the second curve so that the second curve has a smaller curvature than the curvature of the first curve. According to paragraph 1,
The above processing method is,
Receiving a user input for selecting a palate area including scan data for the palate from the 3D oral data; and
Further comprising determining a first reference point and a second reference point for distinguishing the lingual side of the tooth and the buccal side of the tooth among the points included in the first curve,
The step of obtaining the second gingival area is,
An oral image processing method comprising determining the second curve based on points corresponding to the buccal side of the tooth among the points included in the first curve. In clause 7,
The above processing method is,
Obtaining a second palate area excluding a portion of the palate area based on a curve connecting the first reference point and the second reference point in the lingual area of the tooth; and
Oral image processing method further comprising: displaying the second palate area as the final selection area. According to paragraph 1,
The above processing method is,
Oral image processing method further comprising: acquiring tooth model data corresponding to the final selection area by generating mesh data extending from an edge of the final selection area. The oral image processing device,
display;
a memory storing one or more instructions; and
Includes a processor,
The processor executes the one or more instructions stored in the memory,
Obtain 3D oral data by scanning the oral cavity including teeth,
Obtaining a tooth area including the teeth from the 3D oral data,
Determining a second curve based on the first curve at a predetermined distance from the edge of the tooth area,
Obtaining a second gingival area between the edge of the tooth area and the second curve among the first gingival areas included in the oral data,
Controlling the display to display a final selection area including the second gingival area and the tooth area,
Oral image processing device wherein the curvature of the second curve is smaller than the curvature of the edge of the tooth area. According to clause 10,
The processor executes the one or more instructions stored in the memory,
An oral image processing device for obtaining the tooth area by identifying scan data for teeth and scan data for gingiva included in the 3D oral data. According to clause 10,
The processor executes the one or more instructions stored in the memory,
An oral image processing device for obtaining the tooth region by combining the individual tooth regions into one region when the teeth are separated into individual tooth regions in the 3D oral data. According to clause 10,
The processor executes the one or more instructions stored in the memory,
Oral image processing device for obtaining the second gingival area by determining the second curve using some of the points included in the first curve. According to clause 10,
The processor executes the one or more instructions stored in the memory,
An oral image processing device that controls the display to display an object for setting the predetermined distance, receives a user input for the object, and sets the predetermined distance. According to clause 10,
The processor executes the one or more instructions stored in the memory,
An oral image processing device that determines the second curve so that the second curve has a smaller curvature than the first curve. According to clause 13,
The device is,
In the three-dimensional oral data, further comprising a user interface for receiving a user input for selecting a palate region containing scan data for the palate,
The processor executes the one or more instructions stored in the memory,
Based on receiving a user input for selecting the palate area, determining a first reference point and a second reference point for distinguishing the lingual side of the tooth and the buccal side of the tooth among the points included in the first curve,
An oral image processing device that determines the second curve based on points corresponding to the buccal side of the tooth among the points included in the first curve. According to clause 16,
The processor executes the one or more instructions stored in the memory,
Based on a curve connecting the first reference point and the second reference point in the lingual area of the tooth, obtain a second palate area excluding a portion of the palate area,
Oral image processing device for controlling the display to display the second palate area as the final selection area. According to clause 10,
The processor executes the one or more instructions stored in the memory,
An oral image processing device that acquires tooth model data corresponding to the final selection area by generating mesh data extending from the edge of the final selection area.

Images