WO2023027500A1

WO2023027500A1 - Image processing apparatus and image processing method

Info

Publication number: WO2023027500A1
Application number: PCT/KR2022/012639
Authority: WO
Inventors: 로슬야코바마리아; 박선애
Original assignee: 주식회사 메디트
Priority date: 2021-08-24
Filing date: 2022-08-24
Publication date: 2023-03-02

Abstract

Disclosed embodiments relate to an image processing method and an image processing apparatus, and the image processing method according to an embodiment may comprise the steps of: obtaining mesh data for an object; modifying the mesh data on the basis of a user input; and providing feedback for the modified mesh data, on the basis of at least one threshold condition.

Description

Image processing apparatus and image processing method

The disclosed embodiments relate to an image processing device and an image processing method, and more specifically, to an image processing device and processing method for processing an image of a dental restoration.

When designing a dental restoration using CAD/CAM (Computer aided design/Computer aided manufacturing), a process of sculpting mesh data for the restoration is required to similarly implement the curve of the patient's teeth. do. The process of sculpting the mesh data may include transforming the mesh data in various ways, such as adding, removing, smoothing, or morphing the mesh data.

When sculpting mesh data for a restoration using an existing CAD, the user could not know the allowable range of deformation of the mesh data. For example, when a user continuously adds mesh data, interference between the fabricated restoration and the antagonist/adjacent teeth may occur. Alternatively, if the mesh data is continuously removed, the thickness of the restoration becomes thin, and thus the restoration may be broken during printing. In addition, when a user adds mesh data to a part of a restoration and removes mesh data from another part, the thickness deviation of the restoration increases, resulting in a rough restoration.

Existing CADs do not provide feedback on the deformation of mesh data, so the user arbitrarily judged and performed the engraving when sculpting the mesh data for the restoration.

However, there is a problem in that it is not easy for the user to determine whether manually deformed mesh data is acceptable.

In order to solve the above problems, the disclosed embodiment automatically determines whether the deformed mesh data satisfies a critical condition when sculpting mesh data for a restoration, and image processing for feeding back the determined result to the user. It is an object of the present invention to provide a method and an apparatus for performing an operation thereof.

An image processing method according to an embodiment includes obtaining mesh data of an object, transforming the mesh data based on a user input, and transforming the transformed mesh data based on at least one threshold condition. It may include providing feedback on the mesh data.

Mesh data according to an embodiment may include restoration data for at least one tooth.

The image processing method according to an embodiment further includes displaying at least one menu item for transforming the mesh data on a screen, wherein the at least one menu item is a first menu corresponding to a mesh addition function. at least one of an item, a second menu item corresponding to a mesh removal function, a third menu item corresponding to a mesh smoothing function, and a fourth menu item corresponding to a mesh morphing function, wherein the transforming the mesh data comprises: , transforming the mesh data based on the user input for selecting the at least one menu item.

Providing feedback according to an embodiment includes determining whether the deformed mesh data satisfies the threshold condition, and based on the fact that the threshold condition is not satisfied, the deformed mesh data is appropriately and providing the feedback indicating no.

Critical conditions according to an embodiment include a distance condition between an outer surface and an inner surface of the mesh data, whether an interference area in which an outer surface of the mesh data overlaps tooth data corresponding to the mesh data occurs, and the mesh data It may include at least one of distance conditions between the outer surface of the tooth and the tooth data.

Mesh data according to an embodiment is restoration data for at least one tooth, and the tooth data may include data for at least one of an opposing tooth that engages with the restoration object and an adjacent tooth adjacent to the restoration object.

The step of determining whether a threshold condition is satisfied according to an embodiment includes determining whether a distance condition between an outer surface and an inner surface of the mesh data is satisfied, and a distance between an outer surface and an inner surface of the mesh data is satisfied. In the step of determining whether the distance condition of is satisfied, a ray-intersection test is performed by generating virtual rays in a normal direction from vertices or faces included in the inner surface of the mesh data. determining a distance between an outer surface and an inner surface of the mesh data based on points at which the virtual rays intersect, and determining whether the distance satisfies at least one threshold range. can do.

Providing feedback according to an embodiment may include displaying an area in which a distance between an outer surface and an inner surface of the deformed mesh data does not satisfy the threshold condition to be identified with other areas.

Providing feedback according to an embodiment may include displaying an overlapping degree between the deformed mesh data and the tooth data in a color when the interference area occurs.

Providing feedback according to an embodiment may include displaying a message indicating that the deformed mesh data is not appropriate based on the fact that the deformed mesh data does not satisfy the threshold condition. .

Providing feedback according to an embodiment may include displaying a deformed region of the mesh data in a color according to a deformation amount.

Providing feedback according to an embodiment may include displaying at least one of an allowable minimum thickness and a maximum allowable thickness of the mesh data.

An image processing apparatus according to an embodiment includes a display, a memory for storing one or more instructions, and a processor, wherein the processor executes the one or more instructions stored in the memory to generate mesh data for an object. The display may be obtained, deforming the mesh data based on a user input, and providing feedback on the deformed mesh data based on at least one critical condition.

An image processing apparatus and an image processing method according to the disclosed embodiments may automatically determine whether deformed mesh data satisfies a critical condition when sculpting mesh data for a restoration, and provide feedback to the user based on the determined result. there is. Accordingly, the user can easily determine whether the deformed mesh data is acceptable, and the quality of a restoration fabricated based on the deformed mesh data can be improved.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention may be readily understood from the following detailed description in combination with the accompanying drawings, wherein reference numerals denote structural elements.

1 is a diagram for explaining an image processing system according to an exemplary embodiment.

2 is a flowchart illustrating an image processing method according to an exemplary embodiment.

3 is a diagram illustrating an example of displaying a restoration image by an image processing apparatus according to an exemplary embodiment.

4 to 7 are views referenced to describe a method of engraving restoration data by an image processing apparatus according to an exemplary embodiment.

8 is a diagram referenced to explain a method of determining whether an image processing device satisfies a threshold condition in deformed mesh data according to an exemplary embodiment.

9 and 10 are diagrams illustrating examples of providing feedback when an image processing apparatus according to an exemplary embodiment does not satisfy a critical condition for a thickness of deformed restoration data.

11 is a diagram referenced to describe a method of determining whether an image processing device satisfies a threshold condition in deformed mesh data according to an exemplary embodiment.

12 is a diagram illustrating a screen on which an image processing apparatus displays an interference region to be distinguished from another region according to an exemplary embodiment.

13 and 14 are diagrams referenced to describe a method of determining whether the deformed mesh data satisfies a critical condition and providing feedback thereof, according to an exemplary embodiment.

FIG. 15 is a diagram referenced to explain a method of determining whether deformed mesh data of another image processing device satisfies a critical condition according to an exemplary embodiment.

16 is a diagram illustrating a screen on which an image processing device displays a deformation amount of mesh data according to an exemplary embodiment.

17 is a block diagram illustrating an image processing device according to an exemplary embodiment.

This specification clarifies the scope of the present invention, explains the principles of the present invention, and discloses embodiments so that those skilled in the art can practice the present invention. The disclosed embodiments may be implemented in various forms.

Like reference numbers designate like elements throughout the specification. This specification does not describe all elements of the embodiments, and general content or overlapping content between the embodiments in the technical field to which the present invention belongs is omitted. The term 'part' (portion) used in the specification may be implemented as software or hardware, and according to embodiments, a plurality of 'parts' may be implemented as one element (unit, element), or a single 'unit'. It is also possible that section' includes a plurality of elements. Hereinafter, the working principle and embodiments of the present invention will be described with reference to the accompanying drawings.

On the other hand, when a component is said to be "connected" to another component in this specification, this includes not only the case of being 'directly connected', but also the case of being 'connected with another component in between'. In addition, when a certain component "includes" another component, this means that other components may be further included without excluding other components unless otherwise specified.

Also, terms including ordinal numbers such as 'first' or 'second' used in this specification may be used to describe various elements, but the elements should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

In this specification, an 'object' is an object to be photographed, and may include a human, an animal, or a part thereof. For example, the object may include a body part (organ or organ, etc.) or a phantom. Also, for example, the object may include a plaster model imitating the oral cavity, dentures such as dentures or dentures, teeth-shaped dentiforms, and the like. For example, the object may include teeth, gingiva, at least a portion of the oral cavity, and/or artificial structures (eg, orthodontic devices including brackets and wires, implants, abutments, artificial teeth, inlays, and dental restorations including onlays, orthodontic aids inserted into the oral cavity, etc.), teeth or gingiva to which artificial structures are attached, and the like.

A “scanner” may refer to a device that acquires an image related to an object. The scanner may refer to a scanner that acquires an image related to the oral cavity used for oral treatment. For example, the scanner may be an intraoral scanner having a form that can be inserted into the oral cavity. Here, since the intraoral scanner generally has a form that can be held and carried with one hand, it can be referred to as a hand-held scanner. Alternatively, the scanner may be a table type scanner usable for dental treatment. Also, the scanner may acquire at least one of a 2D image and a 3D image. Also, the scanner may acquire at least one 2D image of the oral cavity and generate a 3D image (or 3D model) of the oral cavity based on the obtained at least one 2D image. Also, the scanner may obtain at least one 2D image of the oral cavity and transmit the at least one 2D image to an external device. The external device may generate a 3D image of the oral cavity based on the received at least one 2D image.

In addition, the meaning of "scanning the oral cavity" may mean a case of scanning the oral cavity itself, as well as a case of scanning an artificial object and/or representing the oral cavity or other objects related to the oral cavity.

An “image” may be a 2D image of an object or a 3D model or 3D image representing the object in three dimensions. For example, an image may be data required to represent an object in 2D or 3D. For example, an image may mean raw data or a raw image obtained from at least one camera. Specifically, the raw image is data acquired to generate an oral image necessary for diagnosis, and is included in the scanner when scanning the patient's oral cavity using a scanner (eg, intraoral scanner) It may be an image acquired from at least one camera (eg, a 2D frame image). Also, the raw image is an image that has not been processed and may mean an original image obtained from a scanner.

The “3-dimensional oral model” may refer to a model in which the oral cavity is 3-dimensionally modeled based on raw data obtained by a scanning operation of a scanner. Also, a “3D oral model” may refer to a structure modeled three-dimensionally based on data obtained by scanning an object such as a tooth, an impression body, or an artificial object by a scanner. The 3D oral model is generated by 3D modeling the internal structure of the oral cavity, and may be referred to as a 3D scan model, a 3D model, or a tooth model. For example, the format of the 3D oral model may be one of STL (Standard Triangle Language), OBJ, and PLY (Polygon File Format), and is not limited to the above example. In addition, the 3D oral model may include information such as geometry information, color, texture, and material for a 3D shape.

Also, "polygon" may refer to a polygon, which is the smallest unit used when expressing a three-dimensional shape of a 3D oral model. For example, the surface of a 3D oral model may be represented by triangular polygons. For example, a polygon can consist of at least 3 vertices and 1 face. A vertex may include information such as position, color, and normal. A mesh may be an object in a 3D space created by gathering a plurality of polygons. As the number of polygons representing the 3D oral model increases, the object can be expressed in detail.

Hereinafter, embodiments will be described in detail with reference to the drawings.

Referring to FIG. 1 , the image processing system includes a scanner 10 and an image processing device 100 . The scanner 10 and the image processing device 100 may communicate through a communication network.

The scanner 10 is a device that scans an object and may be a medical device that acquires an image of the object. The scanner 10 may obtain an image of at least one of the oral cavity or an artificial structure or a plaster model modeled after the oral cavity or an artificial structure.

A scanner having a shape retractable into an oral cavity, such as the scanner 10 shown in FIG. 1 , may be referred to as an intraoral scanner or a portable scanner. The scanner 10 may be a table type scanner in addition to the handheld type scanner shown in FIG. 1 .

The scanner 10 is inserted into the oral cavity and scans an object (eg, an object in the oral cavity such as a tooth or an impression body) in a non-contact manner, thereby generating an image of the oral cavity including at least one tooth. can be obtained Also, the scanner 10 may scan the inside of the patient's oral cavity or an impression modeled after the inside of the patient's oral cavity using at least one image sensor (eg, an optical camera).

The scanner 10 may include at least one of teeth, gingiva, and artificial structures insertable into the oral cavity (eg, orthodontic devices including brackets and wires, implants, artificial teeth, and orthodontic aids inserted into the oral cavity). In order to image the surface of the object, surface information of the object may be obtained as raw data.

The raw data acquired by the scanner 10 may be at least one image acquired by at least one camera included in the scanner 10 . Specifically, the raw data may be at least one 2D frame image obtained by performing a scanning operation by the scanner 10 . Here, 'frame image' may also be referred to as 'frame' or 'frame data'.

The scanner 10 may transmit the acquired raw data to the image processing device 100 through a communication network. Alternatively, the scanner 10 may acquire a 3D model or 3D image generated based on raw data obtained from at least one camera. Also, the acquired 3D model or 3D image may be transmitted to the image processing device 100 .

Image data acquired by the scanner 10 may be transmitted to the image processing device 100 connected through a wired or wireless communication network.

The image processing device 100 is connected to the scanner 10 through a wired or wireless communication network, receives data obtained by scanning an object from the scanner 10, and generates, processes, and displays an image based on the received data. and/or any electronic device capable of transmitting.

The image processing device 100 may be a computing device such as a smart phone, a laptop computer, a desktop computer, a PDA, or a tablet PC, but is not limited thereto. Also, the image processing device 100 may exist in the form of a server (or server device) for processing oral cavity images.

Specifically, the image processing device 100 may, based on the data received from the scanner 10, information necessary for diagnosis of the oral cavity, an image representing the oral cavity, and a model used for oral treatment (eg, a 3D image of the teeth). At least one of a model or a three-dimensional model for generating a crown) may be created, and the generated information and image may be displayed through the display 130 .

For example, the scanner 10 may transmit raw data obtained through scanning to the image processing device 100 as it is. In this case, the image processing device 100 may generate a 3D oral image (3D oral model) representing the oral cavity in 3D based on the received raw data. The image processing device 100 according to an embodiment may generate 3D data (eg, surface data, mesh data, etc.) representing the shape of the surface of the object in 3D, based on the received raw data. there is. In this case, the 3D data may include a plurality of polygons.

Also, the image processing device 100 may analyze, process, display, and/or transmit the generated image to an external device.

As another example, the scanner 10 may obtain raw data by scanning an object, process the obtained raw data, generate an image corresponding to the object, and transmit the image to the image processing device 100 . In this case, the image processing device 100 may analyze, process, display, and/or transmit the received image.

In the disclosed embodiment, the image processing device 100 is an electronic device capable of generating and displaying an image representing an object in 3D, which will be described in detail below.

When receiving raw data obtained by scanning an object from the scanner 10, the image processing apparatus 100 according to an embodiment may generate a 3D image (or 3D model) by processing the received raw data. For convenience of description, a 3D image of an object generated by the image processing apparatus 100 will be referred to as 'scan data' hereinafter.

For example, the scanner 10 may scan an oral cavity including at least one tooth. The image processing apparatus 100 according to an embodiment receives raw data obtained by scanning the oral cavity from the scanner 10, and based on the received raw data, 3D scan data for the oral cavity including at least one tooth is generated. It is possible to generate and display the generated 3D scan data (3D image) through the display 130 .

The image processing apparatus 100 according to an embodiment may obtain initial mesh data of the restoration based on scan data of the oral cavity. The image processing apparatus 100 may engrave initial mesh data of the restoration in order to design the restoration, based on a user input. The image processing device 100 may determine whether or not the degree of deformation of the initial mesh data satisfies a critical condition, and feedback the determination result to the user in various ways.

Hereinafter, with reference to the drawings, a description will be given of a method in which the image processing apparatus 100 according to an embodiment determines whether the degree of deformation of mesh data for a restoration satisfies a critical condition and feeds back the determination result to the user. .

Referring to FIG. 2 , the image processing device 100 according to an exemplary embodiment may obtain mesh data of an object (S210).

For example, the image processing device 100 may receive raw data obtained by scanning an oral cavity including at least one tooth from the scanner 10 . The image processing device 100 may acquire a 3D image or 3D model of the oral cavity based on the received raw data. In this case, the 3D image of the oral cavity may include a plurality of objects in the oral cavity and 3D shape information of the surfaces of the objects. For example, a 3D image of the oral cavity may be expressed as a plurality of polygons, and the shape of the polygon may be a triangle. However, it is not limited thereto.

Alternatively, the image processing device 100 may receive a 3D image of the oral cavity from the scanner 10 or an external device.

The image processing apparatus 100 according to an embodiment may identify a tooth (target tooth) requiring treatment in a 3D image of the oral cavity, and obtain restoration data for the target tooth. For example, the image processing apparatus 100 may design a restoration for a target tooth based on 3D shape information of the target tooth. The image processing apparatus 100 may design a restoration for a target tooth using a computer aided design (CAD)/computer aided manufacturing (CAM) program. However, it is not limited thereto.

Alternatively, the image processing device 100 may transmit a 3D image of an oral cavity or data of a target tooth to an external device. The external device may design a restoration of the target tooth based on the 3D image or data received from the image processing device 100 and transmit the image or data of the restoration to the image processing device 100 .

Images or data (hereinafter, referred to as restoration data) of a restoration according to an embodiment may be expressed as a mesh including a plurality of polygons.

The image processing device 100 according to an embodiment may obtain an oral cavity image including 3D scan data obtained by scanning the oral cavity and restoration data. For example, the image processing apparatus 100 may acquire an oral cavity image in which a restoration object is attached to a target tooth by applying restoration data to 3D scan data of the oral cavity. The image processing device 100 may display on the screen an oral cavity image in which a restoration object is attached to a target tooth.

The image processing device 100 according to an embodiment may transform mesh data based on a user input (S220).

The image processing apparatus 100 according to an embodiment may transform mesh data of a restoration based on a user input. For example, the image processing device 100 may transform mesh data by using a sculpting function. The image processing device 100 may display at least one menu corresponding to the sculpting function. For example, the sculpting function according to an embodiment may include at least one of a mesh adding function, a mesh removing function, a mesh smoothing function, and a mesh morphing function. However, it is not limited thereto.

When at least one displayed menu is selected by a user input, the image processing device 100 may transform mesh data using a function corresponding to the selected menu. This will be described in detail with reference to FIGS. 4 to 7 .

The image processing device 100 according to an embodiment may provide feedback on deformed mesh data based on at least one threshold condition (S230).

The image processing device 100 may check whether the deformed mesh data satisfies a critical condition. For example, the critical condition according to an embodiment is a distance condition between an outer surface and an inner surface of the mesh data, whether an interference area in which an outer surface of the mesh data overlaps tooth data corresponding to the mesh data occurs, and mesh data It may include at least one of distance conditions between the outer surface of the tooth data. A method of determining whether the image processing device 100 deformed mesh data satisfies the critical condition will be described in detail with reference to FIGS. 8, 11, 13, and 15 .

The image processing device 100 may provide feedback indicating that the deformed mesh data is not appropriate based on the fact that the deformed mesh data does not satisfy the critical condition.

For example, the image processing device 100 may display a region in which a distance between an outer surface and an inner surface of the deformed mesh data does not satisfy a critical condition to be identified with other areas. Also, when an interference area occurs between the mesh data of the restoration and the tooth data, the image processing apparatus 100 may display the degree of overlap between the mesh data and the tooth data in the interference area in color. In addition, the image processing device 100 may display a message indicating that the deformed mesh data is not appropriate based on the fact that the deformed mesh data does not satisfy a threshold condition. Also, the image processing device 100 may display the deformed region of the mesh data in a color according to the amount of deformation. Also, the image processing device 100 may display at least one of a minimum allowable thickness and a maximum allowable thickness of mesh data.

Referring to FIG. 3 , the image processing apparatus 100 according to an exemplary embodiment may display a restoration image (restoration data).

The image processing device 100 may receive raw data obtained by scanning the oral cavity including at least one tooth, and may obtain a 3D image or 3D model of the oral cavity based on the received raw data. there is. Alternatively, the image processing device 100 may receive a 3D image of the oral cavity from an external device.

The image processing apparatus 100 may identify a tooth (target tooth) requiring treatment in the 3D image of the oral cavity, and design a restoration 310 for the target tooth. For example, the image processing apparatus 100 may design the restoration 310 for the target tooth using a computer aided design (CAD)/computer aided manufacturing (CAM) program.

Alternatively, the image processing apparatus 100 may transmit a 3D image of an oral cavity or data of a target tooth to an external device, and the external device may design a restoration for the target tooth based on the received information. The external device may transmit restoration data to the image processing device 100 .

Accordingly, the image processing device 100 may acquire data on the restoration 310 and display the data on the screen. The restoration 310 according to an embodiment may include an outer surface and an inner surface, and the transparency of the outer and inner surfaces may be adjusted. For example, if the transparency of the outer surface is increased and the transparency of the inner surface is decreased, the inner surface of the restoration 310 may be displayed on the screen. However, it is not limited thereto.

The image processing device 100 according to an embodiment may sculpt the restoration 310 . When designing a dental restoration, a process of sculpting restoration data is required to implement a similar curve of a patient's tooth or to design a restoration in detail to match the tooth. In this case, sculpting the restoration may mean deforming the outer surface data of the restoration.

The image processing device 100 according to an embodiment may transform data of the restoration 310 by using a sculpting function, and a method of sculpting the restoration 310 is described in detail with reference to FIGS. 4 to 7 . Let's explain.

Referring to FIG. 4 , the image processing device 100 according to an exemplary embodiment may provide an engraving function. The image processing device 100 may display the engraving menu 410 corresponding to the engraving function on the screen. The sculpting menu 410 includes a first menu item 420 corresponding to a function of adding mesh data, a second menu item 430 corresponding to a function of removing mesh data, and smoothing (smoothing) the mesh data. A third menu item 440 corresponding to a function and a fourth menu item 450 corresponding to a function of morphing mesh data may be included. The function of smoothing the mesh data may mean smoothing the mesh data by adding or removing mesh data. Also, the function of morphing mesh data may mean changing the position or normal direction of polygons while maintaining the number of polygons included in the mesh data.

In addition, the engraving menu 410 may include an item 460 for adjusting brush strength and an item 470 for adjusting brush size. However, it is not limited thereto.

The image processing device 100 may determine the amount of mesh data to be added or removed or the speed at which mesh data is added or removed based on the set brush strength and brush size.

When receiving a user input for selecting any one of the first to

fourth menu items

420, 430, 440, and 450, the image processing apparatus 100 may display a brush icon 480 on the screen. For example, based on a user input for selecting the first menu item 420 , the image processing device 100 may display a brush icon 480 .

When the brush icon 480 is displayed, the user can move the displayed brush icon 480 on the restoration data 401 . The image processing device 100 may add or remove mesh data to an area where the brush icon 480 passes.

Referring to FIG. 5 , when the image processing device 100 receives a user input for moving the brush icon 480 while the first menu item 420 is selected, mesh data is stored in the area where the brush icon 480 has passed. can be added. For example, the image processing apparatus 100 may add mesh data 520 to the outer surface of the restoration data 401 corresponding to the region 510 through which the brush icon 480 has passed. At this time, data on the inner surface of the restoration data 401 is not modified. In addition, the amount or speed at which mesh data is added may be adjusted according to the set brush strength and brush size.

Referring to FIG. 6 , if the image processing device 100 receives a user input for moving the brush icon 480 while the second menu item 430 is selected, mesh data is stored in the area where the brush icon 480 has passed. can be removed. For example, the image processing apparatus 100 may remove mesh data from the outer surface of the restoration data 401 corresponding to the area 610 through which the brush icon 480 passed. At this time, data on the inner surface of the restoration data 401 is not modified. Alternatively, when the image processing device 100 receives a user input for moving the brush icon 480 while the second menu item 430 is selected, the image processing device 100 applies mesh data to an area where the brush icon 480 has passed by (-). direction can be added. For example, the image processing device 100 may add mesh data in a direction opposite to a direction of a normal vector of an outer surface corresponding to an area where the brush icon 480 passes.

Also, depending on the set brush strength and brush size, the amount of mesh data removed (or the amount of mesh data added in the (-) direction) or the speed at which mesh data is removed (or the speed at which mesh data is added in the (-) direction) ) can be adjusted.

Referring back to FIG. 4 , when receiving a user input for moving the brush icon 480 in a state where the third menu item 440 is selected, the image processing apparatus 100 determines the area where the brush icon 480 has passed. By adding or removing mesh data, the area can be smoothed. Since the operation of adding or removing mesh data has been described above, the same description will be omitted.

Referring to FIG. 7 , the image processing device 100 may morph mesh data when receiving a user input of dragging a brush icon 480 while the fourth menu item 450 is selected. For example, the image processing device 100 may morph the mesh data of the outer surface of the restoration data 401 corresponding to the region 710 where the brush icon 480 is located in the direction in which the brush icon 480 is dragged. At this time, data on the inner surface of the restoration data 401 is not modified. Also, the number of polygons included in the morphed mesh data 720 is equal to the number of polygons included in the mesh data before morphing. The image processing device 100 may morph the mesh data by changing the position or normal direction of the polygons while maintaining the number of polygons included in the mesh data.

The image processing device 100 according to an embodiment may determine whether or not mesh data deformed through a function of sculpting mesh data satisfies a critical condition, and provide feedback for the determination to the user. This will be described in detail with reference to FIGS. 8 to 16 .

The image processing device 100 according to an exemplary embodiment may check whether the transformed restoration data satisfies the thickness condition of the restoration. For example, when restoration data is deformed, the image processing device 100 may check whether the deformed restoration data satisfies a thickness condition. However, it is not limited thereto.

Referring to FIG. 8 , the image processing device 100 according to an exemplary embodiment may obtain the thickness of restoration data 810 by performing a ray intersection inspection. The ray intersection test generates virtual rays in the normal vector direction from vertices or faces included in the inner surface 820 of the restoration, and includes the outer surface 810 of the restoration where the generated virtual rays intersect. You can get distances to vertices or faces.

The image processing device 100 may check whether the obtained distance is within a threshold range (greater than the first threshold and equal to or less than the second threshold). In this case, the first threshold value and the second threshold value may be preset values. The first threshold value may be determined as a minimum thickness at which the restoration is not broken when the restoration data 801 is 3D printed. For example, the first threshold may be determined to be 1.0 mm, but is not limited thereto.

Meanwhile, in the above, it has been described that virtual rays are generated in a normal vector direction at vertices or faces included in the inner surface 820 of the restoration, but it is not limited thereto. The image processing apparatus 100 according to an embodiment generates rays in the opposite direction of a normal vector at vertices or faces included in the outer surface 810 of the restoration, and includes the virtual rays on the inner surface of the restoration where the generated virtual rays intersect. It is possible to obtain the distance to the vertices or faces that are

The image processing device 100 gives feedback indicating that the deformed restoration data is not appropriate when the obtained distance is not within a threshold range (above the first threshold and equal to or less than a second threshold that is greater than the first threshold). can provide This will be described in detail with reference to FIGS. 9 and 10 .

Referring to FIG. 9 , the image processing apparatus 100 according to an exemplary embodiment allows the thickness of the deformed restoration data when a region in which the distance between the outer surface and the inner surface of the deformed restoration data is smaller than a first threshold exists. A message 910 indicating less than the minimum possible thickness may be displayed.

Also, referring to FIG. 10 , the image processing apparatus 100 according to an exemplary embodiment may display a region where the thickness of restoration data is smaller than an allowable minimum thickness to be distinguished from other regions.

For example, the image processing device 100 may display the minimum thickness view menu item 1010 on the screen. When the minimum thickness view menu item 1010 is selected, the image processing device 100, as shown in FIG. , blue). Based on the color map 1030 representing colors according to thickness, the image processing device 100 may display a dark blue color when the thickness is thin, and a light blue color when the thickness is thick. However, it is not limited thereto.

The image processing apparatus 100 according to an embodiment may check whether an overlapping interference region occurs between the deformed restoration data and tooth data.

The image processing apparatus 100 according to an exemplary embodiment may obtain an overlapping interference area between restoration data and tooth data by performing a ray intersection inspection. In FIG. 11 , for convenience of explanation, an interference region generated between a restoration and an opposing tooth will be described as an example.

Referring to FIG. 11 , the image processing apparatus 100 generates virtual rays from a plurality of vertices or faces included in the opposition data 1120 in a direction opposite to the normal direction of the corresponding vertices or faces, It may be checked whether the virtual rays intersect the restoration data 1110. The image processing device 100 may acquire the corresponding area as the interference area 1130 when the virtual rays intersect the restoration data 1110 .

When an interference area 1130 occurs, the image processing apparatus 100 according to an embodiment may provide feedback to a user by displaying the interference area 1130 to be identified with other areas. For example, the image processing apparatus 100 may display restoration data corresponding to the interference region 1130 in a color determined according to an overlapping degree. This will be described with reference to FIG. 12 .

The image processing apparatus 100 according to an embodiment may display the interference region 1130 where the restoration data 1110 and the antagonist data 1120 overlap to be identified with other regions. For example, the restoration data 1110 and the antagonist data 1120 may be displayed in different colors depending on the degree of overlap. At this time, the degree of overlap can be determined through the ray intersection test described in FIG. 11 . For example, the image processing apparatus 100 may determine the degree of overlap based on a distance from a starting point of a ray to a vertex where the ray crosses. The image processing apparatus 100 may determine that the degree of overlap is greater as the distance from the starting point of the ray to the vertex where the ray crosses is longer, and based on the color map 1210 representing colors according to the degree of overlap, the greater the degree of overlap, the greater the degree of overlap. It may be displayed in a color close to the first color (eg, red).

In addition, the image processing device 100 may determine that the overlapping degree is smaller as the distance from the starting point of the ray to the vertex where the ray crosses is shorter, and based on the color map 1210, the smaller the overlapping degree, the second color (eg, green). However, it is not limited thereto.

The image processing device 100 according to an exemplary embodiment may check whether the transformed restoration data satisfies the thickness condition of the restoration. For example, when the restoration data is deformed, the image processing device 100 may check whether the deformed mesh data satisfies the thickness condition. However, it is not limited thereto.

Referring to FIG. 13 , the image processing apparatus 100 according to an exemplary embodiment may obtain the thickness of restoration data 1301 by performing a ray intersection inspection. The ray intersection test generates virtual rays in the normal vector direction from vertices or faces included in the inner surface 1310 of the restoration, and vertices or faces included in the outer surface 1320 of the restoration where the generated virtual rays intersect. distance can be obtained. When the obtained distance is equal to or less than the third threshold, the image processing device 100 may display the corresponding area to be distinguished from other areas.

For example, as shown in FIG. 13, when the distance obtained from the first area 1330 in the restoration data 1301 is equal to or less than the third threshold value, the image processing apparatus 100 as shown in FIG. 14 , the first region 1330 may be displayed in a first color (eg, blue).

In addition, the image processing device 100 determines the area to be compared to other areas when the obtained distance is equal to or greater than the fourth threshold or when virtual rays do not intersect vertices or faces included in the outer surface 1320 of the restoration. can be identified and displayed.

For example, as shown in FIG. 13, when the virtual rays generated in the second area 1340 in the restoration data 1301 do not intersect vertices or faces included in the outer surface 1320 of the restoration, The second area 1340 may be displayed in a second color (eg, gray). However, it is not limited thereto.

The image processing apparatus 100 according to an embodiment may check whether a distance condition between the deformed restoration data and tooth data is satisfied. For example, if the distance between the restoration and the antagonist is too far, the restoration and the antagonist may not come into contact with each other, which may cause discomfort when chewing food. In addition, if the distance between the restoration and the adjacent teeth is too great, the probability of food getting caught in the gap between the restoration and the adjacent teeth increases. Therefore, when sculpting a restoration, the distance between the restoration and the antagonist, and the distance between the restoration and the adjacent tooth should be smaller than the critical value.

Referring to FIG. 15 , the image processing apparatus 100 according to an embodiment may check whether the distance between the restoration and the antagonist is greater than or equal to a threshold value. The image processing apparatus 100 may obtain a distance between the restoration object and the antagonist tooth by performing a ray intersection test. For example, the image processing apparatus 100 generates virtual rays from a plurality of vertices or facets included in the restoration data 1510 in a normal direction of the vertices or facets, and the generated virtual rays cross each other. Vertices or surfaces of the antagonist data 1520 may be obtained, and the distance from the starting point of the ray to the vertices or surfaces at which the ray crosses may be obtained as a distance between the restoration and the antagonist tooth.

In the above, it has been described that the ray intersection test is performed by generating virtual rays from a plurality of vertices or faces included in the restoration data 1510, but it is not limited thereto, and the plurality of By creating virtual rays at vertices or faces, ray intersection checks can be performed.

The image processing apparatus 100 may check whether the distance between the obtained restoration and the antagonist is equal to or greater than a threshold value, and if the distance is equal to or greater than the threshold value, feedback indicating that the modified restoration data is not appropriate may be provided to the user.

For example, a region where the distance between the restoration and the antagonist is equal to or greater than a threshold value may be displayed to be distinguished from other regions, or a message indicating that the modified restoration data is not appropriate may be displayed on the screen. However, it is not limited thereto.

Also, referring to FIG. 15 , the image processing apparatus 100 according to an exemplary embodiment may determine whether a distance between a restoration object and an adjacent tooth is greater than or equal to a threshold value. The image processing device 100 may obtain a distance between a restoration and an adjacent tooth by performing a ray intersection inspection. For example, the image processing apparatus 100 generates virtual rays from a plurality of vertices or facets included in the restoration data 1510 in a normal direction of the vertices or facets, and the generated virtual rays cross each other. Vertices or faces of the adjacent tooth data 1530 may be obtained, and the distance from the starting point of the rays to the vertices or faces at which the rays cross may be obtained as the distance between the restoration and the adjacent tooth.

The image processing apparatus 100 may check whether the distance between the obtained restoration and the adjacent tooth is greater than or equal to a threshold value, and if the distance is greater than or equal to the threshold value, feedback indicating that the modified restoration data is not appropriate may be provided to the user.

For example, a region where the distance between the restoration and adjacent teeth is equal to or greater than a threshold value may be displayed to be distinguished from other regions, or a message indicating that the modified restoration data is not appropriate may be displayed on the screen. However, it is not limited thereto.

Referring to FIG. 16 , the image processing apparatus 100 may calculate a mesh deformation amount based on initial mesh data 1610 and deformed mesh data 1620 of the restoration. For example, the image processing device 100 may obtain the deformation amount by subtracting the initial mesh data 1610 from the mesh data 1620 deformed through the sculpting function. For example, the image processing device 100 may subtract the initial mesh data 1610 from the deformed mesh data 1620 using a boolean technique. The image processing device 100 may acquire an area in which the amount of deformation is not zero as a deformed area.

The image processing device 100 may display the deformed area in different colors according to the amount of deformation. For example, the image processing device 100 may determine that the amount of deformation of the region increases as the value obtained by subtracting the initial mesh data 1610 from the deformed mesh data 1620 increases, and the larger the amount of deformation, the deformed mesh data 1620 ), the meshes included in the corresponding region may be displayed in a color close to the first color (eg, red). In addition, the image processing device 100 may determine that the deformation amount of the region is smaller as the value obtained by subtracting the initial mesh data 1610 from the deformed mesh data 1620 is smaller, and the smaller the deformation amount, the deformed mesh data 1620 ), meshes included in the corresponding region may be displayed in a color close to the second color (eg, green). However, it is not limited thereto.

Also, the image processing device 100 may display the mesh data 1620 with different colors according to the degree of overlap between the antagonist data. At this time, the degree of overlap can be determined through the ray intersection test described in FIG. 11 . For example, the image processing device 100 may determine that the degree of overlap is greater as the distance from the start point of the ray to the vertex where the ray crosses is longer, and as the distance from the start point of the ray to the vertex where the ray crosses is shorter, the overlap is greater. It can be determined as small. The image processing device 100 displays a color closer to the first color (eg, red) as the degree of overlap between the mesh data 1620 and the antagonist data increases, and the degree of overlap between the mesh data 1620 and the antagonist data When is smaller, a color closer to the second color (eg, green) may be displayed. However, it is not limited thereto.

The image processing method illustrated in FIG. 17 may be performed through the image processing device 100 . Accordingly, the image processing method illustrated in FIG. 2 may be a flowchart illustrating operations of the image processing apparatus 100 .

Referring to FIG. 17 , the image processing device 100 may include a communication interface 110 , a user interface 120 , a display 130 , a memory 140 and a processor 150 .

The communication interface 110 may perform communication with at least one external electronic device (eg, the scanner 10, a server, or an external medical device) through a wired or wireless communication network. The communication interface 110 may perform communication with at least one external sperm device under the control of the processor 150 .

Specifically, the communication interface 110 is at least one short-range communication that performs communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), NFC/RFID, Wi-Fi Direct, UWB, or ZIGBEE. modules may be included.

In addition, the communication interface 110 may further include a remote communication module that communicates with a server for supporting remote communication according to a telecommunication standard. Specifically, the communication interface 110 may include a remote communication module that performs communication through a network for internet communication. In addition, the communication interface 110 may include a remote communication module that performs communication through a communication network conforming to communication standards such as 3G, 4G, and/or 5G.

In addition, the communication interface 110 may include at least one port for connecting to an external electronic device (eg, intraoral scanner, etc.) through a wired cable in order to communicate with the external electronic device. Accordingly, the communication interface 110 may perform communication with an external electronic device wired through at least one port.

The user interface 120 may receive a user input for controlling the image processing device 100 . The user interface 120 includes a touch panel for detecting a user's touch, a button for receiving a user's push operation, a mouse or a keyboard for specifying or selecting a point on a user interface screen, and the like. It may include a user input device, but is not limited thereto.

Also, the user interface 120 may include a voice recognition device for voice recognition. For example, the voice recognition device may be a microphone, and the voice recognition device may receive a user's voice command or voice request. Accordingly, the processor 150 may control an operation corresponding to the voice command or voice request to be performed.

The display 130 displays a screen. Specifically, the display 130 may display a predetermined screen according to the control of the processor 150 . Specifically, the display 130 may display a user interface screen including an oral cavity image generated based on data acquired by scanning the patient's oral cavity with the scanner 10 . Alternatively, a user interface screen including an image of an object generated based on data obtained from the scanner 10 may be displayed.

Alternatively, the display 130 may display a user interface screen including information related to the patient's dental treatment.

The memory 140 may store at least one instruction. Also, the memory 140 may store at least one instruction executed by the processor 150. Also, the memory 140 may store at least one program executed by the processor 150 . Also, the memory 140 may store data received from the scanner 10 (eg, raw data obtained through scanning). Alternatively, the memory 140 may store an image representing an object in 3D. Memory 140 according to one embodiment may contain one or more instructions for sculpting restoration data. Memory 140 according to an embodiment may include one or more instructions for performing a method disclosed in this disclosure to provide feedback on modified restoration data, based on at least one threshold condition.

The processor 150 executes at least one instruction stored in the memory 140 and controls an intended operation to be performed. Here, at least one instruction may be stored in an internal memory included in the processor 150 or in the memory 140 included in the data processing device separately from the processor.

Specifically, the processor 150 may control at least one component included in the data processing apparatus so that an intended operation is performed by executing at least one instruction. Therefore, even if the processor performs certain operations as an example, it may mean that the processor controls at least one component included in the data processing apparatus so that the certain operations are performed.

The processor 150 according to an embodiment may generate scan data based on raw data received from the 3D scanner by executing one or more instructions stored in the memory 140 . In this case, the raw data may include raw data obtained by scanning an oral cavity including at least one tooth by a 3D scanner.

The processor 150 may acquire a 3D image or 3D model of the oral cavity based on the received raw data by executing one or more instructions stored in the memory 140 .

The processor 150 may obtain an image or data for restoration of a tooth (target tooth) requiring treatment from a 3D image of the oral cavity by executing one or more instructions stored in the memory 140 . For example, the processor 150 may identify a target tooth in the 3D image of the mouth and design a restoration for the target tooth. The processor 150 may design a restoration for the target tooth based on the 3D shape information of the target tooth. The processor 150 may design a restoration for a target tooth using a computer aided design (CAD)/computer aided manufacturing (CAM) program. However, it is not limited thereto.

Alternatively, the processor 150 may transmit a 3D image of an oral cavity or data of a target tooth to an external device, and may receive an image or data of a restoration object from the external device.

The processor 150 according to an exemplary embodiment executes one or more instructions stored in the memory 140 to generate an oral cavity image including 3D scan data obtained by scanning the oral cavity and restoration data (hereinafter referred to as 'restoration data'). can be obtained For example, the processor 150 may obtain an oral cavity image in which a restoration object is attached to a target tooth by applying restoration data to 3D scan data of the oral cavity.

According to an embodiment, the processor 150 may deform mesh data of the restoration based on a user input by executing one or more instructions stored in the memory 140 . For example, the processor 150 may transform mesh data using a sculpting function. The processor 150 may display at least one menu corresponding to the sculpting function. For example, the sculpting function according to an embodiment may include at least one of a mesh adding function, a mesh removing function, a mesh smoothing function, and a mesh morphing function. However, it is not limited thereto.

The processor 150 according to an embodiment may check whether the deformed mesh data satisfies a critical condition by executing one or more instructions stored in the memory 140 . For example, the critical condition according to an embodiment is a distance condition between an outer surface and an inner surface of the mesh data, whether an interference area in which an outer surface of the mesh data overlaps tooth data corresponding to the mesh data occurs, and mesh data It may include at least one of distance conditions between the outer surface of the tooth data.

The processor 150 according to an embodiment provides feedback indicating that the deformed mesh data is not appropriate based on the fact that the deformed mesh data does not satisfy a threshold condition by executing one or more instructions stored in the memory 140. can provide

For example, the processor 150 may display a region in which the distance between the outer and inner surfaces of the deformed mesh data does not satisfy a critical condition on the display 130 to be identified with other regions. Also, when an interference area occurs between the mesh data of the restoration and the tooth data, the processor 150 may display the degree of overlap between the mesh data and the tooth data in the interference area in color. Additionally, the processor 150 may display a message indicating that the deformed mesh data is not appropriate on the display 130 based on the fact that the deformed mesh data does not satisfy the critical condition. Also, the processor 150 may display the deformed region of the mesh data in a color according to the amount of deformation. Also, the processor 150 may display on the display 130 at least one of the allowable minimum and maximum thicknesses of the mesh data.

The processor 150 according to an embodiment internally includes at least one internal processor and a memory device (eg, RAM, ROM) for storing at least one of programs, instructions, signals, and data to be processed or used in the internal processor. etc.) may be implemented in a form including.

Also, the processor 150 may include a graphic processing unit for graphic processing corresponding to video. Also, the processor may be implemented as a system on chip (SoC) in which a core and a GPU are integrated. Also, the processor may include multiple cores over a single core. For example, a processor may include a dual core, triple core, quad core, hexa core, octa core, deca core, dodeca core, hexadecimal core, and the like.

In the disclosed embodiment, the processor 150 may generate an image based on a 2D image received from the scanner 10 .

Specifically, under the control of the processor 150, the communication interface 110 may receive data obtained from the scanner 10, for example, raw data obtained through scanning. Also, the processor 150 may generate a 3D image representing the object in 3D based on the raw data received through the communication interface 110 . For example, the scanner 10 uses an L camera corresponding to a left field of view and an R camera corresponding to a right field of view in order to restore a 3D image according to the optical triangulation method. can include In addition, the 3D scanner may obtain L image data corresponding to a left field of view and R image data corresponding to a right field of view from the L camera and the R camera, respectively. Subsequently, the 3D scanner may transmit raw data including L image data and R image data to the communication interface 110 of the image processing device 100 .

Then, the communication interface 110 transfers the received raw data to the processor 150, and the processor 150 may generate an image representing the object in three dimensions based on the received raw data.

Also, the processor 150 may control the communication interface 110 to directly receive an image representing an object in 3D from an external server, medical device, or the like. In this case, the processor may acquire the 3D image without generating the 3D image based on the raw data.

According to the disclosed embodiment, the processor 150 performing operations such as 'extraction', 'acquisition', and 'creation' means that the processor 150 directly performs the above-described operations by executing at least one instruction. In addition, it may include controlling other components so that the above-described operations are performed.

In order to implement the embodiments disclosed in this disclosure, the image processing apparatus 100 may include only some of the components shown in FIG. 17 or may include more components in addition to the components shown in FIG. 17. .

Also, the image processing device 100 may store and execute dedicated software linked to the scanner 10 . Here, the dedicated software may be referred to as a dedicated program, a dedicated tool, or a dedicated application. When the image processing device 100 operates in conjunction with the scanner 10, dedicated software stored in the image processing device 100 is connected to the scanner 10 to receive data acquired through scanning of an object in real time. can do. For example, in Medit's 3D scanner i500, there is dedicated software for processing data acquired through scanning of an object. Specifically, Medit produces and distributes 'Medit Link', software for processing, managing, using, and/or transmitting data obtained from a 3D scanner (eg i500). Here, 'dedicated software' means a program, tool, or application that can operate in conjunction with a 3D scanner, so that various 3D scanners developed and sold by various manufacturers may use it in common. In addition, the aforementioned dedicated software may be produced and distributed separately from the 3D scanner that scans the object.

The image processing device 100 may store and execute dedicated software corresponding to the i500 product. The transfer software may perform one or more operations for acquiring, processing, storing, and/or transmitting the image. Here, dedicated software may be stored in the processor. Also, the dedicated software may provide a user interface for using data obtained from the 3D scanner. Here, the user interface screen provided by dedicated software may include an image created according to the disclosed embodiment.

An image processing method according to an embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable medium. In addition, an embodiment of the present disclosure may be a computer-readable storage medium in which one or more programs including at least one instruction for executing an image processing method are recorded.

The computer readable storage medium may include program instructions, data files, data structures, etc. alone or in combination. Here, examples of computer-readable storage media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, floptical disks and Hardware devices configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like, may be included.

Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' may mean that the storage medium is a tangible device. Also, the 'non-temporary storage medium' may include a buffer in which data is temporarily stored.

According to an embodiment, a method of processing an image according to various embodiments disclosed in this document may be included in a computer program product and provided. A computer program product may be distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)). Alternatively, it may be distributed (eg, downloaded or uploaded) online through an application store (eg, play store, etc.) or directly between two user devices (eg, smartphones). Specifically, the computer program product according to the disclosed embodiment may include a storage medium on which a program including at least one instruction for performing the image processing method according to the disclosed embodiment is recorded.

Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also within the scope of the present invention. belongs to

Claims

In the image processing method,

obtaining mesh data of an object;

transforming the mesh data based on a user input; and

Based on at least one threshold condition, providing feedback on the deformed mesh data.
According to claim 1,

The mesh data includes restoration data for at least one tooth.
According to claim 1,

The method,

Further comprising displaying at least one menu item for transforming the mesh data on a screen,

The at least one menu item may include a first menu item corresponding to a mesh addition function, a second menu item corresponding to a mesh removal function, a third menu item corresponding to a mesh smoothing function, and a fourth menu item corresponding to a mesh morphing function. contains at least one of the menu items;

The step of transforming the mesh data,

and transforming the mesh data based on the user input for selecting the at least one menu item.
According to claim 1,

The step of providing the feedback is,

determining whether the deformed mesh data satisfies the threshold condition; and

Based on not satisfying the threshold condition, providing the feedback indicating that the deformed mesh data is not appropriate; an image processing method comprising:
According to claim 1,

The critical condition is,

A distance condition between the outer surface and the inner surface of the mesh data, whether or not an interference area occurs in which the outer surface of the mesh data overlaps with the tooth data corresponding to the mesh data, and the distance between the outer surface of the mesh data and the tooth data An image processing method comprising at least one of the conditions.
According to claim 5,

The mesh data is restoration data for at least one tooth,

The tooth data includes data on at least one of an opposing tooth engaged with the restoration and an adjacent tooth adjacent to the restoration.
According to claim 5,

Determining whether or not the threshold condition is satisfied,

Determining whether a distance condition between an outer surface and an inner surface of the mesh data is satisfied;

Determining whether or not the distance condition between the outer surface and the inner surface of the mesh data is satisfied,

performing a ray-intersection test by generating virtual rays in a normal direction from vertices or faces included in inner surfaces of the mesh data;

determining a distance between an outer surface and an inner surface of the mesh data based on points at which the virtual rays intersect; and

Determining whether the distance satisfies at least one threshold range; including, image processing method.
According to claim 5,

The step of providing the feedback is,

and displaying a region in which a distance between an outer surface and an inner surface of the deformed mesh data does not satisfy the threshold condition to be identified with other areas.
According to claim 5,

The step of providing the feedback is,

and displaying, in color, a degree of overlap between the deformed mesh data and the tooth data in the interference area when the interference area occurs.
According to claim 1,

The step of providing the feedback is,

and displaying a message indicating that the deformed mesh data is not appropriate based on the fact that the deformed mesh data does not satisfy the threshold condition.
According to claim 1,

The step of providing the feedback is,

And displaying the deformed area of the mesh data in a color according to the amount of deformation.
According to claim 1,

The step of providing the feedback is,

And displaying at least one of an allowable minimum thickness and maximum thickness of the mesh data.
The image processing device,

display;

a memory that stores one or more instructions; and

contains a processor;

The processor, by executing the one or more instructions stored in the memory,

Acquiring mesh data for an object,

Transforming the mesh data based on user input;

Based on at least one critical condition, the image processing device controls the display to provide feedback on the deformed mesh data.
According to claim 13,

The mesh data includes restoration data for at least one tooth.
According to claim 13,

The processor, by executing the one or more instructions,

Control the display to display at least one menu item for transforming the mesh data on the screen;

Modifying the mesh data based on the user input for selecting the at least one menu item;

The at least one menu item may include a first menu item corresponding to a mesh addition function, a second menu item corresponding to a mesh removal function, a third menu item corresponding to a mesh smoothing function, and a fourth menu item corresponding to a mesh morphing function. An image processing device comprising at least one of the menu items.
According to claim 13,

The processor, by executing the one or more instructions,

determining whether the deformed mesh data satisfies the threshold condition;

Based on not satisfying the threshold condition, providing the feedback indicating that the deformed mesh data is not appropriate.
According to claim 13,

The critical condition is,

A distance condition between the outer surface and the inner surface of the mesh data, whether or not an interference area occurs in which the outer surface of the mesh data overlaps with the tooth data corresponding to the mesh data, and the distance between the outer surface of the mesh data and the tooth data An image processing device comprising at least one of the conditions.
According to claim 17,

The mesh data is restoration data for at least one tooth,

The tooth data includes data on at least one of an opposing tooth engaged with the restoration and an adjacent tooth adjacent to the restoration.
According to claim 17,

The processor, by executing the one or more instructions,

Generating virtual rays in a normal direction from vertices or faces included in the inner surface of the mesh data to perform a ray-intersection test;

Determine a distance between an outer surface and an inner surface of the mesh data based on points at which the virtual rays intersect;

An image processing device that determines whether the distance satisfies at least one threshold range.
A computer-readable recording medium recorded with a program containing at least one instruction for performing an oral image processing method by a computer, wherein the oral image processing method comprises:

obtaining mesh data of an object;

transforming the mesh data based on a user input; and

Based on at least one threshold condition, providing feedback on the deformed mesh data.