KR20220127764A - Device and method for identifying selection region in intraoral image - Google Patents

Abstract

A method of identifying a selection region within an oral cavity image is disclosed. Specifically, a method of identifying a selection region in an oral cavity image includes the steps of: obtaining an oral cavity image; determining a reference point of the oral cavity image; determining a brush based on a reference point and at least one piece of distance information; and identifying a region overlapping with a region defined by the brush in the oral cavity image as a selection region; and displaying a selection region in the oral cavity image.

Description

DEVICE AND METHOD FOR IDENTIFYING SELECTION REGION IN INTRAORAL IMAGE

Embodiments of the present disclosure relate to a method and an apparatus for identifying a selection region in an oral cavity image, and more particularly, to a method and an apparatus for identifying a selection region in a three-dimensional model of an oral cavity.

Dental CAD/CAM (Dental Computer Aided Design/Computer Aided Manufacturing) technology is widely used in dental treatment, particularly, prosthetic treatment. The most important thing in dental treatment using CAD/CAM is to acquire precise 3D data on the shape of an object, such as a patient's teeth, gums, and jawbone. In performing dental treatment, there is an advantage that accurate calculation can be performed by a computer by using 3D data obtained from an object. For example, in order to acquire 3D data of an object in a dental CAD/CAM treatment process, methods such as computed tomography (CT), magnetic resonance imaging (MRI), and optical scanning may be used.

In the dental CAD/CAM field, a 3D scanning device is widely used. The 3D scanning apparatus may acquire 3D surface shape information using light reflected from the object. Specifically, the 3D surface data may be recorded in the form of a polygon mesh, and the 3D surface data may include position information of vertices of the surface of the object and connection relationship information between each vertex. Alternatively, the 3D surface data may be recorded in the form of a point cloud.

When the oral cavity image processing apparatus acquires an oral cavity image from the scan data, the user may select a region in the oral cavity image using the acquired oral cavity image. However, in the prior art, there was a problem in that a lot of time is required or an unnecessary area is set in the process of identifying a selected area in the oral cavity image. Thus, a technique for accurately determining an area within an oral image may be required.

The disclosed embodiment is a method for identifying a selected region in an oral cavity image so that the region in the oral cavity image can be accurately specified according to a user input, an apparatus for performing the operation according thereto, and a computer storing a program or instructions for performing the method. An object of the present invention is to provide a readable recording medium.

As a technical means for achieving the above-described technical problem, a method according to a first aspect of the present disclosure is a method for identifying a selection region in an oral cavity image, the method comprising: acquiring an oral cavity image; determining a reference point of the oral image; determining a brush based on the reference point and the at least one distance information; identifying an area overlapping the area defined by the brush in the oral image as a selection area; and displaying a selection area in the oral image; may include.

In the method according to an embodiment of the present disclosure, the step of identifying the selection region includes: based on position information on a plurality of points of an area defined by the brush and position information on a plurality of points of an oral image, identifying at least one boundary on which the region defined by the overlapping oral image; and identifying the selection region based on the at least one boundary. may include.

In the method according to an embodiment of the present disclosure, when the brush is a two-dimensional brush, the area defined by the brush may include an area obtained by extending the two-dimensional brush in a normal direction of the display unit.

In a method according to an embodiment of the present disclosure, the identified selection region may include at least one boundary and a region of the oral cavity image located within the identified at least one boundary.

In the method according to an embodiment of the present disclosure, the displaying of the selection area may include: displaying the selection area by emphasizing at least one boundary of the selection area; may include.

In the method according to an embodiment of the present disclosure, the displaying of the selection area by emphasizing at least one boundary of the selection area includes displaying at least one boundary of the selection area with a preset color and located within the at least one boundary. Displaying the region of the oral cavity image by overlapping or blending the color of the oral image and a preset color; may include.

In a method according to an embodiment of the present disclosure, the identifying the selection region may include: identifying at least one object of the oral cavity image based on location information of a reference point; and identifying the selection region further based on the identified region of the at least one object; may include.

In a method according to an embodiment of the present disclosure, the displaying of the selection region may include: identifying at least one object of the oral cavity image included in the selection region; and displaying the selection area with different colors according to at least one object. may include.

In the method according to an embodiment of the present disclosure, the at least one distance information may include distance information between the reference point and another point in the oral image.

In the device for processing an oral cavity image according to a second aspect of the present disclosure, the device for processing the oral cavity image includes: a display unit for displaying the oral cavity image; a memory storing one or more instructions; and at least one processor executing one or more instructions. wherein the at least one processor acquires an oral cavity image, determines a reference point of the oral cavity image, determines a brush based on the reference point and at least one distance information, and includes an area defined by the brush in the oral cavity image; The overlapping region may be identified as a selection region, and the display unit may be controlled to display the selection region in the oral cavity image.

The recording medium according to the third aspect of the present disclosure may include a computer-readable recording medium in which a program for performing the method in a computer is recorded.

A method for identifying a selection region in an oral cavity image according to the disclosed embodiment, an apparatus for performing an operation according thereto, and a computer-readable recording medium storing a program or instructions for performing the method include a reference point of the oral cavity image and at least one By identifying the selection region based on the distance information of , it is possible to provide a user interface screen with increased accuracy of region selection in the oral cavity image.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention can be easily understood by the following detailed description and combination of the accompanying drawings, in which reference numerals mean structural elements.
1 is a view for explaining an oral image processing system according to the disclosed embodiment.
2 is a diagram for explaining a method of identifying a selection region in an oral cavity image.
3 shows a block diagram of an apparatus for processing an oral image according to an embodiment.
4 is an example of a detailed block diagram of an apparatus for processing an oral image according to an embodiment.
5 is a flow diagram illustrating an embodiment of a method for identifying a selection region within an oral cavity image.
6 is a flowchart for explaining an operation of identifying an area overlapping an area determined by a brush in an oral image as a selection area.
7 is a reference diagram for explaining an operation of identifying a selection region in an oral cavity image when the brush is a two-dimensional brush.
8 is a reference diagram for explaining an operation of identifying a selection region in an oral cavity image when the brush is a two-dimensional brush.
9 is a reference diagram for explaining an operation of identifying a selection region in an oral image when the brush is a three-dimensional brush.
10 is a reference diagram for explaining an operation of identifying at least one boundary of a selection region of an oral cavity image.
11 is a reference diagram for explaining an embodiment of identifying at least one object of an oral cavity image based on location information of a reference point.
FIG. 12 is a diagram for explaining an embodiment in which a selection region is further identified based on the region of at least one identified object and an embodiment in which a selection region is displayed with a different color according to the identified at least one object, following FIG. 11 . It is also a reference.
13 is a reference diagram for explaining an example of identifying at least one object of an oral cavity image based on location information of a reference point.
14 is a diagram for explaining an embodiment in which a selection region is further identified based on the region of at least one identified object and an embodiment in which a selection region is displayed with a different color according to the identified at least one object, following FIG. 13 . It is also a reference.
15 is a reference diagram for explaining an embodiment of displaying a selection region in an oral image when a selection region is identified based on a three-dimensional brush.
16 is a reference diagram for explaining an embodiment of displaying a selection area in which a hole is displayed when there is a hole in an area identified based on a three-dimensional brush.

This specification clarifies the scope of the present invention, explains the principles of the present invention, and discloses embodiments so that those of ordinary skill in the art to which the present invention pertains can practice the present invention. The disclosed embodiments may be implemented in various forms.

Like reference numerals refer to like elements throughout. This specification does not describe all elements of the embodiments, and general content in the technical field to which the present invention pertains or content that overlaps between the embodiments is omitted. The term 'part' used in the specification may be implemented in software or hardware, and according to embodiments, a plurality of 'parts' may be implemented as one element (unit, element), or one ' It is also possible for part' to include a plurality of elements. Hereinafter, the working principle and embodiments of the present invention will be described with reference to the accompanying drawings.

As used herein, an 'object' is an object to be photographed, and the object may include a person, an animal, or a part thereof. For example, the object may include a body part (such as an organ or an organ), an artificial structure attachable to or insertable into the object, or a phantom. For example, the subject may have teeth, gingiva, at least a portion of the oral cavity, and/or artificial structures insertable into the oral cavity (eg, orthodontic devices including brackets and wires, implants, artificial teeth, inlays and onlays, etc.) including dental restorations, orthodontic aids inserted into the oral cavity), teeth or gingiva to which artificial structures are attached.

In the present disclosure, an 'oral image' may refer to a two-dimensional image of an object or a three-dimensional image as an oral image three-dimensionally representing the object. Specifically, the image may include at least one tooth or an image representing an oral cavity including at least one tooth (hereinafter, 'oral image'). In the present disclosure, the oral image may include both a two-dimensional frame and a three-dimensional frame. For example, the oral image may include a two-dimensional frame including two-dimensional images obtained from different viewpoints with respect to the object, a three-dimensional frame expressed in a point cloud form, or a polygonal mesh form.

Also, in the present disclosure, 'data' may refer to information necessary to represent an object in two or three dimensions, for example, raw data obtained from at least one image sensor. Specifically, the raw data may be data acquired to generate an oral image, and the raw data is at least included in the oral scanner when scanning the inside of the patient's mouth, which is an object, using an intraoral scanner. It may be data (eg, two-dimensional data) obtained from one image sensor. Raw data obtained from an intraoral scanner may be referred to as scan data or two-dimensional image data.

Hereinafter, embodiments will be described in detail with reference to the drawings.

1 is a view for explaining an oral image processing system according to the disclosed embodiment.

1 , an oral image processing system according to an embodiment of the present disclosure may include a scanner 100 and an oral image processing device 300 .

The scanner 100 according to an embodiment of the present disclosure is a medical device for acquiring an image in an oral cavity. Specifically, the scanner 100 may be a device for acquiring an image of the oral cavity including at least one tooth by being inserted into the oral cavity and scanning teeth in a non-contact manner. In addition, the scanner 100 may have a form that can be drawn in and out of the oral cavity, and can scan the inside of the patient's oral cavity using at least one image sensor (eg, an optical camera, etc.). The scanner 100 is at least one of teeth, gingiva, and artificial structures insertable into the oral cavity (eg, orthodontic devices including brackets and wires, implants, artificial teeth, orthodontic aids inserted into the oral cavity, etc.) In order to image the surface of , surface information on the object may be acquired as two-dimensional image data. The two-dimensional image data obtained by the scanner 100 may be raw data obtained to generate an oral image. In FIG. 1 , the scanner 100 is illustrated as an oral scanner having a shape that is inserted into the oral cavity, but the scanner 100 applied to the embodiments disclosed in the present disclosure may include a model scanner that scans a tooth model.

The two-dimensional image data obtained by the scanner 100 according to an embodiment of the present disclosure may be transmitted to the oral image processing apparatus 300 connected through a wired or wireless communication network. The oral image processing device 300 is connected to the scanner 100 through a wired or wireless communication network, and may receive two-dimensional image data obtained by scanning the oral cavity from the scanner 100. The oral cavity image processing apparatus 300 may generate a 3D oral cavity image according to the following embodiments.

As an embodiment of generating a three-dimensional oral image, the scanner 100 may transmit raw data obtained through an oral scan to the oral image processing apparatus 300 or process and transmit the raw data. The oral cavity image processing apparatus 300 may generate a 3D oral cavity image representing the oral cavity in three dimensions according to the received raw data. Since the '3D oral image' can be generated by modeling the internal structure of the oral cavity in three dimensions based on the received raw data, the '3D oral image' is a '3D model' It may be referred to as a 'three-dimensional model', a 'three-dimensional oral model' or a 'three-dimensional oral image'. Hereinafter, a model or image representing the oral cavity in two or three dimensions is collectively referred to as a 'mouth image'. As another embodiment of generating a three-dimensional oral image, the scanner 100 may obtain raw data through an oral scan and process the obtained raw data to generate an image corresponding to the oral cavity, which is an object. The scanner 100 may transmit the oral cavity image generated to correspond to the oral cavity to the oral cavity image processing apparatus 300 .

The oral cavity image processing device 300 according to an embodiment of the present disclosure may be any electronic device capable of generating, processing, displaying, and/or transmitting an oral cavity image based on the two-dimensional image data received from the scanner 100. Specifically, the oral image processing device 300 generates at least one of the information generated by processing the two-dimensional image data and the oral image generated by processing the two-dimensional image data, and displays at least one of the generated information and the oral image to the display unit 310 can be displayed through The oral image processing device 300 is a device for analyzing, processing, displaying, and/or transmitting the received image, and may be a computing device such as a smart phone, a laptop computer, a desktop computer, a PDA, a tablet PC, and the like. not limited For example, the oral image processing device 300 may be in the form of a server (or server device) for processing the oral cavity image.

In addition, the oral image processing apparatus 300 according to an embodiment of the present disclosure may store and execute dedicated software linked to the scanner 100 . Here, the dedicated software may be called a dedicated program or a dedicated application. When the oral image processing device 300 operates by interworking with the scanner 100, dedicated software stored in the oral image processing device 300 may be connected to the scanner 100 to receive data acquired through object scan in real time. The dedicated software may be stored in the memory of the oral image processing device 300 .

In addition, the dedicated software may provide a user interface for use of data acquired by the scanner 100 . The user interface screen provided by the dedicated software may include an oral image or a three-dimensional model. The oral cavity image processing apparatus 300 may display a selection area identified according to the reference point of the oral cavity image and at least one piece of distance information on the display unit 310 using dedicated software.

In the disclosed embodiment, the oral image processing device 300 is an electronic device capable of generating an oral cavity image three-dimensionally representing an oral cavity including one or more teeth, and displaying the oral cavity image in which a selection area is displayed through the display unit 310, It will be described in detail below.

2 is a diagram for explaining a method of identifying a selection region in an oral cavity image.

Referring to FIG. 2 , in the related art, a user may hover or hover over an oral image 210 using a graphic tool called a brush in order to select an area 211 of the oral image 210, and the oral image processing apparatus uses a brush. When the user clicks in a state in which is positioned or moved, a screen including a graphic showing a preview of a selection area determined by an area in which the brush is positioned or passed by the brush may be output.

However, since the brush has a certain size and shape, depending on the size or shape of the brush, the area 211 selected by the brush is an area 212 or three-dimensional area corresponding to the back gum in addition to the area the user wants to select with the brush. The region 213 in which the point data of the model does not exist may also be included. Accordingly, the area 212 and the area 213 may be unnecessarily selected areas. According to the related art, there is a problem in that an unnecessary area is set in identifying a selected area in a 3D image.

In addition, referring to FIG. 2 , in the related art, although the oral image 220 is a three-dimensional oral image or a three-dimensional oral model, the selection area 221 may be displayed as if it were two-dimensional. Therefore, according to the related art, in identifying the selection region in the three-dimensional image, although the oral image 220 is a three-dimensional image, the selection region is displayed in two dimensions, there is a problem in that it is difficult to accurately select the selection region.

In order to solve this problem, the oral image processing apparatus 300 according to various embodiments of the present disclosure proposes a method for identifying and displaying a selection area that a user wants to select with high speed and high accuracy.

3 shows a block diagram of an apparatus for processing an oral image according to an embodiment.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may be an electronic device for processing an oral cavity image and displaying the processed oral cavity image. The oral image processing apparatus 300 according to an embodiment of the present disclosure may include a display 310 , a memory 320 , and a processor 330 . Hereinafter, the components will be described in turn.

The display unit 310 may display a screen, and may display a predetermined screen under the control of the processor 330 . The display unit 310 may include a display panel and a controller (not shown) for controlling the display panel, and the display unit 310 may display a display built in the oral image processing apparatus 300 . The display panel may be implemented in various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active-matrix organic light-emitting diode (AM-OLED), a plasma display panel (PDP), and the like. . The display panel may be implemented to be flexible, transparent, or wearable. The display 310 may be provided as a touch screen by being combined with a touch panel of a user input unit (not shown). For example, the touch screen may include an integrated module in which the display panel and the touch panel are combined in a stacked structure.

The display unit 310 according to an embodiment of the present disclosure may display a screen, and may display a predetermined screen under the control of the processor 330 . Specifically, the display unit 310 may display a user interface screen including an oral cavity image generated based on data obtained by scanning the patient's oral cavity with the scanner 100 . The display unit 310 may display a user interface screen including information related to a patient's dental treatment. Also, for example, the display 310 may provide a user interface screen including the selected area to the user by displaying the 3D oral model in which the area selected by the user is displayed.

The memory 320 may store a program for processing and controlling the processor 330 . The memory 320 according to an embodiment of the present disclosure may store one or more instructions.

The processor 330 may control the overall operation of the oral image processing apparatus 300, and may control the operation of the oral image processing apparatus 300 by executing one or more instructions stored in the memory 320.

The processor 330 according to an embodiment of the present disclosure executes one or more instructions stored in the memory 320 to obtain an oral cavity image, determine a reference point of the oral cavity image, and determine a brush based on the reference point and at least one distance information and identify an area overlapping the area determined by the brush in the oral cavity image as the selection region, and control the display 310 to display the selection region in the oral cavity image.

The processor 330 according to an embodiment of the present disclosure executes one or more instructions stored in the memory 320, based on the location information for a plurality of points in the area defined by the brush and location information for a plurality of points in the oral image, At least one boundary where the region defined by the brush and the oral cavity image overlap may be identified, and the selection region may be identified based on the at least one boundary.

The processor 330 according to an embodiment of the present disclosure may control the display 310 to display the selection area by emphasizing at least one boundary of the selection area by executing one or more instructions stored in the memory 320 .

By executing one or more instructions stored in the memory 320, the processor 330 according to an embodiment of the present disclosure displays at least one boundary of the selection region with a preset color, and the region of the oral image located within the at least one boundary is the oral image. The display unit 310 may be controlled to display the color and the preset color by overlapping or blending.

The processor 330 according to an embodiment of the present disclosure executes one or more instructions stored in the memory 320, and identifies at least one object of the oral cavity image based on the position information of the reference point, and in the area of the identified at least one object. The selection region may be identified further based on it.

By executing one or more instructions stored in the memory 320, the processor 330 according to an embodiment of the present disclosure identifies at least one object of an oral image included in the selection area, and selects the selection area with a different color according to the at least one object The display unit 310 may be controlled to display.

However, not all illustrated components are essential components. The oral image processing apparatus 300 may be implemented by more components than the illustrated components, and the oral image processing apparatus 300 may be implemented by fewer components. For example, as shown in FIG. 4 , the oral image processing apparatus 300 may include a display unit 310 , a memory 320 , a processor 330 , a communication unit 340 , and a user input unit 350 .

4 is an example of a detailed block diagram of an apparatus for processing an oral image according to an embodiment.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may be an electronic device for processing an oral cavity image and displaying the processed oral cavity image. The oral image processing device 300 may be a computing device such as a smart phone, a laptop computer, a desktop computer, a PDA, or a tablet PC, but is not limited thereto. Also, the oral image processing apparatus 300 may further include a communication unit 340 and a user input unit 350 in addition to the display unit 310, the memory 320, and the processor 330. Hereinafter, the components will be described in turn. Since the description of the display unit 310 is the same as that described in FIG. 2 , it will be omitted.

The memory 320 may store a program for processing and controlling the processor 330 . The memory 320 according to an embodiment of the present disclosure may store one or more instructions. The memory 320 may include at least one of an internal memory (not shown) and an external memory (not shown). The memory 320 may store various programs and data used for the operation of the oral image processing apparatus 300 . For example, the memory 320 may store the generated three-dimensional oral image, and may store raw data or two-dimensional image data obtained from the scanner 100 . In addition, dedicated software linked to the scanner 100 may be stored. Here, the dedicated software may be a program or application for providing a user interface for use of data acquired by the scanner 100 . Also, the memory 320 may store position information of vertices of the surface of at least one object of the 3D oral image from the scanner 100 and connection relationship information between the vertices. Specifically, the memory 320 may store surface data in the form of a point cloud, and the point cloud may include location information of vertices of the object surface and connection relationship information between the vertices.

The memory 320 may include information for distinguishing at least one object of the 3D oral cavity image. For example, the memory 320 may include color information on at least one object of the 3D oral cavity image. Also, the memory 320 may include color information for displaying the selection area. Also, the memory 320 may determine at least one piece of distance information used to determine a brush. Here, the at least one piece of distance information may indicate distance information between the reference point and another point of the three-dimensional oral image.

The built-in memory includes, for example, a volatile memory (eg, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), a non-volatile memory (eg, One Time Programmable ROM (OTPROM)). ), Programmable ROM (PROM), Erasable and Programmable ROM (EPROM), Electrically Erasable and Programmable ROM (EEPROM), Mask ROM, Flash ROM, etc.), hard disk drive (HDD), or solid state drive (SSD). may include According to an embodiment, the processor 330 may load a command or data received from at least one of the non-volatile memory or other components into the volatile memory and process it. In addition, the processor 330 may store data received or generated from other components in a non-volatile memory.

The external memory includes, for example, at least one of CF (Compact Flash), SD (Secure Digital), Micro-SD (Micro Secure Digital), Mini-SD (Mini Secure Digital), xD (extreme Digital), and Memory Stick. may include

The processor 330 may include at least one of RAM, ROM, CPU, GPU, and a bus. RAM, ROM, CPU and GPU, etc. can be connected to each other via a bus.

According to an embodiment of the present disclosure, the processor 320 may include an AI-only processor for identifying, as a selection region, a region overlapping a region defined by a brush in an oral image. The artificial intelligence-only processor may be controlled to process input data according to a predefined operation rule or an artificial intelligence model stored in a memory, or may be designed as a hardware structure specialized for processing a specific artificial intelligence model.

A predefined action rule or artificial intelligence model can be created through learning, and being created through learning means that the basic artificial intelligence model is learned by using a plurality of learning data by a learning algorithm, so that the desired characteristic (or purpose) ) means that a predefined action rule or artificial intelligence model set to perform is created. Such learning may be performed in the device itself on which artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and/or system.

The communication unit 340 may communicate with at least one external electronic device through a wired or wireless communication network. Specifically, the communication unit 340 may communicate with the scanner 100 under the control of the processor 330 . The oral image processing apparatus 300 and the oral image processing apparatus 300 may include one or more components that enable communication between a plurality of devices or servers located in the vicinity. The communication unit 340 may include one or more components that enable communication between the oral image processing apparatus 300 and the server. Also, the communication unit 340 may include a short-range communication unit 341 .

Short-range wireless communication unit 341, Bluetooth communication unit, BLE (Bluetooth Low Energy) communication unit, short-range wireless communication unit (Near Field Communication unit), WLAN (Wi-Fi) communication unit, Zigbee (Zigbee) communication unit, infrared (IrDA, Infrared Data Association) communication unit, WFD (Wi-Fi Direct) communication unit, UWB (Ultra Wideband) communication unit, Ant+ communication unit, Ethernet communication unit, etc. may include, but are not limited thereto.

In addition, the communication unit 340 may further include a long-distance communication module for performing communication with a server for supporting long-distance communication according to a telecommunication standard. Specifically, the communication unit 340 may include a long-distance communication module for performing communication through a network for Internet communication. In addition, the communication unit 340 may include a long-distance communication module for performing communication through a communication network conforming to a communication standard such as 3G, 4G, and/or 5G. In addition, the communication unit 340 may include at least one port for connecting to an external electronic device by a wired cable in order to communicate with an external electronic device (eg, an intraoral scanner, etc.) by wire. Accordingly, the communication unit 340 may communicate with an external electronic device connected by wire through at least one port.

The communication unit 340 according to an embodiment of the present disclosure may receive data obtained from the scanner 100, for example, raw data obtained through an intraoral scan under the control of the processor 330 .

The user input unit 350 may receive various commands from the user, and the user input unit 350 may mean a means for the user to input data for controlling the oral image processing apparatus 300 . The user input unit 350 includes a key pad, a dome switch, and a touch pad (contact capacitive method, pressure resistance film method, infrared sensing method, surface ultrasonic conduction method, integral tension measurement method, piezo effect) method, etc.), a jog wheel, or a jog switch, but is not limited thereto. The key may include various types of keys, such as mechanical buttons and wheels, which are formed in various areas such as the front, side, and rear of the body exterior of the oral image processing apparatus 300 . The touch panel may detect a user's touch input and output a touch event value corresponding to the sensed touch signal. When the touch panel is combined with the display panel to form a touch screen (not shown), the touch screen may be implemented with various types of touch sensors such as capacitive type, pressure sensitive type, and piezoelectric type.

Specifically, the user input unit 350 includes a touch panel for detecting a user's touch, a button for receiving a user's push operation, a mouse or a keyboard for designating or selecting a point on the user interface screen, and the like. It may include, but is not limited to, a user input device. Also, the user interface 120 may include a voice recognition device for voice recognition. For example, the voice recognition device may be a microphone, and the voice recognition device may receive a user's voice command or voice request. Accordingly, the processor may control an operation corresponding to the voice command or the voice request to be performed.

5 is a flow diagram illustrating an embodiment of a method for identifying a selection region within an oral cavity image.

Referring to FIG. 5 , in step S510, the oral image processing apparatus according to an embodiment of the present disclosure may acquire an oral cavity image.

In an embodiment in which the oral image processing device acquires the oral cavity image, the scanner 100 may transmit raw data acquired through the oral cavity scan to the oral image processing device 300, and the oral image processing device 300 receives the raw data can be processed to generate or acquire an oral image. The generated oral image is a three-dimensional oral image, and may be generated by modeling the internal structure of the oral cavity based on raw data in three dimensions.

As another embodiment in which the oral image processing device acquires the oral cavity image, the scanner 100 obtains raw data through an oral scan, and processes the obtained raw data to generate an image corresponding to the oral cavity as an object. have. The scanner 100 may transmit raw raw data and an image generated based on the raw data together to the oral image processing apparatus 300 . Accordingly, the oral cavity image processing apparatus 300 may acquire the oral cavity image from the scanner 100, but is not limited thereto.

In addition, the oral image processing device 300 may store the generated oral image in the memory 320 of the oral image processing device 300, and then, when the oral image processing device 300 receives a command for determining a region in the oral image from the user, in the memory 320 Stored oral images may also be used. In addition, the oral image of the present application may refer to an oral image of the user's oral cavity generated from a scan image of the user's oral cavity taken in real time.

In step S520, the oral image processing apparatus according to an embodiment of the present disclosure may determine a reference point of the oral cavity image.

The oral image processing apparatus 300 according to an embodiment of the present disclosure may receive a user's input through the user input unit 350, and the oral image processing apparatus 300 uses the user's input as a reference point of the oral cavity image output on the user interface screen. can be decided

For example, the user may select a reference point of the oral cavity image through the user input unit 350 . Specifically, the user may use the user input unit 350 including a mouse or keyboard to select a point on the user interface screen output on the display unit 310 . Accordingly, when the user clicks or performs a preset operation at a point on the user interface screen, the oral image processing apparatus 300 may determine a point on the user interface screen as a reference point of the oral cavity image. Also, when the user performs a plurality of preset operations at a plurality of points on the user interface screen, the oral image processing apparatus 300 may determine the plurality of points on the user interface screen as a plurality of reference points of the oral cavity image.

A point where the vector identified based on the mouse pointer on the user interface screen meets the oral image on the user interface screen may be a reference point, and the reference point may be composed of a plurality of points. Specifically, the identified vector may mean a vector in a normal direction of the user interface screen among vectors passing through the mouse pointer on the user interface screen. In addition, the reference point herein may refer to a point where the determined vector and the oral image on the user interface screen first meet. Alternatively, the reference point herein may mean at least one point that is directly displayed on the user interface screen among points where the determined vector and the oral image on the user interface screen meet, but is not limited thereto. Reference point herein may refer to both one reference point and a plurality of points.

In operation S530, the oral image processing apparatus according to an embodiment of the present disclosure may determine a brush based on a reference point and at least one piece of distance information.

A brush according to an embodiment of the present disclosure may include both a two-dimensional brush and a three-dimensional brush. For example, a 2D brush may mean a circle, an ellipse, or a rectangle, and the 3D brush may be a sphere or an ellipsoid, but is not limited thereto.

The oral image processing apparatus 300 according to an embodiment of the present disclosure may determine a brush based on a reference point and at least one piece of distance information. The at least one piece of distance information may mean distance information between the reference point and another point of the oral image. Also, for example, the at least one piece of distance information may mean distance information between reference points, but is not limited thereto.

The preset distance information may be determined in various ways. The preset distance information may be determined according to a value set as a default in the system or a user input for changing the size of the brush.

When the brush is a sphere among three-dimensional brushes, the oral image processing apparatus 300 may determine a three-dimensional brush sphere by identifying a reference point determined by the user as the center of the sphere and identifying preset distance information as a radius of the sphere. In addition, when the brush is an ellipsoid among the three-dimensional brushes, the oral image processing apparatus 300 identifies the reference point determined by the user as the center of the ellipsoid, and according to a plurality of preset distance information, the x-axis semiprincipal axis, By determining the y-axis semi-major axis and the z-axis semi-major axis, an ellipsoid that is a three-dimensional brush can be determined.

In operation S540, the oral cavity image processing apparatus according to an embodiment of the present disclosure may identify a region overlapping the region determined by the brush in the oral cavity image as the selection region.

When the brush is a two-dimensional brush, the area defined by the brush may mean an area obtained by extending the two-dimensional brush in a normal direction of the display unit. Also, when the brush is a three-dimensional brush, the area defined by the brush may mean a surface area of the three-dimensional brush.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure is based on location information on a plurality of points of an area defined by a brush and location information on a plurality of points of an oral image, an area determined by a brush and an oral cavity At least one boundary on which the image overlaps may be identified. Also, the oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may identify a selection region of the oral cavity image based on the identified at least one boundary. An operation of identifying a selection region in a specific oral image will be described in detail with reference to FIGS. 6 to 9 .

In step S550, the oral image processing apparatus according to an embodiment of the present disclosure may display a selection area in the oral cavity image.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may display an oral cavity image in which the identified region is displayed through the display unit 310 . The oral image processing apparatus 300 may display the selection region by emphasizing at least one boundary of the selection region so that the user can clearly recognize and distinguish the selection region of the oral cavity image. A selection region herein may be divided into at least one boundary and a region of the oral image located within the at least one boundary. The at least one boundary may mean an area including near a boundary located outside the selection area, and the area of the oral cavity image located within the at least one boundary may mean an area excluding at least one boundary among the selection areas in the oral cavity image. can

In an embodiment for displaying the selection area by emphasizing at least one boundary of the selection area, the oral image processing apparatus 300 displays at least one boundary of the selection area with a preset color, The region may be displayed by overlapping or blending the color of the oral cavity image and a preset color. In addition, the oral image processing apparatus 300 may output a preset region located outside at least one boundary according to a preset color, and the oral image processing apparatus 300 may display and provide the selected region more appropriately to the user. .

6 is a flowchart for explaining an operation of identifying an area overlapping an area determined by a brush in an oral image as a selection area.

In step S610, the oral image processing apparatus according to an embodiment of the present disclosure may obtain position information on a plurality of points in an area determined by a brush and position information on a plurality of points in the oral image.

Herein, the location information on the plurality of points of the oral cavity image may include position information of points located on the surfaces of at least one object of the oral cavity image and/or connection relationship information between the respective points.

When the brush according to the embodiment of the present disclosure is a 3D brush, location information on a plurality of points in an area defined by the brush may mean location information of points located on the surface of the 3D brush. Also, when the brush is a two-dimensional brush, the oral image processing apparatus 300 may identify a three-dimensional figure in which the brush is projected in a normal direction on the user interface screen, and location information on a plurality of points in an area determined by the brush may mean position information of points located on the identified 3D figure surface. The location information herein may be stored in the memory 320 of the oral image processing apparatus 300, and the oral image processing apparatus 300 may use the location information stored in the memory 320 to identify the selection area.

Accordingly, the oral image processing apparatus 300 obtains position information for a plurality of points in the region defined by the brush and position information for a plurality of points in the oral image, thereby forming at least one of the region defined by the brush and the oral image. An area where the objects overlap may be accurately identified.

In step S620, the oral image processing apparatus according to an embodiment of the present disclosure may identify at least one boundary where the region defined by the brush and the oral cavity image overlap.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may identify at least one point in which position information on a plurality of points in an area determined by a brush and position information on a plurality of points in the oral image match . Specifically, the position information for the plurality of points in the area determined by the brush and the position information for the plurality of points in the oral image coincide with the oral cavity. Here, each axis of the three-dimensional model of the oral cavity may mean an x-axis, a y-axis, and a z-axis. In addition, the location information for a plurality of points in the area defined by the brush and location information for a plurality of points in the oral image coincide with the distance between the plurality of points in the area defined by the brush and the plurality of points in the oral image It may mean that is less than or equal to a preset threshold, but is not limited thereto.

In step S630, the oral image processing apparatus according to an embodiment of the present disclosure may identify a selection region of the oral cavity image based on at least one boundary.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may identify a selection region of the oral cavity image according to at least one boundary. Specifically, the oral cavity image processing apparatus 300 may at least identify a plurality of points surrounded by at least one boundary among a plurality of points of the oral cavity image. Accordingly, the oral image processing apparatus 300 may identify a region including a plurality of points identified as being surrounded by at least one boundary and at least one boundary identified in step S620 as the determined region of the oral cavity image.

7 is a reference diagram for explaining an operation of identifying a selection region in an oral cavity image when the brush is a two-dimensional brush.

Referring to FIG. 7 , an embodiment in which a selection area 730 in the oral cavity image 700 is identified according to the two-dimensional brush 720 of the oral cavity image 700 is illustrated.

The oral image 700 displayed on the display unit 310 according to an embodiment of the present disclosure may include objects such as teeth 701, teeth including teeth 702, and gums 703, and the oral image processing apparatus 300 includes at least the oral image 700 included in the oral image 700. Location information on one object and color information on at least one object may be stored. Conversely, point data including location information or color information may not exist in an area where a separate object of the oral image 700 is not present. Accordingly, the selected region in the oral cavity image may be characterized in that the region in which point data does not exist is excluded.

The two-dimensional brush 720 according to an embodiment of the present disclosure may be determined based on the reference point 710 and at least one piece of distance information. Specifically, the oral image processing apparatus 300 projects the two-dimensional brush 720 determined based on the reference point 710 located on the gum 703 and the at least one distance information in the normal direction 715, so that the three-dimensional area generated by the extension of the two-dimensional brush is projected. can be identified. Herein, the three-dimensional region generated by extending the two-dimensional brush may be referred to as a region defined by the two-dimensional brush.

Specifically, a three-dimensional area 770 generated by extending a two-dimensional brush will be described. The two-dimensional brush 760 may be determined based on the reference point 750 positioned on the object 780 of the oral cavity image and distance information stored in the memory 320 . The two-dimensional brush 760 may be a circular brush. The 3D area 770 generated by extending the 2D brush may have a shape in which the 2D brush 760 is extended in the direction of a normal vector 765 . Also, the selection area within the object 780 may refer to an area where the 3D area 770 generated by extending the 2D brush and the object 780 overlap.

The oral cavity image processing apparatus 300 may identify the selection region 730 based on position information on a plurality of points of the region determined by the two-dimensional brush 720 and position information on a plurality of points of the oral cavity image 700 . Also, the selection area 730 may not include the area 740 without point data.

8 is a reference diagram for explaining an operation of identifying a selection region in an oral cavity image when the brush is a two-dimensional brush.

Referring to FIG. 8 , an embodiment of identifying a selection region in the oral cavity image 800 according to the two-dimensional brush 830 in the oral cavity image 800 is illustrated.

Referring to FIG. 8 , the oral image processing apparatus 300 according to an embodiment of the present disclosure may identify the two-dimensional brush 830 based on a reference point 810 of the oral cavity image 800 and a distance 820 according to preset distance information. The oral image processing apparatus 300 may set a region where the 3D model extended with the 2D brush 830 and the oral cavity image 800 overlap as a selection region within the oral cavity image 800 . For example, the selection area in the oral cavity image 800 may include an area 850 that is a partial area of the tooth 851 and an area 860 that is a partial area of the tooth 861. In addition, the selection region in the oral cavity image 800 may include a region 840 that is a partial region of the gum. In this case, since the reference point 810 is located on the tooth 861 of the object, it may be appropriate for the area 850 and the area 860 to be included in the selection area within the oral image 800, considering that the area selected by the user may be limited to the tooth. On the other hand, considering that the reference point 810 selected by the user through the user input unit 350 is located on the tooth 861, so that the area selected by the user may be limited to the tooth, the area 840, which is a part of the gum, is the selected area in the oral image 800 It may be more appropriate not to include

In this case, the oral image processing apparatus 300 according to an embodiment of the present disclosure may change the type of brush to a three-dimensional brush. The oral image processing apparatus 300 may identify a selection region in the oral cavity image more suitable for the user and display it on the display unit 310 . Here, the operation of changing the type of the brush to the 3D brush by the oral image processing apparatus 300 may include an operation of suggesting to change the type of the brush to the 3D brush. Accordingly, as the oral image processing apparatus 300 changes the type of brush to a three-dimensional brush, the changed region in the oral cavity image 800 may not include the region 840, which is a partial region of the gums. The oral cavity image processing apparatus 300 may provide the user with a changed selection area within the oral cavity image 800 .

9 is a reference diagram for explaining an operation of identifying a selection region in an oral image when the brush is a three-dimensional brush.

Referring to FIG. 9 , an embodiment of identifying a selection region 930 in the oral cavity image 900 according to the three-dimensional brush 920 of the oral cavity image 900 is illustrated.

The oral image 900 displayed on the display unit 310 according to an embodiment of the present disclosure may include teeth including teeth 911 and teeth 912 and objects such as gums. The oral cavity image processing apparatus 300 may determine a reference point of the oral cavity image 900 according to a user's input. Referring to FIG. 9 , the oral cavity image processing apparatus 300 may determine a reference point 910 of the oral cavity image 900 according to a user input. Specifically, the reference point 910 may correspond to a point located on the surface of the tooth 911 among the objects.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may determine the 3D brush 920 based on the reference point 910 of the oral cavity image 900 and at least one piece of distance information. Referring to FIG. 9 , the oral image processing apparatus 300 may determine a radius of the 3D brush 920 based on at least one piece of distance information. Accordingly, the oral image processing apparatus 300 may identify the 3D brush 920 by setting the reference point 910 as the center of the sphere and determining the radius of the 3D brush 920 based on at least one piece of distance information.

The oral image processing apparatus 300 according to an embodiment of the present disclosure is based on the position information on the plurality of points located in the area determined by the three-dimensional brush 920 and the position information on the plurality of points of the oral image 900, within the oral image. The selection area 930 may be identified. For example, the oral image processing apparatus 300 may identify at least one boundary where the region defined by the three-dimensional brush 920 and the oral image 900 overlap, and identify the selection region 930 based on the identified at least one boundary. have. The area defined by the brush 920 may mean a surface area of the brush 920 . The selection area 930 may correspond to an area in which up to the curved portions of the surfaces of the teeth 911 and 912 are expressed in detail. In addition, the oral image processing apparatus 300 displays at least one boundary of the selection area 930 with a preset color, and sets the color of the tooth 911 and the color of the tooth 912 and the preset color for the area of the selection area 930 except for the at least one boundary. It can be displayed by overlapping or blending. Accordingly, the oral image processing apparatus 300 may display the selection area 930 through the display unit 310 to highlight the area selected by the user of the oral cavity image 900 .

10 is a reference diagram for explaining an operation of identifying at least one boundary of a selection region of an oral cavity image.

Referring to FIG. 10 , an embodiment of identifying at least one boundary 1020 of a selection area 1030 from an oral image 1000 is illustrated.

The oral image processing apparatus 300 according to an embodiment of the present disclosure may identify a reference point 1010 from among a plurality of points located on the surface of a tooth 1070 that is an object. The oral image processing apparatus 300 may determine a 3D brush according to a radius determined based on the reference point 1010 and at least one piece of distance information. Accordingly, the oral image processing apparatus 300 may identify at least one boundary 1020 in which the determined 3D brush and the tooth 1070 of the oral image 1000 overlap, and may determine the selection area 1030 based on the at least one boundary 1020.

For example, the at least one boundary 1020 may include points separated from the reference point 1010 by a preset radius. Referring to FIG. 10 , a distance between a point 1040 and a reference point 1010 may coincide with a preset radius r. Similarly, among a plurality of points located on the surface of the oral cavity image 1000, a plurality of points in which a distance between the reference points 1010 coincides with a preset r may be included in at least one boundary 1020.

Also, referring to FIG. 10 , a plurality of points located outside the at least one boundary 1020 may mean points having a distance from the reference point 1010 greater than a preset r. For example, the distance between the reference point 1010 and the point 1050 of the tooth 1080 located next to the tooth 1070 may be greater than a preset r. Accordingly, the point 1050 may be a point located outside the selection area 1030 . A plurality of points located within at least one boundary 1020 may mean points having a distance from the reference point 1010 smaller than a preset r. Referring to FIG. 10 , a distance between a point 1060 and a reference point 1010 may be smaller than a preset r. Accordingly, the point 1060 may be a point located within the selection area 1030 .

The oral image processing apparatus 300 may output a plurality of points separated by a preset radius r from the reference point 1010 among a plurality of points located on the surface of the oral cavity image 1000 in a preset color. Specifically, referring to FIG. 10 , the oral image processing apparatus 300 selects a plurality of points closer than a reference point 1010 and a preset radius r among a plurality of points located on the surface of the oral image 1000 to the color of the tooth 1070 and the preset color. By blending, it is possible to output translucently.

11 is a reference diagram for explaining an embodiment of identifying at least one object of an oral cavity image based on location information of a reference point.

As an embodiment of identifying at least one object of the oral cavity image 1100, the oral cavity image processing apparatus 300 may identify the at least one object of the oral cavity image 1100 according to color information corresponding to the position information for the reference point 1110. For example, a plurality of objects included in the oral image 1100, such as teeth and gums, may have different color information according to the type of the object, and such color information may be related to a plurality of points located in the oral image 1100 together with location information. It may be stored in the memory 320 in the form of a point cloud.

Referring to FIG. 11 , the oral image processing apparatus 300 may identify that the object on which the reference point 1110 is located is a tooth 1105 based on color information of the reference point 1110 . Also, the oral image processing apparatus 300 may identify at least one boundary 1130 of the object on which the reference point 1110 is located, based on the color information of the tooth 1105 and the color information of the other object. However, the present invention is not limited thereto, and the oral image processing apparatus 300 may identify curvature information between points of the oral image 1100 according to the position information, and identify that the object in which the reference point 1110 is located is the tooth 1105.

FIG. 12 is a diagram for explaining an embodiment in which a selection region is further identified based on the region of at least one identified object and an embodiment in which a selection region is displayed with a different color according to the identified at least one object, following FIG. 11 . It is also a reference.

The oral cavity image processing apparatus 300 may display a selection region in the oral cavity image according to various embodiments, based on the at least one object identified in FIG. 11 .

Referring to FIG. 12 , the oral cavity image processing apparatus 300 may further identify the selection area 1210 of the oral cavity image 1200 based on at least one identified object of the oral cavity image 1200 . Specifically, the oral image processing apparatus 300 selects the oral image 1200 according to the position information on the plurality of points of the brush 1230, the position information on the plurality of points of the oral image 1200, and the identified at least one object of the oral image 1200 Region 1210 may be identified. The selection area 1210 is identified in consideration of at least one identified object, and a partial boundary of the selection area 1210 may correspond to a boundary between the tooth 1220, which is the object, and the gum.

Accordingly, the oral image processing apparatus 300 may provide a more suitable selection area to the user by displaying the identified selection area 1210 on the display unit 310 in consideration of the boundary between the tooth 1220 and the gum.

As another embodiment of displaying the selection region in the oral cavity image, referring to FIG. 12 , the oral cavity image processing apparatus 300 may display the selection region in different colors according to at least one identified object of the oral cavity image 1250 . Specifically, the oral cavity image processing apparatus 300 may identify the selection region based on position information on a plurality of points in the region determined by the brush 1260 and position information on a plurality of points in the oral cavity image 1250 . Also, the oral image processing apparatus 300 may display the selection area in different colors according to at least one object included in the selection area. For example, as shown in FIG. 12 , the oral image processing apparatus 300 may display the area 1270 corresponding to the tooth 1290 among the selected areas in the oral image with a first color, and the oral image processing apparatus 300 may display the area in the oral image. The area 1280 corresponding to the middle gum 1295 may be displayed in the second color. That is, the oral image processing apparatus 300 may display the area 1270 and the area 1280 in different colors based on the boundary between the tooth 1290 and the gum 1295 .

Accordingly, the oral image processing apparatus 300 may provide a more suitable selection region to the user by displaying the region in the oral cavity image on the display unit 310 in consideration of the boundary between the tooth 1290 and the gum 1295 together.

13 is a reference diagram for explaining an example of identifying at least one object of an oral cavity image based on location information of a reference point.

As an embodiment of identifying at least one object of the oral cavity image 1300, the oral cavity image processing apparatus 300 may identify the at least one object of the oral cavity image 1300 according to color information corresponding to the position information for the reference point 1310. The oral image processing apparatus 300 may identify that the object on which the reference point 1310 is located is the gum 1320 based on the color information on the reference point 1310 . Also, the oral image processing apparatus 300 may identify at least one boundary of the object on which the reference point 1310 is located, based on the color information of the gum 1320 and the color information on other objects (eg, teeth 1330 and 1340). have. In more detail, the at least one boundary may mean a boundary between the teeth 1330 , 1340 , and the gum 1320 .

14 is a diagram for explaining an embodiment in which a selection region is further identified based on the region of at least one identified object and an embodiment in which a selection region is displayed with a different color according to the identified at least one object, following FIG. 13 . It is also a reference.

The oral cavity image processing apparatus 300 may display a selection region in the oral cavity image according to various embodiments, based on the at least one object identified in FIG. 13 .

As an embodiment of displaying the selection region in the oral cavity image, referring to FIG. 14 , the oral image processing apparatus 300 may further identify the selection region 1420 of the oral cavity image 1400 based on at least one identified object of the oral cavity image 1400 have. Specifically, the oral image processing device 300 according to the position information for a plurality of points in the area determined by the brush 1410, the position information for the plurality of points of the oral image 1400 and the identified at least one object of the oral image 1400, A selection region 1420 of the oral image 1400 may be identified. 14 , a partial boundary of the selection area 1420 may correspond to a boundary between a tooth (it may include a tooth 1430 and a tooth 1431) and a gum 1432 as an object. Also, the selection area 1420 may not include an area in which point data of the oral cavity image does not exist.

Accordingly, the oral image processing apparatus 300 displays the identified selection area 1420 on the display unit 310 in consideration of the boundary between the teeth (which may include the teeth 1430 and 1431) and the gums 1432, so that more suitable according to the user's input is provided. You can provide a selection area. For example, the oral image processing apparatus 300 may display the selection area 1420 on the display unit 310 by emphasizing only a portion corresponding to the gum 1432 .

As another embodiment of displaying the selection region in the oral cavity image, referring to FIG. 14 , the oral image processing apparatus 300 may display the selection region 1470 in different colors according to at least one identified object of the oral cavity image 1450 . Specifically, the oral cavity image processing apparatus 300 may identify the selection area 1470 based on location information on a plurality of points of the brush 1460 and the oral cavity image 1450 . Also, the oral image processing apparatus 300 may display the selection area 1470 in different colors according to at least one object included in the selection area 1470 . For example, as shown in FIG. 14 , the oral image processing apparatus 300 may display the area 1481 corresponding to the tooth 1491 among the selection areas 1470 in the oral cavity image as a first color, and the oral image processing apparatus 300 may display the area 1481 in the oral cavity image. The area 1482 corresponding to the tooth 1492 among the selection areas 1470 may be displayed as a second color, and the oral image processing apparatus 300 may display the area corresponding to the gum 1493 among the selection areas 1470 in the mouth image as a third color. The area corresponding to the gum 1493 may correspond to an area other than the area 1481 and the area 1482 in the selection area 1470 . That is, the oral image processing apparatus 300 may display the area 1480 in a different color based on the boundary between the teeth (it may include the teeth 1491 and 1492) and the gums 1493 . Accordingly, the oral image processing apparatus 300 may identify the tooth 1491 , the tooth 1492 , and the gum 1493 which are at least one object within the selection area 1470 , and the oral image processing apparatus 300 determines the selection area 1470 according to the teeth 1491 , the tooth 1492 , and the gum 1493 . can be displayed in different colors. The oral image processing apparatus 300 may provide a more suitable selection region to the user by displaying the region within the oral cavity image on the display unit 310 in consideration of the boundary between the teeth 1491, 1492, and the gum 1493 together.

15 is a reference diagram for explaining an embodiment of displaying a selection region in an oral image when a selection region is identified based on a three-dimensional brush.

Referring to FIG. 15 , an embodiment of displaying a selection area in an oral image by the oral image processing apparatus 300 is illustrated.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may identify a selection region according to a reference point of the oral cavity image and location information for a plurality of points, and display the selection region in the oral cavity image. For example, referring to FIG. 15 , the oral cavity image processing apparatus 300 may identify a reference point 1510 of the oral cavity image 1500 . When the brush is a sphere, the oral image processing apparatus 300 may identify the sphere 1520, which is a three-dimensional brush, based on the reference point 1510 and a preset distance. Since the oral image 1500 is an oral image corresponding to the front part of the tooth, the user may not be able to clearly identify whether the rear part of the tooth 1520 and the rear part of the tooth 1522 and the three-dimensional brush sphere 1520 overlap.

The oral image 1550 may be an image that can clearly identify whether the rear portion of the tooth 1520 and the rear portion of the tooth 1522 of the oral image 1500 overlap with the sphere 1520, which is a three-dimensional brush.

The oral cavity image processing apparatus 300 according to an embodiment of the present disclosure may identify the selection area 1570 according to the reference point of the oral cavity image 1550 and location information on a plurality of points, and display the selection area 1570 of the oral cavity image. For example, a boundary of the selection area 1570 may include a point A 1530 and a point B 1540 . Specifically, a point A 1530 located on the tooth 1521 of the oral cavity image 1550 and a point B 1540 located on the tooth 1522 may be points located at the top of the front portion of each tooth. Accordingly, the tooth 1521, the sub-region 1560 located at the rear portion of the tooth 1522, and the boundary 1580 corresponding to the sub-region 1560 may be a region of a tooth that is not observed from the front. Therefore, through the oral image 1550, the oral image processing apparatus 300 clearly identifies that the sub-region 1560 located on the rear part of the teeth 1521 and 1522 is included in the selection region 1570 in the oral image 1550 determined by the sphere 1520, which is the three-dimensional brush. can do. Therefore, by identifying the selected area in the oral image through the sphere 1520, which is an example of a three-dimensional brush, the user can identify the sub-region 1560, which is an area not clearly observed in the front part of the tooth, as a part of the selected area 1570 in the oral image. can

16 is a reference diagram for explaining an embodiment of displaying a selected area in which a hole is displayed when there is a hole in an area identified based on a three-dimensional brush.

Referring to FIG. 16 , the oral image processing apparatus 300 may identify a hole 1620 located in a selection area 1630 identified according to a reference point 1631 , and the oral image processing apparatus 300 may display the hole 1620 in the selection area 1630 .

A hole in an oral image according to an embodiment of the present disclosure may be generated during a dental treatment process, and a hole may mean an area in which point data does not exist according to a technical defect. When the oral image processing apparatus 300 is identified in the selected area, it may be necessary to display the hole in the area and provide it to the user.

The oral image processing apparatus 300 may identify a hole 1620 existing in the tooth 1610 corresponding to the location information of the reference point 1631 . Specifically, the oral image processing apparatus 300 may determine at least one area in which point data does not exist among a plurality of points located in the selection area 1630 as the hole 1620 of the selection area 1630 .

Accordingly, the oral cavity image processing apparatus 300 may display the selection area 1630 in the oral cavity image 1600 more suitable for the user by displaying the hole 1620 together with the selection area 1630 .

The method of processing an oral image according to an embodiment of the present disclosure may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. In addition, an embodiment of the present disclosure may be a computer-readable storage medium in which one or more programs including at least one instruction for executing a method of processing an oral image are recorded.

In the method according to the embodiment herein, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' is a tangible device and only means that it does not contain a signal (eg, electromagnetic wave). It does not distinguish the case where it is stored as For example, the 'non-transitory storage medium' may include a buffer in which data is temporarily stored.

According to the embodiment, the method according to the various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store or between two user devices (eg smartphones). It can be distributed directly or online (eg, downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product (eg, a downloadable app) is stored at least in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server. It may be temporarily stored or temporarily created.

The description of the present disclosure described above is for illustration, and those of ordinary skill in the art to which the present disclosure pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may also be implemented in a combined form.

The scope of the present disclosure is indicated by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present disclosure. .

Claims (11)

A method of identifying a selection region in an oral image comprising:
acquiring the oral image;
determining a reference point of the oral image;
determining a brush based on the reference point and at least one piece of distance information;
identifying an area overlapping the area defined by the brush in the oral image as the selection area; and
displaying the selection area in the oral image; A method of identifying a selection region in an oral image comprising:
The method of claim 1, wherein identifying the selection region comprises:
Based on the location information for a plurality of points in the area defined by the brush and location information for a plurality of points of the oral image, at least one boundary where the area defined by the brush and the oral image overlap identifying; and
identifying the selection region based on the at least one boundary; A method of identifying a selection region in an oral image comprising:
3. The method of claim 2,
wherein the selection area comprises the at least one boundary and an area of the oral cavity image located within the identified at least one boundary.
The method of claim 1, wherein displaying the selection area comprises:
displaying the selection area by emphasizing at least one boundary of the selection area; A method of identifying a selection region in an oral image comprising:
5. The method of claim 4, wherein the displaying of the selection area by emphasizing at least one boundary of the selection area comprises:
displaying at least one boundary of the selection region with a preset color, and displaying the region of the oral cavity image located within the at least one boundary by overlapping or blending the color of the oral cavity image and the preset color; A method of identifying a selection region in an oral image comprising:
The method of claim 1, wherein identifying the selection region comprises:
identifying at least one object of the oral cavity image based on the location information of the reference point; and
identifying the selection region further based on the region of the identified at least one object; A method of identifying a selection region in an oral image comprising:
The method of claim 1, wherein displaying the selection area comprises:
identifying at least one object of the oral cavity image included in the selection area; and
displaying the selection area in different colors according to the at least one object; A method of identifying a selection region in an oral image comprising:
The method of claim 1,
wherein the at least one distance information includes distance information between the reference point and another point in the oral cavity image.
In the apparatus for processing an oral image,
a display unit for displaying the oral image;
a memory storing one or more instructions; and
at least one processor executing the one or more instructions; includes,
The at least one processor acquires the oral image,
determining a reference point of the oral image;
determine a brush based on the reference point and the at least one distance information;
Identifying an area overlapping the area defined by the brush in the oral image as a selection area, and
An apparatus for processing an oral cavity image, which controls the display unit to display the selection region in the oral cavity image.
10. The method of claim 9,
The processor executes the one or more instructions stored in the memory,
Based on the location information for a plurality of points in the area defined by the brush and location information for a plurality of points of the oral image, at least one boundary where the area defined by the brush and the oral image overlap identify, and
identifying the selection region based on the at least one boundary.
A computer-readable recording medium in which a program for performing the method of any one of claims 1 to 8 on a computer is recorded.

Images