KR20080107012A - Method and apparatus for extracting image after dental bleaching using photo of teeth - Google Patents

Method and apparatus for extracting image after dental bleaching using photo of teeth Download PDF

Info

Publication number
KR20080107012A
KR20080107012A KR1020070054761A KR20070054761A KR20080107012A KR 20080107012 A KR20080107012 A KR 20080107012A KR 1020070054761 A KR1020070054761 A KR 1020070054761A KR 20070054761 A KR20070054761 A KR 20070054761A KR 20080107012 A KR20080107012 A KR 20080107012A
Authority
KR
South Korea
Prior art keywords
region
image
interest
whitening treatment
user
Prior art date
Application number
KR1020070054761A
Other languages
Korean (ko)
Inventor
추상완
Original Assignee
(주)풀쓰리디소프트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)풀쓰리디소프트 filed Critical (주)풀쓰리디소프트
Priority to KR1020070054761A priority Critical patent/KR20080107012A/en
Publication of KR20080107012A publication Critical patent/KR20080107012A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/001—Texturing; Colouring; Generation of texture or colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30036—Dental; Teeth

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)

Abstract

Provided are an apparatus and a method for extracting images after whitening treatment using dental photographs.

According to an embodiment of the present invention, an apparatus for extracting a whitening treatment image after receiving a whitening treatment receives a range of a region of interest from a user, a means for generating a divider line having the same threshold value within the region of interest, and receives a region of interest to be added or excluded from the user. Means for automatically excluding the micro area within the region of interest, and means for gradually changing the RGB values of the pixels in the region of interest to produce an image after whitening treatment.

Description

Method and apparatus for extracting image after dental bleaching using photo of teeth}

1 is a block diagram showing the configuration of an image extraction apparatus after whitening treatment according to an embodiment of the present invention.

2 is a flowchart illustrating a process of extracting a whitening treatment image extraction method according to an embodiment of the present invention.

3 is a view showing a photograph taken from the front of the patient's face in the state that the teeth are exposed.

4 is a diagram illustrating a state in which a region of interest is input from a user on a dental photograph according to an exemplary embodiment of the present invention.

FIG. 5 is a diagram illustrating a threshold dividing line generated by the apparatus for extracting a whitening treatment according to an embodiment of the present invention.

FIG. 6 is a diagram illustrating a user interface for allowing a user to adjust a threshold value generated by the apparatus for extracting after-whitening treatment according to an embodiment of the present invention.

FIG. 7 is a view showing a result of combining an ROI generated by an apparatus for extracting whitening treatment and an ROI added or deleted by a user according to an exemplary embodiment of the present invention.

FIG. 8 is a diagram illustrating a user interface provided for a user to add or delete a region of interest to a region of interest generated by the apparatus for extracting after-whitening treatment according to an embodiment of the present invention.

9 is a view showing a whitening treatment post-image generated by the apparatus for extracting after-whitening treatment according to an embodiment of the present invention.

FIG. 10 is a view illustrating a user interface provided to a user to adjust a whitening index of a whitening treatment image generated by the apparatus for extracting a whitening treatment image according to an embodiment of the present invention.

The present invention relates to an apparatus and method for extracting after-whitening treatment, and more particularly, after a whitening treatment that can be provided to the dentist and the patient by predicting the image after the whitening treatment from the dental photograph of the patient before the procedure. An image extraction apparatus and method.

In general, dentists used dental images before and after the procedure to establish a plan for whitening treatment or to explain the plan to patients. However, the dental image before the procedure can be secured by directly photographing the patient, whereas the dental image after the procedure cannot be secured until the procedure is performed. For this reason, it is not an image of a patient to be treated, but rather a plan of treatment based on experience with an image of another patient who has already been treated, or stays on explaining an example with another patient's dental image. This is not an image of the patient to be treated, there is a problem that can not predict the correct treatment results. Although the dentist predicted the treatment result to some extent, there was a problem in that the patient was mistaken for the treatment result because it was difficult to accurately convey the treatment result to the patient.

In order to solve these problems, the patient's teeth are taken to show the face of the patient's teeth and the whitening treatment image is extracted based on this, thereby improving the accuracy of the treatment plan for the dentist and giving the patient more realistic treatment results. There is a need for a simulation apparatus and method that can be presented.

It is an object of the present invention to provide an apparatus and method for extracting after-whitening treatment image, which accurately predicts and displays an image after performing a whitening treatment by using a face photograph in which a patient's teeth are exposed.

Another technical problem to be achieved by the present invention is to provide an apparatus and method for extracting after-whitening treatment image, which predicts and displays an image after performing a whitening treatment using a suitable prediction method according to various conditions of the patient's teeth.

The objects of the present invention are not limited to the above-mentioned objects, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the apparatus for extracting after-whitening treatment according to an embodiment of the present invention is a means for receiving a range of a region of interest from a user, a means for generating a dividing line having the same threshold value within the region of interest, or adding from a user. Means for receiving a region of interest to be excluded, Means for automatically excluding a small region within the region of interest, Means for generating an image after the whitening treatment by gradually changing the RGB value of the pixels in the region of interest.

In order to achieve the above object, according to an embodiment of the present invention, a method for extracting a whitening treatment image after receiving a region of interest from the user, generating a dividing line having the same threshold value within the region of interest, adding or excluding the user Receiving a region of interest to be input, automatically excluding a small region from the region of interest, and gradually generating an image after whitening by gradually changing RGB values of pixels in the region of interest.

Specific details of other embodiments are included in the detailed description and the drawings.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims. Like reference numerals refer to like elements throughout.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. It will be appreciated that the combination of each block in the accompanying block diagram and each step in the flowchart may be performed by computer program instructions. These computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment such that instructions executed through the processor of the computer or other programmable data processing equipment may not be included in each block or flowchart of the block diagram. It will create means for performing the functions described in each step. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of each step of the block diagram. Computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operating steps are performed on the computer or other programmable data processing equipment to create a computer-implemented process to create a computer or other programmable data. Instructions that perform processing equipment may also provide steps for performing the functions described in each block of the block diagram and in each step of the flowchart.

In addition, each block or step may represent a portion of a module, segment or code that includes one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative implementations, the functions noted in the blocks or steps may occur out of order. For example, the two blocks or steps shown in succession may in fact be executed substantially concurrently or the blocks or steps may sometimes be performed in the reverse order, depending on the functionality involved.

1 is a block diagram showing the configuration of an image extraction apparatus after whitening treatment according to an embodiment of the present invention.

The apparatus 100 for extracting post-whitening treatment according to the present exemplary embodiment may include an input unit 110, a tooth image reading unit 120, an ROI generation unit 130, a threshold division line generation unit 140, and an ROI correction unit ( 150), the micro area removing unit 160, the whitening treatment image generating unit 170, the output unit 180, and the storage unit 190.

The dental image reading unit 120 reads a dental image stored in the storage 190, that is, a photograph taken of the patient's face with the teeth exposed, and provides the image to the ROI generator 130. The dental image and the image after the whitening treatment extracted therefrom may be stored in the storage 190.

The ROI generation unit 130 displays the dental image of the patient read through the dental image reading unit 120 to the user. The range of the ROI is input from the user on the patient's dental image. Here, the description will be mainly focused on receiving a region of interest including a tooth from a user, but in another embodiment, the range of the region of interest may be automatically recognized by analyzing a tooth image. The region of interest refers to a region where the range is narrowed out of the entire dental image for the strict application of the extraction algorithm. An embodiment of the dental image is as shown in FIG. 3, and an embodiment of the region of interest input on the dental image is as shown in FIG. 4.

The threshold divider generator 140 analyzes a region of interest of the dental image generated by the region of interest generator 130 to generate and display a divider line 620 having the same threshold values. The threshold dividing line provided in this way has an effect of more precisely area of interest for whitening treatment. In addition to the threshold dividing line generated by the apparatus for extracting after-whitening treatment according to the present embodiment, the threshold value itself is provided to the user (640). Threshold dividing line applied to distinguish the area where the tooth is located in the region of interest of the teeth is mainly focused on automatically generating the image by analyzing the tooth image.However, in order to distinguish the tooth area and other parts more precisely, Can be modified (610, 630) the threshold value as a reference. An embodiment of a dental image in which a threshold dividing line generated by the image extraction apparatus after whitening treatment according to the present embodiment is shown is shown in FIG. 5. The interface provided in relation to the modification of the threshold dividing line and the threshold value by the image extraction apparatus after whitening treatment according to the present embodiment is illustrated in FIG. 6.

The region of interest correction unit 150 allows a user to add or delete the region of interest generated by the region of interest generator 130 through the input unit 110. The region of interest is described mainly based on the user inputting the range of the region of interest and automatically generated by the image extraction apparatus after the whitening treatment according to the present embodiment. The user may add (810) or delete (820) the ROI. In addition, when the user adds or deletes a region of interest, the user may directly select (830) a size to be added or deleted to achieve the purpose more quickly. An embodiment of the ROI modified by the user is illustrated in FIG. 7. The interface provided in connection with the correction of the ROI by the apparatus for extracting after-whitening treatment according to the present embodiment is illustrated in FIG. 8.

The micro region removal unit 160 automatically removes small portions of the region of interest generated by the region of interest generator 130. The user's interest is to predict the changed appearance in advance when the teeth are whitened. Even though a relatively small part is included in the area of interest, such a part is not an area of interest that meets the end purpose. For this reason, the micro area relatively small compared to the tooth is automatically removed by the image extraction apparatus after the whitening treatment according to the present embodiment.

The image generating unit 170 after the whitening treatment is generated by the ROI generation unit 130 and modified by the threshold dividing line generation unit 140, the ROI correction unit 150, and the microregion removal unit 160. After the region of interest is applied to the first tooth photograph, the image after the whitening treatment is finally generated by changing the RGB values of each pixel corresponding to the tooth. That is, a whitening treatment image is generated by comprehensively processing the dental image of the patient input through the dental image reading unit 120 and various information input through the input unit 110 from the user. As a result, the user can grasp the predicted result of the whitening treatment through the virtual photograph. The whitening treatment image generated by the whitening treatment image generator 170 may be illustrated as shown in FIG. 9 through the output unit 180. At this time, the user may change 1010 the whitening index to more accurately predict the whitening treatment result. The interface provided in relation to the change of the whitening index by the image extraction apparatus after the whitening treatment according to the present embodiment is illustrated in FIG. 10.

In addition, the output unit 180 displays the image after the whitening treatment reproduced by the image generator 170 after the whitening treatment whenever the user changes the whitening index. The output unit 180 gradually displays the pre-whitening treatment image to the post-whitening treatment image in various stages so that the user can easily detect the change of the whitening in the output method.

The storage unit 190 may store not only a dental image, but also a region of interest region, a threshold value, a detailed additional region or a region of interest region, a whitening index, a whitening treatment image, and the like input by the user at each step.

Until now, each component of FIG. 1 may refer to software or hardware such as a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). However, the components are not limited to software or hardware, and may be configured to be in an addressable storage medium and may be configured to execute one or more processors. The functions provided in the above components may be implemented by more detailed components, or may be implemented by combining a plurality of components to perform a specific function. In addition, the components may be implemented to execute one or more computers in a system.

2 is a flowchart illustrating a process of extracting a whitening treatment image extraction method according to an embodiment of the present invention.

The dental image reading unit 120 loads the dental image stored in the storage 190 and provides it to the ROI generator 130 (S210). The region of interest generation unit 130 receives the range of the region of interest from the user through the input unit 110 to generate the region of interest (S220).

The ROI received in this way is transferred to the threshold division line generator 140 to generate a division line having the same threshold value within the ROI, and provide the same to the user, and receives a more appropriate threshold value through the input unit 110. Is purified to be closer to the tooth region (S230). This result is transmitted to the ROI correction unit 150 and is provided so that the user can directly add or delete the ROI through the input unit 110 (S240).

The refined region is transferred to the micro region removal unit 160 through this procedure, and here, the micro region is automatically removed to generate a final region of interest called tooth (S250).

The image generating unit 170 after the whitening treatment changes the RGB value of each pixel in the ROI transmitted from the microregion removal unit 160 to have the same effect as the whitening treatment (S260). The result of the change is synthesized with the tooth image loaded from the tooth image reading unit 120 to extract the image after the whitening treatment (S270). The extracted whitening treatment image is transmitted to the output unit 180 to be displayed (S280). At this time, in order to show an effect close to the actual whitening treatment, the user may receive the whitening index from the user and repeat the steps S260, S270 and S280.

6, 8 and 10 illustrate a user interface of the apparatus for extracting after-whitening treatment according to an embodiment of the present invention. The user interface of the apparatus for extracting after-whitening treatment according to the present embodiment may include a portion 1020 for displaying a dental image, an image after a whitening treatment, and intermediate images, a portion 610 for adjusting the threshold dividing line closer to a tooth, A portion 810 for adding a region of interest, a portion 820 for deleting the region of interest, and a portion 1010 for adjusting a whitening index of the final region of interest.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

According to the apparatus and method for extracting after-whitening treatment of the present invention as described above has one or more of the following effects.

First, it is possible to predict the appearance after the whitening treatment before the whitening treatment is performed, which has the advantage of increasing the success rate and reliability of the procedure.

Second, when the dentist explains the procedure of whitening treatment to the patient, the dentist can not only compare the appearance before and after the whitening treatment but can also explain the various situations related to the procedure. Not only is it helpful for communication, it is also helpful for obtaining consent.

Third, since the prediction is based on the facial image of the patient to be treated, a more accurate treatment result can be predicted compared to the example with the image of another patient who has already completed the treatment.

Claims (6)

Means for receiving a range of the ROI from the user; Means for generating dividing lines having the same threshold value in the region of interest and generating a threshold value dividing the tooth region and other regions; Means for receiving an input of a region of interest to be added to or excluded from the region of interest from a user; Means for automatically excluding a micro area within the region of interest; Means for gradually changing the RGB value of each pixel in the region of interest to generate an image after whitening treatment; And Apparatus for extracting post-whitening treatment comprising means for generating the ROI and post-whitening treatment image The method of claim 1, Apparatus for extracting post-whitening treatment further comprising means for displaying the post-whitening treatment image The method of claim 1, The range of the ROI is Image extraction apparatus after whitening treatment receiving a square from the user in the region of interest while displaying the tooth image The method of claim 1, The threshold dividing line and the value An apparatus for extracting post-whitening treatment that displays division lines having the same threshold value within the range of the ROI and classifies the ROI based on a specific value among them. The method of claim 2, The means for displaying The image of the patient's teeth, the image of which the region of interest is represented by a rectangle, the image of which the threshold division lines are displayed and the region of interest is divided by a specific threshold value, the image of the region of interest added or deleted from the user, and the image of interest Whitening treatment image extracting device to display the image after the small region in the region, the image after the whitening treatment that the RGB value of each pixel in the region of interest has changed Receiving an image showing a patient's teeth from a user; Generating a region of interest by receiving a region of interest from a user on the image; Displaying division lines having the same threshold value in the region of interest and dividing the region of interest based on a specific threshold value; Receiving an input of a region of interest from the user on the region of interest; Automatically removing the micro area included in the ROI; Generating an image after whitening treatment by changing the RGB value of each pixel in the ROI; And A method of extracting a whitening treatment image after the whitening treatment is generated by using a whitening index received from a user.
KR1020070054761A 2007-06-05 2007-06-05 Method and apparatus for extracting image after dental bleaching using photo of teeth KR20080107012A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020070054761A KR20080107012A (en) 2007-06-05 2007-06-05 Method and apparatus for extracting image after dental bleaching using photo of teeth

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020070054761A KR20080107012A (en) 2007-06-05 2007-06-05 Method and apparatus for extracting image after dental bleaching using photo of teeth

Publications (1)

Publication Number Publication Date
KR20080107012A true KR20080107012A (en) 2008-12-10

Family

ID=40367453

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020070054761A KR20080107012A (en) 2007-06-05 2007-06-05 Method and apparatus for extracting image after dental bleaching using photo of teeth

Country Status (1)

Country Link
KR (1) KR20080107012A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014014163A1 (en) * 2012-07-18 2014-01-23 (주)에스덴티 Program-recorded readable recording medium and integrated teeth whitening device
KR20180088436A (en) * 2015-11-30 2018-08-03 스냅 인코포레이티드 Segmenting and modifying images in a video stream
KR20210015208A (en) 2019-08-01 2021-02-10 연세대학교 산학협력단 Method of providing the information for predicting the effect of tooth whitening
KR20220154471A (en) * 2021-05-13 2022-11-22 오스템임플란트 주식회사 Method for generating reconstructed images to identify teeth area

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014014163A1 (en) * 2012-07-18 2014-01-23 (주)에스덴티 Program-recorded readable recording medium and integrated teeth whitening device
KR20180088436A (en) * 2015-11-30 2018-08-03 스냅 인코포레이티드 Segmenting and modifying images in a video stream
CN108604378A (en) * 2015-11-30 2018-09-28 斯纳普公司 The image segmentation of video flowing and modification
US11030753B2 (en) 2015-11-30 2021-06-08 Snap Inc. Image segmentation and modification of a video stream
CN108604378B (en) * 2015-11-30 2023-04-18 斯纳普公司 Image segmentation and modification of video streams
US11663706B2 (en) 2015-11-30 2023-05-30 Snap Inc. Image segmentation and modification of a video stream
US11961213B2 (en) 2015-11-30 2024-04-16 Snap Inc. Image segmentation and modification of a video stream
KR20210015208A (en) 2019-08-01 2021-02-10 연세대학교 산학협력단 Method of providing the information for predicting the effect of tooth whitening
KR20220154471A (en) * 2021-05-13 2022-11-22 오스템임플란트 주식회사 Method for generating reconstructed images to identify teeth area

Similar Documents

Publication Publication Date Title
JP6605249B2 (en) Tooth analysis device and program thereof
CN111798571A (en) Tooth scanning method, device, system and computer readable storage medium
US8605973B2 (en) Graph cuts-based interactive segmentation of teeth in 3-D CT volumetric data
JPWO2017154630A1 (en) Image processing apparatus, image processing method, and recording medium
KR20080107012A (en) Method and apparatus for extracting image after dental bleaching using photo of teeth
JP2017050683A (en) Image processor, imaging apparatus, and image processing method and program
CN104768495A (en) Method for determining at least one relevant single image of a dental subject
KR102344521B1 (en) Method for establishing diagnosis and treatment plan and 3D dental image providing device therefor
WO2017161767A1 (en) Element display method and device
US20220378548A1 (en) Method for generating a dental image
Chen et al. Automated Detection System Based on Convolution Neural Networks for Retained Root, Endodontic Treated Teeth, and Implant Recognition on Dental Panoramic Images
EP4235393A1 (en) Image processing device, image processing method, and image processing program
WO2020196939A1 (en) Apparatus and method for assessing bone age of tooth, and recording medium recording instructions for assessing bone age of tooth
KR20070063781A (en) Method and apparatus for image adaptive color adjustment of pixel in color gamut
Durgakeri et al. Implementing image processing algorithms using Xilinx system generator with real time constraints
KR102200060B1 (en) Mhthod and apparatus for easy moving to precision diagnostic module for teeth
CN110148077B (en) Method for accelerating ELBP-IP core and MR intelligent glasses
KR20180070365A (en) Method and Apparatus for Detecting a Plurality of Lesions in a Dental X-ray Image
CN111710426A (en) Method, device, system and computer readable storage medium for filling holes in tooth model
KR20140102515A (en) image processing apparatus and control method thereof
CN117414110B (en) Control method, device, terminal equipment and system of three-dimensional scanning equipment
JP2018022261A (en) Image processing apparatus
JP2020054646A (en) Oral state determination device, oral state determination method, and program
US20220198613A1 (en) Automatic Reduction of the Appearance of Mach Band Effect on Radiographs
Orthy et al. Implementation of Image Enhancement and Edge Detection Algorithm on Diabetic Retinopathy (DR) Image Using FPGA

Legal Events

Date Code Title Description
N231 Notification of change of applicant
A201 Request for examination
E601 Decision to refuse application