KR20200088978A - Method and apparatus for fmx automatic construction - Google Patents

Abstract

The present invention provides a technology for automatically generating data of full mouth series (FMX) through analysis on a multi-layer tooth panoramic image. According to an embodiment of the present invention, the method for automatically generating the FMX automatically generates a representative image for each region in accordance with definitions of the FMX in accordance with a predetermined quality standard. The representative image can be an image of a layer having the best evaluation result in accordance with the quality standard among a plurality of layers of the region.

Description

FMX automatic generation method and its device{METHOD AND APPARATUS FOR FMX AUTOMATIC CONSTRUCTION}

The present invention relates to a method and apparatus for automatically generating an FMX. More specifically, the present invention relates to a method and an apparatus for automatically generating a full mouth series (FMX) through cropping of an image of a partial region in a panoramic image of a tooth.

The Full Mouth Series (FMX) is a set of intraoral radiographic images that efficiently deploy dental radiological images to effectively obtain the information necessary for clinical judgment. FMX is also expressed in other abbreviations such as FMS and Complete Mouth Radiographic Series (CMRS). In general, the FMX is composed of a total of 18 pictures including 14 periapical view images and 4 bitewing view images (FMX-18). However, the type of FMX-20, FMX-16 or FMX-14 is also used depending on the number of apical end view images or the presence or absence and number of bytewing views. Each view provides a view of a predefined group of teeth.

In order to construct an FMX from a tooth panoramic image, there is an inconvenience of capturing an image of the highest quality among the images of an area corresponding to each view and directly inputting information about the image. In particular, if an FMX is generated using a multi-layered tooth panorama image including a plurality of image data for each layer on an arch plane, there is a burden to find a layer having the highest quality for each region. For example, in the case of a layered tooth panorama image with 40 layers, since the image needs to be captured for a total of 18 areas, the picture must be checked over a total of 720 times (18x40).

U.S. Patent No. 8447378

The technical problem to be solved by the present invention is to provide a method and apparatus for automatically generating an optimal FMX from a multi-layer tooth panoramic image.

Another technical problem to be solved by the present invention is to provide a method and apparatus for generating an FMX including an optimal representative image and a clinically meaningful image for each region of interest.

Another technical problem to be solved by the present invention, for each region of interest, add information that can intuitively sense the anterior/posterior position on the arch surface of the optimal representative image and the clinically meaningful image. It is to provide a method and apparatus for generating an FMX that further includes information.

Another technical problem to be solved by the present invention is to provide a method and apparatus for automatically selecting and outputting an optimal type of FMX that can be generated from a multi-layer tooth panoramic image among a plurality of types of FMX.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

The implant simulation method according to an embodiment of the present invention for solving the above technical problem is a step of obtaining a multi-layered tooth panoramic image including image data of a plurality of layers on the arch surface, and according to a predetermined quality criterion, the multi Automatically selecting a representative image of the first region of interest from images of a plurality of layers of the first region of interest of the layered tooth panorama image, and the image of the first view corresponding to the first region of interest And automatically generating a Full Mouth Series (FMX) in which the representative image of the first region of interest is set.

In one embodiment, the step of automatically selecting the representative image includes selecting the representative image based on the sharpness of each of the multiple layer images of the first region of interest.

In one embodiment, the step of automatically generating the FMX includes the step of automatically generating the FMX including the layer identification information of the representative image.

In one embodiment, the step of automatically selecting a representative image of the first region of interest may include the second interest among images of a plurality of layers of the second region of interest of the multi-layer tooth panoramic image according to the predetermined quality standard. And selecting the representative image of the region, and automatically generating the FMX generates the FMX in which the representative image of the second region of interest is set as the image of the second view corresponding to the second region of interest. It may include the steps. At this time, the representative image of the first region of interest and the representative image of the second region of interest are obtained from different layers.

In an embodiment, the step of selecting the representative image may further select a clinical reference image in which a difference value according to a predetermined criterion from the representative image exceeds a reference value among images of a plurality of layers of the first region of interest. And automatically generating the FMX includes generating an FMX in which the representative image and the clinical reference image are set as the image of the first view. In this case, the default image of the first view is the representative image, and the clinical reference image may be displayed auxiliaryly in response to a predetermined user input. In addition, the step of selecting the clinical reference image further includes the step of selecting, as the clinical reference image, an image having a different number of roots from the representative image among the multiple layer images of the first region of interest. can do. At this time, the step of selecting an image having a different number of roots from the representative image as the clinical reference image is based on sharpness, and a part of a plurality of images having different numbers of roots from the representative image is used as the clinical reference image. And selecting. In addition, the step of selecting the clinical reference image further includes the step of selecting, as the clinical reference image, an image in which the length of the root and the root are different from a reference value or more among the multiple layer images of the first region of interest. Can.

In one embodiment, the step of obtaining the multi-layered tooth panoramic image comprises: obtaining a tooth outline by applying tooth segmentation to the multi-layered tooth panoramic image, and the type of the FMX based on the tooth outline. It may include the step of partitioning the first region of interest defined by. At this time, the first region of interest is a region including a plurality of teeth corresponding to the first view, and the step of partitioning the first region of interest defined by the type of the FMX corresponds to the first view The method may include forming a contour of the first region of interest by merging the squares formed by the contours of the teeth of each of the plurality of teeth.

In one embodiment, the method for automatically generating the FMX repeats the steps of automatically generating the representative image and automatically generating the FMX while changing the type of the FMX, and each FMX generated for each FMX type. The method may further include scoring, determining the type of FMX to be output based on the score for each FMX according to the scoring, and outputting the FMX of the determined type. At this time, scoring each FMX generated for each FMX type may include scoring each FMX by using the concentration of layer distributions of representative images for each view included in the FMX.

FMX automatic generation apparatus according to another embodiment of the present invention is a network interface for receiving data of a multi-layer tooth panorama image including a plurality of layer-specific image data on the arch surface, and storage for storing software for automatic generation of the FMX template And a memory in which a plurality of instructions are loaded according to the execution of the software, and a processor executing the plurality of instructions. In this case, the plurality of instructions include: an instruction for automatically selecting a representative image of the first region of interest from among the images of the multiple layers of the first region of interest of the multi-layer tooth panoramic image according to a predetermined quality criterion, and It may include an instruction for automatically generating a Full Mouth Series (FMX) in which a representative image of the first region of interest is set as an image of the first view corresponding to the first region of interest.

FMX automatic generation computer program according to another embodiment of the present invention, a step of obtaining a multi-layered tooth panoramic image including a plurality of image data for each layer on the arch surface in combination with a computing device, and according to a predetermined quality standard, Automatically selecting a representative image of the first region of interest from images of a plurality of layers of the first region of interest of the multi-layered tooth panoramic image, and an image of a first view corresponding to the first region of interest As a result, the step of automatically generating a FMX (Full Mouth Series) in which the representative image of the first region of interest is set may be recorded on a computer-readable recording medium.

1 is a block diagram of an FMX automatic generation system according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a multi-layered tooth panoramic image that can be referred to in some embodiments of the present invention.
3 is a flowchart of an FMX automatic generation method according to another embodiment of the present invention.
4 and 5 are conceptual diagrams for explaining tooth segmentation and FMX region of interest based thereon that may be performed in some embodiments of the present invention.
6A and 6B are diagrams for describing an automatically generated FMX in some embodiments of the present invention.
7 is a view for explaining a method for confirming a clinical reference image in the automatically generated FMX in some embodiments of the present invention.
8 is a flowchart for explaining in detail some operations of the method described with reference to FIG. 3.
9 is a conceptual diagram illustrating selecting a clinical reference image based on the number of roots in some embodiments of the present invention.
10 is a flowchart illustrating an embodiment in which the method described with reference to FIG. 3 is partially modified.
11 is a hardware configuration diagram of an FMX automatic generating apparatus according to another embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention, and methods for achieving them will be clarified with reference to embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be embodied in various different forms, and only the embodiments allow the publication of the present invention to be complete, and general knowledge in the technical field to which the present invention pertains. It is provided to fully inform the holder of the scope of the invention, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same components throughout the specification.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings commonly understood by those skilled in the art to which the present invention pertains. In addition, terms defined in the commonly used dictionary are not ideally or excessively interpreted unless specifically defined. The terminology used herein is for describing the embodiments and is not intended to limit the present invention. In the present specification, the singular form also includes the plural form unless otherwise specified in the phrase. Hereinafter, some embodiments of the present invention will be described with reference to the drawings.

In the present specification, FMX (Full Mouth Series) may be understood to mean a set of intraoral radiographic images in which dental images of a plurality of predetermined views are arranged. Each of the plurality of views is pre-matched to one or more teeth. For information on the definition of FMX and the like, refer to the document such as the web document'https://en.wikipedia.org/wiki/Dental_radiography'. It should be understood that the FMX of the present specification affects not only the widely used FMX type, but also the number of views and the arrangement form of each view in a range capable of achieving the purpose of the FMX in the widely used FMX type. .

Referring to Figure 1, the configuration and operation of the FMX automatic generation system according to an embodiment of the present invention. The FMX automatic generation system according to the present embodiment includes a photographing device 20 and an FMX automatic generation device 100.

The imaging device 20 is a device that generates image data for grasping the arrangement of teeth of a patient, and may be, for example, a dental panoramic imaging device. In particular, the imaging device 20 may be a device that generates data of a multi-layer tooth panorama image.

The multi-layered tooth panorama image will be described with reference to FIG. 2. The multi-layered tooth panoramic image is composed of a plurality of layer images focused on a plurality of layers (1, 2, 3, 4) virtually formed on an arch plane. A plurality of layers (1, 2, 3, 4) are arranged in parallel on the arch surface, arranged so that the position of the anterior (anterior) or posterior (posterior) is different. As a result, the multi-layer tooth panoramic image includes a plurality of multi-layer images having different depths when viewed in a direction from anterior to posterior with respect to the arch surface. This means that although the multi-layer tooth panoramic image is a 2D panoramic image, it partially functions as a 3D image.

The FMX automatic generation device 100 receives data of the multi-layer tooth panorama image from the imaging device 20, and among multiple layer images of the first region of interest of the multi-layer tooth panorama image according to a predetermined quality standard A representative image is automatically selected, and an FMX in which the representative image of the first region of interest is set as the corresponding image of the first region of interest is automatically generated. The quality criterion may refer to a model that calculates a quality value based on one or more image quality evaluation factors such as, for example, sharpness. The first region of interest may be understood as a region including a tooth or a group of teeth corresponding to the first view of the FMX.

The FMX automatic generation device 100 may further set a clinical reference image for the first region of interest. In the clinical reference image, a difference value according to a predetermined criterion from the representative image exceeds a reference value, and is obtained from different layers from the representative image. For example, in the clinical reference image, the representative image and the number of roots are different from each other, or the length of the root is greater than or equal to a reference value. The dental morphology of the crown is greater than or equal to the reference value. Since it is a significantly different image from the representative image, it may be understood to indicate an image that needs to be referenced together with the representative image. The predetermined criteria for selecting a clinical reference image will be described in detail later.

The FMX is composed of a plurality of view images, and at least some of each view images may be obtained from different layers. That is, the representative image of the first region of interest corresponding to the first view is obtained from the first layer, and the representative image of the second region of interest corresponding to the second view may be obtained from the second layer. Since the FMX generated by the FMX automatic generating apparatus 100 according to the present embodiment is composed of representative images obtained from the optimal layer for each region of interest, it is effective in identifying a patient's condition, and is more effective than a manually created FMX by a person. Its quality is good. The FMX automatic generation method, etc. performed by the FMX automatic generation device 100 will be described in more detail with reference to FIGS. 3 to 10.

The FMX automatic generation device 100 may transmit the generated FMX to an external server such as the insurance company server 20. The generated FMX may be transmitted together with patient identification information. In addition, the FMX automatic generation device 100 may query the type of FMX required by the insurance company server 20 in advance before generating the FMX, and automatically generate an FMX having the FMX type received in response to the query. There will be.

The implant simulation system according to the present exemplary embodiment is not implemented only with the device configuration shown in FIG. 2, and the plurality of devices of FIG. 2 may be combined into one physical device as necessary, or conversely, each device of FIG. 2 may be provided with multiple devices It could be implemented by dividing it into physical devices. For example, the photographing device 20 and the FMX automatic generation device 100 may be implemented as one device. That is, the photographing apparatus 20 may have a function of outputting a multi-layer tooth panoramic image and the FMX together. In addition, for example, the FMX automatic generation device 100 and the insurance company server 20 may be implemented as one device. That is, the insurance company server 20 may be provided with a module that automatically configures an FMX by receiving a multi-layer tooth panoramic image.

Next, an implant simulation method according to another embodiment of the present invention will be described with reference to FIG. 3. The method according to the present embodiment may be executed by a multi-layered tooth panoramic image capturing apparatus having a computing device or a computing means. For example, the method according to the present embodiment may be executed by the FMX automatic generation device 100 described with reference to FIG. 1. Hereinafter, in the description of the present embodiment, if the subject of each operation is omitted, it will be understood that it can be performed by the above-described device. In addition, it is needless to say that the method according to the present embodiment may change the execution order of each operation within a range in which the execution order can be logically changed as necessary.

In step S100, a photographed image is obtained. It has already been described that the image may be, for example, a multi-layer tooth panoramic image.

In step S102, data of the multi-layer tooth panoramic image is input to a tooth segmentation logic to obtain a partition line of the tooth region of the image. As a result of the tooth segmentation, the tooth region partition line 30 as shown in FIG. 4 may be formed. Regarding the tooth segmentation method, various documents such as "A Problem of Automatic Segmentation of Digital Dental Panoramic X-Ray Images for Forensic Human Identication", Robert Wanat, 2011, etc. can be referred to. However, it is preferable that an algorithm of a method of forming the tooth area partition line 30 so that the tooth segmentation is closed in a box shape by forming a tooth-side partition line is used.

In step S104, a plurality of regions of interest are partitioned on the tooth panoramic image. Each region of interest is a one-to-one correspondence with each view of the FMX, and is a region including designated teeth of each view according to the FMX type.

The division of the region of interest may be performed based on the tooth region division line 30. As a result of the tooth segmentation, a tooth number corresponding to each tooth area can be identified. In addition, it has been described that each view of the FMX has a designated tooth. In this case, each view of the FMX has a plurality of designated teeth. For example, when a specific view corresponds to two premolar teeth, a square formed by merging a rectangle formed by the tooth outline of each of the two premolar teeth may be a region of interest corresponding to the specific view. FIG. 5 shows the result of forming a region of interest 40 corresponding to each view by merging a rectangle formed by a tooth outline of each of a plurality of teeth corresponding to each view.

In step S106, one representative image is selected for each region of interest. The representative image is obtained from any one of the multiple layer images. The criterion for selecting the representative image is the quality of the image considering the entire region of interest. The quality may be calculated based on one or more image quality evaluation factors such as, for example, sharpness.

The operation of selecting a representative image for each region of interest is repeated until a representative image is selected for all regions of interest (S108, S110). In addition, selection of a representative image is performed independently for each region of interest, and a result of selecting a representative image of one region of interest does not affect a result of selecting a representative image of another region of interest. Therefore, representative images can be obtained in different layers for each region of interest.

In step S112, an FMX in which a representative image for each region of interest is set is automatically generated. 6A shows an example 50 of the automatically generated FMX. The FMX includes a plurality of views 50-1. In one embodiment, the automatically generated FMX may include layer identification information of a representative image. 6A shows an example 50a of the FMX in which layer identification information is overlaid on a representative image of each view.

Preferably, the layer identification information is provided so that the anterior/posterior position of the layer can be intuitively recognized. For example, the layer identification information may be a layer number. For example, a layer number may be sequentially assigned in a manner that #1 is assigned to a layer located in the anterior, and a layer number increases as it is located in the rear. In this case, the front and rear positions of the representative image may be intuitively perceived through the layer number displayed on the representative image of the view. For example, since the representative image of the view 50a-1 is obtained from the #2 layer, it may be intuitive that it is an image of the layer closest to the foremost side.

In one embodiment, a plurality of images may be set in one view. That is, one representative image and one or more auxiliary images may be set in one view. In this specification, the'secondary image' will be referred to as a'clinical reference image'. The representative image should be essentially set, but the clinical reference image is not necessarily set. In addition, the clinical reference image and the representative image are obtained from different layers due to their properties. Hereinafter, some embodiments related to the clinical reference image will be described with reference to FIGS. 7 and 8.

When a representative image and a clinical reference image are set in a specific view, the clinical reference image may be displayed auxiliaryly in response to a predetermined user input. As illustrated in FIG. 7, when a representative image 51 is displayed in an area of a specific view of a screen on which an FMX is displayed, when a user input 60 such as mouse scroll is applied to the area of the specific view, the specific A clinical reference image 51a may be displayed in the area of the view instead of the representative image. To this end, the data of the FMX generated in step S112 preferably includes a representative image for each view and one or more clinical reference images.

The clinical reference image may be plural. In this case, when the first user input is applied while the representative image is displayed, the first clinical reference image is displayed, and when the second user input is applied in the state, the second clinical reference image is displayed. Interface) may be provided. For example, if the user input is a scroll operation using a mouse scroll button, as the scroll is continuously input in one direction, a representative image, a first clinical reference image, and a second clinical reference image will be sequentially displayed on the screen. .

In one embodiment, in a state in which a representative image is displayed, an icon indicating whether a clinical reference image is present may be overlaid on the representative image in order for the user to recognize that a clinical reference image is additionally present.

As will be described later, when the layer number of the clinical reference image of the specific view and the layer number of the representative image are compared, the tooth state of the specific view may be more clearly perceived.

This will be described with reference to FIG. 8. The representative image selection operation described with reference to FIG. 3 may include performing clinical reference image selection in addition to the representative image selection. To this end, in step S160, a comparison according to a predetermined criterion is performed between the representative image and the images of the other layers. For example, the representative image 51 of FIG. 7 is obtained from layer #6, and the images and representative images of the remaining layers (#1 to #5, #7 to #40; when the total number of layers is 40) The comparison according to the predetermined criterion of (51) is performed. In addition, when a difference between the representative image and a reference value or more is calculated as a result of the comparison, when the image of the remaining layer exists (S162), the image is selected as a clinical reference image of the representative image.

In one embodiment, the clinical reference image may be unconditionally limited to one. In this case, even if there are a plurality of images in which the difference value exceeds a reference value, an image of one layer having the largest difference value may be selected as the clinical reference image.

In another embodiment, the clinical reference image may be selected by the number of images exceeding a reference value.

Hereinafter, various embodiments of a comparison criterion between a representative image and other images will be described.

In one embodiment, the comparison criterion may be based on the shape of the tooth outline. The tooth outline may refer to the outline of the entire tooth including the crown and root. This is because FMX aims to understand not only the crown exposed outside the gums, but also the condition of the roots in the gums. The tooth outline may be obtained based on a change in pixel density.

The comparison criterion may be based on the number of roots that can be determined according to the shape of the tooth outline. The root of the tooth is morphologically, there is a mesial root, a distal root and a palatal root, or two or more of the mesial root, a distal root and a palatal root overlap. Can exist. Even if the root image is shown as one in the representative image, the number of roots may be divided into two in different layers from the representative image. It is difficult to properly transmit information about the shape of the teeth using only representative images. Therefore, in order to more accurately provide information about different tooth shapes according to layers, an image showing the number of roots different from the number of roots of the representative image may be selected as the clinical reference image.

In FIG. 9, in the representative image 70 obtained from layer X, the number of tooth roots 71 is 1, and in the image 80 of layer Y, when the number of tooth roots 81 and 82 of each tooth is 2, layer Y It shows an example of the image 80 is selected as a clinical reference image. The number of roots may be determined by various algorithms that analyze the shape of the tooth outline.

Depending on the shape of the patient's teeth, there may be a plurality of images showing the number of roots different from the number of roots in the representative image. In this case, only a part of the plurality of images showing the number of roots different from the number of roots of the representative image may be selected as the clinical reference image. For example, only one image having the highest clarity among a plurality of images showing a different number of roots from the number of roots of the representative image may be selected as the clinical reference image. According to this embodiment, clinically necessary information has an effect that can be provided through a minimum number of clinical reference images.

In one embodiment, one clinical reference image may be selected for each number of roots. For example, the root of the representative image is 1 for each tooth. If there is an image with 2 roots for each tooth and 3 roots for each tooth in a different layer from the representative image, 1 root with 2 roots A clinical reference image and one clinical reference image with three roots may be selected. As a result, the FMX may include the most representative representative image in the region of interest and another image of the anterior/posterior image on the maxillary surface showing a different number of roots from the representative image.

So far, examples have been described in which the comparison criterion is based on the number of roots that can be determined according to the shape of the tooth outline. According to this embodiment, it provides an effect to accurately determine whether the target tooth of each view constituting the FMX has a normal apical root shape. In addition, the location of the periapical lesion of a patient suspected of apical myocarditis is provided with an effect that can be prevented from being incorrectly judged by only representative images. In addition, it provides an effect that can prevent the periodontitis location is incorrectly judged by only a representative image for patients suspected of periodontitis. In short, the FMX that is automatically generated according to the present embodiment is provided with a clinical reference image showing a different root shape from the representative image even if the sharpness is slightly lowered in addition to the sharpest representative image. do.

In another embodiment, the comparison criterion may be based on at least one of the shape and position of the root canal. The shape of the root canal in a state where nerve treatment has been completed is due to an artifact (gutta-percha) filled in the root canal location after inflammation of the root canal is removed according to endodontic treatment. The boundary can be clearly identified. For example, a contour of the root canal may be obtained based on a difference in brightness values of pixels, and an image in which at least one of the shape and position of the outline differs from the representative image and a reference value or more is different from the representative image. When present in a layer, the image may be selected as the clinical reference image. According to this embodiment, there is an effect capable of providing significant clinical information for diagnosis and treatment after nerve treatment through FMX.

In another embodiment, a representative image and an image in which the length of the root is different than a reference value may be selected as the clinical reference image. The length of the root can be obtained by comparing the border between the tooth outline and the gum bone. The gingival border may be obtained by analyzing information such as the brightness value and bone density of each pixel belonging to the image of the region of interest. For example, the gingival bone boundary line may be obtained by connecting the gum-side center point of the closed curved surface formed between each tooth and between the gums.

In another embodiment, a representative image and an image in which the area of the internal lesion of a tooth is different than a reference value may be selected as the clinical reference image. The outline of the lesion inside the tooth may be formed based on the brightness value of each pixel inside the tooth outline. For example, when the number of adjacent pixels whose brightness value is lower than the reference value is greater than or equal to the reference value, the pixels may be determined to form an internal lesion of the tooth.

In one embodiment, an FMX of the type most suitable for a multi-layer tooth panoramic image may be generated. This embodiment will be described with reference to FIG. 10.

In step S100 to step S112, a specific type of FMX is automatically generated. Steps S100 to S112 have been described with reference to FIGS. 3 to 9. In this embodiment, steps S100 to S112 are repeatedly performed while changing the type of FMX (S114J, S116).

The FMX type consists of a total of 18 photos, including 14 periapical view images and 4 bitewing view images. 16 FMX-18, apical view images and 4 bite wing view images. FMX-20 consisting of a total of 20 pictures, including FMX-20, 14 root apex view images and 2 bite wing view images, and a FMX-16 composed of 14 apical view images Types such as 14 are widely known. However, in the present invention, it has been already explained that, in addition to the well-known FMX of the above type, a modified type FMX in which at least a part of the number of apical end view images, the number of bytewing view images, and each view arrangement order is modified may also be considered. .

In step S118, the quality is scored for each type of FMX generated. FMX quality scoring may be performed based on at least one of a total score of sharpness of each view image and a concentration of layer distribution of a representative image for each view. At this time, the higher the concentration, the higher the scoring result may be. If the FMX of a certain type has a different layer of the representative image for each view, the FMX of the type is negative in terms of reliability, and the representative image of each view obtained from different layers may cause confusion about the dental condition information. Because there is.

In step S120, the FMX of the type selected based on the score according to the scoring is output. The output may mean that the video of the FMX is displayed, or the data of the FMX is exported in the form of a file, but the data of the FMX is transmitted to an external device such as an insurance company server.

The methods according to the embodiments of the present invention described so far can be performed by executing a computer program embodied in computer readable code. The computer program may be transmitted from a first electronic device to a second electronic device through a network such as the Internet and installed in the second electronic device, and thus used in the second electronic device. The first electronic device and the second electronic device include both server devices, physical servers belonging to a server pool for cloud services, and fixed electronic devices such as desktop PCs.

Hereinafter, the configuration and operation of the FMX automatic generating apparatus 100 according to another embodiment of the present invention will be described with reference to FIG. 11. As shown in FIG. 11, the FMX auto-generation device 100 according to the present embodiment includes a memory 103, a processor 102 that executes instructions loaded into the memory, a storage 104, and a network interface 105. Includes.

The network interface 105 receives data of a multi-layer tooth panoramic image from an external device such as a panoramic image capturing device. The received data is loaded 132 into the memory 103 so that FMX automatic generation using the received multi-layer tooth panorama image is performed.

In one embodiment, the FMX auto-generation device 100 may have a built-in imaging device for generating data of the multi-layer tooth panorama image. Of course, it may be understood that the photographing device incorporates the FMX automatic generating device 100.

The storage 104 stores the binary 143, which is an executable file of the FMX auto-generation software. The binary 143 is stored in the storage 104 at the time of manufacture of the FMX auto-generating device 100, or after the manufacture of the FMX auto-generating device 100, after storage by the user according to application installation, the storage 104 ).

The storage 104 may store a file 142 from which the FMX exported as a result of executing the FMX auto-generation software is exported.

The memory 103 may store FMX auto-generating instructions 133 that are loaded as the FMX auto-generating software is executed.

The FMX auto-generating instructions 133 include an instruction for automatically selecting a representative image of the first region of interest from among multiple layers of images of the first region of interest of the multi-layer tooth panoramic image according to a predetermined quality criterion. , An instruction for further selecting a clinical reference image in which a difference value according to a predetermined criterion from the representative image exceeds a reference value among images of a plurality of layers of the first region of interest, and the agent corresponding to the first region of interest. The first view may include at least one of an instruction for automatically generating an FMX in which the representative image of the first region of interest is set, and an instruction for outputting the automatically generated FMX.

In the memory 103, the FMX data 132 generated according to the execution result of the FMX automatic generation instruction 133 is temporarily stored, and the FMX data 132 is recognized by the user through an output device such as a display (not shown). It can be displayed as information that can be.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may be implemented in other specific forms without changing the technical spirit or essential features of the present invention. You will understand. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (15)

In the method performed by the computing device,
Obtaining a multi-layered tooth panoramic image including a plurality of image data for each layer on the arch surface;
Automatically selecting a representative image of the first region of interest among images of a plurality of layers of a first region of interest of the multi-layer tooth panoramic image according to a predetermined quality criterion; And
Automatically generating a Full Mouth Series (FMX) in which a representative image of the first region of interest is set as an image of a first view corresponding to the first region of interest,
FMX auto-generation method. According to claim 1,
The step of automatically selecting the representative video,
And selecting the representative image based on the sharpness of each of the images of the plurality of layers of the first region of interest.
FMX auto-generation method. According to claim 1,
The step of automatically generating the FMX,
Automatically generating the FMX containing the layer identification information of the representative image,
FMX auto-generation method. According to claim 1,
In the step of automatically selecting a representative image of the first region of interest,
And selecting a representative image of the second region of interest from among the images of a plurality of layers of the second region of interest of the multi-layer tooth panoramic image according to the predetermined quality standard.
The step of automatically generating the FMX,
And generating the FMX in which the representative image of the second region of interest is set as an image of the second view corresponding to the second region of interest,
The representative image of the first region of interest and the representative image of the second region of interest are obtained from different layers,
FMX auto-generation method. According to claim 1,
The step of selecting the representative video,
Among the images of the plurality of layers of the first region of interest, further comprising selecting a clinical reference image in which a difference value according to a predetermined criterion from the representative image exceeds a reference value,
The step of automatically generating the FMX,
Generating an FMX in which the representative image and the clinical reference image are set as the image of the first view,
FMX auto-generation method. The method of claim 5,
The default image of the first view is the representative image, and the clinical reference image is displayed auxiliaryly in response to a predetermined user input.
FMX auto-generation method. The method of claim 5,
The step of further selecting the clinical reference image,
And selecting an image having a different number of roots from the representative image from among the images of the plurality of layers of the first region of interest as the clinical reference image.
FMX auto-generation method. The method of claim 7,
The step of selecting an image having a different number of roots from the representative image as the clinical reference image,
And selecting, as a clinical reference image, a part of a plurality of images having different numbers of roots from the representative image, based on the sharpness.
FMX auto-generation method. The method of claim 5,
The step of further selecting the clinical reference image,
Among the images of the plurality of layers of the first region of interest, comprising the step of selecting the representative image and the image having a different root length than the reference value as the clinical reference image,
FMX auto-generation method. According to claim 1,
The step of obtaining the multi-layer tooth panoramic image,
Obtaining a tooth outline by applying tooth segmentation to the multi-layered tooth panoramic image; And
Comprising the step of partitioning the first region of interest defined by the type of the FMX based on the tooth outline,
FMX auto-generation method. The method of claim 10,
The first region of interest is an region including a plurality of teeth corresponding to the first view,
The step of partitioning the first region of interest defined by the type of the FMX,
Comprising the steps of forming a contour of the first region of interest by merging a rectangle formed by the tooth contour of each of the plurality of teeth corresponding to the first view,
FMX auto-generation method. According to claim 1,
Repeating the step of automatically generating the representative image and the step of automatically generating the FMX while changing the type of the FMX;
Scoring each FMX generated for each FMX type;
Determining a type of the FMX to be output based on the score for each FMX according to the scoring; And
And outputting the FMX of the determined type.
FMX auto-generation method. The method of claim 12,
Scoring each FMX generated for each FMX type,
Scoring each FMX by using the concentrations of the layer distributions of the representative images for each view included in the FMX,
FMX auto-generation method. A network interface for receiving data of a multi-layered tooth panoramic image including a plurality of image data for each layer on the arch surface;
Storage for storing software for automatic generation of FMX templates;
A memory in which a plurality of instructions are loaded according to the execution of the software;
It includes a processor for executing the plurality of instructions,
The plurality of instructions,
An instruction for automatically selecting a representative image of the first region of interest among images of a plurality of layers of the first region of interest of the multi-layer tooth panoramic image according to a predetermined quality criterion; And
And an instruction to automatically generate a Full Mouth Series (FMX) in which a representative image of the first region of interest is set as an image of a first view corresponding to the first region of interest,
FMX auto-generation device. In combination with computing devices,
Obtaining a multi-layered tooth panoramic image including a plurality of image data for each layer on the arch surface;
Automatically selecting a representative image of the first region of interest among images of a plurality of layers of a first region of interest of the multi-layer tooth panoramic image according to a predetermined quality criterion; And
The step of automatically generating a Full Mouth Series (FMX) in which a representative image of the first region of interest is set as an image of the first view corresponding to the first region of interest is executed.
FMX auto-generated computer program recorded on a computer-readable recording medium.

Images