KR102369100B1 - Method for displaying multi panoramic image and imaging processing apparatus thereof - Google Patents

Abstract

Disclosed are a method for displaying a multi-panoramic image and an image display apparatus therefor. The multi-panoramic image display method according to an embodiment reconstructs a slice image for a region of interest from a plurality of panoramic tomography images, and provides only a slice image in which a lesion is detected from among the reconstructed plurality of slice images to the user, so that the size of the lesion is and path, it is possible to accurately diagnose a lesion through a panoramic image.

Description

Method for displaying multi panoramic image and imaging processing apparatus thereof

The present invention relates to image processing technology, and more particularly, to a technology for displaying a plurality of panoramic tomographic images.

Many variables are involved in the success of dental procedures. For example, in the case of implant surgery in the pubic area, the location of the neural tube, the structure of the maxilla and the mandible, bone density, selection of an appropriate location and fixture, harmony with the prosthesis, etc. may be considered as major variables related to the success of the procedure. Since the above-mentioned variables are closely related to the success of a procedure in the dental field, they should be considered in the process of establishing a procedure plan.

In dentistry, based on information obtained from a CT image or oral data obtained through computed tomography (CT, hereinafter referred to as 'CT'), the above-mentioned variables are considered and then performed. The panoramic image is a 2D image obtained from a CT image or oral data for diagnosis and treatment planning of a patient's teeth. Panoramic image is an image that is essential when a patient visits a hospital because various information such as all teeth and alveolar bone can be obtained with a small amount of X-ray exposure in a short time. is becoming the standard.

A general panoramic image is provided as a single image, so there may be undetectable areas. For example, in panoramic images, lesions were not displayed (detected) due to problems such as overlap, distortion, and image enlargement, or it was difficult to accurately diagnose (shape and location of lesions).

According to an embodiment, a method for displaying a multi-panoramic image capable of accurately diagnosing a lesion through a panoramic image and an image display device for the same are proposed.

A multi-panoramic image display method according to an embodiment includes acquiring a plurality of panoramic tomography images, reconstructing a slice image for a region of interest from each panoramic tomography image, and identifying a suspected lesion region in each reconstructed slice image. and providing the size and path of the lesion by extracting and providing only at least one slice image in which the suspected lesion region is detected.

In the acquiring of the plurality of panoramic tomography images, a single representative panoramic tomography image and at least one panoramic tomography image having different depth information from the representative panoramic tomography image may be acquired.

In the step of acquiring a plurality of panoramic tomography images, a plurality of panoramic tomographic images having a preset interval are acquired, and after automatically checking the product specifications, the setting value for the interval is automatically changed according to the characteristics of the product to obtain a plurality of panoramic tomography images. image can be obtained.

The steps of providing the size and path of the lesion include the steps of segmenting a plurality of slice images for each clinical structure, detecting a suspected lesion region in each of the divided clinical structures, and The method may include extracting and providing only at least one slice image in which the suspicious lesion region exists. In the step of detecting the suspected lesion region, the suspected lesion region may be detected using a gray scale or bone density in each divided clinical structure.

In the step of providing the size and path of the lesion, if there is initial diagnostic information input in the electronic chart of the dental work program on the tooth in which the suspected lesion area is detected, the suspected lesion area and the items entered in the electronic chart are matched to suspect a lesion. It can be provided by displaying the items entered in the electronic chart in the area.

In the step of providing the size and path of the lesion, when there is no initial diagnosis information input in the electronic chart of the dental work program in the tooth in which the suspected lesion area is detected, the lesion including information on possible lesions in each clinical structure stored in advance. It may include providing a list, receiving a selection input from a user from among the provided lesion list, and displaying the selected lesion information on the lesion suspicious area and providing the selected lesion information.

In the step of providing the lesion list, when a suspected lesion region is detected in the crown region of the tooth, a prosthesis list is provided when the gray scale is higher than a preset threshold value, and a list of caries and fractures when the gray scale is lower than the preset threshold value and, when a suspected lesion region is detected in the root region of the tooth, a list of possible lesions in the root can be provided.

In the step of providing the size and path of the lesion, a slice extracted by extracting at least one slice image in which a suspected lesion region related to a disease selected from among a plurality of slice images is selected through disease selection in the electronic chart of the panoramic tomography image screen. You can move to video.

In the step of providing the size and path of the lesion, when moving from the panoramic tomography image screen to the slice image for a predetermined region of interest in the panoramic tomography image, related images including treatment images for each treatment date of the patient can be provided together. .

In the step of providing the size and path of the lesion, the slice images in which the suspected lesion region was detected are provided according to the slice order, or the suspicious lesion region is detected in the order that considers at least one of the resolution of the lesion suspicious region and the possibility of the lesion. The sliced images may be sequentially arranged and provided.

The step of providing the size and path of the lesion includes the steps of selectively extracting and providing only the slice images in which the tooth area exists according to the tooth number from among a plurality of slice images when entering the tooth mode, and the tooth area when entering the disease mode The method may include extracting and providing a suspected lesion region from among the existing slice images. In the step of selectively extracting and providing only slice images in which a tooth region exists, a tooth number may be designated, and only slice images having different depth information may be extracted according to the size of a tooth having the selected tooth area.

The image display device according to another embodiment reconstructs a slice image of a region of interest from a plurality of panoramic tomography images, and then detects a suspected lesion region in each reconstructed slice image, and at least one slice image in which a suspected lesion region is detected. It includes a controller for providing the size and path of the lesion by extracting and providing only the lesion, and an output unit for displaying an image screen including the extracted at least one slice image on the screen.

The control unit divides a plurality of slice images for each clinical structure, detects a suspected lesion region in each divided clinical structure, and only uses at least one slice image in which the detected lesion suspect region exists among the plurality of slice images. It can be extracted and provided.

Through the method for displaying a multi-panoramic image according to an embodiment and the image display device therefor, it is possible to check all dental structures without loss of the entire state, including the apex of the tooth, the entire jaw, and the like. Since multiple slice images can be unfolded in real time, it provides differentiated image resolution compared to the existing single panoramic image, so precise diagnosis and consultation are possible with only panoramic tomography images and multiple slice images of the region of interest. In particular, it is possible to more accurately diagnose periodontitis, periodontitis, and peri-crownitis, and it is possible to confirm multi-root, multi-canal, etc. that could not be confirmed in a single panoramic image.

In addition, by detecting a tooth-related lesion suspected region from a plurality of slice images, only slice images in which the suspected lesion region is detected are provided to the user, so that the size and path of the lesion can be identified.

By distinguishing teeth and diseases from a plurality of slice images, only a slice image having a tooth region may be provided in the tooth mode, and only a slice image having a suspected lesion region may be provided in the disease mode.

Furthermore, when moving from a panoramic tomography image to a slice image, it is possible to move immediately even if a disease is clicked on the electronic chart, which increases the convenience of use.

1 is a view showing the configuration of an image display device according to an embodiment of the present invention;
2 is a view showing a single view screen in a 3D panoramic screen according to an embodiment of the present invention;
3 is a view showing a view all screen in a 3D panoramic screen according to an embodiment of the present invention;
4 is a view showing an image screen displaying the position of the current multi-image viewed through the viewing area on the arch line area based on the tooth arch line according to an embodiment of the present invention;
5 is a view showing a list of lesions that can be automatically detected in a plurality of slice images according to an embodiment of the present invention;
6 is a diagram illustrating a medical history list that can be automatically detected from a plurality of slice images according to an embodiment of the present invention;
7 is a view showing an image screen for explaining a method of moving from a panoramic tomography image to a slice image according to an embodiment of the present invention;
8 is a view showing a screen as a result of moving from a panoramic tomography image to a slice image according to an embodiment of the present invention;
9 is a view showing an image display screen that provides related images together when moving from a panoramic tomography image to a slice image according to an embodiment of the present invention;
10 is a view showing a flow of a method for displaying a multi-panoramic image according to an embodiment of the present invention;
11 is a diagram illustrating a flow of a process for providing a lesion size and path according to an embodiment of the present invention.

Advantages and features of the present invention, and a method for achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

In describing the embodiments of the present invention, if it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted, and the terms to be described later are used in the embodiment of the present invention. As terms defined in consideration of the function of Therefore, the definition should be made based on the content throughout this specification.

Each block in the accompanying block diagram and combinations of steps in the flowchart may be executed by computer program instructions (execution engine), which are executed by the processor of a general-purpose computer, special-purpose computer, or other programmable data processing device. It may be mounted so that its instructions, which are executed by the processor of a computer or other programmable data processing device, create means for performing the functions described in each block of the block diagram or in each step of the flowchart.

These computer program instructions may also be stored in a computer usable or computer readable memory which may direct a computer or other programmable data processing device to implement a function in a particular manner, and thus the computer usable or computer readable memory. It is also possible to produce an article of manufacture containing instruction means for performing the functions described in each block of the block diagram or each step of the flowchart, the instructions stored in the block diagram.

And since the computer program instructions may be mounted on a computer or other programmable data processing device, a series of operational steps is performed on the computer or other programmable data processing device to create a computer-executable process to create a computer or other programmable data processing device. It is also possible that instructions for performing the data processing apparatus provide steps for executing functions described in each block in the block diagram and in each step in the flowchart.

In addition, each block or step may represent a module, segment, or portion of code comprising one or more executable instructions for executing specified logical functions, and in some alternative embodiments the blocks or steps referred to in some alternative embodiments. It should be noted that it is also possible for functions to occur out of sequence. For example, it is possible that two blocks or steps shown one after another may be performed substantially simultaneously, and also the blocks or steps may be performed in the reverse order of the corresponding functions, if necessary.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention illustrated below may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to more completely explain the present invention to those of ordinary skill in the art to which the present invention pertains.

1 is a diagram showing the configuration of an image display device according to an embodiment of the present invention.

Referring to FIG. 1 , an image display device 1 is an electronic device that displays a medical image including a dental image on a screen through a program. Electronic devices include computers, notebook computers, laptop computers, tablet PCs, smart phones, mobile phones, personal media players (PMPs), personal digital assistants (PDAs), and the like.

Programs executed through the image display device 1 include a guide design program, a scan program, a CAD program, and the like. In addition to dental implant surgery, it can be applied to other general medical image processing programs. The image processing process using the program according to an embodiment includes registering a surgical patient, acquiring CT data and oral model data of a registered patient, matching CT data and oral model data, creating an arch line from the matched CT data or oral model data, and Process including creation of a panoramic image using an archline, determination of the position and size of the crown model using the patient's oral model data, positioning of implant structures including fixtures using the patient's CT data, guide shape design, and final guide output is composed of

A general panoramic image is provided as a single image, so there may be a portion that cannot be discovered using only one panoramic image. However, as the image display device 1 according to an embodiment unfolds and shows a multi-panoramic image (Multi-Pano) in real time, it is possible to check the entire dental structure without loss. The multi-panoramic image refers to multiple panoramic tomographic images obtained according to multiple target focal planes when a panoramic image is taken. Through multiple panoramic tomography images, all dental structures can be checked without loss of the overall condition, including the apex of the tooth and the entire jaw. In this case, accurate diagnosis and treatment are possible.

The image display device 1 may reconstruct a slice image for a region of interest (eg, a tooth region) in each panoramic tomography image and provide it. The slice image refers to an image corresponding to a region of interest selected from each panoramic tomography image. The image display device 1 may provide the user with sliced images in which the tooth area exists according to the tooth number when entering the tooth mode by the user's selection.

Furthermore, the image display device 1 may provide the size and path of the lesion by detecting a suspicious lesion region in each reconstructed slice image and extracting and providing only at least one slice image in which the suspicious lesion region is detected. When entering the disease mode by user selection, the image display device 1 extracts only slice images in which the suspicious lesion region exists and provides them to the user, or slices in which the suspected lesion region exists among the slice images in which the tooth region exists. Only images can be extracted and provided to the user.

Hereinafter, the detailed configuration of the image display device 1 having the above-described characteristics will be described later.

Referring to FIG. 1 , an image display device 1 includes a data acquisition unit 10 , a storage unit 12 , a control unit 14 , an input unit 16 , and an output unit 18 .

The data acquisition unit 10 brings a plurality of panoramic tomographic images. Multiple panoramic tomography images. The single representative panoramic tomography image and at least one panoramic tomography image having different depth information from the representative panoramic tomography image are included. The representative panoramic image is an image generated based on an axial CT image or an arch line generated from 3D oral model data. When the position of the arch line is changed, the generated panoramic image is also changed, and at this time, the panoramic tomography images can be checked one by one. In the axial CT image, the arch line shape is maintained, and when the arch line position is changed, the cross-sectional position expressing the panoramic image is changed.

When a single representative panoramic tomography image and at least one panoramic tomography image having different depth information from the representative panoramic tomography image are acquired, a plurality of panoramic tomography images having preset intervals may be acquired. At this time, since the interval is different for each product, it is possible to automatically change the set value for the interval according to the characteristics of the product after automatically checking the specifications of the product.

Generating multiple panoramic tomography images through an arch line For example, an arch line is set for an axial CT image. The arch line setting is to set the focal layer to an arch curve. For a CT image, the arch line can be changed so that all upper and lower teeth (buccal and lingual) can come out from the apex to the crown. Accordingly, multiple panoramic tomographic images can be obtained based on the buccal side, the lingual side, and the middle side of the buccal and lingual side. A panoramic image expressed in one sheet can be adjusted to a desired image by the user by adjusting the thickness region to generate a panoramic tomography image based on the arch line in the CT cross-sectional image. A panoramic image with a thickness of 0.0mm contains information only for the area through which the arch line passes, while a panoramic image with a thickness of 10.0mm includes an area up to 5mm from the inside and outside of the arch line. The area expressed in The higher the thickness, the more information included in the panoramic image, but the image overlaps that much, making it difficult to clearly see the desired area.

The storage unit 12 stores information necessary for performing the operation of the image display device 1 and information generated according to the operation, and provides the information upon request of the control unit 14 . The storage unit 12 according to an embodiment stores a list of lesions and a list of medical records. The lesion list is a list of possible lesions in each tooth area. Looking at the list of lesions, the crown is related to caries, cracks, prostheses, etc., and the root is related to the apical abscess, resorption, and root capsule. Therefore, lesions that may occur for each implant structure can be stored in a database in advance.

The control unit 14 reconstructs a slice image for the region of interest from each panoramic tomography image acquired from the data acquisition unit 10, detects a suspected lesion region in each reconstructed slice image, and selects at least one Only slice images are extracted and provided to provide the size and path of the lesion.

The controller 14 may configure a 3D panoramic screen using a panoramic tomography image and slice images constituting the panoramic tomography image. The 3D panoramic screen may include a navigation area and a viewing area, and may manage information viewed through each area and control the screen configuration of the information. The navigation area is a screen area that displays a panoramic tomography image, and the viewing area is a screen area that enlarges and displays a slice image of a region of interest in the panoramic tomography image. The region of interest may be a tooth, a root tip, a nerve ending, or the like. The 3D panoramic screen will be described in detail later with reference to FIGS. 2 to 9 .

The controller 14 according to an exemplary embodiment detects a tooth-related lesion suspect region from a plurality of slice images and provides only at least one slice image in which the lesion suspect region is detected. To this end, the controller 14 divides a plurality of slice images for each clinical structure. Clinical structures include teeth, gingival bones, maxillary bones, mandibular bones, maxillary sinuses, and neural tubes. A tooth can be divided into a crown and a root. HU values can be used to segment by clinical construct. Teeth can be divided according to tooth numbers.

Subsequently, the controller 14 may detect a suspected lesion region in each of the divided clinical structures, and may extract and provide only at least one slice image in which the detected suspicious lesion region exists among a plurality of slice images. The controller 14 may detect a suspected lesion region using a gray scale or bone density in each divided clinical structure.

The controller 14 according to an embodiment may match the suspected lesion region with the items entered in the electronic chart to match the suspected lesion region when there is initial diagnostic information input in the electronic chart of the dental work program in the tooth in which the lesion suspect region is detected. It can be provided by displaying the information entered in the electronic chart. As another example, when there is no initial diagnosis information input in the electronic chart of the dental work program in the tooth in which the lesion suspect region is detected, a list of lesions including information on possible lesions in each pre-stored clinical structure may be provided. In this case, it is possible to receive a selection input from the user from the provided lesion list, and display the selected lesion information in the lesion suspicious region to provide it.

The control unit 14 according to an embodiment provides a prosthesis list when a gray scale is higher than a preset threshold value when a lesion suspicious region is detected in the crown region of the tooth, and when the gray scale is lower than a preset threshold value, caries and A list of fractures can be provided. As another example, when a suspected lesion region is detected in the root region of the tooth, a list of possible lesions in the root region may be provided.

When entering the disease mode, the controller 14 according to an embodiment may extract and provide only slice images in which a suspicious lesion region exists among a plurality of reconstructed slice images. In this case, after selectively extracting only the slice images in which the tooth region exists according to the tooth number from among the plurality of slice images, the suspected lesion region may be displayed and provided from among the slice images in which the tooth region is present. As another example, when entering the tooth mode, the controller 14 may extract and provide only a slice image in which a tooth region exists among a plurality of reconstructed slice images. In order to selectively extract only slice images in which a tooth region exists, an identification number may be designated, and only slice images having different depth information may be extracted according to the size of a tooth having the selected identification number.

According to an embodiment, the controller 14 provides slice images in which the suspected lesion region is detected according to the slice order, or detects the suspected lesion region in the order in which at least one of the resolution of the lesion suspicious region and the possibility of the lesion is considered. Slice images may be sequentially arranged and provided. The resolution of the suspected lesion area refers to the degree to which the suspected lesion area is clearly and accurately visible, and the likelihood of a lesion refers to the high probability of the lesion in the suspected lesion area.

The output unit 18 outputs various types of information. The output unit 18 according to an embodiment displays an image screen including at least one slice image on the screen.

2 is a diagram illustrating a single view screen in a 3D panoramic screen according to an embodiment of the present invention.

Referring to FIGS. 1 and 2 , the main screen displayed when entering the 3D panorama screen through the program of the image display device 1 includes a navigation area 20 and a viewing area 22 .

The navigation area 20 according to an embodiment includes a single panoramic tomography image 200, a single view interface (Single Slice) 201, a view all interface (All Slice) 202, a region of interest 203, and a window setting. an interface 204 , an archline region 205 , and a slice count interface 206 .

The single slice interface 201 is a graphic interface for switching to a single view mode. For example, when the user selects a single view interface (Single Slice) 201 , one slice image of the selected ROI 203 may be displayed in the viewing region 22 . 2 shows a single view screen in a 3D panoramic screen.

The all slice interface 202 is a graphic interface for switching to the all slice mode. For example, when the user selects the view all interface (All Slice) 202 , all slice images (eg, 41) having the selected region of interest 203 may be displayed on the viewing region 22 . 3 illustrates a view all screen in the 3D panorama screen.

In FIG. 2 , a single view interface 201 and an all slice interface 202 are separated from each other, but a single interface may be provided. For example, one view interface (All Slice) 202 may be provided in the form of a toggle key. In the toggle key method, when the user presses the view all interface (All Slice) 202 in single view mode, it is switched to the view all mode, and in the all view mode, the user presses the view all interface (All Slice) 202 once more Press to switch back to the original single view mode.

The region of interest 203 is a region designated by a user in the form of a window object in the panoramic tomography image 200 . The window size adjustment interface 204 is an interface for setting the size of a window object that designates the region of interest 203. For example, it provides box objects such as horizontal size, vertical size, 2Х3, 3Х4, etc. and select a predetermined size among them.

The arch line area 205 displays position information of an image layer expressed by a predetermined slice image 220 through the arch line through the viewing area 22 . When the user changes the slice number of the slice image 220 through the slice movement interface 222 , the location information of the image layer corresponding to the slice image 220 of the changed slice number is displayed through the archline area 205 . .

The slice number interface 206 is a graphic interface that provides the total number of slices of a slice image when a mouse is clicked. For example, if 41 is selected, it means that the total number of slices is 41. The slice number interface 206 may be provided in the form of a drop-down list interface.

The viewing area 22 according to an embodiment includes a slice image 220 and a slice movement interface 222 .

The viewing area 22 enlarges and displays the slice image 220 of a predetermined slice number corresponding to the area of interest 203 designated as a window in the navigation area 20 on the screen. Among the slice images, a predetermined slice image 220 designated by a user is enlarged and displayed through the viewing area 22 . The magnification ratio of the slice image 220 may be determined in advance, and then, if necessary, the user may adjust the magnification ratio in real time while viewing the slice image 220 .

The slice movement interface 222 moves to the slice image 220 desired by the user from among a plurality of slice images corresponding to the region of interest 203 in the panoramic tomography image 200 of the navigation region 20, and moves it to the viewing region 22 ) is a graphic interface that receives user manipulation signals for display. For example, the slider interface is a graphic interface in which a user selects a slice image slice number that the user wants to view by moving in a slide form. As another example, a scroll interface in which the user directly scrolls the mouse on the enlarged slice image and moves to the slice image slice number desired by the user is also possible. In FIG. 2 , when the user selects the 10th slice image among 41 slice images, the selected 10th slice image 220 is enlarged and displayed on the viewing area 22 .

The slice movement interface 222 may display a slice image 220 of a predetermined slice number displayed in the viewing area 22 in a lingual area (1-14 Image) and a middle area (middle area) 15-29. Image) and which area of the buccal area (30-41 Image) is included can be visually distinguished and displayed. For example, the slice movement interface 222 sets the color of each of the lingual area, the middle area, and the buccal area, and sets the position of the 10th slice of the lingual area. According to the display (10/41), the user can know together with the slice number of the slice image 220 that it is a slice of the lingual area.

3 is a diagram illustrating a view all screen in a 3D panoramic screen according to an embodiment of the present invention.

1 to 3 , when the 3D panoramic screen is switched to the all view mode through the user selecting the All Slice 202, etc., slice images can be simultaneously displayed through the viewing area 22. This allows the user to search for multiple sliced images at once. For example, all viewing areas are Lingual area (1-14 Image) 310, Middle area (15-29 Image) 320 and Buccal area 30- 41 Image) 330 , and slice images are displayed for each classified region 310 , 320 , and 330 . In this case, slice movement interfaces 222-1, 222-2, 222-3 for moving to a slice image desired by the user for each classified area may be displayed on the screen.

The image display device 1 recognizes the tooth number of the slice image displayed in the viewing area using segmentation technology, and searches for a bone density value based on the average thickness value for each recognized tooth number. Search for areas where teeth exist. Then, the slice image corresponding to the searched tooth presence region is visually divided and displayed so that the image can be checked. For example, the slice number of the area in which the tooth exists is visually classified and displayed for each area 310 , 320 , 330 classified in the slice movement interfaces 222-1, 222-2, 222-3 of FIG. 3 . do. As another example, a corresponding slice image among the slice images may be divided into a box object 224 and the like to be displayed.

In the view all mode, all sliced images can be displayed on a single screen. In the archline area 205 , the current image position covers all the positions of all image layers (Lingual, Middle, and Buccal). is indicated to include.

4 is a diagram illustrating an image screen in which positions of multiple images currently viewed through a viewing area are displayed on an arch line area based on a tooth arch line according to an embodiment of the present invention.

Referring to FIGS. 2 and 4 , an arch line area 205 that displays position information of an image layer expressed by a predetermined slice image 220 through an arch line is provided through the viewing area 22 . For example, referring to FIG. 4 , among 41 slice images, the first slice image 1/41 is displayed to be identifiable as 410 on the slider interface, and the first slice image 1/41 An arch line 412 matching with the . is identifiable in the arch line area. As another example, the 20th slice image 20/41 is displayed so as to be identifiable as 420 on the slider interface, and the arch line 422 matching the 20th slice image 20/41 is identified in the arch line area. marked as possible. The 30th slice image 30/41 and the 41st slice image 41/41 are also displayed on the screen according to the same principle.

5 is a diagram illustrating a list of lesions that can be automatically detected in a plurality of slice images according to an embodiment of the present invention, and FIG. It is a diagram showing a list of possible treatment details.

1, 5, and 6, the image display device 1 automatically generates an electronic chart using tooth segmentation and disease automatic detection technology in a method of moving from a panoramic tomography image to a multiple slice image to display the screen. make up In this case, the electronic chart may be generated based on the lesion list of FIG. 5 and the treatment history list of FIG. 6 . The lesion list is a list of possible lesions in each tooth area. When there is no initial diagnosis information input in the electronic chart of the dental work program in the tooth in which the lesion suspect region is detected, the image display device 1 provides a lesion list including information on possible lesions in each clinical structure stored in advance. can do. In this case, it is possible to receive a selection input from the user from the provided lesion list, and display the selected lesion information on the detected lesion suspicious region in the slice image to provide it. Looking at the list of lesions, the crown is related to caries, cracks, prostheses, etc., and the root is related to the apical abscess, resorption, and root capsule. Therefore, lesions that may occur for each implant structure can be stored in a database in advance.

The medical history list is related to the type of treatment, treatment method, treatment material, etc. Crown, Bridge, Inlay, Root canal filling, Sealant, Implant, Post (Post), etc., and it is possible to provide a list of medical records in the electronic chart.

7 is a view showing an image screen for explaining a method of moving from a panoramic tomography image to a slice image according to an embodiment of the present invention, and FIG. 8 is a view from a panoramic tomography image to a slice image according to an embodiment of the present invention. It is a diagram showing the result screen of the movement.

1, 7 and 8 , a 3D panoramic screen according to an embodiment includes an electronic chart 700 . The electronic chart 700 includes a tooth number at which the lesion is expected, a present symptom (Present Illness), treatment plan information, an image, and the like. The electronic chart 700 may be automatically generated based on tooth segmentation and the lesion list and treatment history list described above with reference to FIGS. 5 and 6 .

When the lesion list and the medical history list are recorded through the dental work program 720 , the image display program according to an embodiment may acquire them and automatically display them on the electronic chart 700 . The dental work program 720 is various, such as an insurance claim program, an image diagnosis program, an orthodontic diagnosis program, a consultation program, and the like. Each program may be provided by the same service provider or may be provided by different service providers. The insurance claim program is a dental business management software that integrates various dental tasks such as patient visits and receptions, current symptoms, treatment, payment, insurance claims, and hospital management. An electronic chart function can be provided through the insurance claim program. An image diagnosis program is software that takes images and diagnoses the captured images. The orthodontic diagnosis program is software that supports orthodontic treatment and orthodontic surgery, and can perform various analyzes such as orthodontic diagnosis with captured images. The counseling program establishes a treatment plan through consultation with various patients. The dental work program 720 may be an integrated dental work management program. For example, in the integrated dental work management program, an icon of another program interlocked with one program is created, and the program can be executed through a user action of clicking the corresponding icon with a mouse. Accordingly, the insurance claim program, the image diagnosis program, the correction diagnosis program, and the consultation program can all be used within one program screen.

In the panoramic tomography image 200 , the user's region of interest 203 , for example, a tooth region may be selected (eg, clicked) to move to the corresponding slice images 300 . As another example, in the electronic chart 700 , the disease 702 may be selected (eg, a click operation) to move to the corresponding slice images 300 . That is, when a disease 702 is selected in the electronic chart 700 , slice images 300 in which a lesion suspect region related to the selected disease 702 is extracted from among a plurality of slice images may be extracted and provided.

9 is a diagram illustrating an image display screen for providing a related image together when moving from a panoramic tomography image to a slice image according to an embodiment of the present invention.

1 and 9 , when moving from a panoramic tomography image 200 to a slice image for a predetermined ROI 203 , a related image 900 may be provided together. For example, the related image 900 includes treatment images for each treatment date of the patient.

10 is a diagram illustrating a flow of a method for displaying a multi-panoramic image according to an embodiment of the present invention.

1 and 10 , the image display device 1 acquires a plurality of panoramic tomographic images (S1010). For example, a single representative panoramic tomography image and at least one panoramic tomography image having different depth information from the representative panoramic tomography image are acquired. In the step of acquiring a plurality of panoramic tomography images (S1010), a plurality of panoramic tomographic images having a preset interval are acquired, but after automatically checking the product specifications, the setting value for the interval is automatically changed according to the characteristics of the product to obtain a plurality of panoramas. A tomographic image can be obtained.

Next, the image display device 1 reconstructs a slice image for the region of interest in each panoramic tomography image (S1020).

Next, the image display device 2 detects a suspicious lesion region in each reconstructed slice image, extracts and provides only at least one slice image in which a suspicious lesion region is detected, and provides the size and path of the lesion (S1030). For example, it is possible to determine the size and path of a lesion by providing only slice images having a suspected lesion region among 40 slice images reconstructed at regular intervals to the user.

As another example, the image display device 1 selectively extracts and provides only slice images in which a tooth area exists according to a tooth number among a plurality of slice images in the tooth mode, and from among the slice images in which the tooth area exists in the lesion mode It can be provided by extracting the suspected lesion area. When only slice images in which a tooth region exists are selectively extracted, only slice images having different depth information may be extracted according to the size of the tooth having the selected tooth number after designating the tooth number.

The image display device 1 provides slice images in which the suspected lesion region is detected according to the slice order, or displays the slice images in which the suspected lesion region is detected in an order that considers at least one of the resolution of the suspected lesion region and the possibility of a lesion. They can be provided sequentially.

The detailed process of providing the size and path of the lesion ( S1030 ) will be described later with reference to FIG. 11 .

11 is a diagram illustrating a flow of a process for providing a lesion size and path according to an embodiment of the present invention.

1, 10, and 11 , the image display device 1 divides a plurality of slice images for each clinical structure ( S1110 ). Clinical structures include teeth, gingival bones, maxillary bones, mandibular bones, maxillary sinuses, and neural tubes. A tooth can be divided into a crown and a root. HU values can be used to segment by clinical construct. Teeth can be divided according to tooth numbers. The bone can be divided into upper and lower jaw. The maxillary sinus can be divided into left and right sections. The neural tube can also be divided into left and right sections.

Then, a suspicious lesion region is detected in each divided clinical structure (S1120). In the step of detecting the suspicious lesion region ( S1120 ), the image display device 1 may detect the suspicious lesion region using at least one of gray scale and bone density in each divided clinical structure. For example, the presence or absence of a suspected lesion region may be detected according to whether the gray scale or bone density of the measured clinical structure is high or low by comparing it with a preset threshold value.

Next, the image display device 1 determines whether or not there is initial diagnostic information in the tooth in which the suspicious lesion region is detected (S1130). As a result of determining the existence of the initial diagnosis information (S1130), when there is initial diagnosis information, for example, when there is initial diagnosis information input from the electronic chart of the dental work program in the tooth in which the suspected lesion region is detected, the lesion suspected region and the items entered in the electronic chart are matched based on the dental number, and the items entered in the electronic chart are displayed in the suspicious area of the lesion and provided (S1140).

As a result of determining the existence of the initial diagnosis information (S1130), if there is no initial diagnosis information, for example, if there is no initial diagnosis information input from the electronic chart of the dental work program in the tooth in which the lesion suspicious area is detected, the pre-stored It is possible to provide a lesion list including information on possible lesions in each clinical structure, receive a selection input from the user from the provided lesion list, and display the selected lesion information in the lesion suspect region to provide (S1150). The lesion information includes lesion shape and location. The selected lesion information is transmitted to the dental work program and can be used later.

In the step of providing the lesion list and selecting the user ( S1150 ), the image display device 1 may provide the prosthesis list when the gray scale is higher than a preset threshold value when a suspicious lesion region is detected in the crown region of the tooth. If the gray scale is lower than a preset threshold, a list of caries and fractures can be provided. As another example, the image display device 1 may provide a list of possible lesions at the root of a tooth when a suspected lesion region is detected in the root region of the tooth.

So far, the present invention has been looked at focusing on the embodiments thereof. Those of ordinary skill in the art to which the present invention pertains will understand that the present invention can be implemented in modified forms without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

Claims (15)

In the multi-panoramic image display method using the image display device, the image display device
acquiring a plurality of panoramic tomographic images;
reconstructing a slice image for a region of interest in each panoramic tomography image; and
The size and path of the lesion by detecting the suspicious lesion region using at least one of gray scale and bone density in each reconstructed slice image, and extracting and providing only at least one slice image in which the suspicious lesion region is detected from among the reconstructed slice images. providing;
Multi-panoramic image display method comprising a. The method of claim 1, wherein the acquiring a plurality of panoramic tomography images comprises:
A method for displaying a multi-panoramic image, comprising acquiring a single representative panoramic tomography image and at least one panoramic tomography image having different depth information from the representative panoramic tomography image. In the multi-panoramic image display method using the image display device, the image display device
acquiring a plurality of panoramic tomographic images;
reconstructing a slice image for a region of interest in each panoramic tomography image; and
providing a size and path of a lesion by detecting a suspected lesion region in each reconstructed slice image and extracting and providing only at least one slice image in which a suspected lesion region is detected; includes,
The step of acquiring a plurality of panoramic tomography images is
A multi-panoramic image characterized in that a plurality of panoramic tomographic images having a preset interval are acquired, and a plurality of panoramic tomographic images are acquired by automatically changing the set value for the interval according to product characteristics after automatically checking product specifications display method. In the multi-panoramic image display method using the image display device, the image display device
acquiring a plurality of panoramic tomographic images;
reconstructing a slice image for a region of interest in each panoramic tomography image; and
providing a size and path of a lesion by detecting a suspected lesion region in each reconstructed slice image and extracting and providing only at least one slice image in which a suspected lesion region is detected; includes,
Steps to provide the size and path of the lesion are
dividing a plurality of slice images by clinical structures;
detecting a suspected lesion region in each of the divided clinical structures; and
extracting and providing only at least one slice image in which a detected lesion suspected region exists among a plurality of slice images;
Multi-panoramic image display method comprising a. 5. The method of claim 4, wherein the step of detecting the lesion suspicious area comprises:
A method for displaying a multi-panoramic image, characterized in that a suspected lesion area is detected using a gray scale or bone density in each divided clinical structure. The method of claim 1 , wherein providing the size and path of the lesion comprises:
If there is initial diagnosis information entered in the electronic chart of the dental work program on the tooth in which the suspected lesion area was detected, the items entered in the electronic chart are displayed in the suspected lesion area by matching the items entered in the electronic chart with the suspected lesion area. Multi-panoramic image display method, characterized in that it provides. The method of claim 1 , wherein providing the size and path of the lesion comprises:
providing a lesion list including pre-stored information on possible lesions in each clinical structure when there is no initial diagnosis information input in the electronic chart of the dental work program in the tooth in which the lesion suspect region is detected; and
receiving a selection input from a user from among the provided lesion list, displaying the selected lesion information in a lesion suspicious area and providing the selected lesion information;
Multi-panoramic image display method comprising a. In the multi-panoramic image display method using the image display device, the image display device
acquiring a plurality of panoramic tomographic images;
reconstructing a slice image for a region of interest in each panoramic tomography image; and
providing a size and path of a lesion by detecting a suspected lesion region in each reconstructed slice image and extracting and providing only at least one slice image in which a suspected lesion region is detected; includes,
Steps to provide the size and path of the lesion are
providing a lesion list including pre-stored information on possible lesions in each clinical structure when there is no initial diagnosis information input from the electronic chart of the dental work program in the tooth in which the lesion suspect region is detected; and
receiving a selection input from a user from among the provided lesion list, displaying the selected lesion information in a lesion suspicious area and providing the selected lesion information; includes,
The step of providing a list of lesions is
When a suspected lesion area is detected in the crown area of the tooth, a list of prostheses is provided when the gray scale is higher than a preset threshold,
Provides a list of caries and fractures when the gray scale is lower than a preset threshold,
A multi-panoramic image display method, characterized in that when a suspicious lesion region is detected in the root region of a tooth, a list of possible lesions in the root region is provided. The method of claim 1 , wherein providing the size and path of the lesion comprises:
Multi-panoramic image, characterized in that by extracting at least one slice image in which a lesion suspected region related to a disease selected from among a plurality of slice images through disease selection in the electronic chart of the panoramic tomography image screen, and moving to the extracted slice image display method. The method of claim 1 , wherein providing the size and path of the lesion comprises:
A multi-panoramic image display method, characterized in that when moving from a panoramic tomography image screen to a slice image for a predetermined region of interest in a panoramic tomography image, related images including treatment images for each treatment date of the patient are provided together. The method of claim 1 , wherein providing the size and path of the lesion comprises:
The slice images in which the suspected lesion region is detected are provided according to the slice order, or the slice images in which the suspicious lesion region is detected are sequentially arranged and provided according to an order that considers at least one of the resolution of the suspected lesion region and the possibility of a lesion. How to display multi-panoramic images with In the multi-panoramic image display method using the image display device, the image display device
acquiring a plurality of panoramic tomographic images;
reconstructing a slice image for a region of interest in each panoramic tomography image; and
providing a size and path of a lesion by detecting a suspected lesion region in each reconstructed slice image and extracting and providing only at least one slice image in which a suspected lesion region is detected; includes,
Steps to provide the size and path of the lesion are
When entering the tooth mode, selectively extracting and providing only the slice images in which the tooth region exists according to the tooth number from among the plurality of slice images; and
When the disease mode is entered, extracting and providing a suspected lesion region from among the slice images in which the tooth region exists;
Multi-panoramic image display method comprising a. The method of claim 12, wherein the step of selectively extracting and providing only slice images in which a tooth region exists comprises:
A multi-panoramic image display method, characterized in that each of the tooth numbers is designated and only slice images having different depth information are extracted according to the size of the tooth having the selected tooth number. After reconstructing a slice image for a region of interest from multiple panoramic tomography images, a suspected lesion region is detected from each reconstructed slice image using at least one of gray scale and bone density, and a suspected lesion region is detected from among the reconstructed slice images. a control unit providing the size and path of the lesion by extracting and providing at least one sliced image; and
an output unit for displaying an image screen including the extracted at least one slice image on the screen;
Video display device comprising a. The size of the lesion and the size of the lesion as the slice image of the region of interest is reconstructed from a plurality of panoramic tomography images, and the suspected lesion region is detected in each reconstructed slice image, and only at least one slice image in which the suspicious region is detected is extracted and provided. a control unit providing a path; and
an output unit for displaying an image screen including the extracted at least one slice image on the screen; includes,
the control unit
Segmenting multiple slice images for each clinical structure,
Detects a suspected lesion area in each divided clinical structure,
An image display device, characterized in that it extracts and provides only at least one slice image in which a detected lesion suspected region exists among a plurality of slice images.

Images