WO2020167027A1

WO2020167027A1 - Method for displaying scan data comprising reliability

Info

Publication number: WO2020167027A1
Application number: PCT/KR2020/002111
Authority: WO
Inventors: 이동훈; 이수복; 최원훈
Original assignee: 주식회사 메디트
Priority date: 2019-02-15
Filing date: 2020-02-14
Publication date: 2020-08-20

Abstract

In a method for displaying scan data comprising reliability according to the present invention, a plaster model or the inside of the mouth of a patient is scanned by means of a scanner, and reliability is calculated in accordance with whether or not an overlap exists in a two-dimensional image obtained from the scanning step. The calculated reliability can be grouped so as to be classified into a plurality of groups by means of a predetermined classification standard, and a reliability model can be displayed on a user interface in real time in different colors in accordance with the groups. Accordingly, the reliability model can quickly and visually be discerned by the user, and thus a scanning process can be supplemented for a part of an object to be scanned which has been inadequately scanned. Consequently, highly reliable oral model data can be obtained, and thus a more precise prosthetic treatment service and prosthesis can be provided to the patient.

Description

How to display scan data including reliability

The present invention relates to a method for displaying scan data including reliability that can quickly determine reliability by analyzing acquired three-dimensional scan data in real time (METHOD FOR DISPLAYING SCAN DATA INCLUDING RELIABILITY).

In 3D scan data, the degree of overlapping of the data and the degree of noise of the data affect the reliability of the final result. In the past, after obtaining a result from several pieces of scan data, the suitability or reliability of the result is determined by comparing it with reference data.

In general, in order to evaluate the reliability of the scan data of an oral scanner used for teeth, the following series of processes are performed. First, a plaster model of the tooth is produced, and then, the first scan data is extracted by measuring the produced plaster model with a table type scanner, and the second scan data is measured by measuring the produced plaster model with an oral scanner. The step of extracting is carried out. Next, a step of overlapping and comparing the first scan data and the second scan data is performed. At this time, in general, the first scan data is used as reference data because of the excellent scanning accuracy of the table type scanner. The deviation of the result of the second scan data can be checked based on the first scan data, and the accuracy of the oral scanner can be checked through this, and in this case, it is determined that data with superior reliability can be obtained as the deviation is small. I can. At this time, as a result of checking the accuracy of the scan data, if it is determined that the result is not suitable, the process of performing a scan again to create a new result and comparing it with the reference data is repeated. The same process for obtaining the result to obtain suitable data There was a problem that it had to be repeated.

In addition, it is difficult to confirm the reliability of the results of the measured scan data, so that the dentist or technician using the oral scanner could not determine the reliability of the oral scanner through the above-described conventional method. For this reason, the accuracy of the scanner may decrease over time, but it is difficult to apply due to a large error when manufacturing a result such as a prosthesis using the scan data because the reliability of the measured scan data result cannot be confirmed. In some cases, there is a problem that a lot of time and cost are consumed as remanufacturing is performed to solve the problem.

An object of the present invention is to provide a method of displaying scan data including reliability, which can quickly check and determine reliability by analyzing acquired 3D scan data in real time.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

The scan data display method including the reliability according to the present invention includes a scanning step of obtaining scan data by scanning an object to be scanned with a scanner, and a reliability calculation of calculating the reliability of the scan data from the scan data obtained in the scanning step. The step, a group classification step in which grouping is performed according to the reliability calculated in the reliability calculation step, and a display step of displaying the scan data and the reliability model on a user interface in real time.

In addition, the scan data may be obtaining at least one or more 2D images.

In addition, in the reliability calculation step, reliability calculation may be performed according to overlapping data of the at least one or more 2D images obtained in the scanning step.

In addition, the group classifying step may be to classify data to be grouped into a plurality of groups from a calculation result performed in the reliability calculation step.

In addition, each of the plurality of groups may have different color information.

In addition, the reliability calculation step and the group classification step may be continuously performed while a scan is performed by a user.

In addition, according to the reliability calculated in the reliability calculation step, regrouping may be performed on the grouped data.

In addition, the scan data may be displayed on the user interface to display a scan status in real time, and the reliability model may be displayed on the user interface to reflect the reliability in real time.

In addition, the scan data and the reliability model may be displayed on the user interface, but may be displayed in different regions apart from each other.

In addition, the reliability model may be switched to a color model or a non-color model by operating a switch button.

Meanwhile, the scan data display device including the reliability according to the present invention includes a storage unit in which scan data generated by scanning an object to be scanned by a scanner is stored, and a reliability calculation and the reliability through the scan data stored in the storage unit. It may include a control unit for performing grouping according to, and a display unit for displaying information allocated by the reliability calculated by the control unit.

In addition, the scan data may be grouped according to the reliability calculated by the control unit and classified and stored in the storage unit.

In addition, the scan data divided and stored into a plurality of groups according to the grouping may be displayed together with information allocated to the group through the display unit.

In addition, the controller may additionally perform an operation of converting the scan data into 3D model data.

According to the method for measuring the reliability of scan data according to an embodiment of the present invention, it is possible to quickly determine the reliability by acquiring 3D scan data and analyzing it in real time. Through this, it is possible to determine suitability or reliability before a result using the scan data is produced, thereby preventing an incorrect result from being manufactured.

In addition, since the determination of the suitability or reliability of the final result manufactured based on the scan data is recognized in real time during the scanning process rather than after the result is manufactured, it is possible to provide faster and more intuitive feedback when the final result is produced. Through this, since the user can quickly determine the suitability or reliability of the final result, it is possible to take quick action, and as a result, there is an advantage of obtaining a highly reliable oral model.

1 schematically illustrates a method of determining suitability or reliability of a final result manufactured by applying scan data according to the prior art.

2 is a schematic diagram of a scan data processing method performed in the prior art to produce a final product using scan data.

3 is a schematic flowchart of a method for displaying scan data including reliability according to the present invention.

FIG. 4 is a conceptual diagram illustrating display of different colors based on a difference in reliability of overlapping regions according to a scanning step in a method of displaying scan data including reliability according to the present invention.

5 to 14 are diagrams illustrating a process in which the method according to the present invention is performed and displayed on a user interface in the method for displaying scan data including reliability according to the present invention.

15 is a schematic diagram of a configuration of an apparatus for displaying scan data including reliability according to the present invention.

[Explanation of code]

S10: Scan step

S20: Reliability calculation step

S30: Group classification step

S40: Display stage

1: plaster model (object to be scanned)

12: Reliability model button

12': color model button

12'': non-color model button

14: user interface

14a: reliability model domain interface

14b: Scan screen area interface

16: Scan position display area

M: Reliability model

M': color model

M'': non-color model

SC1: first reliability group

SC2: second confidence group

SC3: 3rd confidence group

Hereinafter, some embodiments of the present invention will be described in detail through exemplary drawings. In adding reference numerals to elements of each drawing, it should be noted that the same elements are assigned the same numerals as possible even if they are indicated on different drawings. In addition, in describing an embodiment of the present invention, if it is determined that a detailed description of a related known configuration or function obstructs an understanding of the embodiment of the present invention, a detailed description thereof will be omitted.

In describing the constituent elements of the embodiments of the present invention, terms such as first, second, A, B, (a), (b), and the like may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the component is not limited by the term. In addition, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this application. Does not.

1 and 2 schematically show a flow chart of the prior art for producing a final result from scan data. 1 shows a series of processes performed to determine suitability or reliability of a final result manufactured by applying scan data. According to this, when a scan operation is first performed, and a result is generated using the scan operation, the generated result is compared with reference data to evaluate and confirm reliability. In the final step, if the result is determined to be reliable, the result is used, and when it is determined that it is not reliable, the task of generating the result is performed again.

2 shows a series of processes internally performed in order to manufacture a final result by applying scan data in the prior art. According to FIG. 2, scan data is input, the scan data is then matched, the scan data is merged, and post-processing is performed, and a final result is produced. Referring to FIGS. 1 and 2, in the prior art, when the reliability of the manufactured result is not good, the same process as shown in FIG. 2 has to be repeated, so that a lot of time is wasted and efficiency is greatly reduced.

Referring to FIG. 3, the method of displaying scan data including reliability according to the present invention may include a scanning step S10 of acquiring scan data by performing a scan on an object to be scanned through a scanner. The object to be scanned in the scanning step (S10) may be the actual inside of the patient's oral cavity, including teeth and gingiva, or gypsum obtained by performing an impression on the inside of the patient's oral cavity with alginate. It could be a model. In addition, the type of scanner for performing the scan may be a fixed table scanner and a handheld portable oral scanner. However, whether the object to be scanned is inside the patient's actual oral cavity or a plaster model may be used. Regardless, it is desirable to perform the scan.

Meanwhile, in the scanning step (S10), the scanner receives the light introduced into the scanner through a camera formed inside the scanner, and the received light analyzes the light through an imaging sensor that is electrically connected to the camera, and scan data can be obtained. have. The scan data refers to a digital image, and the digital image may be at least one or more 2D image data, such as a photo of a certain standard made in a pixel unit. In the process of the present invention in which reliability calculation is performed by overlapping scan data, preferably, a plurality of two-dimensional image data may be obtained.

4, when the scan data is acquired through the scan step (S10) in the scan data display method including the reliability according to the present invention, the reliability calculation step (S20) of calculating the reliability of the scan data from the acquired scan data. Can be performed. In this case, the reliability of the scan data may be calculated according to whether the 2D image data acquired as the scan data overlap. Referring to FIG. 4 as an example, it is assumed that a scan is performed on a plaster model 1 which is an object to be scanned. When scanning is performed in a direction from the upper left to the center of the gypsum model 1, 6 pieces of data may be scanned by a scanner to obtain two-dimensional image data. The acquired scan data checks whether there is an overlapping portion between the scan data, and if an overlapping portion is found, the reliability of the corresponding portion is increased.

For example, since there is no acquired scan data before performing a scan, the reliability may be set to 0 for all areas. When the scanning step S10 is performed on the object to be scanned, a reliability level of 1 is added to an area in which the scan data is acquired once, and thus, data having a reliability level of 1 may be expressed. In addition, an area in which the same data is acquired twice due to overlapping scan data may be expressed as data having a reliability of 2 by adding 1 to the reliability. Reliability of the scan data acquired with respect to the scan target by such calculation may have values of 0, 1, 2, and 3. However, if necessary, it is possible to have more various reliability values depending on the number of overlaps.

When the reliability value reaches the maximum value, it is possible to prevent additional reliability values from being added even if overlap occurs in the subsequent scanning step (S10) and the reliability calculation step (S20). That is, when the maximum reliability value is set to 3, the scan data having the reliability value of 3 is not added even if an additional overlapping portion occurs, and the reliability value of 3 is maintained. In addition, since scan data incorrectly entered due to instantaneous noise corresponds to data different from the normally acquired scan data, they do not overlap and may be excluded from the addition of the reliability value.

Meanwhile, grouping may be performed according to the reliability calculated in the reliability calculation step S20 (group classification step S30). In the group classification step S30, the scan data having the reliability value calculated in the reliability calculation step S20 is classified so that the data is grouped into a plurality of groups. For example, a first reliability group SC1 for data having a reliability value of 1, a second reliability group SC2 for data having a reliability value of 2, and a third reliability group for data having a reliability value of 3 ( SC3) can be assigned. In this case, data having a high reliability value and data having a low reliability value may be distinguished, and this classification may occur not only internally, but also may be expressed so that the user of the scanner can also recognize it.

As described above, even if the reliability calculation for the scan data is performed by the reliability calculation step (S20), and once the scan data calculated with the reliability by the group classification step (S30) is grouped to be assigned to a specific group, the scanning step (S10) is performed. The reliability value may change during the continuous process. That is, as long as the scanner continues to scan the object to be scanned through the scan step S10, the reliability calculation step S20 and the group classification step S30 may be continuously performed. In this process, a group may be changed for a portion where the scan data overlaps according to the scan. For example, if new scan data is superimposed on data allocated to the first reliability group SC1 and the reliability value is increased to 2, the data is moved from the first reliability group SC1 to the second reliability group SC2. You can do regrouping (reassignment) to do so. In the same way, the scan data whose reliability value is increased from 2 to 3 is regrouped to move from the second reliability group SC2 to the third reliability group SC3.

In the above-described group classification step S30, a plurality of groups (eg, a first reliability group to a third reliability group) may be formed to each have different color information. For example, a first reliability group (a group having the lowest reliability value except for a part having a reliability value of 0) is assigned to display a first color (e.g., red), and a second reliability group (medium The second color (e.g., orange) is assigned to display for the group having the confidence value), and the third color (e.g., green) is used for the third confidence group (the group with the highest confidence value). Can be assigned to be displayed.

In the present specification, for convenience of description, it has been described as having three groups, but is not limited thereto. The scan data may be classified as a group having three or more numbers according to a preset specific criterion, and may be visually displayed through color information or pattern information assigned to each group.

Meanwhile, the scan data is displayed on the user interface 14 to display the scan status in real time when the scanning step S10 is performed, and the reliability model may be displayed on the user interface 14 to reflect the reliability in real time. have. That is, in accordance with the scanning step S10 of the scanner, the 2D image data generated by the camera and the imaging sensor formed inside the scanner are displayed in a part of the space of the user interface 14, and the corresponding 2D image data (the above Depending on the method, the reliability calculation for the scan data) is performed (S20) and grouping is performed (S30), so that a 3D reliability model and reliability data corresponding thereto are formed apart from the 2D image data. Is displayed. For example, in this way, the reliability model M and the scan data are spaced apart from the reliability model area interface 14a and the scan screen area interface 14b, respectively, and are simultaneously displayed in real time. There is an advantage of being able to quickly recognize the acquisition status of

Referring to FIGS. 5 to 14, it can be seen that the reliability model is visually generated and changed according to the time and location of the scan. 5 is a diagram showing a screen of the user interface 14 before the scanning step S10 is performed. Meanwhile, the reliability model button 12 is activated on the left side, which means that the reliability model M having color information is displayed on the reliability model area interface 14a.

Referring to FIG. 6, when the first scanning step is performed, since the degree of overlap of data is low, the reliability model M is displayed as a first color RD1 as a whole. Meanwhile, the scan position display area 14b displayed at the lower right corresponds to the scan position display area 16 on the reliability model area interface 14a, and displays the current scanning position.

7 to 12, when proceeding from FIG. 7 to FIG. 12, a portion where the scan data overlap is changed to a second color RD2. At this time, if a specific area is being scanned for a long time, a number of scan data are overlapped with respect to the area, so the first color (RD1) to the second color (RD2), or the second color (RD2) to the third color (RD3) Can be changed. The reliability calculation step (S20) and the group classification step (S30) are continuously performed as the scanning step (S10) is performed as described above, and reliable model data in real time through the color (or pattern) change of the reliability model. It can be confirmed that is being formed. As a result, referring to FIG. 12, scan data is sufficiently superimposed on both ends of the reliability model M, and an area represented by the third color RD3 appears. In addition, a region represented by the second color RD2 appears in a region between regions of the third color RD3 having a relatively lower reliability value than the region of the third color RD3. Meanwhile, portions corresponding to the edges of the reliability model M may be displayed on the surface of the reliability model M through the first color RD1 because the scan data is not overlapped with a sufficient amount.

Referring to FIG. 13, when the reliability model button 12 is operated by clicking or the like, it is converted to the color model button 12'. In this case, the reliability model M is color model data M having color information of the object to be scanned. ') can be changed. Therefore, when the gypsum model is scanned as a scan target, the color of the gypsum model is displayed, and when the patient's actual oral cavity is scanned as a scan target, the color of the gingiva and teeth is displayed on the reliability model area interface 14a. Can be displayed instead. In this case, the model displayed on the reliability model region interface 14a may be model data converted from scan data in 3D.

Referring to FIG. 14, when the color model button 12' is operated by clicking or the like, it is converted to a non-color model button 12'', and the color model data M'is only the structure information of the object to be scanned. The branches can be changed to non-color model data (M''). In this case, regardless of whether the gypsum model or the patient's actual oral cavity has become the object to be scanned, the model data converted in 3D can be displayed only in the brightness range of one color area.

By using the scan data display method including the reliability as described above, the degree of reliability according to the degree of overlapping of the scan data is visually intuitive, without using the reference data, unlike the reference data that was required to confirm the reliability in the past. Phosphorus can be checked, and since an additional process for obtaining reference data is not required, there is an advantage in that the process for obtaining the reliability model M is simplified.

Hereinafter, an apparatus for displaying scan data including reliability according to the present invention will be described. Contents overlapping with the above-described method of displaying scan data including reliability may be briefly described or omitted.

Referring to FIG. 15, the scan data display device including reliability according to the present invention allows scan data generated by scanning an object to be scanned by the scanner 200 to be received into the device 100 through the communication unit 130. It may include a storage unit 110 that is stored and a control unit 120 that performs a reliability calculation and grouping according to the reliability through the scan data stored in the storage unit 110. When a plaster model or a scan object corresponding to the patient's actual oral cavity is scanned through a scanner, the scanned data is formed in the form of 2D image data, and this 2D image data is stored in a storage unit for use in the reliability calculation process. It is stored at 110. The control unit 120 loads 2D image data (ie, scan data) stored in the storage unit 110 to determine whether or not to overlap each 2D image data, and the data does not overlap, but the obtained part is a reliability value of 1 Is assigned, and when a part where data overlap occurs, the reliability value is added to the data part. According to this process, a reliability value is calculated by the controller 120, and a data portion having a relatively large reliability value and a data portion having a relatively low reliability value may be distinguished.

In addition, the control unit 120 performs grouping by dividing the reliability value obtained from the 2D image data into a plurality of groups according to a predetermined criterion. For example, grouping may be performed by being divided into a first reliability group (SC1), a second reliability group (SC2), and a third reliability group (SC3), as in the above-described scan data display method. The data is stored in the storage unit 110. Meanwhile, different color information may be allocated to each reliability group (eg, SC1, SC2, and SC3) (or, in some cases, the allocated information may be different pattern information other than color). . Therefore, when the scan data corresponding to each reliability group (SC1, SC2, SC3) is displayed on the user interface 14 displayed on the display unit 140 in the form of a reliability model (M), real-time to have different colors. By being displayed as, the user of the scanner 200 has the advantage of being able to intuitively and visually check whether or not the scan data is effectively acquired, and can quickly improve the reliability of the overall model data.

Meanwhile, in order for the reliability model M to be expressed in a three-dimensional form on the reliability model region interface 14a, the acquired scan data may be converted into a form of three-dimensional volume data. At this time, in order to convert the acquired scan data into 3D volume data, the scanner 200 may perform a scan by irradiating structured light on the object to be scanned, and through this process, 3D volume data is generated and aligned. It will be apparent that (linking and sorting between data) can be performed.

The above description is merely illustrative of the technical idea of the present invention, and those of ordinary skill in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention.

Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

The present invention provides a method of displaying scan data including reliability, which can quickly check and determine the reliability of the scan data by analyzing acquired 3D scan data in real time.

Claims

A scanning step of obtaining scan data by scanning an object to be scanned with a scanner;

A reliability calculation step of calculating a reliability of the scan data from the scan data obtained in the scanning step;

A group classification step in which grouping is performed according to the reliability calculated in the reliability calculation step; And

A display step of displaying the scan data and the reliability model on a user interface in real time, including, scan data display method including reliability.
The method of claim 1,

The scan data display method including reliability of acquiring at least one 2D image.
The method of claim 2,

In the reliability calculation step, a reliability calculation is performed according to an overlap of data of the at least one or more two-dimensional images obtained in the scanning step.
The method of claim 1,

The group classifying step comprises classifying data to be grouped into a plurality of groups from a calculation result performed in the reliability calculation step.
The method of claim 4,

Each of the plurality of groups has different color information, and the method of displaying scan data including reliability.
The method of claim 5,

The reliability calculation step and the group classification step are continuously performed while a scan is performed by a user.
The method of claim 6,

A method of displaying scan data including a reliability, wherein regrouping is performed on the grouped data according to the reliability calculated in the reliability calculation step.
The method according to any one of claims 1 or 7,

The scan data is displayed on the user interface to display a scan state in real time, and the reliability model is displayed on the user interface to reflect the reliability in real time.
The method of claim 8,

The scan data and the reliability model are displayed on the user interface, and are displayed in different areas apart from each other.
The method of claim 9,

The reliability model is converted to a color model or a non-color model by a switch button operation.
A storage unit for storing scan data generated by scanning an object to be scanned by a scanner;

A control unit for calculating a reliability level and grouping according to the reliability level through the scan data stored in the storage unit; And

And a display unit that displays information allocated by the reliability calculated by the control unit.
The method of claim 11,

The scan data is grouped according to the reliability calculated by the control unit, and is classified and stored in the storage unit.
The method of claim 12,

The scan data display device including reliability, wherein the scan data divided and stored into a plurality of groups according to the grouping is displayed together with information allocated to the group through the display unit.
The method of claim 11,

The control unit further performs an operation of converting the scan data into 3D model data. The scan data display device including reliability.