KR20230138070A - Method for providing image of tmj using virtual camera, and apparatus implementing the same method - Google Patents

Abstract

A method for providing a TMJ image using a virtual camera is provided, wherein images in which an external and internal structures of a temporomandibular joint (TMJ) can be observed from various viewpoints can be provided by setting a virtual camera. The method performed by a computing device according to one embodiment of the present invention, comprises the steps of: setting a position of a virtual camera in a temporomandibular joint (TMJ) region connecting a mandible with a skull in a 3D image in which oral CT data and oral scan data are matched; when an occlusal state of a maxillary teeth and a mandibular tooth is transformed from a static occlusal state to a dynamic motion state, acquiring an image taken at the position of the virtual camera set in the TMJ region; and displaying the image on a screen.

Description

Method for providing TMJ images, and device for implementing the same {METHOD FOR PROVIDING IMAGE OF TMJ USING VIRTUAL CAMERA, AND APPARATUS IMPLEMENTING THE SAME METHOD}

The present invention relates to a method for providing a TMJ image, and a device for implementing the same. More specifically, a method for providing a TMJ image for providing an image near the temporomandibular joint (TMJ) through virtual camera settings using dental imaging software; And it is about a device to implement this.

Observing CT or panoramic images of the patient's oral cavity using dental imaging software is very important in establishing an accurate treatment plan for oral structures such as the patient's teeth and temporomandibular joint.

In particular, in the case of temporomandibular joint (TMJ) disorder, symptoms such as jaw pain, mouth opening disorder, and facial asymmetry may occur, so it is necessary to closely observe the condition of the temporomandibular joint through dental imaging. In addition, in the case of orthodontic treatment, it is necessary to diagnose through imaging how temporomandibular joint movement occurs when the upper and lower jaw occlude.

Previously, to obtain images near the temporomandibular joint (TMJ), images inside the temporomandibular joint could be obtained using oral CT or panoramic images provided by dental imaging software, or using a full-scale endoscopic camera.

However, when using dental imaging software, there is a problem that although it provides a screen to observe the external appearance of the temporomandibular joint (TMJ), it is difficult to observe the internal structure of the temporomandibular joint (TMJ) because it is structurally obscured. In addition, when using a real endoscopic camera separately from dental imaging software, the temporomandibular joint (TMJ) structure can be observed accurately, but both patients and medical staff may feel uncomfortable during the process of filming with an endoscopic camera.

Therefore, there is a need for a method of observing the internal structure of the temporomandibular joint on dental imaging software without using a full-scale endoscopic camera.

Public Patent Publication No. 10-2011-0027467 (published March 16, 2011)

The technical problem to be solved by the present invention is a method of providing TMJ images that can provide images that can observe the external appearance and internal structure of the temporomandibular joint (TMJ) from various viewpoints through virtual camera settings in dental imaging software, and The goal is to provide a device to implement this.

Another technical problem that the present invention aims to solve is that, in dental imaging software, the relationship between the temporomandibular joint (TMJ) and surrounding structures is visually observed when the temporomandibular joint (TMJ) changes from a static occlusion state to a dynamic motion state, thereby The goal is to provide a method of providing TMJ images that can diagnose (TMJ) disorders, and a device to implement the method.

Another technical problem that the present invention aims to solve is a method of providing TMJ images in dental imaging software that can analyze the movement path of the temporomandibular joint (TMJ) and control the settings of a virtual camera according to the movement path, and how to implement the same. To provide a device for

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below.

In order to solve the above technical problem, a method performed by a computing device according to an embodiment of the present invention is a temporomandibular joint (TMJ) region connecting the mandible and the skull in a 3D image that matches oral CT data and oral scan data. setting the position of the virtual camera, when the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state, acquiring an image taken at the position of the virtual camera set in the TMJ region, and It includes displaying the captured image on the screen.

As an embodiment, the step of setting the position of the virtual camera includes, when the mode of the virtual camera is selected as a variable viewpoint mode, a first point corresponding to the medial pole of the mandibular head in the TMJ region and , setting a second point corresponding to the lateral pole of the mandibular head, and a third point corresponding to the uppermost point of the mandibular head as the position of the virtual camera.

As an embodiment, the step of setting the position of the virtual camera includes, when the mode of the virtual camera is selected as a position variable mode, selecting the fourth point and the fifth point of the TMJ region to determine the position of the virtual camera and It may include setting the direction of the virtual camera.

In one embodiment, setting the position of the virtual camera and the direction of the virtual camera includes receiving a user input for setting the fourth point, and selecting the fifth point while the fourth point is set. It may include the step of additionally receiving user input for setting.

As an embodiment, the step of acquiring an image taken at the position of the virtual camera set in the TMJ area includes acquiring the image by using the viewpoint mismatch between the virtual cameras located at the fourth point of the left and right TMJ area. May include steps.

As an example, the dynamic movement state may include a forward movement state based on whether the anterior teeth between the maxillary teeth and the mandibular teeth are in occlusion, and a lateral movement state based on whether the two molars are in occlusion.

As an embodiment, providing a UI that can rotate the position of the virtual camera based on each of the mutually orthogonal A step of setting the position by rotating it may be further included.

As an embodiment, providing a UI that can move the position of the virtual camera up and down or left and right while fixing the Z axis among the mutually orthogonal X, Y, and Z axes, and The step of moving and setting the position of the virtual camera according to user input may be further included.

As an embodiment, providing a UI that can move the position of the virtual camera in a positive or negative direction on the Z-axis among the mutually orthogonal X-axis, Y-axis, and Z-axis, and providing the UI The method may further include moving and setting the position of the virtual camera according to user input.

As an embodiment, providing a UI that can set a magnification for adjusting the perspective projection value of the virtual camera while fixing the X-axis, Y-axis, and Z-axis that are mutually orthogonal to the position of the virtual camera, and The method may further include setting a magnification of the virtual camera according to a user input to the UI.

As an embodiment, providing a UI that can rotate the captured image by modifying the position of the fifth point so that the direction of the virtual camera changes, and the captured image according to a user input to the UI The step of rotating and displaying may further be included.

In order to solve the above technical problem, a dental image providing device according to an embodiment of the present invention includes one or more processors, a communication interface for communicating with an external device, a memory for loading a computer program executed by the processor, And storage for storing the computer program, wherein the computer program sets the position of the virtual camera in the TMJ (temporomandibular joint) area connecting the mandible and the skull in a 3D image that matches oral CT data and oral scan data. Operation, when the occlusion state of the maxillary teeth and mandibular teeth is converted from a static occlusion state to a dynamic movement state, an operation of acquiring an image captured at the position of a virtual camera set in the TMJ area, and displaying the captured image on a screen. Contains instructions to perform operations.

1 is a system configuration diagram according to an embodiment of the present invention.
Figure 2 is a block diagram showing the configuration of a dental image providing device according to an embodiment of the present invention.
Figure 3 is a flowchart for explaining a method of providing a TMJ image using a virtual camera according to an embodiment of the present invention.
Figure 4 is an example of generating a 3D image by matching oral CT data and oral scan data according to some embodiments of the present invention.
Figure 5 is an example of acquiring static occlusion data and dynamic occlusion data according to some embodiments of the present invention.
Figure 6 is an example illustrating a process for matching forward motion data according to some embodiments of the present invention.
Figure 7 is an example showing an image of matching left and right motion data according to some embodiments of the present invention.
Figure 8 is an example of setting the position of a camera in a variable viewpoint mode according to some embodiments of the present invention.
Figure 9 is an example of finding the center of the condyle as a reference point for determining the movement path of the temporomandibular joint according to some embodiments of the present invention.
10 and 11 are examples of finding the angle at which the condyle can move during forward and lateral movements according to some embodiments of the present invention.
Figure 12 is an example of setting the position and direction of a camera in a position variable mode according to some embodiments of the present invention.
Figure 13 is an example of providing a rotation function of a virtual camera according to some embodiments of the present invention.
Figure 14 is an example of providing a virtual camera movement function according to some embodiments of the present invention.
Figure 15 is an example of providing a zoom in/zoom out function of a virtual camera according to some embodiments of the present invention.
FIG. 16 is a hardware configuration diagram of the dental image providing device described with reference to FIG. 2.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the attached drawings. The advantages and features of the present disclosure and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the technical idea of the present disclosure is not limited to the following embodiments and may be implemented in various different forms. The following examples are merely intended to complete the technical idea of the present disclosure and to be used in the technical field to which the present disclosure belongs. It is provided to fully inform those skilled in the art of the scope of the present disclosure, and the technical idea of the present disclosure is only defined by the scope of the claims.

In describing the present disclosure, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present disclosure, the detailed description will be omitted.

Hereinafter, several embodiments of the present disclosure will be described in detail with reference to the attached drawings.

1 is a system configuration diagram according to an embodiment of the present invention. Referring to FIG. 1, the dental image providing device 1 according to an embodiment of the present invention creates an image of the oral structure using CT data and oral scan data received from the external device 10. Create it and display it on the screen. The external device 10 is a device that stores and manages CT data and oral scan data of the patient's oral structure, and may be a computing device such as a server or a PC.

The dental image providing device 1 is a terminal for users or medical staff who want to analyze images of teeth and temporomandibular joints using software, and can be implemented in, for example, a PC, laptop, tablet, or smart phone.

The dental image providing device (1) generates a 3D image by registering oral CT data and oral scan data, and can set the position of the virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and the skull within the registered 3D image. there is. The position of the virtual camera may be set differently depending on whether the camera mode selected according to the user input is the viewpoint variable mode (or stationary mode) or the position variable mode (or movement mode). When the camera mode is selected as a variable viewpoint mode (or in-place mode), the position of the virtual camera is fixed at a specific point in the temporomandibular joint (TMJ) region, and at this time, the direction of the camera can be varied according to the user's input. . Additionally, when the camera mode is selected as a position variable mode (or movement mode), the position of the virtual camera moves along a predetermined path, and the direction of the camera during movement may coincide with the direction of movement of the camera.

The dental image providing device 1 may acquire an image taken at the position of a virtual camera set in the temporomandibular joint (TMJ) region when the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state. Here, the dynamic movement state may include a forward movement state based on whether the anterior teeth between the maxillary teeth and the mandibular teeth are in occlusion, and a lateral movement state based on whether the molars are in occlusion.

According to the system configuration of the present invention as described above, dental imaging software can provide images that can observe the external appearance and internal structure of the temporomandibular joint (TMJ) from various viewpoints through virtual camera settings. In addition, when the temporomandibular joint (TMJ) changes from a static occlusion state to a dynamic movement state, it is possible to diagnose whether the temporomandibular joint (TMJ) is disordered by visually observing the relationship between the temporomandibular joint (TMJ) and surrounding structures. For example, when changing from a static occlusion state to a dynamic movement state, the visual state change between the temporomandibular joint (TMJ) and the mandibular fossa/mandibular head, and the visual state change between the temporomandibular joint (TMJ) and the joint prominence are observed. Through this, it is possible to diagnose whether there is a disorder in the temporomandibular joint (TMJ) and develop a treatment plan. Figure 2 is a block diagram showing the configuration of a dental image providing device according to an embodiment of the present invention.

The dental image providing device 1 according to an embodiment of the present invention includes a communication unit 13, a storage unit 14, and a processor 11, and can be connected to an external device 10 through the communication unit 13. .

The external device 10 is a device that stores and manages CT data and oral scan data taken of the patient's oral structure, and may be implemented as a computing device such as a server or PC.

The dental image providing device 1 is a device that provides an interface that can perform a series of operations to acquire temporomandibular joint images through virtual camera settings according to user input, such as PCs, laptops, tablets, smart phones, etc. It can be implemented with the same computing device.

The communication unit 13 communicates with the external device 10 using a wired or wireless communication method. The communication unit 13 may communicate with the external device 10 through a wired communication method such as Ethernet, or through a wireless communication method such as Wi-Fi or Bluetooth. The method by which the communication unit 13 communicates is not limited to this, and communication may be performed using other communication methods.

The storage unit 14 may store data related to settings of a virtual camera performed according to a user's input, and may store a temporomandibular joint (TMJ) image captured by the virtual camera.

The processor 11 includes an image acquisition module 11a that acquires a temporomandibular joint (TMJ) image through virtual camera settings, and may further include an additional module for providing a user interface for virtual camera settings.

The processor 11 receives a request to provide a temporomandibular joint (TMJ) image through virtual camera settings according to the user's input, and performs an operation to obtain a temporomandibular joint (TMJ) image captured by the virtual camera according to the request.

The processor 11 receives CT data and oral scan data of the oral structure from the external device 10, generates a 3D image by matching the received CT data and oral scan data, and displays it on the screen.

The processor 11 sets the position of the virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and the skull in the 3D image obtained by matching CT data and oral scan data.

As an embodiment, when the camera mode is selected as a variable viewpoint mode (or in-place mode), the processor 11 selects the medial bone (Medial Pole) of the mandibular head in the temporomandibular joint (TMJ) region according to the user input. A point, a point corresponding to the lateral pole of the mandibular head, and a point corresponding to the uppermost point of the mandibular head can be set as the position of the virtual camera.

In addition, when the camera mode is the position variable mode (or movement mode), the processor 11 selects two points from the temporomandibular joint (TMJ) region according to the user input to set the position and direction of the virtual camera. You can.

The image acquisition module 11a can acquire a temporomandibular joint (TMJ) image captured at the position of the virtual camera set by the external device 10. At this time, the temporomandibular joint (TMJ) image may be provided as an endoscope-type 3D image taken to observe not only the external appearance but also the interior of the temporomandibular joint (TMJ) region.

Additionally, the image acquisition module 11a can adjust the position and direction of the virtual camera according to user input. For example, a new temporomandibular joint image can be obtained at the adjusted position by rotating, moving, or zooming in/out the position of the virtual camera.

Figure 3 is a flowchart for explaining a method of providing a TMJ image using a virtual camera according to another embodiment of the present invention.

The method of providing a TMJ image using a virtual camera according to an embodiment of the present invention can be performed by the dental image providing device 1. Description of the subject performing some operations included in the method according to the embodiment of the present invention may be omitted, and in such case, the subject may be understood as the dental image providing device 1.

Referring to FIG. 3, first, in operation S31, the dental image providing device 1 positions the virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and the skull in a 3D image that matches oral CT data and oral scan data. Set .

As an example, as shown in the example of FIG. 4, when the dental image providing device 1 generates a 3D registered image 43 by registering the oral CT data 41 and the oral scan data 42, the oral CT data ( A registration operation can be performed by setting three points corresponding to the anterior teeth and left and right molars among the tooth areas of the oral scan data 41) and oral scan data 42 as reference points.

Here, referring to FIG. 5, the oral scan data 42 includes static occlusion data 50 that records when the patient closes his mouth and the upper and lower teeth come into contact, and when the patient moves forward, left, and right. It may include dynamic occlusion data (51, 52, 53) that records the moments when the upper and lower teeth come into contact with each other and the moments when they do not come into contact with each other. At this time, the dynamic occlusion data includes forward motion data 51, left motion data 52, and right motion data 53, and may be acquired through a photo or video capture method.

For example, as shown in FIG. 6 , a 3D registered image 62 can be generated by registering oral CT data 60 and forward motion data 61. In addition, as shown in FIG. 7, a 3D registered image 71 is generated by registering the oral CT data 60 and the left motion data, or a 3D registered image 72 is generated by registering the oral CT data 60 and the right motion data. ) can be created.

As an embodiment, operation S31 is performed when the camera mode is selected as a variable viewpoint mode (or in-place mode) according to a user input, a first point corresponding to the medial pole of the mandibular head in the TMJ region, and , setting a second point corresponding to the lateral pole of the mandibular head, and a third point corresponding to the uppermost point of the mandibular head as the position of the virtual camera. At this time, the dental image providing device 1 can also set the direction and angle of view (FOV) of the camera for image acquisition.

For example, as shown in FIG. 8, the dental image providing device 1 may select the camera mode as a variable viewpoint mode (or in-place mode) according to a user input, and at this time, oral CT data and oral scan data may be used. In the registered 3D image, three points (81, 82, 83) among the temporomandibular joint (TMJ) region (80) connecting the mandible and the skull can be set as the positions of the three virtual cameras, respectively.

At this time, each of the three points 81, 82, and 83 set as the positions of the three virtual cameras is the medial pole of the mandibular head within the temporomandibular joint (TMJ) region 90 in the example of FIG. 9. It can be determined as a first point 91, a second point 92 which is the lateral bone of the mandibular head, and a third point 93 which is the uppermost point of the mandibular head.

Meanwhile, in the example of FIG. 9, the dental image providing device 1 sets the center 94 of the condyle in contact with the temporomandibular joint disk in the temporomandibular joint (TMJ) region 90, so that the temporomandibular joint (TMJ) is in a static occlusal state. When changing from to dynamic movement state, the movement path of the condyle can be identified. At this time, the center of the condyle (94) is the line connecting the first point (91), which is the medial pole of the mandibular head, and the second point (92), which is the lateral bone (lateral pole) of the mandibular head, and the line of the mandibular head. It can be determined as where the third point 93, which is the uppermost point, meets vertically.

As an example, in the example of FIG. 10 , the dental image providing device 1 may set a condylar angle, which is an angle at which the condyle can move when the temporomandibular joint (TMJ) moves forward. Specifically, the upper border of the external auditory canal (1011) and the lower border of the orbit (1012) are selected through the UI in the coronal view of the CT data, and the first reference plane (FH) connecting the upper border of the external auditory canal (1011) and the lower border of the orbit (1012) is created. plane) can be set. In addition, the uppermost part of the mandibular fossa (1013) and the lowermost part of the articular prominence (1014) are automatically extracted using the inflection point in the coronal view of the CT data, and the uppermost part of the mandibular fossa (1013) and the lowermost part of the articular protuberance (1014) are automatically extracted. 1014) can be set to connect the second reference plane. At this time, the uppermost part of the mandibular fossa (1013) and the lowermost part of the articular prominence (1014) may be selected through the UI.

The dental image providing device 1 may set the angle formed by the first reference plane (FH plane) and the second reference plane set in the above manner as the condylar angle 1015. Accordingly, the dental image providing device 1 can provide a movement path for the condyle during forward movement using the inclination angle of the articular prominence.

As an example, in the example of FIG. 11 , the dental image providing device 1 may set the bennet angle to the lateral condyle, which is an angle at which the condyle can move when the temporomandibular joint (TMJ) moves laterally. Specifically, the dental image providing device 1 uses a first reference plane (FH plane) 112 connecting the upper edge of the external auditory canal 1011 and the lower edge of the orbit 1012 when the temporomandibular joint (TMJ) moves laterally to the left or laterally to the right. The angle moved around the condyle of the (non-working side) 111 on the opposite side of the movement direction (working side) 110 in the third reference plane (axial plane) 113 cut parallel to the reference is defined as the lateral condyle as the inclination angle ( Bennet angle) can be set. At this time, the dental image providing device 1 moves the limit movement centered on the condyle on the opposite side (non-working side) 111 of the direction of movement (working side) 110 along with the bennet angle to the lateral condyle. Distance can also be measured. Based on this, the dental image providing device 1 can provide a movement path for the condyle during lateral movement using the inclination angle of the lateral condyle.

As an example, operation S31 is performed by selecting the fourth and fifth points among the temporomandibular joint (TMJ) region when the mode of the virtual camera is selected as the position variable mode (or movement mode) according to the user input. It may include an operation to set the position and direction of the virtual camera.

For example, as shown in FIG. 12, the mode of the virtual camera can be selected as the position variable mode (or movement mode) according to the user input, and at this time, the mandible is shown in the 3D registered image obtained by registering the oral CT data and the oral scan data. The position and direction of the virtual camera can be set by selecting the first point 121 and the second point 122 of the temporomandibular joint (TMJ) region 120 connecting the skull and the skull. At this time, while the first point 121 is first set according to the user input, the second point 122 may be additionally set. Accordingly, an image taken from the location of the first point 121 toward the direction where the second point 122 is located can be obtained, and at this time, the virtual camera is rotated along the outline of the temporomandibular joint (TMJ) region 120. (R) You can obtain images taken from various angles.

Next, in operation S32, the dental image providing device 1 captures images taken at the position of the virtual camera set in the temporomandibular joint (TMJ) region when the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state. Acquire video.

As an embodiment, referring to FIG. 12, operation S32 uses the viewpoint mismatch between virtual cameras located at the first point 121 in each of the left temporomandibular joint (TMJ) region and the right temporomandibular joint (TMJ) region. Video can be obtained.

Finally, in operation S33, the dental image providing device 1 displays the image captured in operation S32 on the screen.

As an embodiment, the dental image providing device 1 may provide a user interface that can adjust the position, view-plane normal (VPN) vector, and view angle of the virtual camera.

For example, as shown in FIG. 13, the dental image providing device 1 can change the properties of the virtual camera so that the virtual camera can be rotated based on each of the X-axis, Y-axis, and Z-axis, which are orthogonal to each other. It provides a UI and can rotate the virtual camera in a selected direction according to user input to the UI. At this time, the rotation method for the X-axis, Y-axis, and Z-axis can be implemented as Pitch, Roll, and Yaw, respectively, and each rotation method can be set by right-clicking and dragging the mouse. At this time, Pitch is a method of rotating around the am. Yaw is a method of rotating around the Z-axis (vertical axis) so that the camera's gaze moves left and right.

As another example, as shown in FIG. 14, the dental image providing device 1 can move the virtual camera up and down or left and right while fixing the Z axis among the mutually orthogonal X, Y, and Z axes. It provides a UI that can change the properties of a virtual camera and moves the position of the virtual camera according to user input to the UI. At this time, with the Z axis fixed, the X and Y axes are moved respectively according to the up, down, left, and right commands. u, It can be moved by the v value.

As another example, as shown in FIG. 15, the dental image providing device 1 moves the virtual camera in the positive or negative direction on the Z axis among the mutually orthogonal X, Y, and Z axes. It provides a UI that can change the properties of a virtual camera and moves the virtual camera according to user input to the UI. At this time, use the mouse scroll to move in the positive direction of the Z axis. Move n distance, in the negative direction of the Z axis It can be moved by n amount.

As an embodiment, the dental image providing device 1 provides a UI that can set a magnification for adjusting the perspective projection value of the virtual camera while fixing the position of the virtual camera and the X-axis, Y-axis, and Z-axis, , Depending on the user input to the UI, the magnification of the virtual camera can be set to 0.5x, 1.0x, 1.5x, 2.0x, etc.

In addition, the dental image providing device 1 provides a UI that can rotate the captured image by modifying the second point 122 in FIG. 12, and rotates and displays the captured image according to the user input to the UI. You can.

According to the embodiment of the present invention as described above, in dental imaging software, it is possible to provide the effect of observing the external shape and internal structure of the temporomandibular joint (TMJ) as if captured by an endoscopic camera using a virtual camera. . In addition, when the temporomandibular joint (TMJ) changes from a static occlusion state to a dynamic movement state, the relationship between the temporomandibular joint (TMJ) and surrounding structures is visually observed using images captured by a virtual camera to determine the condition of the temporomandibular joint (TMJ). Disability can be diagnosed.

Figure 16 is a hardware configuration diagram of the dental image providing device 1. As shown in FIG. 16, the dental image providing device 1 loads one or more processors 101, a bus 107, a network interface 102, and a computer program 105 executed by the processor 101 ( It may include a memory 103 for loading and a storage 104 for storing a computer program 105.

The processor 101 controls the overall operation of each component of the dental image providing device 1. The processor 101 may perform operations on at least one application or program to execute methods/operations according to various embodiments of the present invention. The memory 103 stores various data, instructions and/or information. Memory 103 may load one or more computer programs 105 from storage 104 to execute methods/operations according to various embodiments of the present invention. The bus 107 provides communication functions between components of the dental image providing device 1. The network interface 102 supports wired and wireless Internet communication of the dental image providing device 1. Storage 104 may non-transitory store one or more computer programs 105. The computer program 105 may include one or more instructions implementing methods/operations according to various embodiments of the present invention. When the computer program 105 is loaded into the memory 103, the processor 101 can perform methods/operations according to various embodiments of the present invention by executing the one or more instructions.

The computer program 105 may include one or more instructions implementing methods/operations according to various embodiments of the present invention. When the computer program 105 is loaded into the memory 103, the processor 101 can perform methods/operations according to various embodiments of the present invention by executing the one or more instructions. In one embodiment, the computer program 105 operates to set the position of the virtual camera in the temporomandibular joint (TMJ) region connecting the mandible and the skull in a 3D image that registers oral CT data and oral scan data, the maxillary teeth and When the occlusion state of the lower teeth is converted from a static occlusion state to a dynamic movement state, an operation of acquiring an image captured at the position of a virtual camera set in the TMJ area, and an operation of displaying the captured image on the screen May contain instructions.

So far, various embodiments of the present invention and effects according to the embodiments have been mentioned with reference to FIGS. 1 to 16. The effects according to the technical idea of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below.

The technical idea of the present invention described so far can be implemented as computer-readable code on a computer-readable medium. The computer program recorded on the computer-readable recording medium can be transmitted to another computing device through a network such as the Internet, installed on the other computing device, and thus used on the other computing device.

Although operations are shown in the drawings in a specific order, it should not be understood that the operations must be performed in the specific order shown or sequential order or that all illustrated operations must be performed to obtain the desired results. In certain situations, multitasking and parallel processing may be advantageous. Moreover, the separation of the various components in the embodiments described above should not be construed as necessarily requiring such separation, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. You must understand that it exists.

Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention can be implemented in other specific forms without changing the technical idea or essential features. I can understand that there is. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. The scope of protection of the present invention shall be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope shall be construed as being included in the scope of rights of the technical ideas defined by the present invention.

Claims (12)

In a method performed by a computing device,
Setting the position of a virtual camera in the temporomandibular joint (TMJ) area connecting the mandible and the skull in a 3D image obtained by registering oral CT data and oral scan data;
When the occlusion state of the maxillary teeth and the mandibular teeth is converted from a static occlusion state to a dynamic movement state, acquiring an image taken at the position of a virtual camera set in the TMJ area; and
Including, displaying the captured image on a screen,
How to provide TMJ images. According to claim 1,
The step of setting the position of the virtual camera is,
When the mode of the camera is selected as a variable viewpoint mode, a first point corresponding to the medial pole of the mandibular head in the TMJ region, and a second point corresponding to the lateral pole of the mandibular head A point, and setting a third point corresponding to the uppermost point of the mandibular head as the position of the virtual camera; including,
How to provide TMJ images. According to claim 1,
The step of setting the position of the virtual camera is,
When the mode of the virtual camera is selected as the position variable mode, selecting the fourth point and the fifth point among the TMJ region to set the position of the virtual camera and the direction of the virtual camera.
How to provide TMJ images. According to clause 3,
The step of setting the position of the virtual camera and the direction of the virtual camera is,
receiving a user input for setting the fourth point; and
Comprising: additionally receiving a user input for setting the fifth point while the fourth point is set,
How to provide TMJ images. According to clause 3,
The step of acquiring an image taken at the position of a virtual camera set in the TMJ area,
Comprising: acquiring an image using a viewpoint discrepancy between the virtual cameras located at the fourth point of the left and right TMJ regions,
How to provide TMJ images. According to claim 1,
The dynamic motion state is,
Including a forward movement state based on whether the anterior teeth between the maxillary teeth and the mandibular teeth are in occlusion, and a lateral movement state based on whether the left and right molars are in occlusion,
How to provide TMJ images. According to claim 1,
Providing a UI that can rotate the position of the virtual camera based on each of the X-axis, Y-axis, and Z-axis, which are orthogonal to each other; and
Further comprising: rotating and setting the position of the virtual camera according to a user input to the UI,
How to provide TMJ images. According to claim 1,
Providing a UI that can move the position of the virtual camera up and down or left and right while fixing the Z axis among the mutually orthogonal X, Y, and Z axes; and
Further comprising: moving and setting the position of the virtual camera according to a user input to the UI,
How to provide TMJ images. According to claim 1,
providing a UI that can move the position of the virtual camera in a positive or negative direction on the Z-axis among mutually orthogonal X, Y, and Z axes; and
Further comprising: moving and setting the position of the virtual camera according to a user input to the UI,
How to provide TMJ images. According to claim 1,
Providing a UI that can set a magnification for adjusting the perspective projection value of the virtual camera while fixing the X-axis, Y-axis, and Z-axis that are mutually orthogonal to the position of the virtual camera; and
Setting a magnification of the virtual camera according to a user input to the UI; further comprising,
How to provide TMJ images. According to clause 3,
providing a UI that can rotate the captured image by modifying the position of the fifth point so that the direction of the virtual camera changes; and
Further comprising: rotating and displaying the captured image according to a user input to the UI,
How to provide TMJ images. One or more processors;
A communication interface for communicating with external devices;
a memory that loads a computer program executed by the processor; and
Including storage for storing the computer program,
The computer program is,
An operation to set the position of a virtual camera in the TMJ (temporomandibular joint) area connecting the mandible and the skull in a 3D image that matches oral CT data and oral scan data,
When the occlusion state of the upper and lower teeth is converted from a static occlusion state to a dynamic movement state, an operation of acquiring an image taken at the position of a virtual camera set in the TMJ area, and
Containing instructions for performing the operation of displaying the captured image on the screen,
Dental imaging device.

Images