KR102236486B1 - A electric loupe and diagnosis method using the same - Google Patents

Abstract

The present invention relates to an electronic loupe device, comprising a first communication unit for receiving pain level information of a patient from a server, and a first display unit for displaying pain level information received by the first communication unit, and the patient's pain level information Is characterized in that the electronic loupe device worn by the patient is information generated by measuring the patient's EEG, and the doctor can accurately identify the patient's pain level during treatment.

Description

Electronic loupe and diagnosis method using the same {A electric loupe and diagnosis method using the same}

The present invention relates to an electronic loupe device, and more particularly, to an electronic loupe device capable of accurately grasping a patient's pain degree during treatment, and a diagnostic method using the same.

Many major surgeons often use a loupe to operate on sophisticated structures. The loupe used by the surgeon is mounted in the lens of the eyeglasses, and is customized for each individual surgeon in consideration of corrected vision, pupillary distance, and desired focal length. Some loupe attaches to a helmet or other head-worn device and multiple magnifications are available. They are most commonly used in plastic surgery, orthopedic surgery, microvascular surgery and tendon suture surgery.

However, in the past, only doctors use a loupe, so the patient could not hear the doctor's explanation while checking the affected area directly, and there is a suspicion of over-treatment because the patient had to rely solely on the doctor's diagnosis for the desired treatment method for the affected area. Also, it was not possible to confirm whether the diagnosis was correct. In addition, even when the actual treatment is not required, there is a discomfort that the patient cannot know before visiting a doctor and receiving face-to-face treatment. In addition, the doctor could not determine the patient's pain level during treatment, so there was no way to check whether the degree of anesthesia or neurological treatment was properly performed.

Prior art (Korean Publication No.:10-2019-0017377) discloses a technology that helps medical treatment by checking AR data superimposed on teeth during treatment, but the prior art also requires the patient to visit the doctor himself. There was a problem in that no feedback could be received from patients who had difficulty using their hands during treatment.

Accordingly, the first problem to be solved by the present invention is to provide an electronic loupe device that allows a doctor to accurately determine the degree of pain of a patient during treatment.

The second problem to be solved by the present invention is a diagnosis using an electronic loupe that can immediately express an intention to a doctor with only the movement of the head or eyes even in a situation where the patient cannot use both hands or speak while receiving treatment. Is to provide a way.

In addition, it is to provide a computer-readable recording medium in which a program for executing the above-described method on a computer is recorded.

The present invention, in order to achieve the first task, the first communication unit for receiving the pain level information of the patient from the server; And a first display unit for displaying pain level information received by the first communication unit, wherein the patient's pain level information is information generated by an electronic loupe device worn by the patient measuring the patient's EEG. It provides an electronic loupe device.

According to an embodiment of the present invention, the first communication unit receives a recorded image selected by mark information, the first display unit displays the recorded image, and the mark information is information inserted into an image being recorded. desirable.

In addition, when the first communication unit receives a consultation request signal from the server, and when the first communication unit transmits a consultation acceptance signal to the server in response to the consultation request signal, the server generates the consultation request signal. The image displayed by the device may be transmitted to the first communication unit to share the image.

Meanwhile, the first communication unit may receive an AR image to be added to the recorded image determined by the AI module of the server.

According to another embodiment of the present invention, further comprising a first sensor unit for detecting a motion, the first communication unit transmits the motion information detected by the first sensor unit to the server, and the server transmits the motion information AR data generated by using may be received, and the first display unit may display the received AR data.

Meanwhile, when the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold value, the first communication unit may receive a signal indicating that anesthesia is insufficient from the server.

In addition, the first communication unit indicates that the nerve of the tooth is alive or that nerve treatment is required when the patient's affected part is a tooth and the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold. It is preferable to receive AR data from the server and output it to the first display unit.

According to another embodiment of the present invention, an image identical to that displayed on the electronic loupe device worn by the doctor may be output to the electronic loupe device worn by the patient.

In addition, when the doctor and the patient to be diagnosed are in different places, an image of the patient's affected area acquired using the electronic loupe device worn by an assistant next to the patient is an electronic loupe worn by the doctor through the server. Can be transferred to the device.

It would be desirable to store the treatment image of the tooth corresponding to the designated number of the tooth, and when the tooth is treated again, the stored treatment image is output to the first display unit and provided to the doctor.

When the patient's affected part image is a tooth image, the first communication unit compares and learns the arrangement or shape of the tooth image with a previously stored healthy tooth image from the AI module of the server, thereby receiving a designation number of a tooth requiring treatment. It is desirable.

In order to achieve the first task, the present invention provides an electronic loupe device worn by a patient, comprising: a pain level information generator configured to generate pain level information of the patient by measuring brain waves of the patient; A second communication unit for receiving a recorded image selected by the mark information from a server and transmitting the generated pain level information to the server; And a second display unit for displaying a recorded image received by the second communication unit, wherein the mark information is information inserted into an image being recorded.

According to an embodiment of the present invention, when a second sensor unit for detecting motion is further included, and at least one or more options for treating the treatment affected area are displayed on the second display unit, the patient selects one of the options. When gazing for a predetermined time or longer, the option is dragged and included in the dental treatment selection list with the movement of the gaze, so that a plurality of selected option costs can be displayed to the patient.

In addition, it is preferable that the AR data output to the electronic loupe device include options for treating the patient's affected area, and display an AR image indicating a result when the options are treated on the affected area.

In this case, a treatment result image or a treatment progress of a case similar to the case of treating the patient's affected part may be received from the server and output to the second display unit to be provided to the patient.

In order to achieve the second task, the present invention comprises the steps of: receiving pain level information of a patient from a server; And displaying the received pain level information, wherein the patient's pain level information is information generated by an electronic loupe device worn by the patient measuring the patient's brain waves. Provides a diagnostic method.

In addition, the present invention, in order to achieve the second task, the step of receiving a recorded image selected by the mark information from the server; Displaying the received recorded image; Generating information about the patient's pain level by measuring the patient's brain waves; And transmitting the generated pain level information to a server.

In order to solve the above other technical problem, the present invention provides a computer-readable recording medium in which a program for executing the diagnosis method using an electronic loupe described above in a computer is recorded.

According to the present invention, a doctor can accurately determine the degree of pain of a patient during treatment.

In addition, according to the present invention, even in a situation where the patient cannot use both hands or speak while receiving treatment, it is possible to immediately express the intention to the doctor with only the movement of the head or eyes.

1 is a block diagram of an electronic loupe device according to an exemplary embodiment of the present invention.
FIG. 2 shows that treatment options are displayed as AR images for a specific tooth that needs treatment.
3 shows a state after resin treatment is performed with an AR image in a situation where a part of a tooth is lost and resin treatment is required.
4 shows an AR image presented according to a crown material when a specific tooth is treated as a crown.
5 is a flowchart of a diagnosis method using an electronic loupe device according to an exemplary embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in which a person of ordinary skill in the art can easily implement the present invention. However, these examples are for describing the present invention in more detail, and it will be apparent to those of ordinary skill in the art that the scope of the present invention is not limited thereto.

The configuration of the present invention for clarifying the solution to the problem to be solved by the present invention will be described in detail with reference to the accompanying drawings based on a preferred embodiment of the present invention, but the same in assigning reference numerals to the components of the drawings. For the components, even if they are on different drawings, the same reference numerals are given, and it should be noted in advance that components of other drawings may be referred to when necessary when describing the drawings. In addition, when it is determined that the detailed description of known functions or configurations related to the present invention and other matters may unnecessarily obscure the subject matter of the present invention in describing the operating principle of the preferred embodiment of the present invention in detail, Its detailed description is omitted.

In addition, throughout the specification, when a part is said to be'connected' with another part, it is not only'directly connected', but also'indirectly connected' with another element in the middle. Includes. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” or “comprising” excludes the presence or addition of one or more other elements, steps, operations, or elements other than the recited element, step, operation, or element. I never do that.

Terms including ordinal numbers such as second and first may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, the second element may be referred to as the first element, and similarly, the first element may be referred to as the second element.

1 is a block diagram of an electronic loupe device according to an exemplary embodiment of the present invention.

Referring to FIG. 1, the electronic loupe device according to the present embodiment may be divided into an electronic loupe device 100 for a doctor and an electronic loupe device 200 for a patient.

It is preferable that the doctor's electronic loupe device 100 is worn by the doctor, and the patient's electronic loupe device 200 is worn by the patient. The doctor's electronic loupe device 100 and the patient's electronic loupe device 200 can communicate with each other via the server 300, and between the first communication unit 130 and the second communication unit 230 without going through the server 300 It is also possible to send and receive directly.

As another embodiment, when a doctor and a patient are located in remote locations from each other, the electronic loupe device 100 for a doctor is worn by an assistant with the patient, and the image of the patient's affected area is displayed as the electronic loupe device 200 for a patient worn by the doctor. It may be transmitted through 300 or may be directly transmitted through the first communication unit 130 and the second communication unit 230. In this case, the patient's own dental condition (the area of the tooth to be treated, the degree of caries progression, etc.) can be checked remotely without directly visiting a doctor, and the affected area can be directly checked during treatment.

The pseudo electronic loupe device 100 includes a camera unit 110, a first sensor unit 120, a first communication unit 130, and a first display unit 140.

The electronic loupe device 100 for doctors is preferably in the form of a smart glass worn by a user or an HMD device (head-mounted display device).

The camera unit 110 photographs an image of the affected area to be diagnosed. It is preferable to indicate the start and end of recording of the recorded image captured by the camera unit 110 by using the mark information received from the doctor. When a specific gesture is input by the first sensor unit 120 or a separate interface (eg, a button, a switch) is input through a specific signal, the mark information may be recognized as input.

As an example, in the case of dentistry, the camera unit 110 generates 3D images of the patient's teeth and facial bone structures using 3D digital imaging, for example, a 3D oral scanner or a Cone Beam Computerized Tomography (CBCT). , 3D model scanner, etc. The 3D oral scanner generates a 3D image of the entire shape of the subject in the oral cavity by sensing the reflected light when incident light irradiated into the oral cavity is reflected on a tooth or a subject. CBCT uses an area detector to detect a cone-shaped transmitted X-ray two-dimensionally, and obtains three-dimensional volume information using this, thereby generating a 3D image with only one rotation scan of a subject in the oral cavity. The 3D image by the 3D oral scanner has the advantage of accurately expressing the surface shape of the subject (tooth, gum, etc.), and the 3D image by the CBCT has the advantage of accurately expressing not only the crown information of the tooth, but also the alveolar bone and root information.

The first sensor unit 120 generates motion information by detecting a movement of a doctor or assistant wearing the electronic loupe device 100 for doctors on the head.

The first sensor unit 120 may detect a head movement of a medical staff or assistant using a 3-axis acceleration sensor and a 3-axis gyro sensor. The generated motion information includes not only movement information of the doctor's head, but also movement information of left and right, up and down of the pupil, and motion information may be a state in which the pupil is stopped for a predetermined time or longer.

When a doctor uses both hands to diagnose or treat a patient while wearing the doctor's electronic loupe device 100, actions such as selecting a menu displayed on the first display unit 140 or pressing a button are performed. In order to do this, it is preferable to use motion information sensed by the first sensor unit 120.

Specifically, when the wearer turns his or her head or face to the left or right, moves the head or face back and forth, moves the head or face up and down, or rotates the head or face, the first sensor unit 120 performs such movement. Can be detected.

In addition, the first sensor unit 120 may detect whether each movement is performed only once or multiple times. According to another embodiment, when there are multiple movements, the first sensor unit 120 may detect a time interval between each movement.

Each of these movements has different meanings, and various actions may occur by adjusting the shape of the wearer's face, the number of attempts to make each movement, or the time interval between each movement.

Meanwhile, the first sensor unit 120 may correspond to a command by detecting the movement of the pupil of the medical staff and the blinking of the eye in addition to the movement of the head. The movement of the pupil includes looking at a specific object for a predetermined period of time and movement of a gaze at which the pupil looks at the object.

For example, when the pupil looks at a specific object for a certain period of time, it is recognized that the object is selected, the selected object is moved as the eye's gaze moves, and when the eye blinks, it is recognized that the selection is canceled. I can.

The first communication unit 130 transmits the image of the affected area acquired by the camera unit 110 and motion information detected by the first sensor unit 120 to the server 300, and the server 300 transmits the image and the movement information. AR data processed from the information can be received. Meanwhile, the received AR data may be AR data corresponding to a menu selected by analyzing a motion input from the motion information and being selected by the motion input.

The image received by the server 300 is photographed by the camera unit 110, and the server 300 may add AR data to a specific object included in the image.

The AR data transmitted from the server 300 to the first communication unit 130 may be added to the received image data and transmitted together. On the other hand, since the image data has a large capacity and is difficult to transmit in real time, the server 300 does not transmit the image data and provides coordinates or object positions in the image and AR data corresponding to the coordinates or positions. 1 Can be sent to the communication unit 130.

The server 300 may generate AR data by receiving the image and motion information of the affected area received from the electronic loupe device 100 for physicians, but the electronic loupe device 100 for physicians does not use the server 300 It is also possible to directly generate AR data.

The first display unit 140 displays an image of the affected area acquired by the camera unit 110 and AR data received by the first communication unit 130. The reason why the AR data may be superimposed and displayed on the affected area is that the server 300 transmits the coordinates or location of the object on which the AR data is to be displayed to the first communication unit 130 together. As another embodiment, image data to which AR data is added may be received from the server 300 and displayed.

Meanwhile, the server 300 preferably has an AI (Artificial Intelligence) function, and the AI module may add and store mark information for some teeth in the tooth image being photographed. . For example, when a'surgical scene using A surgical tool' appears among the images, the AI module may store the image portion by adding mark information of'A surgical tool' to the image.

When the surgical tool is a dental handpiece, the AI module may be stored together with an image recorded using the mark information on which handpiece was used for a specific tooth.

The dental handpiece is an instrument used to remove and smooth teeth when there are cavities in the teeth or when the teeth are sharpened.

High-speed handpieces rotate at a high speed of 300,000 to 450,000 R.P.M to cut teeth, while low-speed handpieces are used for pores due to their slow rotational speed of 200,000 to 300,000 R.P.M. In particular, the high-speed handpiece is used for caries treatment requiring removal of enamel, dentin, and old metal restorations (crowns, etc.), and the low-speed handpiece is used for cutting and prophylactic treatment of the caries itself.

When the type of handpiece used for treatment of a specific tooth is stored in a recorded image together with mark information, when the same tooth is treated later, the recorded image may be displayed and the handpiece used for the previous treatment may be displayed.

In addition, it is possible to easily search for an image that a user wants to find by using mark information stored in the recorded image. Specific surgical tools (e.g., high-speed handpiece, low-speed handpiece, air water syringe, scaling, etc.)are used, the section in which a specific affected area (e.g., a specific tooth number) is photographed, a specific vital sign (blood pressure, Body temperature, pulse, respiration volume, etc.) are stored as mark information, so that it is easy for the user to search for a necessary section of the recorded image.

It is preferable that the mark information includes various information in addition to the surgical tools used for the treatment described above. As input by a doctor, a collaborating doctor, or a medical expert, the mark information may include medical findings about a specific affected area during surgery or an area mark for distinguishing a specific affected area from normal tissue.

In addition, it would be desirable to include a past treatment record for a specific affected area, a recommended treatment method for treating a specific affected area, and an expected disease prediction in the mark information.

The past treatment record includes a neurological treatment record of a corresponding tooth, a last scaled date, or an X-RAY photograph taken in the past. As for the recommended treatment method, the AI module may analyze past similar treatment cases for the specific affected area, and select and present a treatment method with the best prognosis. In addition, the AI module may predict a disease with a high possibility of onset by analyzing the medical image and data measured from the patient, and include it in mark information.

On the other hand, if the medical staff and the patient to be diagnosed are in different places and the medical staff cannot directly see the patient, the image of the patient's affected part obtained using the electronic loupe device 100 for doctors worn by an assistant with the patient and The AR data processed as the assistant's motion information may be transmitted to the doctor's electronic loupe device 100 worn by the doctor through the server 300. Therefore, even a medical person in a remote location can diagnose a patient with the help of an assistant. In this case, the AR data may be AR data corresponding to a menu selected by analyzing a motion input from the motion information and being selected by the motion input.

In addition, a medical staff wearing the electronic loupe device 100 for a doctor according to the present invention may request a consultation from another medical staff. In this case, a collaboration request unit (not shown) may be additionally provided to request a consultation by adjusting the shape of the face and the number of attempts of each movement.

Another medical staff requested for consultation wears the electronic loupe device 100 for doctors equipped with a consultation request receiving unit (not shown), and outputs it to the display unit of the electronic loupe device 100 for doctors worn by the medical staff who requested the consultation. You can share the video.

The patient electronic loupe device 200 includes a second sensor unit 220, a second communication unit 230, a second display unit 240, and a pain level information generation unit 250.

The electronic loupe device 200 for a patient is preferably in the form of a smart glass worn by a user or an HMD device (head-mounted display device).

As an embodiment, the image viewed through the doctor's electronic loupe device 100 worn by the medical practitioner or assistant and the displayed AR data are equally output to the patient's electronic loupe device 200 worn by the patient, and the patient It is preferable that the motion information of is transmitted to the server 300.

Since the patient electronic loupe device 200 displays an image of the affected area viewed by the medical staff to the patient, it is preferable to receive image data of the affected area from the server 300 or the electronic loupe device 100 for doctors.

The second sensor unit 220 generates motion information by detecting the motion of the patient wearing the electronic loupe device 200 for the patient on the head.

The second sensor unit 220 may detect the movement of the patient's head using a 3-axis acceleration sensor and a 3-axis gyro sensor.

When a patient receives treatment or diagnosis from a medical staff, it is difficult to control the electronic loupe device 200 for a patient worn on the head using both hands. In order to select a menu displayed on the second display unit 240 or press a button, motion information detected by the second sensor unit 120 may be used.

For example, a command may be associated with a left or right rotation of the patient's head, an up and down rotation, a clockwise or counterclockwise rotation.

Meanwhile, the second sensor unit 220 may detect the motion of the patient's pupils in addition to the motion of the head and correspond to the command. The motion of the pupil includes a fixed time (time to continuously gaze), etc. without the pupil moving. Through this motion detection, it is possible to communicate a doctor even in situations where the patient cannot speak.

The second communication unit 230 receives the image and AR data of the affected area acquired by the camera unit 110 from the server 300, and transmits motion information detected by the second sensor unit 220 to the server 300. .

The image received by the second communication unit 230 from the server 300 is an image acquired through the camera unit 110 of the doctor's electronic loupe device 100, and the received AR data is applied to a specific object included in the image. It is preferable that it is the corresponding AR data.

It is preferable that the second communication unit 230 receives coordinates or position information of the specific object, and the coordinates or object positions are referred to to display AR data on an object in the image.

The second display unit 240 displays the image and AR data received by the second communication unit 230.

At least one or more options capable of treating the treatment affected area are displayed on the second display unit 240, and when the patient gazes at one of the options for a predetermined period of time or longer, the option is dragged and included in the purchase list. By doing so, it is possible to display the cost of a plurality of selected options to the patient.

AR data output to the second display unit 240 of the patient's electronic loupe device 200 worn by the patient displays options for treating the patient's affected area, but shows the results when the options are treated on the affected area. The indicated AR image can be displayed.

That is, when the patient selects one of the displayed lesion treatment options, it is preferable that the selected option is used to display the expected result of treatment on the affected area as an AR image.

In addition, a treatment result image or a treatment progress of a case similar to the case of treating the affected part of the patient may be searched by the server 300 and displayed on the second display unit 240.

FIG. 2 shows that treatment options are displayed as AR images for a specific tooth that needs treatment.

Referring to FIG. 2, the AI module of the server 300 determines a specific tooth, and an area required for inlaying is determined and displayed. The area required for inlays is displayed through the judgment of the AI module, and by preventing the doctor from arbitrarily modifying the required area for inlays, excessive treatment can be prevented and reliability of treatment can be increased.

In addition, it is preferable that a resin inlay, a ceramic inlay, and a gold inlay, which are inlay treatment options, are displayed as AR images, and a post-treatment image when treated with the inlay material is also displayed.

The treatment price for the inlay treatment option is displayed to the patient, and when the AI module determines, the most optimal inlay option can be recommended to the patient.

When the second sensor unit 220 detects that the patient's pupils are not moving and the eyes are fixed to a specific menu and maintained for a certain period of time while the patient is wearing the patient's electronic loupe device 200, the corresponding menu is selected and displayed on the screen. It rises up, and as the eye's gaze moves, the selected menu also moves.

When the selected menu is moved to the dental treatment selection list, it is preferable that all treatment option prices of the menus selected so far are calculated and the final price is displayed to the patient.

In addition, it is possible to receive the dental insurance subscribed by the corresponding patient from the insurance company server, and display whether the dental insurance is applicable.

3 shows a state after resin treatment is performed with an AR image in a situation where a part of a tooth is lost and resin treatment is required.

When the tooth image captured by the camera unit 110 of the doctor's electronic loupe device 100 is transmitted to the server 300, the AI module of the server 300 determines whether a specific tooth in the tooth image needs treatment. , The image after treatment is transmitted to the electronic loupe device 200 for a patient so that the patient can check it through the second display unit 240.

Referring to FIG. 3, when a part of a specific tooth is lost, a treatment image after resin treatment is performed may be displayed as an AR image.

Patients can select the most preferred treatment option before treatment by checking images after treatment for various options through AR images in advance.

4 shows an AR image presented according to a crown material when a specific tooth is treated as a crown.

The PFM crown is made of ceramic on the outside and metal on the inside, making it the cheapest crown. Gold crowns are hard and flexible in strength, so they can be made the most similar to natural teeth, but have a disadvantage of poor aesthetics. The zirconia crown is very hard in strength, has excellent aesthetics, and has good biocompatibility with natural teeth.

Since the patient can select after viewing the AR image after actually being treated for each crown, it is possible to increase satisfaction with the result after treatment.

Referring back to FIG. 1, the pain level information generation unit 250 generates pain level information by measuring an EEG of the patient. The pain level information generation unit 250 transmits the generated pain level information to the electronic loupe device 100 or the server 300 for doctors.

When the medical electronic loupe device 100 receives the pain level information, the volume of the sound may be adjusted according to the pain level, or the degree of pain may be transmitted to the doctor by shortening the flashing period of light.

When the pain level generated by the pain level information generator 250 exceeds a predetermined threshold, a signal indicating that anesthesia is insufficient in the affected area may be transmitted to the electronic loupe device 100 or the server 300 for doctors. At this time, when the affected part is a tooth and the pain level generated by the pain level information generator 250 exceeds a predetermined threshold, the first display displays the nerve of the tooth as alive or indicates that neurological treatment is required. It can be output to the unit 140.

The pain level information generation unit 250 may measure a degree to which the brain feels pain when a stimulus is applied to a region with pain through brain waves. The EEG at this time is called the induced EEG, and it is called P250 because a positive EEG related to pain appears 250ms after stimulation.

As another embodiment, when 0 is the case where there is no pain and 10 is the case where the pain is severe, the patient's EEG is measured, and the patient writes the degree of pain from 0 to 10, and the measured EEG and the degree of pain are measured. Mapping.

It accumulates mapped data and learns the pattern of brain waves according to the patient's pain level (0-10) through machine learning.

In other words, the pattern data of the EEG corresponding to the pain of 10 that the patient feels the most severe pain, the pattern data of the EEG corresponding to 0, which feels that there is no pain, are accumulated, and the features of the EEG pattern corresponding to the degree of pain are extracted. Thereafter, when the patterns of the received EEG are compared, it is possible to determine how much the patient's pain is based on the EEG measured from the patient.

As another embodiment, blood flow in the brain may be measured in order to measure the degree of pain in the patient. Ultrasound can be used to measure the blood flow rate of cerebrovascular vessels located within the skull.

Preferably, considering both the brain waves and the blood flow to the brain, it is possible to accurately determine the degree of pain of the patient.

When the image acquired by the camera unit 110 using the electronic loupe device 100 for a doctor according to the present invention is a tooth image, the server 300 determines the arrangement of the teeth or the shape of the teeth. It compares with the tooth image, checks the tooth number of the tooth that needs treatment, and transmits it to the electronic loupe device 100 for doctors, and the first display unit 140 or the second display unit 240 stores AR data related to the corresponding tooth. Can be printed.

In addition, the treatment image of the tooth is stored in the server 300 in correspondence with the tooth number of the tooth, and the tooth of the same patient is not only treated again by the same medical personnel, but also when the tooth is treated by another medical staff. The stored treatment image may be output to the first display unit 140 or the second display unit 240.

5 is a flowchart of a diagnosis method using an electronic loupe device according to an exemplary embodiment of the present invention.

Referring to FIG. 5, the diagnostic method using the electronic loupe device according to the present embodiment includes steps processed in a time series by the electronic loupe device shown in FIG. 1. Accordingly, even if omitted below, the contents described above with respect to the electronic loupe device shown in FIG. 1 are also applied to the diagnosis method using the electronic loupe device according to the present embodiment.

In step 500, the electronic loupe device 100 for a doctor captures an image of the affected area to be diagnosed.

In step 510, the electronic loupe device 100 for doctors transmits the image generated in step 500 and the motion information detected by the first sensor unit 120 that detects the motion to the server 300.

When the medical staff uses both hands to diagnose or treat a patient while wearing the doctor's electronic loupe device 100, actions such as selecting a menu displayed on the first display unit 140 or pressing a button are performed. To do this, the motion information detected by the first sensor unit 120 is used.

For example, a command may be associated with a left or right rotation of the medical staff's head, an up and down rotation, a clockwise or counterclockwise rotation.

Meanwhile, in addition to the movement of the head, the movement of the pupils of the medical staff can be detected and corresponded to the command. The motion of the pupil includes a fixed time (time to continuously gaze), etc. without the pupil moving.

In step 520, the doctor's electronic loupe device 100 receives the AR data processed using the image and the motion information from the server 300, and the patient's electronic loupe device 200 is also worn by the medical staff from the server 300. An image captured by an electronic loupe device 100 for a doctor and AR data generated by using motion information of the electronic loupe device are received from the server 300. It is preferable that the received AR data is AR data corresponding to a menu selected by analyzing a motion input from the motion information and being selected by the motion input.

Since the image data has a large capacity and is difficult to transmit in real time, the server 300 transmits the coordinates or object position where the object is located in the image without transmitting the image data, and transmits the AR data corresponding to the coordinates or position. It can be sent to the doctor's electronic loupe device 100.

In addition, the electronic loupe device 200 for a patient may receive a recorded image selected by the mark information from the server 300.

The mark information may be received from a doctor, and it is preferable to indicate the start and end of recording of the recorded image captured by the camera unit 110. When a specific gesture is input by the first sensor unit 120 or a separate interface (eg, a button, a switch) is input through a specific signal, the mark information may be recognized as input.

In step 530, the doctor's electronic loupe device 100 and the patient's electronic loupe device 200 display the image generated in step 500 and AR data generated by the server 300.

It is preferable that the patient electronic loupe device 200 receives and displays the image generated by the doctor's electronic loupe device 100 and AR data added to the image from the server 300.

In step 540, the patient's electronic loupe 200 measures the patient's brain waves to generate pain level information.

The electronic loupe device 200 for a patient may measure a degree to which the brain feels pain when a stimulus is applied to a painful area through brain waves. As another embodiment, when 0 is the case where there is no pain and 10 is the case where the pain is severe, the patient's EEG is measured, and the patient writes the degree of pain from 0 to 10, and the measured EEG and the degree of pain are measured. Mapping. It accumulates mapped data and learns the pattern of brain waves according to the patient's pain level (0-10) through machine learning. In other words, the pattern data of the EEG corresponding to the pain of 10 that the patient feels the most severe pain, the pattern data of the EEG corresponding to 0, which feels that there is no pain, are accumulated, and the features of the EEG pattern corresponding to the degree of pain are extracted. Thereafter, when the patterns of the received EEG are compared, it is possible to determine the degree of pain of the patient based on the EEG measured from the patient.

In step 550, the electronic loupe device 200 for a patient transmits the pain level information generated in step 540 to the server 300.

In step 560, the electronic loupe device 100 for doctors receives pain level information from the server 300.

In step 570, the electronic loupe device 100 for doctors outputs a signal corresponding to the pain level information.

When the medical electronic loupe device 100 receives the pain level information, the volume of the sound may be adjusted in proportion to the degree of pain, or the degree of pain may be transmitted to the medical staff by shortening the flashing period of light.

Embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

As described above, in the present invention, specific matters such as specific components, etc., and limited embodiments and drawings have been described, but these are provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , If a person of ordinary skill in the field to which the present invention belongs, various modifications and variations are possible from these descriptions.

Therefore, the spirit of the present invention is limited to the described embodiments and should not be defined, and all things that are equivalent or equivalent to the claims as well as the claims to be described later fall within the scope of the inventive concept. .

Claims (18)

A first communication unit for receiving pain level information of the patient from the server; And
Including a first display unit for displaying the pain level information received by the first communication unit,
The patient's pain level information is characterized in that the electronic loupe device worn by the patient is information generated by measuring the patient's brain waves,
The first communication unit, when the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold value, and receives a signal from the server indicating that anesthesia is insufficient. The method of claim 1,
The first communication unit receives the recorded image selected according to the mark information,
The first display unit displays the recorded image,
The mark information is information inserted into the image of the affected part of the patient acquired by the camera unit being recorded,
The recorded image is an image in which the image of the patient's affected area acquired by the camera unit is stored. The method of claim 1,
The first communication unit receives a consultation request signal from the server,
When the first communication unit transmits a consultation acceptance signal to the server in response to the consultation request signal, the server transmits the image of the patient's affected area displayed by the electronic loupe device that generated the consultation request signal to the first communication unit. The electronic loupe device, characterized in that to share the image. The method of claim 2,
Wherein the first communication unit receives an AR image to be added to the recorded image determined by the AI module of the server. The method of claim 1,
Further comprising a first sensor unit for detecting the movement,
The first communication unit transmits motion information detected by the first sensor unit to the server, and receives AR data generated by the server using the motion information,
The electronic loupe device, wherein the first display unit displays the received AR data. delete The method of claim 1,
When the patient's affected part is a tooth and the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold, AR data indicating that the nerve of the tooth is alive or that neurological treatment is required Received from the server and outputted to the first display unit. The method of claim 1,
An electronic loupe device, characterized in that the same image of the affected part of the patient as displayed on an electronic loupe device worn by a doctor is output to the electronic loupe device worn by the patient. The method of claim 1,
When the doctor and the patient to be diagnosed are in different places, an image of the patient's affected area acquired using an electronic loupe device for a doctor worn by an assistant next to the patient is an electronic loupe device worn by the doctor through the server Electronic loupe device characterized in that the transmission to The method of claim 7,
Stores the treatment image of the tooth corresponding to the designated number of the tooth,
When the tooth is treated again, the stored treatment image is output to the first display unit. The method of claim 1,
When the patient's affected part image is a tooth image, the first communication unit compares and learns the arrangement or shape of the tooth image with a previously stored healthy tooth image from the AI module of the server, thereby receiving a designation number of a tooth requiring treatment. Electronic loupe device, characterized in that. In the electronic loupe device worn by the patient,
A pain level information generator configured to measure the patient's brain waves to generate pain level information of the patient;
A second communication unit for receiving the recorded image selected by the mark information from the server and transmitting the generated pain level information to the server; And
Including a second display unit for displaying the recorded image received by the second communication unit,
The mark information is information inserted into the image of the affected part of the patient acquired by the camera unit being recorded,
The patient's pain level information is information generated by an electronic loupe device worn by the patient measuring the patient's brain waves,
The recorded image is an image in which an image of the patient's affected part acquired by the camera unit is stored,
When the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold, a signal indicating insufficient anesthesia is transmitted to the server. The method of claim 12,
Further comprising a second sensor unit for detecting the movement,
When at least one or more options for treating a treatment affected area are displayed on the second display unit, when the patient gazes at one of the options for a predetermined time or longer, the option is dragged and included in the dental treatment selection list. By doing so, the electronic loupe device, characterized in that to display the selected plurality of option costs to the patient. The method of claim 12,
The AR data output to the electronic loupe device includes options for treating the affected part of the patient, and displays an AR image indicating a result of the treatment of the affected part of the patient. The method of claim 12,
An electronic loupe device, characterized in that receiving a treatment result image or a treatment progress of a case similar to the case of treating the affected part of the patient from the server, outputting it to the second display unit, and providing it to the patient. Receiving pain level information of the patient from the server; And
Including the step of displaying the received pain level information,
The patient's pain level information is information generated by an electronic loupe device worn by the patient measuring the patient's brain waves,
When the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold, a signal indicating insufficient anesthesia is received from the server. Receiving a recorded image selected by the mark information from the server;
Displaying the received recorded image;
Generating information about the patient's pain level by measuring the patient's brain waves; And
Including the step of transmitting the generated pain level information to the server,
The patient's pain level information is information generated by an electronic loupe device worn by the patient measuring the patient's brain waves,
The recorded image is an image in which an image of the patient's affected part acquired by the camera unit is stored,
When the pain level information generated by the electronic loupe device worn by the patient exceeds a threshold, a signal indicating insufficient anesthesia is transmitted to the server. A computer-readable recording medium storing a program for executing the method of claim 16 or 17 on a computer.

Images