KR101442953B1 - Method for providing gui for apparatus of tracking diagnosis site, and computer readable recording medium recording program for implementing the method - Google Patents

Abstract

The diagnostic position tracking apparatus according to an embodiment of the present invention includes a photographing unit for photographing a face image of a patient or photographing a marker attached to a diagnostic device for observing a lesion portion, A control unit for processing the input unit, the thermographed image or the marker image and extracting a positional relationship between the feature point of the face image and the marker, a feature point of the face image, a positional relationship of the marker, And a graphic user interface for displaying at least one of a frame for inputting the patient information, a frame for receiving the setting information, a frame for outputting the facial image, and a frame for outputting the marker image, (Graphic User Interface, GUI).

Description

TECHNICAL FIELD [0001] The present invention relates to a GUI providing method for driving a diagnostic position tracking apparatus, and a computer readable recording medium storing a program for executing the method on a computer. BACKGROUND OF THE INVENTION 1. Field of the Invention < RTI ID = THE METHOD}

Field of the Invention [0002] The present invention relates to a medical apparatus, and more particularly, to a method of providing a GUI for driving a medical diagnostic position tracking apparatus and a computer readable recording medium recording a program for executing the method in a computer.

If the skin or scalp is treated or operated, it is necessary to follow the site. However, the treatment or the surgical site of the skin or scalp is small in size, and it is not easy to find its position.

Generally, tattoo markings are applied to the treatment or surgical site for the purpose of follow-up, but this method may cause discomfort and inconvenience to the patient, and the mark may be erased.

Accordingly, there is a need for a method for accurately detecting the treatment or the surgical site of the skin or scalp in a short period of time.

SUMMARY OF THE INVENTION The present invention is directed to a method for providing a GUI for driving a medical diagnostic location tracking apparatus and a computer readable recording medium for recording a program for executing the method in a computer.

The diagnostic position tracking apparatus according to an embodiment of the present invention includes a photographing unit for photographing a face image of a patient or photographing a marker attached to a diagnostic device for observing a lesion portion, A control unit for processing a face image, an input unit, a face image or a marker image, extracting a positional relationship between the feature point of the face image and the marker, a feature point of the face image, a positional relationship of the marker, And a graphic user interface for displaying at least one of a frame for inputting the patient information, a frame for receiving the setting information, a frame for outputting the facial image, and a frame for outputting the marker image, (Graphic User Interface, GUI).

The frame for receiving the setting information may provide a GUI for selecting one of an initial mode for registering the position of the affected part and a tracking observation mode for tracking the affected part.

In the initial mode, a frame for outputting the face photographing image displays a feature point of the face photographing image together with the face photographing image, and a frame for outputting the marker photographing image, together with the marker photographing image, Can be displayed.

In the tracking mode, a frame for outputting the facial imaged image displays minutiae points of the facial imaged image registered in advance in the initial mode, and a frame for outputting the marker photographic image is displayed in the initial mode The position and direction of the marker registered in advance can be displayed.

Wherein the frame for receiving the setting information includes an automatic detection mode for automatically detecting a feature point from the facial imaged image or a marker from the marker imaged image and a feature point from the facial imaged image or a marker from the marker imaged image manually And a manual detection mode for detecting a manual detection mode.

The frame for receiving the setting information may provide a GUI for simultaneously controlling the minutiae and the method of detecting the marker.

The frame for receiving the setting information may provide a GUI for controlling the feature point and the method of detecting the marker by a separate frame.

The frame for receiving the setting information may provide a GUI for inputting the minutiae and a set value for detecting the marker.

The output unit may further include a GUI for displaying a frame for outputting the facial image and a screen switching frame for changing a position of a frame for outputting the marker photographing image.

A method for providing a graphical user interface (GUI) of a diagnostic location tracking apparatus according to an embodiment of the present invention includes a frame for receiving patient information, a frame for receiving setting information, Providing a graphical user interface (GUI) for displaying at least one of a frame for outputting a marker image of a marker attached to a diagnostic device for observing a lesion, and a frame for outputting a marker image of the marker, Receiving the patient information and the setting information through a frame for inputting the setting information and a frame for receiving the setting information, a frame for outputting the face image, and a frame for outputting the marker image, A face photographing image and a marker photographing image, And displaying the feature points of the facial imaged image and the position and direction of the marker through a frame for outputting the facial imaged image and a frame for outputting the imaged marker image.

The method may further include providing a GUI for displaying a frame for outputting the facial imaged image and a frame switching frame for changing the position of a frame for outputting the marker photographing image.

According to the embodiment of the present invention, it is possible to obtain a diagnostic position tracking device which can quickly find out the treatment or the surgical site of the skin or the scalp accurately and quickly. In particular, after storing the positional relationship between the feature point of the face and the affected part in advance, it is not necessary to mark the tattoo on the affected part by retrieving the stored information at the time of the follow-up observation. In addition, a GUI may be provided on the screen so that the operator can easily operate it.

1 is a block diagram illustrating a diagnostic location tracking device in accordance with an embodiment of the present invention.
FIG. 2 illustrates a GUI provided through a screen of a diagnostic location tracking device according to an embodiment of the present invention.
3 is a flow diagram illustrating a method for a diagnostic location tracking device to provide a GUI in accordance with an embodiment of the present invention.
4 to 7 show a GUI of a screen provided by the diagnostic position tracking device according to an embodiment of the present invention.

The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated and described in the drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

The terms including ordinal, such as second, first, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the second component may be referred to as a first component, and similarly, the first component may also be referred to as a second component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings, wherein like or corresponding elements are denoted by the same reference numerals, and redundant description thereof will be omitted.

The diagnostic location tracking device according to an embodiment of the present invention tracks the treatment or operation site of the skin or scalp (hereinafter, it can be mixed with the affected area or diagnostic site) based on the feature points of the face. To do this, the face image of the patient is taken during treatment or surgery, the feature points are extracted from the facial images, and the positional relationship between the feature points and the lesion is stored in advance. At this time, the positional relationship between the minutiae and the lesion part can be defined according to the position and direction of the marker attached to the diagnostic device for photographing the minutiae and the affected part.

When the affected part is followed up after a predetermined period of time from the treatment or surgery, the diagnostic position tracking device photographs the face image of the patient and the marker attached to the diagnostic device. The face image and the marker image are stored in advance, By matching the relationship, the diagnostic location can be tracked.

The diagnostic location tracking device according to an embodiment of the present invention provides a graphical user interface (GUI) on the screen for the convenience of the operator.

1 is a block diagram illustrating a diagnostic location tracking device in accordance with an embodiment of the present invention.

1, the diagnostic position tracking apparatus 100 includes a photographing unit 110, an input unit 120, a control unit 130, a storage unit 140, and an output unit 150.

The photographing unit 110 includes at least one camera. The photographing unit 110 can photograph a face of the patient using at least one camera or photograph a marker attached to the diagnostic apparatus. Here, the diagnostic device may include a separate camera for observing the affected part. And, the marker can be attached to a predetermined position of the surface of the diagnostic device to indicate whether or not the diagnostic device is accurately positioned on the affected part.

The input unit 120 receives user information, setting information, and the like from the operator, and transmits the user information and the setting information to the controller 130.

The control unit 130 controls the overall operation of the diagnostic position tracking apparatus 100. [ For example, the control unit 130 may process the image photographed by the photographing unit 110 or may process the information input from the input unit 120. For example,

The storage unit 140 stores a program for processing and control in the control unit 130 and stores the image photographed by the photographing unit 110 and the information input from the input unit 120 and the signal processed by the control unit 130 And so on.

The output unit 150 provides a graphical user interface (GUI) for displaying various kinds of information on a screen in a graphic or text format.

FIG. 2 illustrates a GUI provided through a screen of a diagnostic location tracking device according to an embodiment of the present invention.

2, the screen of the diagnostic location tracking apparatus 100 includes a main frame 200, a subframe 210, a user information input frame 220, a mode input frame 230, a minutia detection setting frame 240, A marker detection setting frame 250, a start / stop / end setting frame 260, a screen switching frame 270, and the like. The position and size of each frame shown in Fig. 2 are merely illustrative, and can be variously modified or modified.

The main frame 200 and the sub-frame 210 display an image photographed by the photographing unit 110. The main frame 200 may be set larger than the sub frame 210 and the face image of the patient or the marker image may be output to the main frame 200 and the sub frame 210. For example, the main frame 200 outputs a photographed face image of a patient, and the subframe 210 outputs a marker photographed image.

The user information input frame 220 is a frame for receiving patient information (e.g., name, date of birth, ID).

The mode input frame 230 is a frame for receiving an initial mode for registering the position of the affected part or a tracking mode for tracking the affected part. For example, if the positional relationship between the feature point of the face and the affected part is to be stored in advance during treatment or surgery, the operator can select the initial mode, i.e., the first treatment mode. And, if the patient is to follow the lesion after treatment or surgery, the operator can select a follow-up mode, i.e., a treatment progress mode.

The minutia detection setting frame 240 is a frame for which a method of detecting minutiae points from the facial image is set. For example, the operator can set the automatic detection mode or the manual detection mode. In the case of the automatic detection mode, the diagnostic position tracking device 100 can automatically extract the feature points from the facial imaged images and display them on the screen. At this time, the operator can set the eye region detection size range, the nose region detection size range, and the like for the minutia point detection. In the case of the manual detection mode, the operator can directly designate the minutiae point from the photographed face image.

The marker detection setting frame 250 is a frame to which a method of detecting a marker attached to the diagnostic apparatus is set. For example, the operator can set the automatic detection mode or the manual detection mode. In the manual detection mode, the operator can adjust the binarization threshold required for marker detection through the slide bar or the numeric input box.

Although the minutia detection setting frame 240 and the marker detection setting frame 250 are illustrated as separate frames, they may be implemented as one frame. The feature points of the facial imaged image and the method of detecting the marker can be independently controlled by separate frames or simultaneously controlled by one frame.

The mode input frame 230, the minutiae detection setting frame 240, and the marker detection setting frame 250 are collectively referred to as a frame for receiving setting information.

The start / stop / end frame 260 is a frame for starting / stopping / ending the output of the image.

The screen switching frame 270 is a frame that is instructed to switch between the main frame 200 and the sub frame 210. For example, when a photographed face image is displayed through the main frame 200 and a marker photographed image is displayed through the subframe 210, when the operator instructs to switch the screen through the screen switching frame 270, The frame 200 may display a marker photographed image, and the subframe 210 may be switched to display a photographed image.

FIG. 3 is a flowchart illustrating a method of providing a GUI according to an exemplary embodiment of the present invention. FIGS. 4 to 7 are flowcharts illustrating a method of providing a GUI of a screen provided by the diagnostic position tracking apparatus according to an exemplary embodiment of the present invention, .

3 to 7, the diagnostic position tracking apparatus 100 includes a frame 220 for receiving patient information, frames 230 and 240 for receiving setting information, And a graphic user interface (GUI) for displaying a frame 210 for outputting a marker photographing image of a marker attached to a diagnostic device for observing the affected part ( S300).

The diagnostic position tracking apparatus 100 receives patient information and setting information through a frame 220 for receiving patient information from an operator and frames 230, 240 and 250 for receiving setting information (S310) . Here, the setting information may be information for selecting one of an initial mode for registering the position of the affected part and a tracking mode for tracking the affected part. The setting information includes an automatic detection mode for automatically detecting a marker from a feature point or a marker image and a manual detection mode for manually detecting a marker from a facial image or a marker image, As shown in FIG. When the operator selects the initial mode, the diagnostic position tracking apparatus 100 can activate the corresponding frame 240, 250 so that the operator can select the automatic detection mode or the manual detection mode.

When the operator inputs the patient information and the setting information and then clicks the start frame 260, the diagnostic position tracking apparatus 100 displays a frame 200 for outputting the photographed image and a frame 200 for outputting the marker photographed image 210 to output a facial image and a marker image (S320).

When the initial mode is set in step S310 (S330), the diagnostic position tracking apparatus 100 displays the feature points of the face and the positions and directions of the markers on the facial image and the marker image, respectively (S340). The feature points of the face can be, for example, eye tail, nostril, mouth tail, but are not limited thereto. The feature point of the face can be set by the operator. The position of the marker can be indicated by the area to which the center point of the marker belongs. The direction of the marker may mean the direction of a specific area of the marker. For example, when a marker includes a straight line formed colorless region, the direction can be indicated in the direction of the marker. At this time, the positions and directions of the feature points and / or the markers of the face can be detected automatically or manually. When the operator sets the automatic detection mode at step S310, the diagnostic position tracking apparatus 100 can automatically detect the marker from the feature point or the marker image from the facial image. When the operator sets the manual detection mode at step S310, the operator can manually display the position and direction of the marker from the feature point or the marker image from the facial image. 4 shows the feature point 401 and the position and direction of the marker 403 from the facial image automatically detected by the diagnostic position tracking device 100. [ 5 shows the feature point 501 and the position and direction of the marker 503 from the face image shot manually detected by the operator.

Thereafter, the diagnostic position tracking device 100 stores the positional relationship between the feature points of the face and the marker of each patient (S350). Here, the positional relationship between the feature point of the face and the marker may be a correlation between the feature point of the face, the position of the marker, and the direction of the marker. As shown in FIG. 6, when the positional relationship between the feature points of the patient and the marker is stored, a screen 601 indicating that patient information is registered can be output.

If the tracking position is set to the tracking mode in step S310, the diagnostic position tracking device 100 retrieves the location and direction of the feature points and markers of the per-user face stored in advance in step S350 and displays them on the screen in step S360. At this time, the error range may be reflected in the position and direction of the marker. FIG. 7 shows an example in which the feature points of the previously stored face and the positions and directions of the markers are displayed on the screen in the tracking observation mode.

The diagnostic position tracking device 100 adjusts the face of the patient according to the feature point of the face, and moves the diagnostic device to match the position and direction of the displayed marker to find the affected part (S370). The closer the position and direction of the marker attached to the diagnostic device is, that is, the position and direction of the previously stored marker, the more the diagnostic position tracking device 100 can output an identifiable sound.

Thus, the diagnostic position tracking device 100 simultaneously outputs the facial image and the scalp image, so that the operator can find the affected part according to the feature point of the face and the position and direction of the marker. In addition, the operator can easily track the affected part through the GUI such as the initial / tracking mode, automatic / manual detection mode, and screen switching.

The embodiments of the present invention described above are not implemented only by the apparatus and method, but may be implemented through a program for realizing the function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the following claims It can be understood that

Claims (12)

A photographing unit for photographing a face image of the woman or photographing a marker attached to a diagnostic device for observing a lesion,
An input unit for inputting patient information or setting information from an operator,
A controller for processing the facial imaged image or the marker imaged image and extracting the positional relationship between the feature point of the facial imaged image and the marker,
A storage unit for storing the feature points of the facial imaged image, the positional relationship of the markers, and the patient information,
A graphical user interface (GUI) for displaying a frame for receiving the patient information, a frame for inputting the setting information, a frame for outputting the face photographing image, and a frame for outputting the marker photographing image, ≪ / RTI >
Lt; / RTI >
Wherein the frame for receiving the setting information provides a GUI for selecting one of an initial mode for registering the position of the affected part and a tracking mode for tracking the affected part. delete The method according to claim 1,
In the initial mode,
Wherein the frame for outputting the photographed image displays feature points of the photographed image together with the photographed image,
Wherein the frame for outputting the marker photographing image displays the position and direction of the marker together with the marker photographing image. The method according to claim 1,
In the tracking mode,
Wherein the frame for outputting the face photographing image displays the feature points of the face photographing image registered in advance in the initial mode,
Wherein the frame for outputting the marker image displays the position and direction of the marker registered in advance in the initial mode. The method according to claim 1,
Wherein the frame for receiving the setting information includes an automatic detection mode for automatically detecting a feature point from the facial imaged image or a marker from the marker imaged image and a feature point from the facial imaged image or a marker from the marker imaged image manually And a manual detection mode for detecting the detected position of the object. 6. The method of claim 5,
Wherein the frame for receiving the setting information provides a GUI for simultaneously controlling the feature point and the method of detecting the marker. 6. The method of claim 5,
Wherein the frame for receiving the setting information provides a GUI for controlling the feature points and the method of detecting the markers by a separate frame. The method according to claim 1,
Wherein the frame for receiving the setting information provides a GUI for inputting the minutiae and a set value for detecting the marker. The method according to claim 1,
Wherein the output unit further comprises a GUI for displaying a frame for outputting the facial image and a frame for changing a position of a frame for outputting the marker photographing image. A method for providing a graphical user interface (GUI) of a diagnostic location tracking device,
A frame for receiving setting information including information for selecting one of a frame for receiving patient information, an initial mode for registering the position of the affected part, and a tracking observation mode for tracking the affected part, Providing a graphical user interface (GUI) for displaying a frame for outputting a marker photographed image of a marker attached to a diagnosing device that is well connected to the affected part,
Receiving the patient information and the setting information through a frame for receiving the patient information and a frame for receiving the setting information,
Outputting the face photographing image and the marker photographing image through a frame for outputting the face photographing image and a frame for outputting the marker photographing image, and
A step of displaying a feature point of the face photographing image and a position and a direction of the marker through a frame for outputting the face photographing image and a frame for outputting the marker photographing image
Gt; a < / RTI > GUI. 11. The method of claim 10,
Further comprising: providing a GUI for displaying a frame for outputting the face photographing image and a screen switching frame for changing a position of a frame for outputting the marker photographing image. A frame for receiving setting information including information for selecting one of a frame for receiving patient information, an initial mode for registering the position of the affected part, and a tracking observation mode for tracking the affected part, Providing a graphic user interface (GUI) for displaying at least one of a frame for outputting a marker image and a frame for outputting a marker photographing image of a marker attached to a diagnostic device for observing the affected part,
Receiving the patient information and the setting information through a frame for receiving the patient information and a frame for receiving the setting information,
Outputting the face photographing image and the marker photographing image through a frame for outputting the face photographing image and a frame for outputting the marker photographing image, and
A step of displaying a feature point of the face photographing image and a position and a direction of the marker through a frame for outputting the face photographing image and a frame for outputting the marker photographing image
A computer-readable recording medium storing a program for executing a method in a computer.

Images