WO2021177583A1

WO2021177583A1 - Medical procedure image display device

Info

Publication number: WO2021177583A1
Application number: PCT/KR2020/095032
Authority: WO
Inventors: 이근용
Original assignee: (주)이끌레오
Priority date: 2020-03-04
Filing date: 2020-03-12
Publication date: 2021-09-10
Also published as: KR20210112130A; KR20220167261A

Abstract

Disclosed is a medical procedure image display device according to some embodiments of the present disclosure. The medical procedure image display device may comprise: an image capturing unit which obtains an image including a medical procedure device and a medical procedure site of a patient; a control unit which analyzes the image to recognize, within the medical procedure site, a first area where a medical procedure has been completed and a second area where the medical procedure has not been completed; and a display unit which differently displays the first area and the second area on the image.

Description

Treatment image display device

The present disclosure relates to an apparatus for displaying a procedure image, and more particularly, to an apparatus for displaying a procedure image.

In recent years, a technique related to an ultrasonic wave generating device is known that uses ultrasonic waves generated through the ultrasonic wave generating device to achieve treatment for skin care and treatment purposes.

In this case, the area to which the ultrasound generated by the ultrasound generating device is irradiated may be rather narrow compared to the affected part of the patient. Therefore, the user (doctor or operator) had to distinguish between a region irradiated with ultrasound and a region not irradiated with ultrasound depending on the senses during ultrasound treatment.

However, when the procedure is performed in this way, a region to which ultrasonic waves are repeatedly irradiated may occur, or a region to which ultrasonic waves are not irradiated may occur. If ultrasonic waves are repeatedly irradiated to the same area, problems such as excessive ultrasonic waves being irradiated to the affected part of the patient may result in burns. In addition, when a region not irradiated with ultrasound is generated, the effect of the procedure may be reduced.

Meanwhile, some users mark a region irradiated with ultrasound with a pen. However, since cleaning of the treatment site is required after the treatment is completed, this method may cause inconvenience.

Therefore, there is a need to develop a technology capable of distinguishing between a site on which a medical treatment is performed and a site on which the treatment is not performed on the affected part of the patient.

The present disclosure has been devised in response to the above-described background technology, and an object of the present disclosure is to provide a device for displaying a surgical image that can distinguish a region where a user has performed a medical procedure from a region where the procedure has not been performed.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

The present disclosure has been devised in response to the above-described background technology, and an object of the present disclosure is to provide an apparatus for displaying a surgical image. The treatment image display device may include: a photographing unit configured to acquire an image including a treatment device and a treatment site of a patient; a control unit that analyzes the image and recognizes a first area in which the treatment is completed and a second area in which the treatment is not completed within the treatment area; and a display unit configured to display the first area and the second area differently on the image. may include.

In addition, a user input unit for receiving information about the treatment site; The method may further include, and the controller may recognize the treatment site in the image by using the treatment area information.

Also, the controller may control the sound output unit to output a preset first sound when it is recognized that the treatment device is located outside the treatment area by analyzing the image.

Also, the controller may analyze the image to recognize location information on the location of the treatment device, and recognize the first area and the second area based on the location information and the treatment area information.

Also, the controller may control the sound output unit to output a preset second sound when it is recognized that the surgical device exists on the first region by analyzing the image.

In addition, the treatment device may include a High Intensity Focused Ultrasonic device, an Ultrasonic Probe, or a medical injector.

In addition, when the treatment device is a treatment device electrically connected to the treatment image display device, the controller monitors an energy generation signal generated by the treatment device, and a region in which the treatment device is located at the time when the energy generation signal is generated can be recognized as the first region.

In addition, the photographing unit acquires at least one image information about the treatment site by photographing at least one of an axial plane, a sagittal plane, and a coronal plane of the treatment site, and the image is, It may be a stereoscopic image generated by the at least one piece of image information.

In addition, as a computer program stored in a computer-readable storage medium, the computer program includes instructions for causing the control unit of the procedure image display device to perform the following steps, wherein the steps are: acquiring an image including a region; analyzing the image to recognize a first area in which the treatment is completed and a second area in which the treatment is not completed within the treatment area; and controlling the display unit to display the first area and the second area differently on the image. may include.

In addition, recognizing the treatment site in the image using the treatment area information received from the user through the user input unit; may further include.

In addition, when analyzing the image and recognizing that the treatment device is located outside the treatment area, controlling the sound output unit to output a preset first sound; may further include.

In addition, the step of analyzing the image and recognizing the first area where the treatment is completed and the second area where the treatment is not completed within the treatment site may include analyzing the image to recognize location information on the location of the treatment device. to do; and recognizing the first region and the second region based on the location information and the treatment region information. may further include.

In addition, when analyzing the image and recognizing that the treatment device exists on the first area, controlling the sound output unit to output a preset second sound; may further include.

In addition, the step of analyzing the image and recognizing the first area in which the treatment is completed and the second area in which the treatment is not completed within the treatment area includes the treatment device being a treatment device electrically connected to the treatment image display device. case, monitoring the energy generation signal generated by the treatment device; and recognizing a region in which the surgical device is located as the first region when the energy generation signal is generated. may include.

In addition, the step of acquiring an image including the treatment device and the patient's treatment site through the photographing unit includes at least one of an axial plane, a sagittal plane, and a coronal plane of the treatment site through the photographing unit. acquiring at least one image information about the treatment site by photographing; and, the image may be a stereoscopic image generated by the at least one piece of image information.

The technical solutions obtainable in the present disclosure are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the art to which the present disclosure belongs from the description below. can be understood

According to some embodiments of the present disclosure, a user may easily recognize an area in which the treatment is completed and an area in which the treatment is not completed.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. .

Various aspects are now described with reference to the drawings, in which like reference numbers are used to refer to like elements collectively. In the following examples, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. It will be evident, however, that such aspect(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more aspects.

1 is a view for explaining an example of a treatment image display device according to some embodiments of the present disclosure.

2 is a block diagram illustrating an example of an apparatus for displaying a procedure image according to some embodiments of the present disclosure.

3 is a view for explaining an example of a method for a controller to recognize a region in which a treatment device is located, according to some embodiments of the present disclosure.

4 is a diagram for describing an example of a method in which a control unit displays a first area and a second area differently according to some embodiments of the present disclosure;

5 is a flowchart illustrating an example of a method in which the controller of the apparatus for displaying a procedure image according to some embodiments of the present disclosure controls the display unit to display a first area and a second area differently.

6 is a flowchart illustrating an example of a method in which a controller of a treatment image display apparatus recognizes a first area and a second area according to some embodiments of the present disclosure.

7 is a flowchart illustrating another example of a method in which a controller of a treatment image display apparatus recognizes a first area according to some embodiments of the present disclosure.

8 depicts a general schematic diagram of an exemplary computing environment in which embodiments of the present disclosure may be implemented.

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be appreciated by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of the various methods in principles of various aspects may be employed, and the descriptions set forth are intended to include all such aspects and their equivalents. Specifically, as used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. is not to be construed as an advantage or advantage of any aspect or design described over other aspects or designs. It may not be.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of reference numerals, and overlapping descriptions thereof will be omitted. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical ideas disclosed in the present specification are not limited by the accompanying drawings.

Although first, second, etc. are used to describe various elements or elements, these elements or elements are not limited by these terms, of course. These terms are only used to distinguish one element or component from another. Accordingly, it goes without saying that the first element or component mentioned below may be the second element or component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from context, "X employs A or B" is intended to mean one of the natural implicit substitutions. That is, X employs A; X employs B; or when X employs both A and B, "X employs A or B" may apply to either of these cases. It should also be understood that the term “and/or” as used herein refers to and includes all possible combinations of one or more of the listed related items.

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. should be understood as not Also, unless otherwise specified or unless the context is clear as to designating a singular form, the singular in the specification and claims should generally be construed to mean "one or more."

In addition, as used herein, the terms “information” and “data” may often be used interchangeably.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

The suffixes "module" and "part" for the components used in the following description are given or used in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves.

Objects and effects of the present disclosure, and technical configurations for achieving them will become clear with reference to the embodiments described below in detail in conjunction with the accompanying drawings. In describing the present disclosure, if it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the subject matter of the present disclosure, the detailed description thereof will be omitted. In addition, the terms to be described later are terms defined in consideration of functions in the present disclosure, which may vary according to intentions or customs of users and operators.

However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. Only the present embodiments are provided so that the present disclosure is complete, and to fully inform those of ordinary skill in the art to which the present disclosure belongs, the scope of the disclosure, and the present disclosure is only defined by the scope of the claims . Therefore, the definition should be made based on the content throughout this specification.

In the present disclosure, the apparatus for displaying a procedure image may provide an image in which a first area in which the treatment is completed and a second area in which the treatment is not completed are divided for the affected part of the patient. Here, the treatment may be an ultrasound treatment using a High Intensity Focused Ultrasonic device, an ultrasound treatment using an ultrasound probe, or a treatment using a medical syringe. That is, the treatment image display apparatus may display the first area in which the treatment is completed and the second area in which the treatment is not completed for all medical treatments or treatments separately. Hereinafter, a procedure image display device according to the present disclosure will be described with reference to FIGS. 1 to 8 .

In the present disclosure, the treatment image display apparatus 1000 is controlled by the treatment apparatus 3000a according to a user's manipulation (eg, a user input for adjusting ultrasound intensity, etc.) as shown in FIG. 1A . It may be a device that may transmit a signal (eg, a signal for changing an ultrasound intensity, etc.) or may capture an image related to a procedure and provide it to the user. That is, the user may set a setting value of the treatment apparatus 3000a by using the treatment image display apparatus 1000 or may check an image related to the treatment.

Meanwhile, the treatment image display apparatus 1000 may include a photographing unit 1100 and a display unit 1300 . In this case, the treatment image display apparatus 1000 may acquire an image including the treatment apparatus 3000 and the treatment area of the patient through the photographing unit 1100 . In addition, the treatment image display apparatus 1000 may analyze the image and display the first area in which the treatment is completed and the second area in which the treatment is not completed differently on the display unit 1300 . Hereinafter, a method in which the procedure image display apparatus 1000 displays the first region and the second region differently on an image will be described later with reference to FIGS. 3 to 7 .

Meanwhile, according to some other exemplary embodiments of the present disclosure, the apparatus for displaying a procedure image 1000 may be a device for capturing an image related to a procedure as shown in FIG. 1B and providing it to the user. Here, the user may change the setting value of the treatment device 3000b by using the treatment device controller 3100 electrically connected to the treatment image display device 1000 . In addition, the user may check the treatment image using the treatment image display device 1000 . That is, the treatment image display apparatus 1000 illustrated in FIG. 1B cannot provide a control signal to the treatment apparatus 3000b unlike the treatment image display apparatus described above with reference to FIG. 1A.

Here, the treatment image display device 1000 includes a desktop computer, a digital signage, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), and a portable multimedia player (PMP). , navigation, slate PC, tablet PC, ultrabook, wearable device, for example, watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD ( head mounted display), etc. may be included.

Meanwhile, the image photographed by the photographing unit 1100 of the operation image display apparatus 1000 of FIGS. Here, the surgical device 3000 included in the image may be an extracorporeal shock wave therapy device capable of treating an affected part of a patient by irradiating ultrasonic waves to generate a shock wave outside the body according to a user's manipulation. As another example, the surgical device 3000a may be a high-intensity focused ultrasound device capable of generating a skin cosmetic effect by irradiating high-intensity focused ultrasound to an affected part of a patient. As another example, the surgical device 3000a may be an ultrasonic probe that transmits ultrasonic waves in a specific wavelength band to generate a thermal action, thereby enabling local deformation. However, the present invention is not limited thereto.

Meanwhile, the treatment image display apparatus 1000 of FIGS. 1A and 1B may be electrically connected to the treatment apparatus 3000 or the treatment apparatus controller 3100 . In this case, the treatment image display apparatus 1000 may monitor the energy generation signal generated by the treatment apparatus 3000 . In addition, the controller of the treatment image display apparatus 1000 may recognize a region in which the treatment apparatus 3000 is located, based on the time when the energy generation signal is generated. Hereinafter, a method for the treatment image display apparatus 1000 to recognize the position of the treatment apparatus 3000 will be described later with reference to FIG. 7 .

On the other hand, according to some other exemplary embodiments of the present disclosure, the treatment image display apparatus 1000 captures an image related to the treatment apparatus 3000c that is not physically or electrically connected as shown in FIG. 1(c) and provides it to the user. It may be a device that For example, the surgical device 3000c may be a medical syringe or other medical tool. In this case, since the treatment image display device 1000 does not generate a signal such as an energy generation signal from the treatment device 3000c, it analyzes the image acquired through the photographing unit 1100 and location can be recognized. However, the present invention is not limited thereto.

According to the above configuration, the treatment image display device 1000 analyzes the image obtained through the photographing unit 1100 regardless of the type of the treatment device 3000 to determine the first area where the treatment is completed and the first area where the treatment is not completed. 2 areas can be recognized. In addition, the treatment image display apparatus 1000 may display the first area and the second area differently through the display unit 1300 . Therefore, the user can conveniently perform the procedure on the affected part of the patient by using the procedure image display device 1000 irrespective of the type of procedure.

Meanwhile, according to some embodiments of the present disclosure, the apparatus for displaying a surgical image 1000 may further include components that can provide convenience to the user. Hereinafter, components constituting the treatment image display apparatus 1000 will be described with reference to FIG. 2 .

Referring to FIG. 2 , the treatment image display apparatus 1000 may include a photographing unit 1100 , a control unit 1200 , a display unit 1300 , a user input unit 1400 , and a sound output unit 1500 . However, since the above-described components are not essential in implementing the procedure image display apparatus 1000 , the procedure image display apparatus 1000 may have more or fewer components than those listed above. Here, each component may be configured as a separate chip, module, or device, or may be included in one device.

The photographing unit 1100 may include a treatment device and at least one camera capable of capturing an image including a treatment area of a patient. Here, the surgical device 3000 may include a High Intensity Focused Ultrasonic device, an Ultrasonic Probe, or a medical injector. However, the present invention is not limited thereto.

Meanwhile, the photographing unit 1100 may be connected to the operation image display apparatus 1000 by wire. In addition, the photographing unit 1100 may transmit an image including the treatment device 3000 and the treatment site of the patient to the treatment image display apparatus 1000 .

Meanwhile, according to some other exemplary embodiments of the present disclosure, the photographing unit 1100 may transmit the photographed image to the procedure image display apparatus 1000 through wireless communication.

For example, the photographing unit 1100 may include a wireless LAN (WLAN), a wireless-fidelity (Wi-Fi), a wireless fidelity (Wi-Fi) Direct, a Digital Living Network Alliance (DLNA), a Wireless Broadband (WiBro), and a WiMAX (Wireless Broadband). The image may be transmitted to the treatment image display device 1000 through World Interoperability for Microwave Access, or the like. However, the present invention is not limited thereto, and the photographing unit 1110 displays an image photographed using a wireless transmission technology used for short-range communication, such as infrared (IrDA) or Bluetooth (Bluetooth), the operation image display device 1000 ) can also be sent to

The controller 1200 may typically process the overall operation of the treatment image display apparatus 1000 . The control unit 1200 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the user input unit 1400 or driving an application program stored in the storage unit.

In the present disclosure, the controller 1200 may analyze an image acquired through the photographing unit 1100 to recognize a first area in which the treatment is completed and a second area in which the treatment is not completed.

For example, when the controller 1200 analyzes the image and recognizes that the treatment apparatus 3000 stays in a specific area for more than a preset time within the treatment site, the control unit 1200 may recognize the specific area as the first area where the treatment is completed. .

As another example, when the controller of the treatment image display device 1000 analyzes the image and recognizes that the treatment device 3000 has stayed in a specific area for more than a preset time within the treatment site, the control unit of the treatment image displays the first treatment completed in the specific area. area can be recognized. In addition, the controller 1200 may recognize an area other than the first area within the treatment site as the second area. However, the present invention is not limited thereto.

Here, the preset time may be pre-stored in a storage unit (not shown). However, the present invention is not limited thereto. Hereinafter, a method for the controller of the treatment image display apparatus 1000 to recognize the first region and the second region will be described later with reference to FIG. 5 .

Meanwhile, the display unit 1300 may display (output) information (or at least one content) processed by the treatment image display apparatus 1000 . For example, the display unit 1300 may include information on an execution screen of an application program driven in the treatment image display device 1000, a user interface (UI), graphic user interface (GUI) information, or a photographing unit ( 1100) may be displayed.

Meanwhile, according to some embodiments of the present disclosure, an image displayed on the display unit 1300 may be a stereoscopic image.

Specifically, the photographing unit 1100 captures at least one of an axial plane, a sagittal plane, and a coronal plane of the treatment site through at least one camera to obtain at least one image information about the treatment site. can be obtained In addition, the controller 1200 may generate a stereoscopic image through at least one piece of image information. However, the present invention is not limited thereto.

The display unit 1300 may differently display the first region and the second region included in the image under the control of the controller 1200 .

For example, the display unit 1300 may display the first area in a preset color (eg, red). In addition, the display unit 1300 may display the second area in a color different from that of the first area. However, the present invention is not limited thereto, and the display unit 1300 may display only the border of the second region and no display inside.

Meanwhile, according to some embodiments of the present disclosure, the second area may be an area divided into a plurality of areas.

Specifically, the control unit 1200 of the treatment image display apparatus 1000 may acquire an image of the treatment site of the patient through the photographing unit 1100 before the user performs the treatment through the treatment apparatus 3000 . In this case, since the treatment device 3000 is not included in the image, the controller may recognize that all treatment areas of the patient are the second area. In addition, the controller may control the display unit 1300 so that the second area is divided into a plurality of areas and displayed. In this way, when the second region is divided into a plurality of regions and displayed, the user can more clearly recognize a region to be treated. However, the present invention is not limited thereto.

The user input unit 1400 is for receiving information from the user, and when information is input through the user input unit 1400 , the control unit 1200 controls the operation of the operation image display apparatus 1000 to correspond to the input information. can The user input unit 1400 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the surgical image display device 1000, a dome switch, a jog). wheel, jog switch, etc.), touch input means, keyboard and mouse, and the like.

In the present disclosure, the user input unit 1400 may receive treatment site information from the user. In this case, the controller 1200 of the treatment image display apparatus 1000 may recognize the treatment site in the image by using the treatment area information.

For example, the image obtained by the control unit 1200 through the photographing unit 1100 may include a site other than the treatment site of the patient. For example, information on the treatment area input through the user input unit 1400 may include information that the area to be treated with the patient is the face. On the other hand, the image acquired through the photographing unit 1100 may include a neck, an ear, etc. in addition to the face. In this case, the controller 1200 may recognize the face as the treatment site in the image by using the treatment site information received through the user input unit 1400 . However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the control unit 1200 of the treatment image display apparatus 1000 analyzes the image obtained through the photographing unit 1100 to recognize location information on the location of the treatment apparatus 3000 . can do. Also, the controller 1200 may recognize the first region and the second region based on the location information and the treatment site information input through the user input unit 1400 . Hereinafter, a method for the controller 1200 to recognize the first region and the second region by using the treatment site information will be described later with reference to FIG. 6 .

Meanwhile, the sound output unit 1500 may output a sound signal related to a function performed by the treatment image display apparatus 1000 . The sound output unit 1500 may include a receiver, a speaker, a buzzer, and the like. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the controller 1200 of the treatment image display apparatus 1000 may control the sound output unit 1500 to output a sound based on the position of the treatment apparatus 3000 .

For example, the controller 1200 may control the sound output unit 1500 to output a preset first sound when it is recognized that the treatment apparatus 3000 is located outside the treatment site by analyzing the image. That is, the controller 1200 may control the sound output unit 1500 to output a first sound that can give attention to the user when the user is performing a procedure on a non-affected part of the patient. Here, the preset first sound may be pre-stored in the storage unit. However, the present invention is not limited thereto.

As another example, the controller 1200 may control the sound output unit 1500 to output a preset second sound when it is recognized that the treatment apparatus 3000 exists on the first area where the treatment is completed by analyzing the image. can That is, the controller 1200 may control the sound output unit 1500 to output a second sound that can give attention to the user when the user performs a treatment on a site where the treatment has already been completed. However, the present invention is not limited thereto.

According to the above configuration, the control unit 1200 of the treatment image display apparatus 1000 may recognize the treatment site, the first area, and the second area of the patient. In addition, the control unit 1200 is preset through the sound output unit 1500 so as to draw the user's attention when the user performs a procedure on a site other than the treatment site or overlaps the area where the treatment has been performed. It can output sound.

Meanwhile, in the present disclosure, the controller 1200 of the treatment image display apparatus 1000 may recognize a region in which the treatment apparatus 3000 is located in the treatment area of the patient. Hereinafter, a method for the controller 1200 to recognize the region in which the treatment device 3000 is located will be described with reference to FIG. 3 .

Referring to FIG. 3 , the treatment device 3000 may be located in one region of the treatment site of the patient. In this case, the controller 1200 may acquire an image including the treatment device 3000 and the treatment area of the patient through the photographing unit 1100 . In addition, when recognizing that the treatment apparatus 3000 is located in one area for more than a preset time, the controller 1200 may recognize the one area as the first area 100 in which the treatment has been completed. However, the present invention is not limited thereto.

For example, when the treatment device 3000 is the treatment device 3000 electrically connected to the treatment image display device 1000 , the controller 1200 may monitor an energy generation signal generated by the treatment device 3000 . Also, the controller 1200 may recognize the region in which the treatment apparatus 3000 is located as the first region 100 at the time when the energy generation signal is generated.

Meanwhile, the controller 1200 may recognize the second region 200 before recognizing the first region 100 .

Specifically, when information on the treatment area is input through the user input unit 1400 , the controller 1200 may recognize the treatment site in the image based on the treatment area input information. In addition, the controller 1200 may recognize the entire area of the treatment area as the second area 200 . In this case, the controller 1200 may display the entire area of the treatment area as the second area 200 . However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the controller 1200 of the treatment image display apparatus 1000 outputs a preset first sound when recognizing that the treatment apparatus 3000 is located outside the treatment site. The sound output unit 1500 may be controlled.

For example, the treatment site may be a region other than the nose, eyes, mouth, and ears. Then, when the controller 1200 recognizes that the treatment device 3000 is located outside the treatment site, that is, the eye, nose, mouth, or ear, the control unit 1200 may control the sound output unit 1500 to output a preset first sound. can

However, the present invention is not limited thereto, and when the controller 1200 analyzes the image and recognizes that the treatment device 3000 is located outside the treatment site, it sends a signal to stop the treatment to the treatment device 3000 or the treatment device controller. It may be transmitted to (3100).

Meanwhile, according to some embodiments of the present disclosure, when the controller 1200 of the treatment image display apparatus 1000 recognizes that the treatment apparatus 3000 exists on the first area 100 , the controller 1200 generates a preset second sound. It is also possible to control the sound output unit 1500 to output.

As an example, the controller 1200 may control the sound output unit 1500 to output a preset second sound when it is recognized that the surgical device 3000 exists on the first region 100 by analyzing the image. have.

As another example, the controller 1200 monitors an energy generation signal generated by the treatment device 3000 and outputs a preset second sound when recognizing that the treatment device 3000 exists on the first area 100 . The sound output unit 1500 may be controlled to do so.

As another example, when the controller 1200 analyzes the image and recognizes that the treatment device 3000 is present on the first region 100, the controller 1200 sends a signal to stop the treatment to the treatment device 3000 or the treatment device controller ( 3100) may be transmitted.

Referring to FIG. 4 , the first region 100 and the second region 200 may be displayed differently in the image being displayed by the controller 1200 of the treatment image display device 1000 through the display unit 1300 . .

For example, the display 130a may display the first area 100 in a preset color. Also, the display unit 1300 may display the second area 200 in a color different from that of the first area 100 . However, the present invention is not limited thereto, and the display unit 1300 may display only the edge of the second region 200 and may not display any inside.

Meanwhile, according to some embodiments of the present disclosure, the controller 1200 may change the color of the first area 100 based on the time the treatment apparatus 3000 stays in the specific area within the treatment site.

Specifically, the control unit 1200 of the treatment image display apparatus 1000 may recognize the time at which the treatment apparatus 3000 is located in the treatment site. In addition, when recognizing that the treatment apparatus 3000 stayed within the first time within the treatment site, the controller 1200 may display the first area 100 in orange. Also, when recognizing that the treatment apparatus 3000 has stayed for more than the first time, the controller 1200 may display the first area 100 in red. However, the method in which the control unit 1200 changes the first region 100 is not limited thereto.

Accordingly, in a procedure in which ultrasound is irradiated to the affected part of a patient for a certain period of time or more, such as an ultrasound procedure, the user may recognize whether the procedure has been performed for a sufficient time for the effect of the procedure to appear. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the controller 1200 of the treatment image display apparatus 1000 controls the sound output unit 1500 to output a preset third sound when the treatment on the entire treatment area is completed. You may.

Specifically, the controller 1200 may recognize whether the user has completed the treatment for the entire treatment area. In addition, when recognizing that the treatment for the entire treatment area has been completed, the controller 1200 may control the sound output unit 1500 to output a preset third sound. Accordingly, the user can easily recognize whether the procedure has been completed.

Meanwhile, according to some other exemplary embodiments of the present disclosure, the controller 1200 of the treatment image display apparatus 1000 outputs a preset fourth sound when the treatment on the entire treatment area is not completed before the power is turned off. The output unit 1500 may be controlled.

Specifically, when an input for terminating the power of the treatment apparatus 3000 is input, the controller 1200 may recognize whether the treatment for the entire treatment area has been completed. In addition, when the controller 1200 recognizes that the treatment on the entire treatment area is not completed (eg, when the second region 200 exists in the image), the control unit 1200 outputs a preset fourth sound to the sound output unit. (1500) may be controlled. However, the present invention is not limited thereto.

On the other hand, according to some embodiments of the present disclosure, the controller 1200 of the treatment image display apparatus 1000 may highlight at least a partial area of the second area 200 .

Specifically, when an input for terminating the power of the treatment apparatus 3000 is input, the controller 1200 may recognize whether the treatment for the entire treatment area has been completed. Then, when recognizing that the treatment on the entire treatment area is not completed (eg, when the second area 200 exists in the image), the controller 1200 displays a highlight on the second area 200 . The display unit 1300 may be controlled to do so. However, the present invention is not limited thereto, and the controller 1200 may perform a highlight display on the second region 200 in which the treatment is not completed in conjunction with outputting the third sound.

According to the above configuration, the controller 1200 of the treatment image display apparatus 1000 may display the first region 100 and the second region 200 differently in the image. Accordingly, the user can easily distinguish the area where the treatment is completed and the area where the treatment is not completed.

Meanwhile, in the present disclosure, an example of a method in which the controller 1200 displays the first region 100 and the second region 200 differently will be described with reference to FIG. 5 .

Referring to FIG. 5 , the control unit 1200 of the treatment image display apparatus 1000 may acquire an image including the treatment apparatus 3000 and the treatment area of the patient through the photographing unit 1100 ( S110 ).

In this case, the controller 1200 may acquire at least one image information including an axial plane, a sagittal plane, and a coronal plane through at least one camera included in the photographing unit 1100 . Also, the controller 1200 may generate a stereoscopic image based on at least one piece of image information. However, the present invention is not limited thereto.

Meanwhile, the controller 1200 of the treatment image display apparatus 1000 may analyze the image to recognize the first area 100 where the treatment is completed and the second area 200 where the treatment is not completed within the treatment area ( S120).

For example, if the controller 1200 recognizes that the treatment apparatus 3000 is located in at least a partial area of the second area 200 for more than a preset time, the at least some area is the first area 100 in which the treatment is completed. can recognize However, the present invention is not limited thereto.

Meanwhile, the controller 1200 of the treatment image display apparatus 1000 may control the display unit 1300 to display the first region 100 and the second region 200 differently on the image (S130).

For example, the control unit 1200 may display the first area 100 by shading through the display unit 1300 , and may display only the border of the second area 200 . However, the present invention is not limited thereto.

Referring to FIG. 6 , the controller 1200 of the treatment image display apparatus 1000 may analyze the image to recognize location information on the location of the treatment apparatus 3000 ( S200 ).

For example, the controller 1200 may analyze the image to recognize location information indicating that the treatment apparatus 3000 is located on at least a portion of the user's face. However, the present invention is not limited thereto.

On the other hand, according to some embodiments of the present disclosure, the control unit 1200 of the treatment image display device 1000 before or after recognizing the location information of the treatment device 3000, the user through the user input unit 1400 You can input part information.

In addition, the controller 1200 of the treatment image display apparatus 1000 may recognize the first area 100 and the second area 200 based on the location information and the treatment site information (S210).

For example, the controller 1200 may recognize the area in which the treatment apparatus 3000 is located as the first area 100 based on the location information. Also, based on the location information, the controller 1200 may recognize that an area in which the treatment apparatus 3000 has stayed for more than a preset time is also the first area 100 . In addition, the controller 1200 may recognize that the area other than the first area 100 is the second area 200 .

Meanwhile, when the controller 1200 analyzes the image captured by the photographing unit 1100 and recognizes that the surgical device 3000 has passed through at least some of the portions recognized as the second area 200 (or the When it is recognized that the treatment apparatus 3000 stayed on at least a partial area for more than a preset time), the at least partial area is changed from the second area 200 in which the treatment is not completed to the first area 100 in which the treatment is completed can be However, the present invention is not limited thereto.

Referring to FIG. 7 , the controller 1200 of the treatment image display device 1000 generates energy generated in the treatment device 3000 when the treatment device 3000 is a treatment device electrically connected to the treatment image display device 1000 . It is possible to monitor the signal (S300).

Specifically, when the treatment device 3000 is operated through a button provided in the treatment device 3000 , an energy generation signal may be generated when the treatment is performed through the treatment device 3000 . In addition, the control unit 1200 may monitor the energy generation signal generated by the treatment device 3000 to recognize whether the energy generation signal has been generated. However, the present invention is not limited thereto.

Meanwhile, the controller 1200 of the treatment image display apparatus 1000 may recognize the area in which the treatment apparatus 3000 is located as the first area 100 at the time when the energy generation signal is generated ( S310 ).

Specifically, the controller 1200 may recognize an area in which the treatment apparatus 3000 is located by analyzing an image captured by the photographing unit 1100 at the time when the energy generation signal is generated. In addition, the controller 1200 may recognize the area in which the treatment apparatus 3000 is located at the time when the energy generation signal is generated as the first area 100 in which the treatment is completed. However, the present invention is not limited thereto.

On the other hand, in the case of ultrasound treatment, the procedure may have to be repeatedly performed on the same site. In this case, the control unit 1200 may analyze the image captured by the photographing unit 1100 at the time when the energy generation signal is generated to recognize the region in which the treatment apparatus 3000 is located. The controller 1200 may store, in the storage unit, a point at which an energy generating signal is generated and the number of times at which an energy generating signal is generated at the corresponding point within the entire area within the treatment site. Also, the controller 1200 may recognize a point at which an energy generation signal is generated a preset number of times within the entire area within the treatment area as the first area 100 where the treatment is completed. However, the present invention is not limited thereto.

According to the above-described configuration, the controller 1200 of the treatment image display apparatus 1000 may recognize a region in which the treatment apparatus 3000 is located within the treatment site of the patient, regardless of the type of the treatment apparatus 3000 . . In addition, the controller 1200 may differently display an area in which the treatment is completed and an area in which the treatment is not completed through the display unit 1300 . Therefore, according to at least one of the several embodiments described above, it is possible to prevent the user from performing a procedure overlapping the treatment site of the patient, and it is also possible to prevent the user from omitting the treatment for a specific site.

Although the present disclosure has been described above generally in the context of computer-executable instructions that may be executed on one or more computers, those skilled in the art will appreciate that the present disclosure may be implemented as a combination of hardware and software and/or in combination with other program modules. you will know

Generally, modules herein include routines, procedures, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In addition, those skilled in the art will appreciate that the methods of the present disclosure are suitable for single-processor or multiprocessor computer systems, minicomputers, mainframe computers as well as personal computers, handheld computing devices, microprocessor-based or programmable consumer electronics, etc. (each of which is It will be appreciated that other computer system configurations may be implemented, including those that may operate in connection with one or more associated devices.

The described embodiments of the present disclosure may also be practiced in distributed computing environments where certain tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Computers typically include a variety of computer-readable media. Media accessible by a computer includes volatile and nonvolatile media, transitory and non-transitory media, removable and non-removable media. By way of example, and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media.

Computer-readable storage media includes volatile and non-volatile media, transitory and non-transitory media, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. includes media. A computer-readable storage medium may be RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage device, magnetic cassette, magnetic tape, magnetic disk storage device, or other magnetic storage device. device, or any other medium that can be accessed by a computer and used to store the desired information.

Computer readable transmission media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and the like. Includes any information delivery medium. The term modulated data signal means a signal in which one or more of the characteristics of the signal is set or changed so as to encode information in the signal. By way of example, and not limitation, computer-readable transmission media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above are also intended to be included within the scope of computer-readable transmission media.

An exemplary environment for implementing various aspects of the present disclosure is shown including a computer 2002 , which includes a processing unit 2004 , a system memory 2006 , and a system bus 2008 . System bus 2008 connects system components, including but not limited to system memory 2006 , to processing device 2004 . The processing device 2004 may be any of a variety of commercially available processors. Dual processor and other multiprocessor architectures may also be used as processing unit 2004 .

The system bus 2008 may be any of several types of bus structures that may be further interconnected to a memory bus, a peripheral bus, and a local bus using any of a variety of commercial bus architectures. System memory 2006 includes read only memory (ROM) 2010 and random access memory (RAM) 2012 . The Basic Input/Output System (BIOS) is stored in non-volatile memory 2010, such as ROM, EPROM, EEPROM, etc., which is the basic contains routines. RAM 2012 may also include high-speed RAM, such as static RAM, for caching data.

The computer 2002 may also include an internal hard disk drive (HDD) 2014 (eg, EIDE, SATA) - this internal hard disk drive 2014 may also be configured for external use within a suitable chassis (not shown). Yes-, magnetic floppy disk drive (FDD) 2016 (eg, for reading from or writing to removable diskette 2018), and optical disk drive 2020 (eg CD-ROM) for reading from, or writing to, disk 2022 or other high capacity optical media such as DVDs. The hard disk drive 2014, the magnetic disk drive 2016, and the optical disk drive 2020 are connected to the system bus 2008 by the hard disk drive interface 2024, the magnetic disk drive interface 2026, and the optical drive interface 2028, respectively. ) can be connected to The interface 2024 for external drive implementation includes, for example, at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.

These drives and their associated computer-readable media provide non-volatile storage of data, data structures, computer-executable instructions, and the like. For computer 2002, drives and media correspond to storing any data in a suitable digital format. Although the description of computer readable storage media above refers to HDDs, removable magnetic disks, and removable optical media such as CDs or DVDs, those skilled in the art will use zip drives, magnetic cassettes, flash memory cards, cartridges, It will be appreciated that other tangible computer-readable storage media and the like may also be used in the exemplary operating environment and any such media may include computer-executable instructions for performing the methods of the present disclosure. .

A number of program modules may be stored in drives and RAM 2012 , including operating system 2030 , one or more application programs 2032 , other program modules 2034 , and program data 2036 . All or portions of the operating system, applications, modules and/or data may also be cached in RAM 2012 . It will be appreciated that the present disclosure may be implemented in various commercially available operating systems or combinations of operating systems.

A user may enter commands and information into the computer 2002 through one or more wired/wireless input devices, for example, a pointing device such as a keyboard 2038 and a mouse 2040 . Other input devices (not shown) may include a microphone, IR remote control, joystick, game pad, stylus pen, touch screen, and the like. Although these and other input devices are connected to the processing unit 2004 via an input device interface 2042 that is often connected to the system bus 2008, parallel ports, IEEE 1394 serial ports, game ports, USB ports, IR interfaces, It may be connected by other interfaces, etc.

A monitor 2044 or other type of display device is also coupled to the system bus 2008 via an interface, such as a video adapter 2046 . In addition to the monitor 2044, the computer typically includes other peripheral output devices (not shown), such as speakers, printers, and the like.

Computer 2002 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer(s) 2048 via wired and/or wireless communications. Remote computer(s) 2048 may be workstations, server computers, routers, personal computers, portable computers, microprocessor-based entertainment devices, peer devices, or other common network nodes, and are generally Although including many or all of the components described, only the memory storage device 2050 is shown for simplicity. The logical connections shown include wired/wireless connections to a local area network (LAN) 2052 and/or a larger network, eg, a wide area network (WAN) 2054 . Such LAN and WAN networking environments are common in offices and companies, and facilitate enterprise-wide computer networks, such as intranets, all of which can be connected to a worldwide computer network, for example, the Internet.

When used in a LAN networking environment, the computer 2002 is connected to the local network 2052 through a wired and/or wireless communication network interface or adapter 2056 . Adapter 2056 may facilitate wired or wireless communication to LAN 2052 , which also includes a wireless access point installed therein for communicating with wireless adapter 2056 . When used in a WAN networking environment, the computer 2002 may include a modem 2058 , connected to a communication server on the WAN 2054 , or otherwise establishing communications over the WAN 2054 , such as over the Internet. have the means Modem 2058 , which may be internal or external and a wired or wireless device, is connected to system bus 2008 via serial port interface 2042 . In a networked environment, program modules described for computer 2002 , or portions thereof, may be stored in remote memory/storage device 2050 . It will be appreciated that the network connections shown are exemplary and other means of establishing a communication link between the computers may be used.

Computer 2002 may be associated with any wireless device or object that is deployed and operates in wireless communication, for example, printers, scanners, desktop and/or portable computers, portable data assistants (PDAs), communications satellites, wireless detectable tags. It operates to communicate with any device or place, and phone. This includes at least Wi-Fi and Bluetooth wireless technologies. Accordingly, the communication may be a predefined structure as in a conventional network or may simply be an ad hoc communication between at least two devices.

Wi-Fi (Wireless Fidelity) makes it possible to connect to the Internet, etc. without a wire. Wi-Fi is a wireless technology such as cell phones that allows these devices, eg, computers, to transmit and receive data indoors and outdoors, ie anywhere within range of a base station. Wi-Fi networks use a radio technology called IEEE 802.20 (a, b, g, etc.) to provide secure, reliable, and high-speed wireless connections. Wi-Fi can be used to connect computers to each other, to the Internet, and to wired networks (using IEEE 802.3 or Ethernet). Wi-Fi networks may operate in unlicensed 2.4 and 5 GHz radio bands, for example, at 20 Mbps (802.20a) or 54 Mbps (802.20b) data rates, or in products that include both bands (dual band). have.

Those of ordinary skill in the art of the present disclosure will recognize that the various illustrative logical blocks, modules, processors, means, circuits, and algorithm steps described in connection with the embodiments disclosed herein include electronic hardware, (convenience For this purpose, it will be understood that it may be implemented by various forms of program or design code (referred to herein as "software") or a combination of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. A person skilled in the art of the present disclosure may implement the described functionality in various ways for each specific application, but such implementation decisions should not be interpreted as a departure from the scope of the present disclosure.

The various embodiments presented herein may be implemented as methods, apparatus, or articles of manufacture using standard programming and/or engineering techniques. The term "article of manufacture" includes a computer program or media accessible from any computer-readable device. For example, computer-readable storage media include magnetic storage devices (eg, hard disks, floppy disks, magnetic strips, etc.), optical disks (eg, CDs, DVDs, etc.), smart cards, and flash drives. memory devices (eg, EEPROMs, cards, sticks, key drives, etc.). The term “machine-readable medium” includes, but is not limited to, wireless channels and various other media capable of storing, holding, and/or carrying instruction(s) and/or data.

It is understood that the specific order or hierarchy of steps in the presented processes is an example of exemplary approaches. Based on design priorities, it is understood that the specific order or hierarchy of steps in the processes may be rearranged within the scope of the present disclosure. The appended method claims present elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the embodiments presented herein, but is to be construed in the widest scope consistent with the principles and novel features presented herein.

Claims

In the treatment image display device,

a photographing unit which acquires an image including the treatment device and the treatment site of the patient;

a control unit that analyzes the image and recognizes a first area in which the treatment is completed and a second area in which the treatment is not completed within the treatment area; and

a display unit configured to display the first area and the second area differently on the image;

containing,

Procedure image display device.
The method of claim 1,

a user input unit for receiving information about the treatment site;

further comprising,

The control unit is

Recognizing the treatment site in the image using the treatment area information,

Procedure image display device.
3. The method of claim 2,

The control unit is

controlling the sound output unit to output a preset first sound when it is recognized that the treatment device is located outside the treatment site by analyzing the image,

Procedure image display device.
3. The method of claim 2,

The control unit is

Analyze the image to recognize location information on the location of the treatment device,

Recognizing the first area and the second area based on the location information and the treatment area information,

Procedure image display device.
The method of claim 1,

The control unit is

controlling the sound output unit to output a preset second sound when it is recognized that the surgical device exists on the first area by analyzing the image,

Procedure image display device.
The method of claim 1,

The treatment device is

including High Intensity Focused Ultrasonic devices, Ultrasonic Probes or medical syringes;

Procedure image display device.
The method of claim 1,

The control unit is

When the treatment device is a treatment device electrically connected to the treatment image display device, monitoring an energy generation signal generated by the treatment device,

Recognizing the region in which the surgical device is located at the time when the energy generation signal is generated as the first region,

Procedure image display device.
The method of claim 1,

The photographing unit,

At least one of an axial plane, a sagittal plane, and a coronal plane of the treatment site is photographed to obtain at least one image information about the treatment site,

The video is

A stereoscopic image generated by the at least one image information,

Procedure image display device.
A computer program stored on a computer-readable storage medium, comprising:

The computer program includes instructions for causing the control unit of the procedure image display device to perform the following steps, wherein the steps include:

acquiring an image including a treatment device and a treatment site of a patient through a photographing unit;

analyzing the image to recognize a first area in which the treatment is completed and a second area in which the treatment is not completed within the treatment area; and

controlling a display unit to display the first area and the second area differently on the image;

containing,

A computer program stored on a computer-readable storage medium.
The method of claim 1,

recognizing the treatment site in the image using treatment area information received from a user through a user input unit;

further comprising,

A computer program stored on a computer-readable storage medium.
10. The method of claim 9,

controlling the sound output unit to output a preset first sound when it is recognized that the treatment device is located outside the treatment area by analyzing the image;

further comprising,

A computer program stored on a computer-readable storage medium.
11. The method of claim 10,

The step of analyzing the image and recognizing a first area in which the treatment is completed and a second area in which the treatment is not completed within the treatment area comprises:

recognizing location information on the location of the treatment device by analyzing the image; and

recognizing the first area and the second area based on the location information and the treatment area information;

further comprising,

A computer program stored on a computer-readable storage medium.
10. The method of claim 9,

controlling the sound output unit to output a preset second sound when it is recognized that the surgical device exists on the first area by analyzing the image;

further comprising,

A computer program stored on a computer-readable storage medium.
The method of claim 1,

The treatment device is

including High Intensity Focused Ultrasonic devices, Ultrasonic Probes or medical syringes;

A computer program stored on a computer-readable storage medium.
The method of claim 1,

The step of analyzing the image and recognizing a first area in which the treatment is completed and a second area in which the treatment is not completed within the treatment area comprises:

monitoring an energy generation signal generated by the treatment device when the treatment device is a treatment device electrically connected to the treatment image display device; and

recognizing the region in which the surgical device is located at the time when the energy generation signal is generated as the first region;

containing,

A computer program stored on a computer-readable storage medium.
10. The method of claim 9,

The step of acquiring an image including the treatment device and the treatment area of the patient through the photographing unit,

acquiring at least one image information about the treatment site by photographing at least one of an axial plane, a sagittal plane, and a coronal plane of the treatment site through the photographing unit;

including,

The video is

A stereoscopic image generated by the at least one image information,

A computer program stored on a computer-readable storage medium.