KR101190265B1 - Head mouted operating magnifying apparatus - Google Patents

Head mouted operating magnifying apparatus Download PDF

Info

Publication number
KR101190265B1
KR101190265B1 KR1020100061856A KR20100061856A KR101190265B1 KR 101190265 B1 KR101190265 B1 KR 101190265B1 KR 1020100061856 A KR1020100061856 A KR 1020100061856A KR 20100061856 A KR20100061856 A KR 20100061856A KR 101190265 B1 KR101190265 B1 KR 101190265B1
Authority
KR
South Korea
Prior art keywords
image
unit
light
surgical
surgical site
Prior art date
Application number
KR1020100061856A
Other languages
Korean (ko)
Other versions
KR20110001952A (en
Inventor
송태진
Original Assignee
고려대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 고려대학교 산학협력단 filed Critical 고려대학교 산학협력단
Publication of KR20110001952A publication Critical patent/KR20110001952A/en
Application granted granted Critical
Publication of KR101190265B1 publication Critical patent/KR101190265B1/en

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361Image-producing devices, e.g. surgical cameras
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361Image-producing devices, e.g. surgical cameras
    • A61B2090/3616Magnifying glass
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50Supports for surgical instruments, e.g. articulated arms
    • A61B2090/502Headgear, e.g. helmet, spectacles
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems

Landscapes

  • Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

The present invention relates to a head-mounted surgical magnification apparatus, which irradiates at least one or more rays of infrared, ultraviolet or visible light to a surgical site, and digitizes the image of the surgical site using the irradiated light, It includes an image processing unit to enlarge the display and the frame unit for supporting the image processing unit around the user's eyes so that the user can see the surgical site with the user's eyes, lighter than the conventional surgical microscope, simple installation, than the surgical loupe The magnification of the surgical site can be increased.

Description

Head mounted surgical magnifying apparatus {Head mouted operating magnifying apparatus}

The present invention relates to a head-mounted surgical magnification device, and more particularly, to a head-mounted surgical magnification device having a function of enlarging a surgical site with a smaller weight than a conventional surgical microscope or surgical loupe. .

In surgery, doctors use a surgical loupe. Surgical loupe refers to surgical glasses for enlarging the surgical site.

1 is a view showing a conventional surgical loupe. As shown in FIG. 1, the conventional surgical loupe was used by adding an enlarged lens to the spectacle lens.

Common surgical loupe magnifications of 2.5 to 3.5 times are common and up to 6 times magnification is used. Magnifications beyond the magnification of a surgical loupe are made using a surgical microscope that can be magnified 10 to 40 times.

Figure 2 is a view showing a conventional surgical microscope (HM500 model of Leica Corporation).

Leica head mounted surgical microscopes currently on the medical market are capable of dividing the path of light through a semi-transparent mirror to the optical field of view of both eyes, or generating and storing digital images through a third separate lens, but all It is an optical type that shows magnified image through lens combination, and it is hard to wear for long time operation because of its heavy weight, and the light of invisible region wavelength such as infrared ray, ultraviolet ray, etc. I can't see it directly.

Both the surgical loupe and the surgical microscope can only see magnified images in visible light. In addition, the surgical lupe is easy to wear, but the magnification is small, there is no zoom function, there is a problem that additionally requires a head-mounted light source or shadowless light. In addition, surgical microscopes are complex to install, their narrow field of view is cumbersome to use, and the equipment is heavy and bulky.

Therefore, there is a need for a surgical loupe that can zoom in on a surgical site image or enlarge the operator as desired, and a surgical loupe capable of observing an image under an infrared or ultraviolet light source as well as visible light is required.

Therefore, the problem to be solved by the present invention is to provide a head-mounted surgical magnification apparatus that can easily adjust the magnification of the surgical site to a larger magnification than before.

In order to achieve the above object, the present invention irradiates at least one of the infrared, ultraviolet or visible light to the surgical site, and digitizes the image of the surgical site using the irradiated light, and then the image An image processing unit for enlarging and displaying the image; And a frame unit which supports the image processing unit around the eyes of the user so that the surgical site can be seen by the eyes of the user.

The image processing unit of the head-mounted surgical magnifying apparatus according to an embodiment of the present invention comprises a filter unit for passing a light beam of a specific wavelength of the light beams coming from the surgical site; A digital image acquisition unit for digitizing an image of the surgical site by using the passed light beam; And a display unit configured to enlarge and output the digitized image, wherein the frame unit may further include a light source unit formed of an optical fiber that irradiates at least one or more rays of infrared, ultraviolet, or visible light to the surgical site.

According to another aspect of the present invention, a head mounted surgical enlargement apparatus receives a digital image obtained by a digital image acquisition unit, enlarges the received image, and then displays the enlarged image so that the display unit outputs the enlarged image. The apparatus further includes an image enlargement unit for transmitting the image processing unit to the image processing unit.

The head mounted surgical enlargement apparatus according to another embodiment of the present invention further comprises a light beam generation unit for generating at least one or more of the infrared, ultraviolet or visible light irradiated to the surgical site, from the light generation unit An optical fiber is used as a passage for moving the light rays to the light source portion.

The image processing unit of the head-mounted surgical magnifying apparatus according to another embodiment of the present invention further comprises two objective lenses, the two objective lenses are the distance between the center of the objective lens, the height of the objective lens, or the objective lens At least one of the inclination of the top, bottom, left and right of the is adjusted.

The image processing unit of the head mounted surgical magnifying apparatus according to another embodiment of the present invention further comprises two alternative lenses, the two alternative lenses are at least one or more of the distance between the center of the alternative lens or the height of the alternative lens This is regulated.

Frame portion of the head-mounted surgical enlargement apparatus according to another embodiment of the present invention includes a head fixing portion for supporting the image processing unit around the eyes of the user, the head fixing portion of the spectacle legs or hair band It is characterized by one.

The digital image acquisition unit of the head mounted surgical enlargement apparatus according to another embodiment of the present invention is any one of a CCD camera or a CMOS camera, the display unit is characterized in that any one of LCD or OLED.

The light source unit may irradiate the surgical site with the laser weakened through the optical fiber.

Further, a subtracted luminance value is generated such that the difference between the luminance value of the ideal image or the luminance value of the preoperative image and the subtracted luminance value from the luminance value of the enlarged image is minimized, and then the generated subtraction is performed. The apparatus may further include an image corrector configured to subtract the luminance value from the luminance value of the enlarged image. In particular, the subtracted luminance value may be determined for each divided area of the enlarged image.

The apparatus may further include a tracking unit which tracks the surgical region, which has been enhanced by the contrast agent, to display an outline of the surgical region.

According to the present invention, it is lighter than a surgical microscope, is simple to install, and the magnification of the surgical site can be made larger than the surgical loupe because it is digitally enlarged instead of optically enlarged. In addition, according to the present invention, it is possible to easily observe the desired surgical site by using infrared rays, ultraviolet rays or visible light passing through the optical fiber selectively, and using a contrast agent in response to each light beam. Furthermore, according to the present invention, it is possible to reduce the size and weight than the conventional optical heavy glass lens structure.

1 is a view showing a conventional surgical loupe.
Figure 2 is a view showing a conventional surgical microscope (HM500 model of Leica Corporation).
Figure 3 is an overall configuration of the head mounted surgical enlargement apparatus according to an embodiment of the present invention.
Figure 4 is a block diagram of a frame portion 320 of the head-mounted surgical enlargement apparatus according to an embodiment of the present invention.
5 is a detailed view of the image processing unit 310 of the head-mounted surgical magnifying apparatus according to an embodiment of the present invention.
6 is a detailed view of the image correcting unit 557 of the head mounted surgical enlargement apparatus according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to preferred examples. However, these examples are intended to illustrate the present invention in more detail, it will be apparent to those skilled in the art that the scope of the present invention is not limited thereby.

Figure 3 is an overall configuration of the head mounted surgical enlargement apparatus according to an embodiment of the present invention.

Referring to FIG. 3, an enlargement apparatus for head mounted surgery according to an embodiment of the present invention includes an image processor 310, a frame part 320, a connection part 330, and a controller 340.

The image processing unit 310 digitizes the image of the surgical site by using light rays (infrared rays, ultraviolet rays, visible light, etc.) irradiated to the surgical site, and then transmits the digitized image to the control unit 340, and then, from the control unit 340. Receive and display the enlarged digital image for the user to view.

The image processor 310 includes a band pass filter, an objective lens, an aperture, a camera sensor, a video sensor board, a display board, a backlight, a display unit, an alternative lens, a protective film, and the like, and a detailed configuration thereof will be described with reference to FIG. 5. Shall be.

The camera sensor of the image processor 310 includes a CCD sensor or a CMOS sensor and is a sensor capable of generating a still image or a moving image.

The filter, the objective lens, the iris, and the camera sensor of the image processor 310 are positioned outside the frame 320 in the direction of the subject and may be attached in the same position and arrangement as the human eye.

The image processing unit 310 has two independent objective lenses, a small zoom CCD camera and a small LCD, one each from side to side. In this case, the images processed by two independent objective lenses, a small zoom CCD camera, and a small LCD have a constant pupil distance and convergence of left and right, so that the user has a three-dimensional effect when looking at the small LCD. . In other words, the two independent lenses are located at the same position as the user's left and right eyes, and the two independent objectives move with the tilt of the top, bottom, left and right as well as the movement range of the pupil. Can be seen.

On the other hand, by moving the two independent lenses beyond the movement range of the pupil, you can see the object with a viewing angle more than the naked eye.

When at least one of the infrared, ultraviolet, and visible light is irradiated to the surgical site, the image processing unit 310 passes only the light of a specific wavelength through the optical band specific filter unit that is pre-mounted or replaceable in the objective lens, and passes the transmitted light. A small zoom CCD camera is reached and processed. Therefore, the image processing unit 310 according to an embodiment of the present invention makes the image as if it is directly viewed by the naked eye.

The frame unit 320 includes an objective lens adjusting unit 321, an alternative lens adjusting unit 322, a support unit 323, an optical fiber light source unit 324, and a head fixing unit 325.

The frame unit 320 fixes the image processor 310 around the eyes of the user so that the user can see the surgical site through the image processor 310.

The objective lens adjusting unit 321 is a device for adjusting the pupil distance or the separation distance of the objective lens of the CCD or CMOS sensor camera equipped with the optical zoom.

The objective lens adjusting unit 321 adjusts the convergence (the pupil angle) and the height of the objective lens for the stereoscopic image. The objective lens adjusting unit 321 allows the objective lens to move three-dimensionally within a predetermined range, like a human pupil. The objective lens controller 321 may use a screw or a latch or a small motor to control the position of the objective lens, the CCD, or the CMOS sensor camera.

The alternative lens adjustment unit 322 is a device for adjusting the separation distance of the alternative lens or the separation distance of the display device (LCD, OLED, etc.). The adjustment of the separation distance of the alternative lens adjustment unit 322 may be implemented through a latch that pushes from the inside to the outside or a slide type that pushes and pulls from side to side. In addition, the alternative lens adjustment unit 322 may provide a convenience to the user using the glasses by adjusting the diopter of the alternative lens. Diopter adjustment is possible by adjusting the fine distance of the lens in front of the LCD monitor or OLED monitor.

The supporter 323 fixes the image processor 310, the objective lens controller 321, the alternative lens controller 322, and the optical fiber 324.

The optical fiber light source 324 is an optical fiber that irradiates infrared (IR), ultraviolet (UV), visible light to the surgical site. The optical fiber 324 may be installed at the edge of the objective lens, and light rays such as visible light, ultraviolet light, and infrared light are generated by the light output part 341 located in the controller 340.

Infrared lasers pass through dozens or hundreds of meters of optical fiber, which weakens the laser beam. Since the weakened laser beam is safe and straightforward for the human eye, in the embodiment of the present invention, the straightness allows light to reach an internal organ of a certain depth.

The head fixing unit 325 fixes the head mounted surgical enlargement apparatus according to an embodiment of the present invention to the user's head, and can be manufactured in various forms such as glasses or hair bands.

The connection unit 330 is a path for transmitting digital data, infrared rays, ultraviolet rays, and visible light between the image processor 310 and the controller 340. The connection part 330 is composed of a tightening part 331, a light cable 332, and a data cable 333.

A part of the connection unit 330 connecting the image processor 310 and the controller 340 is built in the frame unit 320.

The tightening unit 331 is a device for tightening the light cable 332 or the data cable 333, or to fix the head-mounted surgical magnifying device to the user's head.

The light ray cable 332 has a built-in optical fiber for irradiating the infrared, ultraviolet and visible light generated by the control unit 340 to the surgical site.

The data cable 333 transfers left and right digital image data generated from the left and right image processing units 310 to the control unit 340, and transmits the left and right digital image data enlarged by the control unit 340 to the image processing unit ( 310). The data cable 333 may be replaced with a Bluetooth, WLAN, or RF based wireless connection.

The controller 340 enlarges the digital image received from the image processor 310 and transmits the digital image to the image processor 310, generates infrared rays, ultraviolet rays, and visible light, and transmits the generated digital image to the image processor 310. The control unit 340 is composed of a light output unit 341, a light amount adjusting unit 342, and an image enlargement unit 343.

Although the controller 340 is independently configured as a separate device in FIG. 3, the controller 340 may be embedded in the image processor 310 or the frame 320.

The light output unit 341 and the light amount adjusting unit 342 generating the infrared, ultraviolet, and visible light of the controller 340 may be configured separately from the image enlarger 343. The control unit 340 may be included in the small PC, and processes the enlargement and storage of the digital image received from the image processing unit 310 by software.

The light output unit 341 is a device that generates infrared rays, ultraviolet rays, and visible light.

The light amount adjusting unit 342 is a device for adjusting the light amount of infrared rays, ultraviolet rays, and visible light generated by the light output unit 341.

The image enlarger 343 is a device that enlarges the left / right digital data received from the image processor 310 and returns the image data to the image processor 310. The image magnification unit 343 processes each image data separately so that the left and right digital image data received from the image processing unit 310 is displayed to a person in three dimensions.

The image enlarger 343 may store left and right digital image data as a composite image according to a software algorithm, or may store the left and right digital image data separately or simultaneously.

Control of the image enlarger 343 may be performed through a foot switch, a computer touch screen, or a wired / wireless remote controller connected to the image enlarger 343. The PC used as the image enlarger 343 includes not only a general PC but also a PC having a medical tablet called a professionally specialized UMPC (Ultra-Mobile PC) or a medical clinical assistant (MCA).

In addition to the enlarged left and right digital image data, the image enlarger 343 may use data of CT (Computed Tomography), MRI (magnetic resonance imaging), PET (Positron Emission Tomography) or OCS (Order) using a picture archiving and communications system (PACS). Communication data) may be provided with the patient data, data searched through the Internet DB, etc. simultaneously with the enlarged left and right digital image data, or provided to the user alone.

Hereinafter, the process of expanding the surgical site of the head mounted surgical enlargement apparatus according to an embodiment of the present invention will be described as a whole.

The image processing unit 310 is mounted on the outside (opposite sides of the frame) 320 of the frame unit 320 of the head mounted surgical magnifying apparatus according to an embodiment of the present invention. A detailed configuration of the image processor 310 will be described in detail with reference to FIG. 5.

The image processor 310 includes a lens, a small zoom CCD camera, and a small LCD. The controller 340 connects the small zoom CCD camera and the small LCD to each other using the data cable 333, and processes and enlarges and stores the image. When the image passing through the lens is enlarged to some extent (2 to 3 times) and reaches the small zoom CCD camera, the image processing unit 310 converts the image into a digital image signal and transmits it to the controller 340. The control unit 340 includes a light generator and a small personal computer. The controller 340 enlarges the digital image signal received from the image processor 310 and transmits the digital image signal to the small LCD of the image processor 310.

Accordingly, in the head mounted surgical magnification apparatus according to an embodiment of the present invention, the small zoom CCD camera of the image processing unit 310 generates a digital image, and the small LCD of the image processing unit 310 displays the digital image enlarged by the control unit 340. The device to display on. As a result, the weight of the head mounted surgical magnification device due to the lens weight can be reduced because the CCD camera and the small LCD are used instead of the magnification using the optical lens.

Figure 4 is a block diagram of a frame portion 320 of the head-mounted surgical enlargement apparatus according to an embodiment of the present invention.

Referring to FIG. 4, the frame part 320 of the head mounted surgical enlargement apparatus according to the embodiment of the present invention includes an objective lens adjusting part 321, an alternative lens adjusting part 322, a support part 323, and an optical fiber light source part. 324, the head fixing portion (325).

The objective lens adjusting unit 321 adjusts the pupillary distance (PD) of the objective lens, the convergence for the stereoscopic image of the objective lens, and the height of the objective lens.

The alternative lens adjusting unit 322 adjusts the pupil distance (PD), that is, the eye distance of the alternative lens, to the left and right according to the user. The alternative lens adjuster 322 includes a left or right adjustable latch or center screw handle.

The supporter 323 fixes the image processor 310 to a predetermined position so that the user can see the surgical site through the image processor 310.

The optical fiber light source unit 324 is located on the front or side of the support unit 323, irradiating the surgical site by combining at least one or more of the ultraviolet, infrared, visible light to the surgical site. The optical fiber light source unit 324 irradiates the surgical site with ultraviolet, infrared, and visible light transmitted from the light source output unit 341 of the controller 340 using the optical fiber.

As shown in FIG. 4, the optical fiber light source unit 324 may surround the objective lens, and irradiate the surgical site by combining at least one or more rays of ultraviolet light, infrared light, and visible light. In the case of infrared rays, the weakened infrared rays are irradiated to the surgical site through the optical fibers of tens to hundreds of meters. There may be one optical fiber that passes infrared, ultraviolet, and visible light in each ray, or a single optical fiber may be used jointly. In another embodiment, by placing LEDs having different wavelengths around the objective lens, infrared, ultraviolet, and visible light can be irradiated to the surgical site.

Lasers passing through optical fibers are weakened by dispersion, absorption, scattering, etc., but maintain straightness.

In the embodiment of the present invention, a laser, weakened by dispersion, absorption, scattering, or the like, is irradiated to a surgical site while passing through an optical fiber, and thus underneath the skin, such as a lymph node stuck in adipose tissue. Reflected light can also be received against tissues in the. That is, the weakened laser can be effectively used as a surgical light source that penetrates tissue.

The head fixing unit 325 fixes the head mounted surgical enlargement device according to an embodiment of the present invention to the user's head.

The light ray cable 332 is a path from which light rays, such as infrared rays, ultraviolet rays, and visible rays, reach the surgical site from the light output part 341, and may be embedded in the head fixing unit 325.

The data cable 333 transfers the left and right digital image data acquired by the camera sensor of the image processor 310 to the image enlarger 343, and transmits the left and right digital image data enlarged from the image enlarger 343 to the image processor 310. ) Is a passage to be delivered to the display device, and may be embedded in the head fixing unit 325.

5 is a detailed view of the image processing unit 310 of the head-mounted surgical magnifying apparatus according to an embodiment of the present invention.

Referring to FIG. 5, the image processing unit 310 of the head mounted surgical enlargement apparatus according to the embodiment of the present invention includes a filter unit 510, a zoom lens unit 520, an aperture 530, and a digital image acquisition unit ( 540, a video sensor board 550, a display board 560, a backlight 570, a display 580, a collimating lens 590, and a protective film 595.

The optical fiber light source unit 324 is located outside the image processing unit 310 and irradiates a laser to the surgical site.

The filter unit 510 passes only the light rays having a specific wavelength among the reflected light rays when the light rays radiated from the light source unit 410 are reflected at the surgical site. The filter unit 510 is configured to be pre-mounted or replaceable. The wavelength range of the infrared rays is 780 nm to 1000 µm, the wavelength range of the ultraviolet rays is 100 nm to 380 nm, and the wavelength range of the visible light is 380 nm to 780 nm. Therefore, only the light having a specific wavelength depends on the filter unit 510. Will pass.

The bile is excited in blue light close to ultraviolet light having a wavelength of 460 nm to emit light near 475 nm. The ICG is excited in a light beam having a wavelength of 700 to 850 nm (representative value 805 nm) and emits an infrared ray having a wavelength of 780 to 950 nm (representative value 830 nm). Fluorescein is excited in light rays having a wavelength of 465-490 nm (488 nm) and emits light having a wavelength of 520-530 nm (525 nm). Using these properties, only the desired site can be observed.

The zoom lens unit 520 optically enlarges the light rays passing through the filter unit 510. The zoom lens unit 520 preferably has an autofocus function.

The iris 530 adjusts the amount of light passing through the zoom lens unit 520. If the diaphragm has a large diameter, a bright image is formed. If the diaphragm has a small diameter, a dark image is formed.

The digital image acquisition unit 540 generates an image by using the rays passing through the aperture 530, and converts the generated image into digital image data. The digital image acquisition unit 540 may be a CCD camera or a CMOS camera, but is not limited thereto.

The video sensor board unit 550 receives the digital image data from the digital image acquisition unit 540, and transmits the received digital image data to the image enlarger 343.

The display board unit 560 receives the enlarged digital image data from the image enlarger 343.

The backlight unit 570 is a light emitter that emits light required when the display unit 580 is an LCD.

The display unit 580 receives the enlarged left and right digital image data from the display board unit 560 and displays the left and right digital image data on each of the left and right sides. When the display unit 580 is an LCD monitor, the LCD monitor is placed directly in front of the eyes, and shows a large screen of 30 inches to 60 inches. The display unit 580 may be an LCD or an OLED, and a thin and light display device may be used as the display unit 580.

The collimating lens unit 590 makes visible light emitted from the display unit 580 into parallel light.

The protective film 595 is a film for protecting the collimating lens unit 590.

The image enlarger 555 is a board and software that is enlarged by receiving the left and right image signals of the image processing unit 310 is organically interlocked in the computer, and the zoom, image conversion, storage, processing, etc. by the foot switch or remote control, etc. It is configured to allow all hardware operation. In addition, the image enlarger 555 may display an external image signal such as an OCS or PACS on the display 580 or may overlap the visible image.

The image corrector 557 is a device for sharpening an image that appears cloudy at the time of surgery.

The tracking unit 559 is a device for tracking an area of contrast-enhanced bright light that is collected by the enhancement agent.

The tracking unit 559 may mark and target a contrast-enhanced area in a rectangle or a circle. More preferably, the tracking unit 559 is enlarged by the image magnification unit 555, and tracks / marks the contrast-enhanced area using an image sharply corrected by the image correction unit 557, thereby miniaturizing the LCD. Surgery can be performed by the operator while viewing a real-time image through a monitor or a connected external monitor.

In particular, by tracking only the brightly contrasted portion to mark the outline, it is easy to perform monitoring lymph node resection and the like.

In this case, indocyanine green [ICG], Fluorescein, etc., which are licensed for use in vivo, can be used as a fluorescence contrast enhancer to further clarify the required image. This fluorescence imaging method can be applied to the recently widely adopted sentinel lymph node dissection, such as lymph vessel surgery, vascular surgery, hepatobiliary surgery, etc. The scope of application is wide.

When enhancing specific areas using fluorescence contrast enhancers such as ICG sensitive to infrared rays and Fluorescein sensitive to ultraviolet rays, so-called surveillance lymph node biopsy, biliary contrast, etc. It is widely applicable to all surgical areas requiring optical surgical microscopes that use complex x2-x6 magnification optical surgical loupe or magnification of x2-x20 magnification. . Images beyond x20 magnification, which are not possible with conventional optical surgical microscopes, can be obtained with digital zoom.

6 is a detailed view of the image correcting unit 557 of the head mounted surgical enlargement apparatus according to an embodiment of the present invention.

Referring to FIG. 6, the image corrector 557 of the head mounted surgical enlargement device according to the embodiment of the present invention includes a color space converter 600, a subtraction map generator 610, a subtractor 620, And an edge emphasis unit 630 and a color space recovery unit 640.

The color space converter 600 converts the RGB input image into a luminance / color difference color space and outputs the luminance Y and the color difference signals Cb and Cr.

When the RGB input image is blurry or the color is not clear, conversion from the RGB color space to the YCbCr color space is performed using Equation 1 below.

Figure 112010041881759-pat00001

Luminance (Y) is a component that expresses a light and dark degree, and color difference (C) is a component that expresses color information. The two color difference components have Cb and Cr values, where Cb is the difference between the blue (B) component and the reference value, and Cr is the difference between the red (R) component and the reference value. Since the human eye is more sensitive to the change in brightness than the change in color, one embodiment of the present invention uses only a luminance signal. In particular, the YCbCr color space is a color space obtained by separating luminance components from color information using human visual characteristics sensitive to luminance.

In addition, although an embodiment of the present invention describes the conversion of an RGB image to a YCbCr signal, it can be applied not only to YCbCr conversion coordinates but also to other color space coordinate systems such as YUV, Lab, and YCC. have.

The subtraction map generator 610 receives the first luminance signal Y ′ from the color space converter 600 and generates a subtraction map based on the ratio of the average and the standard deviation of the first luminance signal. The subtraction map is preferably generated by dividing the image into a plurality of regions. Here, the subtraction map is a map composed of subtracted luminance values, that is, luminance values that cause the blurry image to be seen, which is a luminance value subtracted from the input image.

In general, a blurry image has an increased overall brightness, and the brightness difference between the surrounding pixels is not distinguished. This means that the dispersion of the brightness between pixels is reduced, and this can be clearly seen by generating the luminance histogram using the luminance signal.

The average of the luminance of the blurry image is larger than that of the clear image, and the comparison of the histogram spreading from the left and the right shows that the blurry image is smaller. This means that the dispersion of the blurry image is smaller.

A subtracted luminance value is determined such that the difference between the result of subtracting the subtracted luminance value from the luminance signal of the ideal image or the luminance signal of the pre-operative image and the image input during surgery is minimized. In this case, the subtracted luminance value may be determined for each divided region.

The subtraction unit 620 subtracts the subtracted luminance value generated by the subtraction map generator 610 from the luminance value of the input image. In this case, when the input image is divided into a plurality of regions, the subtracted luminance value may be subtracted for each region.

The edge emphasis unit 630 performs edge enhancement on the luminance signal Y " output from the subtraction unit 620. Since the boundary of the image is unclear in the blurry image, outline component improvement is performed to solve this phenomenon. Since many techniques have been proposed for the edge enhancement process such as a Gaussian high frequency filter, a Sobel mask, the description thereof will be omitted in the detailed description of the present invention.

The color space reconstructor 640 generates an RGB signal using the luminance signal output from the edge emphasis unit 630 and the color difference signal C received from the color space converter 600.

The conversion equation from the YCbCr color space to the RGB color space is shown in Equation 2 below.

Figure 112010041881759-pat00002

Subsequently, as a result of subtracting the subtracted luminance value from the input image by the subtractor 620, a phenomenon in which the image is generally dark may occur, and a histogram stretching may be performed to solve this problem.

Histogram stretching extends the range between the minimum and maximum values of the histogram of an RGB image to the maximum range that the imaging device can represent. In general, 8 bits of each R, G, and B channel are extended to have a range of 0 to 255.

So far I looked at the center of the preferred embodiment for the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

In the field of science, such as biology, physics, or engineering, which utilizes an optical stereomicroscope that uses much magnification of the x2-x40 magnification, as well as the medical field, the enlargement device for head mounted surgery according to an embodiment of the present invention is utilized. It can also be applied to industrial situations, for example, in any situation where expansion is necessary, for example, in the inspection of semiconductor production processes.If the application of visible light, infrared light, and ultraviolet light is combined, the image can be obtained in a wider area than the visual confirmation. have. For example, you can view virtual video see-throughs processed through the CCD-LCD path, making digital sunglass and digital night surveillance projections better than looking directly at bright or dark light. Night vision glasses), digital telescopes, and magnifying glasses for altitude myopia correction.

Claims (12)

delete An image processing unit for irradiating at least one light beam of infrared rays, ultraviolet rays, or visible light to the surgical site, digitizing an image of the surgical site using the irradiated light beam, and then enlarging and displaying the image; And
It includes a frame unit for supporting the image processing unit around the eyes of the user so that the user can see the surgical site,
The image processing unit
A filter unit for passing a light beam having a specific wavelength among the light beams coming from the surgical site;
A digital image acquisition unit for digitizing an image of the surgical site by using the passed light beam; And
A display unit configured to enlarge and output the digitized image,
The frame portion
And a light source unit made of an optical fiber for irradiating at least one ray of infrared light, ultraviolet light or visible light to the surgical site.
The method of claim 2,
And an image enlargement unit configured to receive an image digitized by the digital image acquisition unit, enlarge the received image, and then transmit the enlarged image to the display unit to output the enlarged image. Magnification Device.
The method of claim 2,
Further comprising a light generating unit for generating at least one of the infrared rays, ultraviolet rays or visible light irradiated to the surgical site, the optical fiber is used as a passage for moving the light rays from the light generating unit to the light source unit Head Mount Enlarger.
The method of claim 2,
The image processing unit further includes two objective lenses, wherein the two objective lenses are adjusted at least one or more of the distance between the center of the objective lens, the height of the objective lens, or the inclination of the top, bottom, left and right of the objective lens. Head Mount Enlarger.
The method of claim 2,
The image processing unit further comprises two alternative lenses, wherein the two alternative lenses are at least one of the distance between the center of the alternative lens or the height of the alternative lens is adjusted.
The method of claim 2,
The frame unit includes a head fixing unit for supporting the image processing unit around the eyes of the user,
The head fixing unit is any one of the spectacle legs or hair band enlargement apparatus.
The method of claim 2,
And the digital image acquisition unit is either a CCD camera or a CMOS camera, and the display unit is either LCD or OLED.
The method of claim 2,
And the light source unit irradiates the surgical site with a weakened laser beam through the optical fiber.
The method of claim 2,
A subtracted luminance value is generated such that a difference between the luminance value of the ideal image or the luminance value of the pre-operative image and the subtracted subtracted luminance value from the luminance value of the enlarged image is minimized, and then the generated subtracted luminance value is generated. And an image correction unit which subtracts from the luminance value of the enlarged image.
11. The method of claim 10,
And the subtracted luminance value is determined for each divided area of the enlarged image.
The method of claim 2,
And a tracking unit which tracks the surgical region enhanced by the contrast agent to display an outline of the surgical region.

KR1020100061856A 2009-06-30 2010-06-29 Head mouted operating magnifying apparatus KR101190265B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20090059441 2009-06-30
KR1020090059441 2009-06-30

Publications (2)

Publication Number Publication Date
KR20110001952A KR20110001952A (en) 2011-01-06
KR101190265B1 true KR101190265B1 (en) 2012-10-12

Family

ID=43411589

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100061856A KR101190265B1 (en) 2009-06-30 2010-06-29 Head mouted operating magnifying apparatus

Country Status (2)

Country Link
KR (1) KR101190265B1 (en)
WO (1) WO2011002209A2 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090214436A1 (en) 2008-02-18 2009-08-27 Washington University Dichromic fluorescent compounds
EP2806781B1 (en) 2012-01-23 2018-03-21 Washington University Goggle imaging systems and methods
US9729831B2 (en) * 2012-11-29 2017-08-08 Sony Corporation Wireless surgical loupe
US10849710B2 (en) 2014-02-21 2020-12-01 The University Of Akron Imaging and display system for guiding medical interventions
WO2015145395A1 (en) * 2014-03-28 2015-10-01 Alma Mater Studiorum - Universita' Di Bologna Augmented reality glasses for medical applications and corresponding augmented reality system
US10595716B2 (en) * 2014-05-09 2020-03-24 X-Biomedical Inc. Portable surgical methods, systems, and apparatus
WO2016179350A1 (en) 2015-05-06 2016-11-10 Washington University Compounds having rd targeting motifs and methods of use thereof
KR101651995B1 (en) 2016-01-27 2016-08-30 주식회사 썸텍 Glasses-free 3d display
CN106878372B (en) * 2016-11-07 2020-10-02 阿里巴巴集团控股有限公司 Information pushing method and device
US10973391B1 (en) 2017-05-22 2021-04-13 James X. Liu Mixed reality viewing of a surgical procedure
IT201900005110A1 (en) * 2019-04-04 2020-10-04 Eye Tech Lab S R L MONOCULAR DIGITAL MAGNIFIER AND RELATED GLASSES.
WO2021119423A1 (en) 2019-12-13 2021-06-17 Washington University Near infrared fluorescent dyes, formulations and related methods
US11166006B2 (en) 2020-01-22 2021-11-02 Photonic Medical Inc. Open view, multi-modal, calibrated digital loupe with depth sensing
US11298564B2 (en) 2020-03-10 2022-04-12 Dennis M. Anderson Medical, surgical and patient lighting apparatus, system, method and controls with pathogen killing electromagnetic radiation
US11445165B1 (en) 2021-02-19 2022-09-13 Dentsply Sirona Inc. Method, system and computer readable storage media for visualizing a magnified dental treatment site
EP4134659A1 (en) * 2021-08-13 2023-02-15 The Swatch Group Research and Development Ltd Portable modular assembly for inspecting in a timepiece the presence of a lubrication agent or an epilame coating

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003504976A (en) 1999-07-13 2003-02-04 サージビジョン リミテッド Stereoscopic video observation and image enlargement system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1739642B1 (en) * 2004-03-26 2017-05-24 Atsushi Takahashi 3d entity digital magnifying glass system having 3d visual instruction function
KR200374672Y1 (en) * 2004-10-22 2005-02-02 이태종 ophthalmic operating microscope through a infrared
JP2009098570A (en) * 2007-10-19 2009-05-07 Mitaka Koki Co Ltd Head-mount type binocular loupe device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003504976A (en) 1999-07-13 2003-02-04 サージビジョン リミテッド Stereoscopic video observation and image enlargement system

Also Published As

Publication number Publication date
WO2011002209A2 (en) 2011-01-06
KR20110001952A (en) 2011-01-06
WO2011002209A3 (en) 2011-04-21

Similar Documents

Publication Publication Date Title
KR101190265B1 (en) Head mouted operating magnifying apparatus
US9967475B2 (en) Head-mounted displaying of magnified images locked on an object of interest
US11852461B2 (en) Generation of one or more edges of luminosity to form three-dimensional models of objects
US11666238B2 (en) System and method for rapid examination of vasculature and particulate flow using laser speckle contrast imaging
US9645379B2 (en) Magnification in ophthalmic procedures and associated devices, systems, and methods
US20160262605A1 (en) Programmable multispectral illumination system for surgery and visualization of light-sensitive tissues
US7286287B1 (en) Visual aid in the form of telescopic spectacles with an automated focusing device
EP3725254A2 (en) Microsurgery system with a robotic arm controlled by a head-mounted display
US10694117B2 (en) Masking approach for imaging multi-peak fluorophores by an imaging system
KR20100103628A (en) Virtual microscope system for monitoring the progress of corneal ablative surgery and associated methods
JP6893896B2 (en) Medicine-How to activate an optical display system
ES2866074T3 (en) Improved resolution of OCT images during vitreoretinal surgery
KR102009558B1 (en) Goggle system for image guide surgery
Ebner et al. Intraoperative hyperspectral label-free imaging: from system design to first-in-patient translation
US20210297606A1 (en) Medical image processing device and medical observation system
CN211131438U (en) Operation microscope system
US9854963B2 (en) Apparatus and method for identifying one or more amyloid beta plaques in a plurality of discrete OCT retinal layers
WO2019100449A1 (en) Imaging fiber based surgical navigation system
WO2020014999A1 (en) Invisible light display device and optical guidance system for operations
KR101651271B1 (en) Apparatus for photodynamics diagnosis
US20170154418A1 (en) Method of Labeling Invisible Fluorescence by Visible Light with Self-Correction
Ilango et al. User evaluation study on illumination requirements to design an augmented reality projector for open liver surgery
US11730340B2 (en) Video display system having an adaptive overlay
EP4201298A1 (en) Endoscope system with adaptive lighting control
JPWO2019198189A1 (en) Microscope device

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20180105

Year of fee payment: 6

LAPS Lapse due to unpaid annual fee