KR20200111370A - Beam Splitter for Realizing Augmented Reality and Optical System for Realizing Augmented Reality Including the Same - Google Patents

Abstract

Disclosed are a beam splitter for realizing augmented reality and an augmented reality optical system including the same. According to an embodiment of the present invention, an augmented reality optical device comprises: a plurality of image generation units each receiving a preset wavelength range of light reflected by an affected part and generating an image of the affected part; a plurality of image output units each outputting a visible wavelength range of light corresponding to an image generated from each image generation unit; a plurality of lens units each focusing light output from each image output unit; and a plurality of beam splitters for reflecting a preset wavelength range of light incident from the outside to each image generation unit, and transmitting or reflecting a portion of an incident visible wavelength range of light to each pupil of a user while transmitting or reflecting a remaining portion thereof in the direction other than the direction where pupils of the user is positioned, wherein each image generation unit is arranged to be spaced apart by a distance between the pupils of the user.

Description

A beam splitter for realizing augmented reality, and an augmented reality optical system including the same {Beam Splitter for Realizing Augmented Reality and Optical System for Realizing Augmented Reality Including the Same}

The present invention relates to a beam splitter used to realize an augmented reality image and an augmented reality optical system including the same.

The content described in this section merely provides background information on the present embodiment and does not constitute the prior art.

In order to operate on a patient's affected area, conventionally, a doctor performed surgery while visually checking the lesion area through an incision in the affected area. For this, the boundary between the location of the affected area and the surrounding tissues and normal tissues must be accurately determined. However, in conventional surgery performed under open thoracic or open abdomen, doctors used to check the location and boundary of the affected area only by relying on their sight and touch. In this case, even if the doctor analyzes various image data acquired using X-ray, CT, PET, etc. before surgery, it is necessary to accurately check the location of the affected area and the boundary between the normal tissue and the location of the affected part within the living organs during the actual operation. It wasn't easy. Due to this problem, the conventional surgery was performed by analyzing image data and cutting out a certain area around the presumed affected area. Since such a conventional surgery does not precisely cut out only the affected area, but also removes normal tissues, there is a problem that it takes a long time to rehabilitate due to inevitably accompanying the deterioration of the organs associated with the removed part.

As a MIS (Minimally Invasive Surgery) surgery to solve this problem, there is a method in which a doctor continuously operates a C-arm (Portable X-ray) to make sure that the implant and surgical instruments are inserted in the desired direction and position. There is a problem in that the surgeon and manpower in the operating room are exposed to radiation because X-rays must be irradiated several times.

In addition, as a recently developed technology, there is a method in which a 3D CT (Computed Tomography) image is output to an operating room monitor, and the doctor performs an operation while watching it. This method has a problem in that it is difficult for the doctor to perform smooth operation because the 3D CT image output from the monitor must be consulted frequently during surgery.

Due to this problem, various attempts to apply augmented reality technology to medical devices in recent years exist.

According to an embodiment of the present invention, by providing a user with an image of a patient's affected area or an information image of the affected area using augmented reality technology, the user can convert the affected area image or information image about the affected area to augmented reality together with the actual affected area of the patient. An object of the present invention is to provide a beam splitter for realizing an augmented reality that enables recognition and an augmented reality optical system including the same.

Another object of the present invention is to provide a beam splitter for implementing augmented reality that enables a user to recognize an augmented reality image along with an actual affected area even with a simple configuration, and an augmented reality optical system including the same. .

According to an aspect of the present invention, a plurality of image generators for generating an image of the affected area by receiving light in a preset wavelength band reflected from the affected area, and the visible light wavelength band corresponding to the image generated from each image generating unit A plurality of image output units each outputting light, a plurality of lens units each focusing light output from each image output unit, and light of a preset wavelength band incident from the outside are reflected to each image generator, and incident visible light It includes a plurality of beam splitters that transmit or reflect a part of light in the wavelength band to each pupil of the user, and transmit or reflect a part of the light in a direction other than the direction in which the pupil of the user is located, and each image generator It provides an augmented reality optical device, characterized in that it is disposed apart by a space distance.

According to an aspect of the present invention, the plurality of image generators are separated from the center of each beam splitter by a distance from the center of each beam splitter to each pupil of the user.

According to an aspect of the present invention, the plurality of beam splitters transmit part of the light to the user's pupil for light in the visible light wavelength band respectively incident from the outside, and transmit the remaining light to the pupil of the user other than the direction in which the pupil is located. It is characterized by reflecting in the direction.

According to an aspect of the present invention, the plurality of beam splitters reflect part of the light to the user's pupil for light in the visible light wavelength band passing through each lens unit, and the rest of the light in a direction other than the direction in which the user's pupil is located. It is characterized in that it transmits.

According to an aspect of the present invention, the light of the preset wavelength band is characterized in that the infrared or ultraviolet wavelength band.

According to an aspect of the present invention, the plurality of image generators are infrared or ultraviolet cameras.

According to an aspect of the present invention, the image output unit may receive an augmented reality image to be output from the outside and additionally output light in a visible light wavelength band corresponding to the augmented reality image.

According to an aspect of the present invention, in a beam splitter that transmits or reflects light incident in different directions, respectively, reflects only light in a preset first wavelength band incident in a preset first direction, and Characterized in that it comprises a first reflective surface that transmits light other than the set wavelength band and a second reflective surface that reflects a part of light in a preset second wavelength band and transmits the remaining part of light incident in a preset second direction. It provides a beam splitter.

According to an aspect of the present invention, the first reflective surface and the second reflective surface are arranged in different directions.

According to an aspect of the present invention, the preset first direction and the preset second direction are different from each other.

According to an aspect of the present invention, the preset first wavelength band is an infrared or ultraviolet wavelength band.

According to an aspect of the present invention, the preset second wavelength band is a visible light wavelength band.

According to an aspect of the present invention, in a medical augmented reality device, corresponding to an image generating unit generating an image of the affected area by receiving light of a preset wavelength band reflected from the affected area and an image generated from the image generating unit, An image output unit for outputting light in a visible wavelength band, an augmented reality optical device according to any one of claims 1 to 7, and a control unit for controlling the operation of the image generation unit, the image output unit, and the augmented reality optical device, and It provides a medical augmented reality device comprising a power supply for supplying power to each component in the augmented reality device.

According to an aspect of the present invention, a plurality of image generators for generating an image of the affected area by receiving light in a preset wavelength band reflected from the affected area, and the visible light wavelength band corresponding to the image generated from each image generating unit A plurality of image output units each outputting light, a plurality of lens units each focusing light output from each image output unit, and a plurality of first units reflecting light of a preset wavelength band incident from the outside to each image generator Including a beam splitter and a plurality of second beam splitters that transmit or reflect a part of light in the incident visible wavelength band to each pupil of the user, and transmit or reflect a part of the light in a direction other than the direction in which the pupil of the user is located. It provides an augmented reality optical device, characterized in that.

As described above, according to an aspect of the present invention, by providing the user with an image of the patient's affected area or an information image of the affected area using an augmented reality technology, the user can perform without continuous confirmation of a separate output screen during surgery. There is an advantage of being able to recognize an image of the affected area or an information image of the affected area together with the actual affected area of the patient.

In addition, according to an aspect of the present invention, it is possible to implement a simple configuration, there is an advantage that the user can be worn without burden.

1 is a view showing an embodiment of a medical augmented reality device according to an embodiment of the present invention.
2 is a diagram showing the configuration of a medical augmented reality device according to an embodiment of the present invention.
3 is a perspective view and a plan view of an augmented reality optical device according to a first embodiment of the present invention.
4 is a diagram illustrating a path through which visible light is introduced from the outside to the augmented reality optical device according to the first embodiment of the present invention.
5 is a view showing a path through which light of a preset wavelength band is introduced from the outside to the augmented reality optical device according to the first embodiment of the present invention.
6 is a diagram illustrating an optical path through which an augmented reality optical device according to the first embodiment of the present invention outputs an augmented reality image.
7 is a perspective view and a plan view of an augmented reality optical device according to a second embodiment of the present invention.
8 is a perspective view of an augmented reality optical device according to a third embodiment of the present invention.
9 is a view showing a reflection surface of a beam splitter in an augmented reality optical device according to a third embodiment of the present invention.
10 is a diagram illustrating a beam splitter in an augmented reality optical device according to a third embodiment of the present invention and a path of light incident on a first reflective surface of the beam splitter.
11 is a view showing a path of light incident on a beam splitter and a second reflective surface of the beam splitter in the augmented reality optical device according to the third embodiment of the present invention.
12 is a diagram illustrating a path through which visible light is introduced from the outside to an augmented reality optical device according to a third embodiment of the present invention.
13 is a diagram illustrating a path through which light of a preset wavelength band is introduced from the outside to an augmented reality optical device according to a third embodiment of the present invention.
14 is a diagram illustrating an optical path through which an augmented reality optical device according to a third embodiment of the present invention outputs an augmented reality image.
15 is a perspective view of an augmented reality optical device according to a fourth embodiment of the present invention.

In the present invention, various changes may be made and various embodiments may be provided, and specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to a specific embodiment, it is to be understood to include all changes, equivalents, or substitutes included in the spirit and scope of the present invention. In describing each drawing, similar reference numerals have been used for similar elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

The terms used in the present application are used only to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "include" or "have" should be understood as not precluding the possibility of existence or addition of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification. .

Unless otherwise defined, all terms, including technical or scientific terms, used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs.

Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this application. Does not.

In addition, each configuration, process, process, or method included in each embodiment of the present invention may be shared within a range not technically contradicting each other.

1 is a view showing an embodiment of a medical augmented reality device according to an embodiment of the present invention, Figure 2 is a view showing the configuration of a medical augmented reality device according to an embodiment of the present invention.

The medical augmented reality device 100 provides an augmented reality image to a user in a state of being mounted on or not mounted on a user such as a doctor. The augmented reality images provided by the medical augmented reality apparatus 100 include an affected area image that directly outputs only the affected area of the patient and a diseased area information image that outputs information about the condition of the patient's affected area. The user can view the actual image of the affected area viewed through the medical augmented reality device 100 and an augmented reality image provided by the medical augmented reality device 100 together. Accordingly, the user can view an actual image of the affected area and an augmented reality image such as an image of the affected area at once, thereby removing the inconvenience that the user must turn the field of view to separately check the augmented reality image.

The affected area image may be generated as follows. When a patient drinks a reagent containing a substance that emits light only in a preset wavelength band or is applied around the patient's affected area, the affected area reflects light in the preset wavelength band. At this time, when light in a preset wavelength band is irradiated to the affected part, light in the corresponding wavelength band is generated or reflected in the affected part by the material. Using this characteristic, the medical augmented reality apparatus 100 generates an image of the affected area by receiving light in a preset wavelength band and generating an image of the affected area. Here, the preset wavelength band corresponds to a wavelength band other than the visible light wavelength band that the user cannot see, for example, an infrared or ultraviolet wavelength band.

The affected area information image includes the following images. The affected area information image includes an image of an affected area such as X-ray, CT, or MRI, or a basic medical image indicating a patient's condition such as a patient's heart rate.

Referring to FIG. 2, a medical augmented reality apparatus 100 according to an embodiment of the present invention includes an image output unit 210, an optical system 220, a control unit 230, and a power supply unit 240.

The image output unit 210 outputs light corresponding to the augmented reality image. The image output unit 210 receives the augmented reality image (affected area image) generated by the optical system 220 and outputs light corresponding to the augmented reality image. On the other hand, the image output unit 210 is directly connected to the outside such as wired or USB, or through a separate communication unit (not shown) to receive an augmented reality image (affected area information image) from the outside, and the light corresponding to the received augmented reality image. Prints. The image output unit 210 outputs light in the visible wavelength band so that the user can view the augmented reality image.

The augmented reality optical system 220 (hereinafter abbreviated as'optical system') transmits light corresponding to the actual image of the affected area and light (image) output from the image output unit 210 to the user. The optical system transmits light corresponding to the actual image of the affected area incident from the affected area of the patient to the user, so that the user can see the affected area of the patient. At the same time, the optical system 220 generates an affected area image from light having a preset wavelength incident on the optical system 220 and transmits the affected area image generated and output from the image output unit 210 to the user. Accordingly, the user can simultaneously view the affected area image at a location close to the actual affected area together with the actual affected area, thereby recognizing the affected area image as augmented reality. The user can simultaneously check the affected area image while viewing the affected area without having to rotate a separate monitor or the like to check the affected area image. In addition, the optical system 220 transmits the affected area information image output from the image output unit 210 to the user. At this time, it is preferable that the affected area information image is output at a location close to the actual affected area and the affected area image, so that the user does not interfere with viewing the actual affected area and the affected area image. Therefore, the optical system 220 transmits the affected area information image to the user so that it is output at a predetermined distance from the actual affected area and the affected area image. For example, if the actual affected area and the affected area image are located in the center of the user's field of view, the affected area information image may be located outside the user's field of view. A configuration in which the optical system 220 transmits light corresponding to the actual image of the affected part and the augmented reality image to the user will be described in detail with reference to FIGS. 3 to 15.

The controller 230 controls the operation of each of the components 210 and 240. The controller 230 may receive an operation control signal (eg, on/off of the augmented reality device) of each component from the user of the medical augmented reality device 100, and accordingly, control each component to operate. can do.

The power supply unit 240 provides power to each component 210 to 230 so that the components 210 to 230 can operate.

3 is a perspective view and a plan view of an augmented reality optical device according to a first embodiment of the present invention.

Referring to FIG. 3, the optical system 220 according to the first embodiment of the present invention includes a first mirror unit 310, a lens unit 320, 323, 326, 329, a beam splitter 330, and a second mirror unit. It includes 340 and an image generating unit 350. In FIG. 3, for convenience, only a configuration in which an image is incident on one pupil of the user is shown, but symmetrically with respect to the second mirror unit 340 on the opposite side (+y-axis direction) of the second mirror unit 340. 1 A mirror unit 310, a lens unit 320, 323, 326, 329, and a beam splitter 330 are disposed.

The first mirror unit 310 reflects the light output from the image output unit 210 toward the beam splitter 330. The first mirror unit 310 reflects light corresponding to the augmented reality image output from the image output unit 210 in the direction of the beam splitter 330, and the corresponding light passes through the beam splitter 330 to the user's pupil ( 360).

The lens units 320, 323, 326, and 329 focus light reflected from the first mirror unit 310 and incident on the user's pupil 360. The lens units 320, 323, 326, and 329 are disposed on the path of light reflected from the first mirror unit 310 and incident into the user's pupil 360, so that the light is in the form of parallel light. The light is focused so that it can be incident on. As a result, the user can recognize as if an augmented reality image is being output from an infinite position, and the augmented reality image can have a screen size and depth of a wide field of view, and a clear image quality characteristic. The lens units 320, 323, and 326 are disposed between the first mirror unit 310 and the beam splitter 330 to focus light and adjust the optical path, and the lens unit 329 additionally includes the beam splitter 330 and It is disposed between the pupils 360 of the user to focus light and adjust the light path. As shown in FIG. 3, a plurality of spherical lenses may be disposed in the lens unit, and a singular or a small number of aspherical lenses may be disposed.

The beam splitter 330 has a plurality of elements 332 and 336 each including reflective surfaces 334 and 338 at the interface, reflecting all light in a preset wavelength band, and separating light in the visible wavelength band. Reflect or transmit.

The beam splitter 330 includes a first component 332 and a second component 336, and each component includes reflective surfaces 334 and 338 that reflect or transmit light of a specific wavelength band. At this time, each reflective surface 334, 338 may be coated on an interface of each component (a surface in a direction in which each component faces each other) and then bonded to each other between the reflective surfaces, or one of the reflective surfaces may have a specific configuration. After coating on the interface, the other reflective surface and the other component may be sequentially bonded. As such, the reflective surfaces 334 and 338 formed at the interface without each component 332 and 336 of the beam splitter 330 are directly bonded to each other, thereby entering the beam splitter 330 with the presence of the air layer. A problem in which the path of the light is changed does not occur, and a problem in which light is unintentionally totally reflected according to an incident angle of light incident on the beam splitter 330 can be prevented.

The first reflective surface 334 separates incident light in the visible wavelength band at a predetermined ratio, reflects a part, and transmits a part. For example, the first reflective surface 334 may reflect half of the incident visible light wavelength band and transmit half of the light. Accordingly, a part of the light corresponding to the augmented reality image incident on the beam splitter 330 through the lens units 320, 323, and 326 is reflected from the first reflective surface 334 and enters the user's pupil 360 , The rest passes through the first reflective surface 334. Part of the light corresponding to the actual image of the affected part incident from the outside (in the -x-axis direction) is reflected from the first reflective surface 334 and directed to the second mirror part 340, and the rest of the light is reflected by the first reflective surface 334. It penetrates and enters the user's pupil 360. On the other hand, the second reflective surface 338 reflects all the light in the preset wavelength band, while transmitting all the light in the remaining wavelength band. When light in a preset wavelength band, for example, infrared or ultraviolet rays, is incident on the pupil of the human body, it adversely affects the eyeball. Accordingly, light in a preset wavelength band incident from the outside (in the position of the +x axis relative to the beam splitter in FIG. 3) (in the direction of the -x axis) is reflected from the second reflective surface 338 and is reflected by the second mirror unit ( While being directed to 340, light corresponding to the actual image of the affected part incident from the outside passes through the second reflective surface 338. By having such a structure, the beam splitter 330 can provide a user with an actual image and an augmented reality image with a minimum volume.

The second mirror unit 340 reflects the light reflected from the beam splitter 330 or transmitted through the beam splitter 330 to the image generating unit 350. As shown in FIG. 3, the second mirror unit 340 includes light of a preset wavelength band reflected from the beam splitter 330 or a visible light wavelength reflected from the beam splitter 330 or transmitted through the beam splitter 330. The band of light is reflected to the image generator 350. The second mirror unit 340 may be implemented in a triangular shape with an open bottom surface, and both surfaces of the second mirror unit 340 facing the beam splitter 330 reflect light. Since the second mirror unit 340 reflects the light incident through both beam splitters to the image generating unit 350, it is possible to receive both lights with only one image generating unit 350. Accordingly, the optical system 220 may provide a three-dimensional effect or a sense of depth of an augmented reality image to a user even if only one image generating unit 350 is used. In addition, by opening the bottom of the second mirror unit 340, when the augmented reality device including the optical system 220 is mounted on the user, it is possible to improve the fit so that the augmented reality device including the optical system 220 can be completely mounted without being separated from the user.

The image generating unit 350 is disposed vertically above the second mirror unit 340 (+z-axis) and receives light reflected from the second mirror unit 340. The second mirror unit 340 reflects light incident from beam splitters located in both directions (on the y-axis), and only one image generator 350 may be included in the optical system 220. The image generator 350 must separate and receive light, respectively, and include an optical sensor (not shown) that senses only light of a predetermined wavelength band on both sides from the center of the image generator 350. Since the light actually used for image generation is only light in the preset wavelength band, and light in the visible wavelength band is not used, the image generator 350 includes an optical sensor (not shown) that senses only light in the preset wavelength band. do. The image generator 350 senses light of a preset wavelength band incident in each direction including each optical sensor on both sides, and generates an affected area image using the sensed information. The image generation unit 350 generates an image of the affected area and transmits the image to each image output unit 210. Accordingly, each image output unit 210 outputs light corresponding to the generated image of the affected area. Even if a plurality of lights are incident at different positions so that both eyes of the user can recognize each, since the optical system 220 includes one image generating unit 350 to process them, the overall volume of the optical system 220 is reduced. Has. Here, the preset wavelength may be an infrared or ultraviolet wavelength band, and the image generator 350 may be implemented as an infrared or ultraviolet camera, but is not limited thereto.

4 is a diagram illustrating a path through which visible light is introduced from the outside to the augmented reality optical device according to the first embodiment of the present invention.

Light corresponding to the actual image of the affected part from the outside is reflected from the affected part and enters the optical system 220. Light corresponding to the actual image of the affected part is directly incident to the user's pupil 360 through only the beam splitter 330. At this time, the light corresponding to the actual image of the affected area passes through the second reflective surface 338 in the beam splitter 330, but passes through the first reflective surface 334, and part of the light is reflected, and only the rest of the light is in the pupil of the user ( 360). Thus, the user can recognize the actual image of the affected area.

Since the space in which the patient is placed is an environment in which strong illumination is irradiated, when all light is incident into the user's pupil 360 without reducing the amount of light, the user may experience a glare phenomenon. Since the light corresponding to the actual image of the affected part passes through the beam splitter 330 and the amount of light is partially reduced, the optical system 220 may prevent a glare phenomenon.

5 is a view showing a path through which light of a preset wavelength band is introduced from the outside to the augmented reality optical device according to the first embodiment of the present invention.

Light of a preset wavelength band reflected and introduced from the affected part is introduced into the beam splitter 330 and is all reflected to the second mirror part 340 by the second reflective surface 338. Light in a preset wavelength band is reflected back to the image generating unit 350 by the second mirror unit 340 and received by the image generating unit 350. The image generator 350 generates the affected area image and then transmits the generated affected area image to the image output unit 210. The image output unit 210 outputs light corresponding to the image of the affected area, and the user's pupil 360 through the first mirror unit 310, the lens units 320, 323, 326, 329 and the beam splitter 330 Enter the company. Light corresponding to the affected area image is partially reflected from the first reflective surface 334 of the beam splitter 330 and enters the user's pupil 360.

6 is a diagram illustrating an optical path through which an augmented reality optical device according to the first embodiment of the present invention outputs an augmented reality image.

The image output unit 210 receives the affected area information image from the outside and outputs light corresponding to the transmitted augmented reality image. The light output from the image output unit 210 passes through the first mirror unit 310, the lens units 320, 323, 326 and 329, and the beam splitter 330 to enter the user's pupil 360.

Accordingly, the user can simultaneously view an actual image of the affected area and an image of the affected area, and additionally, can additionally view the affected area information image.

7 is a perspective view and a plan view of an augmented reality optical device according to a second embodiment of the present invention.

Referring to FIG. 7, the optical system 220 according to the second embodiment of the present invention does not include a first mirror unit 310 in the configuration of the optical system 220 according to the first embodiment of the present invention. Accordingly, the image output unit 210 disposed together with the optical system 220 according to the second embodiment of the present invention is disposed to face the lens units 320, 323, 326, and 329, and the lens units 320, 323 , 326, 329). Accordingly, the augmented reality apparatus 100 including the optical system 220 according to the second embodiment of the present invention may have a relatively small volume.

8 is a perspective view of an augmented reality optical device according to a third embodiment of the present invention.

Referring to FIG. 8, the optical system 220 according to the third embodiment of the present invention includes lens units 810 and 815, a beam splitter 820, and image generation units 830a and 830b.

The lens units 810 and 815 are output from the image output unit 210 and, in the same manner as the lens units 320, 323, 326, and 329, focus light incident on the user's pupil 360.

The beam splitter 820 directly reflects all of the light in the preset wavelength band incident from the outside to the image generating units 830a and 830b, and the light or image output unit 210 corresponding to the actual image of the affected area incident from the outside Reflects or transmits light (in the visible light wavelength band) corresponding to the augmented reality image output from. The beam splitter 820 includes a plurality of reflective surfaces in one overall configuration, and each reflective surface is disposed in different directions to reflect incident light in different directions. More specifically, it is as follows. The user's pupil 360 and the image generators 830a and 830b are respectively disposed in different directions based on the beam splitter 820. The beam splitter 820 reflects all light of a preset wavelength band incident from the outside to the image generators 830a and 830b (in the example shown in FIG. 8 in the +z-axis direction), while incident from the outside or outputs an image The light in the visible wavelength band output from the unit 210 is transmitted to the user's pupil (360, in the example shown in FIG. 8, the +x axis) and the pupil of the user and the other directions in which the image generators 830a and 830b are not located ( In the example shown in FIG. 8, it is reflected or transmitted through the +y axis). In this way, the beam splitter 820 reflects incident light in different directions, so that light may be incident to the image generator without additional configuration, so that the overall volume of the optical system 220 may be reduced.

The length (a) of the beam splitter 820 in the direction in which light is incident from the outside and the length in a direction perpendicular to the direction in which the image generators 830a and 830b are located based on the direction in which light is incident from the outside (a ) Are the same as each other. For this reason, the length of the optical path until the light in the visible wavelength band passes through the reflective surface and leaves the beam splitter 820 among light incident from the outside, and the light in the preset wavelength band among the light incident from the outside is The lengths of the optical paths reflected from and leaving the beam splitter 820 are the same.

The image generators 830a and 830b receive light in a preset wavelength band reflected from the beam splitter 820 at one side of the beam splitter 820 to generate an affected area image. Unlike the optical system 220 according to the first or second exemplary embodiment of the present invention, the image generators 830a and 830b include a plurality of images to receive light reflected from each beam splitter 820, respectively. At this time, each of the image generators 830a and 830b is disposed at a distance of each pupil of the user.

In addition, the image generating units 830a and 830b are disposed apart from the center of the beam splitter 820 by a distance equal to the distance l between the center of the beam splitter 820 and the pupil 360 of the user. When the image generators 830a and 830b are arranged in this way, the following effects may be obtained. The length of the light path (a+l) incident to the image generators 830a and 830b through the beam splitter 820 and the visible light wavelength band incident outside the beam The lengths (a+l) of the light paths incident on the user's pupil 360 through the splitter 820 become the same. In addition, since the image generators 830a and 830b are disposed at a distance of each pupil space of the user, accordingly, even if the optical system does not have a separate configuration or post-processing process, the user can see the angle of view and depth as if he or she saw it directly. A feeling can be felt, and the affected area image (augmented reality image) generated by the image generating units 830a and 830b and output to the user may express the same depth of depth as the actual affected area without the occurrence of depth distortion. Since the image generators 830a and 830b receive light in the same environment as the user's pupil 360, there is no depth distortion in the affected area image (augmented reality image).

9 is a view showing a reflection surface of a beam splitter in an augmented reality optical device according to a third embodiment of the present invention, and FIG. 10 is a beam splitter and a beam splitter in the augmented reality optical device according to a third embodiment of the present invention. Is a diagram showing a path of light incident on a first reflective surface of, and FIG. 11 is a diagram illustrating a path of light incident on a second reflective surface of a beam splitter and a beam splitter in an augmented reality optical device according to a third embodiment of the present invention. It is a drawing.

The beam splitter 820 includes a first reflective surface 910 and a second reflective surface 920 that are disposed in different directions to reflect incident light in different directions. Both reflective surfaces 910 and 920 are not separated from each other and are disposed in different directions, so that they are all disposed within one beam splitter 820.

The first reflective surface 910 reflects and transmits a part of light in the visible wavelength band that is introduced from the outside or output from the image output unit. The first reflective surface 910 transmits a part of the light introduced from the outside to enter the pupil of the user, or reflects the rest of the pupil and the image generator in the remaining direction (+y axis) where the pupil of the user is not located. In addition, the first reflective surface 910 reflects a part of the light output from the image output unit and enters the pupil into the user's pupil, or transmits the rest in the other direction (+y axis) where the pupil and the image generator are not located. Let it.

The second reflective surface 920 reflects all light of a preset wavelength band introduced from the outside, and transmits all light of the remaining wavelength bands. Accordingly, light of a preset wavelength band incident from the outside is reflected from the second reflective surface 920 and is incident on the image generators 830a and 830b, whereas light corresponding to the actual image of the affected area incident from the outside Is transmitted through the second reflective surface 920.

The beam splitter 820 having the first reflective surface 910 and the second reflective surface 920 may be manufactured as follows.

First, the circle of the beam splitter 820 that does not have any reflective surface is cut in either direction of the first reflective surface or the second reflective surface, and is separated into two parts.

The material according to the optical characteristics that the reflective surface in the cut direction should have is coated on the interface of each separated part.

After coating the material on the interface, index matching bonding is performed on the separated two parts. By performing index matching bonding with a material having the same or similar refractive index as the material coated on each interface, optical errors in the reflective surface can be minimized.

Thereafter, the beam splitter having either the first reflective surface or the second reflective surface is cut in the direction of the other reflective surface, and is divided into two parts again.

The beam splitter 820 is completed by coating a material according to the optical characteristics that the cut reflective surface should have on the interface of each separated part, and index matching bonding the separated two parts again.

Accordingly, the beam splitter 820 may include a plurality of reflective surfaces in one overall configuration, thereby minimizing the volume. In addition, since the beam splitter 820 has reflective surfaces in different directions within one configuration, when light of a preset wavelength band is incident by the beam splitter 820, it is reflected on a reflective surface that reflects all the light. It is reflected, and incident on another reflective surface does not cause a problem in that a part is transmitted and introduced into the pupil of the user.

12 is a diagram illustrating a path through which visible light is introduced from the outside to an augmented reality optical device according to a third embodiment of the present invention.

Light corresponding to the actual image of the affected part from the outside is reflected from the affected part and enters the optical system 220. Light corresponding to the actual image of the affected part is directly incident to the user's pupil 360 through only the beam splitter 820. Thus, the user can recognize the actual image of the affected area.

13 is a diagram illustrating a path through which light of a preset wavelength band is introduced from the outside to an augmented reality optical device according to a third embodiment of the present invention.

Light of a preset wavelength band reflected and introduced from the affected part is introduced into the beam splitter 820 and is all reflected by the second reflective surface 920 to the image generator 830a. The image generator 830a generates the affected area image and then transmits the generated affected area image to the image output unit 210. The image output unit 210 outputs light corresponding to the image of the affected area, and enters the user's pupil 360 through the lens units 810 and 815 and the beam splitter 820. The light corresponding to the affected area image is partially reflected from the first reflective surface 910 of the beam splitter 820 and enters the user's pupil 360.

14 is a diagram illustrating an optical path through which an augmented reality optical device according to a third embodiment of the present invention outputs an augmented reality image.

The image output unit 210 receives the affected area information image from the outside and outputs light corresponding to the transmitted augmented reality image. The light output from the image output unit 210 passes through the lens units 810 and 815 and the beam splitter 820 and enters the user's pupil 360.

Accordingly, the optical system 220 according to the third embodiment of the present invention has the advantage of being able to output an augmented reality image together with an actual image of the affected area while only including a lens, a beam splitter, and an image generator.

15 is a perspective view of an augmented reality optical device according to a fourth embodiment of the present invention.

Referring to FIG. 15, the augmented reality optical apparatus 220 according to the third embodiment of the present invention includes a first beam splitter 1510 and a second beam splitter 1515 instead of a beam splitter 820. As shown in FIG. 15A, the first beam splitter 1510 may be disposed at a position relatively closer to the image output unit 210 than the second beam splitter 1515, and as shown in FIG. 15B, the second beam splitter 1515 ) May be disposed at a position relatively farther from the image output unit 210

The first beam splitters 1510a and 1510b reflect all light of a preset wavelength band incident from the outside (in FIG. 15, the -x axis with respect to the beam splitters) to the image generator. However, unlike the augmented reality optical device 220 according to the third embodiment of the present invention, the image generating unit is arranged in one direction (+z axis in FIG. 15) with respect to the first beam splitters 1510a and 1510b. The user's pupil 360 is not disposed on one axis of the first beam splitters 1510a and 1510b. Accordingly, the first beam splitters 1510a and 1510b reflect only light of a preset wavelength band in the direction in which the image generator is located.

The second beam splitters 1515a and 1515b reflect some of the light in the visible wavelength band incident from the outside (in FIG. 15, the -x axis with respect to the beam splitters), and transmit the remaining part to enter the pupil 360. . However, unlike the augmented reality optical device 220 according to the third embodiment of the present invention, the second beam splitters 1515a and 1515b are not disposed within a single beam splitter, but the first beam splitters 1510a and 1510b ) Are disposed on one side of each to reflect or transmit light in the visible wavelength band.

Each of the first beam splitters 1510a and 1510b and the second beam splitters 1515a and 1515b is disposed to have the same spacing as the spacing of the image generator and the binocular spacing. One of the first beam splitters 1510a and 1510b and the second beam splitters 1515a and 1515b is disposed at a spacing equal to the spacing of the image generator, and the other is disposed at a spacing equal to the binocular spacing. Accordingly, even if the optical system does not have a separate configuration or post-processing process, the user can feel the angle of view and a sense of depth as if they have seen it directly.

Since the beam splitter in the augmented reality optical device 220 according to the fourth embodiment of the present invention separates and arranges the configuration of a beam splitter that reflects or transmits light in a preset wavelength band and light in a visible wavelength band, respectively, Although the volume is slightly larger than that of the beam splitter in the augmented reality optical device according to the third embodiment of the present invention, it has the advantage of being easy to manufacture and capable of mass production.

The above description is merely illustrative of the technical idea of the present embodiment, and those of ordinary skill in the technical field to which the present embodiment belongs will be able to make various modifications and variations without departing from the essential characteristics of the present embodiment. Accordingly, the present exemplary embodiments are not intended to limit the technical idea of the present exemplary embodiment, but are illustrative, and the scope of the technical idea of the present exemplary embodiment is not limited by these exemplary embodiments. The scope of protection of this embodiment should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present embodiment.

100: medical augmented reality device
210: video output unit
220: optical system
230: control unit
240: power supply
310: first mirror unit
320, 323, 326, 329, 810, 815: lens unit
330, 820: beam splitter
340: second mirror unit
350, 830a, 830b: image generator
334, 910: first reflective surface
338, 920: second reflective surface
1510: first beam splitter
1520: second beam splitter

Claims (14)

A plurality of image generators configured to generate an image of the affected area by respectively receiving light in a preset wavelength band reflected from the affected area;
A plurality of image output units respectively outputting light in a visible wavelength band corresponding to an image generated by each image generating unit;
A plurality of lens units respectively focusing light output from each image output unit; And
Reflects light in a preset wavelength band incident from the outside to each image generator, transmits or reflects part of the incident visible light wavelength band to each pupil of the user, and transmits the rest of the light in a direction other than the direction in which the pupil is located. It includes a plurality of beam splitters that transmit or reflect in the direction,
Each image generator is an augmented reality optical device, characterized in that the spaced apart by the pupil distance of the user. The method of claim 1,
The plurality of image generating units,
An augmented reality optical device, characterized in that the distance from the center of each beam splitter to each pupil of the user is separated from the center of each beam splitter. The method of claim 1,
The plurality of beam splitters,
An augmented reality optical device, characterized in that, with respect to the light in the visible light wavelength band incident from the outside, a part of the light is transmitted to the pupil of the user and the rest is reflected in a direction other than the direction in which the pupil of the user is located. The method of claim 1,
The plurality of beam splitters,
An augmented reality optical device, characterized in that for light in the visible light wavelength band passing through each lens unit, a part of the light is reflected to the pupil of the user, and the rest is transmitted in a direction other than the direction in which the pupil of the user is located. The method of claim 1,
Light in the preset wavelength band,
Augmented reality optical device, characterized in that the infrared or ultraviolet wavelength band. The method of claim 5,
The plurality of image generating units,
Augmented reality optical device, characterized in that the infrared or ultraviolet camera. The method of claim 1,
The image output unit,
An augmented reality optical device, characterized in that receiving an augmented reality image to be output from the outside, and additionally outputting light in a visible wavelength band corresponding to the augmented reality image. In a beam splitter that transmits or reflects light incident in different directions,
A first reflective surface that reflects only light in a preset first wavelength band, incident in a preset first direction, and transmits light other than the preset wavelength band; And
A second reflective surface that reflects a part of light in a preset second wavelength band and transmits the remaining part of light incident in a preset second direction
Beam splitter comprising a. The method of claim 8,
The first reflective surface and the second reflective surface,
Beam splitter, characterized in that arranged in different directions from each other. The method of claim 8,
The preset first direction and preset second direction,
Beam splitter, characterized in that different. The method of claim 8,
The preset first wavelength band is,
Beam splitter, characterized in that the infrared or ultraviolet wavelength band. The method of claim 8,
The preset second wavelength band is,
Beam splitter, characterized in that the visible light wavelength band. In the medical augmented reality device,
An image generator configured to generate an image of the affected area by receiving light in a preset wavelength band reflected from the affected area;
An image output unit for outputting light in a visible wavelength band corresponding to the image generated by the image generating unit;
The augmented reality optical device of any one of claims 1 to 7;
A control unit for controlling operations of the image generating unit, the image output unit, and the augmented reality optical device; And
A power supply for supplying power to each component in the augmented reality device
Medical augmented reality device comprising a. A plurality of image generators configured to generate an image of the affected area by respectively receiving light in a preset wavelength band reflected from the affected area;
A plurality of image output units respectively outputting light in a visible wavelength band corresponding to an image generated by each image generating unit;
A plurality of lens units respectively focusing light output from each image output unit;
A plurality of first beam splitters reflecting light of a preset wavelength band incident from the outside to each image generator; And
It includes a plurality of second beam splitters that transmit or reflect a part of light in the incident visible wavelength band to each pupil of the user, and transmit or reflect a part of the light in a direction other than the direction in which the pupil of the user is located. Augmented reality optical device.

Images