KR102321416B1 - Beam Splitter for Realizing Augmented Reality and Optical System for Realizing Augmented Reality Including the Same - Google Patents

Abstract

Disclosed are a beam splitter for realizing augmented reality and an augmented reality optical system including the same.
According to one aspect of this embodiment, corresponding to the image generated from a plurality of image generating unit and each image generating unit for generating an image of the affected part by receiving the light of the preset wavelength band reflected from the affected part, respectively, of the visible light wavelength band A plurality of image output units each outputting light, a plurality of lens units for focusing the light output from each image output unit, respectively, and reflected light of a preset wavelength band incident from the outside to each image generating unit, and incident visible light and a plurality of beam splitters that transmit or reflect a portion of the light in the wavelength band to each pupil of the user and transmit or reflect the remaining portion in a direction other than the direction in which the pupil of the user is located, and each image generating unit includes the user's pupil. It provides an augmented reality optical device, characterized in that it is spaced apart by a spatial distance.

Description

Beam Splitter for Realizing Augmented Reality and Optical System for Realizing Augmented Reality Including the Same}

The present invention relates to a beam splitter used for realizing an augmented reality image and an augmented reality optical system including the same.

The content described in this section merely provides background information for the present embodiment and does not constitute the prior art.

In order to operate on the affected part of the patient, conventionally, the surgeon performed the operation while visually checking the lesion site through an incision of the affected part. For this, the boundary between the location of the affected area and the surrounding and normal tissues must be accurately determined in advance. However, in conventional surgery performed under the open chest or laparotomy, doctors used to check the location and boundaries of the affected area only by relying on their sight and touch. In this case, even if the doctor analyzes various image data acquired using X-ray, CT, PET, etc. before the operation, it is necessary to accurately identify the location of the affected area and the boundary between the normal tissue during the actual operation. was not easy Due to this problem, the conventional surgery was carried out in a method of cutting out a certain area around the area estimated to be the affected area through the analysis of the image data. Since this conventional surgery does not precisely cut out only the affected part, but also removes the normal tissue, there is a problem that it takes a long time to rehabilitate as the function of the organ associated with the removed part is inevitably accompanied.

As a MIS (Minimally Invasive Surgery) operation to solve this problem, there is a method in which the doctor continuously operates the C-arm (Portable X-ray) to check whether the implant and surgical instruments are inserted in the desired direction and position. There is a problem in that the operating surgeon and personnel in the operating room are exposed to radiation because the X-ray must be irradiated several times.

In addition, as a recently developed technology, there is a method in which a 3D computed tomography (CT) image is output to an operating room monitor, and a surgeon performs an operation while watching it. This method has a problem in that it is difficult to proceed smoothly because the doctor must frequently refer to the 3D CT image output from the monitor during the operation.

Due to these problems, there are various attempts to graft augmented reality technology to medical devices in recent years.

One embodiment of the present invention, by providing a user with an image of the affected part or an information image about the affected part to the user using augmented reality technology, the user converts the image of the affected part or the information image about the affected part together with the actual affected part of the patient into augmented reality An object of the present invention is to provide a beam splitter for realizing augmented reality that can be recognized and an augmented reality optical system including the same.

In addition, an embodiment of the present invention has a purpose to provide a beam splitter for realizing augmented reality that allows a user to recognize an augmented reality image with an actual affected part even with a simple configuration, and an augmented reality optical system including the same .

According to one aspect of the present invention, corresponding to the image generated from a plurality of image generating unit and each image generating unit for generating an image of the affected part by receiving light of a preset wavelength band reflected from the affected part, respectively, of the visible light wavelength band A plurality of image output units each outputting light, a plurality of lens units for focusing the light output from each image output unit, respectively, and reflected light of a preset wavelength band incident from the outside to each image generating unit, and incident visible light and a plurality of beam splitters that transmit or reflect a portion of the light in the wavelength band to each pupil of the user and transmit or reflect the remaining portion in a direction other than the direction in which the pupil of the user is located, and each image generating unit includes the user's pupil. It provides an augmented reality optical device, characterized in that it is spaced apart by a spatial distance.

According to an aspect of the present invention, the plurality of image generating units are spaced apart from the center of each beam splitter by a distance from the center of each beam splitter to each pupil of the user.

According to one aspect of the present invention, the plurality of beam splitters transmit a part of the light to the user's pupil for light of a visible light wavelength band incident from the outside, and the remainder other than the direction in which the user's pupil is located. It is characterized in that it reflects in the direction.

According to one aspect of the present invention, each of the plurality of beam splitters reflects a portion of the light to the user's pupil with respect to the light of the visible light wavelength band passing through the lens unit, and the remainder in a direction other than the direction in which the user's pupil is located. It is characterized in that it is permeable.

According to one aspect of the present invention, the light of the preset wavelength band is characterized in that the infrared or ultraviolet wavelength band.

According to an aspect of the present invention, the plurality of image generating units are infrared or ultraviolet cameras.

According to an aspect of the present invention, the image output unit receives an augmented reality image to be output from the outside, and additionally outputs light in a visible light wavelength band corresponding to the augmented reality image.

According to one aspect of the present invention, in the beam splitter for transmitting or reflecting light incident in different directions, only light of a predetermined first wavelength band incident in a predetermined first direction is reflected, A first reflective surface that transmits light other than the set wavelength band and a second reflective surface that reflects a portion of the light of the preset second wavelength band, which is incident in a preset second direction, and transmits the remaining part, characterized in that it comprises: A beam splitter is provided.

According to an aspect of the present invention, the first reflective surface and the second reflective surface are arranged in different directions from each other.

According to an aspect of the present invention, the preset first direction and the preset second direction are different from each other.

According to an aspect of the present invention, the preset first wavelength band is an infrared or ultraviolet wavelength band.

According to an aspect of the present invention, the preset second wavelength band is a visible light wavelength band.

According to one aspect of the present invention, in the medical augmented reality device, corresponding to the image generated by the image generation unit and the image generation unit for generating an image of the affected part by receiving light of a preset wavelength band reflected from the affected part, An image output unit for outputting light in a wavelength band of visible light, the augmented reality optical device of any one of claims 1 to 7, a control unit for controlling operations of the image generating unit, the image output unit, and the augmented reality optical device; It provides a medical augmented reality device comprising a power supply for supplying power to each component in the augmented reality device.

According to one aspect of the present invention, corresponding to the image generated from a plurality of image generating unit and each image generating unit for generating an image of the affected part by receiving light of a preset wavelength band reflected from the affected part, respectively, of the visible light wavelength band A plurality of image output units each outputting light, a plurality of lens units for focusing the light output from each image output unit, respectively, and a plurality of first reflection units for reflecting light of a preset wavelength band incident from the outside to respective image generating units A beam splitter and a plurality of second beam splitters that transmit or reflect a portion of the incident visible light wavelength band to each pupil of the user and transmit or reflect the remaining portion in a direction other than the direction in which the pupil of the user is located. It provides an augmented reality optical device, characterized in that.

As described above, according to one aspect of the present invention, by providing an image of the patient's affected area or an information image about the affected area to the user using augmented reality technology, the user can It has the advantage of recognizing an image of the affected area or an information image of the affected area together with the actual affected area of the patient.

In addition, according to one aspect of the present invention, it can be implemented with a simple configuration, there is an advantage that can be worn without burden on the user.

1 is a diagram illustrating an embodiment of a medical augmented reality device according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a medical augmented reality apparatus according to an embodiment of the present invention.
3 is a perspective view and a plan view of an augmented reality optical device according to a first embodiment of the present invention.
4 is a diagram illustrating a path through which visible light flows from the outside to the augmented reality optical device according to the first embodiment of the present invention.
5 is a diagram illustrating a path through which light of a preset wavelength band is introduced from the outside to the augmented reality optical device according to the first embodiment of the present invention.
6 is a diagram illustrating an optical path for outputting an augmented reality image by the augmented reality optical device according to the first embodiment of the present invention.
7 is a perspective view and a plan view of an augmented reality optical device according to a second embodiment of the present invention.
8 is a perspective view of an augmented reality optical device according to a third embodiment of the present invention.
9 is a diagram illustrating a reflective surface of a beam splitter in an augmented reality optical device according to a third embodiment of the present invention.
10 is a view illustrating a beam splitter in an augmented reality optical device according to a third embodiment of the present invention and a path of light incident to a first reflective surface of the beam splitter.
11 is a diagram illustrating a beam splitter in an augmented reality optical device according to a third embodiment of the present invention and a path of light incident to a second reflective surface of the beam splitter.
12 is a diagram illustrating a path through which visible light is introduced from the outside to the augmented reality optical device according to the third embodiment of the present invention.
13 is a diagram illustrating a path through which light of a preset wavelength band is introduced from the outside to the augmented reality optical device according to the third embodiment of the present invention.
14 is a diagram illustrating an optical path for outputting an augmented reality image by an augmented reality optical device according to a third embodiment of the present invention.
15 is a perspective view of an augmented reality optical device according to a fourth embodiment of the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being “connected” or “connected” to another component, it is understood that the other component may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. It should be understood that terms such as “comprise” or “have” in the present application do not preclude the possibility of addition or existence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification in advance. .

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, each configuration, process, process or method included in each embodiment of the present invention may be shared within a range that does not technically contradict each other.

1 is a diagram illustrating an embodiment of a medical augmented reality apparatus according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a configuration of a medical augmented reality apparatus according to an embodiment of the present invention.

The medical augmented reality apparatus 100 provides an augmented reality image to the user in a state in which the medical augmentation reality device 100 is mounted or not mounted on a user such as a doctor. The augmented reality image provided by the medical augmented reality device 100 includes an affected area image that directly outputs only the affected area of the patient and an affected area information image that outputs information about the condition of the patient's affected area. The user can view the augmented reality image provided by the medical augmented reality device 100 and the actual image of the affected part that can be seen through the medical augmented reality device 100 together. Accordingly, the user can view the augmented reality image such as the actual image of the affected part and the affected part image at once, eliminating the inconvenience of having to turn the user's view to separately check the augmented reality image.

The affected area image may be generated as follows. When a patient drinks a reagent containing a substance that emits light only in a preset wavelength band or is applied around the patient's affected part, the affected part reflects light in the preset wavelength band. At this time, when light of a preset wavelength band is irradiated to the affected part, the affected part generates or reflects light of the corresponding wavelength band by the material. Using these characteristics, the medical augmented reality device 100 generates an image of the affected area by generating an image of the affected area by receiving light of a preset wavelength band. Here, the preset wavelength band corresponds to a wavelength band other than the visible light wavelength band that the user cannot see, for example, an infrared or ultraviolet wavelength band.

The information image of the affected area includes the following images. The information image of the affected area includes images of the affected area such as X-ray, CT, or MRI, and basic medical images that show the patient's condition such as the patient's heart rate.

Referring to FIG. 2 , the medical augmented reality apparatus 100 according to an embodiment of the present invention includes an image output unit 210 , an optical system 220 , a control unit 230 , and a power supply unit 240 .

The image output unit 210 outputs light corresponding to the augmented reality image. The image output unit 210 receives the augmented reality image (the affected part image) generated by the optical system 220 and outputs light corresponding to the augmented reality image. On the other hand, the image output unit 210 is directly connected to the outside, such as wired or USB, or receives an augmented reality image (affected part information image) from the outside using a separate communication unit (not shown), and the light corresponding to the received augmented reality image. to output In order for the user to view the augmented reality image, the image output unit 210 outputs light in a visible light wavelength band.

The augmented reality optical system 220 (hereinafter abbreviated as 'optical system') delivers the light (image) output from the image output unit 210 and the light corresponding to the actual image of the affected part to the user. The optical system transmits light corresponding to the actual image of the affected area incident from the patient's affected area to the user, so that the user can see the patient's affected area. At the same time, the optical system 220 generates an image of the affected part from light of a preset wavelength incident to the optical system 220 , and delivers the image of the affected part that is generated and output from the image output unit 210 to the user. Accordingly, the user can simultaneously view the image of the affected area at a location close to the actual affected area together with the actual affected area, so that the affected area image can be recognized as augmented reality. The user can simultaneously check the image of the affected area while looking at the affected area, without the need to rotate the view of a separate monitor or the like to confirm the image of the affected area. In addition, the optical system 220 delivers the affected part information image output from the image output unit 210 to the user. At this time, it is preferable that the affected part information image is output to a location close to the actual affected part and the affected part image, so that the user does not interfere with viewing the actual affected part and the affected part image. Therefore, the optical system 220 delivers the information to the user so that the image is output at a predetermined distance away from the actual affected area and the affected area image. For example, if the actual affected part and the affected part image are located in the center of the user's field of view, the affected part information image may be located outside the user's field of view. The configuration for the optical system 220 to deliver the light corresponding to the real image and augmented reality image of the affected part to the user will be described in detail with reference to FIGS. 3 to 15 .

The control unit 230 controls the operation of each of the components 210 and 240 . The control unit 230 may receive an operation control signal (eg, on/off of the augmented reality device, etc.) of each component from the user of the medical augmented reality device 100 , and accordingly, control each component to operate. can do.

The power supply unit 240 provides power to each of the components 210 to 230 to enable the respective components 210 to 230 to operate.

3 is a perspective view and a plan view of an augmented reality optical device according to a first embodiment of the present invention.

Referring to FIG. 3 , the optical system 220 according to the first embodiment of the present invention includes a first mirror unit 310 , lens units 320 , 323 , 326 , 329 , a beam splitter 330 , and a second mirror unit. 340 and an image generator 350 . 3 shows only a configuration for injecting an image into one pupil of the user for convenience, but the second mirror unit 340 is symmetrically formed on the opposite side (+y-axis direction) of the second mirror unit 340 . 1 A mirror unit 310 , lens units 320 , 323 , 326 , and 329 , and a beam splitter 330 are disposed.

The first mirror unit 310 reflects the light output from the image output unit 210 toward the beam splitter 330 . The first mirror unit 310 reflects the light corresponding to the augmented reality image output from the image output unit 210 in the beam splitter 330 direction, so that the light passes through the beam splitter 330 to the user's pupil ( 360) so that it can be entered.

The lens units 320 , 323 , 326 , and 329 focus the light reflected from the first mirror unit 310 and incident on the user's pupil 360 . The lens units 320 , 323 , 326 , and 329 are disposed on the path of light reflected from the first mirror unit 310 and incident to the user's pupil 360 , so that the light is reflected in the user's pupil 360 in the form of parallel light. The light is focused so that it is incident on the As a result, the user can recognize as if the augmented reality image is output at an infinite position, and the augmented reality image can have a screen size corresponding to a wide angle of view and a deep and clear picture quality. The lens units 320 , 323 , and 326 are disposed between the first mirror unit 310 and the beam splitter 330 to focus the light and adjust the light path, and the lens unit 329 is additionally a beam splitter 330 and It is disposed between the user's pupil 360 to focus the light and adjust the light path. 3 , a plurality of spherical lenses may be disposed in the lens unit, and a single or a small number of aspherical lenses may be disposed.

The beam splitter 330 is provided with a plurality of components 332 and 336 each including reflective surfaces 334 and 338 at the interface, reflects all of the light of a preset wavelength band, and separates the light of the visible wavelength band. reflect or transmit.

The beam splitter 330 includes a first component 332 and a second component 336 , and each component includes reflective surfaces 334 and 338 for reflecting or transmitting light of a specific wavelength band. At this time, each of the reflective surfaces 334 and 338 may be respectively coated on the interface of each component (the surface in the direction in which each component faces each other) and then bonded to each other between the reflective surfaces. After being coated on the interface, the other reflective surface and the other component may be bonded in turn. As described above, the reflective surfaces 334 and 338 formed at the interface of each component 332 and 336 of the beam splitter 330 without having an air gap are directly bonded to the beam splitter 330 with the presence of an air layer. There is no problem that the path of the light is changed, and the problem that the light is unintentionally totally reflected according to the incident angle of the light incident to the beam splitter 330 can be prevented.

The first reflective surface 334 separates incident light of a visible light wavelength band at a predetermined ratio, reflects a portion and transmits a portion. For example, the first reflective surface 334 may reflect half of the incident visible light wavelength band and transmit half of the light. Accordingly, a portion of the light corresponding to the augmented reality image that is incident on the beam splitter 330 through the lens units 320, 323, 326 is reflected from the first reflective surface 334 and is incident on the user's pupil 360. , the remainder is transmitted through the first reflective surface 334 . Part of the light corresponding to the actual image of the affected part incident from the outside (-x-axis direction) is reflected from the first reflective surface 334 and directed to the second mirror unit 340 , and the rest is reflected by the first reflective surface 334 . It passes through and enters the user's pupil 360 . On the other hand, the second reflective surface 338 reflects all the light of the preset wavelength band, while transmitting all the light of the other wavelength band. When light of a preset wavelength band, for example, infrared or ultraviolet rays is incident on the pupil of the human body, it adversely affects the eyeball. Accordingly, light of a preset wavelength band incident from the outside (in the position of the +x axis with respect to the beam splitter in FIG. 3 ) (in the direction of the -x axis) is reflected by the second reflective surface 338 to the second mirror unit ( While directed to 340 , the light corresponding to the actual image of the affected area incident from the outside is transmitted through the second reflective surface 338 . By having such a structure, the beam splitter 330 may provide a real image and an augmented reality image to the user with a minimum volume.

The second mirror unit 340 reflects the light reflected from the beam splitter 330 or transmitted through the beam splitter 330 to the image generator 350 . As shown in FIG. 3 , the second mirror unit 340 has a wavelength of light in a preset wavelength band reflected from the beam splitter 330 , or a wavelength of visible light reflected from the beam splitter 330 or transmitted through the beam splitter 330 . The band of light is reflected to the image generator 350 . The second mirror unit 340 may be implemented in a triangular shape with an open bottom, and both surfaces of the second mirror unit 340 facing the beam splitter 330 reflect light. Since the second mirror unit 340 reflects the light incident through both beam splitters to the image generating unit 350 , only one image generating unit 350 can receive both lights. Accordingly, the optical system 220 may provide the user with a three-dimensional effect or a sense of depth of the augmented reality image even if only one image generator 350 is used. In addition, when the bottom surface of the second mirror unit 340 is opened, when the augmented reality device including the optical system 220 is mounted on the user, it is possible to improve the wearing comfort so that it can be completely mounted without being separated from the user.

The image generator 350 is disposed vertically above (+z-axis) of the second mirror unit 340 , and receives light reflected from the second mirror unit 340 . In the second mirror unit 340 , light incident from beam splitters located in both directions (on the y-axis) is reflected, and only one image generating unit 350 may be included in the optical system 220 . The image generator 350 must receive light by dividing them, and includes an optical sensor (not shown) that senses only light in a predetermined wavelength band on both sides from the center of the image generator 350 . Substantially, light used for image generation is only light of a preset wavelength band and light of a visible light wavelength band is not used, so the image generator 350 includes an optical sensor (not shown) that senses only light of a preset wavelength band. do. The image generating unit 350 senses light of a preset wavelength band incident in each direction, including each optical sensor on both sides, and generates an image of the affected area using the sensed information. The image generating unit 350 generates an image of the affected area and delivers it to each image output unit 210 . Accordingly, each image output unit 210 outputs a light corresponding to the generated image of the affected area. Even if a plurality of lights are incident to different positions so that both eyes of the user are recognized, since the optical system 220 includes one image generator 350 to process it, the overall volume of the optical system 220 is reduced. has Here, the preset wavelength may be an infrared or ultraviolet wavelength band, and the image generator 350 may be implemented as an infrared or ultraviolet camera, but is not limited thereto.

4 is a diagram illustrating a path through which visible light flows from the outside to the augmented reality optical device according to the first embodiment of the present invention.

Light corresponding to the actual image of the affected area from the outside is reflected from the affected area and is incident on the optical system 220 . The light corresponding to the actual image of the affected part is directly incident on the user's pupil 360 through only the beam splitter 330 . At this time, the light corresponding to the actual image of the affected part passes through the second reflective surface 338 in the beam splitter 330, but passes through the first reflective surface 334, some of the light is reflected, and only the remaining part of the light passes through the user's pupil ( 360) is entered. Thereby, the user can recognize the actual image of the affected part.

Since the space where the patient is placed is an environment irradiated with strong lighting, when all the light is incident on the user's pupil 360 without reducing the amount of light, the user may experience a glare phenomenon. As the light corresponding to the actual image of the affected part passes through the beam splitter 330 and the amount of light is partially reduced, the optical system 220 can prevent glare.

5 is a diagram illustrating a path through which light of a preset wavelength band is introduced from the outside to the augmented reality optical device according to the first embodiment of the present invention.

Light of a preset wavelength band reflected from the affected part and introduced is introduced into the beam splitter 330 , and is all reflected to the second mirror part 340 by the second reflective surface 338 . Light of a preset wavelength band is reflected back to the image generator 350 by the second mirror unit 340 and is received by the image generator 350 . After the image generator 350 generates an image of the affected area, the generated image of the affected area is transferred to the image output unit 210 . The image output unit 210 outputs the light corresponding to the image of the affected area, and passes through the first mirror unit 310, the lens units 320, 323, 326, 329, and the beam splitter 330 to the user's pupil 360. enter into The light corresponding to the affected part image is partially reflected from the first reflective surface 334 of the beam splitter 330 and is incident on the user's pupil 360 .

6 is a diagram illustrating an optical path for outputting an augmented reality image by the augmented reality optical device according to the first embodiment of the present invention.

The image output unit 210 receives the information image of the affected area from the outside, and outputs the light corresponding to the received augmented reality image. The light output from the image output unit 210 passes through the first mirror unit 310 , the lens units 320 , 323 , 326 , and 329 , and the beam splitter 330 , and enters the user's pupil 360 .

Accordingly, the user can view the actual image of the affected area and the affected area at the same time, and can additionally view the information image of the affected area.

7 is a perspective view and a plan view of an augmented reality optical device according to a second embodiment of the present invention.

Referring to FIG. 7 , the optical system 220 according to the second embodiment of the present invention does not include the first mirror unit 310 among the components of the optical system 220 according to the first embodiment of the present invention. Accordingly, the image output unit 210 disposed together with the optical system 220 according to the second embodiment of the present invention is disposed to face the lens units 320 , 323 , 326 , and 329 , and the lens units 320 and 323 . , 326, 329) directly output the light. Accordingly, the augmented reality apparatus 100 including the optical system 220 according to the second embodiment of the present invention may have a relatively small volume.

8 is a perspective view of an augmented reality optical device according to a third embodiment of the present invention.

Referring to FIG. 8 , the optical system 220 according to the third embodiment of the present invention includes lens units 810 and 815 , a beam splitter 820 , and image generators 830a and 830b .

Like the lens units 320 , 323 , 326 , and 329 , the lens units 810 and 815 focus the light output from the image output unit 210 and incident on the user's pupil 360 .

The beam splitter 820 directly reflects all of the light of the preset wavelength band incident from the outside to the image generating units 830a and 830b, and the light or image output unit 210 corresponding to the actual image of the affected part incident from the outside. Reflects or transmits light (in the visible light wavelength band) corresponding to the augmented reality image output from the The beam splitter 820 includes a plurality of reflective surfaces in one overall configuration, and each reflective surface is disposed in different directions to reflect incident light in different directions. More specifically, it is as follows. The user's pupil 360 and the image generators 830a and 830b are respectively disposed in different directions with respect to the beam splitter 820 . The beam splitter 820 reflects all light of a preset wavelength band incident from the outside to the image generators 830a and 830b (in the example shown in FIG. 8 in the +z-axis direction), while incident from the outside or outputting an image. The light of the visible light wavelength band output from the unit 210 is transferred to the user's pupil (360, the +x axis in the example shown in FIG. 8) and the user's pupil and the image generating unit 830a, 830b in the remaining direction ( In the example shown in FIG. 8, it is reflected or transmitted along the +y-axis). As such, the beam splitter 820 reflects the incident light in different directions, so that the light can be incident to the image generator without an additional configuration, so that the overall volume of the optical system 220 can be reduced.

A length (a) in a direction perpendicular to the direction in which the image generators 830a and 830b are located based on a length (a) in a direction in which light is incident from the outside of the beam splitter 820 and a direction in which light is incident from the outside (a) ) are equal to each other. For this reason, the length of the optical path until light of the visible wavelength band among the externally incident light passes through the reflective surface and leaves the beam splitter 820, and the light of the preset wavelength band among the light incident from the outside is reflected on the reflective surface. The lengths of the optical paths from the reflection to leaving the beam splitter 820 are equal to each other.

The image generators 830a and 830b receive light of a preset wavelength band reflected from the beam splitter 820 from one side of the beam splitter 820 to generate an affected part image. Unlike the optical system 220 according to the first or second embodiment of the present invention, a plurality of image generators 830a and 830b are included to receive light reflected from each beam splitter 820 . In this case, the image generators 830a and 830b are disposed apart by the user's respective pupil-pupillary distance.

In addition, the image generators 830a and 830b are disposed apart from the center of the beam splitter 820 by a distance equal to the distance l between the center of the beam splitter 820 and the user's pupil 360 . When the image generators 830a and 830b are arranged in this way, the following effects may be brought about. The length (a+1) of the optical path through which light of a preset wavelength band incident from the outside is incident on the image generators 830a and 830b through the beam splitter 820, and the light of the visible light wavelength band incident from the outside is a beam. The lengths (a+1) of the optical paths incident to the user's pupil 360 through the splitter 820 are equal to each other. In addition, since the image generators 830a and 830b are spaced apart by the user's respective pupillary distance, therefore, even if the optical system does not have a separate configuration or post-processing process, the user can see the angle of view and depth as if he or she directly saw it. A sense can be felt, and the affected part image (augmented reality image) generated by the image generators 830a and 830b and output to the user can express the same sense of depth as the actual affected part without the occurrence of depth distortion. Since the image generators 830a and 830b receive light in the same environment as the user's pupil 360 , distortion of a sense of depth does not occur in the affected part image (augmented reality image).

9 is a view showing a reflective surface of a beam splitter in an augmented reality optical device according to a third embodiment of the present invention, and FIG. 10 is a beam splitter and a beam splitter in an augmented reality optical device according to a third embodiment of the present invention. It is a view showing the path of light incident to the first reflective surface of the, Figure 11 shows the path of light incident to the second reflective surface of the beam splitter and the beam splitter in the augmented reality optical device according to the third embodiment of the present invention it is one drawing

The beam splitter 820 includes a first reflective surface 910 and a second reflective surface 920 arranged in different directions to reflect incident light in different directions. Both the reflective surfaces 910 and 920 are not separated from each other and are disposed in different directions, so that they are all disposed in one beam splitter 820 .

The first reflective surface 910 reflects and transmits a portion of light in a wavelength band of visible light introduced from the outside or output from the image output unit. The first reflective surface 910 transmits a portion of the light introduced from the outside and makes it incident on the user's pupil, or reflects the rest in the remaining direction (+y-axis) in which the user's pupil and the image generator are not located. In addition, the first reflective surface 910 reflects a portion of the light output from the image output unit and makes it incident on the user's pupil, or transmits the remainder in the remaining direction (+y-axis) where the user's pupil and the image generating unit are not located. make it

The second reflective surface 920 reflects all of the light of a preset wavelength band introduced from the outside, and transmits all of the light of the remaining wavelength band. Accordingly, the light of the preset wavelength band incident from the outside is reflected from the second reflective surface 920 and is all incident to the image generators 830a and 830b, whereas the light corresponding to the actual image of the affected part incident from the outside is transmitted through the second reflective surface 920 .

The beam splitter 820 having the first reflective surface 910 and the second reflective surface 920 may be manufactured as follows.

First, a circular shape of the beam splitter 820 having no reflective surface is cut in either direction of the first reflective surface or the second reflective surface, and the beam splitter 820 is divided into two parts.

The material according to the optical properties that the reflective surface in the cut direction should have is coated on the interface of each part separated.

After coating the material on the interface, index matching bonding is performed on the two separated parts. By performing index matching bonding with a material having the same or similar refractive index to the material coated on each interface, the optical error on the reflective surface can be minimized.

Thereafter, the beam splitter having one of the first reflecting surface and the second reflecting surface is cut in the direction of the other reflecting surface, and again divided into two parts.

The beam splitter 820 is completed by coating a material according to the optical characteristics that the cut reflective surface should have on the interface of each separated part, and index matching bonding the two separated parts again.

Accordingly, the beam splitter 820 may include a plurality of reflective surfaces in one overall configuration, and thus the volume may be minimized. In addition, since the beam splitter 820 has reflective surfaces in different directions within one configuration, when light of a preset wavelength band is incident to the beam splitter 820, it is reflected on the reflective surface that reflects all of the light. It is reflected and is incident on other reflective surfaces, and a part is transmitted and does not cause a problem that may be introduced into the user's pupil.

12 is a diagram illustrating a path through which visible light is introduced from the outside to the augmented reality optical device according to the third embodiment of the present invention.

Light corresponding to the actual image of the affected area from the outside is reflected from the affected area and is incident on the optical system 220 . The light corresponding to the actual image of the affected part is directly incident on the user's pupil 360 through only the beam splitter 820 . Thereby, the user can recognize the actual image of the affected part.

13 is a diagram illustrating a path through which light of a preset wavelength band is introduced from the outside to the augmented reality optical device according to the third embodiment of the present invention.

Light of a preset wavelength band reflected from the affected part and introduced is introduced into the beam splitter 820 , and is all reflected to the image generator 830a by the second reflective surface 920 . After the image generator 830a generates an image of the affected area, the generated image of the affected area is transferred to the image output unit 210 . The image output unit 210 outputs the light corresponding to the image of the affected area, and enters the user's pupil 360 through the lens units 810 and 815 and the beam splitter 820 . The light corresponding to the affected part image is partially reflected from the first reflective surface 910 of the beam splitter 820 and is incident on the user's pupil 360 .

14 is a diagram illustrating an optical path for outputting an augmented reality image by an augmented reality optical device according to a third embodiment of the present invention.

The image output unit 210 receives the information image of the affected area from the outside, and outputs the light corresponding to the received augmented reality image. The light output from the image output unit 210 is incident on the user's pupil 360 through the lens units 810 and 815 and the beam splitter 820 .

Accordingly, the optical system 220 according to the third embodiment of the present invention has the advantage of being able to output the augmented reality image together with the actual image of the affected part while including only the lens, the beam splitter and the image generator.

15 is a perspective view of an augmented reality optical device according to a fourth embodiment of the present invention.

Referring to FIG. 15 , the augmented reality optical device 220 according to the third embodiment of the present invention includes a first beam splitter 1510 and a second beam splitter 1515 instead of the beam splitter 820 . As shown in FIG. 15A , the first beam splitter 1510 may be disposed at a position relatively closer to the image output unit 210 than the second beam splitter 1515 , and as shown in FIG. 15B , the second beam splitter 1515 . ) may be disposed at a position relatively farther from the image output unit 210 than

The first beam splitters 1510a and 1510b reflect all of the light of a preset wavelength band incident from the outside (the -x axis relative to the beam splitters in FIG. 15 ) to the image generator. However, unlike the augmented reality optical device 220 according to the third embodiment of the present invention, the image generating unit is disposed in one direction (+z axis in FIG. 15) based on the first beam splitters 1510a and 1510b, The user's pupil 360 is not disposed on one axis of the first beam splitters 1510a and 1510b. Accordingly, the first beam splitters 1510a and 1510b reflect only light of a preset wavelength band in a direction in which the image generator is located.

The second beam splitters 1515a and 1515b reflect part of the visible light wavelength band incident from the outside (the -x axis relative to the beam splitters in FIG. 15), and transmit the remaining part to be incident into the pupil 360. . However, unlike the augmented reality optical device 220 according to the third embodiment of the present invention, the second beam splitters 1515a and 1515b are not disposed within one configuration of the beam splitter, but rather the first beam splitters 1510a and 1510b. ) is disposed on one side of each to reflect or transmit light in the visible wavelength band.

Each of the first beam splitters 1510a and 1510b and the second beam splitters 1515a and 1515b is disposed to have the same distance as that of the image generator and the distance between both eyes. One of the first beam splitters 1510a and 1510b and the second beam splitters 1515a and 1515b is spaced at the same distance as the image generator, and the other is spaced at the same distance as the distance between both eyes. Accordingly, even if the optical system does not have a separate configuration or post-processing process, the user can feel the angle of view and the sense of depth as if he or she had seen it directly.

Since the beam splitter in the augmented reality optical device 220 according to the fourth embodiment of the present invention separates and disposes the beam splitter that reflects or transmits light of a preset wavelength band and light of a visible light wavelength band, respectively, Although it is somewhat bulky compared to the beam splitter in the augmented reality optical device according to the third embodiment of the present invention, it is easy to manufacture and thus has the advantage of enabling mass production.

The above description is merely illustrative of the technical idea of this embodiment, and various modifications and variations will be possible by those skilled in the art to which this embodiment belongs without departing from the essential characteristics of the present embodiment. Accordingly, the present embodiments are intended to explain rather than limit the technical spirit of the present embodiment, and the scope of the technical spirit of the present embodiment is not limited by these embodiments. The protection scope of this embodiment should be interpreted by the following claims, and all technical ideas within the equivalent range should be interpreted as being included in the scope of the present embodiment.

100: medical augmented reality device
210: video output unit
220: optical system
230: control unit
240: power unit
310: first mirror unit
320, 323, 326, 329, 810, 815: lens unit
330, 820: beam splitter
340: second mirror unit
350, 830a, 830b: image generator
334, 910: first reflective surface
338, 920: second reflective surface
1510: first beam splitter
1520: second beam splitter

Claims (14)

A plurality of image generating units that each receive light of a predetermined wavelength band reflected from the affected area to generate an image of the affected area, and are respectively disposed apart by the user's pupillary distance;
a plurality of image output units corresponding to the images generated by each image generating unit, respectively, outputting light in a visible wavelength band;
a plurality of lens units for focusing the light output from each image output unit; and
Reflects light of a preset wavelength band incident from the outside to each image generator, transmits or reflects a portion of the incident visible light wavelength band to each pupil of the user, and transmits the remaining part in a direction other than the direction in which the pupil of the user is located a plurality of beam splitters that transmit or reflect in a direction;
The beam splitter is
a first reflective surface that reflects only light of a preset first wavelength band incident in a first preset direction and transmits light other than the preset first wavelength band; and a second reflective surface that reflects a part of light of a preset second wavelength band incident in a preset second direction and transmits the remaining part, wherein the first reflective surface and the second reflective surface are directed in different directions from each other. Augmented reality optical device, characterized in that the arrangement. According to claim 1,
The plurality of image generating unit,
Augmented reality optical device, characterized in that it is separated from the center of each beam splitter by the distance from the center of each beam splitter to each pupil of the user. According to claim 1,
The plurality of beam splitters,
Augmented reality optical device, characterized in that for light in the visible wavelength band incident from the outside, a portion of the light is transmitted to the user's pupil, and the remainder is reflected in a direction other than the direction in which the user's pupil is located. According to claim 1,
The plurality of beam splitters,
Augmented reality optical device, characterized in that with respect to the light of the wavelength band of visible light passing through the lens unit, a portion of the light is reflected to the user's pupil, and the remainder is transmitted in a direction other than the direction in which the user's pupil is located. According to claim 1,
The light of the preset wavelength band,
Augmented reality optical device, characterized in that the infrared or ultraviolet wavelength band. 6. The method of claim 5,
The plurality of image generating unit,
Augmented reality optical device, characterized in that the infrared or ultraviolet camera. According to claim 1,
The video output unit,
Augmented reality optical device, characterized in that by receiving an augmented reality image to be output from the outside, and further outputting light in a visible light wavelength band corresponding to the augmented reality image. delete delete delete delete delete In the medical augmented reality device,
The augmented reality optical device of any one of claims 1 to 7;
a controller for controlling the operation of the augmented reality optical device; and
Medical augmented reality device, characterized in that it comprises a power supply for supplying power to each component in the augmented reality optical device. delete

Images