JP7408202B1 - Head-mounted viewing device - Google Patents

Abstract

An object of the present invention is to propose a head-mounted viewing device that allows images captured by a near-infrared camera to be viewed without any discomfort and that can efficiently perform work to observe objects that cannot be seen with the naked eye. [Solution] First and second prisms 33 and 43 that allow left and right lines of sight S1 and S2 of the wearer to pass forward, respectively, a near-infrared camera 34 that is arranged adjacent to the first prism 33 on one of the left and right sides, and a near-infrared camera 34 that is arranged adjacent to the first prism 33 on the left and right sides, and The monitor 51 is arranged adjacent to the second prism 43, and the near-infrared image captured by the near-infrared camera 34 is displayed on the monitor 51. The optical axis P1 can be refracted to match the line of sight S1 on one of the left and right sides, and the second prism 43 on the other side can make the near-infrared image displayed on the monitor 51 visible with the line of sight S2 on the other side. [Selection diagram] Figure 7

Description

The present invention relates to a head-mounted visual recognition device that makes things that cannot be seen with visible light visible using light in the near-infrared wavelength range so that the wearer can see them.

For example, in the medical field, when medical personnel draw blood or administer an intravenous drip, it may be difficult to see the blood vessel that is being punctured by the needle, and in such cases, methods such as tactile sensation of the finger can be used to confirm the position of the blood vessel. be exposed. However, since this method requires experience, inexperienced medical personnel sometimes fail to puncture the needle and have to re-insert it, creating a burden on the patient. In order to solve this problem, for example, a device disclosed in Patent Document 1 has been proposed. Such a conventional device includes an imaging device that captures a near-infrared image, and a monitor device that displays the image captured by the imaging device, and when the device is worn on glasses, the monitor device is placed in front of one lens. The monitor means is arranged so that near-infrared images can be viewed on the monitor means. By using this conventional configuration, medical personnel can image blood vessels with the imaging means, and by viewing the near-infrared image reflected on the monitor with one eye, they can confirm the position of blood vessels that are invisible to the naked eye. .

JP2015-58221A

In the conventional configuration of Patent Document 1 mentioned above, the imaging means for capturing a near-infrared image is disposed on the glasses so as to be located between the left and right lenses, so that visual observation with both the left and right eyes is possible. It is possible to capture an image in a line-of-sight direction that is similar to the above. However, since the optical axis of the imaging means does not coincide with either the left or right line of sight, when the image taken by the imaging means is displayed on a monitor placed in front of one of the left and right eyes, the appearance with the left and right eyes may change. It is easy to feel uncomfortable. Particularly, when viewing the monitor means with one eye and viewing an object with the other eye, the images seen with each eye do not match and appear blurred. For this reason, it is sometimes difficult to accurately specify the position of a blood vessel that is invisible to the naked eye, and there has been a limit to the efficiency of the work of accurately specifying the position of the blood vessel. Furthermore, since the conventional configuration described above can observe things that cannot be seen with the naked eye, it can be applied not only to blood sampling and intravenous drip sites, but also to other medical sites, construction sites, and research and development sites that require non-destructive observation. However, there is a possibility that the same problem as mentioned above may occur.

The present invention provides a head-mounted viewing device that allows images captured by an imaging device to be viewed without any discomfort in the same way as when viewed with the naked eye, and that allows for efficient observation of objects that cannot be seen with the naked eye. This is a proposal.

The present invention provides a head-mounted part that is mounted on the head of a wearer, a left and right line-of-sight passing member that is attached to the head-mounted part and allows the left and right lines of sight of the wearer to pass forward, respectively, and one of the left and right lines of sight. an imaging means disposed adjacent to the line-of-sight passing member and configured to acquire image data by receiving invisible light through the line-of-sight passing member; and an image display means for displaying an image based on the image data acquired by the means, wherein one of the left and right line of sight passage members allows one of the right and left lines of sight of the wearer to pass forward, and the image pickup means. The device is equipped with a prism that refracts the optical axis forward, and the other left and right line of sight passing members allow the other left and right lines of sight of the wearer to pass forward, and also allow the image displayed by the image display means to pass through to the front. This is a head-mounted visual recognition device characterized by being equipped with a prism that allows visual recognition with the line of sight. Here, invisible light refers to light in a wavelength range other than the wavelength range of visible light that can be seen with the naked eye.

In such a configuration, the optical axis of the imaging means can be made to coincide with one of the left and right line of sight by the prism, and this coincidence allows the imaging means to take an image from the wearer's line of sight. By displaying an image captured by such an imaging device (hereinafter referred to as an invisible light image) on an image display device, a wearer can visually see an object through a prism with one eye, and can also see an object with the other eye. Since the invisible light image can be viewed, the object seen with visible light and the invisible light image (the image captured by the imaging means) can be viewed in a superimposed manner. Here, in this configuration, since the optical axis of the imaging means can match the line of sight, the invisible light image displayed by the image display means matches the object seen with visible light, so that the wearer can see both without feeling discomfort. be able to. Thereby, things that cannot be seen with the naked eye (visible light) can be accurately and easily seen.

According to the configuration of the present invention, the accuracy and efficiency of work can be improved by being used at the above-described medical sites, construction sites, and research and development sites. For example, even if the position of a blood vessel cannot be confirmed with the naked eye in a medical field such as blood sampling described above, the configuration of the present invention allows the position of the blood vessel to be accurately and easily identified. Further, according to the configuration of the present invention, even cancers that cannot be visually recognized with the naked eye can be detected accurately and easily, which can greatly contribute to early detection and early treatment. Furthermore, by using the configuration of the present invention, cancer can be visually recognized in real time, and treatment (surgery, etc.) can also be performed.

In the above-mentioned head-mounted visual recognition device of the present invention, the prism of the line-of-sight passing member has an integrated cubic shape made by overlapping two right-angled prisms with their slopes overlapping each other, and the slopes include: A transmissive/reflective means is provided that separates light incident from the front side into transmitted light that is transmitted to the back side and reflected light that is reflected. The prism is arranged so that the optical axis of the imaging means is refracted forward by the slope having the transmissive reflection means, and the sight line passing member on the other side is arranged so that the prism can display an image displayed on the image display means by the slope having the transmissive reflection means. A configuration is proposed in which the light is reflected so as to be visible from the left and right lines of sight.

In such a configuration, the wearer receives the transmitted light that has passed through the prisms of the left and right line-of-sight passing members, and the imaging means receives the reflected light reflected by the prisms. You can stably capture images from the same eye level. The prisms of the other left and right line-of-sight passing members reflect the image displayed by the image display means, so that the wearer can stably view the image. Therefore, according to this configuration, the effects of the present invention described above can be stably exhibited.

In the head-mounted visual recognition device of the present invention, as described above, the optical axis of the imaging means can be made to coincide with the line of sight of the wearer, and this coincidence allows the imaging means to take an image from the wearer's line of sight. Therefore, this captured invisible light image can be superimposed on the object to be viewed through a prism. As a result, the wearer can visually recognize the invisible light image captured by the imaging means along with the object without feeling uncomfortable, and can accurately and easily perform desired operations (treatments) on objects that cannot be seen with the naked eye. The accuracy and efficiency of the work can be improved.

FIG. 1 is a perspective view showing a head-mounted visual recognition device 1 according to an embodiment. They are (A) a plan view and (B) a front view of the head-mounted visual recognition device 1. FIG. 2 is a side view showing a state in which the head-mounted visual recognition device 1 is worn. They are (A) a plan view with the right side housing 31 cut away and a front view (B) of the right line-of-sight imaging main body 22 with the right side housing 31 cut away. They are (A) a plan view showing the left side housing 41 cut away, (B) a front view showing the left side housing 41 cut away, and (C) a front view of the left line-of-sight imaging main body 23. (A) A perspective view showing the first prism 33 of the right line-of-sight imaging body 22, (B) an exploded perspective view of the first prism 33, and (C) a perspective view showing the second prisms 43, 43 of the left line-of-sight imaging body 23. and (D) an exploded perspective view of second prisms 43, 43. 3 is an explanatory diagram showing the wearer's line of sight S1, S2 and the optical axis P1 of a near-infrared camera 34 in the head-mounted visual recognition device 1. FIG. FIG. 6 is an explanatory diagram showing a visual image display system 61. FIG. 6 is an explanatory diagram showing an example of display on an image display device 64 of a visual image display system 61. FIG.

Embodiments embodying the present invention will be described with reference to the accompanying drawings. In addition, in the embodiment, the front and rear directions refer to the front and back directions of the wearer who wears the head-mounted visual recognition device 1 of the embodiment, and the left and right similarly refer to the left and right of the wearer. The left-right direction that is orthogonal to the front-rear direction and the up-down direction (vertical direction) is called the left-right and lateral direction. Further, in the left-right direction, the direction from the left and right outside toward the center of the wearer is defined as inward. Furthermore, in the embodiments, the terms "front" and "front" are used interchangeably.

As shown in FIGS. 1 to 3, the head-mounted visual recognition device 1 of the embodiment includes a transparent shield portion 4 disposed in front of both eyes of a wearer 101 to cover both eyes, and a transparent shield portion 4 disposed in front of both eyes of a wearer 101, and a transparent shield portion 4 disposed in front of both eyes of a wearer 101, and The protective goggles 2 are integrally provided with a frame part 3 which is attached to the wearer's head by being hung on the wearer's head. A line-of-sight imaging unit 6 and a lighting device 7 are attached to the center of the frame portion 3 via a connecting member 5, and the line-of-sight imaging unit 6 and lighting device 7 are integrally provided.

The connecting member 5 includes a base portion 11 fixed to the frame portion 3 of the safety glasses 2, a support rod portion 12 provided on the base portion 11 so as to be tiltable in the vertical direction, and the support rod portion 12 inserted therethrough. The sliding part 13 is provided with a vertically elongated hole. A positioning portion 15 is rotatably screwed onto the tip of the support rod portion 12, and by fastening the positioning portion 15, the vertical position of the sliding portion 13 relative to the support rod portion 12 can be fixed; By releasing the fastening of the positioning part 15, the sliding part 13 can be moved in the vertical direction with respect to the support rod part 12. The illumination device 7 is attached to the sliding portion 13 so as to be tiltable in the vertical direction, and the line-of-sight imaging unit 6 is integrally attached to the illumination device 7. By tilting the support rod part 12 with respect to the base 11, the connecting member 5 can integrally tilt the support rod part 12, the sliding part 13, the illumination device 7, and the line-of-sight imaging unit 6 in the front-rear direction. . By tilting the line-of-sight imaging unit 6, the distance between it and both eyes of the wearer 101 can be changed. Further, by sliding the sliding portion 13 in the vertical direction with respect to the support rod portion 12, the sliding portion 13, the illumination device 7, and the line-of-sight imaging unit 6 can integrally slide in the vertical direction. Furthermore, by tilting the illumination device 7 in the vertical direction with respect to the sliding portion 13, the illumination device 7 and the line-of-sight imaging unit 6 can be tilted in the vertical direction as a unit, allowing the wearer to view them as desired. It can be tilted at an angle of

The lighting device 7 includes a lighting support part 17 tiltably attached to the sliding part 13, a visible light light 18 that emits visible light, and a near-infrared light (light in the near-infrared wavelength range). The visible light light 18 and the near-infrared light 19 are supported by the illumination support section 17. The visible light light 18 and the near-infrared light light 19 are configured to respectively irradiate light onto an object (view point T of the wearer) viewed through the first and second prisms 33 and 43 of the line-of-sight imaging unit 6. It is located. The visibility of the object can be improved by emitting visible light from the visible light light 18, while the near-infrared camera 34, which will be described later, can improve the visibility of the object by emitting near-infrared light from the near-infrared light 19. Images can be taken. Note that an ON/OFF switch, a power source, etc. (not shown) are connected to these lights 18 and 19 via cables, respectively.

Next, the line-of-sight imaging unit 6 according to the main part of the present invention will be explained.
As shown in FIGS. 1 to 3, the line-of-sight imaging unit 6 includes a guide support member 21 attached to the illumination support section 17 of the illumination device 7, and left and right line-of-sight image capture bodies 22 supported by the guide support member 21, respectively. , 23.

The guide support member 21 is formed in an elongated shape in the left-right direction, and its center portion in the left-right direction is fixed to the illumination support portion 17 . The guide support member 21 is formed symmetrically with respect to the center, and has a first guide slot 25 and a second guide slot 26 on both sides. The first guide elongated hole portion 25 is an elongated hole opened linearly in the left-right and lateral directions, and passes through the guide support member 21 in the up-down direction. The left and right first guide elongated holes 25 are respectively provided in front positions of the left and right eyes of the wearer when the wearer wears the wearer. The second guide slot 26 is a slot formed on the outside of the first guide slot 25 and linearly inclined forward with respect to the first guide slot 25, and is a slot for the guide support member. 21 in the vertical direction.

The right line-of-sight imaging main body 22 includes a right casing 31 that is slidably supported by the guide support member 21 in the left-right direction, a magnifying glass section 32 attached to the front part of the right casing 31, and a right casing 31. and a first prism 33 (see FIG. 4) disposed inside the body 31. Furthermore, a near-infrared camera 34 is disposed inside the right housing 31 (see FIG. 4). The right side housing 31 includes a first housing part 31a arranged on the inside (closer to the lighting device 7), and a second housing connected to the outside of the second housing part 31b via a connecting cylinder part 31c. The inside of the first housing part 31a and the inside of the second housing part 31b are communicated with each other through the inside of the connecting cylinder part 31c.

Here, in the first prism 33 disposed in the first housing part 31a, as shown in FIGS. It is a so-called cube-shaped beam splitter. The slope 38a of the first prism 33 is coated with a mirror coating having a transmittance (transparency) of 0 to 50%. As shown in FIGS. 4 and 7, the first prism 33 is disposed inside the first housing portion 31a so that the slope 38a is inclined inwardly and forwardly in front of the wearer's eyes. The front surface of the first prism 33 is arranged to face the magnifying glass section 32 attached to the front section of the first housing section 31a. The first prism 33 has an antireflection coating on its front, rear, and right side surfaces, and has black coating on the other three surfaces to suppress input and output of light.

As shown in FIG. 4, openings (not shown) facing the first prism 33 inside are formed in the front and rear parts of the first housing part 31a, respectively, as shown in FIG. The magnifying glass section 32 is provided. The magnifying glass section 32 has a substantially truncated conical lens barrel and two lenses arranged in parallel at the front and rear ends of the lens barrel, and the lens at the rear end is connected to the first housing section 31a. The first housing portion 31a is integrally attached to the first housing portion 31a so as to face the opening in the front surface of the first housing portion 31a.

Furthermore, as shown in FIGS. 1 to 4, the first housing portion 31a includes a rod portion that projects upward from the top surface and is inserted into the first guide elongated hole portion 25 of the guide support member 21. A support rod portion 35 is provided on the first guide elongated hole portion 25 and has a fixing portion that is screwed onto the upper portion of the rod portion and cannot be inserted into the first guide elongated hole portion 25 . By tightening the fixing part of the support rod part 35, the first housing part 31a can be positioned and fixed to the guide support member 21, while by releasing the tightening of the fixing part, the first housing part 31a can be fixed to the guide support member 21. It can be relatively moved along the first guide slot 25. Similarly, the second housing portion 31b includes a rod portion that projects upward from the upper surface thereof and is inserted into the second guide slot 26 of the guide support member 21, and a rod portion that is inserted into the second guide slot 26 of the guide support member 21. A support rod portion 36 is provided which is screwed onto the upper portion of the rod portion and has a fixed portion that cannot be inserted into the second guide elongated hole portion 26 . By tightening the fixing portion of the support rod portion 36, the second housing portion 31b can be positioned and fixed to the guide support member 21, while by releasing the tightening of the fixing portion, the second housing portion 31b can be fixed to the guide support member 21. It can be relatively moved along the two guide elongated holes 26.

The right line-of-sight imaging main body 22 is suspended by support rods 35 and 36 inserted into the first and second guide slots 25 and 26 of the guide support member 21, respectively. The line-of-sight imaging main body 22 is movable in the left and right directions with the fixed parts of both support rod parts 35 and 36 not tightened, and the fixed part of at least one of the support rod parts 35 and 36 is tightened. The position is determined by When the line-of-sight imaging main body 22 is moved left and right in this untightened state, the line-of-sight imaging main body 22 moves in the left-right and lateral directions, and the respective support rods 35 inserted into the first guide elongated holes 25 are moved. It tilts forward and backward around the center.

On the other hand, the left line-of-sight imaging main body 23 includes a left housing 41 that is slidably supported by the guide support member 21 in the left-right direction, and a magnifying glass part 32 that is attached to the front part of the left housing 41 that is closer to the inside. , and second prisms 43, 43 (see FIG. 5) disposed inside the left housing 41, respectively. Further, inside the left housing 41, an eyeball camera 44 is disposed, and a monitor 51 and a lens 52 are disposed side by side (see FIG. 5).

Here, inside the left housing 41, as shown in FIG. The other second prism 43 is arranged to the left (outside) of one of the second prisms 43. These second prisms 43, 43 are formed of two right-angled prisms 38, 38, as shown in FIGS. It is a cube with a mirror coating having a transmittance (transparency) of 0 to 50% on the slope 38a. As shown in FIG. 4, the two second prisms 43, 43 are disposed inside the left housing 41 so that the slope 38a is inclined inwardly and rearward in front of the eyes of the wearer. One of the second prisms 43 (just behind the magnifying glass part 32) has an anti-reflection coating on the front, rear, and left side surfaces, and black coating on the other three surfaces to suppress the input and output of light. administered. The other second prism 43 has antireflection coating applied to its front, right side, and left side, and black coating applied to the other three sides to suppress input and output of light.

As shown in FIG. 5, in the left side housing 41, openings (not shown) facing the aforementioned (inner) second prism 43 are formed in the front and rear parts, respectively. The magnifying glass section 32 is provided on the front surface. This loupe section 32 has the same configuration as that disposed in the right line of sight imaging main body 22, and is arranged on the left side so that the lens at the rear end faces the opening in the front part of the left side housing 41. It is integrally attached to the housing 41. Further, the left side housing 41 is provided with a support rod portion 35 that projects upward from the upper surface closer to the inside, and a support rod portion 36 that projects upward from the upper surface closer to the outside. These support rod portions 35 and 36 have the same configuration as the support rod portions 35 and 36 provided on the right line-of-sight imaging main body 22 described above, respectively.

The left line-of-sight imaging body 23, like the right side line-of-sight imaging body 22 described above, is supported by support rods 35 and 36 inserted into the first and second guide elongated holes 25 and 26 of the guide support member 21, respectively. Hanged. The line-of-sight imaging main body 23 is positioned by tightening the fixed portion of at least one of the support rod portions 35 and 36. When the line-of-sight imaging main body 23 is moved left and right with both support rods 35 and 36 not tightened, the line-of-sight imaging main body 23 moves in the left-right and lateral directions and in the front-rear direction centering on the support rods 35. tilt to

Note that the positions, dimensions, shapes, etc. of the support rods 35, 36 of the line-of-sight imaging bodies 22, 23 and the first and second guide elongated holes 25, 26 of the guide support member 21 are determined based on the line-of-sight imaging bodies 22, 23, respectively. 23 is set so that the position T (hereinafter referred to as the viewpoint) where the lines of sight S1 and S2 intersect, which pass through the first and second prisms 33 and 43, does not substantially change as will be described later.

Furthermore, as shown in FIG. 4, in the aforementioned right line-of-sight imaging main body 22, a near-infrared camera 34 is disposed in the second housing portion 31b and the connecting cylinder portion 31c. The near-infrared camera 34 is capable of capturing images by receiving light in the near-infrared wavelength range, and includes a main body portion provided with an image sensor and a lens barrel portion provided with a lens. You can adjust the focus by changing the distance. Such a near-infrared camera 34 is provided such that the lens of the lens barrel section faces the right side surface of the first prism 33. Further, in this embodiment, a disk-shaped operation plate portion 37 for adjusting the focus is provided on the connecting cylinder portion 31c. The near-infrared camera 34 has a focal length, an F value (aperture), etc., so that the focus can be adjusted from the viewpoint T of the wearer through the magnifying glass part 32.

A cable 40 is connected to the near-infrared camera 34, and is connected to a communication control device 39 via the cable 40. As shown in FIGS. 1 and 4, this cable 40 is extended from the second housing section 31b, connected to the frame section 3 of the safety glasses 2, and connected to the communication control device 39 held by the wearer. be done. A signal instructing the near-infrared camera 34 to take an image and image data taken by the near-infrared camera 34 are transmitted and received between the near-infrared camera 34 and the communication control device 39 via the cable 40. Power is supplied from the communication control device 39 to the near-infrared camera 34 . The communication control device 39 includes a switch for causing the near-infrared camera 34 to take an image, a power source, a wireless communication function, and the like, and uses the wireless communication function to communicate image data input from the near-infrared camera 34 via a network. Can be done.

As shown in FIG. 5, in the left housing 41 of the left line-of-sight imaging main body 23, an eyeball camera 44 is disposed outside the other (outside) second prism 43. The eyeball camera 44 is capable of receiving visible light (light in the visible wavelength range) to take an image, and includes a main body portion provided with an image sensor and a lens barrel portion provided with a lens. A second lens is provided so as to face the left side surface of the second outer prism 43. Here, the eyeball camera 44 has a focal length, an F value (aperture), etc. determined so that the eyeball of the wearer can adjust the focus via the second prisms 43, 43.

Further, inside the left side housing 41, a monitor 51 is disposed immediately in front of the second prism 43 on the outside, and a lens 52 is disposed between the second prism 43 and the monitor 51. ing. Here, the lens 52 is disposed opposite to the front surface of the second prism 43 on the outside, and the monitor 51 is disposed opposite to the front surface of the second prism 43 via the lens 52. Here, as will be described later, the monitor 51 is an extremely small device that displays an image captured by the above-mentioned near-infrared camera 34, and the lens 52 enlarges and displays the image displayed on the monitor 51. .

As shown in FIGS. 1 and 5, cables 48 and 49 are connected to the eyeball camera 44 and monitor 51, respectively, and are connected to the communication control device 39 via the cables 48 and 49. There is. Similarly to the near-infrared camera 34 described above, the eyeball camera 44 and the monitor 51 transmit and receive signals and data to and from the communication control device 39 via cables 48 and 49, and control the communication. Power is supplied from device 39. Here, on the monitor 51, an image displayed by the near-infrared camera 34 is displayed by the communication control device 39. That is, the communication control device 39 is provided with display control means for displaying an image on the monitor 51 based on the image data transmitted from the near-infrared camera 34. Thereby, on the monitor 51, an image captured by the near-infrared camera 34 (hereinafter referred to as a near-infrared image) can be displayed in real time.

Since the left and right line-of-sight imaging bodies 22 and 23 are configured to include the first and second prisms 33 and 43, the objects located in front of the wearer's line-of-sight S1 and S2 can be detected by the loupe section 32. , 32, the wearer can take an image using the near-infrared camera 34 and the eyeball camera 44, and view the near-infrared image displayed on the monitor 51.

To be more specific, in the right line-of-sight imaging main body 22, the first prism 33 converts the incident light that enters from the front via the magnifying glass section 32 into transmitted light that passes through the slope 38a of the first prism 33, and the transmitted light that passes through the slope 38a of the first prism 33. It is divided into reflected light that is reflected outward (to the right). As a result, as shown in FIG. 7, the line of sight S1 of the right eye passes through the first prism 33, and the optical axis P1 of the near-infrared camera 34 coincides with the line of sight S1 of the right eye passing through the first prism 33. Because of this, the near-infrared camera 34 can take images from the wearer's line of sight.

In the left line-of-sight imaging main body 23, the incident light that enters from the front via the magnifying glass part 32 passes through the second prism 43 on the inside, and the light emitted from the monitor 51 passes through the slope 38a of the second prism 43 on the outside. It is reflected and refracted inward (to the right), and then reflected by the slope 38a of the inner second prism 43 and refracted backward. As a result, the line of sight S2 of the left eye passes through the inner second prism 43 and the near-infrared image displayed on the monitor 51 can be seen, so the left eye can see the object and the near-infrared image. You can view it over and over again. Here, as described above, since the near-infrared image captured by the near-infrared camera 34 is displayed on the monitor 51 in real time, the wearer can view the image (as seen with visible light) visually with the left and right lines of sight S1 and S2. image) and an image captured by the near-infrared camera 34 (an image visible with light in the near-infrared wavelength range) appear superimposed. Note that the lens 52 disposed immediately behind the monitor 51 is used to adjust the near-infrared image displayed on the monitor 51 to a size that can be viewed through the magnifying glass section 32.

Further, as described above, the outer second prism 43 reflects the light from the monitor 51 on the slope 38a, and transmits the light in the horizontal direction on the slope 38a. As a result, the optical axis P2 of the eyeball camera 44 passes through the second prism 43 on the outside and is refracted backward at the second prism 43 on the inside, so that the wearer's left eyeball can be imaged from approximately the front. It can be done from This eyeball camera 44 focuses on the left eye, captures a moving image of the left eye, and transmits image data of the moving image to the communication control device 39 .

The head-mounted visual recognition device 1 of this embodiment can be used by the wearer by wearing the protective glasses 2 on the wearer's head and placing the line-of-sight imaging unit 6 in front of the wearer's eyes. (See Figure 3). Then, the wearer operates the connecting member 5 to move the line-of-sight imaging unit 6 up and down or tilt it in the front-back direction, thereby bringing the line-of-sight imaging unit 6 and the illumination device 7 to desired positions. Furthermore, by operating the left and right line-of-sight imaging bodies 22, 23, the first and second prisms 33, 43 (and loupe sections 32, 32) of each line-of-sight imaging body 22, 23 are placed in front of the left and right eyes, respectively. By positioning the left and right line-of-sight imaging bodies 22, 23 in accordance with the wearer's eyes, the lines of sight S1, S2 are aligned with the first and second prisms 33, 43 and the loupe portion, as shown in FIG. 32, 32, the object can be viewed in an enlarged manner at a viewpoint T where both lines of sight S1, S2 intersect.

By aligning the line-of-sight imaging bodies 22 and 23 in this manner, when the wearer's line-of-sight S1 passes through the center or approximately the center of the first prism 33, the line-of-sight S1 and the optical axis P1 of the near-infrared camera 34 are aligned. do. Thereby, the near-infrared camera 34 can image the object from the wearer's line of sight. That is, the near-infrared light 19 irradiates the object (light in the near-infrared wavelength range) to the object (viewpoint T), and the near-infrared camera 34 images the object. Image data of near-infrared images can be generated. When the communication control device 39 receives the image data captured by the near-infrared camera 34, it performs control to display a near-infrared image based on the image data on the monitor 51. Thereby, the near-infrared image captured by the near-infrared camera 34 is displayed on the monitor 51 in real time. By viewing the near-infrared image displayed on the monitor 51 with the left eye, the wearer can see the object closer to the object viewed with the left and right eyes through the first and second prisms 33, 43 and the loupe sections 32, 32. Near-infrared images captured by the infrared camera 34 (images that are invisible to visible light but visible to light in the near-infrared wavelength range) can be superimposed and viewed in real time.

Next, the visual image display system 61 having the head-mounted visual recognition device 1 described above will be explained.
As shown in FIG. 8, the visual image display system 61 includes a head-mounted visual recognition device 1, a computer 62 that receives image data transmitted from the communication control device 39 of the head-mounted visual recognition device 1, and a computer 62 that receives image data transmitted from the communication control device 39 of the head-mounted visual recognition device 1. It includes a storage device 63 that stores the image data via a computer 62, and an image display device 64 that displays moving images and still images based on the image data. Note that the image data transmitted from the communication control device 39 includes image data captured by the near-infrared camera 34 and image data captured by the eyeball camera 44.

The computer 62 includes a central control unit, means for transmitting and receiving data, image control means for displaying moving images and still images on the image display device 64, and the like. In the computer 62, when the image data captured by the near-infrared camera 34 is received, the image control means performs a process of displaying a near-infrared image 72 (see FIG. 9) on the image display device 64 in real time based on the image data. I do. Further, upon receiving the image data captured by the eyeball camera 44, the image control means determines the shape of the eyeball on the near-infrared image based on the image data and the image data captured by the near-infrared camera 34. The line-of-sight position is acquired by a predetermined calculation, and a line-of-sight image 73 (see FIG. 9) indicating the line-of-sight position is generated. Then, processing is performed to display this line-of-sight image 73 on the near-infrared image 72 on the image display device 64.

The predetermined calculation for obtaining the line-of-sight position by the image control means is set in advance based on the magnification of the loupe units 32, 32, the position of the eyeball (pupil) displayed in the image data captured by the eyeball camera 44, etc. The line-of-sight position in the near-infrared image 72 to be displayed can be determined from the image data captured by the near-infrared camera 34. Here, as described above, the eyeball camera 44 is capable of capturing a moving image of the eyeball from approximately in front of the left eye. Therefore, the image control means accurately detects the movement of the eyeball by analyzing the image data of the moving image. The line of sight position can be obtained accurately and stably.

Furthermore, the computer 62 performs a process of storing the image data received from the near-infrared camera 34 and the image data received from the eyeball camera 44 in the storage device 63 in a time-series manner. Then, through an operation by an administrator or the like, the image data stored in the storage device 63 is selectively read, and the near-infrared image and the line-of-sight image are superimposed and displayed on the image display device 64 as described above. .

As shown in FIG. 9, such a visual recognition image display system 61 can display a near-infrared image 72 on the image display device 64 using image data captured by the near-infrared camera 34 of the head-mounted visual recognition device 1, and A line-of-sight image 73 acquired from image data captured by the camera 44 can be displayed on the image display device 64 overlapping the near-infrared image 72. As a result, the person viewing the image display device 64 can see the objects 71, including those that are visible with light in the near-infrared wavelength range, in the same way as the wearer, and can also determine the wearer's line of sight position. Can be visually recognized.

As described above, in the head-mounted visual recognition device 1 of this embodiment, the wearer sees a near-infrared image visible using light in the near-infrared wavelength range superimposed on an object that can be seen with the naked eye (viewed using visible light). Therefore, the near-infrared image can be viewed accurately. Here, since the optical axis P1 of the near-infrared camera 34 is refracted by the first prism 33 and coincides with the wearer's line of sight S1, the wearer can comfortably see the near-infrared image superimposed on the object seen with the naked eye. be able to. Furthermore, the visual recognition image display system 61 of the present embodiment superimposes a viewpoint image obtained from the image data photographed by the eyeball camera 44 on the near-infrared image photographed by the near-infrared camera 34 of the head-mounted visual recognition device 1. , since it is displayed on the image display device 64, the person viewing the image display device 64 can see the near-infrared image from the same line of sight as the wearer, and can also visually recognize the wearer's gaze point from the viewpoint image. . The configuration of this embodiment can be applied in a medical field, for example, when a medical worker who performs blood sampling, intravenous drip, etc. wears the head-mounted visualization device 1, a patient whose blood vessels are difficult to see with the naked eye can be used. However, the position of the blood vessel can be accurately and easily visualized. Furthermore, by wearing the head-mounted viewing device 1 by the operating surgeon, it is possible to accurately and easily view cancers and the like that cannot be seen with the naked eye. By displaying the near-infrared image taken by the near-infrared camera 34 and the viewpoint image based on the image taken by the eyeball camera 44 during the surgery on the image display device 64, assistants, visitors, etc. can see the same line of sight as the surgeon. In addition to being able to see the status of the surgery, you can also learn the surgeon's point of focus. As a result, if the information is displayed in real time during the surgery, the assistants and visitors can accurately know the surgical situation, and can give accurate advice depending on the surgical situation. Alternatively, it is possible to accurately convey to visitors, etc., the flow of surgery performed by the surgeon and the points of interest. Similarly, by reading the image data stored in the storage device 63 after surgery and displaying it on the image display device 64, it is useful to spread knowledge about various surgical situations to students and other medical personnel.

In this embodiment, the safety glasses 2 correspond to the head-mounted part according to the present invention. The first prism 33 disposed on the right line-of-sight imaging body 22 and the inner second prism 43 (located immediately behind the magnifying glass part 32) disposed on the left line-of-sight imaging body 23 This corresponds to a prism according to the invention, and constitutes a line-of-sight passing member of the invention. The slope 38a of the first prism 33 inclined toward the inner front and the slope 38a of the second prism 43 inclined toward the inner rear correspond to the transmissive/reflective means according to the present invention. The near-infrared camera 34 corresponds to the imaging means according to the present invention, and the near-infrared light (light in the near-infrared wavelength range) corresponds to the invisible light according to the present invention. The monitor 51 corresponds to image display means according to the present invention.

The present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the present invention. For example, the dimensions and shapes of each part in the embodiments described above can be changed as appropriate.

In the above-mentioned embodiment, the eyeball camera is provided in the left line-of-sight imaging body, but the present invention is not limited to this, and a configuration may be adopted in which the eyeball camera is not provided. In the case of this configuration, the visual recognition image display system does not display the viewpoint position on the image display device.

Although the above-described embodiment has a configuration including a near-infrared camera, the present invention is not limited to this, and may include a camera (imaging means) that receives invisible light in other wavelength ranges and takes an image.

In the above-mentioned embodiment, the left line-of-sight imaging body has a configuration in which a lens is disposed between the monitor and the prism, but the present invention is not limited to this, and a configuration in which no lens is provided may be used. This lens is designed to match the scale of the image displayed on the monitor to the object that the wearer sees through the loupe, so if you adjust the monitor size and image display size, the lens will There is no need to set it up.

In the above-mentioned embodiment, the left and right line-of-sight imaging bodies each have a magnifying glass section, but they may have a configuration without a magnifying glass section.

1. Head-mounted viewing device 2. Safety glasses (head-mounted part)
33 First prism 43 Second prism 34 Near-infrared camera 38 Right angle prism 51 Monitor (image display means)
P1 Optical axis S1, S2 Line of sight

Claims (2)

a head-mounted part that is mounted on the wearer's head;
left and right line-of-sight passing members that are attached to the head-mounted part and allow left and right lines of sight of the wearer to pass forward, respectively;
an imaging means that is disposed adjacent to one of the left and right line-of-sight passing members and receives invisible light through the line-of-sight passing member to obtain image data;
an image display means disposed adjacent to the other left and right line of sight passing member for displaying an image based on the image data acquired by the imaging means;
The line of sight passing member on either the left or right side is
It is equipped with a prism that allows one of the left and right line of sight of the wearer to pass forward and refracts the optical axis of the imaging means forward,
The line of sight passing member on the left and right side is
A head-mounted type of viewing device characterized by comprising a prism that allows the wearer's other left and right line of sight to pass forward and allows the image displayed by the image display means to be viewed with the line of sight. Device. The prism of the line-of-sight passing member is
Two rectangular prisms are stacked on top of each other to form an integrated cube shape, and the light incident on the slope is divided into transmitted light that is transmitted to the back and reflected light that is reflected. It is equipped with a transmissive and reflective means,
The line-of-sight passing members on either the left or right side are
The prism is arranged so that the optical axis of the imaging means is refracted forward by the slope having the transmissive reflection means,
The line-of-sight members on the left and right are
Claim characterized in that the prism is arranged so that the image displayed by the image display means is reflected by the slope having the transmissive reflection means so that the image can be viewed from the other left and right lines of sight. 1. The head-mounted visual recognition device according to 1.

Images