JP2022108089A - projection device - Google Patents

Abstract

To suppress the complication of adjustment of each optical axis in imaging and projection of a subject and achieve the size reduction and weight reduction of the entire system.SOLUTION: A projection device comprises: a lens to which light from an observation portion is incident; an imaging unit which captures an image of the observation portion on the basis of the light received through the lens; and a projection unit which generates a projection image to the observation portion on the basis of the image of the observation portion captured by the imaging unit. The lens projects light of the projection image from the projection unit along a light projection axis being coaxial with an incident axis of the light from the observation portion in the direction opposite to the direction in which the light from the observation portion is incident.SELECTED DRAWING: Figure 3

Description

The present disclosure relates to projection devices.

In recent years, during surgery or examination, ICG (indocyanine green) is administered as a fluorescent reagent into the subject, and the ICG is excited by irradiation with excitation light, etc., and the near-infrared fluorescence image emitted by the ICG is captured together with the subject image. , a method of making a diagnosis by observation has attracted attention. For example, the optical imaging system disclosed in US Pat. and optical elements that align optical axes of the electronic imaging device and the projector.

U.S. Patent Application Publication No. 2008/0004533

In the configuration of Patent Document 1, an electronic imaging device (for example, a camera) and a projector that constitute an optical imaging system are arranged separately and at different positions, and the electronic imaging device and the projector each have a different lens. there is For this reason, not only is complicated work required to individually align the optical axis when the electronic imaging device picks up an image and the optical axis when the projector projects, but it also makes it possible to reduce the size of the system. It was difficult. In other words, there is room for improvement in terms of adjustment of each optical axis during imaging and projection of a subject (for example, a patient) and miniaturization of the overall system.

The present disclosure has been devised in view of the above-described conventional circumstances, and suppresses the complexity of adjusting each optical axis when imaging and projecting a subject, and realizes the overall size and weight of the system. It is an object of the present invention to provide a projection device.

The present disclosure includes a lens into which light from an observation site is incident, an imaging unit that captures an image of the observation site based on the light received through the lens, and the observation imaged by the imaging unit. a projection unit that generates a projected image onto the observed region based on the image of the region, and the lens projects the light of the projected image from the projection unit in a direction in which the light from the observed region is incident. A projection device that projects light along a projection axis that is opposite to and coaxial with the incident axis of light from the observation site.

Advantageous Effects of Invention According to the present disclosure, it is possible to suppress complication of adjustment of each optical axis when imaging an object and when projecting, and realize miniaturization and weight reduction of the entire system.

FIG. 4 is a diagram showing a use case example of the spectral prism camera according to the first embodiment; 1 is a block diagram showing an internal configuration example of a spectral prism camera according to Embodiment 1; FIG. FIG. 4 is a diagram showing an outline of the operation of the spectral prism camera according to Embodiment 1; A graph showing an example of the reflection characteristics of the A surface of the cross prism Graph showing an example of the reflection characteristics of the B surface of the cross prism Graph showing a first example of transmission characteristics of an optical filter Graph showing a second example of transmission characteristics of an optical filter 4 is a flow chart showing a first example of operation procedure of the spectral prism camera according to the first embodiment; 4 is a flow chart showing a second operation procedure example of the spectral prism camera according to the first embodiment; 10 is a flow chart showing a third operation procedure example of the spectral prism camera according to the first embodiment; FIG. 4 is a block diagram showing an internal configuration example of a spectral prism camera according to Embodiment 2; FIG. 11 is a diagram showing an outline of the operation of the spectral prism camera according to the second embodiment; 10 is a flow chart showing a first operation procedure example of the spectral prism camera according to the second embodiment;

Hereinafter, embodiments specifically disclosing a projection apparatus according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid unnecessary verbosity in the following description and to facilitate understanding by those skilled in the art. It should be noted that the accompanying drawings and the following description are provided for a thorough understanding of the present disclosure by those skilled in the art and are not intended to limit the claimed subject matter.

FIG. 1 is a diagram showing a use case example of the spectral prism camera 100 according to the first embodiment. A spectroscopic prism camera 100 as an example of a projection device according to the present disclosure is used by being worn by a doctor U1 who is performing an operation on a patient PAT1 with the cooperation of an assistant U2 such as a nurse. (see below) is projected onto the affected area AFP1 of the patient PAT1. The spectroscopic prism camera 100 is, for example, attached and fixed to the tip side of a headband HMB1 that covers the outer circumference of the head of the doctor U1, and is a head-mounted type that projects a projection image so as to follow the movement of the head of the doctor U1. It is a projection device. Note that the use case of the spectral prism camera 100 need not be limited to a medical application such as being worn by a doctor U1 during an operation.

(Embodiment 1)
FIG. 2 is a block diagram showing an example internal configuration of the spectral prism camera 100 according to the first embodiment. The spectral prism camera 100 includes a common lens LS1, a camera head section 10, a camera signal processing section 20, a CCU (Camera Control Unit) 30, a projector section 40, a camera control section 50, an ABF (Auto Back Focus ) includes a control unit 51, an illumination control unit 52, a lens control unit 54, and an illumination unit ILM1. Also, the spectral prism camera 100 is connected to the display DP1 via wire or wireless.

A common lens LS1 as an example of a lens is a lens unit including an optical lens attached on the object side (in other words, on the affected part AFP1 side as an example of an observed part) from the cross prism CXP1 (see below) of the camera head section 10. Configured. Light from an observation site (for example, reflected light from the observation site) is incident on the common lens LS1, and the common lens LS1 collects the incident light. The light from the observation site condensed by the common lens LS1 enters the cross prism CXP1 of the camera head section 10 .

Further, the common lens LS1 has a function of condensing light received by the image sensors 11 and 12 of the camera head section 10 and a function of projecting light of a projected image (see later) from the projector section 40. have. In other words, the common lens LS1 projects the light of the projected image (see below) from the projector unit 40 in the direction opposite to the direction in which the light from the observation site is incident, and the incident axis IMX1 of the light from the observation site ( For example, light is projected along a light projection axis PJX1 that is coaxial with the optical axis). In other words, in Embodiment 1, the shared lens LS1 is shared by the camera head section 10 and the projector section 40 .

The camera head unit 10 is arranged next to the shared lens LS1 on the object side (that is, on the observation site side), and separates and images the light transmitted through the shared lens LS1. The camera head unit 10 includes a cross prism CXP1 having two optical surfaces (see A surface AS1 and B surface BS1 which will be described later), an optical filter OPF1, an auto back focus mechanism ABF1 including an image sensor 11, and an optical filter OPF2. , an automatic back focus mechanism ABF2 including an image sensor 12, and an optical filter OPF3.

A cross prism CXP1 as an example of a spectral prism has an A surface AS1 and a B surface BS1 having properties as optical surfaces, and is fixed by a prism fixing member FX1. The cross prism CXP1 reflects and transmits the light condensed by the common lens LS1 (that is, the light from the observation site) on the surface B BS1, and also reflects the light of the projection image (see below) projected from the projector unit 40. is reflected or totally reflected by the A surface AS1 and projected onto the common lens LS1.

Here, optical characteristics of the A surface AS1 and the B surface BS1 of the cross prism CXP1 will be described with reference to FIGS. 4A and 4B. FIG. 4A is a graph showing an example of reflection characteristics of the A surface AS1 of the cross prism CXP1. FIG. 4B is a graph showing an example of reflection characteristics of the B surface BS1 of the cross prism CXP1. 4A and 4B, the horizontal axis indicates wavelength [nm: nanometer], and the vertical axis indicates reflectance as an example of reflection characteristics.

In FIG. 4A, the A surface AS1 has an optical property of reflecting monochromatic blue light (blue light) having a wavelength of, for example, 400±20 [nm] with a high reflectance (eg, 70%). Although the blue light reflectance of the A surface AS1 is 70% in FIG. 4A, it may be 100% (that is, a reflectance capable of total reflection). On the other hand, the A-surface AS1 has an optical property of reflecting near-infrared (IR) light having a wavelength of, for example, 830±30 [nm] without transmitting it. For example, the optical density (OD (Optical Density) value) for transmittance is 4-5.

In FIG. 4B, B-side BS1 has an optical property of reflecting visible light having a wavelength of, for example, 430 to 680 [nm] with a high reflectance (eg, 70%). Although the visible light reflectance of the B surface BS1 is 70% in FIG. 4B, it is not limited to 70%. On the other hand, the B-side BS1 has an optical property of reflecting near-infrared (IR) light having a wavelength of, for example, 830±30 [nm] without transmitting it. For example, the optical density (OD value) in terms of transmittance is 4-5.

The optical filter OPF1 is, for example, a band pass filter (BPF) that transmits only near-infrared (IR) light having a wavelength of 840 to 900 [nm] and blocks light having wavelengths in other bands. Configured. The wavelength band of light transmitted by the optical filter OPF1 (bandpass filter) need not be limited to 840 to 900 [nm]. The optical filter OPF1 filters 840 to 900 [nm ] (for example, fluorescence reflected by the site of observation). Near-infrared (IR) light transmitted through the optical filter OPF1 is received by the image sensor 11 . The optical filter OPF1 may be arranged so as to be provided within the automatic back focus mechanism ABF1, or may be provided separately from the automatic back focus mechanism ABF1.

Here, optical characteristics of the optical filter OPF1 will be described with reference to FIGS. 4C and 4D. FIG. 4C is a graph showing a first example of transmission characteristics of the optical filter OPF1. FIG. 4D is a graph showing a second example of transmission characteristics of the optical filter OPF1. In FIGS. 4C and 4D, the horizontal axis indicates wavelength [nm: nanometer], and the vertical axis indicates transmittance as an example of transmission characteristics.

In FIG. 4C, the optical filter OPF1 has an optical property of transmitting near-infrared (IR) light having a wavelength of, for example, 840 to 900 [nm] with a high transmittance (eg, 80%). This is because, for example, a fluorescent reagent (eg, ICG: indocyanine green) pre-administered to the affected area APF1 before surgery emits fluorescence based on excitation light of 720 to 820 [nm], and the wavelength band is 840 to 900 [nm]. based on being In FIG. 4C, the transmittance of near-infrared (IR) light having a wavelength of 840 to 900 [nm] of the optical filter OPF1 is 80%, but it is not limited to 80%. On the other hand, the optical filter OPF1 has an optical property of reflecting visible light having a wavelength of, for example, 600 to 670 [nm] without substantially transmitting it. For example, the optical density (OD value) for transmittance is 5.

In FIG. 4D, the optical filter OPF1 has an optical property of transmitting near-infrared (IR) light having a wavelength of, for example, 800 to 860 [nm] with a high transmittance (eg, 80%). For example, a fluorescent reagent (for example, a fluorescent reagent whose wavelength band is 800 to 860 [nm] for fluorescence emitted based on excitation light of 720 to 820 [nm]) is administered to the affected area APF1 in advance before surgery. based on In FIG. 4D, the transmittance of near-infrared (IR) light having a wavelength of 800 to 860 [nm] of the optical filter OPF1 is 80%, but it is not limited to 80%. On the other hand, the optical filter OPF1 has an optical property of reflecting visible light having a wavelength of, for example, 600 to 670 [nm] without substantially transmitting it. For example, the optical density (OD value) for transmittance is 5.

The image sensor 11 includes, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) in which a plurality of pixels suitable for imaging near-infrared (IR) light are arranged. The imaging surface of the image sensor 11 is perpendicular to the imaging axis CAX1, which is perpendicular to the incident axis IMX, so that the near-infrared (IR) light reflected or totally reflected by the B surface BS1 of the cross prism CXP1 can be easily received. placed in a state where The image sensor 11 captures a near-infrared image of the observation site based on the received near-infrared (IR) light (for example, a fluorescence image that allows the position of the affected area AFP 1 to be identified based on fluorescence emission of ICG). The image sensor 11 sends a near-infrared image signal of the observation site obtained by imaging to the first signal processing section 21 .

The automatic back focus mechanism ABF1 is configured by a mechanism such as that disclosed in Japanese Patent No. 3738777, for example, and based on a control signal from the ABF control section 51, the imaging surface of the image sensor 11 is perpendicular to the imaging axis CAX1. It has a function of appropriately adjusting the focal length of the image sensor 11 by moving the image sensor 11 in the direction of the imaging axis CAX1 while maintaining the state. That is, according to the auto back focus mechanism ABF1, even if the wavelength band of the light received by the image sensor 11 is selected by the camera control unit 50 (see below) as a different wavelength band, the optical path length associated with the different wavelength band Since the image sensor 11 can be moved in the direction of the imaging axis CAX1 even if there is a change in , a clear near-infrared image in focus can be obtained.

The optical filter OPF2 is composed of a bandpass filter (BPF) that transmits only visible light (however, there is little blue light) having a wavelength of, for example, 430 to 680 [nm] and blocks light having wavelengths in other bands. be. In other words, the optical filter OPF2 functions as an infrared light cut filter. The wavelength band of light transmitted by the optical filter OPF2 (band-pass filter) need not be limited to 430 to 680 [nm]. The optical filter OPF2 transmits visible light (however, little blue light) having a wavelength of 430 to 680 [nm] transmitted through the B surface BS1 of the cross prism. Visible light (however, blue light is less) transmitted through the optical filter OPF2 is received by the image sensor 12 . The optical filter OPF2 may be arranged so as to be provided inside the automatic back focus mechanism ABF2, or may be provided separately from the automatic back focus mechanism ABF2.

The image sensor 12 includes, for example, a CCD or CMOS in which a plurality of pixels suitable for visible light imaging are arranged. The image sensor 12 is arranged so that the incident axis IMX1 and the imaging surface are perpendicular to each other so that visible light (however, blue light is less) transmitted through the B surface BS1 of the cross prism CXP1 is easily received. The image sensor 12 captures a visible image of the observation site based on the received visible light (however, blue light is less). The image sensor 12 sends a visible image signal of the observation site obtained by imaging to the second signal processing section 22 . Note that the image sensor 12 may have a configuration including a CCD or a CMOS in which a plurality of pixels suitable for capturing near-infrared (IR) light are arranged, like the image sensor 11 .

The auto back focus mechanism ABF2 is configured by a mechanism such as that disclosed in Japanese Patent No. 3738777, for example, and based on a control signal from the ABF control section 51, the imaging surface of the image sensor 12 is perpendicular to the incident axis IMX1. It has a function of appropriately adjusting the focal length of the image sensor 12 by moving the image sensor 12 in the direction of the incident axis IMX1 while maintaining the state. That is, according to the auto back focus mechanism ABF2, even if the wavelength band of the light received by the image sensor 12 is selected by the camera control unit 50 (see below), the optical path length associated with the different wavelength band Even if there is a change in , the image sensor 12 can be moved in the direction of the incident axis IMX1, so that a sharp visible image in focus can be obtained.

The optical filter OPF3 is composed of a band-pass filter (BPF) that transmits only blue light having a wavelength of, for example, 400±20 [nm] and blocks light having wavelengths in other bands. The wavelength band of light transmitted by the optical filter OPF3 (band-pass filter) need not be limited to 400 [nm]. The optical filter OPF3 transmits blue light of 400±20 [nm] out of the light of the projection image (see below) formed by the image forming plane 43 (see below) of the projector section 40 . Blue light transmitted through the optical filter OPF3 is reflected or totally reflected by the A surface AS1 of the cross prism CXP1. Note that the optical filter OPF3 may be arranged so as to be provided within the automatic back focus mechanism ABF3, or may be provided separately from the automatic back focus mechanism ABF3.

The camera signal processing unit 20 uses an image signal obtained by imaging with the camera head unit 10 to generate captured image data in a format recognizable by humans (for example, RGB format or YUV format). The camera signal processing section 20 includes a first signal processing section 21 and a second signal processing section 22 . Note that the CCU 30 to be described later may be configured to be included in the camera signal processing section 20 .

The first signal processing unit 21 is configured by a processor such as a DSP (Digital Signal Processor) or an FPGA (Field Programmable Gate Array). The first signal processing unit 21 performs various camera signal processing using an image signal from the image sensor 11 (for example, a near-infrared image signal of an observation site) to generate imaged image data (for example, fluorescence image data of an observation site). Generate and send to CCU 30 . Note that the captured image data generated by the first signal processing unit 21 is not limited to the above-described near-infrared image data of the observation site, and may be, for example, visible image data of the observation site or specific wavelength image data of the observation site. may The specific wavelength image data is image data in which only components in a preset specific wavelength band are extracted by camera signal processing in the first signal processing unit 21 .

The second signal processing unit 22 is configured by a processor such as DSP or FPGA, for example. The second signal processing unit 22 performs various camera signal processing using an image signal (for example, a visible image signal of an observation site) from the image sensor 12 to generate imaged image data (for example, visible image data of an observation site). and sent to the CCU 30. Note that the imaged image data generated by the second signal processing unit 22 is not limited to the visible image data of the observation site described above, and is, for example, the near-infrared image data of the observation site (see above), or the specific wavelength of the observation site. It may be image data. The specific wavelength image data is image data from which only components in a preset specific wavelength band are extracted by camera signal processing in the second signal processing unit 22 .

The CCU 30 is composed of a processor such as a DSP or FPGA, for example, and uses the captured image data from each of the first signal processing section 21 and the second signal processing section 22 to perform various image analysis processes (for example, inter-image calculation or image synthesis). )I do. In addition, the CCU 30 may analyze the state, properties, etc. of the observation site or an object placed at the observation site (for example, an object to be analyzed) by the above-described image analysis processing.

Further, the CCU 30 observes the near-infrared image data of the observation site using the near-infrared image data of the observation site from the first signal processing unit 21 and the visible image data of the observation site from the second signal processing unit 22. A generation instruction may be generated for conversion into visible image data of the part (for example, blue single-color projection image data for projection by the projector unit 40), and the projection processing unit 41 may be instructed. Note that the generation of this projection image data may be executed by the CCU 30 . In addition, the CCU 30 superimposes the near-infrared image data of the observed region from the first signal processing unit 21 and the visible image data of the observed region from the second signal processing unit 22, synthesizes an image, and displays the synthesized image on the display device DP1. may be output. As a result, the doctor U1 or the assistant U2 can intuitively grasp the detailed state of the observation site from the visible image data and the near-infrared image data, and can receive assistance in the progress of medical procedures (for example, surgery). .

The projector section 40 generates a projection image to be projected onto the observation site based on the image analysis processing result of the CCU 30 and projects the light of the projection image onto the camera head section 10 . The projector unit 40 includes a projection processing unit 41, a database 42, an image plane 43, and an automatic back focus mechanism ABF3.

Based on the generation instruction from the CCU 30 , the projection processing unit 41 generates a projection image to be projected onto the observation site and projects the light of the projection image onto the image forming plane 43 . Based on a generation instruction from the CCU 30, the projection processing unit 41 refers to (for example, partially or wholly combines or cuts) a reference image registered (saved) in advance in the database 42 to generate a projection image. may be generated.

The database 42 stores reference image data that can be part or all of the projection image generated by the projection processing unit 41 . The reference image data are, for example, "o", "x", numbers, and ratios (for example, "%"), but needless to say, they are not limited to these.

The image forming surface 43 is configured using, for example, a known MEMS (Micro Electro Mechanical System) mirror, and forms a projected image by forming the light of the projected image from the projection processing unit 41, and transmits it to the optical filter OPF3. emit light.

The auto-back focus mechanism ABF3 is configured by a mechanism such as that disclosed in Japanese Patent No. 3738777, for example, and based on a control signal from the ABF control section 51, the image plane 43 is perpendicular to the initial projection axis PJX0. It has a function of appropriately adjusting the focal length of the image forming surface 43 by moving the image forming surface 43 in the direction of the initial light projection axis PJX0 while maintaining the state in which it is projected. The light of the projected image projected along the initial projection axis PJX0 is reflected or totally reflected by the A surface AS1 of the cross prism CXP1, and is projected along the projection axis PJX1 orthogonal to the initial projection axis PJX0. It is projected onto the observation site via LS1. That is, according to the auto-back focus mechanism ABF3, for example, even if the wavelength band of the light imaged on the image forming surface 43 is selected by the camera control unit 50 (see below), the wavelength band is set to a different wavelength band. Even if there is an accompanying change in the optical path length, the image plane 43 can be moved in the direction of the initial light projection axis PJX0, so that a clear and focused projected image can be obtained.

The camera control unit 50 is composed of a processor such as a CPU (Central Processing Unit), DSP, or FPGA, and supervises various controls related to the operation of the spectral prism camera 100 . For example, the camera control unit 50 sends a control signal related to auto-back focus to the ABF control unit 51, sends a control signal related to excitation light irradiation to the lighting control unit 52, and transmits a control signal related to irradiation of excitation light to the lens control unit 54. and send control signals related to Further, the camera control unit 50 may receive an external control signal based on an external input different from that of the spectral prism camera 100 and execute various controls related to the operation of the spectral prism camera 100 .

Based on the control signal from the camera control unit 50, the ABF control unit 51 independently generates and sends control signals for forward movement, origin detection, and position holding to each of the three auto-back focus mechanisms ABF1, ABF2, and ABF3. . As a result, each of the three automatic back focus mechanisms ABF1, ABF2, and ABF3 can advance, detect the origin, and hold the position based on the control signal from the ABF control section 51. FIG.

Based on the control signal from the camera control unit 50, the illumination control unit 52 generates a control signal for turning on or off the light emitted from the illumination unit ILM1 and the amount of light, and sends the control signal to the illumination unit ILM1. The light emitted from the illumination unit ILM1 is, for example, visible light, near-infrared (IR) light, or excitation light in a specific wavelength band (eg, 720 to 820 [nm]). The excitation light having a wavelength of 720 to 820 [nm] is irradiated in order to fluoresce a fluorescent reagent (ICG) preliminarily administered to the observation site (eg, the diseased site AFP1) before surgery. Thereby, the illumination unit ILM1 can irradiate visible light, near-infrared (IR) light, or excitation light in a specific wavelength band.

Based on the control signal from the camera control unit 50, the lens control unit 54 generates control signals regarding the diaphragm, magnification, and focus of the common lens LS1. As a result, in the spectral prism camera 100, the aperture, magnification, and focus of the common lens LS1 can be appropriately adjusted.

Based on the control signal (see above) from the illumination control unit 52, the illumination unit ILM1 emits visible light, near-infrared (IR) light, or excitation light of a specific wavelength band (see above) to the observation site (for example, the affected area AFP1). ).

The display DP1 is configured using, for example, an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) device, and displays image data after image synthesis by the CCU30.

FIG. 3 is a diagram showing an outline of the operation of spectral prism camera 100 according to the first embodiment. FIG. 3 shows a use case example of the spectral prism camera 100 during surgery on the patient PAT1. The spectral prism camera 100 irradiates the patient PAT1 with excitation light (illumination light), which is near-infrared (IR) light having a wavelength of, for example, 720 to 820 [nm]. In addition, the illumination light irradiated to the patient PAT1 is not limited to the excitation light described above. It can be a lamp. Light from the observed site of the patient PAT1 (eg, the affected site AFP1 in FIG. 1) passes through the common lens LS1 and enters the cross prism CXP1. This light includes fluorescence (for example, fluorescence having a wavelength of 840 to 900 [nm]) emitted by a fluorescent reagent (eg, ICG) based on irradiation with excitation light.

Fluorescence having a wavelength of 840 to 900 [nm] out of the light (for example, light having a wavelength of 400 to 900 [nm]) incident on the cross prism CXP1 is reflected or totally reflected by the B surface BS1 and transmitted through the optical filter OPF1. Then, the light is received by the image sensor 11 . A captured image signal obtained by capturing an image of fluorescence by the image sensor 11 is transmitted to the CCU 30, and the CCU 30 generates fluorescence image data.

On the other hand, among the light (for example, light having a wavelength of 400 to 900 [nm]) incident on the cross prism CXP1, visible light (however, there is little blue light) having a wavelength of 430 to 680 [nm] is B surface BS1, optical The light passes through the filter OPF2 (not shown in FIG. 3) and is received by the image sensor 12 . A picked-up image signal obtained by picking up visible light (however, there is little blue light) by the image sensor 12 is transmitted to the CCU 30, and the CCU 30 generates visible image data.

The CCU 30 synthesizes the fluorescence image data and the visible image data and displays them on the display device DP1, or uses the fluorescence image data and the visible image data to send an instruction to the projector unit 40 to generate projection image data for projection. or Based on a generation instruction from the CCU 30, the projector unit 40 produces a monochromatic blue projection image light (e.g., 400 [nm] wavelength) that is easy to project (in other words, easy to identify) onto the skin of a person such as the patient PAT1. ) is projected onto the observation site via the optical filter OPF3 and the A-plane AS1. Light having a wavelength of 400 [nm] easily passes through the optical filter OPF3 and is easily reflected by the A surface AS1 (see FIG. 4A).

Next, an operation procedure example of the spectral prism camera 100 according to the first embodiment will be described with reference to FIGS. 5, 6 and 7, respectively. FIG. 5 is a flow chart showing a first operation procedure example of the spectral prism camera 100 according to the first embodiment. FIG. 6 is a flow chart showing a second operation procedure example of the spectral prism camera 100 according to the first embodiment. FIG. 7 is a flow chart showing a third operation procedure example of the spectral prism camera 100 according to the first embodiment. In the description of FIGS. 6 and 7, the same reference numerals are given to the processes that overlap with the processes of FIG. 5, and the description is simplified or omitted, and the different contents are described.

In the first operation procedure shown in FIG. 5, the spectral prism camera 100 irradiates the affected area AFP1 (eg, abdominal internal organs) of the patient PAT with excitation light (eg, excitation light having a wavelength of 720 to 820 [nm]) to excite the An example in which a projection image is projected onto the affected area AFP1 using imaging of fluorescence based on irradiation of light will be described.

In FIG. 5, the spectral prism camera 100 irradiates an observation site with excitation light for ICG (for example, excitation light having a wavelength of 720 to 820 [nm]) from the illumination unit ILM1 (St1). The spectral prism camera 100 receives light (light from the observation site) containing fluorescence emitted by a fluorescent reagent (for example, ICG) at the observation site based on the excitation light irradiated in step St1, through the common lens LS1. shine. Spectral prism camera 100 reflects or totally reflects fluorescence, which is near-infrared (IR) light, out of the light from the observation site condensed by common lens LS1 by B surface BS1 of cross prism CXP1 (St2). The spectral prism camera 100 receives the fluorescence reflected or totally reflected by the B surface BS1 in step St2 with the image sensor 11 and takes an image (St3).

Spectral prism camera 100 allows visible light (for example, visible light having a wavelength of 430 to 680 [nm]) out of the light from the observation site condensed by shared lens LS1 to pass through B surface BS1 of cross prism CXP1. The image sensor 12 receives the light and takes an image. Spectral prism camera 100 converts the fluorescence image data into projection image data (specifically, (St4). The spectral prism camera 100 reflects or totally reflects the projection image data generated in step St4 by the A surface AS1 of the cross prism CXP1, and projects the light toward the observation site via the shared lens LS1 (St5). .

After step St5, if the processing of the spectral prism camera 100 has not ended (St6, NO), the processing of the spectral prism camera 100 returns to step St1. That is, the spectral prism camera 100 repeats the processing from step St1 to step St6 until the processing of the spectral prism camera 100 is completed. On the other hand, after step St5, when the processing of the spectral prism camera 100 ends (for example, when the power of the spectral prism camera 100 is turned off by the operation of the doctor U1 or the assistant U2) (St6, YES), The processing of the prism camera 100 ends.

In the second operation procedure shown in FIG. 6, unlike the first operation procedure, the spectral prism camera 100 captures images of light in different wavelength bands with the image sensors 11 and 12, respectively. (For example, activity of fruits such as mandarin oranges or leaves) is analyzed, and a projection image showing the analysis result is projected onto the observation site.

In FIG. 6, the spectral prism camera 100 irradiates visible light having a wavelength of, for example, 430 to 680 [nm] from the illuminator ILM1 toward the observation site. The spectral prism camera 100 receives the light reflected by an object (for example, an orange) placed at the observation site based on the irradiated visible light through the shared lens LS1. Spectral prism camera 100 captures near-infrared (IR) light having a first wavelength band (for example, a wavelength of 800 [nm]) out of the light from the object condensed by common lens LS1, and directs it to surface B of cross prism CXP1. Reflected or totally reflected at BS1 (St11). The spectral prism camera 100 receives the 800 [nm] near-infrared (IR) light reflected or totally reflected by the B surface BS1 in step St11 with the image sensor 11 and takes an image (St12).

Spectral prism camera 100 converts near-infrared (IR) light having a second wavelength band (for example, a wavelength of 850 [nm]) out of the light from the object condensed by common lens LS1 to surface B of cross prism CXP1. It is transmitted by BS1 (St13). The spectral prism camera 100 receives the near-infrared (IR) light of 850 [nm] that has passed through the B surface BS1 in step St13 with the image sensor 12 and takes an image (St14). The spectral prism camera 100 performs image analysis processing on the near-infrared image data of the observation site obtained based on the images captured by the image sensors 11 and 12, respectively, and determines the size of the object (for example, an orange) placed on the observation site. The sugar content is analyzed and processed (St15). Spectral prism camera 100 generates projection image data indicating the analysis result (for example, the sugar content of oranges) obtained by the analysis processing in step St15, and the light of the projection image data is reflected or reflected by A surface AS1 of cross prism CXP1. The light is totally reflected and projected (projected) toward the observation site through the common lens LS1 (St16). Since the processing after step St16 is the same as in FIG. 5, the description is omitted.

In the third operation procedure shown in FIG. 7, the spectral prism camera 100 is different from the first operation procedure and the second operation procedure in that the size or true size of the object (for example, a fruit such as an orange) placed on the observation site is determined. An example will be described in which the circularity is analyzed and a projection image showing the analysis result (for example, the quality determination result) is projected onto the observation site.

In FIG. 7, the spectroscopic prism camera 100 projects light of a monochromatic blue projection image (for example, a diagram showing a reference shape or a scale (measure)) having a wavelength of 400 [nm], for example, into a cross prism CXP1. The light is reflected or totally reflected by the A surface AS1, and is projected (projected) toward the observation site through the common lens LS1 (St21). The spectral prism camera 100 receives light from an object (such as an orange) including light reflected by the object in the projection image projected in step St21 through the common lens LS1. Spectral prism camera 100 reflects part of the light from the object condensed by shared lens LS1 by B surface BS1 of cross prism CXP1 (St22). The spectral prism camera 100 receives a part of the light reflected by the B surface BS1 in step St22 with the image sensor 11 and takes an image (St23).

Spectral prism camera 100 allows the rest of the light from the object condensed by common lens LS1 to pass through surface B BS1 of cross prism CXP1. The spectral prism camera 100 receives the remaining light transmitted through the B surface BS1 with the image sensor 12 and takes an image. The spectral prism camera 100 performs image analysis processing on the near-infrared image data of the observation site obtained based on the images captured by the image sensors 11 and 12, respectively, and determines the size of the object (for example, an orange) placed on the observation site. The quality of the object is determined by analyzing the size, roundness, etc. (St24). The spectroscopic prism camera 100 refers to the database 42, and projects the determination result (for example, the size or roundness of the mandarin orange) obtained by the pass/fail determination in step St24 superimposed on the existing projection image (see step St21). Image data is generated (St25). Spectral prism camera 100 reflects or totally reflects the light of the generated projection image data by surface A AS1 of cross prism CXP1, and projects the light toward the observation site via common lens LS1 (St26). . Since the processing after step St16 is the same as in FIG. 5, the description is omitted.

As described above, the spectral prism camera 100 according to the first embodiment can obtain an image of the observation site based on the lens (for example, the shared lens LS1) into which the light from the observation site is incident and the light received through the lens. An imaging unit (for example, camera head unit 10) that takes an image, and a projection unit (for example, projector unit 40) that generates a projected image of the observed region based on the image of the observed region captured by the imaging unit. The lens projects the light of the projected image from the projection unit along a projection axis PJX1 that is opposite to the incident direction of the light from the observation site and coaxial with the incident axis IMX1 of the light from the observation site. emit light.

As a result, the spectral prism camera 100 projects the shared lens LS1 without the need to separate the projector unit 40 for projecting the projection image onto the observation site and the camera head unit 10 for imaging based on the light from the observation site. Since it can be shared by the machine unit 40 and the camera head unit 10, it is possible to suppress the complexity of adjusting each optical axis when imaging and projecting a subject (for example, an observation part) (that is, fine adjustment of each optical axis is unnecessary). becomes). Therefore, according to the spectroscopic prism camera 100, the projector section 40 and the camera head section 10 can be arranged in one housing, so that the size and weight of the overall system can be reduced. User-friendliness is improved like the device (see FIG. 1). For example, in a medical field or the like, the head-mounted spectroscopic prism camera 100 enables projection of an image onto an affected area AFP 1 or the like on an observation site. Since the incident axis IMX1 and the light projecting axis PJX1 are coaxial, even if the housing of the spectral prism camera 100 shakes, the camera is less likely to shake, thereby suppressing image quality deterioration of the captured image.

In addition, the spectral prism camera 100 has a first surface (for example, surface B BS1) that reflects part of the light from the observation site and transmits the remaining light, and a surface that reflects the light of the projected image toward the projection axis PJX1. and a spectral prism (eg, cross prism CXP1) having a second surface (eg, A surface AS1). A lens (for example, a shared lens LS1) is arranged closer to the observation site than the spectral prism. As a result, the spectroscopic prism camera 100 has a simple structure, and can split the light from the observation site into two lights on the B surface BS1 to obtain two types of captured images. can be projected (illuminated) onto the observation site.

In addition, the spectral prism (for example, cross prism CXP1) reflects near-infrared light (for example, light having a wavelength of 840 to 900 [nm]) out of the light of the observation site on the first surface (for example, B surface BS1), and It transmits visible light (for example, light having a wavelength of 430 to 680 [nm]) out of the light of the observation site. The imaging unit (for example, camera head unit 10) includes a first imaging unit (for example, image sensor 11) that captures a near-infrared image of the observation site based on near-infrared light, and a visible image of the observation site based on visible light. and a second imaging unit (for example, the image sensor 12) that captures the . A projection unit (for example, the projector unit 40) generates a projection image based on the near-infrared image of the observed region and the visible image of the observed region, and projects the projected image onto the observed region via a spectral prism and a lens. Thereby, the spectroscopic prism camera 100 can reflect the fluorescence generated by the emission of the fluorescent reagent (for example, ICG) on the B surface BS1 of the cross prism CXP1 and obtain an image of the observation site based on the fluorescence. An image of the observation site based on less visible light can be obtained.

Also, the projection unit (for example, the projector unit 40) projects the blue light of the projected image onto the observation site via the lens (for example, the shared lens LS1). As a result, the doctor U1 or the assistant U2 who wears the spectral prism camera 100 can accurately recognize the blue projected image whose content is easy to recognize even when projected onto the observation site (for example, the affected area AFP1 of the patient PAT1). Assistance in the progress of medical intervention can be adaptively received.

In addition, the spectral prism camera 100 captures at least two first images (for example, a near-infrared image based on near-infrared (IR) light having a wavelength of 800 [nm]) and a second It further comprises a signal processing unit (for example, CCU 30) that analyzes the object at the observation site based on an image (for example, a near-infrared image based on near-infrared (IR) light having a wavelength of 850 [nm]). The projection unit (for example, the projector unit 40) generates a projection image showing the analysis result of the target object (for example, the sugar content of fruits such as mandarin oranges, or the activity level of leaves). As a result, the spectral prism camera 100 can not only observe the state of the observation site (eg, the affected area AFP1) during medical practice (eg, surgery), but also the state of the object (eg, fruit such as an orange) placed on the observation site ( For example, it can be used for analysis of sugar content) and can be used for versatile use cases. Also, a near-infrared image based on near-infrared (IR) light having a wavelength of 800 [nm] and a second image (for example, a near-infrared image based on near-infrared (IR) light having a wavelength of 850 [nm] image) makes it possible to identify the results (for example, arteries or veins) when the affected area AFP1 (for example, blood vessels of the patient PAT1) is the observation site, and to appropriately support the progress of medical procedures.

Moreover, the spectral prism camera 100 further includes a signal processing unit (for example, the CCU 30) that analyzes the quality of the object in the observed region based on the image of the observed region captured by the imaging unit. A projection unit (for example, the projector unit 40) projects in advance a reference image for analyzing the quality of an object onto an observation site. An imaging unit (for example, the image sensor 11 or the image sensor 12) captures an image of an observed region including the reference image projected by the projection unit. The signal processing unit analyzes the quality of the target object based on the image of the observed region including the reference image captured by the imaging unit. The projection unit generates a projection image showing the quality analysis result of the object. Thereby, the spectroscopic prism camera 100 projects a reference image such as a diagram or a measure that serves as a reference of the object placed at the observation site in advance, and the object is obtained by imaging based on the light from the object. Since the quality of the object can be determined from the captured image and the reference image, and the result of the determination can be projected, the user can intuitively recognize the quality of the object.

The spectroscopic prism camera 100 further includes an illumination unit ILM1 that irradiates excitation light having a predetermined wavelength band (for example, a wavelength of 720 to 820 [nm]) to an observation site to which a fluorescent reagent has been administered in advance. The spectral prism reflects fluorescence, which is light emitted by the fluorescent reagent based on the excitation light, on the first surface (for example, B surface BS1). A first imaging unit (for example, the image sensor 11) receives fluorescence via a spectral prism and captures a near-infrared image of an observation site. A projection unit (for example, the projector unit 40) generates a projection image for indicating the light-emitting location of the fluorescent reagent based on the near-infrared image of the observation site. As a result, during surgery, the doctor U1 or the assistant U2 can intuitively grasp the luminescence point of the fluorescent reagent such as ICG that has been administered to the patient PAT1 in advance, so that he/she can receive support for the progress of appropriate medical practice. can.

(Embodiment 2)
In spectral prism camera 100 according to Embodiment 1, since the wavelength of visible light transmitted through B surface BS1 of cross prism CXP1 is 430 to 680 [nm], there is little blue light, and visible light captured by image sensor 12 The image signal also had little blue component. Therefore, the visible image data generated by the second signal processing unit 22 also has little blue component, and depending on the observation site (an example of the subject), it may not be easy to grasp the situation.

Therefore, in the second embodiment below, an example of a spectroscopic prism camera 100A that suppresses a decrease in blue light in the wavelength band of visible light transmitted through the B surface of the cross prism will be described.

FIG. 8 is a block diagram showing an internal configuration example of the spectral prism camera 100A according to the second embodiment. The spectral prism camera 100A includes a common lens LS1, a camera head section 10A, a camera signal processing section 20, a CCU 30, a projector section 40, a camera control section 50, an ABF control section 51, and an illumination control section 52. , a polarization filter control unit 53, a lens control unit 54, and an illumination unit ILM1. In the description of FIG. 8, the same reference numerals are assigned to the same configurations as those of FIG. 2, and the description is simplified or omitted, and different contents are described.

The camera head unit 10A is arranged next to the shared lens LS1 on the object side (that is, on the observation site side), and separates and images the light transmitted through the shared lens LS1. The camera head unit 10A includes a polarizing filter PLF1, a cross prism CXP2 having two optical surfaces (see A surface AS2 and B surface BS2, which will be described later), an optical filter OPF1, and an automatic back focus mechanism ABF1 including an image sensor 11. , an optical filter OPF2, an automatic back focus mechanism ABF2 including an image sensor 12, and an optical filter OPF4.

The polarizing filter PLF1 selects specific polarized components (for example, p-polarized component and s-polarized component with respect to the traveling direction of light set by the polarizing filter control unit 53) of the light condensed by the common lens LS1 (that is, the light from the observation site). It has an optical property to transmit only component).

A cross prism CXP2 as an example of a spectral prism has an A surface AS2 and a B surface BS2 having properties as optical surfaces, and is fixed by a prism fixing member FX1. The cross prism CXP2 reflects the s-polarized component of the light of the p-polarized component and the s-polarized component that have passed through the polarizing filter PLF1 on the B-surface BS2 and transmits the p-polarized component on the B-surface BS2. The light (s-polarized component) of the projected image (see later) is reflected or totally reflected by the A surface AS2 and projected onto the common lens LS1 via the polarizing filter PLF1.

Only near-infrared (IR) light having a wavelength of 840 to 900 [nm] out of the s-polarized light component reflected by B surface BS2 is transmitted through optical filter OPF1 and received by image sensor 11 . Since the operation contents of the image sensor 11 and the automatic back focus mechanism ABF1 are the same as those of the first embodiment, the description thereof is omitted.

Of the p-polarized light component transmitted through B-side BS2, only visible light (p-polarized light component) having a wavelength of 400 to 680 [nm] is transmitted through optical filter OPF2 and received by image sensor 12 . Since the contents of operations of the image sensor 12 and the automatic back focus mechanism ABF2 are the same as those of the first embodiment, the description thereof will be omitted.

The optical filter OPF4 is composed of a bandpass filter (BPF) that transmits only visible light having a wavelength of 400 to 680 [nm], for example, and blocks light having wavelengths in other bands. That is, the optical filter OPF4 has a function as an infrared light cut filter. The wavelength band of light transmitted by the optical filter OPF4 (bandpass filter) need not be limited to 400 to 680 [nm]. The optical filter OPF4 transmits the light of the projected image formed by the image forming plane 43 of the projector unit 40 (eg, visible light (s-polarized component) having a wavelength of 400 to 680 [nm]). The visible light (s-polarized component) transmitted through the optical filter OPF4 is reflected or totally reflected by the A surface AS2 of the cross prism CXP2. The optical filter OPF4 may be arranged so as to be provided within the automatic back focus mechanism ABF3, or may be provided separately from the automatic back focus mechanism ABF3.

In the second embodiment, the projection processing unit 41 of the projector unit 40 generates a projection image to be projected onto the observation site based on a generation instruction from the CCU 30, and emits light of the projection image (for example, 400 to 680 [nm] (s-polarized light component) having a wavelength of ) is projected onto the imaging plane 43 . This light is reflected or totally reflected by the A surface AS2 of the cross prism CXP2 via the image forming plane 43 and the optical filter OPF4, and is projected onto the observation site via the polarizing filter PLF1 and the common lens LS1.

The polarizing filter control unit 53 rotates the polarizing filter PLF1 based on a control signal from the camera control unit 50 to change the polarization angle of the light from the observation site to be transmitted by the polarizing filter PLF1 (for example, the angle of the light from the observation site). Set the angles of the p- and s-polarization components with respect to the direction of travel).

FIG. 9 is a diagram showing an operation outline of the spectral prism camera 100A according to the second embodiment. FIG. 9 shows a use case example of the spectral prism camera 100A during surgery on the patient PAT1, for example, like FIG. In the description of FIG. 9, the same reference numerals or names are given to the same elements as those of FIG. 3, the description is simplified or omitted, and different contents are described.

The spectral prism camera 100A irradiates the patient PAT1 with excitation light (illumination light), which is near-infrared (IR) light having a wavelength of, for example, 720 to 820 [nm]. In addition, the illumination light irradiated to the patient PAT1 is not limited to the excitation light described above. It can be a lamp. Light from the observation site of the patient PAT1 (for example, the affected site AFP1 in FIG. 1) is transmitted through the common lens LS1, and a specific polarized component of the transmitted light (eg p-polarized component and s-polarized component) enter the cross prism CXP2. This light includes fluorescence (for example, fluorescence having a wavelength of 840 to 900 [nm]) emitted by a fluorescent reagent (eg, ICG) based on irradiation with excitation light.

The cross prism CXP2 reflects the s-polarized component of the light of the p-polarized component and the s-polarized component transmitted through the polarizing filter PLF1 at the B-surface BS2 and transmits the p-polarized component at the B-surface BS2. Therefore, the s-polarized component (e.g., fluorescence) passes through the optical filter OPF1 and is received by the image sensor 11, and the captured image signal of the fluorescence imaged by the image sensor 11 is transmitted to the CCU 30, where the CCU 30 generates fluorescence image data. be.

On the other hand, the p-polarized component (for example, visible light having a wavelength of 400 to 680 [nm]) that has passed through the B surface BS2 of the cross prism CXP2 passes through the optical filter OPF2 (not shown in FIG. 3) and reaches the image sensor 12. light is received. A captured image signal obtained by capturing visible light by the image sensor 12 is transmitted to the CCU 30, and the CCU 30 generates visible image data.

The CCU 30 synthesizes the fluorescence image data and the visible image data and displays them on the display device DP1, or uses the fluorescence image data and the visible image data to send an instruction to the projector unit 40 to generate projection image data for projection. or Based on a generation instruction from the CCU 30, the projector unit 40 produces a monochromatic blue projection image light (e.g., 400 [nm] wavelength) that is easy to project (in other words, easy to identify) onto the skin of a person such as the patient PAT1. ) is projected onto the observation site via the optical filter OPF4 (not shown in FIG. 9) and the A plane AS2. Light having a wavelength of 400 [nm] is likely to pass through the optical filter OPF4, and is also likely to be reflected by the A surface AS2.

Next, an operation procedure example of the spectral prism camera 100A according to the second embodiment will be described with reference to FIG. FIG. 10 is a flow chart showing a first operation procedure example of the spectral prism camera 100A according to the second embodiment. In the description of FIG. 10, the same step numbers are given to the same processes as those of FIG. 5, and the description is simplified or omitted, and different contents are described.

In FIG. 10, after step St2, the spectral prism camera 100A passes the p-polarized component (for example, visible light having a wavelength of 400 to 680 [nm]) transmitted through the B surface BS2 of the cross prism CXP2 to the optical filter OPF2 (see FIG. 3). (not shown)) and received by the image sensor 12 (St31). After step St3, the spectral prism camera 100A generates a visible image based on the fluorescence image data based on the fluorescence image signal obtained by the image sensor 11 and the visible image signal (p-polarized component) obtained by the image sensor 12. Data (p polarization component) is used to convert the fluorescence image data into projection image data for projection (specifically, projection image data (s polarization component) of visible light) (St4A).

The spectral prism camera 100A reflects or totally reflects the projection image data (s-polarized component) generated in step St4A by the A surface AS2 of the cross prism CXP2, and projects light toward the observation site via the shared lens LS1. ) (St5A). Since the processing after step St5A is the same as in FIG. 5, the description is omitted.

Note that, similarly to the spectral prism camera 100 according to the first embodiment, the spectral prism camera 100A according to the second embodiment performs operations according to the same operation procedures as those shown in FIG. 6 or FIG. I don't mind.

As described above, in the spectral prism camera 100A according to the second embodiment, the spectral prism (for example, the cross prism CXP2) has the near-infrared light (for example, 840 to 900 light having a wavelength of [nm]) and having the same wavelength band as visible light among the light of the observation site (for example, p-polarized light component of visible light having a wavelength of 400 to 680 [nm]) To Penetrate. The imaging unit (for example, the camera head unit 10A) includes a first imaging unit (for example, the image sensor 11) that captures a near-infrared image of the observation site based on near-infrared light, and a visible image of the observation site based on the first polarized light. and a second imaging unit (for example, the image sensor 12) that captures an image. The projection unit (for example, the projector unit 40) generates a projection image based on the near-infrared image of the observation site and the visible image of the observation site, and emits a second polarized light having the same wavelength band as the visible light (for example, 400 to An s-polarized component of visible light having a wavelength of 680 [nm] is used to project a projection image through a spectral prism (for example, cross prism CXP2) and a lens (for example, shared lens LS1).

Thus, similarly to the spectral prism camera 100 according to the first embodiment, the spectral prism camera 100A includes the projector unit 40 that projects a projected image onto the observation site and the camera head unit 10A that captures an image based on the light from the observation site. Since the common lens LS1 can be shared between the projector section 40 and the camera head section 10A without the need to separate the , the complicated adjustment of each optical axis during imaging and projection of a subject (for example, an observation site) can be reduced. can be suppressed. In addition, the spectral prism camera 100A detects that the visible light (p-polarized component) received by the image sensor 12 and the light of the projection image projected from the projector unit 40 (that is, the s-polarized component of the visible light) are different polarized components. Therefore, it is possible to prevent blue light from decreasing in the wavelength band of visible light that is received by the image sensor 12 after passing through the B surface BS2 of the cross prism CXP2. Therefore, spectroscopic prism camera 100A can retain more blue information in the visible light image data obtained by second signal processing unit 22 than spectroscopic prism camera 100 according to the first embodiment. can form an image.

Various embodiments have been described above with reference to the drawings, but it goes without saying that the present disclosure is not limited to such examples. It is obvious that a person skilled in the art can conceive of various modifications, modifications, substitutions, additions, deletions, and equivalents within the scope of the claims. Naturally, it is understood that it belongs to the technical scope of the present disclosure. In addition, the constituent elements of the various embodiments described above may be combined arbitrarily without departing from the gist of the invention.

INDUSTRIAL APPLICABILITY The present disclosure is useful as a projection apparatus that suppresses complicated adjustment of each optical axis when capturing an image of a subject and when projecting, and realizes miniaturization and weight reduction of the overall system.

10, 10A camera head units 11, 12 image sensor 20 camera signal processing unit 21 first signal processing unit 22 second signal processing unit 30 CCU
40 projector section 41 projection processing section 42 database 43 image forming surface 50 camera control section 51 ABF control section 52 lighting control section 53 polarizing filter control section 54 lens control section 100, 100A spectral prism cameras ABF1, ABF2, ABF3 auto back focus Mechanism AS1, AS2 A surface BS1, BS2 B surface CXP1 Cross prism DP1 Display FX1 Prism fixing member ILM1 Illumination unit LS1 Common lens OPF1, OPF2, OPF3 Optical filter

Claims (8)

a lens into which light from an observation site is incident;
an imaging unit configured to capture an image of the observation site based on light received through the lens;
a projection unit that generates an image projected onto the observed region based on the image of the observed region captured by the imaging unit;
The lens projects the light of the projected image from the projection unit in a direction opposite to a direction in which the light from the observation site is incident and has a projection axis that is coaxial with the incident axis of the light from the observation site. project along the
projection device. a spectral prism having a first surface that reflects part of the light from the observation site and transmits the remaining light, and a second surface that reflects the light of the projected image toward the projection axis; further prepared,
The lens is arranged closer to the observation site than the spectral prism.
A projection device according to claim 1 . the spectral prism reflects near-infrared light out of the light of the observed region on the first surface and transmits visible light out of the light of the observed region,
The imaging unit includes a first imaging unit that captures a near-infrared image of the observation site based on the near-infrared light, and a second imaging unit that captures a visible image of the observation site based on the visible light. , has
The projection unit generates the projection image based on the near-infrared image of the observation site and the visible image of the observation site, and projects the projection image onto the observation site through the spectral prism and the lens. ,
3. A projection device according to claim 2. The projection unit projects the blue light of the projection image onto the observation site through the lens.
4. Projection device according to claim 3. a signal processing unit that analyzes an object of the observation site based on at least a first image and a second image of the observation site captured by the imaging unit;
The projection unit generates the projection image showing the analysis result of the object.
A projection device according to claim 1 . a signal processing unit that analyzes the quality of the object at the observation site based on the image of the observation site captured by the imaging unit;
The projection unit projects a reference image for analyzing the quality of the object onto the observation site in advance,
The imaging unit captures an image of the observation site including the reference image projected by the projection unit,
The signal processing unit analyzes the quality of the object based on the image of the observation site including the reference image captured by the imaging unit,
wherein the projection unit generates the projection image indicating the quality analysis result of the object;
A projection device according to claim 1 . the spectral prism reflects near-infrared light out of the light from the observed region on the first surface and transmits first polarized light having the same wavelength band as visible light out of the light from the observed region,
The imaging unit includes a first imaging unit that captures a near-infrared image of the observation site based on the near-infrared light, and a second imaging unit that captures a visible image of the observation site based on the first polarized light. and
The projection unit generates the projection image based on the near-infrared image of the observation site and the visible image of the observation site, and uses second polarized light having the same wavelength band as visible light to project the spectral prism and the lens. projecting the projection image through
3. A projection device according to claim 2. further comprising an illumination unit that irradiates excitation light having a predetermined wavelength band to the observation site to which the fluorescent reagent has been administered in advance,
the spectral prism reflects fluorescence, which is light emitted by the fluorescent reagent based on the excitation light, on the first surface;
The first imaging unit receives the fluorescence through the spectral prism and captures a near-infrared image of the observation site,
The projection unit generates the projection image for teaching the light emitting location of the fluorescent reagent based on the near-infrared image of the observation site.
4. Projection device according to claim 3.

Images