JP2017116982A - Image analyzing device, image analyzing method and image analyzing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image analyzing technology that is able to obtain an image hindered in shading, while maintaining speckle contrast.SOLUTION: An image analyzing device comprises: a light source that emits, under a first emitting condition and a second emitting condition, coherent light to an object to be imaged; a speckle image capturing section that captures a first speckle image obtained from light scattered from the object to be imaged, to which the coherent light emitted under the first emitting condition has been emitted, and a second speckle image obtained from light scattered from the object to be imaged, to which the coherent light emitted under the second emitting condition has been emitted; and an information processing part that separates the speckle images on the boundary of the difference in average brightness between the first speckle image and the second speckle image, joins the separated speckle images on the boundary, and analyzes the combined speckle images.SELECTED DRAWING: Figure 1

Description

  The present technology relates to an image analysis apparatus. More specifically, the present invention relates to an image analysis apparatus, an image analysis method, and an image analysis system that use speckle generated by light irradiation to an imaging target.

Conventionally, in order to grasp the shape and structure of a biological sample such as blood vessels and cells, an image analysis apparatus and an image analysis method using an optical method have been developed (see Patent Document 1).
The image analysis apparatus disclosed in Patent Document 1 is a microscope that converts a phase distribution of a biological sample into an image intensity distribution, and includes a microscope having an image contrast changing unit that changes an image contrast of the image intensity distribution, A control unit that controls the image contrast change unit so as to acquire a plurality of images having different contrasts, and the phase distribution measurement method according to claim 1, wherein the plurality of images acquired by the control by the control unit. An arithmetic unit for calculating a phase distribution of the biological sample from the image and forming a phase distribution image from the calculated phase distribution of the biological sample; and a biochemical of the biological sample acquired by a method different from the phase distribution image Image of the biological sample visualizing various phenomena and / or physical phenomena, and the biological sample formed by the arithmetic unit Having a combining unit for combining the phase distribution image, and the.

  On the other hand, in imaging technology using an optical technique for imaging a flow path such as a blood vessel, there is a concern that various noises may cause a decrease in detection accuracy. Speckle is known. Speckle is a phenomenon in which a spot-like swaying pattern appears on the irradiated surface in accordance with the uneven shape of the irradiated surface. In recent years, a technique has been developed for a method of imaging a flow path such as a blood vessel using speckle, which is one of noises.

  By the way, speckle is a random interference / diffraction pattern caused by scattering in the optical path. The magnitude of speckle is represented by an index called speckle contrast, which is a value obtained by dividing the standard deviation of the intensity distribution by the average of the intensity distribution. When an imaging target illuminated with coherent light is observed using an imaging optical system, speckle due to scattering of the imaging target is observed on the image plane. When the object to be imaged moves or changes its shape, a random speckle pattern corresponding to the object is observed.

  When a light scattering fluid such as blood is observed, the speckle pattern changes every moment due to the change in the fine shape caused by the flow. At that time, if an imaging device is installed on the image plane and the fluid is imaged with an exposure time sufficiently longer than the change in the speckle pattern, the speckle contrast of the blood flowing part, that is, the blood vessel part is time-averaged. It decreases by. Angiography can be performed by utilizing such a change in speckle contrast.

JP2015-125326A

In the image analysis technique using such an optical method, there are generally an illumination optical system and an imaging optical system. And, in order to prevent surface reflection caused by light irradiation to the imaging target, generally, the optical path of the illumination optical system and the optical path of the imaging optical system are, for example, obliquely illuminating the illumination optical system with respect to the imaging optical system. The structure does not match.
In such a configuration, the luminance value near the illumination position in the imaging target tends to increase.

  As a method for preventing the occurrence of such an average luminance difference (hereinafter also referred to as “shading”) in an image, ring illumination or the like may be used in the case of the bright field illumination technique as disclosed in Patent Document 1. Conceivable.

  On the other hand, the image analysis technique using speckle measures the flow rate dependency of blood or the like flowing in the deep part by the speckle contrast space image developed in the acquired image pixel. This is different from the digital holography that separates a plurality of images with different conditions into a phase distribution image and an intensity distribution image as shown in FIG.

  For this reason, as in the case of bright field illumination technology, when ring illumination or the like is used in order to prevent the occurrence of an average luminance difference, the problem that the speckle contrast, which is an index of speckle size, decreases. was there.

  Accordingly, the main object of the present technology is to provide an image analysis technology capable of obtaining an image in which shading is suppressed while maintaining speckle contrast.

The present technology is obtained from a light source that irradiates an imaging target with coherent light under the first irradiation condition and the second irradiation condition, and scattered light of the imaging target that is illuminated with the coherent light irradiated under the first irradiation condition. A speckle image capturing unit that captures a second speckle image obtained from the scattered light of the imaging target illuminated with the first speckle image and the coherent light irradiated under the second irradiation condition, and the first spec The speckle images are separated at the boundary of the average brightness difference formed in each of the speckle image and the second speckle image, and the separated speckle images are joined at the boundary, and the synthesized speckle composite image is obtained. An image analysis apparatus including an information processing unit for analysis is provided.
In this image analysis device, the information processing unit may be configured such that an average value of the luminance value of the first speckle image and the luminance value of the second speckle image is used as the luminance value of the speckle composite image. .
Further, in the image analysis device, the information processing unit may be configured such that an intersection of the luminance value of the first speckle image and the luminance value of the second speckle image is the boundary.

Further, in the image analysis device, when there is a difference between the luminance value at the boundary of the first speckle image and the luminance value at the boundary of the second speckle image in the information processing unit, The configuration may be such that the luminance value at the boundary is corrected so as to match the average value of the luminance values at the boundary.
The image analysis apparatus further includes a vibration unit that suppresses speckles on the optical axis of the light source, and the information processing unit includes an average luminance difference distribution in the first speckle image and a second speckle image. A configuration may be used in which a correction value of the luminance value at the boundary is calculated based on the average luminance difference distribution.
Further, in the image analysis device, the information processing unit detects a region having a predetermined luminance threshold or more in the first speckle image and the second speckle image, and further, the region on the first speckle image and The configuration may be such that a common area in the area on the second speckle image is calculated and detected as a boundary in the speckle composite image from the common area.
In the image analysis device, the speckle image capturing unit captures the first speckle image and the second speckle image a plurality of times, and further extracts a first difference image from the plurality of first speckle images. A difference image capturing unit that generates and generates a second difference image from a plurality of second speckle images, and the information processing unit forms each of the first difference image and the second difference image. The difference image may be separated at the boundary of the average brightness difference, the separated difference images are connected to each other at the boundary, and the synthesized difference composite image may be analyzed.

Further, the present technology provides a light irradiation step of irradiating the imaging target with coherent light under the first irradiation condition and the second irradiation condition, and the imaging target illuminated with the coherent light irradiated under the first irradiation condition. A speckle image imaging step of imaging a first speckle image obtained from the scattered light and a second speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the second irradiation condition; Specs synthesized by separating each speckle image at the boundary of the average luminance difference formed in each of the first speckle image and the second speckle image, and joining the separated speckle images at the boundary An image analysis method including an information processing step of analyzing a synthesized image is also provided.
In this image analysis method, in the information processing step, an average value of the luminance value of the first speckle image and the luminance value of the second speckle image may be used as the luminance value of the speckle composite image.
In the image analysis method, the information processing step may use a crossing point between the luminance value of the first speckle image and the luminance value of the second speckle image as a boundary.

Further, in the image analysis method, in the information processing step, if there is a difference between the luminance value at the boundary of the first speckle image and the luminance value at the boundary of the second speckle image, the boundary of each speckle image The luminance value at may be corrected so as to match the average value of the luminance values at the boundary.
The image analysis method further includes a vibration step of vibrating the irradiated coherent light. In the information processing step, an average luminance difference distribution in the first speckle image and an average luminance difference in the second speckle image Based on the distribution, a correction value of the luminance value at the boundary may be calculated.
In the image analysis method, in the information processing step, a region having a predetermined luminance threshold or more is detected in the first speckle image and the second speckle image, and the region on the first speckle image and A common region in the region on the second speckle image may be calculated and detected as a boundary in the speckle composite image from the common region.
Furthermore, in the image analysis method, in the speckle image capturing step, each of the first speckle image and the second speckle image is captured a plurality of times, and further, a first difference image is obtained from the plurality of first speckle images. Generating a second difference image from a plurality of second speckle images, and in the information processing step, each of the first difference image and the second difference image is formed. Alternatively, the difference images may be separated at the boundary of the average luminance difference, the separated difference images may be connected at the boundary, and the synthesized difference composite image may be analyzed.

  The present technology also provides a light source that irradiates the imaging target with coherent light under the first irradiation condition and the second irradiation condition, and the scattered light of the imaging target that is illuminated with the coherent light irradiated under the first irradiation condition. A speckle image imaging device that captures a second speckle image obtained from the scattered light of the imaging target illuminated with the first speckle image obtained from the above and the coherent light irradiated under the second irradiation condition; Each speckle image is separated at the boundary of the average brightness difference formed in each of the one speckle image and the second speckle image, and the separated speckle images are connected at the boundary to synthesize the speckle composition. An image analysis system including an information processing apparatus for analyzing an image is also provided.

According to the present technology, it is possible to obtain an image in which shading is suppressed while maintaining speckle contrast, and as a result, it is possible to improve the accuracy of the state analysis of the imaging target.
In addition, the effect described here is not necessarily limited, and may be any effect described in the present technology.

It is a schematic conceptual diagram which shows typically the concept of 1st embodiment of the image analysis apparatus which concerns on this technique. It is a schematic conceptual diagram which shows an example of the arrangement structure of the light source and speckle image imaging part which are shown in FIG. It is a drawing substitute graph which shows the illumination timing of the image analysis apparatus shown in FIG. 3 is a flowchart illustrating an example of a drive sequence of the image analysis apparatus illustrated in FIG. 1. It is a flowchart which shows the imaging process of the 1st speckle image shown in FIG. It is a flowchart which shows the imaging process of the 2nd speckle image shown in FIG. It is a schematic conceptual diagram which shows an example of the arrangement structure of the light source and speckle image imaging part in the image analysis apparatus of 2nd embodiment which concerns on this technique. It is a flowchart which shows an example of the drive sequence of the image analysis apparatus shown in FIG. It is a schematic conceptual diagram which shows typically the structure of the image analysis apparatus of 3rd embodiment which concerns on this technique. It is a schematic conceptual diagram which shows typically the concept of the image analyzer of 4th embodiment which concerns on this technique. It is a flowchart which shows an example of the drive sequence of the image analysis apparatus shown in FIG. It is the model conceptual diagram which showed typically the concept of the image analysis system which concerns on this technique.

Hereinafter, preferred embodiments for carrying out the present technology will be described with reference to the drawings. The embodiment described below shows an example of a typical embodiment of the present technology, and the scope of the present technology is not interpreted narrowly. The description will be given in the following order.
1. Image analysis apparatus according to the first embodiment (1) Light source (2) Speckle image capturing unit (3) Information processing unit (4) Storage unit (5) Display unit (6) Support unit (7) Imaging control unit (8) ) Lighting control unit (9) Imaging target 2. Image analysis apparatus according to second embodiment (1) Vibration unit 3. Image analysis apparatus according to third embodiment (1) Wavelength variable section (2) Multiplexing section 4. Image analysis apparatus according to fourth embodiment (1) Difference image capturing unit Image Analysis Method According to First Embodiment (1) Light Irradiation Step (2) Speckle Image Imaging Step (2-1) First Speckle Image Imaging Step (2-2) Second Speckle Image Imaging Step (3) Information processing step (3-1) Boundary detection step (3-2) Speckle composite image creation step (3-3) Speckle composite image analysis step (4) Storage step (5) Display step 6. Image analysis method according to second embodiment (1) Vibration process 7. Image analysis method according to fourth embodiment (1) Wavelength variable step (2) Multiplexing step 8. Image analysis method according to fourth embodiment (1) Difference image capturing step Image analysis system (1) Light source (2) Speckle image capturing device (3) Information processing device (4) Server (5) Display device (6) Imaging control device (7) Lighting control device

<1. Image Analysis Device According to First Embodiment>
FIG. 1 is a schematic conceptual diagram schematically showing the first embodiment of the image analysis device according to the present technology. FIG. 2 is a schematic diagram illustrating an example of an arrangement structure of light sources and imaging units in the image analysis apparatus according to the first embodiment. The image analysis apparatus 1 according to the first embodiment includes a light source 11, a speckle image capturing unit 12, and an information processing unit 13. Moreover, it is possible to further include a storage unit 14, a display unit 15, a support unit 16, an imaging control unit 17, an illumination control unit 18, and the like as necessary. Hereinafter, each part will be described in detail.

(1) Light source The light source 11 irradiates the imaging target O with coherent light. The coherent light emitted from the light source 11 is that the phase relationship of light waves at any two points in the light beam is constant in time and constant. Even light that exhibits complete coherence.

  The type of the light source 11 is not particularly limited as long as the effect of the present technology is not impaired. An example is laser light. As the light source 11 that emits laser light, for example, argon ion (Ar) laser, helium-neon (He-Ne) laser, die (dye) laser, krypton (Cr) laser, semiconductor laser, or semiconductor laser, wavelength conversion with the semiconductor laser One or two or more solid lasers combined with optical elements can be used in any combination.

As shown in FIG. 2, the image analysis apparatus 1 according to the first embodiment includes a light source 11 and includes a first light source 11 a and a second light source 11 b. Each light source 11a, 11b is rotatably provided with respect to the said support part 16 via the pulse motor 16a. That is, each of the light sources 11a and 11b can be rotated in units of steps by giving a pulse signal to the pulse motor 16a, but can be stopped at that position when no pulse signal is given.
In addition, it does not specifically limit regarding the structure which makes each light source 11a, 11b rotatable with respect to the support part 16, You may use well-known structures other than a pulse motor.

In the image analysis apparatus 1 according to the first embodiment, the irradiation conditions of the light sources 11a and 11b with respect to the imaging target O are different.
That is, in the image analysis apparatus 1 according to the first embodiment, as shown in FIG. 2, the coherent light L <b> 1 is applied to the imaging target O in a state where the first light source 11 a is inclined by 45 degrees with respect to the support portion 16. It comes to irradiate.
For this reason, in the imaging target O, the luminance value of the coherent light L1 is high at the position closest to the first light source 11a (the end in the left direction in FIG. 2), and the position farthest from the first light source 11a (the paper surface in FIG. 2). The luminance value of the coherent light L1 is low at the right end) (corresponding to the first irradiation condition in the present technology).
On the other hand, the second light source 11b also irradiates the imaging target O with the coherent light L2 in a state inclined by 45 degrees with respect to the support portion 16, and the first light source 11a is centered on the imaging target O. Are arranged at symmetrical positions.
Then, in the imaging object O, the luminance value of the coherent light L2 is high at the position closest to the second light source 11b (the end in the right direction in FIG. 2), and the position farthest from the second light source 11b (the left side in FIG. 2). The luminance value of the coherent light L2 is low at the end of the direction (corresponding to the second irradiation condition in the present technology).

In other words, in the image analysis apparatus 1 according to the first embodiment, the coherent light L1 emitted from the first light source 11a and the coherent light L2 emitted from the second light source 11b complement each other in luminance values. It is irradiated.
Further, in the image analysis apparatus 1 according to the first embodiment, as shown in FIG. 3, the coherent light L1 and the second light source of the first light source 11a with the same luminous flux and the same time with respect to the imaging target O are obtained. The 11b coherent light L2 is illuminated in time series. Further, in response to this, as shown in FIG. 3, the speckle image capturing unit 12 captures speckle images in time series.
In the image analysis device 1 according to the first embodiment, the light sources 11a and 11b do not need to be alternately illuminated as long as speckle images based on coherent light having different irradiation conditions are captured. Other configurations can be employed.

  In the image analysis apparatus 1 according to the first embodiment, the two light sources 11 are provided. However, the number of the light sources 11 is not particularly limited, and the brightness value varies depending on the coherent light emitted from each light source 11. For example, three or more may be provided.

(2) Speckle Image Imaging Unit In the speckle image imaging unit 12, specs appearing on the surface of the imaging object O based on the scattered light obtained from the imaging object O irradiated with the coherent light of the light sources 11a and 11b. The image is captured. Specifically, the first speckle image is captured based on the scattered light obtained from the imaging target O illuminated with the coherent light L1 irradiated from the first light source 11a under the first irradiation condition, Based on the scattered light obtained from the imaging object O illuminated with the coherent light L2 irradiated from the second light source 11b under the second irradiation condition, the second speckle image is captured.

The speckle image imaging unit 12 includes an imaging optical system 12a that forms an image of scattered light obtained from the imaging target O, and an imaging unit 12b that receives the light imaged by the imaging optical system 12a. . The imaging optical system 12a includes, for example, an image sensor such as a CCD sensor (CCD: Charge CoupLED 38 Device) or a CMOS sensor (CMOS: Complementary Metal Oxide Semiconductor), an imaging lens, and the like.
In FIG. 2, one speckle image capturing unit 12 is provided. However, two speckle image capturing units 12 are provided for each of the light sources 11a and 11b to capture the first speckle image. It is good also as a structure which provides the speckle image imaging part and the speckle image imaging part for imaging a 2nd speckle image.

  The imaging method performed by the speckle image imaging unit 12 is not particularly limited as long as the effect of the present technology is not impaired, and one or more known imaging methods can be selected and used in any combination. . For example, an imaging method using the conventional imaging device can be given.

In the speckle image capturing unit 12, for example, an image in which a pseudo blood vessel in which pseudo blood flows is mapped based on speckle is generated. Here, as described above, speckle is a random interference / diffraction pattern. Therefore, when light scattering fluid such as blood moves or changes with time, the speckle also changes with time. For this reason, the boundary between the fluid and the other part can be observed.
In addition, the speckle image capturing unit 12 includes a configuration that performs leveling using, for example, a plurality of speckle images to reduce speckle image unevenness in order to clarify a portion where speckles are generated. It may be.

As described above, the image analysis apparatus 1 according to the first embodiment employs a configuration in which the imaging target O is alternately irradiated with the first light source 11a and the second light source 11b.
Therefore, in the speckle image capturing unit 12, the first speckle image and the second speckle image are continuously captured in time series.
Note that the image analysis apparatus 1 according to the first embodiment may be configured to capture the first speckle image and the second speckle image one by one or plural images.

(3) Information Processing Unit The image analysis apparatus 1 according to the first embodiment includes an information processing unit that performs a predetermined process on the speckle image captured by the speckle image imaging unit 12.
Here, shading due to the irradiation condition occurs in the first speckle image and the second speckle image captured under the first irradiation condition and the second irradiation condition.
For this reason, the information processing unit 13 first measures the speckle luminance distribution in the captured speckle image.
That is, when the imaging target O illuminated with the coherent light is observed by the imaging optical system 12a, speckles due to scattering of the imaging target O are observed on the image plane. In the information processing unit 13, for example, a luminance meter is used to measure the speckle luminance distribution in the captured image.
The measurement method of the luminance distribution is not particularly limited as long as the effect of the present technology is not impaired, and one or more known measurement methods can be selected and used in any combination.

  Thereafter, the information processing unit 13 detects a shading boundary (hereinafter simply referred to as “boundary”) in each speckle image based on the luminance distribution of each speckle image. The method for detecting this boundary is not particularly limited, and a known method for detecting a shading boundary in a speckle image can be employed. Among the methods for detecting this boundary, a characteristic method will be described later.

Further, the information processing unit 13 detects the shading boundary of each speckle image, and then separates the speckle images based on the boundary. Further, the information processing unit 13 connects the separated first speckle image and the separated second speckle image at the boundary between the speckle images.
As a result, the information processing unit 13 forms a speckle image (hereinafter referred to as “speckle composite image”) having a luminance value necessary for the state analysis of the imaging target O.

Here, in the speckle composite image formed by the information processing unit 13, it is necessary to ensure the speckle contrast, and therefore the luminance distribution is uniform in the speckle composite image. Required.
Therefore, the information processing unit 13 measures, for example, the luminance value of the first speckle image and the luminance value of the second speckle image, and the luminance value of the first speckle image and the second speckle image The average value with the luminance value is calculated. It is preferable that the calculated average value is set as the luminance value of the speckle composite image.

Further, the information processing unit 13 measures speckle contrast, which is a value obtained by dividing the standard deviation of the luminance distribution by the average of the luminance distribution in the speckle composite image.
The information processing unit 13 analyzes the state of the imaging target O based on the measured speckle contrast.
According to this analysis, for example, the boundary surface between the fluid part and the stationary part in the imaging target O can be clearly grasped, and the position of the blood vessel and the like can be analyzed.
Further, when a light scattering fluid such as blood moves or changes with time, the speckle also changes with time, so that the flow velocity of the fluid can be analyzed.

Next, a shading boundary detection method performed by the information processing unit 13 will be described.
In the image analysis apparatus 1 according to the present technology, as described above, the information processing unit 13 measures the luminance value of the first speckle image and the luminance value of the second speckle image.
Then, the information processing unit 13 creates, for example, a graph with the horizontal axis representing the pixel of the image and the vertical axis representing the luminance value based on the measurement result of the luminance value of each speckle image. Pixels that intersect the luminance value of the speckle image and the luminance value of the second speckle image are detected as a boundary in each speckle image.

In addition, as another method for detecting the boundary, a brightness value that can sufficiently observe speckles is determined in advance (hereinafter referred to as “brightness threshold”), and the boundary is detected using this brightness threshold. It is done.
That is, in the information processing unit 13, a luminance threshold value at which speckles increase with respect to other noise components in each of the first speckle image and the second speckle image is determined in advance.
And using this brightness | luminance threshold value, the pixel whose brightness | luminance value is more than the said brightness | luminance threshold value is selected in each speckle image. In such a case, when there are a plurality of pixels that are equal to or greater than the luminance threshold, a pixel region in which these are collected is selected.
Furthermore, a pixel or a pixel region that is equal to or higher than the luminance threshold in the first speckle image is compared with a pixel or a pixel region that is equal to or higher than the luminance threshold in the second speckle image, and the luminance value is the same or approximated (hereinafter referred to as a luminance value). , “Common area”).
Then, the light amounts of the first light source 11a and the second light source 11b are darkened, and a minute area before the common area becomes an empty set is detected as the boundary.

The boundary detection method described above is merely an example, and a known method can be used as long as the speckle contrast is ensured in the speckle composite image.
Further, the shape of the boundary to be detected is not particularly limited, and can be appropriately selected according to the shading pattern, and may be a straight line, a curve, or a circle. When the boundary is linear, it is preferable because the position can be easily adjusted when the separated first speckle image and the separated second speckle image are joined. In general, as a shading pattern of a speckle image, the central portion of the image is bright and the peripheral portion tends to be dark. In consideration of such a shading pattern, it is preferable to make the boundary circular.

  Here, as described above, the irradiation conditions of the coherent light are different between the first speckle image and the second speckle image. For this reason, there is a possibility that the luminance value at the boundary of each speckle image is different. An example of a method for correcting the luminance value at the boundary in the speckle composite image in such a case will be described below.

That is, as shown in Equation 1 below, first, the luminance value P1 at the boundary of the first speckle image and the luminance value P2 at the boundary of the second speckle image are measured.
From this measurement result, an average value Pave of the luminance value P1 and the luminance value P2 is calculated.
In the first speckle image, the luminance value P1 is corrected so as to match the average value Pave, and in the second speckle image, the luminance value P2 is corrected so as to match the average value Pave.
According to such a method, even if there is a difference in the luminance value at the boundary between the speckle images, this difference can be eliminated.

(4) Storage Unit The image analysis device according to the present technology analyzes each speckle image captured by the speckle image capturing unit 12, speckle contrast and boundary measured by the information processing unit 13, and analysis by the information processing unit 13. It is possible to further include a storage unit 14 for storing the analysis results.
The storage unit 14 is not essential in the image analysis device according to the present technology. For example, an external storage device can be connected to store a speckle image or the like.

(5) Display Unit The image analysis apparatus according to the present technology further includes a display unit 15 that displays a speckle image captured by the speckle image capturing unit 12, an analysis result analyzed by the information processing unit 13, and the like. it can. The display unit 15 is not essential in the image analysis apparatus according to the present technology, and for example, an external monitor or the like can be used.

(6) Support Unit The image analysis apparatus according to the present technology may further include a support unit 16 for arranging the light source 11. In the image analysis apparatus according to the first embodiment, as described above, the light sources 11a and 11b are rotatably attached to the support portion 16.
The configuration of the support unit 16 is not particularly limited, and a known unit that is usually used for supporting the light source in the image analysis apparatus can be employed.

(7) Imaging Control Unit The image analysis apparatus according to the present technology may further include an imaging control unit 17 that controls the imaging timing of the speckle image imaging unit 12. In the imaging control unit 17, imaging by the speckle image imaging unit 12 is paused, or a pause period of the speckle image imaging unit 12 is set. The imaging control unit 17 is not essential in the image analysis device according to the present technology, and for example, an external imaging control device or the like can be used.

(8) Illumination control unit The image analysis apparatus according to the present technology may further include an illumination control unit 18 that controls the illumination timing or the illumination position of the first light source 11a and the second light source 11b. The illumination control unit 18 controls turning on / off of the first light source 11a and the second light source 11b. As described above, in the image analysis apparatus 1 according to the first embodiment, the first light source 11a and the second light source 11b are alternately irradiated, and the illumination control unit 18 uses the first light source 11a. Switching between illumination and illumination of the second light source 11b is performed.
The control method by the illumination control unit 18 is not particularly limited, and a known method can be employed. For example, illumination can be switched using an external device such as a liquid crystal tunable filter.
The illumination control unit 18 is configured to control the rotation angle and rotation speed of the pulse motor that is responsible for the rotational drive of the light sources 11a and 11b, and transmits a pulse signal to each pulse motor 16a to transmit each light source. 11a and 11b are driven to rotate. Or when each light source 11a, 11b is arrange | positioned in a desired position, transmission of a pulse signal is stopped and each light source 11a, 11b is fixed.

(9) Imaging target O
The image analysis apparatus according to the present technology can be used for various types of imaging targets, and can be suitably used for imaging using, for example, those including a fluid. Due to the nature of speckles, speckles are unlikely to be generated from the fluid. Therefore, when the image analysis apparatus 1 according to the present technology is used to image a fluid including a fluid, the boundary between the fluid and the other portion, the flow velocity of the fluid, and the like can be obtained.

  More specifically, the imaging object O can be a biological sample, and the fluid can be blood. For example, if the image analysis apparatus 1 according to the present technology is mounted on a surgical microscope, a surgical endoscope, or the like, it is possible to perform a surgery while confirming the position of a blood vessel. Therefore, safer and more accurate surgery can be performed, which can contribute to further development of medical technology.

  Next, an example of a drive sequence of the image analysis apparatus according to the first embodiment will be described with reference to FIGS.

First, based on the coherent light L1 emitted from the light source 11a, the speckle image capturing unit 12 captures a first speckle image (ST1).
After the first speckle image is captured, the first speckle image is stored in the storage unit 14 (ST2).
Thereafter, based on the coherent light L2 emitted from the light source 11b, the speckle image capturing unit 12 captures the second speckle image (ST3).
After the second speckle image is captured, the second speckle image is stored in the storage unit 14 (ST4).
Detailed imaging steps of the first speckle image and the second speckle image will be described later.

After the second speckle image is stored, the information processing unit 13 detects the boundary of shading in each speckle image as described above (ST5). Further, the boundary is stored in the storage unit 14 as necessary (ST6).
Thereafter, the information processing unit 13 separates the first speckle image and the second speckle image based on the detected boundary, and further separates the second speckle image from the separated first speckle image. The speckle image is connected to create a speckle composite image having a luminance value necessary for the state analysis of the imaging target O (ST7).
Thereafter, the speckle composite image is stored in the storage unit 14 (ST8).
Thereafter, the information processing unit 13 measures the speckle contrast in the speckle composite image stored in the storage unit 14, and analyzes the state of the imaging target O based on the speckle contrast (ST9). .

Furthermore, in the image analysis apparatus 1 according to the first embodiment, the analysis result by the information processing unit 13 is stored in the storage unit 14 (ST10).
Finally, in the image analysis apparatus 1 according to the first embodiment, the analysis result by the information processing unit 13 is displayed on the display unit 15 (ST7), and a series of operations ends.
In the image analysis apparatus 1 according to the first embodiment, the speckle composite image stored in the storage unit 14, the first speckle image captured by the speckle imaging unit, and the display unit 15; A second speckle image may be displayed.

Note that FIG. 4 is an explanatory diagram in which the second speckle image is captured after the first speckle image is captured, but the order in which the speckle images are captured is not particularly limited. It does not matter if the two speckle image is taken first.
FIG. 4 shows a driving sequence in which the first speckle image and the second speckle image are captured one by one. In the image analysis apparatus 1, the first speckle image and the second speckle image are displayed. It is also possible to create a speckle composite image using a plurality of speckle images, each of which is configured to capture a plurality of images.
Therefore, the first speckle image imaging step (ST1) and the second speckle image imaging step (ST3) may be repeatedly performed according to the number of speckle images that need to be imaged.

  Further, in the image analysis apparatus 1 according to the first embodiment, the first speckle image, the second speckle image, the boundary, and the speckle composite image are stored in the storage unit 14, but these are not necessarily limited to these. The first speckle image, the second speckle image, the boundary, and the speckle composite image may not be stored in the storage unit 14. Furthermore, in the image analysis device 1 according to the first embodiment, at least the speckle contrast is ensured and the speckle image in which shading is suppressed is formed. Therefore, the storage operation and the display operation are not necessarily performed. There is no need. In FIG. 4, after the analysis results are stored, the analysis results are displayed. However, the order of these operations is not particularly limited.

Next, the imaging process of each speckle image will be described with reference to FIGS.
As shown in FIG. 5, when imaging of the first speckle image is started, first, the illumination control unit 18 is driven, the first light source 11a is turned on, and the imaging target O is irradiated with coherent light L1. (ST101).
Thereafter, the illumination position of the first light source 11a with respect to the imaging object O is adjusted by the illumination controller 18 (ST102).
Thereafter, the speckle image capturing unit 12 is activated by the image capturing control unit 17 (ST103). Thereby, in the speckle image imaging unit 12, the scattered light of the imaging target O is imaged by the imaging optical system 12a, and further, the first speckle image is generated by the imaging unit 12b based on the imaged scattered light. Is imaged (ST104).
After the imaging of the first speckle image is completed, the first light source 11a is turned off by the illumination control unit 18 (ST105).
Further, the speckle image capturing unit 12 is suspended by the image capturing control unit 17 (ST106), and the first speckle image capturing is ended.

Next, the imaging process of a 2nd speckle image is demonstrated using FIG.
Similar to the imaging of the first speckle image, when the imaging of the second speckle image is started, the illumination control unit 18 is driven, the second light source 11b is illuminated, and the coherent light L2 is applied to the imaging object O. Is irradiated (ST201).
Thereafter, the illumination position of the second light source 11b is adjusted by the illumination controller 18 (ST202).
Thereafter, the speckle image capturing unit 12 is activated by the image capturing control unit 17 (ST203). Thereby, in the speckle image imaging unit 12, the scattered light of the imaging target O is imaged by the imaging optical system 12a, and further, the second speckle image is generated by the imaging unit 12b based on the imaged scattered light. Is imaged (ST204).
After the second speckle image is captured, the second light source 11b is turned off by the illumination control unit 18 (ST205).
Further, the speckle image capturing unit 12 is paused by the image capturing control unit 17 (ST206), and the capturing of the first speckle image is completed.

Here, in the imaging process of each speckle image shown in FIG. 5 and FIG. 6, the illumination position of each light source is adjusted after each light source is turned on. After performing, each light source may be turned on.
Further, as described above, the imaging control unit 17 and the illumination control unit 18 are not essential components in the image analysis apparatus according to the present technology, and thus need not be provided. For this reason, in the image analysis device according to the present technology, the speckle image imaging unit 12 can be always driven without pausing the speckle image imaging unit 12 in the imaging control unit 17. Further, the light sources 11a and 11b may not be turned on / off by the illumination control unit 18, and the light sources 11a and 11b may be always illuminated.
That is, there may be a configuration in which the steps ST101 to 103, ST105 and 106 shown in FIG. 5 and the steps ST201 to 203, ST205 and 206 shown in FIG. 6 are not performed.
However, if the speckle image capturing unit 12 is always driven and each of the light sources 11a and 11b is always illuminated, electric power for maintaining driving is required, and driving cost increases. For this reason, the configuration in which the speckle image capturing unit 12 is activated / paused by the imaging control unit 17 and the light sources 11a and 11b are turned on / off by the illumination control unit 18 is preferable.

According to the image analysis apparatus 1 of the first embodiment according to the present technology, the information processing unit 13 can form a speckle composite image having a luminance value necessary for the state analysis of the imaging target O. it can.
That is, the information processing unit 13 can prevent a decrease in speckle contrast due to insufficient luminance value and obtain an image in which shading is suppressed.
As a result, the accuracy of the state analysis of the imaging object O can be improved.

<2. Image Analysis Device According to Second Embodiment>
Next, a second embodiment of the image analysis device according to the present technology will be described with reference to FIGS. FIG. 7 is a schematic conceptual diagram illustrating an example of an arrangement structure of light sources and speckle image capturing units in the image analysis apparatus according to the second embodiment. FIG. 8 is a flowchart illustrating an example of a driving sequence of the image analysis apparatus.
Similar to the image analysis apparatus 1 according to the first embodiment, the image analysis apparatus 101 according to the second embodiment includes two light sources 11a and 11b, a speckle image imaging unit 12, and an information processing unit 13. Moreover, it is possible to further include a storage unit 14, a display unit 15, a support unit 16, an imaging control unit 17, an illumination control unit 18, and the like as necessary.
On the other hand, the image analysis apparatus 101 according to the second embodiment includes a vibration unit 19, and the structure thereof is different from that of the image analysis apparatus 1 according to the first embodiment. In the image analysis apparatus 101 according to the second embodiment, the speckle composite image in which speckles are suppressed can be obtained by providing the vibration unit 19.

  Below, the light source 11, the speckle image imaging part 12, the information processing part 13, the memory | storage part 14, the display part 15, the support part 16, the imaging control part 17, and illumination which are common in the image analysis apparatus 1 which concerns on 1st embodiment are demonstrated. While the description of the control unit 18 is omitted, the different vibration unit 19 will be mainly described. For this reason, only the figure which can grasp | ascertain the detail of the said vibration part 19 is shown, and it abbreviate | omits regarding the schematic diagram which shows the whole structure.

(1) Vibrating unit In the image analysis apparatus 101 according to the second embodiment, the vibrating unit 19 is arranged on the optical axis of each of the light sources 11a and 11b.
The vibration unit 19 vibrates the coherent lights L1 and L2 emitted from the light sources 11a and 11b. For example, a known optical stirrer can be used.
In the image analysis apparatus 101 according to the second embodiment, the vibration units 19 are vibrated to agitate the coherent lights L1 and L2 emitted from the light sources 11a and 11b, and as a result, appear on the surface of the imaging target O. Can be suppressed.
In the image analysis apparatus 101 according to the second embodiment, the vibration unit 19 may be constantly driven, or may be configured such that activation / pause of the vibration unit 19 is controlled.

Since the image analysis apparatus 101 according to the second embodiment includes the vibration unit 19, speckle images captured by the speckle image imaging unit 12 have speckles suppressed. Here, in the following description, for the sake of convenience, the first speckle image in which speckle is suppressed is referred to as a first speckle suppression image, and the second speckle image in which speckle is suppressed is referred to as a second speckle suppression image.
In the image analysis apparatus 101 according to the second embodiment, since the generation of speckle is suppressed by the vibration unit 19, the speckle image captured by the speckle image capturing unit 12 is subjected to shading. The peak position is easy to detect, and the information processing unit 13 is configured to detect the shading peak position from the speckle suppression image.

In the image analysis apparatus 101 according to the second embodiment, since speckle is suppressed in each speckle image captured by the speckle image capturing unit 12, an average luminance difference distribution (hereinafter, “ It is easy to detect a shading pattern).
For this reason, in the image analysis apparatus 101 according to the second embodiment, the information processing unit 13 uses the shading pattern in the first speckle suppression image and the shading pattern in the second speckle suppression image to generate the speckle composite image. It is also possible to calculate a value for correcting the luminance value at.

  Furthermore, in the image analysis apparatus 101 according to the second embodiment, the information processing unit 13 detects a difference between the shading peak position detected from the speckle suppression image and the center position of the speckle suppression image. It has become. The information processing unit 13 is configured to convert the difference into an electrical signal and feed back the difference signal to the illumination control unit 18.

Then, the illumination control unit 18 drives each pulse motor 16a based on the difference signal, and sets the illumination position of each light source 11a, 11b to the image center of the speckle image captured by the speckle image imaging unit 12. It is configured to match.
The method for detecting the shading peak position in the information processing unit 13 is not particularly limited, and a known method can be used. Furthermore, the method for detecting the difference between the shading peak position and the image center position is not particularly limited, and a known method can be adopted.

Next, an example of a drive sequence of the image analysis apparatus 101 according to the second embodiment having the above configuration will be described with reference to FIG.
First, the vibration unit 19 is activated and vibrated (ST301). Thereafter, similarly to the image analysis apparatus 1 according to the first embodiment, the processing shown in ST101 to ST106 in FIG. 5 and the processing ST201 to ST206 in FIG. 6 are performed to capture the first speckle image and the second speckle image. (ST302).
Here, in the image analysis apparatus 101 according to the second embodiment, since the coherent light emitted from each of the light sources 11a and 11b is agitated by the vibration unit 19, the speckle imaged by the speckle image imaging unit. The image is a speckle suppression image.

After the first and second speckle suppression images are captured, each speckle suppression image is stored in the storage unit 14 as in the image analysis device according to the first embodiment (ST303). Thereafter, the information processing unit 13 detects the peak position of shading in each speckle suppression image (ST304).
Further, the information processing unit 13 detects a difference between the shading peak position in each speckle suppression image and the center position of each speckle suppression image (ST305). Thereafter, the difference detected by the information processing unit 13 is stored in the storage unit 14 (ST306).

Then, the information processing unit 13 determines whether or not the difference is less than a specified value (ST307).
In this determination, when the difference is larger than the specified value (NO in ST307), the difference is converted into an electric signal, and the difference signal is transmitted to the illumination control unit 18. Based on the difference signal, the pulse motor 16a that supports the light sources 11a and 11b is controlled again, and the irradiation positions of the light sources 11a and 11b are changed (ST102 in FIG. 5 and ST202 in FIG. 6). Then, the operation of capturing each speckle suppression image is performed again (ST302).
On the other hand, when it is determined that the difference is less than the specified value (YES in ST307), the information processing unit 13 performs processing for matching the shading peak position and the image center position (ST308).

Thereafter, in the image analysis apparatus 101 according to the second embodiment, each speckle image is captured by the speckle image capturing unit 12 in a state in which processing for matching the shading peak position and the image center position is performed.
And the speckle synthetic | combination image is produced in the said information processing part 13 similarly to the image analysis apparatus 1 which concerns on 1st embodiment (ST309). Thereafter, the created speckle composite image is stored in the storage unit 14 (ST310).
Further, the information processing unit 13 analyzes the state of the imaging target O based on the speckle contrast in the speckle composite image (ST311).
Thereafter, in the image analysis apparatus 101 according to the second embodiment, the analysis result by the information processing unit 13 is stored in the storage unit 14 (ST312).

Finally, in the image analysis apparatus 101 according to the second embodiment, the analysis result by the information processing unit 13 is displayed on the display unit 15 (ST313), and a series of operations ends.
In the image analysis apparatus 101 according to the second embodiment, the first speckle image, the second speckle image, the boundary, the speckle composite image, and the difference are stored in the storage unit 14. The first speckle image, the second speckle image, the boundary, the speckle composite image, and the difference are not necessarily stored in the storage unit 14. In addition, since the image analysis apparatus according to the present technology may be configured to form at least a speckle image in which speckle contrast is ensured and shading is suppressed, the storage operation and the display operation are not necessarily performed. .
Further, in FIG. 8, after the analysis result is stored, the analysis result is displayed. However, the order of these operations is not particularly limited, and the analysis result display operation is performed. It may be performed prior to storing the analysis result.

According to the image analysis apparatus 101 according to the second embodiment configured as described above, the information processing unit 13 can form a speckle composite image having a luminance value necessary for the state analysis of the imaging target O. it can.
That is, the information processing unit 13 can prevent a decrease in speckle contrast due to insufficient luminance value and obtain an image in which shading is suppressed.
As a result, the accuracy of the state analysis of the imaging object O can be improved.

Furthermore, according to the image analysis apparatus 101 according to the second embodiment, it is possible to create a speckle suppression image by providing the vibration unit 19. For this reason, the information processing unit 13 can easily extract only the shading pattern from each speckle suppression image.
As a result, it is possible to improve the accuracy of the state analysis of the imaging target O based on the obtained speckle composite image.
Further, for example, in a case where a structure capable of capturing both a bright-field image and a speckle image is obtained, when the bright-field image and the speckle image are superimposed by switching the vibration unit 19, an image without a sense of incongruity is obtained. Can do.

<3. Image Analysis Device According to Third Embodiment>
Next, a third embodiment of the image analysis device according to the present technology will be described with reference to FIG. FIG. 9 is a schematic conceptual diagram illustrating an example of an arrangement structure of light sources and speckle image capturing units in the image analysis apparatus of the third embodiment.
In the image analysis apparatus 1 according to the first embodiment, a configuration is employed in which the optical axis of the light source 11 and the optical axis of the speckle image capturing unit 12 are arranged on different axes. The image analysis apparatus 201 has a so-called coaxial epi-illumination configuration in which the optical axis of the light source 11 and the optical axis of the speckle image capturing unit 12 are matched.

The image analysis apparatus 201 according to the third embodiment is a coaxial epi-illumination type and has a configuration in which only one light source 11 is provided. However, the configuration of the light source 11 itself and the configuration of the speckle image capturing unit 12 itself are as follows. These are the same as those of the image analysis apparatus 1 of the first embodiment.
Further, the image analysis apparatus 201 according to the third embodiment includes the same information processing unit 13 as the image analysis apparatus 1 according to the first embodiment. Moreover, it is possible to further include the same storage unit 14, display unit 15, support unit 16, imaging control unit 17, illumination control unit 18 and the like as the image analysis apparatus 1 according to the first embodiment as necessary. .
In the following description, the description of the configuration common to the image analysis apparatus 1 according to the first embodiment will be omitted, and the different configuration will be mainly described.

  That is, the image analysis apparatus 201 according to the third embodiment includes a wavelength variable unit 20 that controls the wavelength of the coherent light emitted from the light source 11, the wavelength of the coherent light emitted from the light source 11, and the speckle image. And a combining unit 21 that combines wavelengths of light emitted from the imaging unit. Each part will be described below.

(1) Wavelength variable unit The wavelength variable unit 20 is disposed on the optical axis of the light source 11 and changes the wavelength band of coherent light emitted from the light source 11. The wavelength variable section 20 is not particularly limited, but a known tunable filter can be used. Among the tunable filters, it is preferable to use a liquid crystal tunable filter.
The optical axis of the light source 11 whose wavelength band is adjusted by the wavelength variable unit 20 is deflected by the half mirror 22 disposed on the optical axis of the speckle image imaging unit 12, and the optical axis of the speckle image imaging unit 12. And set coaxially.

(2) Multiplexing Unit The image analysis apparatus 201 according to the third embodiment has a multiplexing unit 21 on the optical axis of the speckle image capturing unit 12 and the optical axis of the light source 11 deflected by the half mirror 22. Prepare.
The multiplexing unit 21 combines the coherent light L3 emitted from the light source 11 provided on the same axis and the light L4 emitted from the speckle image capturing unit 12.
The multiplexing unit 21 is not particularly limited, and a known multiplexer used for the configuration of the coaxial epi-illumination can be used.

  In an image analysis apparatus that performs coaxial epi-illumination on such an imaging target, generally, as a shading pattern of a speckle image, the center of the image is bright and the periphery tends to be dark, and the spec The contrast is lowered. On the other hand, when the light emitted from the light source is adjusted by the liquid crystal tunable filter to increase the luminance value of the central portion of the imaging target, the luminance value of the central portion may be saturated.

For this reason, in the image analysis apparatus 201 according to the third embodiment, the wavelength variable unit 20 captures the first speckle image and the second speckle image having different luminance values.
Specifically, for example, the wavelength variable unit 20 is driven to adjust the wavelength of the coherent light emitted from each light source 11. As a result, the speckle image capturing unit 12 captures the first speckle image in which the luminance value of the peripheral portion is increased and the second speckle image in which the luminance value of the central portion is increased.
After that, based on the first speckle image and the second speckle image having different luminance values, a speckle composite image having a necessary luminance value for state analysis, which is equivalent to the image analysis apparatus 1 according to the first embodiment, is created. To do.
In such a case, it is preferable that the information processing unit 13 detects a circular boundary based on a shading pattern unique to the coaxial incident illumination.

According to the image analysis apparatus 201 according to the third embodiment, the specification having the luminance value necessary for the state analysis of the imaging target O is performed by the information processing unit 13 even if the configuration is the coaxial epi-illumination. A composite image can be formed.
That is, the information processing unit 13 can prevent a decrease in speckle contrast due to insufficient luminance value and obtain an image in which shading is suppressed.
As a result, the accuracy of the state analysis of the imaging object O can be improved.

<4. Image Analysis Device According to Fourth Embodiment>
Next, a fourth embodiment of the image analysis device according to the present technology will be described with reference to FIGS. 10 and 11. FIG. 10 is a schematic conceptual diagram schematically showing the configuration of the image analysis apparatus according to the fourth embodiment. FIG. 11 is a flowchart showing an example of a drive sequence of the image analysis apparatus according to the fourth embodiment.

The image analysis apparatus 301 according to the fourth embodiment is different from the image analysis apparatus 1 according to the first embodiment mainly in the configuration for creating a speckle composite image. On the other hand, the image analysis device 301 according to the fourth embodiment includes the same light source 11, speckle image capturing unit 12, and information processing unit 13 as the image analysis device 1 according to the first embodiment. Furthermore, the storage unit 14, the display unit 15, the support unit 16, the imaging control unit 17, the illumination control unit 18, and the like can be further provided as necessary.
In the following description of the image analysis device 301 according to the fourth embodiment, the same reference numerals are assigned to the same components as those of the image analysis device 1 according to the first embodiment, and the description thereof is omitted. explain.

In the image analysis apparatus 301 according to the fourth embodiment, the speckle image capturing unit 12 captures a plurality of first speckle images and second speckle images.
The order in which each speckle image is captured is not particularly limited. For example, the first speckle image, the second speckle image, the second speckle image, the second speckle image, and the second speckle image in this order. Speckle images may be taken alternately.
Alternatively, a configuration may be adopted in which after capturing a plurality of first speckle images, a plurality of second speckle images are captured.
In the image analysis apparatus 301 according to the fourth embodiment, a speckle composite image is formed using a plurality of captured speckle images.

(1) Difference Image Imaging Unit The image analysis apparatus 301 according to the fourth embodiment employs a configuration in which a speckle image to be analyzed by the information processing unit 13 is created step by step.
That is, the image analysis apparatus 301 includes a difference image imaging unit 23 that creates a difference image from a plurality of speckle images.
In the differential image capturing unit 23, a first differential image derived from the first speckle image is created from a plurality of first speckle images captured based on the coherent light L1 emitted from the first light source 11a. Is done.
That is, in the difference image capturing unit 23, for example, a difference between a first speckle image captured first and a first speckle image captured second is calculated, and a first difference image is created. .
Similarly, in the differential image capturing unit 23, a second differential image derived from the second speckle image is obtained from a plurality of second speckle images captured based on the coherent light L2 emitted from the second light source 11b. Is created.
Note that the difference between the speckle images may not be calculated by the difference image capturing unit, and may be calculated by the information processing unit 13, for example. Moreover, the difference process and the difference image imaging method performed to the difference image imaging part 23 are not specifically limited, A well-known method can be used.

In the image analysis apparatus 301 according to the fourth embodiment, the information processing unit 13 detects a shading boundary in each of the first difference image and the second difference image.
Furthermore, after each difference image is separated based on the boundary, the information processing unit 13 joins the separated difference images to create a difference composite image having a luminance value necessary for state analysis. Done.
After the difference composite image is created, the information processing unit 13 measures the speckle contrast of the difference composite image, and performs the state analysis of the imaging target O based on the speckle contrast.

An example of a drive sequence of the image analysis apparatus 301 according to the fourth embodiment having the above-described configuration will be described with reference to FIG.
In the following description, two first speckle images and two second speckle images are taken, and one first difference image is obtained from two first speckle images, and two second speckle images are obtained. A drive sequence for obtaining one second differential image will be described. However, as described above, the number of captured speckle images is not particularly limited, and any configuration can be used as long as a differential image can be obtained.
In the following description, for the sake of convenience, the first speckle image captured first is referred to as “first speckle image I”, and the second speckle image captured second is referred to as “first speckle image II”. It shows. Similarly, the second speckle image is described with reference numerals corresponding to the number of times of imaging.

First, in the image analysis apparatus 301 according to the fourth embodiment, the processing shown in ST101 to ST106 in FIG. 5 is performed, and the speckle image capturing unit 12 captures the first speckle image I (ST401). That is, the “first speckle image” shown in FIG. 5 corresponds to the “first speckle image I”. Thereafter, the captured first speckle image I is stored in the storage unit 14 (ST402).
Next, processing shown in ST201 to ST206 in FIG. 6 is performed, and the speckle image capturing unit 12 captures the second speckle image I (ST403). That is, the “second speckle image” shown in FIG. 6 corresponds to the “second speckle image I”. Thereafter, like the first speckle image I, the second speckle image I is stored in the storage unit 14 (ST404).
In the image analysis apparatus 301 according to the fourth embodiment, after the second speckle image I is captured, the processing shown in ST101 to ST106 in FIG. The first speckle image II is imaged (ST405). That is, the “first speckle image II” in the process of ST405 corresponds to the “first speckle image” shown in FIG. Thereafter, the captured first speckle image II is stored in the storage unit 14 (ST406).
Thereafter, the processes shown in ST201 to ST206 in FIG. 6 are performed, and the speckle image capturing unit 12 captures the second speckle image II (ST407). That is, the “second speckle image II” in the processing of ST407 corresponds to the “second speckle image” shown in FIG. Furthermore, as with other speckle images, the captured second speckle image II is stored in the storage unit 14 (ST408).

After each speckle image is captured, the difference image capturing unit 23 is based on the first speckle image I and the first speckle image II captured by the coherent light L1 emitted from the same first light source 11a. Thus, a difference image (first difference image) between the first speckle image I and the first speckle image II is created (ST409). Thereafter, the created first difference image is stored in the storage unit 14 (ST410).
Further, in the differential image capturing unit 23, based on the second speckle image I and the second speckle image II captured by the coherent light L2 emitted from the same second light source 11b, the second speckle image is obtained. A difference image (second difference image) between I and the second speckle image II is created (ST411). Thereafter, the created second difference image is stored in the storage unit 14 (ST412).

After each difference image is captured, the information processing unit 13 detects a shading boundary in the first difference image and a shading boundary in the second difference image (ST413). Further, the boundary in the first difference image and the boundary in the second difference image are stored in the storage unit 14 (ST414).
Thereafter, the information processing unit 13 separates each difference image based on the detected boundary. Then, the separated first difference image and the separated second difference image are connected to create a difference composite image having a luminance value necessary for analysis (ST415). Further, the created difference composite image is stored in the storage unit 14 (ST416).
Then, the information processing unit 13 measures the speckle contrast of the difference composite image, and analyzes the state of the imaging target O based on the measurement result (ST417).
Thereafter, in the image analysis device 301 according to the fourth embodiment, the analysis result of the imaging target O analyzed by the information processing unit 13 is stored in the storage unit 14 (ST418).

Finally, in the image analysis apparatus 301 according to the fourth embodiment, the analysis result by the information processing unit 13 and the difference composite image are displayed on the display unit 15 (ST419), and the series of operations ends.
In the image analysis apparatus 301 according to the fourth embodiment, the first speckle images I and II, the second speckle images I and II, the boundary in each difference image, and the difference composite image are stored in the storage unit 14. However, the first speckle images I and II, the second speckle images I and II, the boundary in each difference image, and the difference composite image are not necessarily stored in the storage unit 14. .
In addition, since the image analysis apparatus according to the present technology may be configured to form at least a speckle image in which speckle contrast is ensured and shading is suppressed, the storage operation and the display operation are not necessarily performed. . In FIG. 11, the analysis result is displayed after the analysis result is stored. However, the order of these steps is not particularly limited.
Although not shown, each speckle image, the differential image captured by the differential image capturing unit 23, and the differential composite image created by the information processing unit 13 are stored in the storage unit 14. It does not matter even if it is done.

According to the image analysis device 301 according to the fourth embodiment configured as described above, the information processing unit 13 has a luminance value necessary for the state analysis of the imaging target O, as with other image analysis devices. A speckle composite image can be formed.
That is, the information processing unit 13 can prevent a decrease in speckle contrast due to insufficient luminance value and obtain an image in which shading is suppressed.
As a result, the accuracy of the state analysis of the imaging object O can be improved.

Furthermore, in the image analysis apparatus 301 according to the fourth embodiment, shading that appears in each image can be canceled by creating a difference image by the difference image capturing unit 23.
For this reason, according to the image analysis apparatus 301, when the average luminance value in the speckle image captured by shading is low, the difference image capturing unit 23 cancels the shading, so that the image capturing target O can be surely captured. A speckle composite image having a luminance value necessary for state analysis can be formed.

<5. Image Analysis Method According to First Embodiment>
The present technology also provides an image analysis method.
The image analysis method according to the first embodiment includes a light irradiation process, a speckle image imaging process, and an information processing process, and may include a storage process and a display process as necessary. Each step will be described below.

(1) Light Irradiation Step The image analysis method according to the first embodiment includes a step of irradiating the imaging target from a light source with coherent light.
In this light irradiation process, the imaging target is irradiated with coherent light under two different irradiation conditions. That is, in this light irradiation step, for example, the imaging target is illuminated using two light sources.
For example, while irradiating coherent light with the first light source tilted 45 degrees with respect to the imaging target (first irradiation condition), with the second light source tilted 45 degrees with respect to the imaging target, and Coherent light is irradiated in a state where the imaging target is located at a position symmetrical to the first light source (second irradiation condition).
Through such a light irradiation process, the coherent light is irradiated from each light source onto the imaging target, whereby scattered light corresponding to the coherent light irradiated from each light source is obtained.
In the image analysis method according to the first embodiment, the light irradiation step may be always performed. That is, the light source may always be turned on and the coherent light may be always emitted.
Or you may make it irradiate a coherent light at the timing which images a speckle image.

(2) Speckle image capturing step The image analysis method according to the first embodiment includes a speckle image capturing step of capturing a speckle image based on the scattered light obtained by the light irradiation step.
This speckle image capturing process is roughly divided into a first speckle image capturing process and a second speckle image capturing process. These steps will be described below.

(2-1) First speckle image capturing step The first speckle image capturing step is a step of capturing a speckle image based on scattered light obtained under the first irradiation condition in the light irradiation step.
In the first speckle image capturing step, first, the irradiation position of the first light source is adjusted in order to prevent the occurrence of shading in the first speckle image to be captured as much as possible.
Thereafter, the speckle image capturing unit for capturing the speckle image is driven. Thereafter, the first speckle image is picked up using an imaging lens, an image pickup device, and the like included in the speckle image pickup unit.
Then, after capturing the first speckle image, the speckle image capturing unit is paused, and the capturing of the first speckle image is completed.

  The first speckle image capturing process described above is merely an example. For example, when the illumination position of the first light source is appropriately set and occurrence of shading in the captured speckle image is suppressed, There is no need to adjust the illumination position of the light source. Further, in the first speckle image capturing process described above, the speckle image capturing unit is activated / paused, but these processes need not be performed.

(2-2) Second speckle image capturing step This second speckle image capturing step refers to a step of capturing a speckle image based on scattered light obtained by the second irradiation condition in the light irradiation step. The same process as the first speckle image capturing process is performed.
That is, the irradiation position of the second light source is adjusted to prevent the occurrence of shading in the second speckle image to be captured as much as possible.
Thereafter, the speckle image capturing unit for capturing the speckle image is driven. Thereafter, the second speckle image is picked up using an imaging lens, an image pickup device, and the like included in the speckle image pickup unit.
Then, after capturing the second speckle image, the speckle image capturing unit is paused, and the capturing of the second speckle image is completed.

  The second speckle image capturing process described above is merely an example. For example, if the occurrence of shading in the captured speckle image is suppressed, it is not necessary to adjust the illumination position of the second light source. In the second speckle image capturing process described above, the speckle image capturing unit is activated / paused, but these processes need not be performed.

(3) Information processing step The information processing step in the image analysis method according to the first embodiment is roughly divided into a boundary detection step, a speckle composite image creation step, and a speckle composite image analysis step. Each step will be described below.

(3-1) Boundary detection step In the boundary detection step according to the present technology, the first speckle image and the second speckle image captured in the speckle image capturing step appear on each speckle image. Shading boundary detection is performed.
Although the detection method performed in this boundary detection step is not particularly limited, for example, after calculating the luminance values of the first speckle image and the second speckle image, these luminance values are plotted on the horizontal axis. When represented on a graph with the pixel and vertical axis representing the luminance value, the pixel where the luminance value of the first speckle image and the luminance value of the second speckle image intersect in this graph is the boundary in each speckle image. A method of detecting as is conceivable. Alternatively, a method of setting a threshold value for a luminance value in a speckle image and detecting the boundary using the threshold value may be used.

In addition, the boundary detection step may include a step in which a luminance value capable of sufficiently observing speckles is determined in advance (hereinafter referred to as “luminance threshold”), and the boundary is detected using the luminance threshold. . An example of this boundary detection step will be described below.
In this process, first, in each of the first speckle image and the second speckle image imaged in the speckle image imaging process, a luminance threshold value at which speckle becomes larger than other noise components is determined.
Then, using this luminance threshold, in each speckle image, a pixel having a luminance value equal to or higher than the luminance threshold or a pixel region in which pixels equal to or higher than the luminance threshold are collected is selected.
Furthermore, a pixel or a pixel region that is equal to or higher than the luminance threshold in the first speckle image is compared with a pixel or a pixel region that is equal to or higher than the luminance threshold in the second speckle image, and the luminance value is the same or approximated (hereinafter referred to as a luminance value). , “Common area”).
Next, the light amounts of the first light source and the second light source are darkened, and a minute region before the common region becomes an empty set is selected. Then, the minute area is detected as the boundary.
As described above, there are various methods for detecting the boundary in the image analysis method according to the present technology, and the same method as the boundary detection method used in the image analysis device according to the present technology described above may be employed. it can.

In the image analysis method according to the first embodiment, since the first speckle image and the second speckle image are captured under mutually different irradiation conditions, the speckle image is detected at the boundary detected by the boundary detection step. The brightness value may be different between the two.
In such a case, the image analysis method according to the present technology may include a step of correcting the luminance value of the detected boundary.
That is, in the correction step, first, the luminance value P1 at the boundary of the first speckle image and the luminance value P2 at the boundary of the second speckle image are measured.
From this measurement result, an average value Pave of the luminance value P1 and the luminance value P2 is calculated.
In the first speckle image, the luminance value P1 is corrected so as to match the average value Pave, and in the second speckle image, the luminance value P2 is corrected so as to match the average value Pave.
According to such a correction process, even if there is a difference in the luminance value at the boundary between the speckle images, this difference can be eliminated.

(3-2) Speckle Composite Image Creation Step Next, the speckle composite image creation step will be described. In this step, each speckle image is separated based on the boundary detected in the boundary detection step.
Thereafter, the separated first speckle image and the separated second speckle image are connected so as to have a luminance value necessary for performing the state analysis of the imaging target.
As a result, it is possible to create a speckle composite image having a luminance value necessary for analyzing the state of the imaging target.
Here, in the speckle composite image created by the speckle composite image creation step, it is necessary to ensure the speckle contrast, so that the luminance distribution in the speckle composite image is uniform. Is required.
Therefore, in the image analysis method according to the present technology, for example, the luminance value of the first speckle image and the luminance value of the second speckle image are measured, and the luminance value of the first speckle image and the second speckle image are measured. A step of calculating an average value with the luminance value of the image may be included. The calculated average value is preferably set as the luminance value of the speckle composite image.

(3-3) Speckle Composite Image Analysis Step Next, the speckle composite image analysis step will be described. In this step, speckle contrast is measured, which is a value obtained by dividing the standard deviation of the luminance distribution in the speckle composite image by the average of the luminance distribution.
Then, based on the measured speckle contrast, the imaging target is analyzed.
According to this analysis, for example, the boundary surface between the fluid part and the stationary part in the imaging target can be clearly grasped, and the position of the blood vessel and the like can be analyzed.
Further, when a scattering fluid such as blood moves or changes with time, the speckle also changes with time, so that the flow velocity of the fluid can be analyzed.

(4) Storage step The image analysis method according to the first embodiment may include a storage step as necessary.
In this storage step, each speckle image captured in the speckle imaging step, information on the boundary detected in the boundary detection step, a speckle composite image created in the speckle composite image creation step, the spec The analysis results measured in the image synthesis image analysis process are stored.

(5) Display process The image analysis method according to the first embodiment may include a display process as necessary. In this display step, each speckle image captured in the speckle imaging step, a speckle composite image created in the speckle composite image creation step, an analysis result measured in the speckle composite image analysis step, etc. Is displayed on a monitor, for example.

According to the image analysis method according to the first embodiment including the above steps, it is possible to form a speckle composite image having a luminance value necessary for the state analysis of the imaging target.
That is, it is possible to prevent a decrease in speckle contrast due to insufficient luminance value and to obtain an image in which shading is suppressed, thereby improving the accuracy of state analysis of the imaging target.

<6. Image Analysis Method According to Second Embodiment>
The image analysis method according to the second embodiment is different from the image analysis method according to the first embodiment in a vibration process performed before each speckle image is captured and a process until a speckle composite image is created.
In the following, only steps different from the image analysis method according to the first embodiment will be described, and description of other common steps will be omitted.

(1) Vibration process The image analysis method according to the second embodiment includes a vibration process in which the coherent light emitted from the light source is agitated before performing each speckle image process.
In this vibration process, for example, a known optical stirrer or the like is disposed on the optical axis of the coherent light emitted from the light source, and the optical stirrer is driven to stir the coherent light. .
According to this vibration process, since the coherent light emitted from the light source is agitated, the generation of speckle is suppressed in the speckle image captured in the speckle image imaging process.

Next, a speckle image capturing process in the image analysis method according to the second embodiment will be described.
In the speckle image capturing step of the image analysis method according to the second embodiment, as a result of the agitation of the coherent light by the vibration step, each speckle image to be captured is an image in which speckle is suppressed (hereinafter, “speckle”). It is called “suppressed image”.
In the image analysis method according to the second embodiment, since the speckle is suppressed in the captured speckle image, it is easy to extract the shading peak position in the image.
For this reason, in the image analysis method according to the present embodiment, after the speckle image capturing step is performed, the peak position of shading is detected based on the captured speckle suppression image.
Further, the difference between the shading peak position and the center position of the speckle suppression image is calculated.

After that, it is determined whether or not the difference between the shading peak position and the center position of the speckle-suppressed image is less than a specified value.If the difference is larger than the specified value in this determination, each difference is determined based on the difference. The operation of adjusting the illumination position of the light source and capturing each speckle image again is performed.
On the other hand, when it is determined that the difference is less than the specified value, processing for matching the shading peak position and the image center position is performed.

In this manner, the process of matching the shading peak position and the image center position is performed, and a speckle composite image is created based on the processing result.
Thereafter, as in the image analysis method according to the first embodiment, the speckle composite image analysis step and the storage step are performed.
Here, in the image analysis method according to the second embodiment, each captured speckle image becomes a speckle-suppressed image. Therefore, an average luminance difference distribution (hereinafter referred to as “shading pattern”) from the captured speckle-suppressed image. It is easy to detect.
Therefore, in the image analysis method according to the second embodiment, in the information processing step, the luminance in the speckle composite image is calculated from the shading pattern in the first speckle suppression image and the shading pattern in the second speckle suppression image. A step of calculating a value for correcting the value may be performed.

According to such an image analysis method according to the second embodiment, it is possible to form a speckle composite image having a luminance value necessary for the state analysis of the imaging target.
That is, it is possible to prevent a decrease in speckle contrast due to insufficient luminance value and to obtain an image in which shading is suppressed. As a result, it is possible to improve the accuracy of state analysis of the imaging target O.

Furthermore, according to the image analysis method according to the second embodiment, it is possible to create a speckle suppression image by including the vibration step. For this reason, it becomes easy to extract only a shading pattern from each speckle suppression image in the information processing step. As a result, it is possible to improve the accuracy of the state analysis of the imaging target O based on the obtained speckle composite image.
Further, for example, when a method for capturing both a bright field image and a speckle image is used, an image without a sense of incongruity can be obtained when the bright field image and the speckle image are superimposed.

<7. Image Analysis Method According to Third Embodiment>
The image analysis method according to the third embodiment is a method using a so-called coaxial epi-illumination type image analysis apparatus, a step of changing the wavelength of coherent light emitted from one light source, and the light emitted from the light source. The image analysis method according to the first embodiment is different from the image analysis method according to the first embodiment in that it includes a step of combining the coherent light and the light from the speckle image capturing unit for capturing the speckle image.
In the following, only steps different from the image analysis method according to the first embodiment will be described, and description of other common steps will be omitted.

(1) Wavelength variable process The image analysis method according to the third embodiment includes a wavelength variable process for controlling the wavelength of coherent light emitted from the light source.
In this wavelength variable step, for example, the wavelength band of the coherent light emitted from the light source is changed using a wavelength variable unit arranged on the optical axis of the light source. The wavelength changing unit is not particularly limited, and a known tunable filter can be used. Among the tunable filters, it is preferable to use a liquid crystal tunable filter.
Then, by changing the wavelength of the coherent light emitted from the single light source by the wavelength variable step, it is possible to obtain the first speckle image and the second speckle image having different luminance values. .
This wavelength variable step is performed after the light irradiation step of irradiating coherent light from the light source, and further, for example, in order to capture the second speckle image after the first speckle image imaging step is performed. Done.

(2) Combined Step The image analysis method according to the third embodiment includes a combined step of combining the coherent light emitted from the light source and the light emitted from the speckle image capturing unit.
For example, a half mirror is arranged on the optical axis of the speckle image capturing unit, and the optical axis of the light source whose wavelength band is adjusted by the wavelength varying step is used as the light of the speckle image capturing unit. Set coaxial with the axis.
Then, using a known multiplexer or the like, the coherent light emitted from the light source and the light emitted from the speckle image capturing unit are multiplexed.

  In the image analysis method according to the third embodiment using the coaxial incident illumination type image analysis apparatus including the wavelength variable step and the multiplexing step, the imaging process of the first speckle image and the second speckle image is completed. After that, the information processing step, the storage step, and the display step are performed as in the image analysis method according to the first embodiment.

Even in the image analysis method according to the third embodiment using the coaxial epi-illumination type image analysis apparatus including the wavelength variable step and the multiplexing step, the information processing step allows the state analysis of the imaging target O. A speckle composite image having a necessary luminance value can be formed. That is, it is possible to obtain an image in which shading is suppressed and a decrease in speckle contrast due to insufficient luminance value is prevented.
As a result, the accuracy of the state analysis of the imaging object O can be improved.

<8. Image Analysis Method According to Fourth Embodiment>
The image analysis method according to the fourth embodiment is different from the image analysis method according to the first embodiment in the step of creating a speckle image to be analyzed step by step.
In the following, only steps different from the image analysis method according to the first embodiment will be described, and description of other common steps will be omitted.

(1) Difference Image Imaging Step The image analysis method according to the fourth embodiment includes a difference image imaging step.
That is, in the image analysis method according to the fourth embodiment, in the speckle image capturing step, a plurality of first speckle images and a second speckle image are captured and imaged by coherent light emitted from the same light source. A step of capturing a difference image from the plurality of speckle images.
In this difference image imaging step, for example, a step of creating a first difference image from the first speckle image I imaged first and the first speckle image II imaged second is performed.
Similarly to this, a step of creating a second difference image from a plurality of second speckle images captured is performed.

In the image analysis method according to the fourth embodiment, the shading boundary is detected in each of the first difference image and the second difference image.
Then, as in other image analysis methods, each difference image is separated based on the boundary detected in the boundary detection step.
Thereafter, the separated first difference image and the separated second difference image are joined so as to have a luminance value necessary for performing the state analysis of the imaging target. As a result, a difference composite image having a luminance value necessary for analyzing the state of the imaging target is created.

Thereafter, the speckle contrast is measured, which is a value obtained by dividing the standard deviation of the luminance distribution in the difference composite image by the average of the luminance distribution.
Then, based on the measured speckle contrast, the imaging target is analyzed.

  According to the image analysis method according to the fourth embodiment including the above steps, as in other image analysis methods, it is possible to prevent a decrease in speckle contrast due to insufficient luminance values and obtain an image in which shading is suppressed. it can. As a result, the accuracy of the state analysis of the imaging target can be improved.

  Furthermore, in the image analysis method according to the fourth embodiment, shading that appears in each image can be canceled by creating a difference image based on the first speckle image and the second speckle image. For this reason, when the average luminance value in the speckle image captured by shading is low, a speckle composite image having a luminance value necessary for the state analysis of the imaging target can be formed reliably.

9. Image Analysis System The present technology also provides an image analysis system.
FIG. 12 is a schematic conceptual diagram schematically showing the image analysis system 401 according to the first embodiment of the present technology. The image analysis system 401 includes at least a light source 110, a speckle image capturing device 120, and an information processing device 130. Further, it is possible to further include a server 140, a display device 150, an imaging control device 170, an illumination control device 180, and the like as necessary. Hereinafter, each component will be described in detail.

(1) Light Source The image analysis system 401 according to the present technology includes the light source 110 that irradiates the imaging target O with coherent light.
The type of the light source 110 is not particularly limited as long as the effect of the present technology is not impaired. An example is laser light. As the light source 11 that emits laser light, for example, argon ion (Ar) laser, helium-neon (He-Ne) laser, die (dye) laser, krypton (Cr) laser, semiconductor laser, or semiconductor laser, wavelength conversion with the semiconductor laser One or two or more solid lasers combined with optical elements can be used in any combination.

In the image analysis system 401 according to the present technology, at least two light sources 110 are provided.
In the image analysis system 401, the coherent light L1 is irradiated with the first light source 110a tilted 45 degrees with respect to the imaging target O. As a result, the luminance value of the coherent light L1 is high at one end of the imaging target O and low at the other end (corresponding to the first irradiation condition in the present technology).
On the other hand, the second light source 110b also emits the coherent light L2 in a state inclined by 45 degrees with respect to the imaging target O, and is disposed at a position symmetrical to the first light source 11a0 with the imaging target O as the center. Yes.
The luminance value of the coherent light L2 of the second light source 11b is high at one end of the imaging target O and low at the other end (corresponding to the second irradiation condition in the present technology).
In other words, in the image analysis system 401 according to the present technology, the coherent light L1 emitted from the first light source 110a and the coherent light L2 emitted from the second light source 110b are emitted so as to compensate for the brightness value. The

  In addition, the image analysis system 401 is similar to the image analysis apparatus 1 according to the first embodiment described above with the coherent light L1 of the first light source 110a with the same luminous flux and the same time with respect to the imaging target O. The coherent light L2 of the second light source 110b is lit in time series.

  In the image analysis system 401 according to the present technology, two light sources 110 are provided. However, the number of the light sources 110 is not particularly limited, and the brightness value is compensated by coherent light emitted from each light source 110. For example, three or more may be provided.

(2) Speckle Image Imaging Device An image analysis system 401 according to an embodiment of the present technology performs speckle imaging based on scattered light obtained from the imaging target O irradiated with coherent light from the light sources 110a and 110b. An image capturing device 120 is provided.
In the speckle image capturing apparatus 120, the first speckle image is captured based on the scattered light obtained from the imaging target O illuminated with the coherent light L1 irradiated from the first light source 110a under the first irradiation condition. Done. Further, the second speckle image is captured based on the scattered light obtained from the imaging object O illuminated with the coherent light L2 irradiated from the second light source 110a under the second irradiation condition.

  Since the configuration, imaging method, and the like of the speckle image imaging device 120 are the same as those of the speckle image imaging unit 12 included in the image analysis device 1 according to the first embodiment, description thereof is omitted here. .

(3) Information processing apparatus The image analysis system 401 according to the present technology creates a speckle composite image based on the speckle image captured by the speckle image capturing apparatus 120, and further analyzes the speckle composite image. The information processing apparatus 130 is provided.
The information processing apparatus 130 is roughly divided into measurement of the speckle luminance distribution of the speckle image captured by the speckle image capturing apparatus 120, and shading boundaries (hereinafter simply referred to as “boundaries”) in each speckle image. Detection, separation of each speckle image based on the boundary, creation of a speckle composite image based on each separated speckle image, analysis of the speckle composite image, and the like.
Each process performed in the information processing apparatus 130 is performed by the same method as each process performed by the information processing unit 13 included in the image analysis apparatus 1 according to the first embodiment described above.
For this reason, the description regarding the method of each process is omitted here.

(4) Server The image analysis system 401 according to the present technology includes, as necessary, speckle images captured by the speckle image capturing device 120, speckle contrast and boundaries measured by the information processing device 130, A server 140 that stores analysis results analyzed by the information processing apparatus 130 can be further provided.

(5) Display device The image analysis system 401 according to the present technology displays a speckle image captured by the speckle image capturing device 120, an analysis result analyzed by the information processing device 130, and the like as necessary. A device 150 may further be provided.

(6) Imaging Control Device The image analysis system 401 according to the present technology may further include an imaging control device 170 that controls the imaging timing of the speckle image imaging device 120 as necessary. The imaging control device 170 pauses imaging by the speckle image imaging device 120 or sets a pause period of the speckle image imaging device 120.
In the image analysis system 401 according to the present technology, the imaging control device 170 is not an indispensable device. The driving cost of the image analysis system 401 can be suppressed.

(7) Illumination Control Device The image analysis system 401 according to the present technology may further include an illumination control device 180 that controls the illumination timing or illumination position of the first light source 110a and the second light source 110b.
As described above, in the image analysis system 401 according to the present technology, the first light source 110a and the second light source 110b are alternately irradiated. In the illumination control device 180, the first light source 110a is illuminated. Switching to the illumination of the second light source 110b is performed. The illumination controller 180 also adjusts the illumination position of the coherent light emitted from the light sources 110a and 110b.
Since the configuration and the like of the illumination control device 180 are the same as the configuration and the like of the illumination control unit 18 included in the image analysis device 1 according to the first embodiment described above, description thereof is omitted here.

According to the image analysis system 401 according to the present technology configured as described above, the information processing apparatus 130 can form a speckle composite image having a luminance value necessary for the state analysis of the imaging target O. .
In other words, the information processing apparatus 130 can prevent a decrease in speckle contrast due to insufficient luminance value and can obtain an image in which shading is suppressed. As a result, the accuracy of the state analysis of the imaging object O can be improved.

An image analysis system 401 illustrated in FIG. 12 is merely an example of an image analysis system according to the present technology. For example, similar to the image analysis apparatus 101 according to the second embodiment described above, the image analysis system 401 is arranged on the optical axis of each of the light sources 110a and 110b. It is also possible to arrange a vibration device. According to the image analysis system in which the vibration device is arranged, not only can the accuracy of the state analysis of the imaging target O be improved, but the speckle suppression image can be created by including the vibration device. . Therefore, in the information processing apparatus 130, it is easy to extract only the shading pattern from each speckle suppression image.
As a result, it is possible to improve the accuracy of the state analysis of the imaging target O based on the obtained speckle composite image.
Furthermore, for example, when a structure capable of capturing both a bright field image and a speckle image is used, an image without a sense of incongruity can be obtained when the bright field image and the speckle image are superimposed.

Furthermore, the image analysis system according to the present technology includes the light source 110 and the optical axis of the light source 110 and the light of the speckle image imaging device 120 as in the image analysis device 201 according to the third embodiment described above. A configuration of so-called coaxial epi-illumination in which the axis is matched may be used.
In this case, the wavelength variable device that controls the wavelength of the coherent light emitted from the light source 110, the wavelength of the coherent light emitted from the light source 110, and the wavelength of the light emitted from the speckle image capturing device are combined. And a multiplexing device.
Even if it is such a coaxial incident illumination type image analysis system, the information processing apparatus 130 can form a speckle composite image having a luminance value necessary for the state analysis of the imaging target O. It is possible to prevent a decrease in speckle contrast due to insufficient luminance value and obtain an image in which shading is suppressed. As a result, the accuracy of the state analysis of the imaging object O can be improved.

  Further, the image analysis system according to the present technology is similar to the image analysis apparatus 301 according to the fourth embodiment described above, and the speckle image imaging apparatus 120 includes a plurality of first speckle images and a plurality of second speckle images. It may be configured to be imaged. The image analysis system may include a differential image capturing device that captures a differential image based on a plurality of speckle images.

  According to the image analysis system configured as described above, shading appearing in each image can be canceled by creating a difference image by the difference image capturing device. For this reason, even when the average luminance value in the speckle image captured by shading is low, a speckle composite image having a luminance value necessary for the state analysis of the imaging target O can be reliably formed.

Note that the image analysis apparatus according to the present technology may also have the following configuration.
(1)
A light source that irradiates the imaging object with coherent light under the first irradiation condition and the second irradiation condition;
The first speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the first irradiation condition and the scattering of the imaging target illuminated with the coherent light irradiated under the second irradiation condition A speckle image capturing unit that captures a second speckle image obtained from light;
Each speckle image is separated at the boundary of the average luminance difference formed on each of the first speckle image and the second speckle image, and the separated speckle images are joined at the boundary to combine the specs. An information processing unit that analyzes the composite image;
An image analysis apparatus comprising:
(2)
The image processing apparatus according to (1), wherein the information processing unit uses an average value of a luminance value of the first speckle image and a luminance value of the second speckle image as a luminance value of the speckle composite image.
(3)
The image analysis apparatus according to (1) or (2), wherein the information processing unit uses an intersection of the luminance value of the first speckle image and the luminance value of the second speckle image as the boundary.
(4)
In the information processing unit, when there is a difference between the luminance value at the boundary of the first speckle image and the luminance value at the boundary of the second speckle image, the luminance value at the boundary of each speckle image is calculated at the boundary. The image analysis apparatus according to any one of (1) to (3), wherein correction is performed so as to match an average value of luminance values.
(5)
Having a vibration part for suppressing speckles on the optical axis of the light source;
The information processing unit calculates a correction value of the luminance value at the boundary based on the average luminance difference distribution in the first speckle image and the average luminance difference distribution in the second speckle image, (1) to (4) The image analysis apparatus according to any one of the above.
(6)
The information processing unit detects a region having a predetermined luminance threshold or more in the first speckle image and the second speckle image, and
Any one of (1) to (5), wherein a common area in the area on the first speckle image and the area on the second speckle image is calculated and detected as a boundary in the speckle composite image from the common area The image analysis apparatus according to claim 1.
(7)
In the speckle image capturing unit, each of the first speckle image and the second speckle image is captured a plurality of times,
A differential image capturing unit that generates a first differential image from a plurality of first speckle images and generates a second differential image from a plurality of second speckle images;
In the information processing unit, each difference image is separated at the boundary of the average luminance difference formed in each of the first difference image and the second difference image, and the separated difference images are connected at the boundary and synthesized. The image analysis apparatus according to any one of (1) to (6), wherein the difference composite image is analyzed.
(8)
A light irradiation step of irradiating the imaging target with coherent light under the first irradiation condition and the second irradiation condition;
The first speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the first irradiation condition and the scattering of the imaging target illuminated with the coherent light irradiated under the second irradiation condition A speckle image capturing step of capturing a second speckle image obtained from light;
Each speckle image is separated at the boundary of the average luminance difference formed on each of the first speckle image and the second speckle image, and the separated speckle images are joined at the boundary to combine the specs. An information processing process for analyzing the composite image;
An image analysis method including:
(9)
(8) The image analysis method according to (8), wherein, in the information processing step, an average value of a luminance value of the first speckle image and a luminance value of the second speckle image is used as the luminance value of the speckle composite image.
(10)
The image analysis method according to (8) or (9), wherein, in the information processing step, the intersection of the luminance value of the first speckle image and the luminance value of the second speckle image is used as a boundary.
(11)
In the information processing step, when there is a difference between the luminance value at the boundary of the first speckle image and the luminance value at the boundary of the second speckle image, the luminance value at the boundary of each speckle image is calculated at the boundary. The image analysis method according to any one of (8) to (10), wherein correction is performed so as to match an average value of luminance values.
(12)
A vibration process for vibrating the coherent light,
In the information processing step, luminance value correction values at the boundary are calculated based on the average luminance difference distribution in the first speckle image and the average luminance difference distribution in the second speckle image. The image analysis method according to any one of the above.
(13)
In the information processing step, the first speckle image and the second speckle image are detected in a region having a predetermined luminance threshold or more, and
Any one of (8) to (12), wherein a common area in the area on the first speckle image and the area on the second speckle image is calculated and detected as a boundary in the speckle composite image from the common area The image analysis method according to claim 1.
(14)
In the speckle image capturing step, each of the first speckle image and the second speckle image is captured a plurality of times,
Generating a first difference image from a plurality of first speckle images, generating a second difference image from a plurality of second speckle images, and a difference image imaging step,
In the information processing step, each difference image is separated at the boundary of the average luminance difference formed in each of the first difference image and the second difference image, and the separated difference images are joined at the boundary and synthesized. The image analysis method according to any one of (8) to (13), wherein the difference composite image is analyzed.
(15)
A light source that irradiates the imaging object with coherent light under the first irradiation condition and the second irradiation condition;
The first speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the first irradiation condition and the scattering of the imaging target illuminated with the coherent light irradiated under the second irradiation condition A speckle image capturing device for capturing a second speckle image obtained from light;
Each speckle image is separated at the boundary of the average luminance difference formed on each of the first speckle image and the second speckle image, and the separated speckle images are joined at the boundary to combine the specs. An information processing device that analyzes the composite image;
An image analysis system comprising:

1, 101, 201, 301 Image analysis apparatus 11 Light source 11a First light source 11b Second light source 12 Speckle image imaging unit 12a Imaging optical system 12b Imaging unit 13 Information processing unit 14 Storage unit 15 Display unit 16 Support unit 17 Imaging control Unit 18 Illumination control unit 19 Vibrating unit 20 Wavelength varying unit 21 Multiplexing unit 22 Half mirror 23 Difference image imaging unit L1, L2, L3, L4 Coherent light O Imaging target 401 Image analysis system 110 Light source 110a First light source 110b Second light source 120 Speckle Image Imaging Device 130 Information Processing Device 140 Server 150 Display Device 170 Imaging Control Device 180 Illumination Control Device

Claims (15)

A light source that irradiates the imaging object with coherent light under the first irradiation condition and the second irradiation condition;
The first speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the first irradiation condition and the scattering of the imaging target illuminated with the coherent light irradiated under the second irradiation condition A speckle image capturing unit that captures a second speckle image obtained from light;
Each speckle image is separated at the boundary of the average luminance difference formed on each of the first speckle image and the second speckle image, and the separated speckle images are joined at the boundary to combine the specs. An information processing unit that analyzes the composite image;
An image analysis apparatus comprising:   The image analysis apparatus according to claim 1, wherein the information processing unit uses an average value of a luminance value of the first speckle image and a luminance value of the second speckle image as a luminance value of the speckle composite image.   The image analysis apparatus according to claim 1, wherein the information processing unit uses an intersection of the luminance value of the first speckle image and the luminance value of the second speckle image as the boundary.   In the information processing unit, when there is a difference between the luminance value at the boundary of the first speckle image and the luminance value at the boundary of the second speckle image, the luminance value at the boundary of each speckle image is calculated at the boundary. The image analysis apparatus according to claim 1, wherein correction is performed so as to match an average value of luminance values. Having a vibration part for suppressing speckles on the optical axis of the light source;
The image according to claim 1, wherein the information processing unit calculates a correction value of the luminance value at the boundary based on an average luminance difference distribution in the first speckle image and an average luminance difference distribution in the second speckle image. Analysis device. The information processing unit detects a region having a predetermined luminance threshold or more in the first speckle image and the second speckle image, and
The image analysis apparatus according to claim 1, wherein a common area in the area on the first speckle image and the area on the second speckle image is calculated and detected as a boundary in the speckle composite image from the common area. In the speckle image capturing unit, each of the first speckle image and the second speckle image is captured a plurality of times,
A differential image capturing unit that generates a first differential image from a plurality of first speckle images and generates a second differential image from a plurality of second speckle images;
In the information processing unit, each difference image is separated at the boundary of the average luminance difference formed in each of the first difference image and the second difference image, and the separated difference images are joined at the boundary and synthesized. The image analysis apparatus according to claim 1, wherein the difference composite image is analyzed. A light irradiation step of irradiating the imaging target with coherent light under the first irradiation condition and the second irradiation condition;
The first speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the first irradiation condition and the scattering of the imaging target illuminated with the coherent light irradiated under the second irradiation condition A speckle image capturing step of capturing a second speckle image obtained from light;
Each speckle image is separated at the boundary of the average luminance difference formed on each of the first speckle image and the second speckle image, and the separated speckle images are joined at the boundary to combine the specs. An information processing process for analyzing the composite image;
An image analysis method including:   The image analysis method according to claim 8, wherein in the information processing step, an average value of a luminance value of the first speckle image and a luminance value of the second speckle image is used as a luminance value of the speckle composite image.   The image analysis method according to claim 8, wherein, in the information processing step, the intersection of the luminance value of the first speckle image and the luminance value of the second speckle image is used as a boundary.   In the information processing step, when there is a difference between the luminance value at the boundary of the first speckle image and the luminance value at the boundary of the second speckle image, the luminance value at the boundary of each speckle image is calculated at the boundary. The image analysis method according to claim 8, wherein correction is performed so as to match an average value of luminance values. A vibration process for vibrating the coherent light,
9. The image according to claim 8, wherein, in the information processing step, a correction value of a luminance value at the boundary is calculated based on an average luminance difference distribution in the first speckle image and an average luminance difference distribution in the second speckle image. analysis method. In the information processing step, the first speckle image and the second speckle image are detected in a region having a predetermined luminance threshold or more, and
The image analysis method according to claim 8, wherein a common area in the area on the first speckle image and the area on the second speckle image is calculated and detected as a boundary in the speckle composite image from the common area. In the speckle image capturing step, each of the first speckle image and the second speckle image is captured a plurality of times,
Generating a first difference image from a plurality of first speckle images, generating a second difference image from a plurality of second speckle images, and a difference image imaging step,
In the information processing step, each difference image is separated at the boundary of the average luminance difference formed in each of the first difference image and the second difference image, and the separated difference images are joined at the boundary and synthesized. The image analysis method according to claim 8, wherein the difference composite image is analyzed. A light source that irradiates the imaging object with coherent light under the first irradiation condition and the second irradiation condition;
The first speckle image obtained from the scattered light of the imaging target illuminated with the coherent light irradiated under the first irradiation condition and the scattering of the imaging target illuminated with the coherent light irradiated under the second irradiation condition A speckle image capturing device for capturing a second speckle image obtained from light;
Each speckle image is separated at the boundary of the average luminance difference formed on each of the first speckle image and the second speckle image, and the separated speckle images are joined at the boundary to combine the specs. An information processing device that analyzes the composite image;
An image analysis system comprising:

Images