JP2022072613A - Imaging method and imaging device - Google Patents

Abstract

To provide an imaging method and an imaging device that can obtain reconstructed images at high speed and high resolution.SOLUTION: A method has a step for superimposing the image of the 10 imaging targets and a plurality of projection patterns onto a linear image sensor 3 with at least two or more unit elements arranged one-dimensionally, and a step for performing optimization calculations in the light gathering direction of the linear image sensor 3 based on the plurality of one-dimensional imaging data acquired by the linear image sensor 3.SELECTED DRAWING: Figure 1

Description

The present invention relates to an imaging method and an imaging apparatus for reconstructing a two-dimensional image or a three-dimensional image from the captured data acquired by an image sensor.

Conventionally, single pixel imaging (SPI) and high-speed camera technology using a CCD / CMOS are known as a technique for reconstructing a two-dimensional image or a three-dimensional image from the image pickup data acquired by an image sensor.

SPI forms an image of light with a special projection pattern superimposed on the imaged object on an image sensor, repeats shooting, and performs statistical processing, linear conversion, optimization calculation, etc. based on the acquired multiple imaged data. This is a technique for reconstructing an image to be imaged. In addition, since the SPI uses a photodiode, which is a unit element, as an image sensor, it has a higher degree of freedom in the wavelength band that can be photographed compared to high-speed camera technology using CCD / CMOS, and in principle, the high-speed response of the photodiode. High-speed imaging based on sex is possible.

The imaging device of Patent Document 1 reconstructs a three-dimensional image by using SPI, and is a spatial light modulator provided between a light source that irradiates illumination light and an image pickup target, and the spatial light modulation. It is provided with a lens arranged so that the illumination light patterned by the device forms an image on the image pickup target, and an image pickup element for acquiring the image pickup data carried by the reflected light or the transmitted light of the illumination light from the image pickup target. The multi-valued two-dimensional projection pattern displayed on the spatial optical modulator is changed over time, and the projection pattern displayed on the spatial optical modulator and the projection pattern displayed on the spatial optical modulator are displayed for each unit element of the image pickup element. The relationship of the acquired imaging data is captured for each display of the projection pattern, and the two-dimensional element image is reconstructed for each unit element based on the imaging data captured for each projection pattern, and for each reconstructed unit element. By reconstructing the three-dimensional image to be imaged based on the two-dimensional element image of the above, the resolution and the resolution in the depth direction are excellent. The image pickup device used in Patent Document 1 is a two-dimensional array of unit elements.

Japanese Unexamined Patent Publication No. 2020-136837 (pages 5 to 6, FIG. 1)

However, in order to obtain a high-resolution three-dimensional image in the imaging device of Patent Document 1, it is necessary to reconstruct a high-resolution two-dimensional element image by capturing imaging data based on many projection patterns for each unit element. Therefore, there was a problem that it took a long time to shoot.

The present invention has been made focusing on such a problem, and an object of the present invention is to provide an imaging method and an imaging apparatus capable of obtaining a reconstructed image at high speed and with high resolution.

In order to solve the above problems, the imaging method of the present invention is used.
A step of forming an image of an image to be imaged and a light obtained by superimposing a plurality of projection patterns on a linear image sensor in which at least two or more unit elements are one-dimensionally arranged.
It is characterized by having a step of performing an optimization calculation in the focusing direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor.
According to this feature, the one-dimensional imaging data acquired by the linear image sensor is continuous data without duplication or loss in the direction orthogonal to the focusing direction, and since the data is not compressed, a plurality of one-dimensional imaging data. By performing the optimization calculation in the focusing direction based on the above and combining the result with the data in the direction orthogonal to the focusing direction, it is possible to obtain a reconstructed image at high speed and with high resolution with a small number of projection patterns. Further, the imaging method of the present invention does not require mechanical scanning by forming an image of an image to be imaged and a light obtained by superimposing a plurality of projection patterns on a linear image sensor, and thus is suitable for imaging various objects to be imaged. Applicable.

It is characterized by having a step of performing an optimization calculation in a direction orthogonal to the light-collecting direction after performing an optimization calculation in the light-collecting direction of the linear image sensor.
According to this feature, the optimization calculation is first performed in the focusing direction of the linear image sensor with many overlaps and defects, and then the two-step optimization calculation is performed in the direction orthogonal to the focusing direction to achieve higher resolution. A reconstructed image can be obtained.

The calculation for optimizing the focusing direction of the linear image sensor includes a matrix A representing the irradiation of the plurality of projection patterns, a matrix B for obtaining the total variation, and a vector X representing one line in the focusing direction of the reconstructed image. ^, Based on the vector y representing the shooting data, the calculation based on the equation 1 is performed, and the squared error of one line with the focusing direction of the shot data and the image to be reconstructed, and 1 with the reconstructed image. It is characterized by minimizing all fluctuations in the line.
According to this feature, one line is reconstructed by performing an optimization calculation for each line in the focusing direction, and the same optimization calculation is repeated a predetermined number of times according to the number of pixels to be imaged at high speed. Reconstructed images can be obtained at high resolution.

The optimization calculation of the focusing direction of the linear image sensor and the optimization calculation of the direction orthogonal to the focusing direction are characterized in that the same mathematical formula is used.
According to this feature, a reconstructed image can be obtained at high speed and with high resolution.

The matrix A is characterized by including the conditions of a matrix representing the irradiation of the plurality of projection patterns and the physical imaging process of focusing one-dimensionally by an optical system.
According to this feature, a reconstructed image can be obtained at high speed and with high resolution.

The imaging apparatus of the present invention is
Spatial light modulators that output multiple projection patterns and
A linear image sensor in which at least two unit elements are arranged one-dimensionally,
An imaging means for forming an image of an image to be imaged and a light obtained by superimposing the plurality of projection patterns on the linear image sensor.
It is characterized by comprising an analysis means for performing an optimization calculation in the focusing direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor.
According to this feature, the one-dimensional imaging data acquired by the linear image sensor is continuous data without duplication or loss in the direction orthogonal to the focusing direction, and since the data is not compressed, a plurality of one-dimensional imaging data. By performing the optimization calculation in the focusing direction based on the above and combining the result with the data in the direction orthogonal to the focusing direction, it is possible to obtain a reconstructed image at high speed and with high resolution with a small number of projection patterns. Further, the imaging apparatus of the present invention does not require mechanical scanning by forming an image of an image to be imaged and a light obtained by superimposing a plurality of projection patterns on a linear image sensor, and thus is suitable for imaging various objects to be imaged. Applicable.

The analysis means is characterized in that after performing an optimization calculation in the focusing direction of the linear image sensor, an optimization calculation is performed in a direction orthogonal to the focusing direction.
According to this feature, a reconstructed image with higher resolution can be obtained by performing two-step optimization calculation in the focusing direction of the linear image sensor and the direction orthogonal to the focusing direction.

The spatial light modulator is characterized by being a digital micromirror device.
According to this feature, it is possible to output a precise projection pattern at high speed, so that a reconstructed image can be obtained at higher speed and higher resolution.

The imaging means is characterized by being a cylindrical lens.
According to this feature, a linear image sensor can be one-dimensionally imaged with light in which an image to be imaged and a plurality of projection patterns are superimposed with a simple configuration.

It is a schematic diagram which shows the imaging apparatus in the Example of this invention. It is a figure which shows the procedure of the imaging method in an Example. (A) is an image pickup target, and (b) is a reconstructed image of the image pickup target reconstructed by the imaging method using the imaging device in the embodiment.

Similar to single-pixel imaging (SPI), the inventors have formed a linear image sensor in which unit elements are one-dimensionally arranged to form an image of light obtained by superimposing a projection pattern on an image to be imaged. By performing optimization calculation in the focusing direction of the linear image sensor based on multiple one-dimensional imaging data acquired by repeating this shooting while changing the projection pattern, it is significantly compared to SPI. In addition to reducing the number of shots and enabling image reconstruction with higher resolution, the frame rate is significantly higher than that of high-speed camera technology using CCD / CMOS, and image reconstruction with higher resolution is possible. I got the knowledge of.

The image reconstruction is performed by performing an optimization calculation for each line in the focusing direction and reconstructing one line, and this process can be expressed as follows using the mathematical formula of Equation 2 below.

Here, X is a vector representing one line in the focusing direction of the object to be obtained, A is a matrix representing irradiation of a plurality of projection patterns and focusing by an optical system, and B is intensity data when irradiating a plurality of projection patterns. It is a vector representing. For example, when the number of pixels to be imaged is N × N pixels and the number of projection pattern irradiations is M, the row vector of the matrix A represents a certain projection pattern (N-dimensional vector), and when the number of projection pattern irradiations is M times. , M different row vectors are lined up in the column direction, and the matrix A is an M × N matrix. Further, the size of the vector X is N × 1, and the size of the vector B is M × 1.

If the inverse matrix of the matrix A can be obtained, the vector X can be easily obtained, but since there is no inverse matrix in this matrix A, the above-mentioned condition is made that the total variation of the vector X ^ is sparse. The vector X ^ is estimated by performing the following optimization using the mathematical expression of the number 1.

The present invention performs an optimization calculation in the focusing direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by forming a one-dimensional image on the linear image sensor for each projection pattern. It reconstructs a two-dimensional image or a three-dimensional image at high speed and with high resolution. Preferably, in addition to the optimization calculation of the focusing direction, the optimization calculation of the direction orthogonal to the focusing direction is performed to reconstruct the two-dimensional image or the three-dimensional image at high speed and higher resolution. be. The following mathematical formula of Equation 1 is used for this two-step optimization calculation.

Here, A is a matrix representing irradiation of a plurality of projection patterns, B is a matrix for obtaining total variation, X ^ is a vector representing one line having a focusing direction of the reconstructed image, and y is a vector representing shooting data. The optimization calculation based on the above formula minimizes the squared error of one line with the focusing direction of the captured data and the image to be reconstructed, and the total variation in one line with the reconstructed image. Is. Further, the matrix A includes the conditions of the matrix representing the irradiation of a plurality of projection patterns and the physical photographing process of focusing one-dimensionally by the optical system. In addition, various parameters that reflect an error or the like according to the shooting conditions may be added to the above formula.

Preferably, the matrix B in the mathematical expression of Equation 1 is a matrix for obtaining total variation, and is a matrix for performing an operation for taking the difference between adjacent pixels of the vector X ^. By this optimization calculation, one line in the focusing direction of the image pickup target is reconstructed, and by repeating this work a total of N times in the direction orthogonal to the focusing direction, the image of N × N pixels can be reconstructed. Will be done. That is, by this optimization operation, the image compressed in the focusing direction is reconstructed, and the image of N × N pixels can be reconstructed. Preferably, the image of N × N pixels from which noise has been removed can be reconstructed by performing the same optimization in the direction orthogonal to the focusing direction.

Further, in the mathematical formula of Equation 1 used in the optimization calculation, the matrix A includes the conditions of the matrix representing the irradiation of a plurality of projection patterns and the physical imaging process of condensing the data in one dimension by the optical system. Since the analysis accuracy of the one-dimensional image pickup data acquired by the linear image sensor can be improved, a reconstructed image can be obtained at high speed and with high resolution.

The imaging method and the embodiment for carrying out the imaging apparatus according to the present invention will be described below based on examples.

(Imaging device)
As shown in FIG. 1, the imaging apparatus 1 in this embodiment includes a spatial light modulator 2 capable of outputting a plurality of projection patterns to the modulation surface 2a, and a linear image sensor 3 in which unit elements are arranged one-dimensionally. The light obtained by superimposing the image of the image pickup target 10 and the projection pattern output on the modulation surface 2a of the spatial light modulator 2 with the lens 4 that forms an image of the image pickup target 10 on the modulation surface 2a of the spatial light modulator 2. A cylindrical lens 5 as an imaging means for forming a one-dimensional image on a linear image sensor 3, and an A / D converter 6 for converting one-dimensional imaging data acquired by the linear image sensor 3 from analog data to digital data. It is mainly composed of a personal computer 7 as an analysis means for performing optimization calculation based on a plurality of digitally converted one-dimensional imaging data and projection pattern data of the spatial light modulator 2.

The personal computer 7 is based on a storage unit that stores one-dimensional imaging data corresponding to each projection pattern output to the modulation surface 2a of the spatial light modulator 2 and a plurality of one-dimensional imaging data stored in the storage unit. It includes an analysis unit that performs two-step optimization calculations, and a display unit that inputs image data reconstructed by the analysis unit and displays the reconstructed image.

The spatial optical modulator 2 is a digital micromirror device (DMD), has a modulation surface 2a in which a plurality of pixel regions capable of modulating the light intensity of the output light with respect to the input light are arranged, and is set. Based on the projection pattern, light intensity modulation of two or more values is possible in each of the plurality of pixel regions of the modulation surface 2a. By using the DMD as the spatial light modulator 2, a precise projection pattern can be output at high speed.

In this embodiment, the spatial optical modulator 2 is described as outputting a binary two-dimensional random pattern (see FIG. 1) in black and white as a projection pattern, but the present invention is not limited to this, and the gray level is not limited to black and white. By outputting a two-dimensional random pattern consisting of three or more values including the value having the above, the number of one-dimensional imaging data required for image reconstruction may be reduced to facilitate the analysis. Further, the projection pattern is not limited to the random pattern, but may be set to a pattern using the Hadamard transform or the discrete cosine transform (DCT) so that the reconstructed image can be obtained at a higher speed. ..

The linear image sensor 3 is a Linea HS 32k (16384 pixels, 300 KHz / line) manufactured by Teledyne DALSA.

The linear image sensor in the imaging method of the present invention may theoretically have two unit elements arranged one-dimensionally.

The lens 4 is a biconvex lens, and an image of the image pickup target 10 is formed on the modulation surface 2a of the spatial light modulator 2.

The image forming means is a plano-convex cylindrical lens 5, and the image of the image pickup target 10 imaged on the modulation surface 2a of the spatial light modulator 2 by the lens 4 and the image are output to the modulation surface 2a of the spatial light modulator 2. The light on which the projection pattern is superimposed is collected and imaged one-dimensionally on the linear image sensor 3.

In this embodiment, the focusing direction of the linear image sensor 3 is the direction of focusing by the cylindrical lens 5, that is, the lateral direction of the linear image sensor 3 (see FIG. 1), and is a linear image sensor. The direction orthogonal to the focusing direction of 3 is the direction not focused by the cylindrical lens 5, that is, the longitudinal direction of the linear image sensor 3 (see FIG. 1), in other words, the unit element constituting the linear image sensor 3 is one-dimensional. It is the direction to line up with.

(Imagery method)
Next, the imaging method using the imaging device 1 in this embodiment will be described with reference to the flowchart of FIG. First, when the image of the image pickup target 10 is imaged on the modulation surface 2a of the spatial light modulator 2 by the lens 4 (step S01), the output of the projection pattern preset on the modulation surface 2a of the spatial light modulator 2 (step S01). Step S02) is performed, and the light obtained by superimposing the image of the image pickup target 10 and the projection pattern output on the modulation surface 2a of the spatial light modulator 2 is unilaterally imaged on the linear image sensor 3 by the cylindrical lens 5 (step S02). Step S03).

Next, when the one-dimensional imaging data is acquired by the linear image sensor 3 (step S04), the one-dimensional imaging data is converted from analog data to digital data by the A / D converter 6 (step S05) and digitally converted. The one-dimensional image pickup data is associated with the projection pattern data output to the modulation surface 2a of the spatial optical modulator 2 at the time of shooting, and is stored in the storage unit of the personal computer 7 (step S06).

Next, the personal computer 7 determines whether or not the number of one-dimensional image pickup data stored in the storage unit has reached the same number as the preset number of times of shooting (step S07). Steps S02 to S07 are repeated while changing the projection pattern output to the modulation surface 2a of the spatial light modulator 2 until the number of one-dimensional imaging data stored in the storage unit reaches a preset number of shootings. Is done.

Next, when the number of one-dimensional imaging data stored in the storage unit reaches a preset number of shots, the analysis unit uses the above-mentioned mathematical formula to create a linear image based on a plurality of one-dimensional imaging data and projection pattern data. The optimization calculation (step S08) is performed in the focusing direction of the sensor 3, and then the optimization calculation (step S09) is performed in the direction orthogonal to the focusing direction of the linear image sensor 3 using the same mathematical formula.

Next, in the analysis unit, image reconstruction (step S10) is performed by combining the results of the optimization calculation in step S07 and step S08, and the reconstructed image is displayed on the display unit (step S11).

A spatial light modulator 2 is connected to the personal computer 7, and information such as a preset number of shots and a projection pattern output to the modulation surface 2a of the spatial light modulator 2 is shared for each shot. ing.

As described above, in the imaging method using the imaging device 1 in the present embodiment, the image of the image pickup target 10 and the light obtained by superimposing the plurality of projection patterns output on the modulation surface 2a of the spatial optical modulator 2 are superimposed on the cylindrical lens 5. The plurality of one-dimensional imaging data acquired by the linear image sensor 3 are compressed in the focusing direction of the linear image sensor 3 by condensing the data in a linear image sensor 3 and forming a one-dimensional image on the linear image sensor 3. However, since the data is not compressed in the direction orthogonal to the focusing direction and becomes continuous data without duplication or loss, a collection of linear image sensors 3 based on a plurality of one-dimensional imaging data acquired for each projection pattern. After performing the optimization calculation in the optical direction, the optimization calculation is performed in the direction orthogonal to the focusing direction of the linear image sensor 3, and by combining these results, it is reconstructed at high speed and high resolution with a small number of projection patterns. You can get the image.

The imaging method using the imaging device 1 in this embodiment makes it possible to reconstruct an image with higher resolution while significantly reducing the number of shootings as compared with the conventional SPI, and also with high-speed camera technology using CCD / CMOS. The reason why the frame rate is much higher than that and the image reconstruction with higher resolution is possible is that the light obtained by superimposing the projection pattern on the image to be imaged is imaged on a point sensor consisting of one unit element and photographed. Compared to the SPI that performs the above, the linear image sensor 3 has an increased number of unit elements due to the one-dimensional arrangement of the unit elements, so that the amount of information that can be acquired in one shooting is large. Specifically, since the unit elements of the linear image sensor 3 are arranged one-dimensionally, the spatial resolution is high in the longitudinal direction of the linear image sensor 3, that is, in the direction orthogonal to the focusing direction of the linear image sensor 3. Therefore, the one-dimensional imaging data acquired by condensing the light obtained by superimposing the projection pattern on the image of the imaging target 10 by the cylindrical lens 5 and forming a one-dimensional image on the linear image sensor 3 is in the condensing direction. Can be regarded as low-resolution point data similar to SPI, data is not compressed in the direction orthogonal to the focusing direction, and can be regarded as high-resolution continuous data without duplication or loss. ..

As described above, the one-dimensional imaging data acquired by the linear image sensor 3 is continuous high-resolution data in the direction orthogonal to the focusing direction of the linear image sensor 3 without duplication or loss, and thus one shooting is performed. The amount of information that can be acquired in is large, and the relevance of each data is in a moderately clear state without performing optimization calculation based on a plurality of one-dimensional imaging data acquired for each projection pattern. Therefore, in order to perform image reconstruction from a plurality of one-dimensional imaging data acquired for each projection pattern, it is optimal based on the data in the focusing direction of the linear image sensor 3, which can be regarded as at least low-resolution point data. By performing the conversion calculation, it is sufficient to obtain the relevance of the data in the focusing direction, and as a result, it is possible to reconstruct the image with higher resolution while reducing the number of shootings required for the image reconstruction. ..

Further, in the imaging method using the imaging device 1 of the present embodiment, the two-step optimization calculation of the focusing direction of the linear image sensor 3 and the direction orthogonal to the focusing direction is performed, and these optimization calculations are performed. Since the same formula is used for, the reconstructed image can be obtained at higher speed and higher resolution.

Here, the result of comparing the imaging method using the imaging apparatus 1 of this embodiment with the high-speed camera technique by CMOS will be described. As an image sensor used in the high-speed camera technology, a 120MXS CMOS sensor (13272 × 9176 pixels) manufactured by Canon Inc. was used. The CMOS sensor has a frame rate of 9.4 fps and requires 11.3 Gbps for data transfer. On the other hand, as the linear image sensor 3 constituting the imaging device 1 of this embodiment, Linea HS 32k (16384 pixels, 300 KHz / line) manufactured by Teledyne DALSA was used. According to the inventors, in the imaging method using the imaging apparatus 1 of the present embodiment, a sufficiently high-resolution reconstructed image (16384 × 16384 pixels) can be obtained if there are 50% of the projection patterns in one line. It has been verified.

When the imaging performance by the imaging method using the imaging apparatus 1 of this embodiment is estimated under these conditions, the number of projection patterns is 8192 times, so that the frame rate is 37 fps (≈300 KHz / 8192) and 16384 × 16384 pixels. It is an estimate that you can get the image of. As described above, it has been confirmed that the imaging method using the imaging device 1 of the present embodiment enables image reconstruction with a significantly higher frame rate and higher resolution than the high-speed camera technique using CMOS.

Further, 1 Gbps is required for data transfer by the imaging method using the imaging device 1 of this embodiment. This indicates that the imaging method using the imaging device 1 of this embodiment implicitly has a data compression function.

Moreover, the result of comparison between the imaging method using the imaging apparatus 1 of this example and SPI will be described. Considering that the image of 16384 × 16384 pixels is reconstructed by SPI, when the optimization method (compression sensing) is used, about 10% of the number of pixels of the reconstructed image, that is, the number of projection patterns of about 26.8 million times. In the case of deep learning, about 2% of the number of pixels of the reconstructed image, that is, the number of projection patterns of 5.4 million times is required. In the imaging method using the imaging apparatus 1 of this embodiment, the number of projection patterns required to reconstruct an image of 16384 × 16384 pixels is 8192 times, so that the number of times of shooting is significantly reduced as compared with SPI. It was confirmed above that image reconstruction with higher resolution is possible.

The linear image sensor 3 is assumed to have one line, but by using a sensor with a plurality of lines, the number of times of shooting can be further reduced to perform image reconstruction. In this case, since the light receiving angle changes for each line of the linear image sensor, the matrix A in the formula of the optimization calculation is set for each line.

Further, in the imaging method using the imaging device 1 in the present embodiment, the image of the image pickup target 10 and the light obtained by superimposing the plurality of projection patterns are one-dimensionally imaged on the linear image sensor 3 by the cylindrical lens 5. Since it does not require mechanical scanning, it can be applied to imaging various imaging objects.

In this embodiment, a mode of reconstructing a two-dimensional image from one-dimensional image pickup data using one linear image sensor 3 has been described, but the present invention is not limited to this, and for example, a plurality of linear image sensors are arranged. A three-dimensional image may be reconstructed by applying the principle of triangulation by acquiring one-dimensional imaging data from different angles.

Although examples of the present invention have been described above with reference to the drawings, the specific configuration is not limited to these examples, and any changes or additions that do not deviate from the gist of the present invention are included in the present invention. Will be.

For example, in the above embodiment, the embodiment in which the same mathematical formula is used in the two-step optimization calculation has been described, but the present invention is not limited to this, and for example, even if different mathematical formulas are used in the optimization calculation in the direction orthogonal to the focusing direction. good.

Further, in the above embodiment, the image reconstruction is performed by analyzing the one-dimensional imaging data using the mathematical formula of the optimization calculation, but the image reconstruction may be performed by deep learning.

Further, the linear image sensor is not limited to one in which a plurality of unit elements are arranged one-dimensionally continuously, and a plurality of point sensors used for SPI may be arranged at predetermined intervals.

Further, the spatial light modulator is not limited to the DMD, and may be any one capable of performing modulation with high accuracy and high speed.

Further, in the above embodiment, the embodiment in which the image to be imaged is formed on the modulation surface of the spatial light modulator and superimposed on the projection pattern has been described, but the present invention is not limited to this, and the image is output to the modulation surface of the spatial light modulator. The projection pattern may be irradiated on the image pickup target and superimposed on the image to be imaged.

Further, the imaging means is not limited to the cylindrical lens, and may be configured so as to be able to form a one-dimensional image of light obtained by superimposing an image to be imaged and a projection pattern on a linear image sensor.

Further, the light on which the image to be imaged and the projection pattern are superimposed may be at least a wavelength having the sensitivity of the linear image sensor, and the image to be imaged is obtained by irradiation light from a light source set for photographing. It may be one obtained by natural light such as sunlight.

1 Imaging device 2 Spatial light modulator 2a Modulation surface 3 Linear image sensor 4 Lens 5 Cylindrical lens (imaging means)
6 A / D converter 7 Personal computer (analysis means)
10 Image target

Claims (9)

A step of forming an image of an image to be imaged and a light obtained by superimposing a plurality of projection patterns on a linear image sensor in which at least two or more unit elements are one-dimensionally arranged.
An imaging method comprising: a step of performing an optimization calculation in a focusing direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor. The imaging method according to claim 1, further comprising a step of performing an optimization calculation in a focusing direction of the linear image sensor and then performing an optimization calculation in a direction orthogonal to the focusing direction. The calculation for optimizing the focusing direction of the linear image sensor includes a matrix A representing the irradiation of the plurality of projection patterns, a matrix B for obtaining the total variation, and a vector X representing one line in the focusing direction of the reconstructed image. ^, Based on the vector y representing the shooting data, the calculation based on the equation 1 is performed, and the squared error of one line with the focusing direction of the shot data and the image to be reconstructed, and 1 with the reconstructed image. The imaging method according to claim 1 or 2, wherein the total variation in the line is minimized.

The imaging method according to claim 3, wherein the same mathematical formula is used for the optimization calculation of the focusing direction of the linear image sensor and the optimization calculation of the direction orthogonal to the focusing direction. The imaging method according to claim 3 or 4, wherein the matrix A includes a matrix condition representing an irradiation of the plurality of projection patterns and a physical imaging process of focusing one-dimensionally by an optical system. Spatial light modulators that output multiple projection patterns and
A linear image sensor in which at least two unit elements are arranged one-dimensionally,
An imaging means for forming an image of an image to be imaged and a light obtained by superimposing the plurality of projection patterns on the linear image sensor.
An imaging apparatus comprising: an analysis means for performing an optimization calculation in a focusing direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor. The imaging apparatus according to claim 6, wherein the analysis means performs an optimization calculation in the focusing direction of the linear image sensor, and then performs an optimization calculation in a direction orthogonal to the focusing direction. The imaging device according to claim 6, wherein the spatial light modulator is a digital micromirror device. The imaging apparatus according to claim 6, wherein the imaging means is a cylindrical lens.

Images