JP6681103B1 - Image data acquisition method - Google Patents

Abstract

An object of the present invention is to provide a method for efficiently acquiring image data of a subject in a shorter time. A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional, or three-dimensional, and a second space including at least one of the locations. A second scanning step of scanning the inside of the object, wherein the second scanning step includes a step X of randomly determining the position of the observation point and the image data of the observation point. And a step Y to perform, and when the scanning in one of the second spaces is completed, the second space has a first region including 50% of the observation points and the first region. Has a second region that is outside the region and includes the remaining 50% of the observation points, and the second region is wider than the first region by 15% or more. [Selection diagram] Figure 1

Description

  The present invention relates to an image data acquisition method, a program for executing the image data acquisition method, a confocal microscope for executing the image data acquisition method, and a Raman microscope for executing the image data acquisition method.

  Image acquisition devices such as microscopes and telescopes are variously focused on how to improve spatial resolution and wavelength resolution, or how to quickly acquire information on an observation target. Research has been done.

  For example, Patent Document 1 listed below describes a confocal spectroscopic imaging system that enables rapid data acquisition. In this confocal spectroscopic imaging system, as described in claim 1 of the same document, a light source means and a predetermined illumination pattern for conjugating the position of an object being inspected by forming an illumination aperture are provided. A confocal spectroscope comprising light modulating means arranged to guide and analyzing means comprising a detection aperture, a spectral dispersive element and a detector camera, the illumination and detection apertures being arranged in a conjugate optical plane. In an imaging system, the light modulating means comprises a two-dimensional array of light modulating elements, the groups of elements forming the two-dimensional array are arranged to form an illumination aperture according to an illumination pattern, the illumination pattern being the object. The light modulating means is configured to be controllable so that the conjugate position of (1) changes depending on time.

  As described in paragraph [0014] of Patent Document 1, the basic idea of this confocal spectroscopic imaging system is confocal having a spectral analysis means equipped with spatial light modulation means (hereinafter referred to as SLM). It is in operation of an optical image system. The SLM means comprises an array of light modulation elements. One array is a mask composed of light modulation elements, which are individually controllable. Its controllability is related to the optical characteristics of the element such as transmission, reflection or diffraction. By changing the group or all of the light modulation elements, an illumination and / or an illumination pattern coded as a detection aperture is formed. The mutually matched illumination or detection patterns are those generated by separate or common modulators.

  As described in paragraph [0015] of Patent Document 1, any illumination pattern sequence of the confocal spectroscopic imaging system may be used. For example, regularly or randomly spaced systematically shifted lines according to either a finite length pseudorandom sequence or an S-matrix Hadamard sequence, such as triangles, squares, rectangles, hexagons, etc. Regular dot grid, finite length random or pseudo-random pattern based on so-called Walsh, Sillivester, Hadamard or Gory sequences, square or rectangular grid formed from intersecting line patterns, sequentially acquired integers on SLM It was said that it could be chosen to be either a plane-fill pattern suitable for rotation on a number of SLM elements or a combination of the above pattern sequences.

JP, 11-249023, A

  However, Patent Document 1 does not describe a specific configuration in which it is effective to use a specific illumination pattern sequence in order to speed up the acquisition of information on a subject (observation target). It seems that the degree of speeding up will not change even if it is changed. An object of the present invention is to provide a method for efficiently acquiring image data of a subject in a shorter time.

[1] The method of acquiring image data according to the first aspect of the present invention, which has achieved the above object, includes a step W of determining one place in a first space that is one-dimensional, two-dimensional, or three-dimensional. A first scanning step including a plurality of;
A second scanning step of scanning in a second space containing at least one of the locations;
A method of acquiring image data of a subject, comprising:
The second scanning step includes a step X for randomly determining the position of an observation point (hereinafter, referred to as “second random determination”) and a step Y for acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points, and the second area is larger than the first area by 15% or more.

  In the above image data acquisition method, the second random decision follows a probability distribution in which the closer to the center position, the higher the probability of appearance is. Therefore, the visual field center area is grasped in a higher degree of detail, and the visual field peripheral area is slightly rough. However, it is similar to the way information is obtained with the naked eye to grasp a wide range. By following the probability distribution in which the second random determination is closer to the center position and having a higher appearance probability, it is possible to acquire image data that can be easily grasped by an observer from an early stage after the start of scanning. It is considered to be a thing.

[2] The image data acquiring method further includes a pre-second scanning step of scanning the inside of the second space before starting the second scanning step, and the scanning center of the second scanning step is It is preferable to adjust to a specific position determined by the pre-second scanning step.

[3] The step of determining the position of the n-th (n is a natural number) observation point in the second scanning step is step Xn, and the step of acquiring the n-th image data corresponding to the observation point is step Yn. Then, the number of observation points acquired in the second scanning step is not fixed at the time of executing step X1, and the one or more image data acquired in steps Y1 to Yn satisfy the predetermined condition. It is preferable to adopt the image data acquisition method described in [1] or [2], which terminates the second scanning step when satisfied.

[4] The method of acquiring image data according to the second aspect of the present invention, which has achieved the above object, includes a step W of determining one place in the first space which is one-dimensional, two-dimensional or three-dimensional. A method of acquiring image data of a subject, comprising a plurality of first scanning steps, and a second scanning step of scanning in a second space including at least one of the locations,
The second scanning step includes a step X for randomly determining the position of an observation point in the second space (hereinafter referred to as “second random determination”) and a step Y for acquiring image data of the observation point. Have,
When the step of determining the position of the n-th (n is a natural number) observation point in the second scanning step is step Xn and the step of acquiring the n-th image data corresponding to the observation point is step Yn When the number of observation points acquired in the second scanning step is not fixed at the time of executing step X1, and one or a plurality of image data acquired in steps Y1 to Yn satisfy a predetermined condition. Then, the second scanning step is finished.

[5] The predetermined condition is preferably the image data acquisition method according to [3] or [4], in which the intensity function with the one or a plurality of image data as an argument is a predetermined value or less.

[6] The intensity function at the time point when the data acquisition of the nth point by the step Yn is completed uses m image data from the (n−m) th point to the nth point as an argument [5] ] The image data acquisition method described in [1] is preferable. However, m and n are natural numbers, and m <n.

[7] The image data acquisition method according to any one of [1] to [6], in which an area within a predetermined distance from an observation point that has already been scanned in the second space is not scanned is preferable.

[8] The plurality of second spaces whose positions have been determined by the first scanning step are selected so as to be discrete from each other, and the image data according to any one of [1] to [7]. The acquisition method is preferable.

[9] In the first scanning step, the position of the second space is randomly determined in the first space (hereinafter, referred to as “first random determination”). [1] to [8] It is preferable that the method for acquiring image data according to any one of items is used.

[10] It is preferable that the first random determination is performed by the method of acquiring image data according to [9], which follows a uniform random number.

[11] The image data acquisition method according to any one of [1] to [10], wherein the second random decision is according to a normal random number.

[12] The image data acquisition method according to any one of [1] to [11], in which the second scanning step is performed between the one step W and the other step W. It is preferable.

[13] The method for acquiring image data according to any one of [1] to [12], wherein the second space is arranged along a predetermined grid in the first space.

[14] When the step of determining the k-th (k is a natural number) position of the second space in the first scanning step is step Wk, the steps within the predetermined grid are executed and the steps W1 to Wk are executed. The probability that the remaining second space other than the k second spaces already determined by will be determined to be the (k + 1) th second space is likely to be the same, respectively. .

[15] The acquisition of the image data according to any one of [1] to [14], in which the acquisition of the image data ends when the cumulative number of executions of step W reaches a predetermined value in the first space. Method.

[16] A method for acquiring image data according to the third aspect of the present invention, which has achieved the above object, comprises:
A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional, and scanning in a second space that includes at least one of the locations. A method of acquiring image data of an object, comprising: a second scanning step,
The second scanning step has a step X of randomly determining the position of the observation point in the second space (second random determination), and a step Y of acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points and the second area is wider than the first area,
The method further comprises a pre-second scanning step of scanning the inside of the second space before starting the second scanning step, wherein a scanning center of the second scanning step is a specific position determined by the pre-second scanning step. To suit.

[17] A method of acquiring image data according to the fourth aspect of the present invention which can achieve the above object,
A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional, and scanning in a second space that includes at least one of the locations. A method of acquiring image data of an object, comprising: a second scanning step,
The second scanning step has a step X of randomly determining the position of the observation point in the second space (second random determination), and a step Y of acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points and the second area is wider than the first area,
The step W is to randomly determine the position of one place in the first space (first random determination).

[18] A method for acquiring image data according to the fifth aspect of the present invention, which has achieved the above object, comprises:
A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional, and scanning in a second space that includes at least one of the locations. A method of acquiring image data of an object, comprising: a second scanning step,
The second scanning step has a step X of randomly determining the position of the observation point in the second space (second random determination), and a step Y of acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points and the second area is wider than the first area,
The second scanning step is executed between the one step W and the other step W.

[19] It is preferable to configure a program that executes the image data acquisition method according to any one of [1] to [18].

[20] It is preferable to configure a confocal microscope that executes the image data acquisition method according to any one of [1] to [18].

[21] It is preferable to configure a Raman microscope that executes the image data acquisition method according to any one of [1] to [18].

  According to the image data acquisition method of the present invention, it is premised that at least two scanning steps of a first scanning step and a second scanning step are performed, and among them, (1) the execution procedure of the second random determination is mainly performed. The position close to the position follows a probability distribution having a higher appearance probability than the peripheral part, or (2) when the image data acquired in the second scan satisfies a predetermined condition, the second scan By ending the steps, it is possible to acquire image data that is easily grasped by an observer from an early stage after the start of scanning.

6 is a flowchart of an image data acquisition method according to the first or second embodiment of the present invention. It is a figure which shows the determined position of the 2nd space which concerns on Embodiment 1 of this invention. It is a figure which shows the determined position of the 2nd space which concerns on the acquisition method of the image data of a reference example. 3 shows an example of distribution of observation points according to the first embodiment of the present invention. 3 shows an example of distribution of observation points according to the first embodiment of the present invention. 3 shows an example of distribution of observation points according to the first embodiment of the present invention. 5 is a diagram showing an example of distribution of observation points according to the first or second embodiment of the present invention. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 6 illustrates a process of forming image data in Example 1 and Comparative Example 1. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2. 9 illustrates a process of forming image data in Example 2 and Comparative Example 2.

  In the current state-of-the-art scientific analysis and measurement, it is required to detect an extremely weak spatial distribution of emitted or scattered light from a large area or volume of a measurement sample in a short measurement time. However, even with the latest measurement technology and microscope technology, it is very difficult to satisfy weak signals, a large area, and a short time at the same time. The idea of the present inventors is that instead of deterministically determining the scanning route for acquiring image data, the scanning is left to a stochastic process such as Brownian motion. It may be similar to finding a unique place or finding animals in a large area. As a specific application, for example, it is possible to perform Raman scattering spectroscopic microscopy imaging of the molecular distribution in living cells with high spatial resolution and in a short time. It can also be applied to imaging defect distribution and chirality of nanomaterials such as carbon nanotubes, and strain distribution of advanced semiconductor devices. In the present invention, the process for determining the scanning route has at least two scanning layers, and each layer determines the scanning route in accordance with the statistical and stochastic processes such as uniform random number, random walk, and information entropy. The observation target to which this method can be applied is not limited to a one-dimensional or two-dimensional image, and can be effectively implemented in imaging of a three-dimensional structure.

  Hereinafter, the present invention will be described more specifically based on the following embodiments. However, the present invention is not limited to the following embodiments, and appropriate changes may be made within a range that can conform to the purpose of the preceding and the following. In addition, it is of course possible to implement them, and all of them are included in the technical scope of the present invention.

(Embodiment 1)
The image data acquisition method according to the first embodiment of the present invention includes a first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional, or three-dimensional; A second scanning step of scanning in a second space including at least one of the following, wherein the second scanning step randomly determines the position of the observation point. X and a step Y of acquiring image data of the observation points, and at the time when the scanning in one second space is completed, the second space contains the 50% of the observation points. It has one region and a second region outside the first region and containing the remaining 50% of observation points, and the second region is 15% or more wider than the first region. .

  In the image data acquisition method according to the first embodiment, the second random decision follows a probability distribution in which the closer to the center position of the second space, the higher the probability of appearance. Although the peripheral area of the visual field is somewhat rough, it is similar to the visual information acquisition mode for grasping a wide area. By following the probability distribution in which the second random determination is closer to the center position and having a higher appearance probability, it is possible to acquire image data that can be easily grasped by an observer from an early stage after the start of scanning. It is considered to be a thing.

  Hereinafter, a preferred mode of the method for acquiring image data according to Embodiment 1 of the present invention will be described with reference to the drawings. FIG. 1 is a flowchart of a method for acquiring image data according to the first embodiment of the present invention, which has steps described below.

(1) First Scanning Step The first scanning step is composed of a plurality of steps W, and the step W is a step of determining one place in the first space. This step W may be a step of defining the existence field of the second space, a step of determining a point included in the second space, or a center position of the second space. It may be a step.

  The existence field of the second space may be predetermined (i) when step W in the first scanning step is executed and before the second scanning step described later is started, or (ii) The existence region of the second space is not determined before the start of the two scanning steps, and the existence region of the second space including the set of observation points is determined as a result when the second scanning step is completed. May be.

  There is no particular limitation on the order or order in which the one place is determined in the first scanning step, and a plurality of second spaces may be sequentially determined or may be determined simultaneously. In order to cover a wide area in the first space in a short time, it is preferable that the second spaces are discretely determined with respect to each other, and more preferably randomly (first random determination). In the present invention, “random” indicates an irregular selection, and an irregular value may be generated by a computer as necessary, or a random value obtained from the computer and a device other than the computer. It is also possible to generate by compounding (noise etc.). Further, instead of generating an irregular value each time, a predetermined random value list (so-called random number table) can be prepared in advance.

  FIG. 2 shows one place (typically the central position of the second space) 1 to 7 determined in the first space by step W. As shown in FIG. 2, the locations 1 to 7 of the second space are not regularly positioned, that is, randomly positioned, and thus are respectively arranged discretely over the entire first space.

  FIG. 3 shows places 1 to 7 in the second space arranged by the raster scan shown for reference, not within the scope of the first embodiment. As shown in FIG. 3, in raster scanning, scanning is performed sequentially from the corners of the first space, so the state of the upper part of the screen is found relatively early after the start of scanning, but the state of the lower part of the screen is in the final stage. It won't be known unless you scan up to.

(2) Second scanning step (2-1) Step X
Step X forms a part of the second scanning step, and randomly determines the position of at least one observation point at one location specified by Step W (hereinafter, referred to as “second random determination”). It is a step to do. Here, the second random decision follows a probability distribution with a higher appearance probability at a position closer to the center position. Specifically, when the scanning in one second space is finished, the second space is , Having a first region containing 50% of the observation points and a second region existing outside the first region and containing the remaining 50% of the observation points, The second area is 15% or more wider than the first area.

  The first region may be, for example, a spherical or circular region centered on the center position of the second space, and may have a minimum radius for including 50% of observation points. The second region can be, for example, a region excluding the first region from a spherical or circular region having the smallest radius among regions including all the observation points in the second space. When step X is performed for each pixel arranged in the three-dimensional space or the two-dimensional plane, the boundary of the spherical or circular area is not naturally smooth as a matter of course. The radius may be a distance between the center position of the second space and the center position of each cell. The pixels may be arranged in a lattice in a three-dimensional space or a two-dimensional plane, or may be arranged point-symmetrically with respect to the center of the second space.

  When the number of observation points is an odd number, the number of observation points in the first area can be increased by one more than the number of observation points in the second area.

  Here, the meaning of "the second region is wider than the first region" means that, when the second space is one-dimensional, "the second region existing on one side and the other side of the first region". Means that the total length of is longer than the length of the first region ", and that the second region is two-dimensional, it means that" the area of the second region is larger than the area of the first region ". However, when the second space is three-dimensional, it means that “the volume of the second region is larger than the volume of the first region”.

  In this way, since the location where the observation point is closer to the central position follows the probability distribution with a higher appearance probability, the first area, which is the central area, can be grasped with higher precision, and the second area, which is the peripheral area, is slightly Although it is rough, it is possible to grasp a wide range of information in a short time. In order to exert such an effect more effectively, the second region is preferably 20% or more wider than the first region, more preferably 30% or more wider, further preferably 50% or more wider, and 80% or more. Wider is more preferable.

  When steps W and X of the first embodiment are applied to the optical microscope, efficient and quick scanning can be performed by controlling the light irradiating the sample to be observed by deflecting it with a galvanometer mirror.

  4 to 6 show one-dimensional examples of distributions of the observation points set in the second space, respectively. FIG. 4 shows an example in which the observation points exist according to a normal distribution, FIG. 5 shows an example in which the observation points exist according to a triangular distribution, and FIG. 6 shows an example in which the observation points are distributed in a stepwise manner. Is.

  The center of the second scan does not necessarily have to match the center of the second space. Preferably, before executing the second scan, significant data such as strong contrast exists in the second space by scanning the second space (hereinafter referred to as “pre-second scan”). By grasping the specific position that exists and performing the second scan around the specific position, the specific position where significant data exists can be more intensively resolved. As a scanning method for the pre-second scanning, it is desirable to use a uniform scanning method such as raster scanning or uniform random scanning.

(2-2) Step Y
Step Y is a step of acquiring the image data of the location corresponding to the observation point specified in the above-mentioned step X, and basically acquiring the same number of image data as the observation points, but the acquired image The number of data may be smaller than the number of observation points. A publicly known array sensor can be used to acquire information, or a single sensor such as a photodiode can be used.

(3) Continuation / end of the second scanning step When the acquisition of the image data of the part corresponding to the specific observation point in the second space is completed, the process is returned to step X, as shown in FIG. The process of determining the next observation point in the second space of is performed. The second scan is repeated in this manner, but when the number of observation points reaches a predetermined value, it is determined that the image data in the second space has been sufficiently acquired, and the second scan step is ended. be able to.

  Note that unlike the case where the second scanning step is ended when the number of observation points reaches a predetermined value as described in (3) above, after the second scanning is repeated n times, It is possible to terminate even if the number has not reached a predetermined value. For example, the step of determining the position of the n-th (n is a natural number) observation point in the second scanning step is set to step Xn, and the step of acquiring the n-th image data corresponding to the observation point is set to step Yn. At this time, when the number of observation points acquired in the second scanning step is not fixed at the time of executing step X1, and one or a plurality of image data acquired in steps Y1 to Yn satisfy a predetermined condition. Also, the second scanning step can be ended early.

(A) Early termination part 1
For example, if significant information such as sufficient contrast has already been obtained from the image data acquired in steps Y1 to Yn, it is determined that the schematic image of the second space has been grasped, and the second scanning step is terminated early. It is possible to shift to scanning of another second space. On the other hand, if the image data acquired in steps Y1 to Yn alone do not provide significant information, the second scanning step may be continued in order to resolve the second space in more detail.

(B) Early termination 2
On the contrary to the above (a), when the image data acquired in the above steps Y1 to Yn has not obtained sufficient intensity information, it is determined that the area does not include significant information. Then, the second scanning step can be ended early, the process can be moved to step W, and the scanning of another second space can be started. On the other hand, when significant image information such as contrast is obtained from the image data obtained in steps Y1 to Yn, the second scanning step can be continued in order to further increase the resolution of the image.

  FIG. 7 shows an example of the distribution of the observation points scanned by the early termination method according to the first embodiment or the early termination method according to the second embodiment described below. As shown in FIG. 7, a plurality of observation points are scanned in each of the three second spaces, but the number of observation points differs depending on the second space. As described above, since the timing for satisfying the predetermined condition is different for each second space, the second space in which the number of observation points is small and the second space in which a relatively large number of observation points are scanned coexist. It will be in the state of being. The second space, in which the number of observation points is small, is a part particularly contributing to early acquisition of image data.

  Although there is a more specific method as the ending condition of the second scanning step, there is a part overlapping with the description of the image data acquiring method according to the second embodiment of the present invention which will be described below. It ends once.

  The number of observation points in the second space that meets the condition for early termination becomes smaller than the number of observation points included in the other second space, and accordingly, it is part of the requirements in the first aspect of the present invention. A certain “second space has a first area including 50% of the observation points and a second area existing outside the first area and including the remaining 50% of the observation points. The second area is 15% or more wider than the first area. ”There may be a second space that does not satisfy the condition. However, even if such a second space exists, As long as there is another second space satisfying the condition in one space, it corresponds to the embodiment satisfying the first aspect of the present invention.

(4) Continuation / end of the first scanning step If the image data acquisition of the predetermined second space is not completed, the process is returned to step W as shown in FIG. The process of determining the position of the two spaces is performed. By repeatedly continuing the first scan in this manner, a plurality of image data of the second space can be acquired. When the number of the second spaces reaches a predetermined value, it is considered that the image data in the first space has been sufficiently acquired, and the first scanning step is ended, and the entire process of acquiring the image data can be completed.

(Embodiment 2)
A method of acquiring image data according to Embodiment 2 of the present invention includes a first scanning step including a plurality of steps W for determining one place in a first space which is one-dimensional, two-dimensional or three-dimensional; A second scanning step of scanning in a second space including at least one of the following, wherein the second scanning step randomly positions the observation points in the second space. And a step Y of obtaining image data of the observation point, and a step of deciding the position of the n-th (n is a natural number) observation point in the second scanning step is defined as step Xn. When the step of acquiring the nth image data corresponding to the observation point is step Yn, it is acquired in the second scanning step when step X1 is executed. The number of measurement points is not fixed, in which one or more of the image data obtained by the step Y1~ step Yn is completed the second scanning step when satisfies a predetermined condition.

  The image data acquisition method according to the second embodiment is executed according to the flowchart of FIG. 1 as in the first embodiment. The difference between the first embodiment and the second embodiment is that the specific content of "(2-1) Step X for randomly determining the position of one observation point in the second space" in FIG. Since there are only two specific contents of “(3) Continuation / termination of scanning of the second space” in No. 1, the difference between these two will be mainly described below.

  First, with regard to the step (2-1), in addition to the requirement that the observation points are randomly determined in the first embodiment, “at the time when the scanning in one second space is completed, the second The space has a first area containing 50% of the observation points and a second area existing outside the first area and containing the remaining 50% of the observation points, While there is a requirement that the second region is 15% or more wider than the first region, in the second embodiment, there is no special requirement other than that the observation points are randomly determined.

  Next, regarding the step "(3) Continuation / termination of scanning of the second space" in FIG. 1, there is no particular requirement in the first embodiment, whereas in the second embodiment, "in the second scanning step" When the step of determining the position of the n-th (n is a natural number) observation point is step Xn and the step of acquiring the n-th image data corresponding to the observation point is step Yn, step X1 is executed. At this point in time, the number of observation points to be acquired in the second scanning step is not fixed, and when the one or more image data acquired in steps Y1 to Yn satisfy the predetermined condition, the second scanning step is performed. The difference is that there is a requirement to "end." However, since the requirement has already been sufficiently described in (3) of the first embodiment, redundant description will be omitted.

(Common subject matter)
Hereinafter, optional items common to both the first embodiment and the second embodiment will be described. In some aspects of the first embodiment and the second embodiment, it is described that the scanning of the second space is ended under a predetermined condition. However, the predetermined condition is that one or a plurality of image data is used as an argument. The intensity function to be performed is equal to or less than a predetermined value. The intensity function may be a simple summation of intensities in one or more image data, or may be a summation with weighting. In addition, as the intensity function, those showing the entropy of the intensity and those showing the standard deviation of the intensity can be used.

  In some aspects of the first embodiment and the second embodiment, the intensity function at the time point when the data acquisition at the n-th point in step Yn is completed is m pieces from the (n−m) th point to the nth point. Image data may be used as an argument. By intentionally ignoring the image data from the first point to the (n−m−1) th point in step Yn, the m image data from the (n−m) th point to the nth point are used as arguments. This is because it is possible to determine whether or not to end the second scan, based on the latest m pieces of image data that have appeared during the second scan.

  In the first and second embodiments, it is also a preferable mode that the region within a predetermined distance from the observation point already scanned in the second space is not scanned, that is, step X is not performed. Since step X is not performed, neither step Y is performed. The image data of the area within a predetermined distance from the already scanned point is relatively likely to be similar to the image data already obtained, so prioritize the area beyond the predetermined distance from the observation point. This is because scanning is preferable in terms of early completion of image data.

  In the first and second embodiments, the observation point that has already been scanned in the second space is excluded from the target of step X, and instead, the observation point (observed pixel) that is closest to the observation point is not observed. It is preferable that the point (unobserved pixel) is the target of step X. Among the closest unobserved points, by performing step X and step Y for the unobserved point farthest from the center position of the second space, the predetermined second scanning follows as the second scanning progresses. It is also possible to observe a wider range than the width of the probability distribution (for example, Gaussian distribution).

  In the first and second embodiments, from the viewpoint of early covering the entire image of the first space by the smaller number of second spaces, the plurality of second spaces whose positions are determined by the first scanning step are It is preferably selected to be discrete. For example, the second space next to the outermost line (or outer peripheral surface) of the first space and the inscribed circle (or inscribed sphere) inscribed in the second space in which the second scanning has already been completed has the maximum diameter. Is preferably selected. Further, it is preferable to select the next second space so that the second spaces which have already been subjected to the second scanning do not come into contact with each other.

  In the first and second embodiments, it is preferable that the first scanning step is to randomly determine the position of the second space within the first space (first random determination). For example, when observing a weak signal that requires 48 hours to grasp the entire image of the first space, when performing a raster scan in the first scanning step, the entire first space can be read until 48 hours have elapsed. Although the image cannot be grasped, according to the first random decision, the whole image can be generally grasped in the first 24 hours, for example, and the observation is terminated or the resolution is further reduced for the remaining 24 hours from the obtained image data. You have the option of continuing your observations to increase. It is also preferable that the first random decision is performed according to, for example, a uniform random number.

  In the first and second embodiments, the second scanning step may be preferably performed between one step W and the other step W, but a plurality of steps W are simultaneously performed. As a result, the specification of the positions of all the second spaces may be completed before starting the first second scan.

  In the first and second embodiments, it is preferable that the second space is arranged along the predetermined grid in the first space. This is because the existence of the grid makes it possible to avoid the occurrence of inefficiency due to the overlapping of the second spaces.

  In the first and second embodiments, when the step of determining the k-th (k is a natural number) position of the second space in the first scanning step is step Wk, it means that the space is within a predetermined grid. The probabilities that the remaining second spaces other than the k second spaces already determined by the execution of steps W1 to Wk are determined to be the (k + 1) th second space may be similarly probable. preferable. This is one method for disposing the plurality of second spaces in a discrete manner as described above.

  The program for executing the image data acquisition method described above is useful for executing the method on a computer. The program may be stored in a device for measuring image data, or may be stored in a usable state via the Internet.

  The confocal microscope and Raman microscope capable of implementing the image data acquisition method described above are very useful as a high-speed and high-definition image acquisition device.

  Hereinafter, in the process of actually forming an image of a sample using an optical microscope, image data is created by the method according to the first embodiment (Example 1) and the method according to the second embodiment (Example 2). Experiments were performed and image data (Comparative Example 1 and Comparative Example 2) were created by a conventional raster scan method that does not perform two-step scanning. Therefore, the obtained images will be described below. The detailed conditions for image generation are as follows.

Microscope used: Nanophoton's RAMAN drive
Sample used for the experiment: polystyrene particles Microscope magnification: 100 times Total number of observation points: 8000 pixels

(Example 1 and Comparative Example 1)
8 to 15 are image data obtained by the methods of Example 1 and Comparative Example 1. In each drawing, the image data of Example 1 is adjacent to the left half and the image data of Comparative Example 1 is adjacent to the right half. It is what was displayed. 8 to 15 each show an intermediate process in the generation of image data, FIG. 8 shows the image data at the time when the scanning of 1000 pixels is completed, and FIG. 9 shows the scanning of 2000 pixels. 10 shows the image data at the time of scanning, FIG. 10 shows the image data at the time when the scanning of 3000 pixels is completed, and FIG. 11 shows the image data at the time when the scanning of 4000 pixels is completed. 12 shows the image data when the scanning of 5000 pixels is completed, FIG. 13 shows the image data when the scanning of 6000 pixels is completed, and FIG. 14 shows 7000. FIG. 15 shows the image data at the time when the scanning of the pixels is completed, and FIG. 15 shows the image data at the time when the scanning of the 8000 pixels is completed.

  As can be seen from FIG. 15, the image data obtained in Comparative Example 1 displayed on the right half of the screen is scanned only about 80% of the entire screen, and the area of the lower 20% of the screen is about 20%. No image information has been obtained. On the other hand, the image data obtained in Example 1 displayed on the left half of the screen is almost completed over the entire field of view, and a characteristic image 8 which cannot be confirmed at all in the image of Comparative Example 1 appears.

(Example 2 and Comparative Example 2)
16 to 23 are image data obtained by the methods of Example 2 and Comparative Example 2, in which the image data of Example 2 is adjacent to the left half and the image data of Comparative Example 2 is adjacent to the right half in each drawing. It is what was displayed. 16 to 23 each show an intermediate process in the generation of image data, FIG. 16 shows image data at the time when scanning of 1000 pixels is completed, and FIG. 17 shows scanning of 2000 pixels. 18 shows the image data at the time of scanning, FIG. 18 shows the image data at the time when the scanning of 3000 pixels is completed, and FIG. 19 shows the image data at the time when the scanning of 4000 pixels is completed. 20 shows the image data at the time when the scanning of 5000 pixels is completed, FIG. 21 shows the image data at the time when the scanning of 6000 pixels is completed, and FIG. 22 shows the image data at 7000. FIG. 23 shows the image data at the time when the scanning of pixels is completed, and FIG. 23 shows the image data at the time when the scanning of 8000 pixels is completed.

  As can be seen from FIG. 23, the image data obtained in Comparative Example 2 displayed in the right half of the screen is scanned only about 40% of the entire screen, and the area at the bottom of the screen is about 60%. No image information has been obtained. On the other hand, the image data obtained in Example 2 displayed on the left half of the screen is almost completed over the entire field of view, and a characteristic image 8 that cannot be confirmed at all in the image of Comparative Example 2 appears.

  For example, in addition to laser scanning microscopes and scanning electron microscopes, laser radar and astronomical observation, electron beam lithography, focused ion beam processing, 3D printer processing (including those using the two-photon photopolymerization method), laser displays, laser televisions, etc. In the field of display systems, etc., more and more efficient and short-time scanning of large screens will be required in the future, and these are suitable as fields of application of the present invention. Furthermore, the state-of-the-art measuring instrument for image analysis of weak signals such as Raman scattering microscope may be renewed to the one using the present invention.

1 to 7: scan locus of the first scan (location of the second space in the first space)
8: Image not observed in Comparative Example

Claims (21)

A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional;
A second scanning step of scanning in a second space containing at least one of the locations;
A method of acquiring image data of a subject, comprising:
The second scanning step includes a step X for randomly determining the position of an observation point (hereinafter, referred to as “second random determination”) and a step Y for acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points, and the second area is 15% or more wider than the first area.   The method further comprises a pre-second scanning step of scanning the inside of the second space before starting the second scanning step, wherein a scanning center of the second scanning step is a specific position determined by the pre-second scanning step. The method for acquiring image data according to claim 1, wherein   When the step of determining the position of the n-th (n is a natural number) observation point in the second scanning step is step Xn and the step of acquiring the n-th image data corresponding to the observation point is step Yn When the number of observation points acquired in the second scanning step is not fixed at the time of executing step X1, and one or a plurality of image data acquired in steps Y1 to Yn satisfy a predetermined condition. The image data acquisition method according to claim 1, wherein the second scanning step is ended. A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional;
A second scanning step of scanning in a second space containing at least one of the locations;
A method of acquiring image data of a subject, comprising:
The second scanning step includes a step X for randomly determining the position of an observation point in the second space (hereinafter referred to as “second random determination”) and a step Y for acquiring image data of the observation point. Have,
When the step of determining the position of the n-th (n is a natural number) observation point in the second scanning step is step Xn and the step of acquiring the n-th image data corresponding to the observation point is step Yn When the number of observation points acquired in the second scanning step is not fixed at the time of executing step X1, and one or a plurality of image data acquired in steps Y1 to Yn satisfy a predetermined condition. A method for acquiring image data, characterized in that the second scanning step is completed.   The image data acquisition method according to claim 3, wherein the predetermined condition is that an intensity function having the one or more image data as arguments is equal to or less than a predetermined value.   The intensity function at the time point when the data acquisition of the n-th point by the step Yn is completed uses m image data from the (n−m) th point to the nth point as an argument. How to get the image data of. However, m and n are natural numbers, and m <n.   The image data acquisition method according to claim 1, wherein an area within a predetermined distance from an observation point that has already been scanned in the second space is not scanned.   The method for acquiring image data according to claim 1, wherein the plurality of second spaces whose positions are determined by the first scanning step are selected so as to be mutually discrete.   The said 1st scanning step determines the position of the said 2nd space at random in the said 1st space (henceforth "the 1st random determination" is described). How to obtain the described image data.   The image data acquisition method according to claim 9, wherein the first random decision is according to a uniform random number.   The method for acquiring image data according to claim 1, wherein the second random decision is according to a normal random number.   The method for acquiring image data according to any one of claims 1 to 11, wherein the second scanning step is performed between one of the steps W and another of the steps W.   The image data acquisition method according to claim 1, wherein the second space is arranged along a predetermined grid in the first space.   When the step of determining the k-th (k is a natural number) position of the second space in the first scanning step is step Wk, the space is within the predetermined grid and is already determined by performing steps W1 to Wk. 14. The image data acquisition method according to claim 13, wherein the probabilities that the remaining second spaces other than the set k second spaces are determined to be the (k + 1) th second spaces are also likely to be the same.   The image data acquisition method according to any one of claims 1 to 14, wherein the acquisition of the image data is terminated when the cumulative number of executions of step W reaches a predetermined value in the first space. A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional;
A second scanning step of scanning in a second space containing at least one of the locations;
A method of acquiring image data of a subject, comprising:
The second scanning step has a step X of randomly determining the position of the observation point in the second space (second random determination), and a step Y of acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points and the second area is wider than the first area,
The method further comprises a pre-second scanning step of scanning the inside of the second space before starting the second scanning step, wherein a scanning center of the second scanning step is a specific position determined by the pre-second scanning step. A method of acquiring image data, characterized by: A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional;
A second scanning step of scanning in a second space containing at least one of the locations;
A method of acquiring image data of a subject, comprising:
The second scanning step has a step X of randomly determining the position of the observation point in the second space (second random determination), and a step Y of acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points and the second area is wider than the first area,
The step W is a method of acquiring image data, wherein the position of one place is randomly determined in the first space (first random determination). A first scanning step including a plurality of steps W for determining one location in a first space that is one-dimensional, two-dimensional or three-dimensional;
A second scanning step of scanning in a second space containing at least one of the locations;
A method of acquiring image data of a subject, comprising:
The second scanning step has a step X of randomly determining the position of the observation point in the second space (second random determination), and a step Y of acquiring image data of the observation point,
At the time when one scan in the second space is completed, the second space exists in the first region including 50% of the observation points and the remaining 50 in the outside of the first region. % Of the observation points and the second area is wider than the first area,
The image data acquisition method, wherein the second scanning step is performed between one of the steps W and another of the steps W.   A program for executing the image data acquisition method according to claim 1.   A confocal microscope that executes the method for acquiring image data according to claim 1. A Raman microscope that carries out the method for acquiring image data according to claim 1.