WO2019186965A1

WO2019186965A1 - Data processing method and data processing program in imaging mass analysis

Info

Publication number: WO2019186965A1
Application number: PCT/JP2018/013453
Authority: WO
Inventors: 有里子中木村
Original assignee: 株式会社島津製作所
Priority date: 2018-03-29
Filing date: 2018-03-29
Publication date: 2019-10-03
Also published as: JP6927415B2; JPWO2019186965A1

Abstract

When a user designates a plurality of MS imaging images originated from samples having different objects to overlap, an image position matching processing unit (34) reads, from an optical image data storage unit (30), optical microscopic image data on a plurality of samples that correspond to the designated images and executes position matching by means of a known image registration technology to obtain image modification information. Since the shape of a sample can be distinctly observed in the optical microscopic image, the position matching can be performed with higher accuracy. An MS imaging image adjustment unit (36) uses the obtained image modification information and modifies a plurality of MS imaging images. The image overlap processing unit (37) causes the modified images to overlap. Even when the shape of a part on the sample cannot be observed in the MS imaging image, an overlap in which the locations, the magnitudes, and the shapes of the same part are matched can be performed. By using this, an accurate overlap of MS imaging images derived from a plurality of slice samples that are consecutively cut from one piece of bio tissue is possible.

Description

Data processing method and data processing program in imaging mass spectrometry

The present invention relates to a method for processing data obtained by an imaging mass spectrometer capable of acquiring mass spectrum data for each of a large number of measurement points in a measurement region on a sample, and a method for performing the method on a computer. The present invention relates to a data processing program for implementation.

In mass spectrometry imaging, the spatial distribution of a substance having a specific mass is obtained by performing mass analysis on each of a plurality of measurement points (micro-regions) in a two-dimensional measurement region on a sample such as a biological tissue section. It is a method to investigate, and its application to drug discovery, biomarker search, investigation of the cause of various diseases and diseases is being promoted. A mass spectrometer for performing mass spectrometry imaging is generally called an imaging mass spectrometer (see Non-Patent

Documents

1 and 2, etc.).

In general, an imaging mass spectrometer obtains mass spectrum data (including MS ⁿ spectrum data where n is 2 or more) over a predetermined mass-to-charge ratio (m / z) range for each of a large number of measurement points on a sample. Then, when the user designates the m / z value of the ion derived from the compound to be observed, the ion intensity value at each measurement point at the designated m / z value is extracted, and the ion intensity value is extracted according to the gray scale or color scale. A two-dimensional image (mass spectrometry imaging image, hereinafter referred to as “MS imaging image”) visualized and associated with the position of the measurement point is created and displayed on the screen of the display unit.

In recent years, research using these imaging mass spectrometers has been conducted to observe two-dimensional distributions of specific compounds in specimens cut out from biological tissues, thereby conducting pharmacokinetic analysis, metabolic pathway analysis, molecular correlation analysis, etc. Has been actively conducted.

In general, the imaging mass spectrometer uses a matrix-assisted laser desorption / ionization (MALDI) method to ionize components (compounds) in a sample. In that case, prior to the analysis, a matrix for MALDI is applied or sprayed on the surface of a sample such as a biological tissue section. Various compounds are known as matrices, but the components to be ionized differ depending on the type of matrix. Therefore, if there are multiple types of components to be observed and the types of matrices for ionizing them are different, a plurality of very thin slice samples that can be regarded as having the same tissue structure are cut out from one biological tissue, Imaging mass spectrometry may be performed by applying different types of matrices to a plurality of section samples. In addition, when it is desired to grasp the three-dimensional distribution of a specific component, it is necessary to cut out a large number of very thin continuous section samples from one living tissue and to perform imaging mass spectrometry for each of the continuous section samples. Done.

In addition, the above example is an example in which imaging mass spectrometry is performed for each of a plurality of samples collected from one biological tissue, specifically, for example, an organ such as a mouse or a human liver. When comparing an individual with an abnormal individual (eg, suffering from cancer), imaging mass spectrometry is performed on each sample cut from the same living tissue of a different individual.

As described above, based on MS imaging images obtained by performing imaging mass spectrometry for each of a plurality of samples, the distribution of specific components can be compared, the relationship between the distributions of different components can be investigated, In order to grasp the three-dimensional distribution of components, it is necessary to superimpose a plurality of MS imaging images.

Of course, if multiple samples are obtained from different individuals, even if multiple samples are obtained from one individual, the position and size of the region to be observed in the created MS imaging image Often, the shapes do not match or are not aligned. Therefore, when accurately overlaying MS imaging images derived from different samples, it is necessary to deform the images so that the positions, sizes, shapes, and the like of the same part are aligned as much as possible.

Normally, such processing is performed by manually aligning images by movement, rotation, enlargement / reduction, nonlinear deformation, etc. while confirming on the display screen a plurality of MS imaging images that a user (operator, etc.) wants to overlay. It has been implemented. However, these operations are very time consuming and low in efficiency. In the first place, the MS imaging image shows the intensity distribution of ions derived from components having a certain mass, that is, the distribution of abundance, and does not necessarily indicate the contour or boundary of a certain part or tissue structure. Since it is not limited, it has been difficult to accurately align MS imaging images.

In the observation and analysis of biological tissue, a stained image obtained by staining the sample with, for example, HE (hematoxylin / eosin) staining is acquired, and the stained image and a specific MS imaging image are superimposed. Even in such a case, there is a problem similar to the case where the MS imaging images are superimposed.

The present invention has been made in view of the above problems, and the object of the present invention is to superimpose a plurality of MS imaging images obtained from different samples, or to superimpose stained images and the MS imaging images. Provides a data processing method and data processing program for imaging mass spectrometry that can easily perform high-precision alignment so that the same part and tissue structure on the sample are as much as possible in the same position and shape There is to do.

The data processing method according to the first aspect of the present invention, which has been made to solve the above-mentioned problems, is an imaging mass spectrometry that processes mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample. Data processing method that performs processing to superimpose a plurality of mass spectrometry imaging images created based on mass spectrometry data obtained for a plurality of samples having the same or similar parts to be observed. A method,
a) an image selection step for allowing the user to select a plurality of mass spectrometry imaging images to be subjected to superposition processing;
b) an optical microscopic image acquisition step for acquiring optical microscopic images for a plurality of samples respectively corresponding to the selected plurality of mass spectrometry imaging images;
c) an image alignment step for aligning the images so that the same or similar parts coincide with each other while deforming one or a plurality of images among the plurality of obtained optical microscopic images;
d) an image deformation information acquisition step for acquiring image deformation information for one or more images at the time of image alignment;
e) an image deformation step of performing deformation processing of at least one image by applying the image deformation information acquired in the image deformation information acquisition step to a plurality of mass spectrometry imaging images that are targets of the superposition processing;
f) an image superposition processing step for performing superposition processing of the plurality of mass spectrometry imaging images at least one of which has been deformed in the image deformation step;
It is characterized by having.

The data processing program according to the first aspect of the present invention, which has been made to solve the above-mentioned problems, processes on the computer mass analysis data respectively obtained at a plurality of measurement points in a measurement region on a sample. A data processing program for performing a process of superimposing a plurality of mass spectrometry imaging images created based on mass spectrometry data respectively obtained for a plurality of samples, comprising:
a) an image selection function unit that allows a user to select a plurality of mass spectrometry imaging images to be subjected to superposition processing;
b) an optical microscopic image acquisition function unit for acquiring optical microscopic images for a plurality of samples respectively corresponding to the selected plurality of mass spectrometry imaging images;
c) an image alignment function unit that aligns images so that the same or similar parts match while deforming one or a plurality of images among a plurality of acquired optical microscopic images;
d) an image deformation information acquisition function unit for acquiring image deformation information about one or more images at the time of image alignment;
e) an image deformation function unit that applies at least one image deformation process by applying the acquired image deformation information to a plurality of mass spectrometry imaging images to be subjected to the superposition process;
f) an image superposition processing function unit that performs superposition processing of the plurality of mass spectrometry imaging images, at least one of which is deformed by the image deformation function unit;
It is characterized by operating.

For example, in an imaging mass spectrometer (imaging mass microscope) disclosed in Non-Patent Document 1, an imaging mass spectrometer and an optical microscope are integrated, and sample morphology observation and mass spectrometry are performed by a single device. Yes. When such an apparatus is used, it is possible to acquire an optical microscopic image and a mass spectrometry imaging image in which the positions of the same parts on the sample are aligned. In addition, even when the imaging mass spectrometer and the optical microscope are not integrated, they are usually prepared separately from the imaging mass spectrometer to determine the measurement range of the object to be subjected to imaging mass analysis on the sample. An optical microscope image on the sample is taken with an optical microscope. In this case, the position of the same part on the sample should be aligned in the optical microscopic image and the mass spectrometry imaging image corresponding to the measurement range.

Even if a specific region or tissue structure on the sample cannot be identified on the mass spectrometry imaging image, the specific region or tissue structure on the sample appears relatively clearly in the optical microscopic image. . Therefore, in the data processing method realized by the data processing program according to the first aspect of the present invention, when a plurality of mass spectrometry imaging images to be superimposed are selected by the user in the image selection step, In the optical microscopic image acquisition step, optical microscopic images of a plurality of samples respectively corresponding to the selected plurality of mass spectrometry imaging images are acquired. In the image alignment step, the same or mutually similar parts (tissue structure, etc.) between the optical microscopic images of the plurality of samples from which the plurality of mass spectrometry imaging images to be subjected to the overlay process are obtained. In the image deformation information acquisition step, image deformation information for one or a plurality of images is acquired in the image deformation information acquisition step.

In general, when performing alignment between a plurality of optical microscopic images, if any one of the images is used as a reference and other images are deformed so that the position matches the reference image. Good. For image alignment, for example, an image registration technique used in the medical field can be used. Here, “deformation” includes both linear deformation and non-linear deformation such as movement, rotation, enlargement / reduction, and the like of an image.

As described above, if the position of the same part on the sample is matched between the optical microscopic image and the mass spectrometry imaging image of one sample, the deformation information obtained for the optical microscopic image is obtained by a plurality of masses. It can be used as it is for alignment between analytical imaging images. Therefore, in the deformation information image deformation step, the deformation information is applied to a plurality of mass spectrometry imaging images to be superimposed to deform at least one of the images. As a result, regardless of the pattern of the original mass spectrometry imaging image, the positions of the plurality of mass spectrometry imaging images to be superimposed are substantially aligned. In the image superimposition processing step, a plurality of mass spectrometry imaging images in such a state are superimposed, thereby creating a superimposed image that can compare, for example, distributions of predetermined components.

The data processing method according to the second aspect of the present invention, which has been made to solve the above problems, is an imaging mass spectrometry for processing mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample. A data processing method in which a mass spectrometric imaging image created based on mass spectrometric data obtained for one of a plurality of samples whose parts to be observed are the same or similar to each other; A data processing method for performing a process of superimposing a reference image obtained by a measurement or observation technique other than mass spectrometry on one,
a) an image selection step that allows the user to select one mass spectrometry imaging image that is the subject of the overlay process;
b) an optical microscopic image acquisition step for acquiring an optical microscopic image corresponding to the selected mass spectrometry imaging image;
c) Image alignment is performed between the acquired optical microscopic image and the reference image of the same sample so that one or a plurality of images are deformed and the same or similar parts are matched. An image alignment step;
d) an image deformation information acquisition step for acquiring image deformation information for one or more images at the time of image alignment;
e) an image deformation step of applying the acquired image deformation information to the mass spectrometry imaging image that is the object of the superimposition process to perform an image deformation process;
f) an image superposition processing step for performing superposition processing of the mass spectrometry imaging image deformed in the image deformation step and the reference image;
It is characterized by having.

The data processing program according to the second aspect of the present invention, which has been made to solve the above-mentioned problems, processes on the computer the mass spectrometry data respectively obtained at a plurality of measurement points in the measurement region on the sample. A data processing program for obtaining a mass spectrometry imaging image based on mass spectrometry data obtained for one of a plurality of samples and a measurement or observation technique other than mass spectrometry for the other one A data processing program for performing a process of superimposing a reference image on a computer,
a) an image selection function unit that allows the user to select one mass spectrometry imaging image that is the target of the overlay process;
b) an optical microscopic image acquisition function unit for acquiring an optical microscopic image corresponding to the selected mass spectrometry imaging image;
c) Image alignment is performed between the acquired optical microscopic image and the reference image of the same sample so that one or a plurality of images are deformed and the same or similar parts are matched. An image alignment function,
d) an image deformation information acquisition function unit for acquiring image deformation information about one or more images at the time of image alignment;
e) an image deformation function unit that applies image deformation information acquired by the image deformation information acquisition function unit to a mass spectrometry imaging image that is an object of the superposition process, and performs image deformation processing;
f) an image superimposition processing function unit that performs superposition processing of the mass spectrometry imaging image deformed by the image deformation function unit and the reference image;
It is characterized by operating.

In the data processing method and data processing program of the second aspect, the reference image can be obtained by various methods as long as the shape such as the contour or pattern of the site such as the tissue structure on the sample can be observed to some extent clearly. Can be used. Typically, this is a stained image, but in some cases, Raman spectroscopy measurement or measurement and absorption of electromagnetic wave emission intensity of various wavelengths (terahertz, far-infrared, visible, ultraviolet, X-ray, etc.) Obtained by various measurements and observations such as PET (Positron Emission Tomography) measurement, MRI (Magnetic Resonance Imaging) measurement, ESR (Electron Spin Resonance) measurement, CT (Computed Tomography) measurement, etc. Can be used as a reference image.

Since such a reference image can be used to obtain image deformation information in the same manner as an optical microscopic image, image deformation information is obtained from an optical microscopic image of one sample and a reference image of another sample. If the mass spectrometry imaging image corresponding to the optical microscopic image is deformed by using, the mass spectrometry imaging image and the reference image can be aligned.

In addition, in the Raman microscopic imaging apparatus and the infrared microscopic imaging apparatus, in addition to the Raman microscopic imaging image or the infrared microscopic imaging image on the sample, a general optical microscopic image can be obtained together with the imaging mass spectrometer. . Therefore, images are aligned using the optical microscopic image obtained at the time of Raman microscopic imaging measurement or infrared microscopic imaging measurement and the optical microscopic image obtained at the time of mass spectrometry imaging. The deformation information can be used for alignment between the mass spectrometry imaging image and the Raman microscopic imaging image or the infrared microscopic imaging image.

That is, the data processing method according to the third aspect of the present invention is a data processing method in imaging mass spectrometry that processes mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample, and is an observation target. A mass spectrometry imaging image created based on mass spectrometry data obtained for one of a plurality of samples having the same or similar site, and an imaging measurement other than imaging mass spectrometry for the other Other than mass spectrometry imaging images and imaging mass spectrometry, which is performed by superimposing the second imaging image obtained by the technique, or created based on the mass spectrometry data obtained for the same observation target part of one sample Data for processing to superimpose the second imaging image obtained by the imaging measurement method of A management method,
a) an image selection step that allows the user to select one mass spectrometry imaging image and a second imaging image that are to be superposed;
b) an optical microscopic image acquisition step of acquiring optical microscopic images respectively corresponding to the selected mass spectrometry imaging image and the second imaging image;
c) an image alignment step for aligning images so that the same or similar parts on the sample match between the two acquired optical microscopic images;
d) an image deformation information acquisition step for acquiring image deformation information for one or more images at the time of alignment;
e) an image deformation step of applying at least one image deformation process by applying the image deformation information to the mass spectrometry imaging image and the second imaging image to be subjected to the superposition process;
f) an image superimposition processing step for performing superimposition processing of the mass spectrometry imaging image and the second imaging image, at least one of which is deformed in the image deformation step;
It is characterized by having.

The data processing program according to the third aspect of the present invention is a data processing program for processing, on a computer, mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample. Mass spectrometric imaging image created based on mass spectrometric data obtained for one of multiple samples of the same or similar target site, and imaging other than imaging mass spectrometric analysis for the other A mass spectrometric imaging image and an imaging mass spectrometric process that are performed by superimposing the second imaging image obtained by the measurement technique or that are created based on the mass spectrometric data obtained for the same observation target part of one sample To superimpose a second imaging image obtained by an imaging measurement technique other than A chromatography data processing program, the computer,
a) an image selection function unit that allows a user to select one mass spectrometry imaging image and a second imaging image that are to be superposed;
b) an optical microscopic image acquisition function unit for acquiring optical microscopic images respectively corresponding to the selected mass spectrometry imaging image and the second imaging image;
c) an image alignment function unit that aligns images so that the same or similar parts on the sample match between the two acquired optical microscopic images;
d) an image deformation information acquisition function unit for acquiring image deformation information about one or more images at the time of alignment;
e) an image deformation function unit that applies at least one image deformation process by applying the image deformation information to the mass spectrometry imaging image and the second imaging image that are targets of the superposition process;
f) an image superposition processing function unit that performs superposition processing of the mass spectrometry imaging image deformed by the image deformation function unit and the second imaging image;
It is characterized by operating.

Here, the second imaging image is an imaging image obtained by a technique other than mass spectrometry, such as a Raman microscopic imaging image or an infrared microscopic imaging image.
According to the third aspect, an image obtained by accurately superimposing a mass spectrometry imaging image, a Raman microscopic imaging image, an infrared microscopic imaging image, and the like can be created. Can be provided to the user.

In the data processing methods according to the first to third aspects of the present invention, the plurality of samples from which a plurality of mass spectrometry imaging images to be superimposed can be obtained from different individuals. If the parts to be observed are not the same or similar to each other, it is meaningless to perform the overlay process substantially.
In this respect, in the data processing methods according to the first to third aspects of the present invention, the plurality of samples may be slice samples continuously cut out from one living tissue of one individual.

According to the data processing method and data processing program in imaging mass spectrometry according to the present invention, a plurality of mass spectrometry imaging images respectively obtained from different samples, a superposition of a stained image and the like and a mass spectrometry imaging image, Or, when superimposing a mass spectrometry imaging image with a Raman microscopic imaging image, an infrared microscopic imaging image, or the like, the same part or tissue structure on different samples or one sample is as much as possible in the same position or shape. As described above, highly accurate positioning can be performed easily, that is, while omitting complicated manual work by the user. Thereby, the images can be efficiently superimposed, and the burden on the user for such work is reduced.

BRIEF DESCRIPTION OF THE DRAWINGS The schematic block diagram of one Example of the imaging mass spectrometer for enforcing the data processing method in the imaging mass spectrometry which concerns on this invention. 6 is a flowchart for creating a characteristic superimposed image in the imaging mass spectrometer of the present embodiment. The conceptual diagram for demonstrating the superimposition image creation process shown in FIG. The conceptual diagram of the measurement area | region on the sample in the imaging mass spectrometer of a present Example. The conceptual diagram of the section | slice sample cut out continuously from a biological tissue. The conceptual diagram for demonstrating the process in the case of superimposing a dyeing | staining image and MS imaging image using the imaging mass spectrometer of a present Example. The conceptual diagram at the time of creating the three-dimensional distribution image of a specific compound. The conceptual diagram for demonstrating the process in the case of superimposing a Raman microscopic imaging image and MS imaging image using the imaging mass spectrometer of a present Example.

Hereinafter, an embodiment of a data processing method in imaging mass spectrometry according to the present invention will be described with reference to the accompanying drawings.

FIG. 1 is a schematic configuration diagram of an embodiment of an imaging mass spectrometer for carrying out a data processing method according to the present invention.
The imaging mass spectrometer of the present embodiment includes an imaging mass spectrometer 1, an optical microscope observation unit 2, a data processing unit 3, an operation unit 4, and a display unit 5. The operation unit 4 and the display unit 5 are user interfaces.

Although not shown, the imaging mass spectrometer 1 includes, for example, a matrix-assisted laser desorption ionization ion trap time-of-flight mass spectrometer (MALDI-IT-TOFMS), and a two-dimensional measurement region on a sample 6 such as a biological tissue section. The mass spectrum data of each of a large number of measurement points (small regions) can be acquired. This mass spectrum data also includes MS ⁿ spectrum data in which n is 2 or more. On the other hand, the optical microscope observation unit 2 acquires an optical microscope image in a range including at least a measurement region on the sample 6.

The data processing unit 3 receives the mass spectrum data at each measurement point collected by the imaging mass spectrometry unit 1 and the optical microscopic image data obtained by imaging by the optical microscopic observation unit 2, and performs a predetermined process. Optical image data storage unit 30, MS imaging data storage unit 31, optical image creation unit 32, MS imaging image creation unit 33, image alignment processing unit 34, image deformation information storage unit 35, MS imaging image adjustment unit 36, image superposition Functional blocks such as an alignment processing unit 37 and an image display processing unit 38 are provided.

In general, the substance of the data processing unit 3 is a personal computer (or a higher-performance workstation). By operating dedicated software (that is, a computer program) installed in the computer on the computer, The function of the block is achieved.

In this example, as in the apparatus disclosed in Non-Patent Document 1, the imaging mass spectrometer 1 and the optical microscope observation section 2 are integrated, that is, a sample set at a predetermined position of the apparatus. 6 is an apparatus that moves between the measurement position by the imaging mass spectrometry unit 1 and the imaging position by the optical microscope observation unit 2 automatically or in response to a manual operation. The imaging mass spectrometer 1 and the optical microscope observation unit 2 may not be integrated.

As an example, as shown in FIG. 5, different types of matrixes are applied to a plurality of slice samples continuously cut out from one living tissue, and each is subjected to imaging mass spectrometry. Consider the case where MS imaging images are superimposed. In such a plurality of slice samples, it can be considered that the size and shape of the biological tissue appearing in each sample are substantially the same.

First, the operation when acquiring MS imaging data and optical microscopic image data for one sample 6 in the imaging mass spectrometer of the present embodiment will be described.

The user sets a sample 6 placed on a dedicated plate and not coated with a matrix at a predetermined position of the apparatus, and performs a predetermined operation with the operation unit 4. Then, the optical microscope observation unit 2 takes an optical microscope image on the sample 6 and displays the image on the screen of the display unit 5. The user confirms this image, determines a measurement region to be subjected to imaging mass spectrometry on the sample 6, and designates the measurement region by setting a frame surrounding the measurement region on the screen by the operation unit 4, for example. Thereby, for example, as shown in FIG. 4, a measurement region 60 is set on a sample 6 derived from a living body such as a mouse liver slice. At this time, the optical microscopic image data obtained by photographing the sample 6 is stored in the optical image data storage unit 30 together with information for specifying the position of the measurement region 60.

The user once removes the plate on which the sample 6 is placed from the apparatus, applies an appropriate matrix to the surface of the sample 6, and then returns the plate to the apparatus. Then, the operation unit 4 instructs execution of mass spectrometry. Then, as shown in FIG. 4, the imaging mass spectrometer 1 performs mass analysis (or MS ⁿ analysis) on each of a large number of measurement points 61 within the range of the measurement region 60 set as described above. Acquire mass spectral data over the m / z range. As a result, a set of mass spectrum data corresponding to the number of measurement points 61 in the measurement region 60 (hereinafter referred to as “MS imaging data”) is obtained, and this data is transferred from the imaging mass analyzer 1 to the data processor 3. The data is input and stored in the MS imaging data storage unit 31.

Thus, the optical microscopic image data and MS imaging data for one sample 6 are stored in association with the optical image data storage unit 30 and the MS imaging data storage unit 31. Then, as described above, measurement is similarly performed on the plurality of samples 6 cut out from one living tissue, and optical microscopic image data and MS imaging data are collected.

It should be noted that optical microscopic observation may be performed after applying the matrix on the sample 6, but in general, when the matrix is applied, the color or pattern of the tissue on the sample 6 becomes difficult to see. Therefore, generally, a clear optical microscopic image on the sample 6 is acquired prior to the matrix coating, and the measurement region 60 is determined using the image.

Next, data processing is performed in a state where MS imaging data and optical microscopic image data for a plurality of samples (continuous section samples) are stored in the MS imaging data storage unit 31 and the optical image data storage unit 30 as described above. Characteristic data processing executed in the unit 3 will be described with reference to FIGS. FIG. 2 is a flowchart showing the procedure of the data processing, and FIG. 3 is a conceptual diagram for explaining the data processing.

The user designates a plurality of MS imaging images to be subjected to the overlay process by the operation unit 4 (step S1). Specifically, one MS imaging image can be designated by information (for example, serial numbers assigned to a plurality of samples) and m / values that specify the sample. Although it is possible to designate the superimposition processing of three or more MS imaging images, for the sake of simplicity of explanation, a case where two MS imaging images are designated will be described here. As an example, as shown in FIG. 3, it is assumed that the MS imaging image of sample A at m / z = M1 and the MS imaging image of sample B at m / z = M1 are designated as objects to be superimposed.

In response to the designation in step S1, the optical image creating unit 32 is an optical microscopic image in the measurement region corresponding to each of the designated MS imaging images, that is, an optical microscopic image in the almost same measurement region of the sample A and the sample B. The optical microscopic image data constituting the image is read out from the optical image data storage unit 30 (step S2). At this time, the optical image creation unit 32 may create an optical microscopic image from the read optical microscopic image data and display it on the screen of the display unit 5.

The image alignment processing unit 34 executes alignment processing according to a predetermined algorithm so that the position, size, and shape of the same part are aligned between the two optical microscopic images. For this alignment process, for example, an image registration technique widely used in the medical field can be used. Image registration technology can be broadly divided into linear registration that performs alignment by translation, rotation, and enlargement / reduction, and two-dimensional lattice points on the image, and the lattice points can be moved freely. Nonlinear registration (for example, FFD (Free Form Deformation) method, etc.) for performing alignment is used, but it is preferable to use a combination of these. Of course, the method of alignment processing is not limited to this.

In any case, in such an alignment process, image deformation information for translating, rotating, enlarging / reducing, non-linear deformation, etc. of an image when one image is used as a reference and the other image is matched with the reference image is provided. can get. Therefore, the image deformation information is stored in the image deformation information storage unit 35 as image deformation information for alignment between the sample A and the sample B (step S3).

Next, the MS imaging image creation unit 33 reads out MS imaging data constituting the plurality of MS imaging images specified in Step S1 from the MS imaging data storage unit 31 (Step S4). Then, the MS imaging image adjustment unit 36 reads image deformation information for alignment between the sample A and the sample B from the image deformation information storage unit 35, and uses the image deformation information to read the plurality of MS imaging images. Image processing for deforming one of these is performed (step S5). That is, here, regardless of the pattern of the MS imaging image, the image is appropriately moved, rotated, enlarged / reduced, or nonlinearly deformed based on the given image deformation information. If the accuracy of the alignment performed in step S3 is high and the positional deviation between the optical microscopic image and the MS imaging image is negligible in each sample, the same parts of the MS imaging images after image deformation are located at substantially the same position. , Become size and shape. That is, alignment of a plurality of MS imaging images is realized with high accuracy by image deformation.

The image superimposing processing unit 37 superimposes the MS imaging images that have undergone image deformation for alignment in step S5, so that the two-dimensional distribution of the ion intensity of the sample A m / z = M1 and the sample B An image in which the two-dimensional distribution of the ion intensity of m / z = M1 overlaps is created (step S6). Each distribution of ionic strength is depicted in different colors that are easily distinguishable from each other. Then, the image display processing unit 38 displays the created superimposed image on the screen of the display unit 5 (step S7).

In this manner, the imaging mass spectrometer of the present embodiment performs high-precision alignment between the MS imaging image of the sample A at an arbitrary m / z value and the MS imaging image of the sample B at an arbitrary m / z value. In addition, a superimposed image can be created.

The above embodiment is an overlay of two MS imaging images, but the same may be applied to an overlay of three or more MS imaging images. That is, image deformation information of another optical microscopic image based on one optical microscopic image may be obtained, and a plurality of MS imaging images may be processed using the image deformation information.

In addition, MS imaging derived from a continuous section sample cut from one living tissue is not an image, but MS imaging derived from a sample cut from the same living tissue of another individual (for example, another mouse). The same process can be applied when images are superimposed.

Further, as shown in FIG. 5, imaging mass spectrometry is performed on each of a large number of section samples continuously cut out from the living tissue, and as shown in FIG. 7, the three-dimensional MS imaging image at a specific m / z value is obtained. By performing superimposing, a three-dimensional distribution image of a specific compound can be created.

In the imaging mass spectrometer of the above embodiment, the image deformation information is obtained by aligning the optical microscopic images in order to superimpose the MS imaging images, but obtained by a technique other than the MS imaging image and mass spectrometry. A similar method can be used when superimposing other images.

Specifically, a stained image by HE staining or the like is acquired for one of the continuous section samples, and imaging mass spectrometry is performed for the other one, and MS imaging at an arbitrary m / z value created by the imaging mass spectrometry is performed. There are cases where it is desired to superimpose an image and a stained image. FIG. 6 is a conceptual diagram for explaining processing in the case of superimposing one stained image and one MS imaging image. In general, a stained image is observed in such a manner that a specific tissue, a specific substance, or the like is stained and can be distinguished from others. However, the shape of other parts can be observed sufficiently clearly.

Therefore, in this case, the alignment based on the stained image is performed between the optical microscopic image of sample A and the stained image of sample B from which the MS imaging image with m / z = M1 to be superimposed is obtained. Try. Then, image deformation information based on the alignment is acquired. Then, using this image deformation information, the MS imaging image of sample A at m / z = M1 is deformed. Then, an image is created by superimposing the MS imaging image and the stained image after the image deformation.

If it is an image that can be observed to some extent clearly, such as the outline and pattern of the tissue structure on the sample, it is not a stained image but an image obtained by another measurement or observation and an MS imaging image. In some cases, the same technique can be used.

In general, an apparatus capable of imaging measurement, such as a Raman microscopic imaging apparatus or an infrared microscopic imaging apparatus, can acquire an optical microscopic image of a site on a sample to be imaged, similar to an imaging mass spectrometer. Therefore, processing according to the conceptual diagram shown in FIG. 8 obtained by modifying FIG. 3 may be performed.

That is, for example, for the same part of the same sample, an optical microscopic image obtained with a Raman microscopic imaging measuring device and an optical obtained with an imaging mass spectrometer (or obtained with another optical microscope for performing mass spectroscopic imaging) Position alignment is performed with the microscopic image, and image deformation information is acquired based on the position alignment. Then, using this image deformation information, one or both of the MS imaging image or the Raman microscopic imaging image of the sample is deformed. Then, an image is created by superimposing the MS imaging image and the Raman microscopic imaging image after the image deformation.
In this way, it is possible to accurately align imaging images obtained by different measurement techniques and create a superimposed image. Such a method is suitable for multi-modality.

Further, the above-described embodiment is merely an example of the present invention, and it is obvious that any change, correction, or addition as appropriate within the scope of the present invention is included in the scope of the claims of the present application.

DESCRIPTION OF SYMBOLS 1 ... Imaging mass spectrometry part 2 ... Optical microscope observation part 3 ... Data processing part 30 ... Optical image data storage part 31 ... MS imaging data storage part 32 ... Optical image creation part 33 ... MS imaging image creation part 34 ... Image alignment process Unit 35 ... Image deformation information storage unit 36 ... MS imaging image adjustment unit 37 ... Image superposition processing unit 38 ... Image display processing unit 4 ... Operation unit 5 ... Display unit 6 ... Sample

Claims

A data processing method in imaging mass spectrometry that processes mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample, and each of a plurality of samples whose parts to be observed are the same or similar to each other A data processing method for performing a process of superimposing a plurality of mass spectrometry imaging images created based on obtained mass spectrometry data,
a) an image selection step for allowing the user to select a plurality of mass spectrometry imaging images to be subjected to superposition processing;
b) an optical microscopic image acquisition step for acquiring optical microscopic images for a plurality of samples respectively corresponding to the selected plurality of mass spectrometry imaging images;
c) an image alignment step for aligning the images so that the same or similar parts coincide with each other while deforming one or a plurality of images among the plurality of obtained optical microscopic images;
d) an image deformation information acquisition step for acquiring image deformation information for one or more images at the time of image alignment;
e) an image deformation step of performing deformation processing of at least one image by applying the image deformation information acquired in the image deformation information acquisition step to a plurality of mass spectrometry imaging images that are targets of the superposition processing;
f) an image superposition processing step for performing superposition processing of the plurality of mass spectrometry imaging images at least one of which has been deformed in the image deformation step;
A data processing method in imaging mass spectrometry, comprising:
A data processing method in imaging mass spectrometry according to claim 1,
The data processing method in imaging mass spectrometry, wherein the plurality of samples are section samples continuously cut from one living tissue of one individual.
A data processing program for processing, on a computer, mass spectrometry data obtained at a plurality of measurement points in a measurement region on a sample, and created based on the mass spectrometry data obtained for each of a plurality of samples. A data processing program for performing a process of superimposing a plurality of mass spectrometry imaging images, comprising:
a) an image selection function unit that allows a user to select a plurality of mass spectrometry imaging images to be subjected to superposition processing;
b) an optical microscopic image acquisition function unit for acquiring optical microscopic images for a plurality of samples respectively corresponding to the selected plurality of mass spectrometry imaging images;
c) an image alignment function unit that aligns images so that the same or similar parts match while deforming one or a plurality of images among a plurality of acquired optical microscopic images;
d) an image deformation information acquisition function unit for acquiring image deformation information about one or more images at the time of image alignment;
e) an image deformation function unit that applies at least one image deformation process by applying the acquired image deformation information to a plurality of mass spectrometry imaging images to be subjected to the superposition process;
f) an image superposition processing function unit that performs superposition processing of the plurality of mass spectrometry imaging images, at least one of which is deformed by the image deformation function unit;
A data processing program characterized by being operated.
A data processing method in imaging mass spectrometry that processes mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample, and among the plurality of samples whose parts to be observed are the same or similar to each other Data processing for processing to superimpose a mass spectrometry imaging image created based on mass spectrometry data obtained for one of the images and a reference image obtained by a measurement or observation technique other than mass spectrometry for the other A method,
a) an image selection step that allows the user to select one mass spectrometry imaging image that is the subject of the overlay process;
b) an optical microscopic image acquisition step for acquiring an optical microscopic image corresponding to the selected mass spectrometry imaging image;
c) Image alignment is performed between the acquired optical microscopic image and the reference image of the same sample so that one or a plurality of images are deformed and the same or similar parts are matched. An image alignment step;
d) an image deformation information acquisition step for acquiring image deformation information for one or more images at the time of image alignment;
e) an image deformation step of applying the acquired image deformation information to the mass spectrometry imaging image that is the object of the superimposition process to perform an image deformation process;
f) an image superposition processing step for performing superposition processing of the mass spectrometry imaging image deformed in the image deformation step and the reference image;
A data processing method in imaging mass spectrometry, comprising:
A data processing method in imaging mass spectrometry according to claim 4,
The data processing method in imaging mass spectrometry, wherein the plurality of samples are section samples continuously cut from one living tissue of one individual.
A data processing program for processing, on a computer, mass spectrometry data obtained at a plurality of measurement points in a measurement region on a sample, based on mass spectrometry data obtained for one of a plurality of samples. A data processing program for performing a process of superimposing a mass spectrometry imaging image created on a reference image obtained by a measurement or observation technique other than mass spectrometry for another one,
a) an image selection function unit that allows the user to select one mass spectrometry imaging image that is the target of the overlay process;
b) an optical microscopic image acquisition function unit for acquiring an optical microscopic image corresponding to the selected mass spectrometry imaging image;
c) Image alignment is performed between the acquired optical microscopic image and the reference image of the same sample so that one or a plurality of images are deformed and the same or similar parts are matched. An image alignment function,
d) an image deformation information acquisition function unit for acquiring image deformation information about one or more images at the time of image alignment;
e) an image deformation function unit that applies image deformation information acquired by the image deformation information acquisition function unit to a mass spectrometry imaging image that is an object of the superposition process, and performs image deformation processing;
f) an image superimposition processing function unit that performs superposition processing of the mass spectrometry imaging image deformed by the image deformation function unit and the reference image;
A data processing program characterized by being operated.
A data processing method in imaging mass spectrometry that processes mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample, and among the plurality of samples whose parts to be observed are the same or similar to each other A process of superimposing a mass spectrometry imaging image created based on the mass spectrometry data obtained for one of the images and a second imaging image obtained by an imaging measurement technique other than imaging mass spectrometry for the other A mass spectrometry imaging image that is performed or created based on mass spectrometry data obtained for the same observation target part of one sample is overlaid with a second imaging image obtained by an imaging measurement technique other than imaging mass spectrometry. A data processing method for performing a matching process,
a) an image selection step that allows the user to select one mass spectrometry imaging image and a second imaging image that are to be superposed;
b) an optical microscopic image acquisition step of acquiring optical microscopic images respectively corresponding to the selected mass spectrometry imaging image and the second imaging image;
c) an image alignment step for aligning images so that the same or similar parts on the sample match between the two acquired optical microscopic images;
d) an image deformation information acquisition step for acquiring image deformation information for one or more images at the time of alignment;
e) an image deformation step of applying at least one image deformation process by applying the image deformation information to the mass spectrometry imaging image and the second imaging image to be subjected to the superposition process;
f) an image superimposition processing step for performing superimposition processing of the mass spectrometry imaging image and the second imaging image, at least one of which is deformed in the image deformation step;
A data processing method in imaging mass spectrometry, comprising:
A data processing program for processing on a computer mass spectrometry data respectively obtained at a plurality of measurement points in a measurement region on a sample, and for a plurality of samples having the same or similar parts to be observed. A process of superimposing a mass spectrometry imaging image created based on mass spectrometry data obtained for one of them and a second imaging image obtained by an imaging measurement technique other than imaging mass spectrometry for the other one Or a mass spectrometry imaging image created based on mass spectrometry data obtained for the same observation target part of one sample and a second imaging image obtained by an imaging measurement technique other than imaging mass spectrometry. A data processing program for performing superimposition processing, wherein a computer is
a) an image selection function unit that allows a user to select one mass spectrometry imaging image and a second imaging image that are to be superposed;
b) an optical microscopic image acquisition function unit for acquiring optical microscopic images respectively corresponding to the selected mass spectrometry imaging image and the second imaging image;
c) an image alignment function unit that aligns images so that the same or similar parts on the sample match between the two acquired optical microscopic images;
d) an image deformation information acquisition function unit for acquiring image deformation information about one or more images at the time of alignment;
e) an image deformation function unit that applies at least one image deformation process by applying the image deformation information to the mass spectrometry imaging image and the second imaging image that are targets of the superposition process;
f) an image superposition processing function unit that performs superposition processing of the mass spectrometry imaging image deformed by the image deformation function unit and the second imaging image;
A data processing program characterized by being operated.