JP2012022437A - Image information display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily grasp relativity of position information between a plurality of images.SOLUTION: An image information display method includes: a first display process of displaying a reference image 1 of a sample including an ROI 3 having at least one coordinate axis, and at least one information display image 2 having a coordinate axis common to the at least one coordinate axis of the ROI 3 and represents information on the ROI 3; and a second display process of displaying a mark A' when an arbitrary position A of interest of the ROI 3 is indicated in one of the reference image 1 and information display image 2 displayed in the first display process, the mark A' specifying a position, corresponding to the position A of interest on the coordinate axis common to the one image, in other images.

Description

  The present invention relates to an image information display method.

  Conventionally, a scanning microscope apparatus that generates a three-dimensional specimen image is known (for example, see Patent Document 1). The scanning microscope apparatus described in Patent Document 1 obtains a three-dimensional reference image by stacking two-dimensional images of a specimen, displays a high-luminance portion from the reference image as a planar image, and indicates a site of interest. Then, the relative position in the Z-axis direction between the objective lens and the sample is continuously changed while two-dimensionally scanning the sample with laser light in accordance with the Z position movement course data and Z position movement speed data of the instructed target region. Thus, a three-dimensional specimen image is acquired. As a result, the time required for scanning is reduced as compared with the case of scanning the entire surface in the XYZ directions, the damage to the sample by the laser light is reduced, and scanning corresponding to the rapid change of the sample is realized.

JP 2005-24642 A

  However, in the scanning microscope apparatus described in Patent Document 1, the reference image is a three-dimensional image, whereas the image indicating the target region is a planar image. Therefore, the positional information is related between these images. There is a problem that it is difficult to grasp accurately.

  The present invention has been made in view of the above-described circumstances, and an object thereof is to provide an image information display method capable of easily grasping the relevance of position information between a plurality of images.

In order to solve the above problems, the present invention employs the following means.
The present invention relates to a reference image of a specimen including a region of interest having at least one coordinate axis, and at least one information display image having a coordinate axis common to at least one coordinate axis of the region of interest and displaying information on the region of interest. When an arbitrary attention position in the region of interest is indicated in any one of the reference image displayed in the first display step and the reference image displayed in the first display step and the information display image, another image is displayed. And a second display step of displaying a specific display for specifying a position corresponding to the target position on the coordinate axis common to any one of the images.

  According to the present invention, when an arbitrary attention position of a region of interest is indicated on the reference image by the second display step with respect to the reference image and the information display image displayed by the first display step, When a specific display for specifying a position corresponding to the position of interest on the coordinate axis common to the reference image is displayed, and when an arbitrary position of interest is indicated on the information display image, the coordinate axis common to the information display image in the reference image A specific display for specifying a position corresponding to the above noted position is displayed.

  That is, in the second display step, the position corresponding to the target position indicated on any one of the reference image and the information display image is related to the reference position on the basis of the common coordinate axis by the specific display. Displayed. Therefore, the relevance of the position information of the region of interest between the reference image and the information display image can be easily grasped.

In the above invention, the dimension of the reference image and the dimension of the information display image may be different from each other.
By displaying the attention position in any one image and the specific display of the corresponding corresponding position in the other image in association with each other by using a common coordinate axis as a reference, the images of different dimensions are interested. The relevance of the position information of the area can be accurately grasped.

  According to the present invention, it is possible to easily grasp the relevance of position information between a plurality of images.

It is a flowchart which shows the image information display process of the image information display method which concerns on one Embodiment of this invention. It is a figure which shows the reference image and information display image which link and display position information by the image information display method of FIG. It is a figure which shows the reference image of XY axis. It is a figure which shows a mode that the ROI of the free line was described on the reference image. It is a figure which shows the coordinate information of ROI of FIG. It is the figure which displayed the profile of the attention position on the monitor by the image display method which concerns on the 1st modification of one Embodiment of this invention. It is a figure which shows the profile of the brightness | luminance change with respect to the time axis of the reference image of FIG. 6, and an attention position. It is a figure which shows the reference image and information display image which display image information mutually linked | related by the image display method which concerns on the 2nd modification of one Embodiment of this invention.

Hereinafter, an image information display method according to an embodiment of the present invention will be described with reference to the drawings.
In the image information display method according to the present embodiment, as shown in FIG. 1, a reference image (reference image) of a specimen and an information display image that displays information on ROI (region of interest) of interest on the reference image are arranged in parallel. When an arbitrary attention position of the ROI is specified in one of the first display step SA1 to be displayed and either the reference image or the information display image, the corresponding position corresponding to the attention position is specified in the other information display image or reference image And a second display step SA2 for displaying a mark (specific display) to be performed.

  In the image information display method according to the present embodiment, for example, positional information is displayed in association with a plurality of images acquired by a known laser scanning microscope apparatus or the like. As a laser scanning microscope apparatus, for example, a stage on which a specimen is placed, a light source that emits laser light toward the specimen on the stage, and a galvanoscope that scans the specimen with laser light emitted from the light source two-dimensionally. A scanning unit such as a mirror, and the sample is irradiated with laser light scanned by the scanning unit, while an objective lens that collects return light returning from the sample, and partially passes through the return light collected by the objective lens A pinhole and a detector that detects return light that has passed through the pinhole and outputs an electrical signal corresponding to the light intensity. The pinhole is disposed at a position conjugate to the focal position of the objective lens.

  The laser scanning microscope apparatus also includes an A / D converter that performs A / D conversion on the electrical signal output from the detection unit, and image information based on the electrical signal that is output from the A / D converter. A CPU that controls the driving of the stage, light source, and scanning unit, a memory that stores image information generated by the CPU, a display unit such as a CRT display that displays the image information, and an operator Input devices such as a mouse and a keyboard that send instructions from the CPU to the CPU.

  In the image information display method according to the present embodiment, for example, a two-dimensional planar image of a specimen as shown in FIG. 2 generated by the operation of the CPU of the laser scanning microscope apparatus is used as the reference image 1. Further, the line scan image of ROI 3 selected by the operator on the reference image 1 is set as the information display image 2.

  The reference image 1 is an XY axis plane image. The information display image 2 is a planar image in which the scanning direction from one end to the other end of the ROI 3 is the X axis, and the time taken for one line scan is the T axis. The ROI 3 of the reference image 1 and the information display image 2 have the same X axis.

  In the first display step SA1, the reference image 1 and the information display image 2 generated by the CPU are displayed in parallel on the monitor 5.

  In the second display step SA2, when an arbitrary position of the ROI 3 is instructed on the reference image 1 by the operator using the mouse, a mark is displayed on the information display image 2 almost in synchronization with the instruction by the operation of the CPU. (Specific display) A 'is displayed. The mark A ′ on the information display image 2 is displayed as a line extending along the T-axis direction through the coordinate position on the X axis corresponding to the target position A of the reference image 1.

  On the other hand, when an arbitrary position is instructed on the information display image 2 by the operator using the mouse, the mark A ′ is displayed on the reference image 1 almost in synchronization with the instruction. The mark A ′ on the reference image 1 is displayed as a point at the coordinate position on the X axis of the ROI 3 corresponding to the target position A of the information display image 2.

The operation of the image information display method configured as described above will be described below with reference to the flowchart of FIG.
To display a plurality of positional information in association with each other by the image information display method according to the present embodiment, first, using a laser scanning microscope apparatus, for example, a reference image 1 and a reference of a specimen as shown in FIG. An information display image 2 for displaying the information of the ROI 3 on the image 1 is generated, and these images are displayed in parallel on the monitor 5 (step SA1).

  In order to generate the reference image 1, a sample is placed on the stage, and laser light is emitted from the light source. Then, the scanning unit scans the laser beam in a two-dimensional direction intersecting the optical axis, and irradiates the specimen with the objective lens. The return light returning from the sample irradiated with the laser light is collected by the objective lens, passes through the pinhole, and is detected by the detection unit.

  When return light is detected by the detection unit, the electrical signal is input to the CPU via the A / D conversion unit, and the CPU generates a two-dimensional reference image 1 of the sample as shown in FIG. In the figure, the horizontal axis of the reference image 1 indicates the X axis, and the vertical axis indicates the Y axis. The reference image 1 of the specimen generated by the CPU is stored in the memory and displayed on the monitor 5.

  Next, in order to generate the information display image 2, as shown in FIG. 4, the operator describes the ROI 3 in a free line on the reference image 1 using a mouse. When the ROI 3 is described on the reference image 1, the coordinate information is acquired by the operation of the CPU. When the ROI 3 is described as a free line, for example, as indicated by a symbol P in FIG. 5, the coordinate information is acquired by the CPU in units of one coordinate and one pixel.

  Subsequently, the ROI 3 coordinates acquired by the CPU are line-scanned a plurality of times from one end to the other end along the line. Thus, the information display image 2 is generated with the line direction of the ROI 3 as the X axis and the time for one line scan as the T axis. The horizontal axis of the information display image 2 indicates the X axis, and the vertical axis indicates the T axis. The information display image 2 generated by the CPU is displayed in parallel with the reference image 1 on the monitor 5 as shown in FIG.

Next, the positional information on the ROI 3 is displayed in association between the reference image 1 and the information display image 2 displayed on the monitor 5 in the first display step SA1 (step SA2).
Specifically, when the operator designates an arbitrary position of interest A of the ROI 3 on the reference image 1 using the mouse, the CPU operates to activate an X corresponding to the position of interest A of the reference image 1 in the information display image 2. A line-shaped mark A ′ that passes through the coordinate position on the axis and extends along the T-axis direction is displayed.

  If the instruction of the target position A is not changed (step SA3 “NO”), the display of the position information is ended. On the other hand, if the instruction of the target position A is changed (step SA3 “YES”), the process returns to step SA2. When the operator designates another attention position A of the ROI 3 on the reference image 1, a mark A ′ passing through the coordinate position on the X axis corresponding to the new attention position A is displayed in the information display image 2. .

  When the attention position A is designated on the reference image 1 in this way, the mark A ′ is displayed at the position corresponding to the attention position A in the information display image 2 in association with the X axis. Further, when the indication of the attention position A in the reference image 1 is changed to another position, the display on the information display image 2 is updated, and the mark A ′ is associated with the position corresponding to the new attention position A with reference to the X axis. Displayed.

  On the other hand, when the operator designates an arbitrary position of interest A on the information display image 2 using the mouse, the CPU operates to turn on the X axis of the ROI 3 corresponding to the position of interest A of the information display image 2 in the reference image 1. A point-shaped mark A ′ is displayed at the coordinate position. Similarly in this case, if the indication of the target position A on the information display image 2 is changed, the display on the reference image 1 is updated, and the mark A is placed at the coordinate position on the X axis of the ROI 3 corresponding to the new target position A. 'Is displayed.

  As described above, according to the image information display method according to the present embodiment, the corresponding position on the information display image 2 or the reference image 1 with respect to the target position A indicated on the reference image 1 or the information display image 2. By displaying the mark A ′ in association with the X axis as a reference, the relevance of the position information of the ROI 3 between both images can be easily grasped. If the indication of the attention position A on the reference image 1 or the information display image 2 is changed to another position, the display on the information display image 2 or the reference image 1 is changed to the mark A ′ corresponding to the new attention position A. By updating to, it is possible to always accurately grasp the relevance of the position information of the ROI 3 between both images.

  In this embodiment, for example, when the operator designates an arbitrary time, a point-like mark that displays the coordinate position at the designated time is displayed on the line-like mark A ′ of the information display image 2. It is good to do. In the present embodiment, the reference image 1 is generated by the detection unit and the CPU. However, instead of this, the reference image 1 may be generated using an imaging element such as a CCD.

This embodiment can be modified as follows.
As a first modification, for example, as shown in FIG. 6, when the target position A is indicated in the reference image 1, the luminance change with respect to the time axis of the target position A is displayed on the monitor 5 as a profile 15. It is good.

  In this case, for example, when the operator designates an arbitrary time, the coordinate position on the mark A ′ of the information display image 2 and the luminance value on the profile 15 at the designated time are displayed in association with each other by the line B. Also good. In addition, as shown in FIG. 7, the reference image 1 and the profile 15 may be displayed adjacent to each other on the monitor 5. By doing so, it is possible to easily grasp the luminance change with respect to the time axis of the target position A by the profile 15.

Further, as shown in FIG. 6, the luminance change with respect to the line direction of the ROI 3 of the reference image 1 (the X-axis direction of the information display image 2) may be displayed on the monitor 5 as a profile 17. In this case, for example, when the coordinate information of the ROI 3 on the reference image 1 is acquired by the CPU, the luminance information of the ROI 3 at time T = 0 may be displayed on the profile 17 first. When the operator designates an arbitrary time, the display of the profile 17 may be switched to the luminance information of the ROI 3 at the designated time.
When the target position A is designated on the reference image 1, as shown in the figure, the coordinate position on the X axis of the information display image 2 and the luminance value on the profile 17 are represented by a line mark A ′. May be displayed in association with each other.

  In the present embodiment, the information display image 2 is displayed on the monitor 5. For example, the reference image 1 and the profile 17 are displayed without displaying the information display image 2, and the reference image 1 and the profile 17 are displayed. It is good also as displaying the positional information of ROI3 between in direct association. In this case, when the operator specifies an arbitrary time, the luminance information of the ROI 3 at the specified time may be displayed on the profile 17. In addition, a point-like mark may be displayed on the luminance value on the X axis of the profile 17 corresponding to the target position A designated on the reference image 1.

  In the present embodiment, the XY-axis two-dimensional reference image 1 and the XT-axis two-dimensional information display image 2 are exemplified as the reference image, and the second modification is described. As an example, for example, position information may be displayed in association with each other between a reference image and an information display image having different dimensions. Further, the position information may be displayed in association with each other between one reference image and a plurality of information display images.

  For example, as shown in FIG. 8, a three-dimensional XYZ-axis image generated by a laser scanning microscope apparatus is used as a reference image (reference image) 11, and an XY-axis image of ROI 4 in the reference image 11 is a first image. The information display image 12 may be used, and the XZ-axis image of the ROI 4 in the reference image 1 may be used as the second information display image 13 so that the positional information is associated with each other and displayed.

In this case, for example, the operation of the CPU moves the stage position in the optical axis direction to change the laser beam condensing position in the depth direction, and the laser beam applied to the sample by the objective lens is scanned by the scanning unit. Scan in the direction crossing the optical axis above. Further, the return light returning from the sample irradiated with the laser light is detected by the detection unit through the objective lens and the pinhole, and the CPU detects each relative position (Z-axis direction) between the objective lens and the sample based on the electric signal. 2D image of the specimen at (position). These two-dimensional images are stacked in the optical axis direction (Z-axis direction) to generate a three-dimensional reference image 11 of the sample.
The reference image 11 generated by the CPU is displayed on the monitor 5 by the first display process SA1.

  Next, when the operator describes the long spherical ROI 4 including the sample on the reference image 11 using the mouse, the coordinate information of the described ROI 4 is acquired by the operation of the CPU. Then, a two-dimensional image at a desired Z position in the Z-axis direction (in this modification, a two-dimensional image at the tenth relative position between the objective lens and the specimen, Z = 10) is extracted as the first information display image 12. To do. In FIG. 8, the horizontal axis of the first information display image 12 indicates the X axis, and the vertical axis indicates the Y axis.

In addition, a two-dimensional second information display image 13 on the XZ axis of the designated long spherical ROI 4 is generated. In the figure, the horizontal axis of the second information display image 13 indicates the X axis, and the vertical axis indicates the Z axis. The reference image 11 and the information display images 12 and 13 have the same X axis.
The information display images 12 and 13 generated by the CPU are displayed side by side with the reference image 11 on the monitor 5 in the first display step SA1.

  Next, in the second display step SA2, when the operator designates an arbitrary attention position A of the ROI 4 on the reference image 11, the first information display image 12 corresponds to the attention position A of the reference image 11. A point-shaped mark A′-1 is displayed at the coordinate position of the X axis. Further, in the second information display image 13, a line-shaped mark A′-2 that passes through the coordinate position on the X axis corresponding to the target position A of the reference image 11 and extends along the T axis direction is displayed.

  On the other hand, when the operator designates an arbitrary attention position A in the first information display image 12 or the second information display image 13, the correspondence corresponding to the attention position A in the reference image 11 and the other information display images 12 and 13. Point-shaped or line-shaped marks are displayed at positions in association with the X axis.

According to this modification, the common position sharing the target position A in the reference image 11 with the mark A′-1 in the first information display image 12 and the mark A′-2 in the second information display image 13 is shared. By displaying the X axis in association with the reference, it is possible to easily and accurately grasp the position information of the ROI 4 even if the images have different dimensions.
In this modification, as shown in FIG. 8, the luminance change with respect to the Z axis of the target position A may be displayed by a profile 19.

As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included. For example, the present invention is not limited to those applied to the above-described one embodiment and modifications, but may be applied to embodiments in which these embodiments and modifications are appropriately combined, and is not particularly limited. Absent.
Further, in the present embodiment and the modification thereof, the ROI 3 described by a free line has been described as an example, but the shape of the ROI 3 may be, for example, a straight line, a circle, a rectangle, or the like. . Further, in the present embodiment and the modification thereof, the line-shaped marks A ′ and A′−2 and the point-shaped mark A′-1 have been exemplified and described as the specific display. As long as the position corresponding to the target position in other images can be identified, the present invention is not limited to this.

SA1 1st display process SA2 2nd display process 1,11 Reference image (reference image)
2 Information display image 3, 4 ROI (region of interest)
12 1st information display image 13 2nd information display image A Attention position A ', A'-1, A'-2 mark (specific display)

Claims (2)

A reference image of a sample including a region of interest having at least one coordinate axis, and at least one information display image having a coordinate axis common to at least one coordinate axis of the region of interest and displaying information on the region of interest. 1 display process;
When an arbitrary attention position of the region of interest is indicated in any one of the reference image and the information display image displayed in the first display step, the other image is common to the one image And a second display step of displaying a specific display for specifying a position corresponding to the target position on the coordinate axis.   The image information display method according to claim 1, wherein a dimension of the reference image and a dimension of the information display image are different from each other.

Images