JP2016096747A - Image processing device, image processing program, image processing method, and housing container of object to be observed - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device or the like which is capable of easily detecting a height of a cross-sectional position at which a slice image is captured.SOLUTION: An image processing device 30 comprises: an image data recording part 302 which acquires an observation image including a slice image of a fertilized egg housed in a housing container, which is captured by focusing the fertilized egg at a cross-sectional position orthogonal to a height direction and a marker image of a marker provided for the housing container; a marker image extraction part 321 which extracts the marker image from the observation image; a reference marker image recording part 303 in which a reference marker image obtained by capturing the marker while a distance between a reference position in a height direction and a focusing position of the imaging device is changed along a height direction is recorded; a similarity calculation part 322 which calculates similarity between an extracted marker image and each reference marker image; and a height detecting part 323 which detects a height of the slice image based on a reference marker image having the highest similarity.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an image processing apparatus, an image processing program and an image processing method used for observing cultured cells, for example, and an observation object storage container.

  In recent years, research has progressed in the field of cell culture including regenerative medicine and infertility treatment. At the same time, there is a technology for easily observing the culture state of cells collected from living bodies without affecting the cells. It is requested.

  For example, when a fertilized egg by in vitro fertilization is cultured, an operation for obtaining an observation image of the fertilized egg by observing the state of the fertilized egg in the culture container with a microscope at regular time intervals is performed. At this time, the position of the objective lens of the microscope in the optical axis direction (hereinafter referred to as the “height direction”) is adjusted, and the fertilized egg is imaged by focusing at the cross-sectional position where a desired observation image is obtained. An egg slice image is acquired.

  Conventionally, as an apparatus for acquiring this kind of observation image, an eyepiece, an objective lens, a stage on which a dish for accommodating the specimen is arranged, and a position in the height direction of the objective lens are adjusted to focus on the specimen. There is known a microscope apparatus including a focusing handle to be moved, a position detector that detects the height of the objective lens with respect to the stage, and a display controller that displays the detected height of the objective lens (for example, Patent Document 1).

  With this configuration, if the observer turns the focusing handle while observing the field of view with the eyepiece lens, the objective lens is focused at the desired cross-sectional position of the sample and a slice image is captured, the objective lens at that cross-sectional position is captured. Since the height is displayed on the display controller, it is possible to manage the slice image and the height of the cross-sectional position where the slice image is captured based on the height of the objective lens.

JP 2006-023487 A

  However, the apparatus described in Patent Document 1 requires a complicated operation in which an observer manually records the height of the objective lens when a slice image is captured. Therefore, there is a demand for an apparatus that can easily detect the height of a cross-sectional position where a slice image is captured.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an image processing apparatus and the like that can easily detect the height of a cross-sectional position where a slice image is captured. is there.

  In order to solve the above-described problems, the present invention captures an image acquired from an imaging apparatus that focuses and images an observation target object stored in a storage container at a predetermined cross-sectional position set in an axial direction different from the observation direction. An image processing device for processing, an observation image acquisition means for acquiring an observation image including a slice image of the observation object and a marker image of a marker provided in the storage container, which is focused at the cross-sectional position and imaged And a marker image extracting means for extracting the marker image from the observation image, and changing a predetermined distance between the reference position in the observation direction and the in-focus position of the imaging device along the observation direction. A distance-corresponding marker image recording unit that records a plurality of distance-corresponding marker images obtained by imaging the marker, the marker image extracted by the marker image extracting unit, and the distance correspondence A similarity calculation unit that calculates a similarity to each distance-corresponding marker image recorded in the maker image recording unit, and the slice image is captured from the reference position based on the distance-corresponding marker image having the highest similarity. Distance detecting means for detecting the distance to the cross-sectional position.

  With this configuration, the present invention acquires an observation image including a slice image of an observation object and a marker image of a marker provided on the storage container, and extracts a marker image extracted from the acquired observation image and each distance-corresponding marker recorded in advance. Since the distance from the reference position to the cross-sectional position where the slice image is captured can be detected based on the distance-corresponding marker image having the highest similarity to the image, the height of the cross-sectional position where the slice image is captured can be easily Can be detected accurately and accurately.

  The image processing apparatus of the present invention can easily and accurately detect the height of the cross-sectional position where the slice image is captured.

It is a block diagram which shows the structure of one Embodiment of the slice image position detection system which concerns on this invention. It is a figure which shows an example of the storage container used in the imaging device in the slice image position detection system of one Embodiment. It is a figure which shows an example of the observation image imaged with the imaging device in the slice image position detection system of one Embodiment. It is a block diagram which shows the structure of the image processing apparatus of one Embodiment. It is a figure which shows an example of the data containing the observation image recorded on the image data recording part in the slice image position detection system of one Embodiment. It is a figure for demonstrating the reference marker image recorded on the reference marker image recording part in the slice image position detection system of one Embodiment. It is a figure which shows an example which added the data of slice image height to the observation image in the image processing apparatus of one Embodiment. It is a flowchart which shows the operation | movement of the slice image height detection process performed in the image processing apparatus of one Embodiment. It is a figure which shows the modification of a marker in the modification of one Embodiment. It is a figure which shows what imaged the micro bead in the modification of one Embodiment, changing slice image height. It is explanatory drawing at the time of giving the identification function for identifying each well in the modification of one Embodiment to a marker. It is explanatory drawing at the time of adding well ID for every well which cultures a fertilized egg in the modification of one Embodiment, and managing a fertilized egg by the well ID. It is a figure which shows an example at the time of providing the marker in the storage container in the modification of one Embodiment.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In the following embodiments, an image processing apparatus, an image processing program, and an image processing according to the present invention are applied to a slice image position detection system that detects a position where a slice image of a cultured fertilized egg (embryo) is captured. It is embodiment at the time of applying the storage container of a method and an observation object. However, the present invention is not limited to the following embodiments as long as the technical idea is included.

[1] Outline of Image Processing Apparatus First, the configuration and outline of a slice image position detection system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a system configuration diagram showing the configuration of the slice image position detection system 1 in the present embodiment.

  The slice image position detection system 1 according to the present embodiment is a predetermined cross section perpendicular to the Z-axis direction perpendicular to the XY plane on which the target cell placed on a predetermined container such as a dish is placed. In this system, a slice image is picked up by focusing at a position, and the Z-axis direction position of the picked slice image is detected. The Z-axis direction corresponds to the observation direction according to the present invention, and is referred to as “height direction” in the following description. However, as will be described later, the cross-sectional position only needs to be set in an axial direction different from the Z-axis direction, and may not be set in a direction orthogonal to the Z-axis direction.

  For example, the cell to be observed includes a fertilized egg used for infertility treatment. In fertility treatment, generally, after collecting an egg and performing in vitro fertilization, the obtained fertilized egg is cultured in a predetermined container, and then developed to a suitable developmental stage and transplanted into the uterus. Has been done.

  In particular, after fertilization, two pronuclei that are the nuclei of the egg and sperm are formed in the ovum, and after the two pronuclei are fused, cell division occurs and cleavage occurs. Also, two days after fertilization, the fertilized egg goes through the 2-cell stage to the 4-cell stage, and 3 days after fertilization, the fertilized egg goes into the 8-cell stage. Furthermore, 4 days after fertilization, cell division further proceeds and each cell boundary becomes a morula that contacts each other, and 5 days after fertilization, the egg cell further divides into a blastocyst . And this blastocyst is comprised from the trophectoderm and the inner cell mass in the inside. In addition, there is an error of around several hours in each occurrence of cleavage, and observations that take this into account are necessary.

  On the other hand, in the process of transplanting fertilized eggs into the mother body for infertility treatment, in order to ensure reliable implantation and subsequent growth, the fertilized eggs are cultured for 2 to 5 days after fertilization, and then suitable for transplantation. Only fertilized eggs in good stages are selected and transplanted.

  In observing or photographing a fertilized egg, it is preferable to observe the central part of the fertilized egg. By observing the central part of the fertilized egg, the outer periphery of the fertilized egg is maximized in the cross section of the central part, and a wider range of internal structures can be observed. Therefore, in general, a slice image captured by focusing at the cross-sectional position of the central portion is used. However, since the diameters of fertilized eggs vary, recording the height of a cross-sectional position where a slice image with respect to a predetermined reference position is captured (hereinafter simply referred to as “slice image height”) is a slice. This is important in managing images.

  Therefore, in the present embodiment, a marker is provided in the vicinity of the well in which the fertilized egg is accommodated, and the slice image captured by focusing at a predetermined cross-sectional position of the fertilized egg is captured so that the marker image is included. The slice image height can be easily detected based on the marker image.

  Specifically, as illustrated in FIG. 1, the slice image position detection system 1 according to the present embodiment includes a marker image in a slice image obtained by focusing on a predetermined cross-sectional position of a fertilized egg and capturing the fertilized egg. Image processing device 10 capable of acquiring an observation image captured in a network, network 20, and image processing for extracting a marker image from the observation image and easily detecting a slice image height based on the extracted marker image And an image processing apparatus 30 for performing the above.

  The imaging device 10 is a device that has a communication function for connecting to the network 20 and exchanging data, an imaging function capable of acquiring an observation image, and a microscope function for observing a fertilized egg, for example.

  In particular, the imaging device 10 has a fertilized egg to be observed, which is placed in a dish well at a predetermined cross-sectional position at regular intervals (for example, every 6 minutes or 12 minutes) by an imaging function, An image including a marker provided in the vicinity of the outer edge of the well is generated as an observation image, and data of the generated observation image is transmitted to the image processing device 30.

  For example, the imaging apparatus 10 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates

  Further, when transmitting the observation image data to the image processing device 30, the imaging device 10 uses a predetermined communication standard such as a LAN (Local Area Network) or the like directly or via an access point (not shown). It has the structure which transmits to the image processing apparatus 30 by radio | wireless.

  The network 20 is constituted by, for example, a wired or wireless IP (Internet Protocol) network, or a public telephone line network including a mobile phone network or other networks.

  The image processing device 30 operates in conjunction with the imaging device 10 to extract a marker image from an observation image generated by the imaging device 10 and to perform image processing for detecting a slice image height based on the extracted marker image. It is a processing device.

Specifically, the image processing apparatus 30
(1) A plurality of reference marker images obtained by imaging a marker while changing a distance between a reference position in a predetermined height direction and a focus position of the imaging device 10 along the height direction are acquired and recorded in advance. Aside,
(2) Obtain and record an observation image from the imaging device 10,
(3) A marker image is extracted from the recorded observation image,
(4) calculating the similarity between the marker image extracted from the observed image and each reference marker image acquired in advance;
(5) detecting a height from a reference position to a cross-sectional position where the slice image is captured based on the reference marker image having the highest similarity;
Thus, the slice image height is detected (hereinafter referred to as “slice image height detection process”).

  The predetermined reference position in the Z-axis direction is an arbitrary position set by the user in the Z-axis direction. For example, for positioning of the well bottom surface, the dish bottom surface, the upper vertex of the fertilized egg, and the slice image The upper part of the marker 103 to be used (described later) can be exemplified.

  With such a configuration, the slice image position detection system 1 of the present embodiment can easily and accurately detect the slice image height.

[2] Storage Container Next, the configuration of the storage container used in the imaging device 10 of the present embodiment will be described with reference to FIG. FIG. 2 is a view showing an example of the storage container of the present embodiment, FIG. 2 (A) is a plan view of the storage container, and FIG. 2 (B) is shown in FIG. 2 (A). It is sectional drawing in the line segment AA.

  The storage container 101 of this embodiment is a well 102 that functions as a storage unit that stores an observation object as the fertilized egg 40, and a marker that is formed within a predetermined range from the outer edge of the well 102, and is fertilized. When the egg 40 is imaged, the marker 103 has a shape in which the marker imaged on the image imaged with the fertilized egg 40 (that is, on the slice image) changes according to the imaging position in the Z-axis direction. It has.

  Specifically, as illustrated in FIG. 2A, the storage container 101 includes a well 102 as a storage unit that stores the fertilized egg 40, and a marker 103 provided in the vicinity of the well 102. . The storage container 101 is generally a culture container for culturing cells and is called a dish, and is placed on the stage of the imaging apparatus 10.

  As shown in FIG. 2B, the well 102 is formed in a concave shape with respect to the surface 101a of the storage container 101, and has a bottom surface 102a and an outer edge 102b. In the present embodiment, the bottom surface 102a is used as a reference surface in the height direction. In the illustrated example, the height of the cross section 40a of the central portion of the fertilized egg 40 is indicated by the symbol h.

  The marker 103 is provided within a predetermined range from the outer edge 102 b of the well 102. Specifically, the marker 103 is provided in a range included in the imaging range of the fertilized egg 40 when the fertilized egg 40 is imaged at a predetermined magnification. In the present embodiment, the marker 103 has a cylindrical shape that is convex with respect to the surface 101 a of the storage container 101, in other words, a cylindrical shape that is convex along the height direction.

  When one well 102 shown in FIG. 2A is imaged by the imaging device 10, an observation image as shown in FIG. 3 is obtained. FIG. 3 is a diagram illustrating an example of an observation image captured by the imaging device 10 according to the present embodiment.

  As shown in FIG. 3, the observation image 50 includes a slice image 50 a of the fertilized egg 40 and a marker image 50 b of the marker 103. In FIG. 3, an image focused on the bottom surface of the well 102 is used as a substitute for the slice image 50a.

  The slice image 50a of the fertilized egg 40 is, for example, a slice image focused on the cross section 40a (see FIG. 2B) of the central portion of the fertilized egg 40 by the imaging device 10. Since the cross section 40a is focused, the marker 103 is not focused, and the marker image 50b is a defocused image.

[3] Image Processing Device Next, the configuration of the image processing device 30 in the present embodiment will be described with reference to FIGS. 4, 5, and 6.

  FIG. 4 is a block diagram illustrating a configuration of the image processing apparatus 30 according to the present embodiment. 5 is an example of data including an observation image recorded in the image data recording unit 302, and FIG. 6 is a diagram for explaining a reference marker image recorded in the reference marker image recording unit 303. .

  As shown in FIG. 4, the image processing apparatus 30 according to the present embodiment includes a data recording unit 300 that records various data used when various programs are executed, and an observation image transmitted from the imaging apparatus 10. It has a communication control unit 310 that exchanges various data such as data, and a data processing unit 320 that executes a slice image height detection process and the like from the acquired observation image.

  The image processing apparatus 30 according to the present embodiment includes a display unit 340 configured by a liquid crystal panel, a display control unit 350 that controls the display unit 340, an operation unit 370, and a management control unit 380 that controls each unit. ,have.

  Note that the above-described units are connected to each other via a bus 31, and data transfer is performed between the components.

  The data recording unit 300 is configured by, for example, an HDD (Hard Disc Drive) or the like, and is imaged by the application recording unit 301 in which an application program for executing each process such as a slice image height detection process is recorded, and the imaging apparatus 10. An image data recording unit 302 that records the generated observation image data, a reference marker image recording unit 303 that records a reference marker image, and a ROM / RAM 304 that is used as a work area during the execution of each program. Have. The image data recording unit 302 constitutes an observation image acquisition unit of the present invention. The reference marker image recording unit 303 constitutes a distance-corresponding marker image recording unit of the present invention.

In particular, an observation image acquired from the imaging apparatus 10 is recorded in the image data recording unit 302. For example, in the image data recording unit 302 of the present embodiment, as shown in FIG.
(1) Image name,
(2) storage container,
(3) a light source, and
(4) magnification,
The observation images associated with each are recorded.

  Specifically, the image name is set, for example, when the user operates the operation unit 370 or automatically in the imaging apparatus 10. The storage container, the light source, and the magnification are examples of the conditions for observing the fertilized egg. The magnification is shown. Information on these observation conditions is set by the user operating the operation unit 370 or automatically in the imaging apparatus 10 and recorded in the image data recording unit 302 together with the observation image.

  For example, in FIG. 5, the observation image with the image name A1 is captured under the observation condition that the storage container D3 is used, the light source at the time of imaging is L1, and the magnification at the time of imaging is 100 times. It has been shown.

  In FIG. 5, the five observation images of image names A1 to A5 and the observation conditions are collectively recorded in the image data recording unit 302. For example, one observation image for each image name and its observation image The observation conditions may be recorded in the image data recording unit 302. Moreover, as the observation conditions shown in FIG. 5, one or two of the exemplified observation conditions may be used, and other observation conditions may be added. Further, items other than those shown in FIG. 5, for example, time information when an observation image is captured may be added.

  The reference marker image recording unit 303 records a reference marker image acquired in advance from the imaging device 10. The reference marker image is an image serving as a reference for extracting the marker image from the observation image, and a predetermined reference position in the height direction (for example, the reference plane shown in FIG. 2B) and the imaging device 10 are used. It is the image which imaged the marker 103, changing the distance between focus positions along a height direction.

  In the present embodiment, for easy understanding, as shown in FIG. 6 (A), the height (the observation image position and illustration) at which the observation image is imaged is set to three types of 50 μm, 100 μm, and 150 μm. The marker image extracted from the image is used as the reference marker image. That is, in the reference marker image recording unit 303 in the present embodiment, as shown in FIG. 6B, the heights of 50 μm, 100 μm, and 150 μm obtained by capturing the observation image, and the reference marker images at the respective heights are stored. An associated reference marker image table is recorded. The reference marker image recorded in the reference marker image table corresponds to the distance corresponding marker image of the present invention.

  The ROM / RAM 304 stores various programs necessary for driving the image processing apparatus 30. In particular, various applications executed by the data processing unit 320 and the management control unit 380 are recorded in the ROM / RAM 304. The ROM / RAM 304 is used as a work area during execution of each program.

  The communication control unit 310 is a predetermined network interface, establishes a communication line with the imaging device 10, and exchanges various data acquired by the imaging device 10.

The data processing unit 320 is based on an application that executes slice image height detection processing recorded in the ROM / RAM 304.
(1) Processing for extracting a marker image from an observation image acquired from the imaging device 10 (hereinafter referred to as “marker image extraction processing”),
(2) Processing for calculating the similarity between the marker image extracted by the marker image extraction processing and each reference marker image included in the reference marker image table recorded in the reference marker image recording unit 303 (hereinafter referred to as “similarity”). Calculation process)),
(3) Processing for detecting the height from the reference position to the cross-sectional position at which the slice image is captured based on the reference marker image with the highest similarity among the similarities obtained in the similarity calculation processing ( Hereinafter, this is referred to as “distance detection processing”).
Execute.

  In particular, the data processing unit 320 executes a marker image extraction unit 321 that executes a marker image extraction process, a similarity calculation unit 322 that executes a similarity calculation process, and a height detection process by executing an application. A height detector 323.

  For example, the marker image extraction unit 321 of this embodiment constitutes a marker image extraction unit of the present invention, and the similarity calculation unit 322 constitutes a similarity calculation unit of the present invention. For example, the height detection unit 323 of the present embodiment constitutes a distance detection unit of the present invention.

  Details of each part of the data processing unit 320 in this embodiment will be described later.

  The display unit 340 is configured by a panel of a liquid crystal element or an EL (Electro Luminescence) element, and displays a predetermined image based on display data generated by the display control unit 350.

  The display control unit 350 generates drawing data necessary for causing the display unit 340 to draw a predetermined image under the control of the management control unit 380 and the data processing unit 320, and generates the generated drawing data on the display unit 340. Output.

  The operation unit 370 includes various buttons, operation buttons for inputting operation commands, and a number of keys such as a numeric keypad. The operation unit 370 includes a touch sensor provided on the display unit 340 and is used when performing each operation. It is like that.

  The management control unit 380 is mainly configured by a central processing unit (CPU), and performs overall management control of the image processing apparatus 30 and control of various other processes by executing a program.

[4] Data Processing Unit Next, details of the data processing unit 320 in the image processing apparatus 30 of the present embodiment will be described.

  The marker image extraction unit 321 reads a predetermined observation image from the image data recording unit 302 and executes a marker image extraction process for extracting a marker image from the read observation image.

  For example, the marker image extraction unit 321 can extract a marker image from the observation image using a pattern matching method that is a known technique. Specifically, the marker image extraction unit 321 prepares a plurality of standard patterns representing the contour of the marker 103 in advance, and sequentially compares partial regions of the observation image read from the image data recording unit 302 with each standard pattern. Then, the marker image can be extracted from the observation image by selecting the most similar region. The extracted marker image is, for example, an image as shown in the reference marker image in FIG.

  In consideration of extracting the marker image from the observation image 50, if the angle of view is set so that the position of the marker image with respect to the observation image is almost the same every time the observation device 10 captures the observation image, The marker image extraction process is facilitated, which is preferable. For example, as shown in FIG. 3, it is preferable to set the angle of view with the imaging device 10 so that the marker image is captured in the lower right region of the observation image 50.

  The similarity calculation unit 322 executes similarity calculation processing for calculating the similarity between the extracted marker image extracted by the marker image extraction unit 321 and the reference marker image recorded in the reference marker image recording unit 303.

  For example, the similarity calculation unit 322 uses a known technique that uses an average value of pixel values of both images, a technique that uses a histogram of pixel values, a technique that uses a correlation coefficient, and the like, The similarity with the reference marker image is calculated.

  The height detection unit 323 increases the distance from the reference position to the cross-sectional position where the slice image is captured based on the reference marker image with the highest similarity among the similarities calculated by the similarity calculation unit 322. A height detection process is detected.

  More specifically, referring to FIG. 6, as a result of calculating the similarity between the three reference marker images shown in FIG. 6B and the extracted marker image, the reference marker image shown in the center of FIG. 6B. When the similarity is the highest, the height detection unit 323 detects that the slice image included in the observation image together with the extracted marker image is captured at a height of 100 μm from the reference plane. To do. In this embodiment, as shown in FIG. 6B, the reference marker image has three heights at a 50 μm pitch, but the accuracy of the slice image height improves as the pitch is reduced. It is preferable to prepare a reference marker image with a pitch as narrow as possible.

  Further, the height detection unit 323 adds the detected slice image height data to the observation image shown in FIG. Specifically, the height detection unit 323 adds slice image height data to the observation image, for example, as shown by being surrounded by a dotted line in FIG. In FIG. 7, for example, the slice image with the image name A1 has a height of 50 μm, and the slice image with the image name A2 has a height of 100 μm. Note that the observation image to which the slice image height data is added is recorded in the image data recording unit 302.

  As another method for adding slice image height data to an observation image, for example, when observation image data is recorded one by one, the slice image height information is included in the file name. There is. Specifically, when the data file name of the observation image received from the imaging device 10 is “A1.jpg” and the slice image height is 50 μm, the file name of the observation image is, for example, “A1 — 050.jpg”. ”, The information on the slice image height can be included in the data file name of the observation image.

[5] Operation of Image Processing Device Next, an operation of slice image height detection processing executed in the image processing device 30 of the present embodiment will be described using FIG. FIG. 8 is a flowchart showing an operation of slice image height detection processing executed in the image processing apparatus 30.

  This operation is executed after the reference marker image is recorded in the reference marker image recording unit 303 of the image processing apparatus 30.

  First, when the image data recording unit 302 detects the user's observation image acquisition operation via the operation unit 370 (step S101), the image data recording unit 302 acquires an observation image from the imaging device 10 based on the detected operation (step S102). . This observation image includes a slice image and a marker image, for example, as shown in FIG.

  Next, the image data recording unit 302 records the acquired observation image (step S103).

  Next, the marker image extraction unit 321 reads an observation image designated by the user via the operation unit 370 from the image data recording unit 302, and extracts a marker image from the read observation image (step S104).

  Next, the similarity calculation unit 322 calculates the similarity between the extracted marker image extracted by the marker image extraction unit 321 and the reference marker image recorded in the reference marker image recording unit 303 (step S105).

  Next, the height detection unit 323 detects the slice image height based on the reference marker image from which the highest similarity is obtained among the similarities calculated by the similarity calculation unit 322 (step S106).

  Next, for example, as illustrated in FIG. 7, the height detection unit 323 adds the detected slice image height data to the captured image (step S <b> 107).

  Next, the image data recording unit 302 records the observation image to which the slice image height data is added (step S108).

[6] Modification [6.1] Modification 1
In the embodiment described above, the marker 103 has an example of a cylindrical shape that is convex along the height direction with respect to the surface 101a of the storage container 101 (see FIG. 2). FIG. 9 shows a modified example of the marker instead of this.

  FIGS. 9A to 9F are diagrams illustrating modifications of the marker. FIGS. 9A to 9F show markers having a shape in which the marker imaged on the image imaged together with the observation object changes according to the imaging position in the observation direction of the observation object. It is a figure which shows the example of the marker which has a some convex part from which the length along the said observation direction differs mutually while showing an example.

  FIG. 9A shows the marker 111 having a step-shaped cross section that is convex along the height direction from the surface 101 a of the storage container 101. The marker 111 has a shape in which a plurality of discs, triangles, squares, or the like are stacked in the height direction.

  FIG. 9B shows a marker 112 having a stepped cross section that is concave from the surface 101a of the storage container 101 along the height direction. The marker 112 has a shape opposite to that of the marker 111 shown in FIG. 9A with respect to the surface 101a.

  FIG. 9C is a modification of the marker 111 shown in FIG. 9A, and shows a stepped marker 113 only on one side (for example, the well side). The marker 113 may be concave with respect to the surface 101a.

  FIG. 9D shows a marker 114 having a conical or quadrangular pyramid-shaped cross section that is convex along the height direction on the upper surface of the surface 101a of the storage container 101. Note that a slide-like inclined surface may be provided without using a conical shape or a quadrangular pyramid shape. Further, the marker 114 may be concave with respect to the surface 101a.

  As described above, if the convex shape or concave shape in which the marker shape on the observation image changes when the image is captured while changing the height direction as in the markers 111 to 114 shown in FIGS. This is preferable because the marker image extraction process, the similarity calculation process, the distance detection process, and the like in the unit 320 are easier.

  FIG. 9E shows a printed layer 115 formed on the upper surface of the surface 101a of the storage container 101 by printing. The print layer 115 is, for example, characters, symbols, designs, etc. formed by printing with ink, and has a convex shape along the height direction. The printed layer 115 can be formed with a thickness of several μm or less, particularly submicron or less. By providing the printing layer 115 as a marker, it is preferable to prevent the fertilized egg from being damaged more than to process the surface of the storage container into a concave shape or a convex shape. Therefore, it can be easily formed by a method such as the above, so that the cost can be reduced.

  FIG. 9F shows a marker 116 in which three glass microbeads, for example, are aligned and fixed on the upper surface of the surface 101a. The marker 116 is composed of microbeads having a spherical diameter of, for example, 50 μm, 100 μm, and 150 μm. According to the study by the inventors, by using the microbeads, as shown in FIG. 10, the difference in the marker image in the height direction tends to appear clearly, and the marker image extraction process in the data processing unit 320 and the similarity calculation This is preferable because processing, distance detection processing, and the like become easier.

  FIG. 10 shows a microbead having a diameter of about 150 μm taken while changing the slice image height. In the figure, “0 μm” is a microbead imaged on a reference plane in the height direction. The “+” sign indicates a direction away from the storage container, and the “−” sign indicates a direction approaching the storage container. As shown in FIG. 10, it can be seen that if microbeads are used as the markers, the difference in the marker image in the height direction tends to appear clearly.

[6.2] Modification 2
In the said embodiment, the marker used for the same storage container gave the example made into the same shape (refer FIG. 2). Instead of this, it is also possible to configure as shown in FIG.

  In FIG. 11, the storage container 120 is provided with three wells 121, 122, and 123. A semicircular marker 131 is formed in the vicinity of the well 121. A triangular marker 132 is formed in the vicinity of the well 122. A square marker 133 is formed in the vicinity of the well 123. As shown in FIG. 11, by making the markers different for each well, each marker has an identification function for identifying each well, which is preferable because management of slice images of the observation object is accurate and easy. .

[6.3] Modification 3
In order to observe a fertilized egg, it is necessary to handle slice image data in units of fertilized eggs. For this purpose, a container ID can be assigned to each culture container for fertilized eggs and handled as one fertilized egg for each container, so that the container ID can be managed as a cell ID.

  Further, in a configuration in which the inside of the container is divided into a plurality of sections and an ID is assigned to each well in which the fertilized egg is cultured, a combination of the container ID and the well ID can be used as the fertilized egg ID. In addition, when culturing cells other than a fertilized egg, it will manage by cell ID.

  The well ID can be set as shown in FIG. 12, for example. In FIG. 12, eight wells 141 to 148 for culturing fertilized eggs are provided in the culture container. The eight wells 141 to 148 can be distinguished from each other by a combination of dot marks formed in the vicinity of the wells. The dot mark is formed at any one of the four positions of the mark positions a to d. A dot mark is always formed at the mark position d, and the dot mark at this position is a reference for identification.

  In FIG. 12, for example, since the well 143 has dot marks formed at the mark positions b and d, it can be seen that the fertilized egg ID being cultured in the well 143 is “3”. Therefore, the fertilized egg being cultured in the well 143 can be distinguished from other fertilized eggs by the ID and fertilized egg ID in the container.

  In this configuration, the image processing apparatus of the present invention forms a dot mark by, for example, ink printing and treats the image of the dot mark as the marker image described above, and determines the slice image height of each fertilized egg as information on the fertilized egg ID. Can be acquired.

[6.4] Modification 4
In the above embodiment, the configuration in which the marker is provided in the vicinity of the well has been described as an example (see FIG. 2). Instead of this, it is also possible to configure as shown in FIG.

  In FIG. 13, the storage container 150 is provided with a circular marker 151. For example, when cultivating bacteria in the storage container 150, the image processing of the present invention is performed by capturing an observation image so that the image of the bacteria to be imaged and the marker image of the marker 151 are included in the imaging range. The apparatus can easily detect the height of the slice image of bacteria based on the observation image.

[6.5] Modification 5
In the above embodiment, the Z-axis direction perpendicular to the XY plane on which the container is arranged is described as the observation direction according to the present invention. However, the observation direction according to the present invention means only a direction completely perpendicular to the XY plane. Instead, the axial direction may intersect with the XY plane at an arbitrary angle.

  For example, the axis perpendicular to the XY plane (reference axis) is used as a reference in such a range that the contents such as fertilized eggs and culture fluid do not leak from the culture container and wells in the container and the slice image cannot be taken. In addition, an axial direction from +5 degrees to -5 degrees from the reference axis (that is, an axis in the range of 85 degrees to 95 degrees when the reference axis is 90 degrees with respect to the XY plane) can be applied as a specific direction. Even if the angle range is exceeded, if the specific slice image can be acquired, the axial direction can be used as the specific direction.

  As described above, the slice image position detection system 1 according to the present embodiment acquires an observation image including a slice image of an observation object and a marker image of a marker provided in a storage container, and a marker image extracted from the acquired observation image in advance. Since the distance from the reference position to the cross-sectional position where the slice image is captured is detected based on the reference marker image having the highest degree of similarity with the recorded reference marker image, the height of the cross-sectional position where the slice image is captured can be easily Can be detected.

DESCRIPTION OF SYMBOLS 10 Imaging apparatus 30 Image processing apparatus 50a Slice image 50b Marker image 101 Storage container 102 Well 103 Marker 111-114 Marker 115 Print layer 116 Marker 121-123 Well 131-133 Marker 141-148 Well 143 Well 150 Storage container 151 Marker 300 Data Recording unit 301 Application recording unit 302 Image data recording unit 303 Reference marker image recording unit 320 Data processing unit 321 Marker image extraction unit 322 Similarity calculation unit 323 Height detection unit 340 Display unit 350 Display control unit 370 Operation unit 380 Management control unit

Claims (12)

An image processing apparatus that processes an image acquired from an imaging apparatus that focuses and images an observation object stored in a storage container at a predetermined cross-sectional position set in an axial direction different from an observation direction,
Observation image acquisition means for acquiring an observation image including a slice image of the observation object and a marker image of a marker provided in the storage container, which is focused and imaged at the cross-sectional position;
Marker image extraction means for extracting the marker image from the observation image;
A distance-corresponding marker in which a plurality of distance-corresponding marker images obtained by capturing the marker while changing a distance between a predetermined reference position in the observation direction and the in-focus position of the imaging device along the observation direction are recorded Image recording means;
Similarity calculating means for calculating the similarity between the marker image extracted by the marker image extracting means and the distance corresponding marker images recorded in the distance corresponding marker image recording means;
Distance detecting means for detecting a distance from the reference position to a cross-sectional position where the slice image is captured based on the distance-corresponding marker image having the highest similarity;
An image processing apparatus comprising: The image processing apparatus according to claim 1.
The observation image acquisition means displays the observation image together with an observation condition including at least one of a type of the storage container, a light source that irradiates the observation object, and a magnification that images the observation object. Acquired,
The distance-corresponding marker image recording unit is an image processing apparatus that records each distance-corresponding marker image together with the observation condition. The image processing apparatus according to claim 1 or 2,
The storage container is one of a plurality of types,
The marker is an image processing apparatus having a function of identifying the storage container. The image processing apparatus according to any one of claims 1 to 3,
The storage container is a culture container for culturing cells,
The observation image acquisition unit is an image processing device that acquires a slice image of the cell as a slice image of the observation object. The image processing apparatus according to any one of claims 1 to 4,
The said marker has an image processing apparatus which has the shape from which the said marker imaged on the image imaged with the said observation target object changes according to the imaging position in the observation direction of an observation target object. The image processing apparatus according to any one of claims 1 to 4,
The marker is an image processing apparatus having a plurality of convex portions having different lengths along the observation direction. The image processing apparatus according to any one of claims 1 to 6,
The image processing apparatus, wherein the marker has one of a convex shape and a concave shape along the observation direction. The image processing apparatus according to claim 7.
The marker is an image processing apparatus having a stepped cross-sectional shape. A container for the observation object used in an imaging apparatus that focuses and images an observation object at a predetermined cross-sectional position set in an axial direction different from the observation direction,
An accommodating portion for accommodating the observation object;
A marker formed within a predetermined range from the outer edge of the housing portion;
With
When the observation object is imaged by the imaging device, the marker is imaged on an image imaged together with the observation object according to the imaging position in the observation direction of the observation object. A container for an observation object, characterized by having a changing shape. The storage container for an observation object according to claim 9,
Comprising at least one housing part;
The marker is a container for an observation object having a function of identifying the container. An image processing program for causing a computer to execute image processing for processing an image acquired from an imaging apparatus that focuses and images an observation object stored in a storage container at a predetermined cross-sectional position orthogonal to an observation direction. ,
The computer,
An observation image acquisition means for acquiring an observation image including a slice image of the observation object and a marker image of a marker provided in the storage container, which is focused and imaged at the cross-sectional position;
Marker image extraction means for extracting the marker image from the observation image;
A distance-corresponding marker in which a plurality of distance-corresponding marker images obtained by capturing the marker while changing the distance between the predetermined reference position in the observation direction and the in-focus position of the imaging device along the observation direction are recorded Image recording means,
Similarity calculating means for calculating the similarity between the marker image extracted by the marker image extracting means and the distance corresponding marker images recorded in the distance corresponding marker image recording means; and
Distance detecting means for detecting a distance from the reference position to a cross-sectional position where the slice image is captured based on the distance-corresponding marker image having the highest similarity;
An image processing program that functions as an image processing program. An image processing method for processing an image acquired from an imaging apparatus that focuses and images an observation object stored in a storage container at a predetermined cross-sectional position orthogonal to an observation direction,
Obtaining an observation image including a slice image of the observation object and a marker image of a marker provided in the storage container, which is focused and imaged at the cross-sectional position;
Extracting the marker image from the observation image;
Recording a plurality of distance-corresponding marker images obtained by imaging the marker while changing a distance between a predetermined reference position in the observation direction and a focus position of the imaging device along the observation direction;
Calculating the similarity between the extracted marker image and the recorded marker images corresponding to each distance;
An image processing method comprising: detecting a distance from the reference position to a cross-sectional position where the slice image is captured based on the distance-corresponding marker image having the highest similarity.