WO2018158810A1 - Cell observation device - Google Patents

Cell observation device Download PDF

Info

Publication number
WO2018158810A1
WO2018158810A1 PCT/JP2017/007728 JP2017007728W WO2018158810A1 WO 2018158810 A1 WO2018158810 A1 WO 2018158810A1 JP 2017007728 W JP2017007728 W JP 2017007728W WO 2018158810 A1 WO2018158810 A1 WO 2018158810A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
range
unit
focus
cell
Prior art date
Application number
PCT/JP2017/007728
Other languages
French (fr)
Japanese (ja)
Inventor
藤原　直也
Original Assignee
株式会社島津製作所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社島津製作所 filed Critical 株式会社島津製作所
Priority to JP2019502314A priority Critical patent/JP6760477B2/en
Priority to PCT/JP2017/007728 priority patent/WO2018158810A1/en
Publication of WO2018158810A1 publication Critical patent/WO2018158810A1/en

Links

Images

Classifications

    • C—CHEMISTRY; METALLURGY
    • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
    • C12M1/00—Apparatus for enzymology or microbiology
    • C12M1/34—Measuring or testing with condition measuring or sensing means, e.g. colony counters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/41—Refractivity; Phase-affecting properties, e.g. optical path length
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto

Definitions

  • the present invention relates to a cell observation apparatus for observing the state of a cell, and more specifically, a phase image and an intensity image of an object obtained by arithmetic processing on a hologram obtained by recording a fringe pattern of an object wave and a reference wave obtained by a digital holography microscope.
  • the present invention relates to a cell observation apparatus that creates a reconstructed image such as the above.
  • the object light reflected or transmitted from the light source by the light source and the reference light directly reaching from the same light source acquire the interference fringes (hologram) formed on the detection surface of the image sensor or the like,
  • hologram interference fringes
  • an intensity image and a phase image are created as a reconstructed image of the object.
  • the above-mentioned advantage of the holographic microscope means that it is necessary to determine an appropriate focal position at the stage of creating an image based on a hologram obtained by photographing.
  • a plurality of images for example, phase images
  • the viewer displays the plurality of images. It is necessary to find an image in the most suitable in-focus state by comparing on the screen.
  • the details are in focus. It is difficult and time consuming to determine whether or not.
  • the image of the entire area of one cell culture plate or the entire area of one or a plurality of wells is large, it takes time to create a plurality of images with different focal positions.
  • the focal position is not necessarily the same for the entire area of one cell culture plate or the entire area of one or more wells, and the height of the bottom surface is different for each well in one cell culture plate. Since the bottom surface of the culture plate is inclined, it may not be possible to determine one focal position for the entire observation target region.
  • the present invention has been made to solve the above-mentioned problems, and in a cell observation device that creates and displays a phase image or the like based on hologram data obtained by a holographic microscope, an observer can appropriately focus while confirming the image.
  • the main purpose is to facilitate visual judgment and improve the workability in determining the position.
  • the present invention which has been made to solve the above problems, performs at least one of phase, intensity, or pseudo phase by performing arithmetic processing based on hologram data obtained by measuring a sample containing cells with a holographic microscope.
  • a cell observation device that creates a reconstructed image showing any two-dimensional distribution and displays it on a display unit, a) a focal position comparison image creating unit that creates a plurality of reconstructed images having different focal positions for the entire observation target region or a partial region thereof based on the acquired hologram data; b) Displaying a screen on which an image display frame on which one of a plurality of reconstructed images having different focal positions is displayed and a slider that is an operator for changing the focal position within a predetermined range are displayed.
  • the pseudo phase is a value corresponding to a phase difference in a phase contrast microscope, that is, phase information including an intensity element.
  • the holographic microscope may be any of an inline type, an off-axis type, a phase shift type, etc., regardless of the system.
  • the sample is a cell culture plate
  • the observation target region is the entire cell culture plate or a region including one or a plurality of wells formed on the plate. It can be. That is, the cell observation device according to the present invention is a device suitable for observing living cells in culture on a cell culture plate.
  • the focal position comparison image creating unit has different focal positions for the entire observation target region, for example, based on hologram data acquired for a cell culture plate in which cells are being cultured.
  • a plurality of phase images are created as reconstructed images.
  • the focus alignment display processing unit displays a screen on which an image display frame and a slider of a predetermined size are arranged on the display unit, but the focus position comparison image display processing unit responds to the position of the slider knob.
  • the phase image at the focal position is selected from the plurality of phase images created as described above and drawn in the image display frame. Accordingly, when the user performs an operation of appropriately moving the slider knob with the pointing device, phase images of different focal positions for the same region are displayed one after another according to the operation. Thereby, the user can visually confirm the change of the phase image accompanying the change of the focal position, that is, the state of the image blur while moving the slider knob.
  • the user for example, performs a predetermined operation after moving the slider knob so that the portion of interest can be seen most clearly, that is, in a focused state.
  • the focus position determination unit determines that the focus position corresponding to the phase image displayed at that time is the focus position.
  • the same operation may be performed using an intensity image or a pseudo phase image instead of the phase image.
  • the cell observation device is preferably configured to further include a focus alignment parameter setting unit for the user to set the range of change of the focus position assigned to the slider and the pitch of the change. .
  • the user can freely set the focal position change range and the pitch of the change assigned to the slider by the focus alignment parameter setting unit.
  • the focus position change pitch can be set wider (the change range is narrow) and the focus position can be searched more finely. This makes it easier to find a more accurate in-focus position.
  • the user designates the same focal position application range in which the same focal position can be applied on the wide-range display image which is a reconstructed image of the entire observation target area displayed on the display unit or a part of the observation target area.
  • a range designating unit for The focusing position determination unit may be configured to determine a focusing position for each same focal position application range specified by the range specification unit.
  • the range designating unit is a pointing device capable of designating a range of any shape and size on the displayed image, and an operation for recognizing the designated range as the same focal position application range.
  • a reception unit for example, as described above, the focal position can be determined for each well even if the appropriate focal position is different for each well in one cell culture plate. Then, the focus position can be made common.
  • An enlarged observation range designating unit for the user to designate a partial range on the wide-range display image as an enlarged observation range;
  • An enlarged image creating unit that creates an enlarged image with a magnification higher than at least the wide-range display image for the designated enlarged observation range, and displays the enlarged image on the screen of the display unit; It is good to set it as the structure further provided.
  • the magnified observation range designating unit is similar to the above range designating unit, for example, a pointing device capable of designating a range of any shape or size on the displayed image, and a magnified observation of the range designated thereby And an operation receiving unit recognized as a range.
  • the user can check an enlarged image in a narrow range designated on the wide-range display image and determine whether or not the image is in focus.
  • the accuracy of determination as to whether or not it is the in-focus position is improved, and workability for that is also improved.
  • the enlarged observation range may not necessarily be a desired portion.
  • a focus alignment target range designation for a user to specify a focus alignment target range used for determining a focal position in one or a plurality of the same focal position application ranges preferably, a focus alignment target range designation for a user to specify a focus alignment target range used for determining a focal position in one or a plurality of the same focal position application ranges. It can be set as the structure further provided with a part.
  • the focal position comparison image creating unit can create a plurality of reconstructed images having different focal positions for the focus alignment target range.
  • the data amount of the reconstructed image such as the phase image created by the focus position comparison image creating unit can be reduced by narrowing the focus alignment target range by the user. Accordingly, it is possible to speed up the process of calculating phase information and the like and the process of creating an image using the obtained phase information and the like. As a result, it is possible to shorten the time required for the work of determining the in-focus position and efficiently perform the cell observation work.
  • the cell observation apparatus when an observer (user) performs an operation of determining an appropriate focal position while visually confirming a reconstructed image such as a phase image, it is determined whether or not the subject is in focus. It can be done easily and accurately. As a result, the efficiency of the cell observation work itself can be improved, and highly accurate cell observation using a good reconstructed image can be performed.
  • the block diagram of the principal part of the cell observation apparatus which is one Example of this invention.
  • Explanatory drawing of the image creation process in the cell observation apparatus of a present Example. The flowchart which shows operation and the process in the case of focusing in the cell observation apparatus of a present Example.
  • Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example. Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example.
  • Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example. Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example.
  • FIG. 1 is a configuration diagram of a main part of the cell observation apparatus of this embodiment.
  • the cell observation apparatus of the present embodiment includes a microscope observation unit 1, a control / processing unit 2, an input unit 3 and a display unit 4 which are user interfaces.
  • the microscopic observation unit 1 is an in-line holographic microscope (IHM), and includes a light source unit 10 including a laser diode and an image sensor unit 11, and is provided between the light source unit 10 and the image sensor unit 11.
  • a cell culture plate 12 including cells 13 to be observed is arranged.
  • the cell culture plate 12 is movable in two axial directions of the X axis and the Y axis by a moving unit 14 including a driving source such as a motor.
  • the control / processing unit 2 controls the operation of the microscopic observation unit 1 and processes data acquired by the microscopic observation unit 1, and includes an imaging control unit 20, a measurement data storage unit 21, a phase information calculation unit 22, The whole image creation unit 23, the focal position comparison image creation unit 24, the image data storage unit 25, the focusing processing unit 26, the focal position information storage unit 27, the display processing unit 28, the operation reception processing unit 29, and the like are provided as functional blocks.
  • the entity of the control / processing unit 2 is a personal computer or a higher-performance workstation, and the function of each functional block described above is operated by operating dedicated control / processing software installed on the computer. Is realized. Therefore, the input unit 3 includes a pointing device such as a keyboard and a mouse. Further, as will be described later, the function of the control / processing unit 2 may be shared by a plurality of computers connected via a communication network instead of a single computer.
  • FIG. 2 is an explanatory diagram of image creation processing in the cell observation apparatus of the present embodiment
  • FIG. 3 is a flowchart showing operations and processing at the time of focusing
  • FIG. 4 is an explanation of a display method of a focal position comparison image at the time of focusing.
  • FIGS. 5A and 5B are schematic diagrams of a focus position alignment screen
  • FIGS. 6 to 8 are explanatory diagrams at the time of focus position alignment.
  • An observer sets a cell culture plate 12 on which cells (pluripotent cells) 13 to be analyzed are cultured at a predetermined position, and inputs information such as an identification number for identifying the cell culture plate 12 and a measurement date and time. Instruct the execution of measurement after inputting from 3.
  • FIG. 2 (a) six wells 50 having a circular shape in a top view are formed on the cell culture plate 12, and cells are cultured in the respective wells 50. Therefore, the entire cell culture plate 12, that is, the entire rectangular range including the six wells 50 is the observation target region, that is, the imaging target range.
  • the imaging control unit 20 controls the microscopic observation unit 1 to acquire data on the imaging target range as follows.
  • CMOS image sensors are installed on the same XY plane of the image sensor unit 11. These four CMOS image sensors are respectively responsible for photographing four quadrant ranges 51 obtained by dividing the entire cell culture plate 12 shown in FIG. 2A into four equal parts.
  • the range in which one CMOS image sensor can be photographed at a time is a rectangular range 52 including only one well 50 in the four-divided range 51 as shown in FIGS.
  • the four CMOS image sensors have long sides with a length corresponding to 15 imaging units in the X-axis direction and four rectangular images having a short side with a length corresponding to 12 imaging units in the Y-axis direction. Four different imaging units of the cell culture plate 12 are photographed at the same time.
  • the light source unit 10 irradiates a predetermined region of the cell culture plate 12 with coherent light having a minute angle spread of about 10 °.
  • the light (object light 16) that has passed through the cell culture plate 12 and the cell 13 reaches the image sensor unit 11 while interfering with the light (reference light 15) that has passed through the area close to the cell 13 on the cell culture plate 12.
  • the object light 16 is light whose phase has changed when passing through the cell 13.
  • the reference light 15 is light that does not pass through the cell 13 and therefore does not undergo phase change caused by the cell 13.
  • the cell culture plate 12 is moved stepwise by the moving unit 14 by a distance corresponding to the size of the imaging unit 53 in the XY plane. Thereby, the irradiation area of the coherent light emitted from the light source unit 10 moves on the cell culture plate 12, and each CMOS image sensor in the image sensor unit 11 can acquire hologram data corresponding to one imaging unit 53. it can.
  • the cell culture plate 12 is moved by the moving unit 14 stepwise by 180 times corresponding to the number of imaging units 53 included in one quadrant 51, and hologram data is acquired for each movement. In this way, hologram data for the entire cell culture plate 12 can be obtained without omission.
  • the hologram data obtained by the image sensor unit 11 of the microscopic observation unit 1 is sequentially sent to the control / processing unit 2 and stored in the measurement data storage unit 21.
  • the phase information calculation unit 22 reads out the hologram data for each imaging unit 53 from the measurement data storage unit 21 and executes the back propagation calculation of light.
  • the whole image creating unit 23 performs a tiling process (see FIG. 2D) for joining phase images in a narrow range based on the phase information calculated for each imaging unit 53, thereby observing the observation target region, that is, cell culture.
  • a phase image of the entire plate 12 is created.
  • the display processing unit 28 displays the phase image of the entire observation area on the screen of the display unit 4 (step S1).
  • phase information when calculating such phase information or creating a phase image, a known algorithm disclosed in Patent Documents 1 and 2 may be used.
  • intensity information, pseudo phase information, and the like may be calculated based on hologram data, and an intensity image and pseudo phase image based on these may be generated and displayed.
  • the observer visually recognizes the phase image of the entire observation target area on the screen of the display unit 4 and inputs a range in which the same focal position can be applied on the phase image (corresponding to the same focal position application range in the present invention). It designates by operation using the part 3 (pointing device). Specifically, when the observer designates a rectangular frame of any size both vertically and horizontally on the phase image and performs a predetermined operation with a pointing device, the operation reception processing unit 29 is surrounded by the designated frame. Is recognized as the same focal position application range (step S2). By repeating such an operation, a plurality of same focal position application ranges can be designated. Of course, the same focal position may be applicable to the entire observation target region without performing such designation.
  • FIG. 6 is a schematic diagram showing an example in which the same focal position application range 210 is designated for the region corresponding to the two wells 201 on the phase image 200 of the entire cell culture plate 12.
  • the observer designates a local focus alignment target range 220 used for focus alignment for each same focus position application range 210 on the phase image 200 of the entire cell culture plate 12.
  • This designation method may be the same as that of the same focal position application range 210, and appropriately select a part that is desired to be clearly observed or a part that is likely to be focused, such as a part where a cell focused by the observer exists. You can specify.
  • the phase image 200 of the entire cell culture plate 12 it is difficult to find the cell of interest because it is difficult to see the outline of each cell.
  • step S4 when the observer designates an appropriate focus alignment target range 220 and performs a predetermined enlargement operation, the focus processing unit 26 that has received an instruction via the operation reception processing unit 29, as shown in FIG. Then, an enlarged image 240 of the phase image corresponding only to the designated range is created and displayed on the screen of the display unit 4 (step S4).
  • the processing unit 26 creates an enlarged image after movement or enlargement / reduction by the operation, and updates the displayed enlarged image 240.
  • the observer can find an appropriate focus alignment target range 220 while searching for a cell of interest and confirming whether or not the cell can be clearly observed in the enlarged image 240. If an appropriate focus alignment target range 220 is thus determined, the focus alignment target range 220 may be determined by performing a predetermined operation with the input unit 3.
  • the observer instructs execution of the focal position alignment from the input unit 3 (step S5).
  • the focusing processing unit 26 creates a phase image having different focal positions in a plurality of stages as the focal position comparison image with respect to one or a plurality of designated focal position alignment target ranges 220 (see FIG. 4). ), Image data constituting the image is stored in the image data storage unit 25 (step S6). Since the size of the focus alignment target range 220 can be freely set by an observer, the focus alignment target range 220 may be contained in one imaging unit 53 or straddle a plurality of imaging units 53. In some cases.
  • the above-described tiling process is performed when creating the phase image.
  • smooth display can be performed during continuous confirmation of a plurality of focal position comparison images as will be described later. be able to.
  • the focus position range and pitch of the focus position comparison image created in step S6 may be determined in advance by the manufacturer that provides this apparatus. These parameters may be appropriately changed by the user (observer or manager of the apparatus). However, the focus position at the time of image display, which will be described later, is changed depending on the focus position range and pitch of the created focus position comparison image. Since the range and pitch of change are restricted, it is desirable that the focal position range is not too narrow and the focal position pitch is not too wide.
  • the display processing unit 28 displays a focus alignment screen 100 as shown in FIG. 5 on the screen of the display unit 4 (step S7).
  • a focus position adjustment screen 100 On the focus position adjustment screen 100, an image display frame 101 for displaying a focus position comparison image and a focus position change slider 102 which is one of GUI components are arranged.
  • the initial value of the focus position change range and the focus position change pitch determined by default is assigned to the focus position change slider 102, for example, the change of the focus position.
  • a focus position comparison image corresponding to the maximum or minimum focus position within the range is selected from the image data storage unit 25 and displayed in the image display frame 101.
  • the observer performs an operation of appropriately moving the knob 103 of the focus position change slider 102 by the input unit 3 while viewing the focus position comparison image displayed in the image display frame 101 of the focus position alignment screen 100.
  • the focus processing unit 26 that has received the instruction through the operation reception processing unit 29 selects a focus position comparison image associated with the focus position corresponding to the position of the knob 103 from the image data storage unit 25, and The display image in the display frame 101 is updated (step S8).
  • the observer determines, for example, whether or not the focused part such as the outline or pattern of the cell looks the clearest, that is, whether or not the focused part is in focus (step S9), and the in-focus state is the most focused.
  • the position of the knob 103 of the focal position changing slider 102 is adjusted so as to find the position (step S10). If it is determined that the in-focus state is obtained when the knob 103 is moved to a certain position (Yes in step S9), the “OK” button 104 arranged at the bottom of the focus position alignment screen 100 is clicked. Thus, the determination of the focal position is instructed (step S12).
  • the focusing processing unit 26 Upon receiving this instruction, the focusing processing unit 26 has the focal position corresponding to the position of the knob 103 at that time as the focal position for the same focal position application range 210 including the focus alignment target range 220 at that time. Information indicating this is stored in the focal position information storage unit 27 (step S13).
  • the default focus position change pitch is too coarse, or the actual focus position is out of the default focus position change range.
  • the observer appropriately changes the focal position change range and pitch assigned to the focal position change slider 102 on a parameter setting dialog screen, for example, pop-up displayed in response to a predetermined operation by the input unit 3. (Step S11).
  • the display processing unit 28 assigns the change range and pitch of the changed focus position to the focus position change slider 102.
  • a focus position comparison image corresponding to the maximum or minimum focus position within the change range of the focus position is selected from the image data storage unit 25 and displayed in the image display frame 101 (step S7).
  • the observer can determine an appropriate focal position while viewing the focal position comparison image.
  • the operations and processes shown in FIG. 3 may be performed for each focal position alignment target range 220 included in the same focal position application range 210.
  • region ie, the whole cell culture plate 12
  • the focal position is determined.
  • a process of newly creating a phase image of the whole cell culture plate 12 or a part thereof corresponding to the focal position may be performed.
  • the focus position obtained for the phase image may be used for the intensity image and the pseudo phase image, or the focus position may be determined for the intensity image and the pseudo phase image by the same method as the phase image. .
  • different focal position comparison images are displayed one after another in response to the observer manually operating the slider, but a plurality of focal position comparison images having different focal positions are automatically displayed.
  • An automatic playback function that is displayed one after another may be added.
  • a button for instructing automatic reproduction of the focal position comparison image is prepared, and when the button is operated, the focal position comparison image within the focal position change range determined at that time is automatically selected. It is good to reproduce like a movie by displaying in order. At this time, the playback speed may be adjusted.
  • Such automatic reproduction is particularly convenient for the observer to determine a rough focus position.
  • control / processing unit 2 In this case, complicated processing such as calculation of phase information based on hologram data and creation of a phase image is performed on the server side, and the terminal device receives image data created thereby, and a phase image is generated based on this image data. It is preferable to perform the process of displaying the message on the terminal device side.
  • the functional blocks of the control / processing unit 2 shown in FIG. 1 are separated into the terminal device side and the server side.
  • the functions of the control / processing unit 2 may be shared by a plurality of computers.
  • an in-line type holographic microscope is used as the microscopic observation unit 1, but other types of holographic methods such as an off-axis type and a phase shift type may be used as long as the microscope can obtain a hologram. Of course, it can be replaced by a microscope.

Landscapes

  • Chemical & Material Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Analytical Chemistry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Physics & Mathematics (AREA)
  • Zoology (AREA)
  • Biotechnology (AREA)
  • Organic Chemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Biochemistry (AREA)
  • Wood Science & Technology (AREA)
  • Sustainable Development (AREA)
  • Microbiology (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Genetics & Genomics (AREA)
  • Medicinal Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Microscoopes, Condenser (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Holo Graphy (AREA)

Abstract

Provided is a cell observation device wherein an image display frame (101) and a slider (102) that is capable of selecting a focus position are disposed in a focus positioning screen (100). A large number of phase images having different focus positions in a plurality of stages are created in advance, the phase images corresponding to the range designated by an observer on the entire phase image of a cell culture plate to be observed, and one of the phase images is displayed in the image display frame (101). When the observer moves a tab (103) of the slider (102), a focusing processing unit selects a phase image at a focus position corresponding to the position of the tab (103), and displays the selected phase image in the image display frame (101). The observer checks whether the displayed image is in the focused state while appropriately operating the slider (102), and when the image is in the focused state, clicks a "confirm" button (104) to determine the focus position. As a result, an appropriate focus position can be efficiently determined.

Description

細胞観察装置Cell observation device
　本発明は、細胞の状態を観察する細胞観察装置に関し、さらに詳しくは、デジタルホログラフィ顕微鏡により得られる、物体波と参照波との干渉縞を記録したホログラムに対する演算処理により物体の位相画像、強度画像等の再構成画像を作成する細胞観察装置に関する。 The present invention relates to a cell observation apparatus for observing the state of a cell, and more specifically, a phase image and an intensity image of an object obtained by arithmetic processing on a hologram obtained by recording a fringe pattern of an object wave and a reference wave obtained by a digital holography microscope. The present invention relates to a cell observation apparatus that creates a reconstructed image such as the above.
　再生医療分野では、近年、ｉＰＳ細胞やＥＳ細胞等の多能性幹細胞を用いた研究が盛んに行われている。一般に細胞は透明であって通常の光学顕微鏡では観察しにくいため、従来、細胞の観察には位相差顕微鏡が広く利用されている。
　しかしながら、位相差顕微鏡では顕微画像を撮影する際に焦点合わせを行う必要があるため、広い観察対象領域を細かく区画したそれぞれの小領域についての顕微画像を取得しするような場合、測定に多大な時間が掛かり実用的でないという問題がある。これを解決するために、近年、デジタルホログラフィ技術を用いたホログラフィック顕微鏡が開発され実用に供されている（特許文献１、２等参照）。 In the field of regenerative medicine, research using pluripotent stem cells such as iPS cells and ES cells has been actively conducted in recent years. In general, since a cell is transparent and difficult to observe with a normal optical microscope, a phase contrast microscope has been widely used for cell observation.
However, since it is necessary to perform focusing when taking a microscopic image in a phase contrast microscope, a large amount of measurement is required when acquiring microscopic images of each small area obtained by finely dividing a wide observation target area. There is a problem that it takes time and is not practical. In order to solve this, in recent years, a holographic microscope using a digital holography technique has been developed and put into practical use (see Patent Documents 1 and 2).
　ホログラフィック顕微鏡では、光源からの光が物体表面で反射又は透過してくる物体光と同一光源から直接到達する参照光とがイメージセンサ等の検出面で形成する干渉縞（ホログラム）を取得し、そのホログラムに基づいた所定の演算処理を実施することで物体の再構成画像として強度画像や位相画像を作成する。こうしたホログラフィック顕微鏡では、ホログラムを取得したあとの位相回復等のための演算処理の段階で任意の距離における再構成画像を形成することができるため、撮影時にいちいち焦点合わせを行う必要がなく測定時間を短縮することができるという利点がある。 In the holographic microscope, the object light reflected or transmitted from the light source by the light source and the reference light directly reaching from the same light source acquire the interference fringes (hologram) formed on the detection surface of the image sensor or the like, By performing a predetermined calculation process based on the hologram, an intensity image and a phase image are created as a reconstructed image of the object. In such a holographic microscope, it is possible to form a reconstructed image at an arbitrary distance at the stage of calculation processing for phase recovery after acquiring the hologram, so there is no need to perform focusing every time during shooting. There is an advantage that can be shortened.
　一方で、ホログラフィック顕微鏡における上記利点は、撮影により得られたホログラムに基づく画像を作成する段階で適切な焦点位置を決める必要があることを意味している。細胞培養プレート内で培養中の多能性細胞を観察する場合、細胞培養プレート内のいずれの位置にある細胞に対して焦点合わせを行うのかを観察者自身が目視により判断する必要がある。そのためには、例えば一つの細胞培養プレート全体又は該プレート中の一若しくは複数のウェル全体の領域について焦点位置の異なる画像（例えば位相画像）を複数作成し、この複数の画像を観察者が表示部の画面上で見比べて最も適切な合焦状態である画像を見つける作業が必要である。 On the other hand, the above-mentioned advantage of the holographic microscope means that it is necessary to determine an appropriate focal position at the stage of creating an image based on a hologram obtained by photographing. When observing pluripotent cells in culture in a cell culture plate, it is necessary for the observer himself / herself to visually determine at which position in the cell culture plate the focusing is performed. For this purpose, for example, a plurality of images (for example, phase images) having different focal positions are created for the entire cell culture plate or the entire region of one or a plurality of wells in the plate, and the viewer displays the plurality of images. It is necessary to find an image in the most suitable in-focus state by comparing on the screen.
　しかしながら、焦点が異なる多数の画像を一覧で見ても、或いは、観察者がマウス等によるクリック操作で一枚ずつ画像を選択指示しながら確認しても、細かな部分の焦点が合っているのか否かを判定するのは難しいし手間も掛かる。
　また、一つの細胞培養プレート全体や一若しくは複数のウェル全体の領域についての画像はサイズが大きいため、焦点位置が相違する複数の画像を作成するのには時間が掛かる。
　さらにまた、一つの細胞培養プレート全体や一若しくは複数のウェル全体の領域について焦点位置が共通であるとは限らず、一つの細胞培養プレート内のウェル毎に底面の高さが相違していたり細胞培養プレートの底面が傾いていたりするために、観察対象領域全体に対して一つの焦点位置を決めることができないこともある。 However, even if a large number of images with different focal points are viewed in a list, or even if an observer selects and checks images one by one by clicking with a mouse or the like, the details are in focus. It is difficult and time consuming to determine whether or not.
In addition, since the image of the entire area of one cell culture plate or the entire area of one or a plurality of wells is large, it takes time to create a plurality of images with different focal positions.
Furthermore, the focal position is not necessarily the same for the entire area of one cell culture plate or the entire area of one or more wells, and the height of the bottom surface is different for each well in one cell culture plate. Since the bottom surface of the culture plate is inclined, it may not be possible to determine one focal position for the entire observation target region.
国際特許公開第２０１６／０８４４２０号International Patent Publication No. 2016/084420 特開平１０－２６８７４０号公報JP-A-10-268740
　本発明は上記課題を解決なされたものであり、ホログラフィック顕微鏡で得られたホログラムデータに基づいて位相画像等を作成して表示する細胞観察装置において、観察者が画像を確認しながら適切な焦点位置を決める作業の際に、目視による判断を容易にするとともにその作業性を向上させることを主たる目的としている。 The present invention has been made to solve the above-mentioned problems, and in a cell observation device that creates and displays a phase image or the like based on hologram data obtained by a holographic microscope, an observer can appropriately focus while confirming the image. The main purpose is to facilitate visual judgment and improve the workability in determining the position.
　上記課題を解決するために成された本発明は、細胞を含む試料をホログラフィック顕微鏡で測定することにより得られたホログラムデータに基づく演算処理を行うことで、位相、強度、又は擬似位相の少なくともいずれかの２次元分布を示す再構成画像を作成して表示部に表示する細胞観察装置であって、
　a)取得されたホログラムデータに基づいて観察対象領域の全体又はその一部の領域について焦点位置が相違する複数の再構成画像を作成する焦点位置比較画像作成部と、
　b)前記焦点位置が相違する複数の再構成画像のうちの一つが表示される画像表示枠と、焦点位置を所定範囲で変化させるための操作子であるスライダーとが配置された画面を前記表示部に表示する焦点位置合わせ用表示処理部と、
　c)ユーザによる前記スライダーの操作に応じて前記焦点位置が相違する複数の再構成画像を選択し、前記画像表示枠中に描出させる焦点位置比較画像表示処理部と、
　d)ユーザにより指定された前記焦点位置が相違する複数の再構成画像のうちの一つに対応する焦点位置を合焦位置であると決定する合焦位置決定部と、
　を備えることを特徴としている。 The present invention, which has been made to solve the above problems, performs at least one of phase, intensity, or pseudo phase by performing arithmetic processing based on hologram data obtained by measuring a sample containing cells with a holographic microscope. A cell observation device that creates a reconstructed image showing any two-dimensional distribution and displays it on a display unit,
a) a focal position comparison image creating unit that creates a plurality of reconstructed images having different focal positions for the entire observation target region or a partial region thereof based on the acquired hologram data;
b) Displaying a screen on which an image display frame on which one of a plurality of reconstructed images having different focal positions is displayed and a slider that is an operator for changing the focal position within a predetermined range are displayed. A focus alignment display processing unit to be displayed on the screen;
c) a plurality of reconstructed images having different focal positions according to the operation of the slider by the user, and a focal position comparison image display processing unit that is rendered in the image display frame;
d) a focus position determination unit that determines that the focus position corresponding to one of a plurality of reconstructed images having different focus positions specified by the user is the focus position;
It is characterized by having.
　上記擬似位相とは位相差顕微鏡における位相差に相当する値、即ち、強度の要素を含む位相情報である。
　また、上記ホログラフィック顕微鏡はその方式を問わず、インライン型、オフアクシス型、位相シフト型などのいずれでもよい。 The pseudo phase is a value corresponding to a phase difference in a phase contrast microscope, that is, phase information including an intensity element.
The holographic microscope may be any of an inline type, an off-axis type, a phase shift type, etc., regardless of the system.
　本発明に係る細胞観察装置では、典型的には、前記試料は細胞培養プレートであり、前記観察対象領域は該細胞培養プレート全体又は該プレートに形成されている一又は複数のウェルが含まれる領域とすることができる。即ち、本発明に係る細胞観察装置は、細胞培養プレートにおいて培養中である生体細胞を観察するのに好適な装置である。 In the cell observation apparatus according to the present invention, typically, the sample is a cell culture plate, and the observation target region is the entire cell culture plate or a region including one or a plurality of wells formed on the plate. It can be. That is, the cell observation device according to the present invention is a device suitable for observing living cells in culture on a cell culture plate.
　本発明に係る細胞観察装置において、焦点位置比較画像作成部は例えば、細胞を培養中である細胞培養プレートに対して取得されたホログラムデータに基づいて、観察対象領域全体について焦点位置がそれぞれ相違する複数の位相画像を再構成画像として作成する。焦点位置合わせ用表示処理部は、所定の大きさの画像表示枠とスライダーとが配置された画面を表示部に表示するが、焦点位置比較画像表示処理部は、そのスライダーのつまみの位置に応じた焦点位置の位相画像を上記作成されている複数の位相画像の中から選択し、それを画像表示枠中に描出する。したがって、ユーザがポインティングデバイスによりスライダーのつまみを適宜に移動させる操作を行うと、その操作に応じて、同じ領域に対する異なる焦点位置の位相画像が次々に表示される。これにより、ユーザはスライダーのつまみを移動させながら、焦点位置の変化に伴う位相画像の変化、つまり画像ボケの状態を視覚的に確認することができる。 In the cell observation apparatus according to the present invention, the focal position comparison image creating unit has different focal positions for the entire observation target region, for example, based on hologram data acquired for a cell culture plate in which cells are being cultured. A plurality of phase images are created as reconstructed images. The focus alignment display processing unit displays a screen on which an image display frame and a slider of a predetermined size are arranged on the display unit, but the focus position comparison image display processing unit responds to the position of the slider knob. The phase image at the focal position is selected from the plurality of phase images created as described above and drawn in the image display frame. Accordingly, when the user performs an operation of appropriately moving the slider knob with the pointing device, phase images of different focal positions for the same region are displayed one after another according to the operation. Thereby, the user can visually confirm the change of the phase image accompanying the change of the focal position, that is, the state of the image blur while moving the slider knob.
　ユーザは例えば、着目している部分が最も明瞭に見える状態つまりは合焦状態になるようにスライダーのつまみを移動させたうえで、所定の操作を行う。この操作を受けて合焦位置決定部は、そのときに表示されている位相画像に対応する焦点位置が合焦位置であると決定する。もちろん、位相画像の代わりに強度画像や擬似位相画像を利用して同様の作業を行ってもよい。こうした一連の操作により、ユーザは容易に且つ的確に再構成画像の合焦位置を決めることができる。 The user, for example, performs a predetermined operation after moving the slider knob so that the portion of interest can be seen most clearly, that is, in a focused state. Upon receiving this operation, the focus position determination unit determines that the focus position corresponding to the phase image displayed at that time is the focus position. Of course, the same operation may be performed using an intensity image or a pseudo phase image instead of the phase image. Through such a series of operations, the user can easily and accurately determine the in-focus position of the reconstructed image.
　焦点位置を正確に合わせるにはスライダーに割り当てられる焦点位置の変化のピッチが狭い、つまりはスライダーのつまみの移動に応じて少しずつ焦点位置が変化することが望ましいが、そうすると、つまみの可動範囲に対応する焦点位置の変化の範囲が狭くなり、その範囲から合焦位置が外れる可能性がある。
　そこで、本発明に係る細胞観察装置では、好ましくは、前記スライダーに割り当てられる焦点位置の変化の範囲及びその変化のピッチをユーザが設定するための焦点位置合わせパラメータ設定部をさらに備える構成とするとよい。 To adjust the focus position accurately, it is desirable that the focus position change pitch assigned to the slider is narrow, that is, the focus position gradually changes according to the movement of the slider knob. There is a possibility that the range of change of the corresponding focal position becomes narrow and the in-focus position deviates from that range.
Therefore, the cell observation device according to the present invention is preferably configured to further include a focus alignment parameter setting unit for the user to set the range of change of the focus position assigned to the slider and the pitch of the change. .
　この構成によれば、ユーザが焦点位置合わせパラメータ設定部によりスライダーに割り当てられる焦点位置の変化の範囲及びその変化のピッチを自由に設定できるので、例えばまず焦点位置の変化の範囲を広く（変化のピッチは狭く）設定したうえでおおまかに合焦位置を決めたあと、焦点位置の変化のピッチを広く（変化の範囲は狭く）設定し直して、より細かく合焦位置を探索することができる。それにより、より正確な合焦位置を見つけ易くなる。 According to this configuration, the user can freely set the focal position change range and the pitch of the change assigned to the slider by the focus alignment parameter setting unit. After setting the focus position roughly after setting the pitch (narrow), the focus position change pitch can be set wider (the change range is narrow) and the focus position can be searched more finely. This makes it easier to find a more accurate in-focus position.
　また本発明に係る細胞観察装置では、
　前記表示部に表示されている観察対象領域の全体又はその一部の領域についての再構成画像である広範囲表示画像上で、同一の焦点位置を適用可能である同一焦点位置適用範囲をユーザが指定するための範囲指定部、をさらに備え、
　前記合焦位置決定部は、前記範囲指定部により指定された同一焦点位置適用範囲毎に合焦位置を決定する構成とするとよい。 In the cell observation device according to the present invention,
The user designates the same focal position application range in which the same focal position can be applied on the wide-range display image which is a reconstructed image of the entire observation target area displayed on the display unit or a part of the observation target area. A range designating unit for
The focusing position determination unit may be configured to determine a focusing position for each same focal position application range specified by the range specification unit.
　ここで、範囲指定部は例えば、表示されている画像上で任意の形状、任意の大きさの範囲を指定可能なポインティングデバイスと、それにより指定された範囲を同一焦点位置適用範囲として認識する操作受付部と、から成るものとすることができる。
　この構成によれば、例えば上述したように一つの細胞培養プレート中のウェル毎に適切な焦点位置が異なる場合であっても、ウェル毎に焦点位置を定めることができ、また逆に同一ウェル内では焦点位置を共通にすることができる。 Here, for example, the range designating unit is a pointing device capable of designating a range of any shape and size on the displayed image, and an operation for recognizing the designated range as the same focal position application range. And a reception unit.
According to this configuration, for example, as described above, the focal position can be determined for each well even if the appropriate focal position is different for each well in one cell culture plate. Then, the focus position can be made common.
　また上記構成の細胞観察装置では、
　前記広範囲表示画像上の一部の範囲をユーザが拡大観察範囲として指定するための拡大観察範囲指定部と、
　該指定された拡大観察範囲について少なくとも前記広範囲表示画像よりも倍率の高い拡大画像を作成し該拡大画像を前記表示部の画面上に表示する拡大画像作成部と、
　をさらに備える構成とするとよい。 In the cell observation apparatus having the above-described configuration,
An enlarged observation range designating unit for the user to designate a partial range on the wide-range display image as an enlarged observation range;
An enlarged image creating unit that creates an enlarged image with a magnification higher than at least the wide-range display image for the designated enlarged observation range, and displays the enlarged image on the screen of the display unit;
It is good to set it as the structure further provided.
　拡大観察範囲指定部は上記範囲指定部と同様に、例えば、表示されている画像上で任意の形状、任意の大きさの範囲を指定可能なポインティングデバイスと、それにより指定された範囲を拡大観察範囲として認識する操作受付部と、から成るものとすることができる。 The magnified observation range designating unit is similar to the above range designating unit, for example, a pointing device capable of designating a range of any shape or size on the displayed image, and a magnified observation of the range designated thereby And an operation receiving unit recognized as a range.
　例えば一つの細胞培養プレートの全体やウェル全体である広範囲の位相画像等をユーザが見ても、焦点が合っているのか否かを判断することは難しい。これに対し、上記構成によれば、ユーザは広範囲表示画像上で指定した狭い範囲における拡大画像を確認して焦点が合っているのか否かを判断することができる。それにより、合焦位置か否かの判断の的確性が向上するし、そのための作業性も向上する。 For example, even if the user looks at a wide range of phase images, such as the whole of one cell culture plate or the whole well, it is difficult to determine whether or not the image is in focus. On the other hand, according to the above configuration, the user can check an enlarged image in a narrow range designated on the wide-range display image and determine whether or not the image is in focus. As a result, the accuracy of determination as to whether or not it is the in-focus position is improved, and workability for that is also improved.
　また、表示されている広範囲表示画像上でユーザが拡大観察範囲を指定して拡大画像を表示させても、その拡大観察範囲が必ずしも所望の部分でない場合もある。また、それ以外の部分の画像の状態も確認したい場合もある。 In addition, even when the user designates an enlarged observation range and displays an enlarged image on the displayed wide-range display image, the enlarged observation range may not necessarily be a desired portion. In addition, there are cases where it is desired to check the state of the image of other parts.
　そこで、本発明に係る細胞観察装置では、
　前記表示部に表示されている前記広範囲表示画像上の前記拡大観察範囲を移動させる又は拡大若しくは縮小させる操作をユーザが行うための操作部をさらに備え、
　前記拡大画像作成部は、前記操作部を介した操作による移動後の又は拡大若しくは縮小後の拡大画像を作成して表示することが好ましい。
　これにより、ユーザは観察対象領域内の任意の部位における拡大画像を確認して焦点位置が適当か否かを判断することができる。 Therefore, in the cell observation device according to the present invention,
An operation unit for a user to perform an operation of moving or enlarging or reducing the enlarged observation range on the wide-range display image displayed on the display unit;
It is preferable that the enlarged image creating unit creates and displays an enlarged image after being moved by operation via the operation unit or after being enlarged or reduced.
As a result, the user can check an enlarged image at an arbitrary part in the observation target region and determine whether or not the focus position is appropriate.
　また本発明に係る細胞観察装置では、好ましくは、一又は複数の前記同一焦点位置適用範囲においてそれぞれ焦点位置の決定に使用する焦点位置合わせ対象範囲をユーザが指定するための焦点位置合わせ対象範囲指定部をさらに備える構成とすることができる。 In the cell observation device according to the present invention, preferably, a focus alignment target range designation for a user to specify a focus alignment target range used for determining a focal position in one or a plurality of the same focal position application ranges. It can be set as the structure further provided with a part.
　さらにまた本発明に係る細胞観察装置において、前記焦点位置比較画像作成部は、前記焦点位置合わせ対象範囲について焦点位置が相違する複数の再構成画像を作成する構成とすることができる。 Furthermore, in the cell observation apparatus according to the present invention, the focal position comparison image creating unit can create a plurality of reconstructed images having different focal positions for the focus alignment target range.
　こうした構成によれば、ユーザが焦点位置合わせ対象範囲を絞り込むことで、焦点位置比較画像作成部により作成される位相画像等の再構成画像のデータ量を少なく抑えることができる。それによって、位相情報等を算出する処理や得られた位相情報等を用いて画像を作成する処理を高速化することができる。その結果、合焦位置を決定する作業に掛かる時間を短縮し、細胞観察の作業を効率的に行うことができる。 According to such a configuration, the data amount of the reconstructed image such as the phase image created by the focus position comparison image creating unit can be reduced by narrowing the focus alignment target range by the user. Accordingly, it is possible to speed up the process of calculating phase information and the like and the process of creating an image using the obtained phase information and the like. As a result, it is possible to shorten the time required for the work of determining the in-focus position and efficiently perform the cell observation work.
　本発明に係る細胞観察装置によれば、観察者（ユーザ）が位相画像等の再構成画像を目視で確認しながら適切な焦点位置を決める作業を行う際に、合焦か否かの判断が容易に且つ的確に行える。それにより、細胞観察の作業自体の効率向上を図ることができるとともに、良好な再構成画像を利用した精度の高い細胞観察が可能となる。 According to the cell observation apparatus according to the present invention, when an observer (user) performs an operation of determining an appropriate focal position while visually confirming a reconstructed image such as a phase image, it is determined whether or not the subject is in focus. It can be done easily and accurately. As a result, the efficiency of the cell observation work itself can be improved, and highly accurate cell observation using a good reconstructed image can be performed.
本発明の一実施例である細胞観察装置の要部の構成図。The block diagram of the principal part of the cell observation apparatus which is one Example of this invention. 本実施例の細胞観察装置における画像作成処理の説明図。Explanatory drawing of the image creation process in the cell observation apparatus of a present Example. 本実施例の細胞観察装置における焦点合わせの際の操作及び処理を示すフローチャート。The flowchart which shows operation and the process in the case of focusing in the cell observation apparatus of a present Example. 本実施例の細胞観察装置における焦点合わせの際の焦点位置比較画像の表示手法の説明図。Explanatory drawing of the display method of the focus position comparison image in the case of focusing in the cell observation apparatus of a present Example. 本実施例の細胞観察装置における焦点位置合わせ画面の模式図。The schematic diagram of the focus position alignment screen in the cell observation apparatus of a present Example. 本実施例の細胞観察装置における焦点位置合わせ時の説明図。Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example. 本実施例の細胞観察装置における焦点位置合わせ時の説明図。Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example. 本実施例の細胞観察装置における焦点位置合わせ時の説明図。Explanatory drawing at the time of the focus position alignment in the cell observation apparatus of a present Example.
　以下、本発明に係る細胞観察装置の一実施例について、添付図面を参照して説明する。
　図１は本実施例の細胞観察装置の要部の構成図である。 Hereinafter, an embodiment of a cell observation device according to the present invention will be described with reference to the accompanying drawings.
FIG. 1 is a configuration diagram of a main part of the cell observation apparatus of this embodiment.
　本実施例の細胞観察装置は、顕微観察部１と、制御・処理部２と、ユーザーインターフェイスである入力部３及び表示部４と、を備える。
　顕微観察部１はインライン型ホログラフィック顕微鏡（In-line Holographic Microscopy：ＩＨＭ）であり、レーザダイオードなどを含む光源部１０とイメージセンサ部１１とを備え、光源部１０とイメージセンサ部１１との間に、観察対象である細胞１３を含む細胞培養プレート１２が配置される。細胞培養プレート１２は例えばモータ等の駆動源を含む移動部１４により、Ｘ軸、Ｙ軸の２軸方向に移動自在である。 The cell observation apparatus of the present embodiment includes a microscope observation unit 1, a control / processing unit 2, an input unit 3 and a display unit 4 which are user interfaces.
The microscopic observation unit 1 is an in-line holographic microscope (IHM), and includes a light source unit 10 including a laser diode and an image sensor unit 11, and is provided between the light source unit 10 and the image sensor unit 11. In addition, a cell culture plate 12 including cells 13 to be observed is arranged. The cell culture plate 12 is movable in two axial directions of the X axis and the Y axis by a moving unit 14 including a driving source such as a motor.
　制御・処理部２は顕微観察部１の動作を制御するとともに顕微観察部１で取得されたデータを処理するものであって、撮影制御部２０、測定データ記憶部２１、位相情報算出部２２、全体画像作成部２３、焦点位置比較画像作成部２４、画像データ記憶部２５、合焦処理部２６、焦点位置情報記憶部２７、表示処理部２８、操作受付処理部２９などを機能ブロックとして備える。
　なお、この制御・処理部２の実体はパーソナルコンピュータ又はより高性能なワークステーションであり、そうしたコンピュータにインストールされた専用の制御・処理ソフトウェアを該コンピュータ上で動作させることで上記各機能ブロックの機能が実現される。したがって、入力部３はキーボードやマウス等のポインティングデバイスを含む。また、後述するように制御・処理部２の機能を一つのコンピュータでなく、通信ネットワークを介して接続された複数のコンピュータで分担する構成とすることもできる。 The control / processing unit 2 controls the operation of the microscopic observation unit 1 and processes data acquired by the microscopic observation unit 1, and includes an imaging control unit 20, a measurement data storage unit 21, a phase information calculation unit 22, The whole image creation unit 23, the focal position comparison image creation unit 24, the image data storage unit 25, the focusing processing unit 26, the focal position information storage unit 27, the display processing unit 28, the operation reception processing unit 29, and the like are provided as functional blocks.
The entity of the control / processing unit 2 is a personal computer or a higher-performance workstation, and the function of each functional block described above is operated by operating dedicated control / processing software installed on the computer. Is realized. Therefore, the input unit 3 includes a pointing device such as a keyboard and a mouse. Further, as will be described later, the function of the control / processing unit 2 may be shared by a plurality of computers connected via a communication network instead of a single computer.
　次に、本実施例の細胞観察装置において細胞観察を行う際の観察者の操作及び処理について図２～図８を参照して説明する。図２は本実施例の細胞観察装置における画像作成処理の説明図、図３は焦点合わせの際の操作及び処理を示すフローチャート、図４は焦点合わせの際の焦点位置比較画像の表示手法の説明図、図５は焦点位置合わせ画面の模式図、図６～図８は焦点位置合わせ時の説明図である。 Next, the operation and processing of the observer when performing cell observation in the cell observation apparatus of the present embodiment will be described with reference to FIGS. FIG. 2 is an explanatory diagram of image creation processing in the cell observation apparatus of the present embodiment, FIG. 3 is a flowchart showing operations and processing at the time of focusing, and FIG. 4 is an explanation of a display method of a focal position comparison image at the time of focusing. FIGS. 5A and 5B are schematic diagrams of a focus position alignment screen, and FIGS. 6 to 8 are explanatory diagrams at the time of focus position alignment.
　観察者は解析対象である細胞（多能性細胞）１３が培養されている細胞培養プレート１２を所定位置にセットし、該細胞培養プレート１２を特定する識別番号や測定日時などの情報を入力部３から入力したうえで測定実行を指示する。本例では、図２（ａ）に示すように、細胞培養プレート１２には六個の上面視円形状のウェル５０が形成されており、その各ウェル５０内においてそれぞれ細胞が培養されている。そのため、この一つの細胞培養プレート１２全体、つまりは六個のウェル５０を含む矩形状の範囲全体が観察対象領域、即ち撮像対象範囲である。上記測定指示を受けて撮影制御部２０は、顕微観察部１を制御して以下のように撮像対象範囲についてのデータを取得する。 An observer sets a cell culture plate 12 on which cells (pluripotent cells) 13 to be analyzed are cultured at a predetermined position, and inputs information such as an identification number for identifying the cell culture plate 12 and a measurement date and time. Instruct the execution of measurement after inputting from 3. In this example, as shown in FIG. 2 (a), six wells 50 having a circular shape in a top view are formed on the cell culture plate 12, and cells are cultured in the respective wells 50. Therefore, the entire cell culture plate 12, that is, the entire rectangular range including the six wells 50 is the observation target region, that is, the imaging target range. Upon receiving the measurement instruction, the imaging control unit 20 controls the microscopic observation unit 1 to acquire data on the imaging target range as follows.
　図１には示していないが、イメージセンサ部１１の同一のＸ－Ｙ平面上には四つのＣＭＯＳイメージセンサが設置されている。この四つのＣＭＯＳイメージセンサは、図２（ａ）に示した細胞培養プレート１２全体を４等分した四つの４分割範囲５１の撮影をそれぞれ担うものである。一つのＣＭＯＳイメージセンサが１回に撮影可能である範囲は図２（ｂ）及び（ｃ）に示すように、４分割範囲５１の中の１個のウェル５０のみを含む矩形状の範囲５２をＸ軸方向に１０等分、Ｙ軸方向に１２等分して得られる撮像単位５３に相当する範囲である。したがって、４分割範囲５１は１５×１２＝１８０個の撮像単位５３から成る。四つのＣＭＯＳイメージセンサは、Ｘ軸方向に１５個の撮像単位に対応する長さの長辺を有し、Ｙ軸方向に１２個の撮像単位に対応する長さの短辺を有する矩形の四つの頂点付近にそれぞれ配置されおり、同時に細胞培養プレート１２の異なる四つの撮像単位の撮影を行う。 Although not shown in FIG. 1, four CMOS image sensors are installed on the same XY plane of the image sensor unit 11. These four CMOS image sensors are respectively responsible for photographing four quadrant ranges 51 obtained by dividing the entire cell culture plate 12 shown in FIG. 2A into four equal parts. The range in which one CMOS image sensor can be photographed at a time is a rectangular range 52 including only one well 50 in the four-divided range 51 as shown in FIGS. This is a range corresponding to an imaging unit 53 obtained by dividing into 10 equal parts in the X axis direction and 12 equal parts in the Y axis direction. Therefore, the quadrant 51 is composed of 15 × 12 = 180 image pickup units 53. The four CMOS image sensors have long sides with a length corresponding to 15 imaging units in the X-axis direction and four rectangular images having a short side with a length corresponding to 12 imaging units in the Y-axis direction. Four different imaging units of the cell culture plate 12 are photographed at the same time.
　撮影制御部２０による制御の下で光源部１０は、１０°程度の微小角度の広がりを持つコヒーレント光を細胞培養プレート１２の所定の領域に照射する。細胞培養プレート１２及び細胞１３を透過した光（物体光１６）は、細胞培養プレート１２上で細胞１３に近接する領域を透過した光（参照光１５）と干渉しつつイメージセンサ部１１に到達する。物体光１６は細胞１３を透過する際に位相が変化した光であり、他方、参照光１５は細胞１３を透過しないので該細胞１３に起因する位相変化を受けない光である。したがって、イメージセンサ部１１に配置されている四つのＣＭＯＳイメージセンサの検出面（像面）上には、細胞１３により位相が変化した物体光１６と位相が変化していない参照光１５との干渉像（ホログラム）がそれぞれ形成され、このホログラムに対応する２次元的な光強度分布データ（ホログラムデータ）がイメージセンサ部１１から出力される。 Under the control of the imaging control unit 20, the light source unit 10 irradiates a predetermined region of the cell culture plate 12 with coherent light having a minute angle spread of about 10 °. The light (object light 16) that has passed through the cell culture plate 12 and the cell 13 reaches the image sensor unit 11 while interfering with the light (reference light 15) that has passed through the area close to the cell 13 on the cell culture plate 12. . The object light 16 is light whose phase has changed when passing through the cell 13. On the other hand, the reference light 15 is light that does not pass through the cell 13 and therefore does not undergo phase change caused by the cell 13. Therefore, on the detection surfaces (image surfaces) of the four CMOS image sensors arranged in the image sensor unit 11, interference between the object light 16 whose phase has been changed by the cell 13 and the reference light 15 whose phase has not changed. An image (hologram) is formed, and two-dimensional light intensity distribution data (hologram data) corresponding to the hologram is output from the image sensor unit 11.
　細胞培養プレート１２は移動部１４により、Ｘ－Ｙ面内で上記撮像単位５３のサイズに相当する距離だけステップ状に移動される。これにより、光源部１０から発せられるコヒーレント光の照射領域は細胞培養プレート１２上で移動し、イメージセンサ部１１における各ＣＭＯＳイメージセンサではそれぞれ一つの撮像単位５３に対応するホログラムデータを取得することができる。細胞培養プレート１２は移動部１４により、一つの４分割範囲５１内に含まれる撮像単位５３の数に相当する１８０回ステップ状に移動され、その移動毎にホログラムデータが取得される。このようにして、細胞培養プレート１２全体についてのホログラムデータを漏れなく得ることができる。 The cell culture plate 12 is moved stepwise by the moving unit 14 by a distance corresponding to the size of the imaging unit 53 in the XY plane. Thereby, the irradiation area of the coherent light emitted from the light source unit 10 moves on the cell culture plate 12, and each CMOS image sensor in the image sensor unit 11 can acquire hologram data corresponding to one imaging unit 53. it can. The cell culture plate 12 is moved by the moving unit 14 stepwise by 180 times corresponding to the number of imaging units 53 included in one quadrant 51, and hologram data is acquired for each movement. In this way, hologram data for the entire cell culture plate 12 can be obtained without omission.
　上述したように顕微観察部１のイメージセンサ部１１で得られたホログラムデータは逐次、制御・処理部２に送られ、測定データ記憶部２１に格納される。細胞培養プレート１２全体の測定が終了すると、制御・処理部２では、位相情報算出部２２が測定データ記憶部２１から上記撮像単位５３毎のホログラムデータを読み出し、光の逆伝播計算を実行することで細胞１３の光学厚さを反映した位相情報及び強度情報を算出する。全体画像作成部２３は、撮像単位５３毎に算出された位相情報に基づく狭い範囲の位相画像を繋ぎ合わせるタイリング処理（図２（ｄ）参照）を行うことで、観察対象領域つまりは細胞培養プレート１２全体の位相画像を作成する。表示処理部２８はこの観察領域全体の位相画像を表示部４の画面上に表示する（ステップＳ１）。 As described above, the hologram data obtained by the image sensor unit 11 of the microscopic observation unit 1 is sequentially sent to the control / processing unit 2 and stored in the measurement data storage unit 21. When the measurement of the entire cell culture plate 12 is completed, in the control / processing unit 2, the phase information calculation unit 22 reads out the hologram data for each imaging unit 53 from the measurement data storage unit 21 and executes the back propagation calculation of light. To calculate phase information and intensity information reflecting the optical thickness of the cell 13. The whole image creating unit 23 performs a tiling process (see FIG. 2D) for joining phase images in a narrow range based on the phase information calculated for each imaging unit 53, thereby observing the observation target region, that is, cell culture. A phase image of the entire plate 12 is created. The display processing unit 28 displays the phase image of the entire observation area on the screen of the display unit 4 (step S1).
　なお、こうした位相情報の計算や位相画像の作成の際には、特許文献１、２等に開示されている周知のアルゴリズムを用いればよい。なお、位相情報のほかに、ホログラムデータに基づいて強度情報や擬似位相情報なども併せて算出し、これらに基づく強度画像や擬似位相画像を作成して表示するようにしてもよい。 In addition, when calculating such phase information or creating a phase image, a known algorithm disclosed in Patent Documents 1 and 2 may be used. In addition to the phase information, intensity information, pseudo phase information, and the like may be calculated based on hologram data, and an intensity image and pseudo phase image based on these may be generated and displayed.
　観察者は表示部４の画面上で観察対象領域全体の位相画像を視認し、その位相画像上で同一の焦点位置を適用可能である範囲（本発明における同一焦点位置適用範囲に相当）を入力部３（ポインティングデバイス）を用いた操作により指定する。具体的には、観察者がポインティングデバイスにより縦、横共に任意のサイズの矩形状の枠を位相画像上で指定して所定の操作を行うと、操作受付処理部２９は指定された枠で囲まれる範囲を同一焦点位置適用範囲であると認識する（ステップＳ２）。こうした操作を繰り返して、複数の同一焦点位置適用範囲を指定することができる。もちろん、こうした指定を行わずに観察対象領域全体について同一の焦点位置を適用可能としてもよい。
　図６は、細胞培養プレート１２全体の位相画像２００上で、二つのウェル２０１に対応する領域について同一焦点位置適用範囲２１０が指定された例を示す模式図である。 The observer visually recognizes the phase image of the entire observation target area on the screen of the display unit 4 and inputs a range in which the same focal position can be applied on the phase image (corresponding to the same focal position application range in the present invention). It designates by operation using the part 3 (pointing device). Specifically, when the observer designates a rectangular frame of any size both vertically and horizontally on the phase image and performs a predetermined operation with a pointing device, the operation reception processing unit 29 is surrounded by the designated frame. Is recognized as the same focal position application range (step S2). By repeating such an operation, a plurality of same focal position application ranges can be designated. Of course, the same focal position may be applicable to the entire observation target region without performing such designation.
FIG. 6 is a schematic diagram showing an example in which the same focal position application range 210 is designated for the region corresponding to the two wells 201 on the phase image 200 of the entire cell culture plate 12.
　次に、観察者は図７に示すように、細胞培養プレート１２全体の位相画像２００上で同一焦点位置適用範囲２１０毎に、焦点位置合わせに使用する局所的な焦点位置合わせ対象範囲２２０を指定する（ステップＳ３）。この指定の方法は同一焦点位置適用範囲２１０と同様でよく、観察者が着目している細胞が存在している部位など、鮮明に観察したい部位や焦点を合わせ易いと想定される部位を適宜に指定すればよい。ただし、細胞培養プレート１２全体の位相画像２００では一つ一つの細胞の輪郭等は見にくいので、着目している細胞を探索するのも難しい。そこで、観察者が適宜の焦点位置合わせ対象範囲２２０を指定したうえで所定の拡大操作を行うと、操作受付処理部２９を介して指示を受けた合焦処理部２６は、図８に示すように、指定された範囲のみに対応する位相画像の拡大画像２４０を作成し表示部４の画面上に表示する（ステップＳ４）。 Next, as shown in FIG. 7, the observer designates a local focus alignment target range 220 used for focus alignment for each same focus position application range 210 on the phase image 200 of the entire cell culture plate 12. (Step S3). This designation method may be the same as that of the same focal position application range 210, and appropriately select a part that is desired to be clearly observed or a part that is likely to be focused, such as a part where a cell focused by the observer exists. You can specify. However, in the phase image 200 of the entire cell culture plate 12, it is difficult to find the cell of interest because it is difficult to see the outline of each cell. Therefore, when the observer designates an appropriate focus alignment target range 220 and performs a predetermined enlargement operation, the focus processing unit 26 that has received an instruction via the operation reception processing unit 29, as shown in FIG. Then, an enlarged image 240 of the phase image corresponding only to the designated range is created and displayed on the screen of the display unit 4 (step S4).
　また、観察者が細胞培養プレート１２全体の位相画像２００上で又は拡大画像２４０上で、その拡大画像２４０で示されている範囲を移動させたり拡大又は縮小させたりする操作を行うと、合焦処理部２６はその操作による移動後又は拡大・縮小後の拡大画像を作成し、表示されている拡大画像２４０を更新する。これにより、観察者は着目する細胞を探索しながら、またその細胞が鮮明に観察可能であるか否かを拡大画像２４０において確認しながら、適切な焦点位置合わせ対象範囲２２０を見いだすことができる。そうして適切な焦点位置合わせ対象範囲２２０が決まったならば、入力部３で所定の操作を行うことで焦点位置合わせ対象範囲２２０を確定させればよい。 Further, when the observer performs an operation of moving, enlarging, or reducing the range indicated by the enlarged image 240 on the phase image 200 or the enlarged image 240 of the entire cell culture plate 12, focusing is performed. The processing unit 26 creates an enlarged image after movement or enlargement / reduction by the operation, and updates the displayed enlarged image 240. Thus, the observer can find an appropriate focus alignment target range 220 while searching for a cell of interest and confirming whether or not the cell can be clearly observed in the enlarged image 240. If an appropriate focus alignment target range 220 is thus determined, the focus alignment target range 220 may be determined by performing a predetermined operation with the input unit 3.
　上述のようにして同一焦点位置適用範囲２１０及び焦点位置合わせ対象範囲２２０を指定したあと、観察者は入力部３から焦点位置合わせの実行を指示する（ステップＳ５）。この指示を受けて合焦処理部２６は、指定されている一又は複数の焦点位置合わせ対象範囲２２０について、焦点位置が複数段階に相違する位相画像を焦点位置比較画像として作成し（図４参照）、その画像を構成する画像データを画像データ記憶部２５に格納する（ステップＳ６）。焦点位置合わせ対象範囲２２０の大きさは観察者が自在に設定可能であるので、焦点位置合わせ対象範囲２２０は一つの撮像単位５３に収まっている場合もあれば複数の撮像単位５３に跨っている場合もある。後者の場合には、位相画像を作成する際に上述したタイリング処理が実施される。このように、あとで閲覧する可能性がある焦点位置比較画像を事前に全て用意しておくことで、後述するような複数の焦点位置比較画像の連続的な確認の際に円滑な表示を行うことができる。 After designating the same focal position application range 210 and the focal position adjustment target range 220 as described above, the observer instructs execution of the focal position alignment from the input unit 3 (step S5). In response to this instruction, the focusing processing unit 26 creates a phase image having different focal positions in a plurality of stages as the focal position comparison image with respect to one or a plurality of designated focal position alignment target ranges 220 (see FIG. 4). ), Image data constituting the image is stored in the image data storage unit 25 (step S6). Since the size of the focus alignment target range 220 can be freely set by an observer, the focus alignment target range 220 may be contained in one imaging unit 53 or straddle a plurality of imaging units 53. In some cases. In the latter case, the above-described tiling process is performed when creating the phase image. In this way, by preparing in advance all the focal position comparison images that may be browsed later, smooth display can be performed during continuous confirmation of a plurality of focal position comparison images as will be described later. be able to.
　ステップＳ６で作成される焦点位置比較画像の焦点位置の範囲やピッチは、本装置を提供するメーカが予め適宜に定めておけばよい。これらのパラメータはユーザ（観察者や装置の管理者）が適宜に変更できるようにしてもよいが、作成される焦点位置比較画像の焦点位置の範囲やピッチによって後述する画像表示時における焦点位置の変化の範囲やピッチが制約を受けるので、焦点位置の範囲が狭くなりすぎないように、また焦点位置のピッチが広くなりすぎないようにしておくことが望ましい。 The focus position range and pitch of the focus position comparison image created in step S6 may be determined in advance by the manufacturer that provides this apparatus. These parameters may be appropriately changed by the user (observer or manager of the apparatus). However, the focus position at the time of image display, which will be described later, is changed depending on the focus position range and pitch of the created focus position comparison image. Since the range and pitch of change are restricted, it is desirable that the focal position range is not too narrow and the focal position pitch is not too wide.
　一方、表示処理部２８は表示部４の画面上に、図５に示すような焦点位置合わせ画面１００を表示する（ステップＳ７）。この焦点位置合わせ画面１００には、焦点位置比較画像を表示するための画像表示枠１０１とＧＵＩ部品の一つである焦点位置変更スライダー１０２とが配置されている。焦点位置合わせ画面１００を新たに表示する際には、デフォルトで定められている焦点位置の変化範囲及び焦点位置の変化のピッチの初期値を焦点位置変更スライダー１０２に割り当て、例えばその焦点位置の変化範囲内で最大又は最小の焦点位置に対応する焦点位置比較画像を画像データ記憶部２５から選択して画像表示枠１０１中に表示する。 On the other hand, the display processing unit 28 displays a focus alignment screen 100 as shown in FIG. 5 on the screen of the display unit 4 (step S7). On the focus position adjustment screen 100, an image display frame 101 for displaying a focus position comparison image and a focus position change slider 102 which is one of GUI components are arranged. When a new focus position adjustment screen 100 is displayed, the initial value of the focus position change range and the focus position change pitch determined by default is assigned to the focus position change slider 102, for example, the change of the focus position. A focus position comparison image corresponding to the maximum or minimum focus position within the range is selected from the image data storage unit 25 and displayed in the image display frame 101.
　観察者は焦点位置合わせ画面１００の画像表示枠１０１に表示されている焦点位置比較画像を見ながら、入力部３により、焦点位置変更スライダー１０２のつまみ１０３を適宜に移動させる操作を行う。すると、操作受付処理部２９を通してその指示を受けた合焦処理部２６は、つまみ１０３の位置に応じた焦点位置に対応付けられている焦点位置比較画像を画像データ記憶部２５から選択し、画像表示枠１０１中の表示画像を更新する（ステップＳ８）。 The observer performs an operation of appropriately moving the knob 103 of the focus position change slider 102 by the input unit 3 while viewing the focus position comparison image displayed in the image display frame 101 of the focus position alignment screen 100. Then, the focus processing unit 26 that has received the instruction through the operation reception processing unit 29 selects a focus position comparison image associated with the focus position corresponding to the position of the knob 103 from the image data storage unit 25, and The display image in the display frame 101 is updated (step S8).
　焦点位置が相違する焦点位置比較画像ではそれぞれ、画像ボケの状態が少しずつ異なる。そこで観察者は例えば、細胞の輪郭や模様といった着目している部分が最も鮮明に見えるか否か、つまり合焦状態であるか否かを判断し（ステップＳ９）、最も焦点が合った合焦位置を見つけるように焦点位置変更スライダー１０２のつまみ１０３の位置を調整する（ステップＳ１０）。そして、つまみ１０３を或る位置にしたときに合焦状態であると判断したならば（ステップＳ９でＹｅｓ）、焦点位置合わせ画面１００の下部に配置されている「決定」ボタン１０４をクリック操作することで焦点位置の決定を指示する（ステップＳ１２）。合焦処理部２６はこの指示を受けて、その時点におけるつまみ１０３の位置に応じた焦点位置が、そのときの焦点位置合わせ対象範囲２２０が含まれる同一焦点位置適用範囲２１０についての焦点位置であることを示す情報を焦点位置情報記憶部２７に格納する（ステップＳ１３）。 ¡In the focal position comparison images with different focal positions, the image blur is slightly different. Therefore, the observer determines, for example, whether or not the focused part such as the outline or pattern of the cell looks the clearest, that is, whether or not the focused part is in focus (step S9), and the in-focus state is the most focused. The position of the knob 103 of the focal position changing slider 102 is adjusted so as to find the position (step S10). If it is determined that the in-focus state is obtained when the knob 103 is moved to a certain position (Yes in step S9), the “OK” button 104 arranged at the bottom of the focus position alignment screen 100 is clicked. Thus, the determination of the focal position is instructed (step S12). Upon receiving this instruction, the focusing processing unit 26 has the focal position corresponding to the position of the knob 103 at that time as the focal position for the same focal position application range 210 including the focus alignment target range 220 at that time. Information indicating this is stored in the focal position information storage unit 27 (step S13).
　ただし、上述したようにデフォルトで定められている焦点位置の変化のピッチが粗すぎる、或いは、実際の合焦位置がデフォルトで定められている焦点位置の変化の範囲から外れているような場合には、観察者が焦点位置変更スライダー１０２のつまみ１０３の位置を調整しても合焦状態であると判断できる状態にならないことがある。その場合には、観察者は入力部３による所定の操作に応じて例えばポップアップ表示されるパラメータ設定用のダイアログ画面で、焦点位置変更スライダー１０２に割り当てる焦点位置の変化の範囲やピッチを適宜変更する（ステップＳ１１）。こうした変更が行われると、表示処理部２８はその変更後の焦点位置の変化範囲及びピッチを焦点位置変更スライダー１０２に割り当てる。そして、例えばその焦点位置の変化範囲内で最大又は最小の焦点位置に対応する焦点位置比較画像を画像データ記憶部２５から選択して画像表示枠１０１中に表示する（ステップＳ７）。このように上述したステップＳ７～Ｓ１１の繰り返しにより、観察者は焦点位置比較画像を見ながら適切な焦点位置を決めることができる。 However, as described above, the default focus position change pitch is too coarse, or the actual focus position is out of the default focus position change range. In some cases, even if the observer adjusts the position of the knob 103 of the focal position changing slider 102, it cannot be determined that the in-focus state is achieved. In this case, the observer appropriately changes the focal position change range and pitch assigned to the focal position change slider 102 on a parameter setting dialog screen, for example, pop-up displayed in response to a predetermined operation by the input unit 3. (Step S11). When such a change is made, the display processing unit 28 assigns the change range and pitch of the changed focus position to the focus position change slider 102. Then, for example, a focus position comparison image corresponding to the maximum or minimum focus position within the change range of the focus position is selected from the image data storage unit 25 and displayed in the image display frame 101 (step S7). Thus, by repeating the above-described steps S7 to S11, the observer can determine an appropriate focal position while viewing the focal position comparison image.
　なお、同一焦点位置適用範囲２１０を複数設定した場合には、その同一焦点位置適用範囲２１０に含まれる焦点位置合わせ対象範囲２２０毎に、図３に示した操作及び処理を実施すればよい。これにより、観察対象領域全体つまりは細胞培養プレート１２全体の位相画像についての焦点位置を決めることができる。そして、焦点位置が決まったならば、その焦点位置に対応した細胞培養プレート１２全体の又はその一部の位相画像を改めて作成する処理を実施すればよい。
　なお、強度画像や擬似位相画像については位相画像について求めた焦点位置を利用してもよいし、或いは、強度画像や擬似位相画像について位相画像と同様の手法で焦点位置を決めるようにしてもよい。 When a plurality of the same focal position application range 210 is set, the operations and processes shown in FIG. 3 may be performed for each focal position alignment target range 220 included in the same focal position application range 210. Thereby, the focus position about the phase image of the whole observation object area | region, ie, the whole cell culture plate 12, can be determined. When the focal position is determined, a process of newly creating a phase image of the whole cell culture plate 12 or a part thereof corresponding to the focal position may be performed.
Note that the focus position obtained for the phase image may be used for the intensity image and the pseudo phase image, or the focus position may be determined for the intensity image and the pseudo phase image by the same method as the phase image. .
　上記実施例の細胞観察装置では、観察者がスライダーを手動で操作するのに対応して異なる焦点位置比較画像が次々に表示されるが、焦点位置が相違する複数の焦点位置比較画像が自動的に次々に表示される自動再生機能を付加してもよい。この場合、焦点位置比較画像の自動再生を指示するボタンを用意しておき、そのボタンが操作されたならば、そのときに定められている焦点位置変化範囲内の焦点位置比較画像を自動的に順番に表示することで動画のように再生するとよい。このとき、再生の速度を調整できるようにしてもよい。こうした自動再生は特に、観察者がおおまかな焦点位置を判断するのに都合がよい。 In the cell observation apparatus of the above embodiment, different focal position comparison images are displayed one after another in response to the observer manually operating the slider, but a plurality of focal position comparison images having different focal positions are automatically displayed. An automatic playback function that is displayed one after another may be added. In this case, a button for instructing automatic reproduction of the focal position comparison image is prepared, and when the button is operated, the focal position comparison image within the focal position change range determined at that time is automatically selected. It is good to reproduce like a movie by displaying in order. At this time, the playback speed may be adjusted. Such automatic reproduction is particularly convenient for the observer to determine a rough focus position.
　また、図１に示した実施例の構成では、制御・処理部２において全ての処理を実施しているが、一般に、ホログラムデータに基づく位相情報の計算やその計算結果の画像化には膨大な量の計算が必要である。そのため、通常使用されているパーソナルコンピュータでは計算に多大な時間が掛かり効率的な解析作業は難しい。そこで、顕微観察部１に接続されたパーソナルコンピュータを端末装置とし、この端末装置と高性能なコンピュータであるサーバとがインターネットやイントラネット等の通信ネットワークを介して接続されたコンピュータシステムを利用してもよい。この場合、ホログラムデータに基づく位相情報の計算や位相画像の作成などの複雑な処理はサーバ側で実施し、それによって作成された画像データを端末装置が受け取って、この画像データに基づいて位相画像を表示する処理を端末装置側で行うようにするとよい。こうした構成では、図１に示した制御・処理部２の機能ブロックが端末装置側とサーバ側とに分離されることになる。このように、制御・処理部２の機能は複数のコンピュータで分担しても構わない。 In the configuration of the embodiment shown in FIG. 1, all processing is performed in the control / processing unit 2. However, in general, calculation of phase information based on hologram data and imaging of the calculation result are enormous. A quantity calculation is required. For this reason, a normally used personal computer takes a long time for calculation, and an efficient analysis work is difficult. Therefore, a personal computer connected to the microscopic observation unit 1 is used as a terminal device, and a computer system in which this terminal device and a server that is a high-performance computer are connected via a communication network such as the Internet or an intranet is also used. Good. In this case, complicated processing such as calculation of phase information based on hologram data and creation of a phase image is performed on the server side, and the terminal device receives image data created thereby, and a phase image is generated based on this image data. It is preferable to perform the process of displaying the message on the terminal device side. In such a configuration, the functional blocks of the control / processing unit 2 shown in FIG. 1 are separated into the terminal device side and the server side. As described above, the functions of the control / processing unit 2 may be shared by a plurality of computers.
　また上記実施例の細胞観察装置では、顕微観察部１としてインライン型ホログラフィック顕微鏡を用いていたが、ホログラムが得られる顕微鏡であれば、オフアクシス型、位相シフト型などの他の方式のホログラフィック顕微鏡に置換え可能であることは当然である。 In the cell observation apparatus of the above embodiment, an in-line type holographic microscope is used as the microscopic observation unit 1, but other types of holographic methods such as an off-axis type and a phase shift type may be used as long as the microscope can obtain a hologram. Of course, it can be replaced by a microscope.
　さらにまた、上記実施例及び上記記載の変形例はいずれも本発明の一例であり、本発明の趣旨の範囲でさらに適宜の変更、修正、追加を行っても本願特許請求の範囲に包含されることは当然である。 Furthermore, each of the above-described embodiments and the above-described modified examples is an example of the present invention, and further appropriate changes, modifications, and additions within the scope of the present invention are included in the scope of the claims of the present application. It is natural.
１…顕微観察部
１０…光源部
１１…イメージセンサ
１２…細胞培養プレート
１３…細胞
１４…移動部
１５…参照光
１６…物体光
２…制御・処理部
２０…撮影制御部
２１…測定データ記憶部
２２…位相情報算出部
２３…全体画像作成部
２４…焦点位置比較画像作成部
２５…画像データ記憶部
２６…合焦処理部
２７…焦点位置情報記憶部
２８…表示処理部
２９…操作受付処理部
３…入力部
４…表示部
１００…焦点位置合わせ画面
１０１…画像表示枠
１０２…焦点位置変更スライダー
１０３…つまみ
１０４…「決定」ボタン DESCRIPTION OF SYMBOLS 1 ... Microscopic observation part 10 ... Light source part 11 ... Image sensor 12 ... Cell culture plate 13 ... Cell 14 ... Moving part 15 ... Reference light 16 ... Object light 2 ... Control / processing part 20 ... Imaging | photography control part 21 ... Measurement data storage part 22 ... Phase information calculation unit 23 ... Whole image creation unit 24 ... Focus position comparison image creation unit 25 ... Image data storage unit 26 ... Focus processing unit 27 ... Focus position information storage unit 28 ... Display processing unit 29 ... Operation acceptance processing unit 3 ... Input unit 4 ... Display unit 100 ... Focus position adjustment screen 101 ... Image display frame 102 ... Focus position change slider 103 ... Knob 104 ... "OK" button

Claims (8)

  1. 　細胞を含む試料をホログラフィック顕微鏡で測定することにより得られたホログラムデータに基づく演算処理を行うことで、位相、強度、又は擬似位相の少なくともいずれかの２次元分布を示す再構成画像を作成して表示部に表示する細胞観察装置であって、
    　a)取得されたホログラムデータに基づいて観察対象領域の全体又はその一部の領域について焦点位置が相違する複数の再構成画像を作成する焦点位置比較画像作成部と、
    　b)前記焦点位置が相違する複数の再構成画像のうちの一つが表示される画像表示枠と、焦点位置を所定範囲で変化させるための操作子であるスライダーとが配置された画面を前記表示部に表示する焦点位置合わせ用表示処理部と、
    　c)ユーザによる前記スライダーの操作に応じて前記焦点位置が相違する複数の再構成画像を選択し、前記画像表示枠中に描出させる焦点位置比較画像表示処理部と、
    　d)ユーザにより指定された前記焦点位置が相違する複数の再構成画像のうちの一つに対応する焦点位置を合焦位置であると決定する合焦位置決定部と、
    　を備えることを特徴とする細胞観察装置。     By performing arithmetic processing based on hologram data obtained by measuring a sample containing cells with a holographic microscope, a reconstructed image showing a two-dimensional distribution of at least one of phase, intensity, and pseudo phase is created. A cell observation device for displaying on a display unit,
    a) a focal position comparison image creating unit that creates a plurality of reconstructed images having different focal positions for the entire observation target region or a partial region thereof based on the acquired hologram data;
    b) Displaying a screen on which an image display frame on which one of a plurality of reconstructed images having different focal positions is displayed and a slider that is an operator for changing the focal position within a predetermined range are displayed. A focus alignment display processing unit to be displayed on the screen;
    c) a plurality of reconstructed images having different focal positions according to the operation of the slider by the user, and a focal position comparison image display processing unit that is rendered in the image display frame;
    d) a focus position determination unit that determines that the focus position corresponding to one of a plurality of reconstructed images having different focus positions specified by the user is the focus position;
    A cell observation apparatus comprising:
  2. 　請求項１に記載の細胞観察装置であって、
    　前記試料は細胞培養プレートであり、前記観察対象領域は該細胞培養プレート全体又は該プレートに形成されている一又は複数のウェルが含まれる領域であることを特徴とする細胞観察装置。     The cell observation apparatus according to claim 1,
    The cell observation apparatus, wherein the sample is a cell culture plate, and the observation target region is the entire cell culture plate or a region including one or a plurality of wells formed on the plate.
  3. 　請求項１に記載の細胞観察装置であって、
    　前記スライダーに割り当てられる焦点位置の変化の範囲及びその変化のピッチをユーザが設定するための焦点位置合わせパラメータ設定部をさらに備えることを特徴とする細胞観察装置。     The cell observation apparatus according to claim 1,
    A cell observation apparatus, further comprising a focus alignment parameter setting unit for a user to set a range of change in focus position assigned to the slider and a pitch of the change.
  4. 　請求項１に記載の細胞観察装置であって、
    　前記表示部に表示されている観察対象領域の全体又はその一部の領域についての再構成画像である広範囲表示画像上で、同一の焦点位置を適用可能である同一焦点位置適用範囲をユーザが指定するための範囲指定部、をさらに備え、
    　前記合焦位置決定部は、前記範囲指定部により指定された同一焦点位置適用範囲毎に合焦位置を決定することを特徴とする細胞観察装置。     The cell observation apparatus according to claim 1,
    The user designates the same focal position application range in which the same focal position can be applied on the wide-range display image which is a reconstructed image of the entire observation target area displayed on the display unit or a part of the observation target area. A range designating unit for
    The in-focus position determination unit determines an in-focus position for each same focal position application range designated by the range designation unit.
  5. 　請求項４に記載の細胞観察装置であって、
    　前記広範囲表示画像上の一部の範囲をユーザが拡大観察範囲として指定するための拡大観察範囲指定部と、
    　該指定された拡大観察範囲について少なくとも前記広範囲表示画像よりも倍率の高い拡大画像を作成し該拡大画像を前記表示部の画面上に表示する拡大画像作成部と、
    　をさらに備えることを特徴とする細胞観察装置。     The cell observation device according to claim 4,
    An enlarged observation range designating unit for the user to designate a partial range on the wide-range display image as an enlarged observation range;
    An enlarged image creating unit that creates an enlarged image with a magnification higher than at least the wide-range display image for the designated enlarged observation range, and displays the enlarged image on the screen of the display unit;
    A cell observation device further comprising:
  6. 　請求項５に記載の細胞観察装置であって、
    　前記表示部に表示されている前記広範囲表示画像上の前記拡大観察範囲を移動させる又は拡大若しくは縮小させる操作をユーザが行うための操作部をさらに備え、
    　前記拡大画像作成部は、前記操作部を介した操作による移動後の又は拡大若しくは縮小後の拡大画像を作成して表示することを特徴とする細胞観察装置。     The cell observation device according to claim 5,
    An operation unit for a user to perform an operation of moving or enlarging or reducing the enlarged observation range on the wide-range display image displayed on the display unit;
    The cell observation apparatus, wherein the enlarged image creation unit creates and displays an enlarged image after movement or after enlargement or reduction by an operation via the operation unit.
  7. 　請求項４に記載の細胞観察装置であって、
    　一又は複数の前記同一焦点位置適用範囲においてそれぞれ焦点位置の決定に使用する焦点位置合わせ対象範囲をユーザが指定するための焦点位置合わせ対象範囲指定部をさらに備えることを特徴とする細胞観察装置。     The cell observation device according to claim 4,
    A cell observation apparatus, further comprising: a focus alignment target range specifying unit for a user to specify a focus alignment target range used for determining a focus position in one or a plurality of the same focus position application ranges.
  8. 　請求項７に記載の細胞観察装置であって、
    　前記焦点位置比較画像作成部は、前記焦点位置合わせ対象範囲について焦点位置が相違する複数の再構成画像を作成することを特徴とする細胞観察装置。     The cell observation device according to claim 7,
    The cell observation apparatus, wherein the focal position comparison image creating unit creates a plurality of reconstructed images having different focal positions for the focal position alignment target range.
PCT/JP2017/007728 2017-02-28 2017-02-28 Cell observation device WO2018158810A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2019502314A JP6760477B2 (en) 2017-02-28 2017-02-28 Cell observation device
PCT/JP2017/007728 WO2018158810A1 (en) 2017-02-28 2017-02-28 Cell observation device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2017/007728 WO2018158810A1 (en) 2017-02-28 2017-02-28 Cell observation device

Publications (1)

Publication Number Publication Date
WO2018158810A1 true WO2018158810A1 (en) 2018-09-07

Family

ID=63371117

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/007728 WO2018158810A1 (en) 2017-02-28 2017-02-28 Cell observation device

Country Status (2)

Country Link
JP (1) JP6760477B2 (en)
WO (1) WO2018158810A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190121112A1 (en) * 2017-10-25 2019-04-25 Olympus Corporation Image processing device and microscope system
WO2021261158A1 (en) * 2020-06-25 2021-12-30 富士フイルム株式会社 Information processing device, and operating method and operating program for same
WO2021261150A1 (en) * 2020-06-25 2021-12-30 富士フイルム株式会社 Information processing device, operation method for same, and operation program for same

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009047460A (en) * 2007-08-15 2009-03-05 Lasertec Corp Confocal microscope
WO2011089908A1 (en) * 2010-01-20 2011-07-28 株式会社ニコン Cell observation device and cell culture method
WO2012005315A1 (en) * 2010-07-07 2012-01-12 兵庫県 Holographic microscope, microscopic subject hologram image recording method, method of creation of hologram for reproduction of high-resolution image, and method for reproduction of image
WO2013070287A1 (en) * 2011-11-07 2013-05-16 The Regents Of The University Of California Maskless imaging of dense samples using multi-height lensfree microscope
JP2015082095A (en) * 2013-10-24 2015-04-27 株式会社キーエンス Image processing device, microscope system, image processing method and program
JP2016001274A (en) * 2014-06-12 2016-01-07 レーザーテック株式会社 Laser microscope and scanner
WO2016163560A1 (en) * 2015-04-09 2016-10-13 国立大学法人神戸大学 Digital holographic microscope

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4667944B2 (en) * 2005-04-20 2011-04-13 シスメックス株式会社 Image creation device
JP5048038B2 (en) * 2009-11-05 2012-10-17 シスメックス株式会社 Blood cell classification result display method and blood cell classification result display program
JP5996334B2 (en) * 2012-08-28 2016-09-21 オリンパス株式会社 Microscope system, specimen image generation method and program
WO2016146279A1 (en) * 2015-03-13 2016-09-22 Universite Paris Descartes Optical system for shaping the wavefront of the electric field of an input light beam

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009047460A (en) * 2007-08-15 2009-03-05 Lasertec Corp Confocal microscope
WO2011089908A1 (en) * 2010-01-20 2011-07-28 株式会社ニコン Cell observation device and cell culture method
WO2012005315A1 (en) * 2010-07-07 2012-01-12 兵庫県 Holographic microscope, microscopic subject hologram image recording method, method of creation of hologram for reproduction of high-resolution image, and method for reproduction of image
WO2013070287A1 (en) * 2011-11-07 2013-05-16 The Regents Of The University Of California Maskless imaging of dense samples using multi-height lensfree microscope
JP2015082095A (en) * 2013-10-24 2015-04-27 株式会社キーエンス Image processing device, microscope system, image processing method and program
JP2016001274A (en) * 2014-06-12 2016-01-07 レーザーテック株式会社 Laser microscope and scanner
WO2016163560A1 (en) * 2015-04-09 2016-10-13 国立大学法人神戸大学 Digital holographic microscope

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190121112A1 (en) * 2017-10-25 2019-04-25 Olympus Corporation Image processing device and microscope system
US10690902B2 (en) * 2017-10-25 2020-06-23 Olympus Corporation Image processing device and microscope system
WO2021261158A1 (en) * 2020-06-25 2021-12-30 富士フイルム株式会社 Information processing device, and operating method and operating program for same
WO2021261150A1 (en) * 2020-06-25 2021-12-30 富士フイルム株式会社 Information processing device, operation method for same, and operation program for same
JP7364796B2 (en) 2020-06-25 2023-10-18 富士フイルム株式会社 Information processing device, its operating method and operating program
JP7397196B2 (en) 2020-06-25 2023-12-12 富士フイルム株式会社 Information processing device, its operating method and operating program

Also Published As

Publication number Publication date
JP6760477B2 (en) 2020-09-23
JPWO2018158810A1 (en) 2019-12-19

Similar Documents

Publication Publication Date Title
CN110214290B (en) Micro-spectral measurement method and system
JP5132867B2 (en) Method and apparatus for forming and using virtual microscope slide, and program
JP6860064B2 (en) Cell observation device
JP6503221B2 (en) Three-dimensional information acquisition apparatus and three-dimensional information acquisition method
CN103649992B (en) For the method for the focal plane for automatically adjusting digital pathological image
WO2018158810A1 (en) Cell observation device
US10798333B2 (en) Cell observation system
JP2015082095A (en) Image processing device, microscope system, image processing method and program
JP6950813B2 (en) Cell observation device
US20050117816A1 (en) Virtual microscope-device and method
JP2008281771A (en) Microscopic-measurement apparatus
WO2018158946A1 (en) Cell observation apparatus
KR100897674B1 (en) Sample inspection system and sample inspection method
JP6293453B2 (en) Edge measurement video tool parameter setting user interface
JP5319184B2 (en) Microscope system and microscope control program
Kankaanpää et al. BioImageXD-new open source free software for the processing, analysis and visualization of multidimensional microscopic images
JP2018139532A (en) Cell observation device
JP4046161B2 (en) Sample image data processing method and sample inspection system
JP7036192B2 (en) Cell observation device
Almendarez-Rangel et al. Finding trap stiffness of optical tweezers using digital filters
JP2006153636A (en) 3-dimensional measurement method and program making computer perform 3-dimensional measurement method
JP2023130870A (en) Microscope system, superimposing unit, and operating method
JP2006331852A (en) Surface observation analyzer
WO2013099190A1 (en) Display data generating apparatus and control method for the same
Conklin Tutorial for Collecting and Processing Images of Composite Structures to Determine the Fiber Volume Fraction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899111

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019502314

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17899111

Country of ref document: EP

Kind code of ref document: A1