WO2018163641A1 - Observation device, observation system, control method for observation device, and recording medium recorded with control program for observation device - Google Patents

Abstract

Provided is an observation device (100) comprising an imaging unit (151), a movement mechanism (160), an operation input unit (180), and an observation side control circuit (110). The imaging unit (151) includes an imaging optical system (152) and an imaging element (153) to image a specimen, thereby generating image data. The movement mechanism (160) moves the imaging unit (151). The operation input unit (180) is configured to receive an input for operation of temporary suspension. The observation side control unit (110) makes the movement mechanism (160) move the position of the imaging unit (151) in accordance with a prescribed operation sequence, makes the imaging unit (151) perform imaging to acquire the generated image data, and acquires an input to the operation input unit (180), whereby the operation sequence is temporarily suspended in accordance with the input.

Description

Observation device, observation system, control method for observation device, and recording medium on which control program for observation device is recorded

The present invention relates to an observation apparatus, an observation system, an observation apparatus control method, and a recording medium on which an observation apparatus control program is recorded.

When cells are cultured, there is a demand for grasping the state of the cells. In addition, for culturing cells and the like, operations such as medium exchange and passage are required. For example, Japanese Patent Application Laid-Open No. 2007-110932 relates to a cell culture device that acquires images by photographing cells in culture using a color camera and manages a culture schedule based on the obtained images. Technology is disclosed. This cell culture device judges the necessity of medium replacement or passage work based on an image obtained by photographing, and automatically performs medium replacement or passage work when necessary.

For example, an apparatus for controlling all of the operations such as management of culture schedule and medium exchange and subculture, such as a cell culture apparatus disclosed in Japanese Patent Application Laid-Open No. 2007-110932, becomes large-scale. The structure of the apparatus becomes simpler when the observation is performed according to a predetermined observation schedule and the operations such as medium replacement and passage are performed according to the user's judgment and operation as necessary. In such an apparatus, it is necessary to perform processing such that a predetermined observation is not performed during operations such as medium replacement and passage.

An object of the present invention is to temporarily stop an operation sequence with a simple operation in an apparatus that performs imaging according to a predetermined operation sequence.

According to an aspect of the present invention, an observation apparatus includes an imaging optical system and an imaging element, and an imaging unit that images a sample to generate image data, a moving mechanism that moves the imaging unit, and a temporary stop In accordance with an operation input unit configured to input the operation, and according to a predetermined operation sequence, the position of the imaging unit is moved by the moving mechanism, and the image data generated by causing the imaging unit to capture the image data is acquired. And a control unit that acquires an input to the operation input unit and temporarily stops the operation sequence according to the input.

According to an aspect of the present invention, an observation system includes an imaging optical system and an imaging element, and an imaging unit that images a sample to generate image data, a moving mechanism that moves the imaging unit, and a temporary stop In accordance with an operation input unit configured to input the operation, and according to a predetermined operation sequence, the position of the imaging unit is moved by the moving mechanism, and the image data generated by causing the imaging unit to capture the image data is acquired. And obtaining information related to the input to the operation input unit from the first control unit, and an observation device having a first control unit for acquiring an input to the operation input unit, An instruction to move the position of the imaging unit to the control unit, an instruction to cause the imaging unit to perform imaging, and an instruction to temporarily stop the operation sequence in response to an input to the operation input unit. Has two control units And a controller.

According to one aspect of the present invention, an imaging unit that includes an imaging optical system and an imaging element and captures a sample to generate image data, a moving mechanism that moves the imaging unit, and an operation for pause are input. The method for controlling an observation apparatus including an operation input unit configured to be generated by causing the moving mechanism to move the position of the imaging unit and causing the imaging unit to capture an image according to a predetermined operation sequence. Acquiring the processed image data, and acquiring an input to the operation input unit and temporarily stopping the operation sequence according to the input.

According to one aspect of the present invention, an imaging unit that includes an imaging optical system and an imaging element and captures a sample to generate image data, a moving mechanism that moves the imaging unit, and an operation for pause are input. A recording medium on which a control program of an observation apparatus including an operation input unit configured to be recorded is a code for moving the position of the imaging unit to the moving mechanism according to a predetermined operation sequence, A code for acquiring the image data generated by imaging by the imaging unit, and a code for acquiring an input to the operation input unit and temporarily stopping the operation sequence according to the input .

According to the present invention, in an apparatus that performs shooting according to a predetermined operation sequence, the operation sequence can be paused with a simple operation.

FIG. 1 is a schematic diagram illustrating an outline of an appearance of an observation system according to an embodiment. FIG. 2 is a block diagram illustrating an outline of a configuration example of an observation system according to an embodiment. FIG. 3 is a schematic diagram for explaining observation of a sample by the image acquisition unit according to the embodiment. FIG. 4 is a timing chart for explaining an example of a project executed by the observation system according to the embodiment. FIG. 5 is a schematic diagram illustrating an outline of an example of a configuration of a project management file according to an embodiment. FIG. 6 is a flowchart illustrating an outline of an example of processing performed by the controller of the observation system according to the embodiment. FIG. 7 is a flowchart illustrating an outline of an example of processing performed by the observation device of the observation system according to the embodiment. FIG. 8A is a flowchart illustrating an outline of an example of a project control process performed by the observation apparatus according to an embodiment. FIG. 8B is a flowchart illustrating an outline of an example of a photographing operation process performed by the observation apparatus according to the embodiment. FIG. 8C is a flowchart illustrating an outline of an example of the interval operation process performed by the observation apparatus according to the embodiment. FIG. 8D is a flowchart illustrating an outline of an example of an interval stop process performed by the observation apparatus according to an embodiment. FIG. 8E is a flowchart illustrating an outline of an example of a stop process during photographing performed by the observation apparatus according to an embodiment. FIG. 9 is a timing chart for explaining an example of a project executed by the observation system according to the embodiment. FIG. 10 is a schematic diagram showing an outline of an example of the configuration of a project management file according to an embodiment. FIG. 11 is a schematic diagram illustrating an outline of an example of the configuration of a project management file according to an embodiment. FIG. 12 is a timing chart for explaining an example of a project executed by the observation system according to the embodiment.

[Configuration of observation system]
<Outline of observation system>
The observation system according to the present embodiment is a system for photographing a cell, a cell group, a tissue or the like in culture and recording the number, form, etc. of the cell or cell group. FIG. 1 is a schematic diagram showing an outline of the appearance of the observation system 1. FIG. 2 is a block diagram showing an outline of a configuration example of the observation system 1. The observation system 1 includes an observation device 100 and a controller 200. The observation apparatus 100 has a substantially flat plate shape. A sample 300 to be observed is arranged on the upper surface of the observation apparatus 100, and the observation apparatus 100 and the sample 300 are installed in, for example, an incubator. For the following explanation, an X axis and a Y axis that are orthogonal to each other are defined in a plane parallel to the plane on which the sample 300 of the observation apparatus 100 is arranged, and a Z axis is defined to be orthogonal to the X axis and the Y axis. .

The observation apparatus 100 includes a housing 101, a transparent plate 102, and an image acquisition unit 150. A transparent plate 102 is disposed on the upper surface of the housing 101. The image acquisition unit 150 is provided inside the housing 101, illuminates the sample 300 through the transparent plate 102, and captures an image of the sample 300. On the other hand, the controller 200 is installed outside the incubator, for example. The observation apparatus 100 and the controller 200 communicate with each other. The controller 200 transmits various instructions to the observation apparatus 100 and acquires and analyzes data obtained from the observation apparatus 100.

The observation system 1 can photograph a wide range of the sample 300 by performing repeated photographing while the image acquisition unit 150 moves in the X-axis direction and the Y-axis direction in one observation operation. In addition, the observation system 1 repeatedly performs such an observation operation while providing intervals according to a predetermined sequence.

<Sample>
A sample 300 that is a measurement target of the observation system 1 is, for example, as follows. The sample 300 includes, for example, a container 310, a culture medium 322, cells 324, and a reflection plate 360. A medium 322 is placed in the container 310, and cells 324 are cultured in the medium 322. The container 310 can be, for example, a petri dish, a culture flask, a multiwell plate, or the like. Thus, the container 310 is a culture container for culturing a biological sample, for example. The shape, size, etc. of the container 310 are not limited. The medium 322 may be a liquid medium or a solid medium. The cell 324 to be measured is, for example, a cultured cell, which may be an adhesive cell or a floating cell. The cell 324 may be a spheroid or a tissue. Furthermore, the cell 324 may be derived from any organism, and may be a fungus or the like. Thus, the sample 300 includes a biological sample that is a living organism or a sample derived from a living organism. The reflection plate 360 is for illuminating the cells 324 by reflecting the illumination light incident on the sample 300 via the transparent plate 102, and is disposed on the upper surface of the container 310.

<About the observation device>
The transparent plate 102 disposed on the upper surface of the casing 101 of the observation apparatus 100 is made of, for example, glass. The sample 300 is placed on the transparent plate 102. FIG. 1 shows an example in which the entire upper surface of the housing 101 is formed of a transparent plate, but the observation apparatus 100 is provided with a transparent plate on a part of the upper surface of the housing 101. The other part of the upper surface may be configured to be opaque.

Further, in order to unify the position where the sample 300 is arranged on the transparent plate 102, the transparent plate 102 may be provided with a mark. Further, in order to unify the position where the sample 300 is arranged and to fix the sample 300, a fixing frame may be put on the transparent plate 102 and used.

The image acquisition unit 150 provided inside the housing 101 includes an imaging unit 151, an illumination unit 155, and a support unit 165. As shown in FIG. 1, the illumination unit 155 is provided on the support unit 165. In addition, an imaging unit 151 is provided in the vicinity of the illumination unit 155 of the support unit 165.

As shown in FIG. 2, the illumination unit 155 includes an illumination optical system 156 and a light source 157. The illumination light emitted from the light source 157 is irradiated onto the sample 300 via the illumination optical system 156. The light source 157 includes, for example, an LED. The imaging unit 151 includes an imaging optical system 152 and an imaging element 153. The imaging unit 151 generates image data based on an image formed on the imaging surface of the imaging element 153 via the imaging optical system 152. The imaging optical system 152 is preferably a zoom optical system that can change the focal length. The imaging unit 151 captures the direction of the sample 300, that is, the Z-axis direction, and acquires an image of the sample 300.

FIG. 3 is a schematic diagram showing an outline of a configuration example of the image acquisition unit 150 and a sample. As shown in this figure, the illumination light emitted from the illumination optical system 156 of the illumination unit 155 provided on the support unit 165 is irradiated toward the reflection plate 360 provided on the upper surface of the container 310, and the reflection plate 360. Reflect on. The reflected light illuminates the cell 324 and enters the imaging optical system 152 of the imaging unit 151. The imaging unit 151 performs a shooting operation on the light incident on the imaging optical system 152.

Referring back to FIGS. 1 and 2, the description of the configuration of the observation system 1 will be continued. The observation apparatus 100 includes a moving mechanism 160. The moving mechanism 160 includes an X feed screw 161 and an X actuator 162 for moving the support portion 165 in the X-axis direction. The moving mechanism 160 includes a Y feed screw 163 and a Y actuator 164 for moving the support portion 165 in the Y-axis direction.

The shooting position in the Z-axis direction is changed by changing the focus position of the imaging optical system 152 of the imaging unit 151. In other words, the imaging optical system 152 includes a focusing adjustment mechanism for moving the focusing lens in the optical axis direction, for example. Instead of or together with the focus adjustment mechanism, the moving mechanism 160 may include a Z feed screw and a Z actuator for moving the support portion 165 in the Z-axis direction.

The observation apparatus 100 repeatedly captures images using the imaging unit 151 while acquiring the plurality of images at different positions while changing the position of the image acquisition unit 150 in the X direction and the Y direction using the moving mechanism 160. The observation apparatus 100 may generate an image representing one wide range by combining these images.

Further, the observation apparatus 100 performs repeated shooting while changing the position in the X direction and the Y direction while changing the shooting position in the Z-axis direction, and synthesizes them to form an image at each Z-direction position. May be acquired sequentially. In this way, an image in each three-dimensional part may be acquired.

The housing 101 is provided with a first stop button 181 and a second stop button 182 as the operation input unit 180. The first stop button 181 is a button that is pressed when the user replaces the medium. When the first stop button 181 is pressed, the operation of the observation apparatus 100 is temporarily stopped. The second stop button 182 is a button that is pressed when the user performs substituting work, and when the second stop button 182 is pressed, the operation of the observation apparatus 100 is temporarily stopped. The subsequent operation of the observation apparatus 100 may be different when the first stop button 181 is pressed and when the second stop button 182 is pressed. In the following description, it is not necessary to distinguish between the first stop button 181 and the second stop button 182, and when any button is acceptable, it is simply described as a stop button.

The observation apparatus 100 includes a circuit group 104. The circuit group 104 includes an observation-side control circuit 110, an image processing circuit 120, an observation-side recording circuit 130, an observation-side communication device 140, and a clock unit 172.

The observation-side recording circuit 130 records, for example, a program used in each part of the observation apparatus 100, various control parameters, a movement pattern of the image acquisition unit 150, and the like. The observation-side recording circuit 130 records data obtained by the observation apparatus 100. This data includes a project management file, an image file, etc., which will be described later.

The image processing circuit 120 performs various types of image processing on the image data obtained by the imaging unit 151. Data after image processing by the image processing circuit 120 is recorded in, for example, the observation-side recording circuit 130 or transmitted to the controller 200. Further, the image processing circuit 120 may perform various analyzes based on the obtained image. For example, the image processing circuit 120 may extract an image of a cell or cell group included in the sample 300 based on the obtained image, calculate the number of cells or cell groups, and the like. The analysis result obtained in this way is also recorded in the observation-side recording circuit 130 or transmitted to the controller 200, for example.

The observation side communication device 140 is a communication device for performing communication with the controller 200. For this communication, wireless communication using, for example, Wi-Fi (registered trademark) or Bluetooth (registered trademark) is used. Further, the observation apparatus 100 and the controller 200 may be connected to each other by a wired communication to communicate with each other, or may be connected to an electrical communication line such as the Internet and communicate via an electrical communication line such as the Internet. It may be broken.

The observation side control circuit 110 controls the operation of each unit included in the observation apparatus 100. The observation-side control circuit 110 includes functions as a position control unit 111, an imaging control unit 112, an illumination control unit 113, a communication control unit 114, a recording control unit 115, and a measurement control unit 116. The position control unit 111 controls the operation of the moving mechanism 160 and controls the position of the image acquisition unit 150. The imaging control unit 112 controls the imaging operation of the imaging unit 151. The illumination control unit 113 controls the operation of the illumination unit 155. The communication control unit 114 manages communication with the controller 200 via the observation side communication device 140. The recording control unit 115 controls recording of data obtained by the observation apparatus 100. For example, the recording control unit 115 records an image file in the observation-side recording circuit 130, or creates or updates a project management file described later. The measurement control unit 116 performs various controls related to the execution of the project, such as observation and interval switching, operation pause and restart switching, and the like.

The clock unit 172 generates time information and outputs it to the observation side control circuit 110. The observation side control circuit 110 records various operation histories as a project management file using the time information.

<About the controller>
The controller 200 is, for example, a personal computer (PC), a tablet information terminal, or the like. FIG. 1 illustrates a tablet information terminal.

The controller 200 is provided with an input / output device 270 including a display device 272 such as a liquid crystal display and an input device 274 such as a touch panel. The input device 274 may include a switch, dial, keyboard, mouse, and the like in addition to the touch panel.

In addition, the controller 200 is provided with a terminal side communication device 240. The terminal side communication device 240 is a device for communicating with the observation side communication device 140. The observation apparatus 100 and the controller 200 communicate with each other via the observation side communication apparatus 140 and the terminal side communication apparatus 240.

Further, the controller 200 includes a terminal side control circuit 210 and a terminal side recording circuit 230. The terminal side control circuit 210 controls the operation of each unit of the controller 200. The terminal-side recording circuit 230 records programs and various parameters used in the terminal-side control circuit 210, for example. The terminal-side recording circuit 230 records data obtained by the observation device 100 and received from the observation device 100.

The terminal-side control circuit 210 has functions as a system control unit 211, a display control unit 212, a recording control unit 213, and a communication control unit 214. The system control unit 211 performs various calculations related to control for measurement of the sample 300. The display control unit 212 controls the operation of the display device 272. The recording control unit 213 controls information recording in the terminal-side recording circuit 230. The communication control unit 214 controls communication with the observation device 100 via the terminal side communication device 240. Further, the terminal-side control circuit 210 may perform various analyzes based on images acquired from the observation apparatus 100. For example, the terminal-side control circuit 210 may extract a cell or cell group image included in the sample 300 based on the obtained image, calculate the number of cells or cell groups, and the like.

The observation-side control circuit 110, the image processing circuit 120, and the terminal-side control circuit 210 include an integrated circuit such as Central Processing Unit (CPU), Application Specific Integrated Circuit (ASIC), or Field Programmable Gate Array (FPGA). The observation side control circuit 110, the image processing circuit 120, and the terminal side control circuit 210 may each be configured by one integrated circuit or the like, or may be configured by combining a plurality of integrated circuits. Further, the observation side control circuit 110 and the image processing circuit 120 may be configured by one integrated circuit or the like. The operation of these integrated circuits can be performed, for example, according to a program recorded in the observation-side recording circuit 130, the terminal-side recording circuit 230, or the integrated circuit. The observation-side recording circuit 130 and the terminal-side recording circuit 230 may include, for example, a non-volatile memory such as a flash memory, and a volatile memory such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM).

[Operation of observation system]
<Overview of operation>
An operation of the observation system 1 including the controller 200 and the observation apparatus 100 will be described. The controller 200 and the observation apparatus 100 communicate and cooperate with each other. In this embodiment, a series of operation sequences related to sample observation is managed as one project. FIG. 4 is a timing chart showing an outline of an example of one project. In this project, n observations are made at intervals. As described above, the operation sequence includes a sequence related to an operation period in which the imaging unit 151 or the moving mechanism 160 is operated and a sequence related to an interval period in which the operation of the imaging unit 151 or the moving mechanism 160 is paused. The observation interval between observations can be set as appropriate by the user.

In each observation repeated n times, the following operations are performed. That is, the image acquisition unit 150 is moved along a predetermined route by the operation of the moving mechanism 160. The imaging unit 151 provided in the image acquisition unit 150 performs a shooting operation and acquires an image when the image acquisition unit 150 reaches a predetermined position. Thus, by repeating imaging | photography in several different positions, the observation apparatus 100 can acquire the image of the range wider than the angle of view of the imaging part 151. FIG.

In this embodiment, a record relating to the implemented project is recorded in one project management file. A schematic diagram of an example of the project management file 610 is shown in FIG. In this embodiment, various histories related to a project are sequentially recorded in one project management file 610. Each record that is sequentially recorded is referred to as management information. The project management file 610 includes a plurality of management information. Each piece of management information records time information. The time information may be, for example, information related to the date and time when an event to be recorded as management information occurs, or may be information on elapsed time based on the start of the project. In addition, information indicating how many times the observation is related is recorded in each management information. Each management information includes information regarding various operations, a file name of image data obtained by the operations, and the like.

<Operation of controller>
The operation of the controller 200 will be described with reference to FIG. FIG. 6 is a flowchart illustrating an outline of an example of processing performed by the controller 200. This process starts when a program for controlling the operation of the observation apparatus 100 is started in the controller 200.

In step S101, the terminal-side control circuit 210 determines whether or not there has been an input request for setting the project by the user. For example, when the user selects a setting input request using the input device 274, it is determined that there is a project setting input request. When there is no project setting input request, the process proceeds to step S103. On the other hand, when there is a project setting input request, the process proceeds to step S102.

In step S102, the terminal-side control circuit 210 performs a project setting input process. That is, the terminal-side control circuit 210 acquires the project settings input by the user using the input / output device 270, determines the project settings, and creates an operation sequence. The determined project settings, operation sequence, and the like are recorded in the terminal-side recording circuit 230. Thereafter, the process proceeds to step S103.

In step S103, the terminal-side control circuit 210 determines whether or not there has been a request to start a project. For example, when the user selects a project start request using the input device 274, it is determined that there is a project start request. When there is no request to start a project, the process proceeds to step S105. On the other hand, when there is a request to start a project, the process proceeds to step S104.

In step S104, the terminal-side control circuit 210 performs a process of transmitting a project start instruction to the observation apparatus 100. That is, the controller 200 transmits a project start instruction to the observation device 100 via the terminal side communication device 240. At this time, the controller 200 transmits the project settings, operation sequence, and the like recorded in the terminal-side recording circuit 230 to the observation apparatus 100. Thereafter, the process proceeds to step S105.

In step S105, the terminal-side control circuit 210 determines whether or not there is a data analysis request. For example, when the user selects a data analysis request using the input device 274, it is determined that there is a data analysis request. When there is no data analysis request, the process proceeds to step S109. On the other hand, when there is a request for data analysis, the process proceeds to step S106.

In step S <b> 106, the terminal-side control circuit 210 performs a process of transmitting to the observation apparatus 100 a data transmission instruction that requests transmission of data acquired by the observation apparatus 100 to the controller 200. That is, the terminal-side control circuit 210 transmits a data transmission instruction to the observation apparatus 100 via the terminal-side communication device 240.

In step S107, the terminal-side control circuit 210 acquires the data transmitted from the observation apparatus 100 to the controller 200 in response to the data transmission instruction described above via the terminal-side communication apparatus 240. In step S108, the terminal-side control circuit 210 performs various analyzes on the acquired data. For example, the terminal-side control circuit 210 creates a composite image based on a plurality of images, or counts the number of cells included in the image. Thereafter, the process proceeds to step S109.

In step S109, the terminal-side control circuit 210 determines whether or not to end the processing of the controller. When the controller process is not terminated, the process returns to step S101. That is, the above-described processing for performing processing according to the input from the user is repeated. On the other hand, when it is determined to end, the processing of the controller ends.

<Operation of observation device>
The operation of the observation apparatus 100 will be described with reference to FIG. FIG. 7 is a flowchart illustrating an outline of an example of processing performed by the observation apparatus 100. This processing starts when the sample 300 is placed on the transparent plate 102 of the observation apparatus 100 installed in the incubator and the observation apparatus 100 is activated, for example.

In step S201, the observation-side control circuit 110 determines whether a project start instruction has been received. This project start instruction is the project start instruction transmitted from the controller 200 to the observation apparatus 100 in step S104 of the controller process. When the project start instruction has not been received, the process proceeds to step S203. On the other hand, when the project start instruction is received, the process proceeds to step S202.

In step S202, the observation-side control circuit 110 performs a project control process for controlling a project executed by the observation apparatus 100. Through the project control process, the observation apparatus 100 acquires observation data and the like. The project control process will be described in detail later. After the project control process, the process proceeds to step S203.

In step S203, the observation side control circuit 110 determines whether or not a data transmission instruction has been received. This data transmission instruction is a data transmission instruction transmitted from the controller 200 to the observation apparatus 100 in step S106 of the controller process. When the data transmission instruction has not been received, the process proceeds to step S205. On the other hand, when the data transmission instruction is received, the process proceeds to step S204.

In step S204, the observation-side control circuit 110 performs a data transmission process for transmitting data acquired by the observation apparatus 100 in the project to the controller 200. Based on the data transmitted here, for example, data analysis in step S108 of the controller process is performed. After the data transmission process, the process proceeds to step S205.

In step S205, the observation side control circuit 110 determines whether or not to end the processing of the observation apparatus. If the observation device process is not terminated, the process returns to step S201. That is, the above-described processing for performing processing according to the input from the controller 200 is repeated. On the other hand, when it is determined to end, the processing of the observation apparatus ends.

The project control process performed in step S202 will be described with reference to FIGS. 8A to 8E. FIG. 8A is a flowchart illustrating an outline of an example of the project control process.

In step S301, the observation-side control circuit 110 performs project setting. For example, the observation-side control circuit 110 sets a project based on information acquired from the controller 200 together with a project start instruction. As described with reference to FIG. 4, for example, the following is set for the project. The start timing of the first observation is set. Also, the number of observation repetitions is set. In addition, an interval (observation interval) between observations when observation is repeatedly performed is set. Instead of the number of observations, a time indicating how long the observation is repeated, that is, a project end time or the like may be set. In addition, an observation range in each observation, a focal length of the imaging optical system 152, an exposure time, and the like can be set. If these settings are determined, the time required for one observation is determined. If the time required for one observation is determined, the interval time between observations is determined according to the observation interval. For example, the parameters shown here are determined as project settings. Note that imaging conditions such as exposure time and focal length may be changed for each observation, or an optimum value may be determined in the first observation, and thereafter that value may be used. In consideration of comparing the results of each observation, it is preferable that the imaging conditions are constant.

In step S302, the observation side control circuit 110 starts a project. The observation side control circuit 110 performs various processes at the start of the project. This processing includes creation of a project management file.

In step S303, the observation side control circuit 110 updates the project management file. In step S303, as shown in FIG. 5, for example, as the management information 611 of the first time information 1 of the project management file 610, the information of the start time of the project, the first observation (observation 1), and its photographing The fact that the operation has started is recorded.

In step S304, the observation side control circuit 110 performs a photographing operation process. In the photographing operation process, photographing is repeated at different positions while the image acquisition unit 150 is moved by the moving mechanism 160. As a result, an image of the set observation range is acquired. When the acquisition of the image of the set observation range is completed, the process proceeds to step S305.

The photographing operation process performed in step S304 will be described with reference to FIG. 8B. FIG. 8B is a flowchart illustrating an outline of an example of the photographing operation process.

In step S401, the observation side control circuit 110 operates the moving mechanism 160 to move the image acquisition unit 150. The position of the image acquisition unit 150 is included in the project settings as a position where shooting should be performed. The moving mechanism 160 moves the image acquisition unit in the order of the positions to be photographed.

In step S402, the observation-side control circuit 110 causes the imaging unit 151 to perform an AE / AF operation. That is, the imaging unit 151 adjusts the aperture position, shutter speed, and the like according to the exposure conditions, and adjusts the focus position.

In step S403, the observation-side control circuit 110 causes the imaging unit 151 to perform a shooting operation and generate image data. The observation side control circuit 110 causes the image processing circuit 120 to perform image processing on the generated image data, and causes the observation side recording circuit 130 to record the created image file.

In step S404, the observation side control circuit 110 updates the project management file. The update of the project management file 610 will be described with reference to FIG. For example, in the first shooting, the observation side control circuit 110 writes the management information 612 of the time information 2 in the project management file 610. The management information 612 includes the first observation (observation 1), the position where the image was captured in step S403 (imaging position 1), and the name of the image file created by the image capture (file name 1). Is included.

In step S405, the observation side control circuit 110 determines whether or not the stop button has been pressed. When the stop button is pressed, the process proceeds to step S406. In step S <b> 406, the observation side control circuit 110 performs a photographing stop process. The stop processing during shooting will be described later. After the shooting stop process, the process returns to step S401.

When it is determined in step S405 that the stop button has not been pressed, the process proceeds to step S407. In step S407, the observation-side control circuit 110 determines whether or not the observation position has reached the end. That is, it is determined whether or not a series of observations in which a predetermined range of imaging is performed while moving the image acquisition unit 150 is completed. If the observation position has not reached the end, the process returns to step S401. That is, the image acquisition unit 150 moves, the imaging unit 151 performs shooting, and the project management file 610 is updated accordingly.

By repeating this shooting, in the example of the project management file 610 shown in FIG. 5, management information is recorded in order of management information 613 of time information 3,... Management information 614 of time information n, management information 615 of time information n + 1. It will be done. The management information 615 of the time information n + 1 is management information regarding the photographing position n at the end of the observation position.

When it is determined in step S407 that the observation position has reached the end, the shooting operation process ends, and the process returns to the project control process.

Returning to FIG. 8A, the description will be continued. After the photographing operation process in step S304, in step S305, the observation-side control circuit 110 changes the state of the observation apparatus 100 to the interval state. For example, the position of the image acquisition unit 150 is returned to the initial position by the moving mechanism 160. In addition, when the interval period is long, power supply to unnecessary portions is stopped for energy saving.

In step S306, the observation side control circuit 110 updates the project management file. For example, in the example of the project management file 610 illustrated in FIG. 5, the observation side control circuit 110 writes the management information 616 of the time information n + 2 in the project management file 610. The management information 616 includes information indicating that the photographing operation of the observation 1 has been completed at the time of the time information n + 2.

In step S307, the observation-side control circuit 110 performs interval operation processing. The interval operation process will be described with reference to FIG. 8C. FIG. 8C is a flowchart illustrating an outline of an example of the interval operation process.

In step S501, the observation side control circuit 110 determines whether or not the stop button has been pressed. When it is determined that the stop button has been pressed, the process proceeds to step S502. In step S502, the observation-side control circuit 110 performs a stop process during the interval. The stop processing during the interval will be described later.

When it is determined in step S501 that the stop button has not been pressed, the process proceeds to step S503. In step S503, the observation side control circuit 110 determines whether or not the interval period has elapsed. When it is determined that the interval period has not elapsed, the process returns to step S501. On the other hand, when it is determined that the interval period has elapsed, the interval operation process ends, and the process returns to the project control process. Thus, the process waits until the interval period elapses.

Returning to FIG. 8A, the description will be continued. After the interval operation process in step S307, the process proceeds to step S308. In step S308, the observation-side control circuit 110 determines whether or not to end the running project. For example, when the observation of a predetermined number of times or a period is finished, the project ends. If it is determined not to end the project, the process proceeds to step S309.

In step S309, the observation side control circuit 110 updates the project management file. In the example of the project management file 610 illustrated in FIG. 5, the observation side control circuit 110 writes management information 617 of time information n + 3 in the project management file 610. In the management information 617, information indicating that imaging of the second observation (observation 2) is started in the time information n + 3 is recorded. Normally, the interval between the time information n + 2 and the time information n + 3 is the length of the interval.

In step S310, the observation side control circuit 110 restarts the project. For this reason, the observation-side control circuit 110 restarts the supply of power to each unit that has been stopped, for example, during the interval period. Thereafter, the process returns to step S304. That is, the photographing operation process is performed again. As a result, in the example of the project management file 610 shown in FIG. 5, shooting result information such as management information 618 of time information n + 4 is recorded in the project management file 610.

A case will be described in which the stop button is pressed during the interval operation processing (interval period) described with reference to FIG. 8C. FIG. 9 shows a timing chart when the stop button is pressed during the interval period. The example illustrated in FIG. 9 illustrates an example in which the stop button is pressed during the interval period after the n-th observation (observation n) ends. It is assumed that the stop button is pressed at the time indicated by B1 in FIG.

When the stop button is pressed, the state of the observation apparatus 100 is stopped. In the stop state, the observation apparatus 100 does not perform the next observation operation even after the interval period has elapsed. During this stop state, the user changes the medium of the sample 300 or performs the subculture work of the sample 300. The user who has completed the medium exchange or subculture operation and installed the sample 300 in the observation apparatus 100 presses the stop button again. It is assumed that the stop button is pressed again at the time indicated by B2 in FIG. At this time, the observation apparatus 100 resumes the project. If the preset interval period has elapsed, the next observation (observation n + 1) is started when the stop button is pressed again. If the interval period has not elapsed when the stop button is pressed, the next observation (observation n + 1) is performed after the interval period has elapsed.

In the present embodiment, the stop button is provided with a first stop button 181 and a second stop button 182. The first stop button 181 is a button that is pressed when the medium is exchanged. The second stop button 182 is a button that is pressed when performing the substituting work. In the medium exchange, since there is no significant change in the state of the cells 324 and the like in the sample 300, it is preferable that the photographing conditions such as the exposure condition and the focus position are not changed before and after the pause. For this reason, when photographing conditions are determined, it is preferable to inherit the conditions even after a temporary stop. Even in the case of medium replacement, it is of course possible to change the imaging conditions. On the other hand, in the passage work, a great change can occur in the state of the cells 324 and the like in the sample 300. For this reason, the photographing conditions such as the exposure condition and the focus position may be readjusted after the pause. Even in the case of the subculture work, it is of course possible not to change the photographing conditions.

From the above, in the present embodiment, it is recorded which one of the first stop button 181 and the second stop button 182 is pressed, and the imaging condition after resumption can be changed according to the pressed stop button. . In addition, the user may make a mistake in pressing the first stop button 181 and the second stop button 182. For this reason, in this embodiment, when the same stop button is pressed after any one of the stop buttons is pressed, the pause state is terminated. On the other hand, when a different stop button is pressed after one of the stop buttons is pressed, the input by the previously pressed button is invalidated and it is determined that the temporary stop corresponding to the pressed button has started. The paused state will not end. Thereafter, the pause state ends when the same stop button as that pressed immediately before is pressed again.

When the stop button is pressed during the interval operation process shown in FIG. 8C, the process proceeds to the interval stop process in step S502. The stop process during the interval will be described with reference to FIG. 8D. FIG. 8D is a flowchart illustrating an outline of an example of a stop process during an interval.

In step S601, the observation-side control circuit 110 updates the stop button information in which the history of pressing the first stop button 181 and the second stop button 182 is recorded. In step S602, the observation side control circuit 110 updates the project management file.

FIG. 10 shows an example of the project management file 620 when the stop button is pressed during the interval period after the completion of the m-th observation (observation m). In the project management file 620, records of the m-th observation (observation m) are recorded as management information 621 of time information n, management information 622 of time information n + 1, and management information 623 of time information n + 2. That is, when the m-th observation is completed, information indicating that the observation m has been completed is recorded in the project management file 620 as the management information 623 of the time information n + 2. Thereafter, for example, when the first stop button 181 is pressed at the time point of time information n + 3, as in the management information 624 of the time information n + 3, a temporary stop (stop 1) due to the pressing of the first stop button 181. It is recorded that has started.

In step S603, the observation side control circuit 110 determines whether or not the interval period has elapsed. When the interval period has not elapsed, the process proceeds to step S604.

In step S604, the observation-side control circuit 110 determines whether or not the stop button has been pressed. If the stop button has not been pressed, the process returns to step S603. That is, the processing in steps S603 and S604 is repeatedly waited until the stop button is pressed or the interval period elapses.

When it is determined in step S604 that the stop button has been pressed, the process proceeds to step S605. In step S605, the observation side control circuit 110 updates the stop button information.

In step S606, the observation-side control circuit 110 refers to the stop button information and determines whether or not the pressed stop button is the same as the latest pressed stop button. That is, it is determined whether or not the same stop button has been pressed twice. When the pressed stop button is the same as the latest pressed stop button, the process returns to step S603. On the other hand, when the pressed stop button is not the same as the latest pressed stop button, the process proceeds to step S607.

In step S607, the observation side control circuit 110 updates the project management file. FIG. 11 shows an example of the project management file 630 when the project management file is updated when a different stop button is pressed. In the example shown in FIG. 11, management information 631 of time information n, management information 632 of time information n + 1, management information 633 of time information n + 2, and information of observation m are recorded, and management information 634 of time information n + 3 is recorded for the first time. The pressed stop button is the first stop button 181, and information indicating that stop 1 has started is recorded. Here, when a second stop button 182 different from the first stop button 181 pressed for the first time is pressed to the time information n + 4, the stop 1 ends and the stop 2 related to the second stop button 182 Is recorded in the management information 635.

After the project management file is updated in step S607, the process returns to step S603. Thus, until the interval period elapses, the history of pressing the stop button is recorded as stop button information, and when a different stop button is pressed, that fact is recorded in the project management file.

When it is determined in step S603 that the interval period has elapsed, the process proceeds to step S608. In step S608, the observation-side control circuit 110 refers to the stop button information and determines whether or not the same stop button has been pressed even times. When the same stop button is pressed continuously even times, as shown in FIG. 9, the process proceeds to step S613 so as to end the stop state and move to the next observation operation. For example, when the same stop button as the first pressed stop button is pressed once before the interval period elapses, since the same stop button is continuously pressed twice, the process proceeds to step S613. .

When it is determined in step S608 that the same stop button has not been pressed continuously evenly, the process proceeds to step S609. In step S609, the observation-side control circuit 110 determines whether or not the stop button has been pressed. When the stop button is not pressed, the process repeats step S609 and waits. On the other hand, when the stop button is pressed, the process proceeds to step S610.

In step S610, the observation-side control circuit 110 refers to the stop button information and determines whether or not the pressed stop button is the same as the latest pressed stop button. That is, it is determined whether or not the same stop button has been pressed twice. When the pressed stop button is the same as the latest pressed stop button, the process proceeds to step S613 so as to end the stopped state and move to the next observation operation. On the other hand, if the pressed stop button is not the same as the latest pressed stop button, the process proceeds to step S611.

In step S611, the observation side control circuit 110 updates the stop button information for the pressed stop button. In step S612, the observation side control circuit 110 updates the project management file in the same manner as in step S607. Thereafter, the process returns to step S609 and waits for the next stop button to be pressed.

As described above, when the interval period elapses and the same stop button is continuously pressed, the process proceeds to step S613. In step S613, the observation-side control circuit 110 refers to the stop button information and determines whether the latest pressed stop button is the first stop button 181 or the second stop button 182. When the latest pressed stop button is the first stop button 181, the process proceeds to step S614.

In step S614, the observation side control circuit 110 sets the project setting to a value corresponding to the first stop button 181. Since the first stop button 181 is a button that is pressed when the medium is replaced, for example, the imaging conditions such as the exposure condition and the focus position are not changed. Thereafter, the process proceeds to step S616.

In step S613, when it is determined that the most recently pressed stop button is the second stop button 182, the process proceeds to step S615. In step S615, the observation-side control circuit 110 sets the project setting to a value corresponding to the second stop button 182. Since the second stop button 182 is a button that is pressed during the substituting work, for example, photographing conditions such as an exposure condition and a focus position are changed. Thereafter, the process proceeds to step S616.

In step S616, the observation side control circuit 110 updates the project management file. For example, in the example of the project management file 620 shown in FIG. 10, information indicating that the stop 1 has been completed is recorded as the management information 625 of the time information n + 4. Further, for example, in the example of the project management file 630 shown in FIG. 11, information indicating that the stop 2 has been completed is recorded as the management information 636 of the time information n + 5.

Thereafter, the process returns to the interval operation process shown in FIG. 8C and further returns to the project control process shown in FIG. 8A. At this time, if the project does not end, the project management file is updated in step S309. In the example of the project management file 620 shown in FIG. 10, information indicating that the shooting operation is started is recorded like the management information 626 of the time information n + 5, and then the management of the time information n + 6 is performed in the shooting operation processing in step S304. Shooting information such as information 627 and management information 628 of time information n + 7 is recorded. Similarly, in the example of the project management file 630 shown in FIG. 11, information indicating that the shooting operation is started is recorded as in the management information 637 of the time information n + 6, and then the time information is recorded in the shooting operation processing in step S304. Shooting information such as management information 638 of n + 7 is recorded.

As described above, when the stop button is pressed during the interval, the project is paused, and when the same stop button is pressed, the project is resumed. At this time, the start and end times of the pause and information such as whether the pause is caused by pressing the first stop button 181 or the second stop button 182 are recorded in the project management file.

Next, the case where the stop button is pressed during the shooting operation will be described. FIG. 12 shows a timing chart when the stop button is pressed during the photographing operation. The example shown in FIG. 12 shows an example when the stop button is pressed during the n-th observation (observation n). It is assumed that the stop button is pressed at the timing indicated by B1 in FIG. At this time, the observation apparatus 100 stops the n-th observation and temporarily stops the project. The observation apparatus 100 once discards the image obtained by the n-th observation. Then, when the stop button is pressed again, the project is resumed. It is assumed that the stop button is pressed at the timing indicated by B2 in FIG. At this time, the observation apparatus 100 restarts the n-th observation (observation n) from the beginning. By discarding an image or the like obtained by photographing performed halfway, the state of the sample 300 can be prevented from changing during one observation.

During the photographing operation, that is, when the stop button is pressed during the photographing operation process shown in FIG. 8B, the process proceeds to the photographing stop process in step S406. The stop process during shooting will be described with reference to FIG. 8E. FIG. 8E is a flowchart illustrating an outline of an example of the stop processing during shooting.

In step S701, the observation side control circuit 110 updates the stop button information. In step S702, the observation-side control circuit 110 deletes the image file obtained by, for example, the n-th observation (observation n) that is the observation in which the stop button is pressed. Further, for the project management file, the observation-side control circuit 110 deletes, for example, management information related to the n-th observation (observation n), and writes information related to the pressing of the stop button in the management information. For example, in the example of the project management file 620 shown in FIG. 10, if the stop button is pressed during the n-th observation after the observation m, the observation-side control circuit 110 records the management information 623 in which the photographing of the observation m is recorded. Information such as later shooting start and shooting information is once deleted. Thereafter, the observation-side control circuit 110 writes the stop information like the management information 624 of the time information n + 3.

In step S703, the observation side control circuit 110 determines whether or not the stop button has been pressed. When the stop button is not pressed, the process repeats step S703 and waits until the stop button is pressed. On the other hand, when the stop button is pressed, the process proceeds to step S704.

In step S704, the observation side control circuit 110 refers to the stop button information and determines whether or not the pressed stop button is the same as the latest pressed stop button. That is, it is determined whether or not the same stop button has been pressed twice. When the pressed stop button is not the same as the latest pressed stop button, the process proceeds to step S705.

In step S705, the observation-side control circuit 110 updates the stop button information for the pressed stop button. In step S706, the observation side control circuit 110 updates the project management file. For example, as in the example of the management information 635 of the time information n + 4 of the project management file 630 shown in FIG. 11, the information on pressing the stop button is updated. Thereafter, the process returns to step S703 to wait for the next stop button to be pressed.

In step S704, when it is determined that the pressed stop button is the same as the latest pressed stop button, the process proceeds to step S707 so as to end the pause state and restart the observation operation.

In step S707, the observation-side control circuit 110 refers to the stop button information and determines whether the most recently pressed stop button is the first stop button 181 or the second stop button 182. When the most recently pressed stop button is the first stop button 181, the process proceeds to step S708. In step S708, the observation side control circuit 110 sets the project setting to a value corresponding to the first stop button 181. Thereafter, the process proceeds to step S710.

In step S707, when it is determined that the most recently pressed stop button is the second stop button 182, the process proceeds to step S709. In step S <b> 709, the observation side control circuit 110 sets the project setting to a value corresponding to the second stop button 182. Thereafter, the process proceeds to step S710.

In step S710, the observation side control circuit 110 updates the project management file. For example, in the example of the project management file 620 shown in FIG. 10, information indicating that the stop 1 has been completed is recorded as the management information 625 of the time information n + 4. Further, for example, in the example of the project management file 630 shown in FIG. 11, information indicating that the stop 2 has been completed is recorded as the management information 636 of the time information n + 5.

In step S711, the observation side control circuit 110 restarts the project. Thereafter, the process returns to the photographing operation process shown in FIG. 8B, and the process returns to step S401. That is, the movement and photographing of the image acquisition unit 150 are repeated.

As described above, when the stop button is pressed during the shooting operation, the project is paused, and when the same stop button is pressed, the project is resumed. The acquired image file and management information related to the n-th observation in the middle are deleted, and the start and end times of the pause and whether the pause is caused by pressing the first stop button 181 are included in the project management file. Information about whether or not the second stop button 182 is temporarily stopped is recorded.

[Features of observation system]
According to the observation system 1 according to the present embodiment, when a simple operation such as pressing the stop button is performed, the project is temporarily stopped. Here, even when the observation schedule is determined in advance, for example, an inappropriate operation such as a photographing operation being performed when the sample 300 is not installed in the observation apparatus 100 is prevented, and observation at an appropriate timing is performed. Is done.

The stop button is provided in the observation apparatus 100 as a first stop button 181 and a second stop button 182. The first stop button 181 is a stop button for exchanging the medium, and the second stop button 182 is a stop button for the subculture work. As described above, the observation apparatus 100 is provided with a stop button corresponding to the work performed by the user. For this reason, the operation after the resumption of the project after the first stop button 181 is pressed and the operation after the resumption of the project after the second stop button 182 is pressed are appropriately selected according to each work. Can be.

Also, the fact that the stop button has been pressed and whether the pressed stop button is the first stop button 181 or the second stop button 182 is recorded in the project management file. For this reason, referring to the project management file will reveal when and why the project was suspended.

Also, different processing is performed depending on whether the stop button is pressed during the interval period or when the stop button is pressed during the shooting operation. For this reason, when the user presses the stop button for work such as medium exchange, an appropriate process can be performed in accordance with whether it is during the interval period or during the photographing operation.

In addition, when a different stop button is pressed, such as when the second stop button 182 is pressed when the first stop button 181 is pressed and the project is paused, the stop is caused by any stop button. The information indicating whether or not is updated. For this reason, even if the user erroneously inputs the reason for the suspension, the information can be updated to correct information by an easy method.

Also, the number of medium exchanges may be recorded in the project management file. The observation-side control circuit 110 may count the number of times the first stop button 181 has been pressed, and record the counted result as the number of medium exchanges. Of the number of times that the first stop button has been pressed, the number of times determined to be valid excluding the number of times determined to be invalid due to a mistake in pressing or the like may be counted as the number of times of medium replacement. The number of medium exchanges is recorded, for example, in the management information 625 of the project management file 620 together with the recording of the stop end of stop 1. Thereafter, the number of medium exchanges updated together with the record of the stop end of stop 1 may be similarly recorded in the management information. Further, the number of medium exchanges may be continuously recorded in the management information to be updated every time the first stop button is pressed and stop 1 occurs. Similarly, the number of substituting operations may be recorded in the project management file. The observation-side control circuit 110 may count the number of times that the second stop button 182 has been pressed, and record the counted result as the number of subculture operations. In addition, the recording of the number of subculture operations can be performed in the same manner as the recording of the number of medium replacements.

In addition, when the user operates another operation member of the operation input unit 180 of the observation device 100 or operates the input device 274 of the controller 200, the number of medium exchanges or the number of subculture operations is manually input. May be. For example, in the case of medium replacement, the user counts the number of times before or after pressing the first stop button 181 to end the stop 1 by the operation of the first stop button 181. An input operation may be performed.

[Modification]
Some of the elements of the above-described embodiment may be deleted or modified.

For example, in the above-described embodiment, the case where two stop buttons corresponding to the work are provided has been described as an example, but one stop button may be provided. In this case, since it is not necessary to determine whether or not the pressed button is the same, the processing from step S606 to step S607, the processing from step S610 to step S612, the processing from step S704 to step S706, and the like can be deleted. . In addition, operations that change the processing according to the type of the stop button, such as the processing in steps S613 to S615 and the processing in steps S707 to S709, can be deleted.

In addition, even if the number of stop buttons is three or more, the above-described embodiment can be appropriately changed accordingly.

In the above-described embodiment, the project control process is performed by the observation-side control circuit 110. However, the present invention is not limited to this. The terminal-side control circuit 210 of the controller 200 may perform project control processing. In this case, the observation apparatus 100 transmits various information to the controller 200. For example, input information to the operation input unit 180 is also transmitted to the controller 200. The project management file may be recorded in the terminal-side recording circuit 230 or may be recorded in the observation-side recording circuit 130. Further, the image file may be recorded in the observation-side recording circuit 130, or may be transmitted to the controller 200 and recorded in the terminal-side recording circuit 230.

Although the stop button of the operation input unit 180 has been described as a button, the operation input unit 180 is not limited to a button, and may be any of various types of input means having the same function. Moreover, although the case where the instruction | indication of the pause was input into the operation input part 180 provided in the observation apparatus 100 was mentioned as an example, you may input using the input device 274 of the controller 200. FIG.

Moreover, the analysis of the data obtained by the observation apparatus 100 may be performed by the controller 200 or the observation apparatus 100. As described above, the above-described function may be performed by either the observation apparatus 100 or the controller 200, and the above-described function may be realized as the entire observation system 1.

When the second stop button 182 is pressed to pause, it is when the subculture work is being performed. Therefore, the number of passages may be obtained by acquiring the number of times of temporary stop by the second stop button 182. The passage number can also be useful information as information related to the sample 300.

As described above, the control mainly described with reference to the flowchart can be realized using a program. This program can be stored in a recording medium or a recording unit. There are various methods of recording on this recording medium or recording unit, which may be recorded at the time of product shipment, may be recorded using a distributed recording medium, or may be recorded using download via the Internet. May be.

Claims (24)

1. An imaging unit including an imaging optical system and an imaging element, and imaging a sample to generate image data;
   A moving mechanism for moving the imaging unit;
   An operation input unit configured to input an operation for a pause;
   According to a predetermined operation sequence, the position of the imaging unit is moved by the moving mechanism, the image data generated by the imaging unit is acquired, the input to the operation input unit is acquired, and the input is performed. And a control unit that temporarily stops the operation sequence in response.
2. The operation input unit performs passage of the biological sample with a first operation input unit configured to receive an operation for temporary stop for exchanging a medium of the biological sample as the sample A second operation input unit configured to input an operation for a pause to perform,
   The control unit differs between a first operation performed according to an input to the first operation input unit and a second operation performed according to an input to the second operation input unit.
   The observation apparatus according to claim 1.
3. The control unit generates a management file including information on the history of operation of the observation device,
   The control unit records information in the management file in the first operation and the second operation,
   The control unit makes the information recorded in the management file in the first operation different from the information recorded in the management file in the second operation.
   The observation apparatus according to claim 2.
4. The control unit temporarily stops the operation sequence in response to an input to the first operation input unit or the second operation input unit, and the first operation input unit and the second operation input. An operation performed in response to an input to a previously input unit, and an operation performed in response to an input from the first operation input unit and the second operation input unit not input immediately before The observation apparatus according to claim 2 or 3, wherein
5. The control unit temporarily stops the operation sequence in response to an input to the first operation input unit or the second operation input unit, and the first operation input unit and the second operation input. The observation apparatus according to claim 4, wherein the operation performed in response to an input to a portion not input immediately before among the units includes invalidating an input to the portion not input immediately before.
6. The operation sequence has an operation period for operating the imaging unit or the moving mechanism, and an interval period for pausing the operation of the imaging unit or the moving mechanism,
   The control unit is different from an operation performed according to an input to the operation input unit during the operation period and an operation performed according to an input to the operation input unit during the interval period,
   The observation apparatus according to any one of claims 1 to 5.
7. An imaging unit including an imaging optical system and an imaging element, and imaging a sample to generate image data;
   A moving mechanism for moving the imaging unit;
   An operation input unit configured to input an operation for a pause;
   In accordance with a predetermined operation sequence, the moving mechanism moves the position of the imaging unit, acquires the image data generated by causing the imaging unit to capture an image, and acquires an input to the operation input unit. An observation device having a control unit;
   The information related to the input to the operation input unit is acquired from the first control unit, and the first control unit is instructed to move the position of the imaging unit to the moving mechanism, and the imaging unit is caused to capture an image. An observation system comprising: a controller having a second control unit that issues an instruction and an instruction to temporarily stop the operation sequence in accordance with an input to the operation input unit.
8. The operation input unit performs passage of the biological sample with a first operation input unit configured to receive an operation for temporary stop for exchanging a medium of the biological sample as the sample A second operation input unit configured to input an operation for a pause to perform,
   The second control unit performs an instruction to the first control unit that is performed in response to an input to the first operation input unit and an input to the second operation input unit. Different from the instructions to the control unit,
   The observation system according to claim 7.
9. The second control unit generates a management file including information on the history of operation of the observation system,
   The second control unit includes information to be recorded in the management file in response to an input to the first operation input unit, and information to be recorded in the management file in response to an input to the second operation input unit. Make it different,
   The observation system according to claim 8.
10. When the second control unit pauses the operation sequence in response to an input to the first operation input unit or the second operation input unit, the second control unit and the second operation input unit An instruction to the first control unit that is performed in response to an input to the last input of the operation input unit and an input immediately before the first operation input unit and the second operation input unit. 10. The observation system according to claim 8, wherein an instruction to the first control unit that is performed in response to an input to a person who is not connected is different.
11. When the second control unit pauses the operation sequence in response to an input to the first operation input unit or the second operation input unit, the second control unit and the second operation input unit The instruction to the first control unit performed according to the input to the one not input immediately before among the operation input units includes invalidating the input to the one not input immediately before, The observation system according to claim 10.
12. The operation sequence has an operation period for operating the imaging unit or the moving mechanism, and an interval period for pausing the operation of the imaging unit or the moving mechanism,
    The second control unit is responsive to an instruction to the first control unit in response to an input to the operation input unit during the operation period and an input to the operation input unit during the interval period. Different from the instruction to the first control unit to perform,
    The observation system according to any one of claims 7 to 11.
13. An imaging unit including an imaging optical system and an imaging device, configured to capture an image of a sample and generate image data, a moving mechanism for moving the imaging unit, and an operation input for inputting an operation for pause A method for controlling an observation apparatus comprising:
    Moving the position of the imaging unit to the moving mechanism according to a predetermined operation sequence;
    Acquiring the image data generated by causing the imaging unit to capture an image;
    A control method comprising: acquiring an input to the operation input unit and temporarily stopping the operation sequence according to the input.
14. Performing a first operation in response to a first operation input for a temporary stop for replacing the culture medium of the biological sample as the sample;
    Performing a second operation in response to a second operation input for a temporary stop for performing passage of the biological sample,
    The first operation and the second operation are different.
    The control method according to claim 13.
15. Generating a management file including information on the history of operation of the observation device;
    The first operation and the second operation include recording information in the management file;
    The information recorded in the management file in the first operation is different from the information recorded in the management file in the second operation.
    The control method according to claim 14.
16. When the operation sequence is temporarily stopped according to the first operation or the second operation, an operation performed according to the one input immediately before the first operation or the second operation; The control method according to claim 14, wherein the control method is different from an operation performed according to a first operation and a second operation that are not input immediately before.
17. When the operation sequence is paused in response to the first operation or the second operation, the operation to be performed according to the first operation and the second operation that are not input immediately before is performed. The control method according to claim 16, comprising invalidating an input not input immediately before.
18. The operation sequence has an operation period for operating the imaging unit or the moving mechanism, and an interval period for pausing the operation of the imaging unit or the moving mechanism,
    The operation performed according to the operation input during the operation period is different from the operation performed according to the operation input during the interval period.
    The control method according to any one of claims 13 to 17.
19. An imaging unit including an imaging optical system and an imaging device, configured to capture an image of a sample and generate image data, a moving mechanism for moving the imaging unit, and an operation input for inputting an operation for pause A recording medium on which is recorded a control program for an observation apparatus comprising:
    A code for moving the position of the imaging unit to the moving mechanism according to a predetermined operation sequence;
    A code for acquiring the image data generated by causing the imaging unit to capture an image;
    A recording medium including: a code for acquiring an input to the operation input unit and temporarily stopping the operation sequence according to the input.
20. A code for a first operation in response to a first operation input for a temporary stop for replacing the culture medium of the biological sample as the sample;
    And a code for a second operation in response to a second operation input to perform passage of the biological sample,
    The first operation and the second operation are different.
    The recording medium according to claim 19.
21. A code for generating a management file including information on the history of operation of the observation apparatus;
    The code for the first operation and the code for the second operation include a code for recording information in the management file,
    The information recorded in the management file in the first operation is different from the information recorded in the management file in the second operation.
    The recording medium according to claim 20.
22. When the operation sequence is paused in response to the first operation or the second operation, for the operation to be performed according to the one input immediately before the first operation or the second operation. The recording medium according to claim 20 or 21, wherein the code is different from a code for an operation performed according to the first operation and the second operation not input immediately before.
23. When the operation sequence is paused in response to the first operation or the second operation, an operation to be performed according to the first operation and the second operation that are not input immediately before The recording medium according to claim 22, wherein the code for use includes a code for invalidating the input that has not been input immediately before.
24. The operation sequence has an operation period for operating the imaging unit or the moving mechanism, and an interval period for pausing the operation of the imaging unit or the moving mechanism,
    The code for the operation performed according to the operation input during the operation period is different from the code for the operation performed according to the operation input during the interval period,
    The recording medium according to any one of claims 19 to 23.

Images