JP6238574B2 - Observation device - Google Patents

Description

  The present invention relates to an observation apparatus that captures images at a plurality of different positions, for example.

  Conventionally, a still image of a specimen is photographed at a plurality of different positions, and using the still images photographed at the plurality of positions, an extended focus image (omnifocal image) or a 3D image (surface shape data) that is entirely focused ) Is known (see, for example, Patent Document 1).

  In the technique described in Patent Document 1, pixel values are compared among all still images taken at a plurality of different positions, pixel values at a focused position are extracted, and an extended focus image is generated by combining the images. doing.

  Further, pixel values are compared between all the still images taken at the plurality of different positions, and a 3D image is synthesized based on the height difference information at the focused position.

JP 2010-139890 A

  In the conventional technique, an image range having the maximum pixel value (contrast value based on luminance information between adjacent pixels) is extracted between all still images taken at a plurality of different positions, and all of them are always expanded. It is used to synthesize images and 3D images. Therefore, an unnecessary texture such as an image that the user does not want to be included in the extended focus image or 3D image or an unnecessary height range image may be included in the combined extended focus image or 3D image.

  The present invention has been made in view of the above, and an object of the present invention is to provide an observation apparatus that can easily obtain an extended focus image or a 3D image from which unnecessary textures are deleted.

In order to solve the above-described problems and achieve the object, an observation apparatus according to the present invention includes a stage on which a specimen is placed, an objective lens that collects observation light from the specimen, the stage, and the objective lens A focus control unit capable of adjusting the distance between the stage, an imaging unit that captures the specimen and obtains a specimen image, and allows the focus control unit to adjust the distance between the stage and the objective lens, and the distances are different. A control unit that causes the imaging unit to capture a plurality of the specimen images at a plurality of positions; a selection range setting unit that sets a selection range of the specimen image used for generating a composite image at the plurality of positions; from among the sample images, several selected by the selecting means and, before Symbol selection means for selecting the sample image within the selection that the selection range setting means has set Comprising a composite image generating means for generating a first synthesized image using the specimen image, and the first synthesized image, and a display unit capable of displaying simultaneously the characteristic value of each sample image in the selection It is characterized by that.

Observation apparatus according to the present invention, in the invention, the composite image generation means generates a first composite image, and a second synthesized image generated using all of the specimen image in the plurality of locations It is characterized by doing.

Observation apparatus according to the present invention, in the above invention, the display means, characterized that you to display the first composite image and the second composite image.

The observation apparatus according to the present invention further includes threshold setting means for setting a threshold value of the characteristic value of the sample image in the above invention, wherein the composite image generating means is configured to select the threshold from the images selected by the selection means. According to the threshold set by the setting unit, the first synthesized image is generated by excluding a corresponding region .

Observation apparatus according to the present invention, in the above-mentioned invention is characterized in that to complement the excluded the corresponds to regions with a predetermined color or texture.

  ADVANTAGE OF THE INVENTION According to this invention, the observation apparatus which can obtain the extended focus image and 3D image which deleted the unnecessary texture can be provided easily.

FIG. 1 is a conceptual diagram illustrating an example of the configuration of the microscope system according to the first embodiment. FIG. 2 is a block diagram of a functional configuration of the microscope system according to the first embodiment. FIG. 3A is a conceptual diagram for explaining synthesis of an extended focus image. FIG. 3B is a plan view illustrating an example of synthesis of an extended focus image. FIG. 3C is a conceptual diagram for explaining synthesis of an extended focus image. FIG. 4A is a plan view illustrating an example of a preview window displayed by the display input unit of the microscope system according to the first embodiment of the present invention. FIG. 4B is a plan view illustrating an example of a preview window displayed by the display input unit of the microscope system according to the first embodiment of the present invention. FIG. 5 is a flowchart showing image composition processing executed by the control unit according to the first embodiment of the present invention. FIG. 6 is a plan view illustrating an example of a preview window displayed by the display input unit of the microscope system according to the second embodiment of the present invention. FIG. 7 is a flowchart showing image composition processing executed by the control unit according to the second embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings. In addition, this invention is not limited by the following embodiment. The drawings referred to in the following description only schematically show the shape, size, and positional relationship so that the contents of the present invention can be understood. That is, the present invention is not limited only to the shape, size, and positional relationship illustrated in each drawing.

(Embodiment 1)
FIG. 1 is a conceptual diagram showing an example of the configuration of the microscope system according to the first embodiment of the present invention. FIG. 2 is a block diagram of a functional configuration of the microscope system according to the first embodiment. 1 and 2, the plane on which the microscope system 1 is placed will be referred to as an xy plane, and a direction perpendicular to the xy plane will be described as a z direction.

  As shown in FIGS. 1 and 2, the microscope system (observation apparatus) 1 includes a microscope apparatus 2 that observes the specimen S, a microscope control unit 3 that drives and controls the microscope apparatus 2, and the specimen S via the microscope apparatus 2. The image pickup device 4 that picks up the image and generates image data, the image pickup control unit 5 that controls the drive of the image pickup device 4, the image corresponding to the image data picked up by the image pickup device 4, and various types of the microscope system 1 And a control terminal 7 that controls the microscope control unit 3, the imaging device 4, the imaging control unit 5, and the display input unit 6. The microscope device 2, the microscope control unit 3, the imaging device 4, the imaging control unit 5, the display input unit 6, and the control terminal 7 are connected by wire or wireless so that data can be transmitted and received.

  The microscope apparatus 2 includes a microscope base 2a (stage-side main body) that holds the specimen S, and a head 2b that is held by the microscope base 2a. The microscope base 2a has a support portion 22 that supports the stage 21 on which the specimen S is placed. The head unit 2b holds the objective lens 24 via the nosepiece 23, and has a head main body unit 25 that can move in the z direction, and an epi-illumination light source 26 that emits illumination light that illuminates the specimen S. . In addition, the microscope apparatus 2 includes a Z drive unit 27 that connects the microscope base 2a and the head unit 2b and moves the head unit 2b in the z direction.

  The stage 21 is configured to be movable in the xy direction. The stage 21 is movable in the xy plane by a motor 211. Under the control of the microscope control unit 3, the stage 21 detects a predetermined origin position on the xy plane by an origin sensor at an xy position (not shown), and the drive amount of the motor 211 is controlled based on this origin position. The observation location on the specimen S is moved. The stage 21 outputs position signals (xy coordinates) regarding the x position and the y position at the time of observation to the microscope control unit 3.

  The nosepiece 23 arranges a desired objective lens 24 above the sample S via a slider 231 slidably provided with respect to the head main body 25. The nosepiece 23 holds a plurality of objective lenses 24 (241, 242) having different magnifications (observation magnifications) by the slider 231. Under the control of the microscope control unit 3, the nosepiece 23 slides the slider 231 in the x direction by the motor 232, thereby selecting the objective lens 24 that is inserted in the optical path of the observation light and used for observing the specimen S. Switch on. The nosepiece 23 is not limited to a slider type nosepiece but may be a revolver type nosepiece.

  The objective lens 24 attached to the slider 231 includes, for example, an objective lens 241 with relatively low magnification of 1 ×, 2 ×, and 4 × (hereinafter referred to as “low magnification objective lens 241”) and a low magnification objective lens 241. There is an objective lens 242 (hereinafter referred to as “high-magnification objective lens 242”) that has a higher magnification than the above magnification. The magnification of the objective lens 242 is, for example, 10 times, 20 times, or 40 times. At least one objective lens 241 and 242 is mounted on the slider 231. Note that the magnifications of the low-magnification objective lens 241 and the high-magnification objective lens 242 are examples, and it is sufficient that the high-magnification objective lens 242 is higher than the low-magnification objective lens 241.

  The head main body 25 holds the above-described nosepiece 23 and collects the illumination light L1 emitted from the epi-illumination light source 26 via the fiber 261 (hereinafter referred to as “epi-illumination light L1”). 251; a half mirror 252 that deflects the optical path of the epi-illumination light L1 along the optical axis of the objective lens 24; a zoom lens 253 that enlarges the specimen S; and the objective lens 24, the zoom lens 253, and the half mirror 252. An imaging lens 254 that collects the reflected light of the incident sample S and forms an observation image is provided inside.

  The zoom lens unit 253 is configured using a zoom lens group and a zoom lens motor (not shown) that drives the zoom lens group. The zoom lens motor changes the zoom magnification of the zoom lens unit 253 by moving the zoom lens group along the optical axis direction under the control of the microscope control unit 3.

  The head main body 25 is held by a head holding portion 271 described later, and is movable in the z direction by a motor 274. The head main body 25 is controlled within the predetermined height range by controlling the drive amount of the motor 274 based on a predetermined origin position in the z direction of the head main body 25 under the control of the microscope control unit 3. The sample S is moved to an arbitrary z position. In the present embodiment, the head body portion 25 and the head holding portion 271 constitute an objective lens side body portion.

  The epi-illumination light source 26 is constituted by a halogen lamp, a xenon lamp, an LED (Light Emitting Diode), or the like. The epi-illumination light source 26 emits epi-illumination light L <b> 1 for forming an observation image of the specimen S through the fiber 261.

  The epi-illumination light L1 is applied to the specimen S through the illumination lens 251, the half mirror 252, the zoom lens 253, and the objective lens 24. Reflected light L <b> 2 (hereinafter referred to as “observation light L <b> 2”) reflected by the sample S enters the imaging device 4 through the objective lens 24, the zoom lens 253, the half mirror 252, and the imaging lens 254.

  The Z driving unit 27 includes a head holding unit 271 that holds the head main body unit 25 and is movable in the z direction with respect to the support unit 22, and a motor 274 that drives the head holding unit 271 in the z direction. The Z drive unit 27 functions as a focus control unit that can adjust the distance between the stage 21 and the objective lens 24. Note that the Z drive unit 27 may move the stage 21 in the z direction instead of moving the nosepiece 23 in the z direction.

  The microscope control unit 3 is configured by using a CPU (Central Processing Unit) or the like, and comprehensively controls the operation of each unit constituting the microscope apparatus 2 under the control of the control terminal 7. Specifically, the microscope control unit 3 drives the slider 231 to switch the objective lens 24 arranged on the optical path of the observation light L2, and drives the motor 211 or the motor 274 to drive the stage 21 and the head body. The driving process of the unit 25, the adjustment process for adjusting each part of the microscope apparatus 2 accompanying the observation of the sample S, and the like are performed. Further, the microscope control unit 3 is in a state of each part constituting the microscope apparatus 2, for example, position information (xy position) of the stage 21, position information (z position) of the head main body 25, and the objective lens 24 attached to the slider 231. Type information and the like are output to the control terminal 7.

  The imaging device 4 is configured using an imaging element 41 such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). Under the control of the imaging control unit 5, the imaging device 4 captures an observation image of the specimen S incident through the imaging lens 254 and continuously generates image data of the specimen S. The imaging device 4 outputs the image data of the specimen S generated via the camera cable to the control terminal 7.

  The imaging control unit 5 is configured using a CPU or the like, and controls the operation of the imaging device 4. Specifically, the imaging control unit 5 controls the photographing operation of the imaging device 4 by performing ON / OFF switching processing of automatic gain control of the imaging device 4, gain setting processing, frame rate setting processing, and the like. The imaging control unit 5 includes an AE processing unit 51.

  The AE processing unit 51 automatically sets the exposure condition of the imaging device 4 based on the image data generated by the imaging device 4. Specifically, the AE processing unit 51 calculates the luminance from the image data acquired via the control terminal 7, and determines the exposure condition of the imaging device 4, for example, the exposure time based on the calculated luminance. 4 automatic exposure.

  The display input unit 6 includes a display communication unit 61 that performs communication with the control terminal 7, a display unit 62 that displays an image, and a touch panel 63 that outputs a position signal corresponding to an external object contact.

  The display communication unit 61 is a communication interface for performing communication with the control terminal 7. The display communication unit 61 outputs the image data output from the control terminal 7 to the display unit 62.

  The display unit 62 is configured using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display unit 62 displays an image corresponding to the image data input via the display communication unit 61. The display unit 62 displays various operation information of the microscope system 1 and the like.

  The touch panel 63 is provided on the display screen of the display unit 62 and accepts an input according to the contact position of the object from the outside. Specifically, the touch panel 63 detects a position where the user touches (contacts) according to an operation icon displayed on the display unit 62, and outputs a position signal corresponding to the detected touch position to the control terminal 7. For example, the touch panel 63 functions as a graphical user interface (GUI) when the display unit 62 displays various operation information of the microscope system 1 in the image display area. In general, the touch panel includes a resistance film method, a capacitance method, an optical method, and the like. In the first embodiment, any type of touch panel is applicable.

  The control terminal 7 includes a control communication unit 71 that communicates with the microscope control unit 3, the imaging control unit 5, and the display input unit 6, and an input unit 72 that receives input of a drive instruction signal that instructs driving of each unit of the microscope system 1. And a storage unit 73 that stores various types of information of the microscope system 1 and a control unit 74 that controls each unit of the microscope system 1.

  The control communication unit 71 is a communication interface for communicating with each of the microscope control unit 3, the imaging control unit 5, and the display input unit 6. Further, the control communication unit 71 outputs the image data output from the imaging device 4 to the control unit 74 via the camera cable.

  The input unit 72 is configured using a keyboard, a mouse, a joystick, various switches, and the like, and outputs operation signals corresponding to operation inputs of the various switches to the control unit 74.

  The storage unit 73 is realized using a semiconductor memory such as a flash memory and a RAM (Random Access Memory) fixedly provided inside the control terminal 7. The storage unit 73 stores various programs (for example, a position detection program) to be executed by the microscope system 1 and various data used during the execution of the programs. The storage unit 73 temporarily stores information being processed by the control unit 74. The storage unit 73 includes an image data storage unit 731 that stores image data captured by the imaging device 4, and a position information storage unit 732 that stores position information regarding the position of the head main body unit 25. In addition, the memory | storage part 73 may be comprised using the memory card etc. which are mounted | worn from the outside.

  The control unit 74 is configured using a CPU or the like, and transfers instructions and data corresponding to each unit constituting the microscope system 1 according to a drive instruction signal, a position signal, a switching signal, and the like from the input unit 72 and the touch panel 63. To perform overall control of the operation of the microscope system 1. Also, an image synthesis process for synthesizing an extended focus image and a 3D image, which will be described later, a process for setting the position of the head main body 25, and the like are performed.

  The control unit 74 includes an image processing unit 741, a drive control unit 742, a display control unit 743, and an AF processing unit 744.

  The image processing unit 741 performs predetermined image processing on the image data input via the control communication unit 71 to generate a display image to be displayed on the display unit 62. Specifically, the image processing unit 741 includes optical black subtraction processing, white balance adjustment processing, synchronization processing, color matrix calculation processing, γ correction processing, color reproduction processing, edge enhancement processing, and the like for image data. Perform image processing. The image processing unit 741 compresses the image data by a predetermined method, for example, a JPEG (Joint Photographic Experts Group) method, and outputs the compressed image data to the image data storage unit 731.

  The drive control unit 742 performs drive control for driving the electric unit (stage 21, head main body unit 25) constituting the microscope apparatus 2 in accordance with, for example, an input from the touch panel 63 or the input unit 72. The drive control unit 742 performs drive control such as moving the head main body unit 25 in a direction parallel to the optical axis of the objective lens 24, for example.

The display control unit 743 controls the display mode of the display unit 62. Specifically, the display control unit 743 displays each image of the plurality of image data stored in the image data storage unit 731 on the display unit 62. The display control unit 743 causes the display unit 62 to display operation information regarding each operation of the microscope system 1, for example, operation information of the stage 21 or the head main body unit 25.
The AF processing unit 744 automatically adjusts the focus of the objective lens 24 based on the image data generated by the imaging device 4. Specifically, the AF processing unit 744 drives the electric focusing unit 27, evaluates the contrast of the image at each Z position of the head main body unit 25, and detects the in-focus position (focus position). By doing so, the focus of the objective lens 24 is automatically adjusted.

  The microscope system 1 configured as described above causes the user to observe the image of the sample S by displaying the image data of the sample S captured by the imaging device 4 on the display unit 62 under the control of the control unit 74. be able to. Furthermore, in the microscope system 1, the microscope device 2 and the imaging device 4 are driven when the control unit 74 outputs an instruction signal or a drive signal to each unit of the microscope system 1 based on the position signal input from the touch panel 63. .

  3A to 3C are a conceptual diagram and a plan view for explaining the synthesis of the extended focus image. 3A and 3C show a side view of the stage 21 on which the specimen S is placed, and a contrast distribution of a group of images obtained by photographing the specimen S at a plurality of positions in an extended focal image (EFI) designated range. It is the figure which combined the graph. FIG. 3B is a plan view of an extended focus image photographed and synthesized within the photographing range shown in FIG. 3A.

  In this specification, the imaging range is a range in which the imaging device 4 actually captures the sample S at a plurality of positions (a plurality of positions at which the distance between the imaging device 4 and the sample S is different). Further, the extended focus image (omnifocal image) is generated by synthesizing still images taken at a plurality of positions with respect to the specimen S having a difference in height based on the characteristic values (contrast values, etc.) of each image. The image is in focus on the entire image.

  As shown in FIG. 3A, when the extended focus image is synthesized with the specimen S placed on the stage 21 as the imaging range from the lower limit (upper surface of the stage 21) to the upper limit of the focal position of the imaging device 4, FIG. As shown, the texture on the upper surface of the stage 21 is reflected in the synthesized extended focus image. This is because the imaging range shown in FIG. 3A includes a contrast component corresponding to the texture on the upper surface of the stage 21, and the texture on the upper surface of the stage 21 is also synthesized as a part of the extended focus image. Responsible).

  In order to avoid such reflection of the texture on the upper surface of the stage 21, as shown in FIG. 3C, the photographing range is changed so as to exclude the contrast component corresponding to the texture on the upper surface of the stage 21, and photographing is performed. However, in this case, the texture of the sample S in the range excluded from the imaging range is not synthesized as an extended focus image, and the necessary texture may be lost. According to this method of changing the shooting range, it is necessary to perform shooting again at a plurality of positions in order to combine again so that the necessary texture is included.

  Therefore, in the present embodiment, it is possible to change a use range (hereinafter referred to as a synthesis target) of an image used for synthesizing an image such as an extended focus image or a 3D image without changing the shooting range, It is possible to preview a composite image in a case where composition is performed using only images included in the composition target.

  4A and 4B are plan views illustrating an example of a preview window displayed by the display input unit of the microscope system according to the first embodiment of the present invention. FIG. 4A shows before the change of the image synthesis target, and FIG. 4B shows after the change. In this example, it is assumed that the specimen S is already photographed at a plurality of positions where the distance between the stage 21 and the objective lens 24 is different in a preset photographing range (from the lower limit to the upper limit position). .

  The preview window PW is displayed on the display unit 62, and includes a first display region PS1, a second display region PS2, a contrast display region CS, a start position setting unit 101, an end position setting unit 102, and a determination instruction. Part (OK button) 103.

  The first display area PS1 is an area for displaying a preview image of a composite image when all images photographed in a preset photographing range are used, that is, an area for displaying a state before the composition target is changed. is there. The second display area PS2 is an area for displaying a preview image of a composite image when only an image included in the composition target is used, that is, an area for displaying a state after the composition target is changed. Note that the preview image is preferably synthesized using an image with a reduced amount of data, for example, by reducing the captured image.

  The contrast display area CS is an area for displaying a graph representing the contrast distribution (characteristic value of each image) of an image group captured at a plurality of positions in a specified range. A start position setting unit 101 is provided at the lower end of the right side of the contrast display area CS so as to be movable up and down, and an end position setting unit 102 is provided at the upper end so as to be movable up and down.

  The start position setting unit 101 sets a start position to be synthesized. For example, when the user operates the input unit 72 such as a mouse or the touch panel 63 and changes the position on the preview window PW by dragging the mouse in a state where the start position setting unit 101 is indicated by the pointer. The start position of the composition target is changed. The start position of the compositing target can be set at an arbitrary position from the lower limit position to the end position of the shooting range.

  The end position setting unit 102 sets the end position to be synthesized. By operating the input unit 72 such as a mouse or the touch panel 63, for example, the user drags the mouse while pointing the end position setting unit 102 with a pointer and changes the position on the preview window PW. The end position of the composition target is changed. The end position of the compositing target can be set at an arbitrary position from the upper limit position of the shooting range to the start position.

  In the initial state, as shown in FIG. 4A, the start position setting unit 101 and the end position setting unit 102 are set to the lower limit position and the upper limit position of the contrast display area CS, and specify the same range as the shooting range. Yes. That is, in this state, composition is performed using all the captured images. From this state, for example, as shown in FIG. 4B, when the composition target is changed by moving the start position setting unit 101 upward, the preview image synthesized using the image included in the changed composition target is the second image. It is displayed in the display area PS2. In the example shown in FIG. 4B, since the contrast component corresponding to the texture on the upper surface of the stage 21 is excluded from the synthesis target, the texture on the upper surface of the stage 21 disappears from the image displayed in the second display region PS2.

  By moving the start position setting unit 101 and the end position setting unit 102, the start position and the end position of the composition target are changed, and the preview image synthesized using the image included in the composition target after the change is the second image. It is displayed in the display area PS2. The user can confirm the preview image displayed in the second display area PS2 and determine the composition target. The composition target is determined by clicking the OK button 103 with the input unit 72 or operating the touch panel 63 on the area.

  Note that the start position setting unit 101 and the end position setting unit 102 are not limited to the forms shown in FIGS. 4A and 4B, and the start position and end position to be combined can be set independently at arbitrary positions. Anything may be used. For example, the start position and end position of the synthesis target may be set by numerical values. In that case, the start position and the end position may be designated by the number of frames of the captured image (eg, what number image is from the start of capturing), the distance (height) from the stage, or the like. In addition, a plurality of start positions and end positions may be set so that a plurality of non-continuous areas can be set as synthesis targets. Furthermore, it is possible to designate only one frame image as a synthesis target with the same start position and end position. In the preview window PW, the first display area PS1 can be omitted.

  FIG. 5 is a flowchart showing image composition processing executed by the control unit according to the first embodiment of the present invention. In performing this image composition processing, the specimen S is placed on the specimen placement surface of the stage 21 as advance preparation. This image composition process is started by an instruction to generate an extended focus image by the user.

  In step S101, the control unit 74 initializes a counter “N” representing the number of shot images to be set to “1”.

  In step S102, the control unit 74 drives the Z drive unit 27 to move the head holding unit 271 (objective lens 24) in the z direction to the designated lower limit position (lower limit position of the imaging range). The photographing range may be designated in step S102 or may be designated in advance. The shooting range may be set by setting the upper and lower ends, respectively, or by setting either the upper end or the lower end from the current z position. Alternatively, after the start of shooting, the user may manually specify the z direction by moving only the desired range.

  In step S103, the control unit 74 drives the imaging device 4 to capture a still image at the current z position, and stores the still image in the memory (image data storage unit 731) as an Nth image. Thereafter, in step S104, the control unit 74 determines whether or not the current z position is the upper limit position of the shooting range. When the control unit 74 determines that the current z position is the upper limit position of the shooting range (step S104: Yes), the shooting by the imaging device 4 is terminated, and the process proceeds to step S105. When the control unit 74 determines that the current z position is not the upper limit position of the shooting range (step S104: No), the process proceeds to step S113. The distance between the stage 21 and the objective lens 24 is different by repeating the processing of step S103 and steps S113 and S114 described later until the control unit 74 determines that the current z position is the upper limit position of the imaging range. The specimen S is photographed at a plurality of positions.

  In step S105, the control unit 74 designates the first display area PS1 and the second display area PS2 as preview image designation areas. The preview image designation area is an area for displaying an extended focus image generated in step S107 described later. By designating both the first display area PS1 and the second display area PS2 as the preview image designation area, the same image is displayed in the first display area PS1 and the second display area PS2 in the initial state. Is done.

  In step S106, the control unit 74 designates (all designations) the 1st to Nth images as photographed images (compositing targets) used for synthesis. In the initial state, the setting is made so that the synthesis is performed using all the images photographed by the imaging device 4. Note that instead of specifying all at step S106, an image in a preset range may be specified.

  In step S107, the control unit 74 extracts an extended focus image (preview) by extracting a portion having the highest contrast in each region in the captured image from the compositing targets set in step S106 or step S106 described later. Image).

  In step S108, the control unit 74 displays the extended focus image generated in step S107 as a thumbnail (displays a preview image) in the preview image designation area designated in step S105 or step S115 described later.

  In step S109, the control unit 74 determines whether the composition target has been changed. When the control unit 74 determines that the composition target has been changed (step S109: Yes), the process proceeds to step S115, and when it is determined that the composition target has not been changed (step S109: No), the process proceeds to step S110.

  In step S110, the control unit 74 determines whether or not the determination instruction unit (OK button) 103 has been operated. When the control unit 74 determines that the determination instruction unit (OK button) 103 has been operated (step S110: Yes), the process proceeds to step S111. When it is determined that the determination instruction unit (OK button) 103 has not been operated (step S110: No), Return to S109.

  In step S111, the control unit 74 extracts a portion having the highest contrast in each region in the captured image from the compositing targets set in step S106 or step S116 described later, and finally expands the focus. An image is generated and stored in a memory such as the image data storage unit 731.

  In step S112, the control unit 74 erases the captured image stored in step S103 from the memory such as the image data storage unit 731 and ends the image composition process.

  In step S113, the control unit 74 increments the counter “N” to “N + 1”. In step S114, the control unit 74 drives the Z drive unit 27 to move the head holding unit 271 (objective lens 24) upward by z at a predetermined interval. Here, the predetermined interval is, for example, several μm to several hundred μm. Thereafter, the process proceeds to step S103.

  In step S115, the control unit 74 designates the second display area PS2 as the preview image designation area. By designating only the second display area PS2 as the preview image designation area, the preview image after the composition target change is displayed as a thumbnail in the second display area PS2.

  In step S116, the control unit 74 sets the composition target changed in step S109 as a composition target for generating an extended focus image in steps S107 and S111. Thereafter, the process returns to step S107.

  As described above, according to the first embodiment of the present invention, after the specimen S is photographed at a plurality of positions based on the photographing range, the image used for synthesizing the extended focus image while viewing the preview image displayed on the preview window PW. Can be designated as a synthesis target. Therefore, it is possible to easily exclude an image that is not desired to be captured in the final extended focus image.

  Specifically, the texture on the upper surface of the stage 21 on which the sample S is placed can be easily excluded from the extended focus image while checking in the preview window PW. In addition, when a specimen or the like partially embedded in the base material is photographed, it is possible to easily avoid the reflection of the base material. Furthermore, for example, even when a specimen having a hole in a donut shape is photographed, the texture of the upper surface of the stage 21 exposed from the hole can be easily excluded from the extended focus image.

  Further, according to Embodiment 1 of the present invention, an image to be used for composition is selected as a compositing target from a plurality of captured images instead of a photographing range, and is included in the extended focus image by changing the compositing target. The texture to be changed is changed. Therefore, it is possible to change the texture included in the extended focus image without redoing the shooting.

  In Embodiment 1 described above, only the extended focus image is synthesized using a plurality of captured images, but a 3D image can be synthesized instead of the extended focus image. In this case, in step S107 and step S111 in FIG. 5, the control unit 74 generates a 3D image using the image photographed within the compositing target set in step S106 or step S116 described later.

(Embodiment 2)
FIG. 6 is a plan view illustrating an example of a preview window displayed by the display input unit of the microscope system according to the second embodiment of the present invention. In the description of the microscope system 1 according to the second embodiment, the same components as those in the microscope system 1 according to the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the second embodiment, a threshold value TH is provided for a characteristic value (contrast value, etc.) in each image for synthesizing an extended focus image, and textures having a characteristic value equal to or less than (or higher than) the threshold TH are excluded from the extended focus image. To do. In the preview window PWa shown in FIG. 6, a threshold value setting unit 104 for setting the threshold value TH is provided on the upper side of the contrast display area CS so as to be movable in the horizontal direction. The other configuration of the preview window PWa is the same as that of the preview window PW of the first embodiment shown in FIG. 4A.

  The threshold value setting unit 104 sets a threshold value TH for the characteristic value (contrast value, etc.) of each image in the composition target. For example, when the user operates the input unit 72 such as a mouse or the touch panel 63 and drags the threshold setting unit 104 to change the position on the preview window PWa, the threshold TH is changed.

  In the initial state, the threshold value TH is set to “0” (the right end of the contrast display area CS), and an image included in the composition target is used regardless of the threshold value TH. In this state, for example, as shown in FIG. 6, when the threshold value TH is changed by moving the threshold value setting unit 104 in the left direction (high contrast direction) in the figure, a texture having a characteristic value equal to or less than the changed threshold value TH is selected. The preview image that is excluded and combined is displayed in the second display area PS2. The threshold TH and the composition target are determined by operating the OK button 103 with the input unit 72 or the touch panel 63. In this example, a texture having a characteristic value equal to or less than the threshold value TH is complemented with a predetermined color (shown by shading in the figure).

  Note that the threshold setting unit 104 is not limited to the form shown in FIG. 6 and may be any type as long as the threshold TH can be set to an arbitrary value. For example, the threshold value TH may be directly input as a numerical value. Further, as in the first embodiment, the first display area PS1 can be omitted.

  FIG. 7 is a flowchart showing image composition processing executed by the control unit according to the second embodiment of the present invention.

  The processing from step S201 to step S206 is the same as the processing from step S101 to step S106 shown in FIG. Further, the processing from step S216 to step S219 is the same as the processing from step S113 to step S116 shown in FIG.

  In step S207, the control unit 74 initializes the threshold value TH to “0”.

  In step S208, the control unit 74 has the highest contrast among the set compositing targets in each region in the captured image with a contrast equal to or higher than the threshold value TH set in step S207 or step S220. Is extracted to generate an extended focus image (preview image).

  In step S209, the control unit 74 supplements an area of the extended focus image (preview image) generated in step S208 that does not exceed the threshold value TH set in step S220 with a predetermined color or texture.

  In step S210, the control unit 74 generates a predetermined color in the preview image designation area designated in step S205 or step S218 described later in step S208 (or in step S208 and in which the threshold TH is not exceeded in step S209). The extended focus image (filled with) is displayed as a thumbnail (preview image is displayed).

  In step S211, the control unit 74 determines whether or not the composition target has been changed. When the control unit 74 determines that the composition target has been changed (step S211: Yes), the process proceeds to step S218, and when it is determined that the composition target has not been changed (step S211: No), the process proceeds to step S212.

  In step S212, the control unit 74 determines whether or not the threshold value TH has been changed. If the control unit 74 determines that the threshold value TH has been changed (step S212: Yes), the process proceeds to step S220. If the control unit 74 determines that the threshold value TH has not been changed (step S212: No), the process proceeds to step S213.

  In step S213, the control unit 74 determines whether or not the determination instruction unit (OK button) 103 has been operated. When the control unit 74 determines that the determination instruction unit (OK button) 103 has been operated (step S213: Yes), the process proceeds to step S214, and when it is determined that the determination instruction unit (OK button) 103 has not been operated (step S213: No), the step Return to S211.

  In step S214, the control unit 74 has a contrast equal to or higher than the threshold value TH set in step S207 or step S220 in each region in the image captured within the composition target set in step S206 or step S219 described later. The final extended focus image is generated by extracting the portion having the highest contrast. Further, in the extended focus image generated as necessary, a region that did not exceed the threshold value TH set in step S220 is complemented with a predetermined color or texture to generate a final extended focus image. The control unit 74 stores the generated extended extended focus image in a memory such as the image data storage unit 731.

  In step S215, the control unit 74 erases the captured image stored in step S203 from the memory such as the image data storage unit 731 and ends the image composition process.

  In step S220, the control unit 74 sets the composition target changed in step S212 as a threshold value TH for generating an extended focus image in steps S208, S209, and S214. Thereafter, the process returns to step S208.

  Note that the processing in step S209 described above can be omitted. In that case, even in the final extended focus image generated in step S214, processing such as painting with a predetermined color is not performed on the area that does not exceed the threshold value TH set in step S220.

  As described above, according to the second embodiment of the present invention, as in the first embodiment, after the specimen S is photographed at a plurality of positions based on the photographing range, it is expanded while viewing the preview image displayed on the preview window PWa. An image to be used for synthesizing the focus image can be designated as a synthesis target. Therefore, it is possible to easily exclude an image that is not desired to be captured in the final extended focus image.

  In addition to the first embodiment described above, according to the second embodiment of the present invention, a threshold value TH is provided for a characteristic value (contrast value or the like) in each image for synthesizing an extended focus image, and the characteristic is equal to or lower than the threshold value TH. Textures with values can be excluded from the extended focus image. In addition, an area that does not exceed the threshold value TH can be filled with a predetermined color. Therefore, it is possible to clearly extract an image of a part to be noticed.

  In the second embodiment described above, only the extended focus image is synthesized using a plurality of captured images. However, similarly to the first embodiment, a 3D image can be synthesized instead of the extended focus image. . In this case, in step S208 and step S214 in FIG. 7, the control unit 74 generates a 3D image using an image photographed within the set composition target.

  In the second embodiment described above, the threshold value TH is manually set / changed by operating the threshold value setting unit 104. However, the threshold value TH is set to a maximum value of a characteristic value (contrast, etc.) within the composition target. You may make it set automatically based on an average value. In that case, the threshold value TH is automatically set in steps S207 and S212 of FIG.

DESCRIPTION OF SYMBOLS 1 Microscope system 2 Microscope apparatus 2a Microscope base 2b Head part 3 Microscope control part 4 Imaging device 5 Imaging control part 6 Display input part 7 Control terminal 21 Stage 22 Support part 23 Nosepiece 24 Objective lens 25 Head main body part 26 Light source for epi-illumination 27 Z Drive Unit 41 Image Sensor 51 AE Processing Unit 61 Display Communication Unit 62 Display Unit 63 Touch Panel 71 Control Communication Unit 72 Input Unit 73 Storage Unit 74 Control Unit 211, 232, 274 Motor 251 Illumination Lens 252 Half Mirror 253 Zoom Lens Unit 254 Imaging lens 271 Head holding unit 731 Image data storage unit 732 Position information storage unit 741 Image processing unit 742 Drive control unit 743 Display control unit 744 AF processing unit

Claims (5)

A stage for placing the specimen;
An objective lens for collecting observation light from the specimen;
A focus control means capable of adjusting a distance between the stage and the objective lens;
Photographing means for photographing the specimen and obtaining a specimen image;
Control means for causing the focus control means to adjust the distance between the stage and the objective lens, and for causing the photographing means to photograph a plurality of specimen images at a plurality of positions at which the distances are different;
Selection range setting means for setting a selection range of the specimen image used for generating a composite image at the plurality of positions;
Selection means for selecting the specimen image within the selection range set by the selection range setting means from the plurality of specimen images;
And composite image generation means for generating a first synthesized image using the sample image of several selected by pre-Symbol selection means,
Display means capable of simultaneously displaying the first composite image and the characteristic value of each specimen image in the selection range;
An observation apparatus comprising: The composite image generating means includes a first composite image according to claim 1, characterized in that to generate the second synthesized image generated using all of the specimen image in the plurality of locations Observation device. The display means, the observation apparatus according to claim 2, wherein a call to display the first composite image and the second composite image. Further comprising a threshold setting means for setting a threshold value of the characteristic value of the sample image;
The composite image generation unit generates the first composite image by excluding a corresponding region from the images selected by the selection unit according to a threshold set by the threshold setting unit. The observation apparatus according to any one of claims 1 to 3. Observation apparatus according to claim 4, characterized in that to complement the excluded the corresponds to regions with a predetermined color or texture.

Images