JP5669616B2 - Imaging apparatus, image generation method, and image generation program - Google Patents

Description

  The present invention relates to a technique for generating an image having a wider dynamic range than an original image by synthesizing a plurality of images taken under different exposure conditions.

  Conventionally, in the field of imaging devices represented by digital still cameras, a plurality of images (hereinafter referred to as original images) captured under different exposure conditions are combined to generate an image having a wider dynamic range (hereinafter referred to as an original image). , Which is referred to as a composite image).

  By using these technologies called dynamic range expansion (DR expansion), high dynamic range (HDR), or wide dynamic range (WDR) (hereinafter referred to as HDR technology), the dynamic range of the original image is so-called black. It is possible to satisfactorily observe a subject in which a phenomenon called crushing or white stripes occurs.

  The size of the dynamic range of the subject can be determined from indices such as the saturation level and average luminance on the low gradation side and high gradation side of the histogram of the original image. For this reason, in applying the HDR technique, a technique for determining an appropriate exposure time ratio and the number of combined images (number of original images) has been conventionally proposed in order to ensure a necessary dynamic range according to the subject.

  For example, Patent Document 1 discloses a technique for measuring the luminance value of a subject from a captured image obtained by preliminary imaging, and determining the number of imaging and the exposure condition based on the luminance value.

JP 2004-7298 A

  Incidentally, one of the main parameters for evaluating the image quality of a composite image generated by the HDR technique is the number of gradations of the composite image (hereinafter referred to as post-combination gradation number). In order to generate an overall good composite image in which blackout and whiteout are suppressed, a larger number of gradations is required as the dynamic range of the subject is larger. For example, even if the number of gradations of the original image (hereinafter referred to as the number of gradations of the original image) is 8 bits and white stripes have occurred, as the number of gradations after synthesis increases to 12 bits, 14 bits, 16 bits, Is suppressed, and there is a tendency that a good composite image is obtained as a whole.

  The number of gradations after composition is determined by the number of original images used for composition (hereinafter referred to as composite number) and the exposure time ratio between the original images, and a combination of the number of composite images and exposure time ratio (hereinafter referred to as shooting mode). .) Can vary, a synthesized image having the same number of tones after synthesis can be generated.

For example, by using a composition method in which the number of gradations after composition is increased by Nbit with respect to the number of gradations of the original image by composing an original image that is different in exposure time by 2 ^N times with the light amount and ISO sensitivity fixed. Consider a case where a composite image of a subject that requires 16-bit gradation is generated from an original image with 12-bit gradation. In this case, the composite image, three original images also be generated by synthesizing two original images of times the exposure time ratio of 16 (2 ^4x), the exposure time ratio is four times (2 ² times) that the produce was also synthesized, or can be the exposure time ratio is generated by combining the five original image twice (2 x ^1). That is, when generating a composite image with a specific number of gradations from an original image with a specific number of gradations using HDR technology, the number of composites decreases as the exposure time ratio increases, and the composition decreases as the exposure time ratio decreases. The number of sheets increases.

If the number of combined images is reduced and the exposure time ratio is increased too much, noise of the original image may remain in the combined image. In addition, since it becomes difficult to provide an overlapping portion with the gradation range assigned to another original image in the gradation range assigned to each original image, the composite image tends to be an unnatural image.
For this reason, even for a composite image having the same number of gradations, the image quality tends to increase as the exposure time ratio decreases. On the other hand, as the exposure time ratio is reduced and the number of synthesized images is increased, the processing time required for the synthesis becomes longer, so that high-speed image generation becomes difficult. For this reason, even for a composite image with the same number of gradations, the larger the exposure time ratio, the smaller the time lag from imaging to display, and higher-speed image display becomes possible.

  As described above, in the composite image by the HDR technology, there is a trade-off relationship between the image quality and the processing time, and even in the composite image having the same number of post-combination gradations, which is the main parameter for evaluating the image quality, There may be a difference in image quality between the composite images generated in (1). That is, in the HDR technology, the balance between image quality and processing time can be arbitrarily set when generating a composite image.

  On the other hand, the expansion of the dynamic range by the HDR technology is primarily intended to obtain an image with good image quality. For this reason, conventionally, an image quality higher than a certain level is naturally required for a composite image by the HDR technology.

  Due to such restrictions, most conventional imaging apparatuses to which the HDR technology is applied fix the number of combined images to a number that can obtain a good image quality of a certain level or more. In addition, Patent Document 1 discloses an imaging device in which the number of combined images is variable. However, the image pickup device disclosed in Patent Document 1 has a variable number of combined images in order to obtain good image quality according to the subject. . For this reason, in the imaging apparatus disclosed in Patent Document 1, the range in which the number of combined images is variable is limited to a range in which a good image quality substantially higher than a certain level can be obtained. That is, in the conventional imaging apparatus, the balance between the image quality and the processing time cannot be freely set due to the image quality limitation.

  However, assuming various scenes in which the imaging apparatus is used (referred to as “use scenes”), in reality, the required image quality is not always constant, and scenes in which image quality is prioritized (hereinafter referred to as “image quality-oriented scenes”). .), And there are scenes where the processing time is given priority over the image quality (hereinafter referred to as speed-oriented scenes).

  For example, a case will be described as an example in which an HDR technology is effectively applied and an object such as an electric board that is susceptible to white stripes is observed. In this case, a scene where a still image of a subject is recorded, a scene where measurement data is acquired from an image, and the like are image quality-oriented scenes because importance is placed on image quality and measurement accuracy depending on the image quality. On the other hand, even when observing a subject such as an electric board, images are displayed without delay with respect to user operations during adjustment work such as focusing and changing the observation position, and screening work. There is a need. For this reason, it is a speed-oriented scene because high-speed display is required even if image quality is somewhat sacrificed.

As described above, the imaging apparatus is also required to have a function for appropriately setting the balance between the image quality and the processing time according to the use scene.
In light of the above circumstances, an object of the present invention is to provide a technique for appropriately setting the balance between image quality and processing time according to the usage scene.

  A first aspect of the present invention is an imaging apparatus that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, and the processing time required for generating the composite image quality and composite image A setting input unit for inputting a balance setting and a shooting mode for determining a shooting mode including the number of synthesized images and the exposure condition of the original image based on the balance setting input to the setting input unit A mode determining unit; and an imaging unit that captures a specimen under each of the exposure conditions determined by the shooting mode determining unit and generates a composite number of original images determined by the shooting mode determining unit. Means for determining a shooting mode from at least a speed-oriented mode that prioritizes processing time over the image quality of a composite image and an image quality-oriented mode prioritizing image quality over the processing time of a composite image. To provide a device.

  According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the shooting mode determining means attaches more importance to the image quality than the speed-oriented mode in addition to the speed-oriented mode and the image quality-oriented mode. Provided is an imaging apparatus that determines a shooting mode from at least one intermediate mode in which processing time is more important than an importance mode.

  According to a third aspect of the present invention, in the imaging apparatus according to the first aspect or the second aspect, a recording unit that records an original image generated by the imaging unit, and a composite number generated by the imaging unit An image compositing unit that synthesizes the original images, and the imaging unit switches the exposure condition of the shooting mode determined by the shooting mode determination unit to continuously generate a composite number of original images, and Provides an imaging device that synthesizes the recorded original image each time the original image generated by the imaging means is recorded.

A fourth aspect of the present invention is an imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, and a scene determination unit that determines a use scene of the imaging device; Based on the usage scene determined by the scene determination unit, a shooting mode determination unit that determines a shooting mode that includes a composite number of original images to be combined and an exposure condition of the original image, and an exposure condition that is determined by the shooting mode determination unit Each of the imaging unit includes an imaging unit that generates a composite number of original images determined by the imaging mode determination unit, and an operation unit for operating the imaging device, and the imaging mode determination unit includes: at least to determine the rate-oriented mode giving priority to processing times than quality of the composite image, the image-quality priority mode than the processing time of the composite image is prioritized quality, the shooting mode from the Over down determination means, to provide an imaging apparatus to determine the usage scene by the operation amount with respect to the operating unit.

According to a fifth aspect of the present invention, in the imaging device according to the fourth aspect, when the operation amount is greater than a predetermined threshold, the scene determination unit sets the use scene to a processing time that is higher than the image quality of the composite image. The priority mode is determined to be a speed-oriented scene, and the shooting mode determination unit determines the shooting mode to be a speed-oriented mode, and when the operation amount is equal to or less than a predetermined threshold, the scene determination unit determines that the use scene is a processing time of the composite image. The imaging mode determining unit provides an imaging apparatus that determines the imaging mode to the image quality emphasis mode.

A sixth aspect of the present invention is an imaging apparatus that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, and a scene determination unit that determines a use scene of the imaging apparatus; Based on the usage scene determined by the scene determination unit, a shooting mode determination unit that determines a shooting mode that includes a composite number of original images to be combined and an exposure condition of the original image, and an exposure condition that is determined by the shooting mode determination unit Each of the image capturing means for capturing a sample and generating an original image of the composite number determined by the imaging mode determination means , and a display unit for displaying the composite image, and the imaging mode determination means includes at least a composite image determining a rate-oriented mode giving priority to processing time than image quality, and image-quality priority mode than the processing time of the composite image is prioritized quality, the shooting mode from the scene determination means, if The amount of change rendering parameters for transforming the image into gray scale can be displayed on the display unit to provide a determining imaging device usage scene.

According to a seventh aspect of the present invention, in the imaging device according to the sixth aspect, when the amount of change is greater than a predetermined threshold, the scene determination means sets the usage scene to a processing time longer than the image quality of the composite image. The priority mode is determined to be a speed-oriented scene, and the shooting mode determining unit determines the shooting mode to be a speed-oriented mode, and when the amount of change is equal to or less than a predetermined threshold, the scene determining unit determines that the scene to be used is the processing time of the composite image The imaging mode determining unit provides an imaging apparatus that determines the imaging mode to the image quality emphasis mode.

An eighth aspect of the present invention is an imaging apparatus that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, and a scene determination unit that determines a use scene of the imaging apparatus; Based on the usage scene determined by the scene determination unit, a shooting mode determination unit that determines a shooting mode that includes a composite number of original images to be combined and an exposure condition of the original image, and an exposure condition that is determined by the shooting mode determination unit And imaging means for generating a composite number of original images determined by the imaging mode determination means, and the imaging mode determination means prioritizes processing time over at least the image quality of the composite image. a rate-oriented mode, and determines the image quality priority mode processing than the time giving priority to the quality of the composite image, the shooting mode from the further imaging device, a plurality of machine that utilizes a composite image It includes a scene determination means, to provide an imaging apparatus for determining a usage scene the ability to use a composite image capturing apparatus is running.

A ninth aspect of the present invention is an image generation method for generating a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, the image quality of the composite image and the processing required for generating the composite image An acquisition step for acquiring a setting of a balance with time, a determination step for determining a shooting mode composed of a composite number of original images and an exposure condition of the original image based on the setting acquired in the acquisition step; An imaging step of imaging a specimen under each of the exposure conditions determined by the process and generating a composite image of the composite image determined by the determination process, wherein the determination process is at least processed more than the image quality of the composite image Provided is an image generation method for determining a shooting mode from a speed priority mode that prioritizes time and an image quality priority mode that prioritizes image quality over the processing time of a composite image.

According to a tenth aspect of the present invention, there is provided an image generation program that operates in an imaging apparatus that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions. Based on the acquisition procedure for acquiring the setting of the balance with the processing time required for generating the image, and the setting acquired in the acquisition procedure, a shooting mode is determined that includes the number of synthesized images and the exposure condition of the original image. A determination procedure and a synthesis procedure for synthesizing a composite number of original images generated by imaging a specimen under each of the exposure conditions determined by the determination procedure are executed by a computer, and the determination procedure includes at least a composite image The image generation process is a procedure for determining the shooting mode from a speed-oriented mode that prioritizes processing time over the image quality of images and an image-oriented mode that prioritizes image quality over the processing time of composite images. To provide a gram.

  ADVANTAGE OF THE INVENTION According to this invention, the technique which sets appropriately the balance of an image quality and processing time according to a utilization scene can be provided.

It is a figure for demonstrating the relationship between the imaging | photography mode and image quality of the synthesized image produced | generated from the original image by HDR technique. It is a figure for demonstrating the difference of the range of the imaging | photography mode calculated | required with an image priority scene and a speed priority scene. It is a figure for demonstrating the relationship between exposure time ratio and an image quality. It is a figure for demonstrating the relationship between the number of gradations of a synthesized image, and a synthetic | combination number of sheets on conditions with constant exposure time ratio. 1 is a diagram illustrating a configuration of an imaging apparatus according to a first embodiment. 6 is a diagram illustrating a GUI screen displayed on the display unit of the imaging apparatus according to the first embodiment. FIG. 6 is a flowchart of a composite image generation process using HDR technology by the imaging apparatus according to the first embodiment. FIG. 3 is a diagram illustrating a shooting mode set by the imaging apparatus according to the first embodiment. It is a figure for demonstrating switching of the exposure conditions in an imaging means. FIG. 6 is a diagram for explaining image composition processing performed by the imaging apparatus according to the first embodiment. FIG. 6 is a diagram illustrating a modified example of the configuration of the imaging apparatus according to the first embodiment. FIG. 6 is a diagram illustrating a configuration of an imaging apparatus according to a second embodiment. 9 is a flowchart of a composite image generation process using HDR technology by an imaging apparatus according to a second embodiment. FIG. 6 is a diagram illustrating a configuration of an imaging apparatus according to a third embodiment. 12 is a flowchart of a composite image generation process using HDR technology by an imaging apparatus according to Embodiment 3.

  First, the difference in the adjustable range between the present invention and the prior art will be described with respect to the balance between the image quality of the synthesized image generated by the HDR technique and the processing time. In the following, a composite image refers to a composite image generated by the HDR technique unless otherwise specified.

  FIG. 1 is a diagram for explaining the relationship between the shooting mode and image quality of a composite image generated from an original image by the HDR technology. FIG. 2 is a diagram for explaining the difference in the range of shooting modes required for an image-oriented scene and a speed-oriented scene. 1 and 2, the horizontal axis indicates the number of gradations (bit) of the composite image, and the vertical axis indicates the frame rate (fps) of the composite image.

  In FIG. 1, an example of a case where an original image with a reference frame rate of 15 fps and a gradation number of 10 bits is synthesized by the HDR technology, a shooting mode range in which a composite image with good image quality is generated is a vertical stripe region VD, and the image quality is A range of shooting modes in which a deteriorated composite image is generated is indicated by a lattice area LD. As illustrated in FIG. 1, the lattice region LD is formed in a region having a high gradation and a high frame rate. The reason why the lattice region LD has the shape illustrated in FIG. 1 will be described later.

  In the imaging apparatus according to the conventional technique, since a good image quality of a certain level or more is required, only the shooting mode in the vertical stripe region VD where a composite image with a good image quality is generated is used. For example, in the case of combining two images with a small number of combined images, the range of the photographing mode indicated mainly by the area A is set. In the case of combining five to seven images having a large number of combined images, the image pickup mode indicated mainly by the region B is selected. Range is used.

  On the other hand, in the imaging device according to the present invention, in addition to the shooting mode of the vertical stripe region VD, the shooting mode of the lattice region LD in which a composite image with degraded image quality is generated is used according to the usage scene of the imaging device. Is done.

  In FIG. 2, in addition to the vertical stripe region VD and the lattice region LD, the range of the shooting mode to be applied to the image quality emphasis scene for the subject having the gradation number of 14 bits is applied to the speed emphasis scene in the image quality emphasis mode region QD. The range of photographing modes to be performed is indicated by a speed-oriented mode area SD. Note that FIG. 2 also illustrates a case where an original image with a reference frame rate of 15 fps and a gradation number of 10 bits is synthesized by the HDR technique, as in FIG.

  As illustrated in FIG. 2, the image quality emphasis mode area QD defined by the alternate long and short dash line coincides with the vertical stripe area VD. For this reason, in the imaging device according to the related art, it is possible to realize appropriate synthesis for an image quality-oriented scene.

  On the other hand, the speed emphasis mode area SD defined by the dotted line includes all the areas of the number of gradations (14 bits) or less of the subject in the high frame rate area. For this reason, the speed emphasis mode area SD partially overlaps with the image quality emphasis mode area QD (vertical stripe area VD), but also includes a lattice area LD in which the image quality deteriorates unlike the image quality emphasis mode area QD. The most desirable shooting mode in a speed-oriented scene is often a condition that realizes the number of gradations close to the number of gradations of the subject, and is likely to be included in the lattice region LD. For this reason, in the imaging device according to the conventional technique, it is not usually possible to realize appropriate synthesis for a speed-oriented scene.

  On the other hand, the imaging apparatus according to the present invention supports both the imaging mode included in the vertical stripe region VD and the imaging mode included in the lattice region LD. For this reason, unlike an imaging device according to the related art, it is possible to appropriately cope with both an image quality important scene and a speed important scene. That is, according to the imaging apparatus according to the present invention, it is possible to appropriately set the balance between the image quality and the processing time, that is, the shooting mode, according to the usage scene.

Next, the reason why the lattice region LD has the shape illustrated in FIG. 1 will be described with reference to FIGS.
FIG. 3 is a diagram for explaining the relationship between the exposure time ratio and the image quality. FIG. 4 is a diagram for explaining the relationship between the number of gradations of a composite image and the number of composites under a condition where the exposure time ratio is constant. 3 and 4, the horizontal axis indicates the number of gradations (bits) of the composite image, and the vertical axis indicates the number of composite images. 3 and 4 corresponds to the frame rate in FIGS. 1 and 2, and is an index related to the processing time. One composite number in FIGS. 3 and 4 corresponds to the reference frame rate in FIGS.

In FIG. 3, point A and point C are illustrated as representatives of shooting modes in which image quality does not deteriorate, and point B is illustrated as representative of shooting modes in which image quality deteriorates.
First, point A and point B indicating the shooting mode with two composite images will be compared. Point A indicates a shooting mode in which a 13-bit composite image is generated with two composite images. At this time, the exposure time ratio of the two original images is 8 times (= 2 ^(13-10) ). . On the other hand, point B indicates a shooting mode in which a composite image of 16 bits is generated with two composite images, and at this time, the exposure time ratio of the two original images is 64 times (= 2 ^{(16-10 )} ). As described above, when the number of combined images is fixed, the exposure time ratio increases as the number of gradations of the combined image increases.

Next, point B and point C indicating a shooting mode in which the number of gradations of the composite image is 16 bits will be compared. Point B indicates a shooting mode in which a composite image of 16 bits is generated by two composite images as described above, and the exposure time ratio of the two original images is 64 times (= 2 ^{(16-10 )} ). On the other hand, the point C indicates a shooting mode in which a composite image of 16 bits is generated with seven composite images. At this time, the exposure time ratio of the seven original images is doubled (= 2 ^{(16-10 ) / (7-1)} ). Thus, when the number of gradations of the composite image is fixed, the exposure time ratio increases as the number of composite images decreases.

  In general, if the exposure time ratio is excessively increased, an uncomfortable portion is generated at the time of image composition. Therefore, if the exposure time ratio is increased to a certain extent, the image quality is deteriorated. For this reason, the number of synthesized images is the same at point A and point B, but the image quality deteriorates only at point B where the exposure time ratio is large. Further, although the number of gradations is the same at point B and point C, the image quality deteriorates only at point B where the exposure time ratio is large.

  The solid line and the broken line illustrated in FIG. 4 indicate the shooting modes with the exposure time ratio of 2 times and 4 times, respectively. As described above with reference to FIG. 3, the exposure time ratio increases as the number of gradations increases or the number of combined images decreases. For this reason, the region on the higher gradation side (or on the lower composite number side) than the solid line with the solid line as the boundary is a region in the shooting mode in which the exposure time ratio is twice as large as the boundary. The area on the low composite number side) is an area in the photographing mode in which the exposure time ratio is larger than four times.

  The exposure time ratio that causes unreasonable effects in the combined portion varies depending on the subject and other conditions, so it cannot be specified unconditionally. However, the region of the shooting mode in which the exposure time ratio exceeds a certain value is illustrated in FIG. , And formed in an area of high gradation and high frame rate (low composite number). For this reason, the lattice area LD indicating the range of the photographing mode in which the image quality deteriorates has a shape as illustrated in FIG.

  Although it is empirical, when the exposure time ratio is about 2 to 4 times, the image quality is hardly deteriorated, but when it is 8 times, the image quality may be deteriorated. For this reason, in FIG. 1, the exposure time ratio of 4 times is illustrated as a boundary between a shooting mode in which image quality deteriorates and a shooting mode in which image quality does not deteriorate. However, the boundary between the shooting mode in which the image quality deteriorates and the shooting mode in which the image quality does not deteriorate is not particularly limited to this magnification. The boundary between the vertical stripe region VD and the lattice region LD may be delimited by an exposure time ratio with a higher magnification.

  Hereinafter, embodiments of the imaging apparatus, the image generation method, and the image generation program that can appropriately set the balance between the image quality and the processing time according to the usage scene will be specifically described.

  FIG. 5 is a diagram illustrating the configuration of the imaging apparatus according to the present embodiment. FIG. 6 is a diagram illustrating a GUI screen displayed on the display unit of the imaging apparatus according to the present embodiment. FIG. 7 is a flowchart of the composite image generation process using the HDR technology by the imaging apparatus according to the present embodiment. FIG. 8 is a diagram illustrating a shooting mode set by the imaging apparatus according to the present embodiment. FIG. 9 is a diagram for explaining switching of exposure conditions in the image pickup means. FIG. 10 is a diagram for explaining the image composition process performed by the imaging apparatus according to the present embodiment.

  The imaging apparatus 1 illustrated in FIG. 5 is a microscope imaging apparatus that generates a composite image by synthesizing a plurality of original images obtained by imaging a specimen under different exposure conditions. A setting of a balance between image quality and processing time is input. By including the setting input means, the balance between the image quality of the synthesized image and the processing time can be appropriately set according to the usage scene. In this embodiment, a GUI screen is exemplified as the setting input unit. The exposure condition is the exposure time.

  The imaging device 1 includes a microscope 2 that forms an optical image of the specimen 11, an imaging device body 20 that is an imaging means that images the optical image formed by the microscope 2, and image data generated by the imaging device body 20 ( And a computer 30 that generates image data (composite image) by synthesizing the original image) by the HDR technology.

  The microscope 2 is a microscope that can be used by switching various spectroscopic methods including fluorescence observation. The light source 3 for transmitted illumination, the light source 4 for epi-illumination, and a half mirror are used according to the spectroscopic method. 15 etc. are included.

  On the transmitted illumination optical path 3a of the microscope 2, a collector lens 5, a mirror 6, a window lens 7, a field stop (FS) 8, an aperture stop (AS) 9, and a condenser lens 10 are sequentially arranged from the light source 3 toward the specimen 11. Has been placed. On the other hand, on the epi-illumination light path 4a, a collector lens, AS and FS (not shown), an objective lens 12, and a half mirror 15 (a replaceable cube unit in the case of fluorescence observation) are arranged. On the observation optical path S, an objective lens 12, a half mirror 15, an imaging lens 13, and a port 14 are arranged in this order from the sample 11 side.

  Optical elements such as various filters and polarizing elements may be further disposed in the illumination optical path and the observation optical path. The objective lens 12 and the half mirror 15 are arranged so as to be switchable according to the observation magnification and the spectroscopic method.

  The imaging device body 20 includes an imaging element 21 that photoelectrically converts light from the specimen 11 into an electrical signal, an imaging element drive unit 22 that controls driving of the imaging element 21, and an electrical signal output from the imaging element 21 as a video signal. A pre-processing unit 23 for converting to a video signal; an A / D conversion unit 24 for converting a video signal into digital image signal data; a signal processing unit 25; a bus 26; a control unit 27; / F section 28.

  The computer 30 includes a control unit 31, an operation unit 32, an I / F unit 33, a display unit 34, a recording unit 35, and an HDR processing unit 40. Furthermore, the HDR processing unit 40 includes a setting acquisition unit 41, an imaging condition extraction unit 42, a DR enlargement unit 43, a parameter dynamic calculation unit 44, and a DR compression unit 45.

When the specimen 11 is observed with epi-illumination, the original image of the specimen 11 is output to the computer 30 when the microscope 2 and the imaging apparatus main body 20 operate as follows.
First, the illumination light emitted from the epi-illumination light source 4 passes through the condenser lens and enters the half mirror 15 via the FS and AS (not shown). The illumination light reflected by the half mirror 15 is irradiated onto the specimen 11 by the objective lens 12.

  The reflected light returns from the specimen 11 irradiated with the illumination light. The reflected light enters the half mirror 15 via the objective lens 12. At this time, since the half mirror 15 transmits the reflected light from the specimen 11, the reflected light is emitted from the port 14 toward the image sensor 21 through the imaging lens 13.

  In the imaging apparatus main body 20 connected to the port 14, an imaging element 21 such as a CCD is arranged at a position where the optical image of the specimen 11 is projected by the imaging lens 13. The image sensor 21 is driven with an exposure time based on a drive signal from the image sensor drive unit 22, photoelectrically converts light (optical image of the sample 11) input during that time, and outputs an electrical signal to the pre-processing unit 23. To do.

  The pre-processing unit 23 to which the electrical signal is input receives the control pulse from the image sensor driving unit 22 and converts the electrical signal into video signals of R (red), G (green), and B (blue) colors. And output to the A / D converter 24. The A / D converter 24 converts the video signal into digital image data based on the clock signal from the image sensor driving unit 22 and outputs the digital image data.

  The digital image data output from the A / D conversion unit 24 is subjected to signal processing such as color correction and gradation correction by the signal processing unit 25, and then the bus 26, the control unit 27, and the I / F unit 28 are connected. Then, it is output to the recording unit 35 of the computer 30 as an original image.

  In the computer 30, when a program for generating a composite image by the HDR technique is activated by an instruction input from the user via the operation unit 32, the GUI screen 50 illustrated in FIG. 6 is displayed on the display unit 34. Is displayed. The GUI screen 50 is a setting input unit for inputting a balance between the image quality of the composite image and the processing time required to generate the composite image. The GUI screen 50 includes an image display area 51 for displaying the composite image, and a composite image using the HDR technology. A button 52 for starting the generation process and a slider 53 for adjusting the balance between the image quality of the synthesized image and the processing time are included.

  In FIG. 6, a state where the slider 53 is at the center is displayed as an initial state. By moving the slider 53 to the left side, a balance that emphasizes the processing time is set, and after the button 52 is pressed, a composite image generation process that prioritizes the processing time over the image quality is executed. On the other hand, by moving the slider 53 to the right side, a balance with an emphasis on image quality is set, and after the button 52 is pressed, a composite image generation process giving priority to the image quality with respect to the processing time is executed.

  The GUI screen is not limited to the configuration illustrated in FIG. The GUI control for adjusting the balance between the image quality of the composite image and the processing time is not limited to the slider, and the GUI screen may be configured to include an arbitrary GUI control instead of the slider 53. Further, the button 52 may be omitted, and the composite image generation process may be executed immediately with the setting according to the changed position by changing the position of the slider 53.

Hereinafter, with reference to FIGS. 5 to 10, a composite image generation process using the HDR technique by the imaging apparatus 1 according to the present embodiment will be described.
In the imaging apparatus 1 illustrated in FIG. 5, when a program for generating a composite image using the HDR technology is activated, the GUI screen 50 illustrated in FIG. 6 is displayed on the display unit 34 of the computer 30.

  When the user moves the slider 53 to set the balance between image quality and processing time according to the usage scene and presses the button 52, the imaging apparatus 1 starts the composite image generation process illustrated in FIG.

  As illustrated in FIG. 7, the composite image generation process is roughly composed of an imaging condition extraction process P1, an imaging process P2, and an image composition process P3. When the composite image generation process is started, the imaging condition extraction process P1 is started by the computer 30.

  First, in response to an instruction from the control unit 31, the setting acquisition unit 41 acquires the setting (shooting mode value) of the balance between image quality and processing time input from the GUI screen 50 that is an input setting unit, and the imaging condition extraction unit 42. (Step S101).

  Next, the imaging condition extraction unit 42 extracts the imaging conditions including the imaging mode by calculation based on the image of the sample 11 recorded in the recording unit 35 and the setting (imaging mode value) acquired by the setting acquisition unit 41. Then, it records in the recording part 35 (step S102). Examples of the imaging conditions include the number of gradations of the composite image necessary for expressing the dynamic range of the specimen 11, the number of composite images of the original image, and the exposure condition of the original image.

  The imaging condition extraction unit 42 calculates the number of gradations necessary for the composite image by analyzing the histogram of the image of the sample 11 recorded in the recording unit 35. As a method for calculating the number of gradations necessary for the composite image from the image of the specimen 11, various known conventional techniques can be used.

The imaging condition extracting unit 42 determines the number of original images to be combined and the exposure condition of the original image, that is, the shooting mode, based on the setting (shooting mode value) acquired by the setting acquisition unit 41.
For example, the shooting mode is based on the shooting mode value from among a plurality of combinations of the number of combined images and the exposure time ratio determined from the number of gradations required for the combined image and the number of gradations of the original image generated by the imaging apparatus body 20. May be determined.

  When the number of gradations of the original image generated by the imaging apparatus main body 20 is 10 bits and the number of gradations required for the composite image is 14 bits, the shooting mode is a combination of two original images with an exposure time ratio of 16 times. (Speed priority mode), a combination of three original images with an exposure time ratio of 4 times (intermediate mode), and a combination of 5 original images with an exposure time ratio of 2 times (image quality priority mode). , D and F.

  When the setting acquired by the setting acquisition unit 41 due to the slider 53 being positioned on the left side of the center is a shooting mode value with an emphasis on speed, the shooting mode is a speed emphasis mode in which processing time is prioritized over the image quality of the composite image. (Point E) may be determined. Further, when the setting acquired by the setting acquisition unit 41 is a shooting mode value that emphasizes image quality because the slider 53 is positioned on the right side of the center, the shooting mode prioritizes the image quality over the processing time for generating a composite image. The image quality emphasis mode (point F) may be determined. In addition, when the setting acquired by the setting acquisition unit 41 is a shooting mode value between speed-oriented and image-oriented with the slider 53 being at the center, the image quality is more important than the speed-oriented mode and the image-oriented mode is more important. The intermediate mode (point D) in which processing time is emphasized may be determined.

  In addition, the shooting mode includes a plurality of combinations (for example, point D, point E, point F) of the number of composites determined from the number of gradations required for the composite image and the number of gradations of the original image, and other combinations (for example, point D, point E, point F). For example, it may be determined based on the shooting mode value from among the points E ′, E ″, and F ′).

  When it can be read from the histogram of the image of the specimen 11 using the conventional technique that the image quality in the shooting mode indicated by the point E is significantly deteriorated, the shooting mode indicated by the point E ′ instead of or in addition to the point E May be set to a speed-oriented mode. As a result, although the number of gradations is reduced, it is possible to select a speed-oriented mode in which the processing time is maintained while suppressing significant image quality degradation. The shooting mode indicated by the point F ′ instead of the point F or in addition to the point F may be set as the image quality emphasis mode. Thereby, it is possible to select an image quality emphasis mode that further emphasizes image quality. When speed is extremely important, the number of composites may be one, and the shooting mode indicated by the point E ″ instead of the point E may be set as the speed priority mode. A known process that can improve the image quality may be performed.

  In other words, the imaging condition extraction unit 42 is a shooting mode determination unit that determines a shooting mode based on the setting (shooting mode value) input to the GUI screen 50 and acquired by the setting acquisition unit 41, and at least includes a composite image. The photographing mode is determined from a speed-oriented mode that prioritizes processing time over image quality and an image-oriented mode that prioritizes image quality over processing time of a composite image. More preferably, in addition to at least the speed-oriented mode and the image quality-oriented mode, the imaging condition extraction unit 42 attaches at least one intermediate mode that places more importance on the image quality than the speed-oriented mode and places more importance on the processing time than the image-oriented mode. The photographing mode is determined from the following. Note that the shooting mode has a strong correlation with the composite number.

When the imaging condition is recorded in the recording unit 35, the control unit 31 notifies the imaging device body 20 of the imaging mode.
In the imaging apparatus main body 20 to which the shooting mode is notified, the imaging process P2 is started. The imaging device body 20 images the specimen 11 according to the imaging mode. That is, the imaging apparatus body 20 captures the specimen 11 under each of the exposure conditions determined by the imaging condition extraction unit 42, and generates a composite number of original images determined by the imaging condition extraction unit 42 (Step S104, S105, S106, S107, S108).

  More specifically, the image sensor driving unit 22 changes the exposure time (exposure condition) according to the imaging mode (step S105), the image sensor 21 images the sample 11 (step S106), and the signal processing unit 25 is digital. Image data (original image) is generated (step S107), and the control unit 27 outputs the original image to the computer 30 via the I / F unit 28 (step S108). In the imaging apparatus main body 20, these processes are repeated as many times as the number of composites (step S104).

  By the way, when an imaging means such as a normal digital camera repeatedly images a specimen under a specific exposure condition (Exp1), it is possible to continuously generate images as illustrated in FIG. 9A. it can. However, when imaging a specimen by switching a plurality of exposure conditions, an exposure condition is switched in response to an instruction from the computer 30 every time a frame period ends, and therefore a period for communication or the like occurs between the frame periods. As a result, images cannot be generated continuously.

  On the other hand, the imaging apparatus main body 20 which is an imaging means included in the imaging apparatus 1 switches the exposure condition by determining the switching timing without receiving an instruction from the computer 30 every time the frame period ends. Therefore, a period for communication or the like does not occur between the frame periods. If two types of exposure conditions (Exp1, Exp2) are included in the shooting mode notified from the computer 30, the exposure conditions are switched as illustrated in FIG. 9B. If five types of exposure conditions (Exp1, Exp2, Exp3, Exp4, Exp5) are included, the exposure conditions are switched as illustrated in FIG. 9C. For this reason, the imaging apparatus main body 20 can continuously generate the composite image of the original image by switching the exposure condition in the shooting mode at high speed. The generated original image is transmitted to the computer 30 at any time and recorded in the recording unit 35.

  In the computer 30 that has finished the imaging condition extraction process P1, the image composition process P3 is started. When the original image is recorded in the recording unit 35, initialization or the like is performed as intermediate processing before the HDR processing unit 40 combines the original image (step S110), and the DR enlargement unit 43 combines the original image (step S111). ). These processes are repeated as many times as the number of synthesized images (step S109), and the synthesized image is output to the parameter dynamic calculating unit 44 as HDR image data.

  The parameter dynamic calculation unit 44 calculates drawing parameters from the HDR image data (step S112) and outputs the drawing parameters together with the HDR image data to the DR compression unit 45. The drawing parameter is a parameter used for generating a composite image having the number of gradations that can be displayed on the display unit 34 from the HDR image data. The DR compression unit 45 converts the gradation of the HDR image data using the drawing parameters while maintaining the image quality, and generates a composite image that can be displayed on the display unit 34 from the HDR image data (step S113). The DR compression unit 45 can use any known compression algorithm. The generated composite image is output to the display unit 34 and displayed in the image display area 51 of the GUI screen 50 (step S114).

  In the imaging device 1, the DR enlargement unit 43 synthesizes the original images each time the original image is recorded in the recording unit 35, thereby synthesizing the synthesized number of original images generated by the imaging device body 20. It is. That is, as illustrated in FIG. 10, when the second original image is output, the DR enlargement unit 43 combines the first and second original images and outputs the third original image. Then, the image obtained by combining the first and second original images and the third original image are combined. As the DR enlargement unit 43 operates in this way, the composition process is started before all the original images are output to the recording unit 35. For this reason, the time required to display the composite image can be shortened.

  The imaging device 1 repeats the imaging process P2 and the image synthesis process P3 (step S103), so that the latest synthesized image is displayed in the image display area 51 at any time. Therefore, live observation of the specimen 11 can be performed.

  As described above, according to the imaging apparatus 1 and the image generation method according to the present embodiment, the operation unit 32 is used to move the slider 53 of the GUI screen 50 displayed on the display unit 34 to the left and right, thereby changing the usage scene. Accordingly, it is possible to appropriately set a balance between the image quality of the composite image generated in response to the processing time required for generation.

  5 illustrates the imaging apparatus 1 including the imaging apparatus main body 20 and the computer 30, but the imaging apparatus according to the present embodiment may be configured such that the imaging apparatus main body 20 and the computer 30 are integrated. In FIG. 5, the imaging apparatus 1 including the microscope 2 is illustrated as a means for forming an optical image, but the imaging apparatus may be configured to include a digital still camera instead of the microscope 2 and the imaging apparatus body 20. Furthermore, the digital still camera and the computer 30 may be configured integrally.

  5 illustrates the imaging apparatus 1 including the computer 30 including the HDR processing unit 40 configured by hardware, but the configuration of the imaging apparatus is not particularly limited thereto. The imaging apparatus may include a computer 70 illustrated in FIG. 11 instead of the computer 30.

  FIG. 11 is a diagram illustrating a modified example of the configuration of the imaging apparatus according to the present embodiment. An imaging apparatus 60 illustrated in FIG. 11 is different from the imaging apparatus 1 illustrated in FIG. 1 in that a computer 70 is included instead of the computer 30.

  A computer 70 illustrated in FIG. 11 is, for example, a personal computer, and includes a control unit 71 such as an MPU, an operation unit 72 such as a keyboard, an I / F unit 73, a display unit 74 such as a monitor, an HDD, A recording unit 75 such as a RAM or a ROM, a driving unit 76 such as a CD-ROM drive or a DVD drive, and a recording medium 77 such as a CD-ROM or DVD are included. In addition, the computer 70 performs processing (specifically, the imaging condition extraction processing P1 and the image synthesis processing P3 illustrated in FIG. 7) executed by the HDR processing unit 40 instead of the HDR processing unit 40 of the computer 30. A program to be executed by the computer 70 is stored in the recording unit 75 or the recording medium 77.

  The slider of the GUI screen 50 displayed on the display unit 74 using the operation unit 72 also by the imaging device 60, the image generation method, and the image generation program according to the present modification, similarly to the imaging device 1 including the computer 30. By moving 53 to the left and right, it is possible to appropriately set the balance between the image quality of the synthesized image generated according to the usage scene and the processing time required for generation.

FIG. 12 is a diagram illustrating the configuration of the imaging apparatus according to the present embodiment. FIG. 13 is a flowchart of the composite image generation process using the HDR technology by the imaging apparatus according to the present embodiment.
An imaging device 80 illustrated in FIG. 12 is a microscope imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, and a scene for determining a use scene of the imaging device 80 By including the determination unit, it is possible to appropriately set the balance between the image quality of the composite image and the processing time according to the usage scene. In the present embodiment, a configuration in which a use scene is determined based on the drive amount of the electric stage 92 detected by the stage drive amount detection unit 111 is illustrated. The exposure condition is the exposure time.

The imaging apparatus 80 is different from the imaging apparatus 1 illustrated in FIG. 1 in that an electric microscope 90 is included instead of the microscope 2 and a computer 100 is included instead of the computer 30.
The electric microscope 90 includes an electric stage 92 on which the specimen 91 is arranged, a control unit 93, and an I / F unit 94. The electric microscope 90 is different from the microscope 2 illustrated in FIG. 1 in that the electric stage 92 can be driven by an operation on the computer 100.

  The computer 100 is different from the computer 30 illustrated in FIG. 1 in that it includes an HDR processing unit 110 instead of the HDR processing unit 40. The HDR processing unit 110 includes a stage drive amount detection unit 111, an imaging condition extraction unit 42, a DR enlargement unit 43, a parameter dynamic calculation unit 44, and a DR compression unit 45, and a stage instead of the setting acquisition unit 41. 1 is different from the HDR processing unit 40 illustrated in FIG. 1 in that the driving amount detection unit 111 is included.

Hereinafter, with reference to FIG. 12 and FIG. 13, a composite image generation process using the HDR technology by the imaging apparatus 80 according to the present embodiment will be described.
As illustrated in FIG. 13, the composite image generation process is roughly divided into an imaging condition extraction process P1a, an imaging process P2, and an image composition process P3, and instead of the imaging condition extraction process P1. 7 is different from the composite image generation process illustrated in FIG. 7 in that it includes the imaging condition extraction process P1a. When the composite image generation process is started, the imaging condition extraction process P1a is started by the computer 100.

  First, the stage drive amount detection unit 111 detects the drive amount of the electric stage 92 and outputs it to the imaging condition extraction unit 42 (step S201). The drive amount may be a drive amount in the optical axis direction (Z direction), or may be a drive amount in the XY direction perpendicular to the optical axis direction.

Next, the imaging condition extraction unit 42 determines a usage scene of the imaging device 80 based on the driving amount of the electric stage 92 (step S202).
When the drive amount is large, it is assumed that the imaging device 80 is performing adjustment operations such as focusing and changing the observation position. For this reason, the imaging condition extraction unit 42 determines that the usage scene is a speed-oriented scene where it is desirable to generate an image at a high speed to increase the frame rate.

  On the other hand, when the drive amount is small or completely stationary, it is assumed that the imaging device 80 is performing a measurement operation or the like. For this reason, the imaging condition extraction unit 42 determines that the use scene is an image quality-oriented scene where it is desirable that a high-quality image is generated.

When the driving amount is medium, the imaging condition extraction unit 42 determines that the scene places more importance on the image quality than the speed-oriented scene and places more importance on the processing time than the image quality-oriented scene.
For example, the imaging condition extraction unit 42 determines that the scene is a speed-oriented scene when the drive amount is larger than a predetermined threshold value, and determines that the scene is an image quality-oriented scene when the drive amount is equal to or less than a predetermined threshold value. May be.

  Further, the imaging condition extraction unit 42 extracts the imaging conditions including the imaging mode by calculation based on the image of the sample 11 and the usage scene, and records the extracted imaging conditions in the recording unit 35 (step S102). The imaging conditions include, for example, the number of gradations of the composite image necessary for expressing the dynamic range of the specimen 91, the number of composite images of the original image, the exposure conditions of the original image, and the like.

  The imaging condition extraction unit 42 calculates the number of gradations necessary for the composite image by the same method as the imaging device 1 according to the first embodiment. Furthermore, the imaging condition extraction unit 42 determines the number of original images to be combined and the exposure conditions of the original images, that is, the shooting mode, based on the usage scene determined in step S202. Specifically, the imaging condition extraction unit 42 determines the imaging mode as the speed-oriented mode if the usage scene is a speed-oriented scene, and determines the imaging mode as the quality-oriented mode if the usage scene is an image quality-oriented scene. To do. Further, if the use scene is a scene in which the image quality is more important than the speed important scene and the processing time is more important than the image quality important scene, the intermediate mode may be determined.

  That is, the imaging condition extraction unit 42 is a scene determination unit that determines the usage scene of the imaging device 80 from the driving amount of the electric stage 92, and is a shooting mode determination unit that determines a shooting mode based on the determined usage scene. is there. Furthermore, the imaging condition extraction unit 42 is configured to determine the shooting mode from at least the speed priority mode and the image quality priority mode. More preferably, in addition to at least the speed-oriented mode and the image quality-oriented mode, the imaging condition extraction unit 42 attaches at least one intermediate mode that places more importance on the image quality than the speed-oriented mode and places more importance on the processing time than the image-oriented mode. The photographing mode is determined from the following. Note that the shooting mode has a strong correlation with the composite number.

When the imaging condition is recorded in the recording unit 35, the control unit 31 notifies the imaging device body 20 of the imaging mode.
Thereafter, in the imaging device 80, the imaging process P2 and the image synthesis process P3 similar to those of the imaging apparatus 1 according to the first embodiment are performed, and a synthesized image is generated.

  As described above, according to the imaging apparatus 80 and the image generation method according to the present embodiment, the use scene is automatically determined based on the driving amount of the electric stage 92, and the processing required for the image quality and generation of the composite image according to the use scene. The balance with time can be set appropriately. For example, in the image pickup apparatus 80, when the electric stage 92 is moving at a slightly higher speed, the imaging stage 80 gradually shifts to a shooting mode in which importance is attached to the speed, and the electric stage 92 moves at a sudden speed. Can immediately shift to the speed-oriented mode.

  In FIG. 12, the imaging device 80 including the electric microscope 90 is illustrated. However, as long as the stage driving amount detection unit 111 can detect the driving amount of the stage, the stage is manually set instead of the electric microscope 90. A driving microscope may be included. Further, the imaging apparatus main body 20 and the computer 100 may be configured as a single unit. Further, the imaging apparatus may include a digital still camera instead of the electric microscope 90 and the imaging apparatus main body 20, and the digital still camera and the computer 100 may be configured integrally. Further, the imaging apparatus may include a computer 70 illustrated in FIG. 11 instead of the computer 100.

  Further, in FIG. 12, the electric stage 92 is illustrated as the movable part whose driving amount is detected, but the movable part is not limited to the electric stage 92. For example, the imaging apparatus may detect the driving amount of an arbitrary movable part such as a diaphragm of a microscope, determine a usage scene based on the driving amount of an arbitrary movable part, and set a shooting mode based on the determined usage scene. You may decide. In addition, the imaging device may detect an operation amount for an operation unit or a dimming knob for operating a stage or an aperture instead of a drive amount, and determines a use scene based on an operation amount for the operation unit and uses the operation unit. The shooting mode may be determined based on the scene. In addition, when the setting of the drawing parameter for converting the composite image (HDR image data) into a gradation that can be displayed on the display unit is changed, the imaging apparatus determines the use scene based on the amount of change of the drawing parameter, The shooting mode may be determined based on the usage scene.

  Note that when the usage scene is determined based on the amount of movement of the movable part, the amount of operation with respect to the operation part, and the amount of change in the drawing parameters, as in the case of the amount of driving of the stage, speed is emphasized when it is greater than a predetermined threshold. It may be determined as a scene, and when the drive amount is equal to or less than a predetermined threshold value, it may be determined as an image quality important scene.

FIG. 14 is a diagram illustrating the configuration of the imaging apparatus according to the present embodiment. FIG. 14 is a flowchart of a composite image generation process using the HDR technology by the imaging apparatus according to the present embodiment.
An imaging device 120 illustrated in FIG. 14 is a microscope imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions, and a scene for determining a use scene of the imaging device 120 By including the determination unit, it is possible to appropriately set the balance between the image quality of the composite image and the processing time according to the usage scene. In the present embodiment, the configuration in which the image comparison unit 141 determines the use scene by comparing the composite image and the original image is illustrated. The exposure condition is the exposure time.

The imaging apparatus 120 is different from the imaging apparatus 1 illustrated in FIG. 1 in that the imaging apparatus 120 includes a computer 130 instead of the computer 30.
The computer 130 is different from the computer 30 illustrated in FIG. 1 in that it includes an HDR processing unit 140 instead of the HDR processing unit 40. The HDR processing unit 140 includes an image comparison unit 141, an imaging condition extraction unit 42, a DR enlargement unit 43, a parameter dynamic calculation unit 44, and a DR compression unit 45, and an image comparison unit instead of the setting acquisition unit 41. 141 is different from the HDR processing unit 40 illustrated in FIG.

Hereinafter, with reference to FIGS. 14 and 15, a composite image generation process using the HDR technology by the imaging apparatus 120 according to the present embodiment will be described.
As illustrated in FIG. 15, the composite image generation process is roughly divided into an imaging condition extraction process P1b, an imaging process P2, and an image composition process P3, and instead of the imaging condition extraction process P1. 7 is different from the composite image generation process illustrated in FIG. 7 in that it includes the imaging condition extraction process P1b. When the composite image generation process is started, the imaging condition extraction process P1b is started by the computer 140.

  First, the image comparison unit 141 compares the images recorded in the recording unit 35 and, as a comparison result, the amount of change in the range displayed on the image (hereinafter referred to as screen movement amount) is the imaging condition extraction unit 42. (Step S301).

  The screen movement amount may be a screen movement amount in the optical axis direction (Z direction), or may be a screen movement amount in the XY direction perpendicular to the optical axis direction. Further, the image compared by the image comparison unit 141 may be a composite image that has already been generated, for example, a composite image that is continuously displayed. Further, among the original images of different composite images, the original images having medium brightness may be compared. The screen movement amount can be calculated by various known methods. For example, the screen movement amount may be calculated from a difference between images or may be calculated using a frequency space.

Next, the imaging condition extraction unit 42 determines a usage scene of the imaging device 120 from the screen movement amount (step S302).
When the screen movement amount is large, it is assumed that the imaging apparatus 120 is performing adjustment operations such as focusing and changing the observation position. For this reason, the imaging condition extraction unit 42 determines that the usage scene is a speed-oriented scene where it is desirable to generate an image at a high speed to increase the frame rate.

  On the other hand, when the screen movement amount is small or completely stationary, it is assumed that the imaging device 120 is performing a measurement operation or the like. For this reason, the imaging condition extraction unit 42 determines that the use scene is an image quality-oriented scene where it is desirable that a high-quality image is generated.

Further, when the screen movement amount is medium, the imaging condition extraction unit 42 determines that the scene places more importance on the image quality than the speed-oriented scene and places more importance on the processing time than the image quality-oriented scene.
For example, the imaging condition extraction unit 42 determines that the scene is a speed-oriented scene when the screen movement amount is larger than a predetermined threshold, and determines that the image quality-oriented scene is when the screen movement amount is equal to or less than a predetermined threshold. You may judge.

  Further, the imaging condition extraction unit 42 extracts the imaging conditions including the imaging mode by calculation based on the image of the sample 11 and the usage scene by the same method as described above in the second embodiment, and stores it in the recording unit 35. Recording is performed (step S102).

  That is, the imaging condition extraction unit 42 is a scene determination unit that determines the usage scene of the imaging device 120 from the comparison result of the composite image or the original image, and determines the shooting mode based on the determined usage scene. Means. Furthermore, the imaging condition extraction unit 42 is configured to determine the shooting mode from at least the speed priority mode and the image quality priority mode. More preferably, in addition to at least the speed-oriented mode and the image quality-oriented mode, the imaging condition extraction unit 42 attaches at least one intermediate mode that places more importance on the image quality than the speed-oriented mode and places more importance on the processing time than the image-oriented mode. The photographing mode is determined from the following. Note that the shooting mode has a strong correlation with the composite number.

When the imaging condition is recorded in the recording unit 35, the control unit 31 notifies the imaging device body 20 of the imaging mode.
Thereafter, in the imaging apparatus 120, the same imaging process P2 and image synthesis process P3 as those in the imaging apparatus 1 according to the first embodiment are performed, and a composite image is generated.

  As described above, according to the imaging apparatus 120, the image generation method, and the image generation program according to the present embodiment, the use scene is automatically determined based on the screen movement amount that is the comparison result of the images, and the composite image according to the use scene. It is possible to appropriately set the balance between the image quality of the image and the processing time required for generation. For example, in the imaging device 120, when the screen movement amount is gradually increased, the imaging mode is gradually shifted to a shooting mode in which importance is attached to the speed, and when the screen movement amount is suddenly increased, the speed is instantaneously increased. It is possible to shift to the emphasis mode.

  Note that the imaging apparatus main body 20 and the computer 130 may be configured integrally. The imaging device may include a digital still camera instead of the microscope 2 and the imaging device main body 20, and the digital still camera and the computer 130 may be configured integrally. Further, the imaging apparatus may include a computer 70 illustrated in FIG. 11 instead of the computer 130.

  In the present embodiment, the screen movement amount is exemplified as the image comparison result, but the image comparison result used for determining the use scene is not limited to the screen movement amount. For example, the usage scene may be determined by calculating the brightness of an image that can be changed by an operation of an aperture by comparing the images.

  Further, the method of determining the usage scene is not limited to the above-described determination method, and the usage scene may be determined by a function that uses the composite image that is executed by the imaging apparatus. For example, when a 2D composition function or a 3D composition function is executed by the imaging device, the usage scene is determined as a speed-oriented scene, and when a measurement function is executed by the imaging device, the usage scene is focused on image quality. It may be determined as a scene. Note that the relationship between the function and the usage scene is not limited to the above-described relationship. For example, when the 3D composition function is executed, the usage scene may be determined as an image quality-oriented scene. Further, the imaging apparatus may be configured so that the user can arbitrarily set the relationship between the function and the usage scene.

  The usage scene may be determined according to the type of specimen to be observed. In this case, the type of specimen may be input by a user via a computer operation unit or the like, or may be specified by other methods.

  DESCRIPTION OF SYMBOLS 1, 60, 80, 120 ... Imaging device, 2 ... Microscope, 3, 4 ... Light source, 3a, 4a ... Transmission illumination optical path, 5 ... Collector lens, 6 ... Mirror, 7 ... Window lens, 8 ... Field stop, 9 ... Aperture stop, 10 ... Condenser lens, 11, 91 ... Sample, 12 ... Objective lens, 13 ... Imaging lens , 14 ... Port, 15 ... Half mirror, 20 ... Imaging device body, 21 ... Imaging device, 22 ... Imaging device drive unit, 23 ... Pre-processing unit, 24 ... A / D conversion unit, 25 ... signal processing unit, 26 ... bus, 27, 31, 71, 93 ... control unit, 28, 33, 73, 94 ... I / F unit, 30 , 70, 100, 130 ... computer, 32, 72 ... operation unit, 34, 74 ... display unit, 35, 75 Recording unit, 40, 110, 140 ... HDR processing unit, 41 ... setting acquisition unit, 42 ... imaging condition extraction unit, 43 ... DR enlargement unit, 44 ... parameter dynamic calculation unit 45 ... DR compression unit, 50 ... GUI screen, 51 ... image display area, 52 ... button, 53 ... slider, 76 ... drive unit, 77 ... recording medium, 90 ... Electric microscope, 92 ... Electric stage, 111 ... Stage drive amount detection unit, 141 ... Image comparison unit

Claims (10)

An imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions,
A setting input means for inputting a balance setting between the image quality of the composite image and the processing time required to generate the composite image;
A shooting mode determining means for determining a shooting mode consisting of a composite number of the original images to be combined and an exposure condition of the original image based on a balance setting input to the setting input means;
Imaging means for imaging the specimen under each of the exposure conditions determined by the imaging mode determination means, and generating the original number of the composite images determined by the imaging mode determination means,
The shooting mode determination means determines a shooting mode from at least a speed-oriented mode that prioritizes processing time over the image quality of the composite image and an image-quality-oriented mode that prioritizes image quality over the processing time of the composite image. An imaging apparatus characterized by the above. The imaging device according to claim 1,
In addition to the speed emphasis mode and the image quality emphasis mode, the shooting mode determination means includes at least one intermediate mode that emphasizes image quality more than the speed emphasis mode and emphasizes processing time than the image quality emphasis mode; An imaging device, wherein a shooting mode is determined from The imaging device according to claim 1 or 2, further comprising:
A recording unit for recording the original image generated by the imaging unit;
An image synthesis unit that synthesizes the number of the original images generated by the imaging unit,
The imaging unit switches the exposure condition of the shooting mode determined by the shooting mode determination unit, and continuously generates the combined number of original images,
The imaging apparatus, wherein the image synthesis unit synthesizes the recorded original image every time the original image generated by the imaging unit is recorded. An imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions,
Scene determination means for determining a use scene of the imaging device;
Based on the use scene determined by the scene determination unit, a shooting mode determination unit that determines a shooting mode composed of a composite number of the original images and an exposure condition of the original image;
Imaging means for imaging the specimen under each of the exposure conditions determined by the imaging mode determining means, and generating the composite image of the composite number determined by the imaging mode determining means;
An operation unit for operating the imaging device ,
The shooting mode determination means determines a shooting mode from at least a speed-oriented mode in which processing time is prioritized over the image quality of the composite image and an image quality-oriented mode in which image quality is prioritized over the processing time of the composite image ,
The imaging apparatus according to claim 1, wherein the scene determination unit determines a use scene based on an operation amount with respect to the operation unit. The imaging apparatus according to claim 4 ,
When the operation amount is larger than a predetermined threshold value,
The scene determination means determines that the usage scene is a speed-oriented scene in which processing time is given priority over image quality of the composite image,
The shooting mode determining means determines the shooting mode as the speed-oriented mode,
When the operation amount is less than or equal to the predetermined threshold value,
The scene determination means determines that the use scene is an image quality-oriented scene that prioritizes image quality over the processing time of the composite image,
The imaging apparatus according to claim 1, wherein the imaging mode determining means determines the imaging mode as the image quality emphasis mode. An imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions,
Scene determination means for determining a use scene of the imaging device;
Based on the use scene determined by the scene determination unit, a shooting mode determination unit that determines a shooting mode composed of a composite number of the original images and an exposure condition of the original image;
Imaging means for imaging the specimen under each of the exposure conditions determined by the imaging mode determining means, and generating the composite image of the composite number determined by the imaging mode determining means;
A display unit for displaying the composite image ,
The shooting mode determination means determines a shooting mode from at least a speed-oriented mode in which processing time is prioritized over the image quality of the composite image and an image quality-oriented mode in which image quality is prioritized over the processing time of the composite image ,
The imaging apparatus according to claim 1, wherein the scene determination unit determines a use scene based on a change amount of a drawing parameter for converting the composite image into a gradation that can be displayed on the display unit. The imaging device according to claim 6 ,
When the amount of change is greater than a predetermined threshold,
The scene determination means determines that the usage scene is a speed-oriented scene in which processing time is given priority over image quality of the composite image,
The shooting mode determining means determines the shooting mode as the speed-oriented mode,
When the amount of change is less than or equal to the predetermined threshold,
The scene determination means determines that the use scene is an image quality-oriented scene that prioritizes image quality over the processing time of the composite image,
The imaging apparatus according to claim 1, wherein the imaging mode determining means determines the imaging mode as the image quality emphasis mode. An imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions,
Scene determination means for determining a use scene of the imaging device;
Based on the use scene determined by the scene determination unit, a shooting mode determination unit that determines a shooting mode composed of a composite number of the original images and an exposure condition of the original image;
Imaging means for imaging the specimen under each of the exposure conditions determined by the imaging mode determination means, and generating the original number of the composite images determined by the imaging mode determination means,
The shooting mode determination means determines a shooting mode from at least a speed-oriented mode in which processing time is prioritized over the image quality of the composite image and an image quality-oriented mode in which image quality is prioritized over the processing time of the composite image ,
Furthermore, the imaging device includes a plurality of functions that use the composite image,
The imaging apparatus characterized in that the scene determination means determines a usage scene by a function of using the composite image being executed by the imaging apparatus. An image generation method for generating a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions,
An acquisition step of acquiring a balance setting between the image quality of the composite image and the processing time required to generate the composite image;
Based on the setting acquired in the acquisition step, a determination step of determining a shooting mode consisting of a composite number of the original image to be combined and an exposure condition of the original image;
Imaging the specimen under each of the exposure conditions determined by the determining step, and generating the original image of the composite number determined by the determining step,
The determining step determines a shooting mode from at least a speed-oriented mode that prioritizes processing time over the image quality of the composite image and an image-oriented mode that prioritizes image quality over the processing time of the composite image. An image generation method. An image generation program that operates on an imaging device that generates a composite image by combining a plurality of original images obtained by imaging a specimen under different exposure conditions,
An acquisition procedure for acquiring a setting of a balance between the image quality of the composite image and the processing time required to generate the composite image;
Based on the setting acquired in the acquisition procedure, a determination procedure for determining a shooting mode composed of the number of composites of the original images and the exposure conditions of the original images;
Causing a computer to execute a synthesis procedure for synthesizing the original images of the number of synthesized images generated by imaging the specimen under each of the exposure conditions determined by the determination procedure,
The determination procedure is a procedure for determining a shooting mode from at least a speed-oriented mode that prioritizes processing time over image quality of the composite image and an image-oriented mode that prioritizes image quality over processing time of the composite image. An image generation program characterized by that.