JP2005354166A - Image processing apparatus, image processing system, image processing method, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain easy photographing by using a function of a digital camera so as to support the determination of an exposure time having so far required experience and intuition of a photographer in long time exposure photographing. <P>SOLUTION: An image processing apparatus includes: an imaging means; a plurality of image photographing means for photographing a plurality of images by one photographing instruction of the photographer; a storage means for storing a plurality of the images; an image addition means for adding a plurality of images to obtain a new image; a midway result display means for using the image summation means to sequentially add images photographed for a plurality of times just after the respective photographing and sequentially displaying the image of the added result; a photographing termination means whereby the photographer can terminate the photographing at an arbitrary point of time among a plurality of photographing times; an image selection/addition means for arbitrarily selecting and adding some of a plurality of the images to obtain a complete image; and a storage means for storing the complete image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention stores, for example, an image processing apparatus, an image processing system, an image processing method, and processing steps for carrying out the image processing apparatus, image processing system, and processing steps used in an apparatus or system for photographing or image processing in a computer-readable manner. The present invention relates to a storage medium.

  One method for taking pictures and images is long exposure. This is a technique for performing time exposure of several seconds to several tens of seconds, and in some cases tens of minutes. Long exposure is performed when shooting night scenes. This is because the amount of light is small, so that the exposure time is increased in order to collect a sufficient amount of light to obtain an image.

  In normal shooting, the camera performs photometry as shown in Japanese Examined Patent Publication No. 2-47914 etc., and shows appropriate exposure settings (aperture value and shutter speed). However, in a dark scene where long exposure is performed, the amount of light in the photometric range of the camera is out of the range, and the exposure setting is not shown. Therefore, when performing long exposure, the photographer has to decide the exposure time based on his own experience and intuition.

  Therefore, the present invention was made to eliminate the above-described drawbacks. First, an image processing apparatus, an image processing system, an image processing method, and an image processing apparatus that can observe the exposure amount in real time during exposure, An image processing apparatus, an image processing system, an image processing method, and an image processing apparatus capable of freely adjusting an exposure amount after photographing are provided. It is another object of the present invention to provide a storage medium in which processing steps for carrying it out are stored in a computer-readable manner.

  Under such a purpose, the first invention is an image processing apparatus having an imaging function, wherein a shooting instruction means for instructing start and end of shooting, and a period from a shooting start instruction to a shooting end instruction by the shooting instruction means. An image processing apparatus comprising: an imaging unit that captures images a plurality of times to acquire an image; and a holding unit that holds an image acquired by the imaging unit.

  According to a second aspect, in the first aspect, the photographing instruction unit issues a photographing start instruction by an operator's operation, and issues a photographing end instruction by the operator's operation.

  According to a third aspect, in the first aspect, the photographing instruction means issues a photographing start instruction by an operator's operation, and issues a photographing end instruction after a lapse of a predetermined time from the photographing start instruction.

  According to a fourth aspect of the present invention, in the first, second, and third aspects, the imaging unit performs imaging when a predetermined time elapses from a shooting start instruction and further performs imaging when a shooting end instruction is issued. And

  According to a fifth aspect of the present invention, in the first, second, third, and fourth aspects of the present invention, the exposure for the entire exposure time of the image to be combined is synthesized by combining the display means for displaying the image and the image held by the holding means. When the imaging start instruction is issued, the synthesizing unit that generates an image equivalent to the image acquired by the imaging unit, and every time the imaging unit performs imaging, all the images acquired after the imaging start instruction is output are combined with the combining unit. Exposure state display means for combining and displaying by the display means.

  6th invention is an image processing apparatus which has a function which synthesize | combines a some image, Comprising: The holding means to hold | maintain the several image acquired by one imaging | photography start instruction in the apparatus which has an imaging function, The said holding means Combining means for generating an image equivalent to an image acquired by exposure for the entire exposure time of the image to be combined by combining the images held by the image, a display means for displaying the image, and an operation for accepting the operation of the operator An image processing apparatus comprising: means.

  A seventh invention is characterized in that, in the sixth invention, the operation means can input a value indicating time, and the synthesizing means synthesizes an image held by the holding means, An image equivalent to the image acquired by the time exposure input by the operation means is generated.

  An eighth invention is characterized in that, in the seventh invention, the operation means can input a time having an upper limit of the total exposure time of images held by the holding means and a lower limit of 0. .

  According to a ninth invention, in the sixth invention, there is provided time generating means for generating a plurality of values indicating time, and the synthesizing means combines the images held by the holding means so that the time generating means An image equivalent to the generated image obtained by time exposure is generated, the display means displays a list of images generated by the synthesizing means, and the operation means It is possible to perform an operation of selecting a list-displayed image.

  According to a tenth aspect, in the ninth aspect, the time generating means generates a time having an upper limit of a sum of exposure times of images held by the holding means and a lower limit of 0.

  In an eleventh aspect based on the sixth aspect, the display means displays a list of images held by the holding means, and the operation means selects one or a plurality of the displayed images. And the combining means combines the images selected by the operating means.

  A twelfth aspect of the invention is an image processing apparatus having an imaging function and an image processing function, wherein the function of the image processing apparatus according to any of the first to fifth aspects of the invention and any of the sixth to eleventh aspects of the invention are provided. An image processing apparatus having the function of the image processing apparatus described above.

  A thirteenth invention is an image processing system in which a plurality of devices are communicably connected to each other, and at least one of the plurality of devices is an image according to any one of the first to fifth inventions. An image processing system having a function of a processing device, wherein at least one other device among the plurality of devices has the function of the image processing device according to any one of the sixth to eleventh inventions.

  A fourteenth aspect of the invention is an image processing method including a processing step of imaging, and imaging is performed a plurality of times from a shooting instruction step for instructing start and end of shooting and from a shooting start instruction to a shooting end instruction in the shooting instruction step. An image processing method comprising: an imaging step for acquiring an image; and a holding step for holding the image acquired by the imaging step.

  In a fifteenth aspect based on the fourteenth aspect, the photographing instruction step includes a step of issuing a photographing start instruction by an operator's operation and issuing a photographing end instruction by the operator's operation.

  According to a sixteenth aspect, in the fourteenth aspect, the photographing instruction step includes a step of issuing a photographing start instruction by an operation of an operator and issuing a photographing end instruction after a predetermined time has elapsed from the photographing start instruction. To do.

  According to a seventeenth aspect, in the fourteenth, fifteenth, and sixteenth aspects, the imaging step includes a step of performing imaging when a fixed time elapses from an imaging start instruction and further performing imaging when an imaging end instruction is issued. It is characterized by that.

  According to an eighteenth aspect of the present invention, in the fourteenth, fifteenth, sixteenth and seventeenth aspects of the present invention, by combining the display step for displaying an image and the image held by the holding step, the exposure for the entire exposure time of the image to be combined is performed. A compositing step for generating an image equivalent to the image acquired by the step, and when the imaging start instruction is issued, every time imaging is performed by the imaging step, all the images acquired after the imaging start instruction is output are combined in the combining step. And an exposure state display step of displaying by the display step.

  A nineteenth aspect of the invention is an image processing apparatus having a function of combining a plurality of images, a holding step for holding a plurality of images acquired by one shooting start instruction in a method including an imaging step, and the holding step By combining the images held in the image, a combining step for generating an image equivalent to the image acquired by exposure for the entire exposure time of the image to be combined, a display step for displaying the image, and an operation for accepting the operation of the operator An image processing method comprising steps.

  In a twentieth aspect based on the nineteenth aspect, the operation step includes a step in which a value indicating time can be input, and the combining step combines the images held in the holding step. Thus, the method includes a step of generating an image equivalent to the image acquired by the time exposure input in the operation step.

  In a twenty-first aspect based on the twentieth aspect, the operation step includes a step of inputting a time having an upper limit of the total exposure time of images held by the holding step and a lower limit of 0. Features.

  According to a twenty-second aspect, in the nineteenth aspect, the method includes a time generation step of generating a plurality of values indicating time, and the combining step includes combining the images held in the holding step, Characterized in that it includes a step of generating an image equivalent to an image acquired by exposure for a generated time, wherein the display step includes a step of displaying a list of images generated by the synthesis step, The operation step includes a step of selecting an image displayed in the list.

  In a twenty-third aspect based on the twenty-second aspect, the time generating step includes a step of generating a time having an upper limit of the total exposure time of images held by the holding step and a lower limit of 0. And

  In a twenty-fourth aspect based on the nineteenth aspect, the display step includes a step of displaying a list of images held by the holding step. And a step of selecting a plurality of images, and the combining step includes a step of combining the images selected in the operation step.

  A twenty-fifth aspect of the invention is an image processing method including a processing step for imaging and a processing step for image processing. The processing step of the image processing method according to any one of claims 14 to 18, and the processing steps according to claims 19 to 24 An image processing method comprising the processing steps of any one of the image processing methods.

  A twenty-sixth aspect of the invention is a storage medium in which a computer stores a processing program for implementing the functions of the image processing apparatus according to any of the first to twelfth aspects of the invention.

  A twenty-seventh aspect of the invention is a storage medium in which a computer stores a processing program for executing the functions of the image processing system according to the thirteenth aspect of the invention.

  A twenty-eighth aspect of the invention is a storage medium in which the processing steps of the image processing method according to any one of the fourteenth to twenty-fifth aspects are stored in a computer-readable manner.

  As described above, according to the present invention, it is possible to observe in real time how light is taken into a solid-state image pickup device during exposure and the image emerges during exposure by exposure for several seconds or more, and the exposure is terminated. The photographer can easily determine the time point. Furthermore, after photographing, it is possible to obtain an image obtained by freely selecting and synthesizing a plurality of images generated by dividing during exposure, and the exposure amount, that is, the brightness of the image can be freely adjusted. Therefore, even in a dark scene where an imaging apparatus such as a digital camera cannot automatically calculate the exposure setting, it is possible to easily determine the exposure time that relies on experience and intuition.

  For example, when shooting a night scene, after the shutter of the imaging apparatus is opened, the shutter may be closed when the brightness is appropriate while viewing the image indicating the exposure state. If necessary, the exposure amount (brightness of the image) can be adjusted after shooting. At the time of adjustment, the amount of exposure cannot be made larger than the total amount of exposure at the time of shooting (it can only reduce the amount of exposure). However, there is no problem if the exposure is performed in advance at the time of shooting and adjustment is performed after shooting.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, the term “composite” used in this document will be explained.

  As shown in FIG. 6, for example, when exposure is performed for 10 seconds, the following two images are the same except for errors.

  1. An image generated by reading data from a solid-state image sensor 10 seconds after the start of exposure.

  2. Data obtained by reading out data from the solid-state imaging device every 2 seconds after the start of exposure to generate a total of 5 images, and combining these 5 images.

  Thus, the image processing operation for generating the same image as the batch exposure (above 1.) from a plurality of images subjected to the divided exposure (above 2.) is referred to as synthesis in this document.

  The specific method of combining differs depending on the data format of the image, and the values of the corresponding pixels may be simply added, or more complicated calculations may be required. However, in the present invention, the image data format and composition method are not limited.

(First embodiment)
The present invention is applied to, for example, an image processing apparatus 100 as shown in FIG.

  The image processing apparatus 100 is configured such that means, methods, functions, etc. for implementing the present invention can be activated.

  Specifically, first, as shown in FIG. 1, the image processing apparatus 100 includes a CPU 101, a ROM 102, a RAM 103, a clock 115, a solid-state imaging device 117 and its control unit 116, a lens 119 and its control. Unit 118, operation unit 106 and its control unit 105, display unit 108 and its control unit 107, memory card 110 and its control unit 109, power supply unit 114 and its control unit 113, and other image processing devices Are connected to each other via the system bus 104 so that they can communicate with each other.

  The CPU 101 comprehensively controls each component connected to the system bus 104 by executing software stored in the ROM 102 or software supplied from the memory card 110. By executing the software in this way, the CPU 101 performs control for realizing the most characteristic operation in the present embodiment.

  The ROM 102 stores a boot program, software, data, and the like for the CPU 101 to read.

  The RAM 103 functions as a main memory or work area for the CPU 101.

  The clock 115 records the passage of time.

  The solid-state image sensor 117 converts light incident through the lens 119 into an image. The control unit 116 controls the solid-state image sensor 117.

  The lens 119 stores light from the subject on the solid-state image sensor 117. The control unit 118 controls zooming and focusing of the lens 119.

  The shutter 121 controls exposure by passing or blocking light incident on the solid-state image sensor 117. The control unit 120 controls opening and closing of the shutter 121. However, the shutter 121 and the control unit 120 may be an electronic shutter that is realized as a function of the solid-state imaging device 117 instead of a mechanical shutter.

  The operation unit 106 includes input devices such as buttons and levers, and performs operations for shooting and various settings. The control unit 105 controls instruction input from the operation unit 106.

  The display unit 108 includes a display device such as an LCD. The control unit 107 controls display on the display unit 108.

  The memory card 110 is a detachable card made of a nonvolatile semiconductor memory. However, it may be fixed. Further, other types of storage media such as a magnetic disk, an optical disk, and a magneto-optical disk may be used. The control unit 109 controls access to the memory card 110.

  The power supply unit 114 supplies power to each unit of the image processing apparatus 100. The power supply unit 114 may be a built-in battery or a power supply supplied from the outside. The control unit 113 controls the power supply unit 114 to switch on / off the power supply to each unit of the image processing apparatus 100.

  The interface unit 112 exchanges data with other devices and exchanges various control commands. The communication between the interface unit 112 and the other device may be performed by connection using a cable or optical fiber, by wireless or infrared, or via a network such as a LAN or the Internet.

  Examples of data, variables, constants, etc. used in the image processing apparatus 100 are shown in FIG.

  As will be described later, in this embodiment, data is read from the solid-state imaging device 117 at regular intervals during exposure. This interval is an image generation interval 401.

  Thereby, the image generation timer 402 detects that the time of the image generation interval 401 has elapsed. When this timer is reset, measurement of the passage of time from 0 starts again.

  The exposure progress image 403 is a composite of a plurality of images generated by division during exposure, and this image is displayed on the display unit 108 during exposure.

  The preview image 404 displays a result corresponding to the designated exposure time when adjusting the exposure time after shooting.

  2 and 3 show an example of the flow of processing in the present embodiment. 2 shows processing at the time of shooting, and FIG. 3 shows processing at the time of exposure adjustment after shooting. In the image processing apparatus 100, the CPU 101 is stored in the ROM 102 or supplied from the memory card 110. The software according to the flowcharts of FIGS. As a result, the image processing apparatus 100 performs processing as follows.

  First, processing at the time of shooting in FIG. 2 will be described.

  Step S201: If there is an exposure start instruction from the photographer, the process proceeds to step S202. If not, the process returns to step S201 again. An instruction to start exposure is given by an operation on the operation unit 106 or a remote operation from an external device through the interface unit 112.

  Step S202: The image generation timer 402 is reset. As a result, the image generation timer 402 starts measuring the elapsed time from zero.

  Step S203: Open the shutter 121 and start exposure.

  Step S204: If there is an exposure end instruction, the process proceeds to step S210. If not, the process proceeds to step S205. The exposure end instruction is given by an operation on the operation unit 106 or a remote operation from an external device through the interface unit 112. Alternatively, a method may be used in which a timer is started when exposure is started in step S203, and it is detected by the timer that the total exposure time set before exposure or during exposure has elapsed, and an exposure end instruction is issued.

  Step S205: If the image generation timer 402 indicates that the image generation interval 401 has elapsed, the process proceeds to step S206. Otherwise, the process returns to step S204.

  Step S206: Data is read from the solid-state image sensor 117, and an image is generated. Then, the image is recorded on the memory card 110.

  Step S207: The image generation timer 402 is reset.

  Step S208: One or a plurality of images generated so far in Step S206 are synthesized to generate an exposure progress image 403.

  Each time this step is executed, the combining method is a method of combining all the images that have been generated in step S206 so far, and is generated on the previously generated exposure progress image 403 by executing step S206. A method may be used in which a single image is synthesized. In either of these methods, the obtained exposure progress image 403 is the same. However, in the latter case, in the first execution of this step, the exposure progress image 403 is reset (= a black image with an exposure amount of 0) or the image generated in step S206 is used as it is. It is necessary to process.

  Step S209: The exposure progress image 403 is displayed on the display unit.

  Step S210: The shutter 121 is closed and the exposure is finished.

  Step S211: Data is read from the solid-state image sensor 117, and an image is generated. Then, the image is recorded on the memory card 110. The processing in this step is the same as that in step S206.

  Next, processing during exposure adjustment will be described.

  In the following example, it is assumed that shooting was performed with a total exposure time of 8 seconds, and at that time, the image generation interval 401 = 2 seconds, so that four images subjected to exposure for 2 seconds were generated.

  A display example on the display unit 108 during exposure adjustment is shown in FIG.

  The preview area 501 displays an image corresponding to the exposure time designated by the exposure time adjustment knob 502. The exposure time adjustment knob 502 is used by the photographer to operate the operation unit 106 to designate the exposure time. FIG. 3 shows a state in which an exposure time of 2 seconds is designated in the shooting with a total exposure of 8 seconds. The decision button 503 is pressed by operating the operation unit 106 after the photographer finally decides the exposure time. Then, an actual image for storage is synthesized and recorded.

  The processing flow of FIG. 3 is as follows.

  Step S301: Set the exposure time adjustment knob 502 to the initial position.

  Step S302: A preview image 404 corresponding to the current position of the exposure time adjustment knob 502 is generated.

  Step S303: The preview image 404 is displayed in the preview area 501.

  Step S304: If the exposure time adjustment knob 502 is operated, the process returns to step S302. Otherwise, the process proceeds to step S305.

  Step S305: If the determination button 503 is pressed, the process proceeds to step S306. Otherwise, the process returns to step S304.

  Step S306: An image corresponding to the position of the exposure time adjustment knob 502 is generated. Although the image generated in step S302 may be a preview image and may be small in size, in this step, an image having the final image quality is generated. Then, the image is recorded on the memory card 110.

  By the way, the generation of the preview image 404 in step S302 generates an image corresponding to each position of the exposure time adjustment knob 502 in advance even if it is generated from each captured image every time this step is executed. Alternatively, the image may be read and set as the preview image 404. In the former case, the image once generated may be recorded, and the next recorded image may be read and set as the preview image 404 when the next preview image 404 having the same exposure time is required. By doing so, the time required for processing can be shortened.

  The generation of the image 404 in step S302 and step S306 may be performed by reducing the brightness for each pixel from the image that has been exposed for the entire exposure time (8 seconds in this embodiment). For example, if the brightness of each pixel of an image exposed for 8 seconds is halved, it is equivalent to an image exposed for 4 seconds. In addition, for example, an exposure time that is not affected by the image generation interval 401 can be set such that the brightness of each pixel is reduced to 1/10 to obtain an image equivalent to 0.8 second exposure. This method has the effect of reducing image noise, but it may be difficult to use this method unless the subject is stationary.

  The processing at the time of exposure adjustment shown in FIG. 3 may be performed by the above-mentioned other apparatus by moving the image recorded by the processing at the time of photographing shown in FIG. 2 to another apparatus. For example, the processing of FIG. 2 may be performed by an imaging device such as a digital camera, and the recorded image may be transferred to an information processing device such as a personal computer or an image processing device to perform the processing shown in FIG.

  By executing the processing in steps S201 to S211 and steps S301 to S306 as described above, it becomes possible to observe in real time how light is taken into the solid-state image pickup device during exposure and the image emerges, and the exposure is terminated. The photographer can easily determine the time point. Furthermore, it becomes possible to freely adjust the exposure amount, that is, the brightness of the image after photographing. Therefore, it is possible to easily determine and adjust the exposure time even in the long-time exposure in which it is difficult to determine the exposure time.

  For example, during imaging with the imaging apparatus 100, an image reflecting the exposure amount at each time point is displayed on the display unit 108 at a time interval of the image generation interval 401, and the photographer sees it and stops the exposure. Can be judged. Further, after shooting, the exposure amount can be freely adjusted by operating the exposure time adjustment knob 502 while looking at the preview area 501.

(Second Embodiment)
The present invention is applied to, for example, an image processing apparatus 100 as shown in FIG. The explanation for FIG. 1 is the same as that of the first embodiment.

  Examples of data, variables, constants, etc. used in the image processing apparatus 100 are shown in FIG. The descriptions of the image generation interval 401, the image generation timer 402, and the exposure progress image 403 are the same as those in the first embodiment.

  2 and 7 show an example of the processing flow in the present embodiment. 2 shows processing at the time of shooting, and FIG. 7 shows processing at the time of exposure adjustment after shooting. In the image processing apparatus 100, the CPU 101 executes software according to the flowcharts of FIGS. 2 and 7 stored in the ROM 102 or supplied from the memory card 110. As a result, the image processing apparatus 100 performs processing as follows.

  The explanation for FIG. 2 is the same as that of the first embodiment.

  Next, processing during exposure adjustment will be described.

  In the following example, it is assumed that shooting was performed with a total exposure time of 8 seconds, and at that time, the image generation interval 401 = 2 seconds, so that four images subjected to exposure for 2 seconds were generated.

  A display example on the display unit 108 during exposure adjustment is shown in FIG.

  A sample image 801 is an image corresponding to an exposure amount of zero. That is, it is a black image.

  A sample image 802 is obtained by reducing and displaying the image taken in the process shown in FIG. That is, it corresponds to an image exposed for 0 to 2 seconds after the start of photographing.

  The sample image 803 is obtained by combining the image captured in the process shown in FIG. 2 with the image of 0 to 2 seconds and the image of 2 to 4 seconds after the start of image capturing and displaying the reduced image. That is, it corresponds to an image exposed for 0 to 4 seconds after the start of photographing.

  The sample image 804 is composed of the image captured in the process shown in FIG. 2 and is composed of the image of 0 to 2 seconds, the image of 2 to 4 seconds, and the image of 4 to 6 seconds after the start of the image, and is reduced and displayed. is there. That is, it corresponds to an image exposed for 0 to 6 seconds after the start of photographing.

  The sample image 804 is composed of images taken in the processing shown in FIG. 2 from 0 to 2 seconds, 2 to 4 seconds, 4 to 6 seconds, and 6 to 8 seconds after the start of photographing. And reduced in size. That is, it corresponds to an image exposed for 0 to 8 seconds after the start of photographing.

  The selection indicator 806 moves this by an operation from the operation unit 106, and selects an appropriate exposure state from the sample images 801 to 805.

  The decision button 807 is used to select an image by the operation from the operation unit 106 after selecting an image by the selection indicator 806.

  The processing flow of FIG. 7 is as follows.

  Step S701: The images photographed in the process of FIG. 2 are combined to generate one sample image corresponding to the sample images 801 to 805 in the example of FIG.

  Step S702: The image generated in step S701 is displayed on the display unit.

  Step S703: When there is a sample image that has not been displayed yet (in the example of FIG. 8, when all the sample images 801 to 805 have not been displayed), the process returns to step S701. If all the sample images have been displayed, the process proceeds to step S704.

  Step S704: An operation for the selection indicator 806 in the operation unit 106 is accepted. The photographer moves the selection indicator 806 to select a sample image in an appropriate exposure state.

  Step S705: If the enter button 807 is pressed, the process proceeds to step S706. Otherwise, the process returns to step S704.

  Step S706: An image corresponding to the instruction from the selection indicator 806 is generated. The sample image generated in step S701 may be a sample image and may be small in size, but in this step, an image having the final image quality is generated. Then, the image is recorded on the memory card 110.

  Further, the image generation in step S701 and step S706 may be performed by reducing the brightness for each pixel from the image exposed for the entire exposure time (8 seconds in the present embodiment). For example, if the brightness of each pixel of an image exposed for 8 seconds is halved, it is equivalent to an image exposed for 4 seconds. Further, for example, since the brightness of each pixel is set to 1/10 and an image equivalent to 0.8 second exposure is obtained, it is possible to set an exposure time independent of the image generation interval 401. This method has the effect of reducing image noise, but it may be difficult to use this method unless the subject is stationary.

  The process at the time of exposure adjustment shown in FIG. 7 may be performed by the above-mentioned other apparatus by transferring the image recorded by the process at the time of photographing shown in FIG. 2 to another apparatus. For example, the processing of FIG. 2 may be performed by an imaging device such as a digital camera, and the recorded image may be transferred to an information processing device such as a personal computer or an image processing device to perform the processing shown in FIG.

  By executing the processing in steps S201 to S211 and steps S701 to S706 as described above, it becomes possible to observe in real time how light is taken into the solid-state imaging device during exposure and the image emerges. The photographer can easily determine the point in time when the camera is closed. Furthermore, it becomes possible to freely adjust the exposure amount, that is, the brightness of the image after photographing. Therefore, it is possible to easily determine and adjust the exposure time even in the long-time exposure in which it is difficult to determine the exposure time.

For example, during imaging with the imaging apparatus 100, an image reflecting the exposure amount at each time point is displayed on the display unit 108 at a time interval of the image generation interval 401, and the photographer sees it and stops the exposure. Can be judged. Further, after photographing, an image with an appropriate exposure amount can be selected by operating the selection indicator 806 while viewing sample images 801 to 805 showing images with various exposure amounts.
(Third embodiment)
The present invention is applied to, for example, an image processing apparatus 100 as shown in FIG. The description for FIG. 1 is the same as that of the first embodiment.

  Examples of data, variables, constants, etc. used in the image processing apparatus 100 are shown in FIG. The descriptions of the image generation interval 401, the image generation timer 402, and the exposure progress image 403 are the same as those in the first embodiment.

  In the selected image list 405, an image selected as a compositing target from each image generated at the time of shooting is registered at the time of exposure adjustment after shooting. In the initial state, no image is registered.

  The preview image 406 is a preview image obtained by synthesizing images registered in the selected image list 405.

  2 and 12 show an example of the flow of processing in the present embodiment. FIG. 2 shows processing at the time of shooting, and FIG. 12 shows processing at the time of exposure adjustment after shooting. In the image processing apparatus 100, the CPU 101 executes software according to the flowcharts of FIGS. 2 and 7 stored in the ROM 102 or supplied from the memory card 110. As a result, the image processing apparatus 100 performs processing as follows.

  The explanation for FIG. 2 is the same as that of the first embodiment.

  Next, processing at the time of adjusting the exposure time will be described.

  In the following example, it is assumed that an image having a total exposure time of 8 seconds is taken, and the image generation interval 401 = 2 seconds at that time, so that four images subjected to exposure for 2 seconds are generated.

  An example of display on the display unit 108 during exposure adjustment is shown in FIG.

  The sample image 1102 is a reduced display of an image captured by exposure for 0 to 2 seconds after the start of capturing from the image captured in the process shown in FIG.

  The sample image 1103 is obtained by reducing and displaying an image photographed by exposure for 2 to 4 seconds from the image photographed in the processing shown in FIG.

  A sample image 1104 is a reduced display of an image that has been exposed for 4 to 6 seconds from the start of shooting from the image that was shot in the process shown in FIG.

  The sample image 1105 is obtained by reducing and displaying an image that has been shot for 6 to 8 seconds from the start of shooting from the image that was shot in the process shown in FIG.

  The selection indicator 1106 is moved by an operation from the operation unit 106, and is used to select some of the sample images 1102 to 1105 and attach or remove the selection marker 1107.

  In the example of FIG. 11, the selection marker 1107 is a frame attached to the sample images 1102, 1104, and 1105. Are combined into a resulting image.

  A preview area 1108 is a portion for simply displaying an image obtained by synthesizing an image with the selection marker 1107 and is used as a guide for exposure adjustment.

  The decision button 1109 presses the selection marker 1107 by the operation from the operation unit 106 after the selection indicator 1106 has been attached, and decides the selection.

  The processing flow of FIG. 12 is as follows.

  Step S1201: One image taken by the processing of FIG. 2 is reduced and displayed as a sample image.

  Step S1202: When there is a sample image that has not been displayed yet (in the example of FIG. 11, when all the sample images 1102 to 1105 have not been displayed), the process returns to step S1201. If all sample images have been displayed, the process advances to step S1203.

  Step S1203: The images registered in the selected image list 405 are combined and stored in the preview image 406. When no image is registered in the selected image list 405, the preview image 404 is a black image.

  Step S1204: The preview image 406 is displayed in the preview area 1108.

  Step S1205: An operation for the selection indicator 1106 in the operation unit 106 is accepted. The photographer moves the selection indicator 1106 to specify the sample images 1102 to 1105.

  Step S1206: If a sample image is designated in step S1205, the process proceeds to step S1207. Otherwise, the process proceeds to step S1210.

  Step S1207: If the designated sample image is already registered in the selected image list 405, the process proceeds to step S1209. Otherwise, the process proceeds to step S1208.

  Step S1208: The designated sample image is registered in the selected image list 405.

  Step S1209: Deregister the designated sample image from the selected image list 405. That is, it is possible to cancel the registration by designating the sample image once designated and registered.

  Step S1212: The display of the selection marker 1107 is updated to reflect the change in step S1208 or S1209.

  Step S1210: If the enter button 1109 is pressed, the process proceeds to step S1211. Otherwise, the process returns to step S1205.

  Step S1211: The images registered in the selected image list 405 are synthesized. The image generated in step S1203 is a preview image and may have a small size, but in this step, an image having the final image quality is generated. Then, the image is recorded on the memory card 110.

  The processing at the time of exposure adjustment shown in FIG. 12 may be performed by the above-mentioned other device by transferring the image recorded by the processing at the time of photographing shown in FIG. 2 to another device. For example, the process shown in FIG. 2 may be performed by an imaging apparatus such as a digital camera, and the recorded image may be transferred to an information processing apparatus such as a personal computer or an image processing apparatus.

  By executing the processes in steps S201 to S211 and steps S1201 to S1212 as described above, it becomes possible to observe in real time how light is taken into the solid-state image pickup device during exposure and the image emerges, and the exposure is terminated. The photographer can easily determine the time point. Furthermore, after shooting, it is possible to obtain a composite image by freely selecting and synthesizing a plurality of images generated by dividing during exposure, and it is possible to freely adjust the exposure amount, that is, the brightness of the image, It becomes possible to exclude inappropriate images. An inappropriate image during exposure is an image that you want to exclude only the exposure at that time, for example, when you are shooting a night view, a car passes by and the area is brightly illuminated. .

  Therefore, it is possible to easily determine and adjust the exposure time even in long-time exposure where it was difficult to determine the exposure time, and to exclude any inappropriate light or object appearing during the exposure. it can.

  For example, during imaging with the imaging apparatus 100, an image reflecting the exposure amount at each time point is displayed on the display unit 108 at a time interval of the image generation interval 401, and the photographer stops viewing after viewing the image. Can be judged. In addition, after shooting, the selection indicator 1106 is operated while viewing the sample images 1102 to 1105 showing each of the divided images, and an image with an appropriate exposure amount is obtained by freely selecting and combining the images. be able to.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the host and terminal according to the first to third embodiments to a system or apparatus, and a computer of the system or apparatus. Needless to say, this can also be achieved by (or CPU) reading and executing the program code stored in the storage medium.

  In this case, the program code itself read from the storage medium realizes the functions of the first to third embodiments, and the storage medium storing the program code constitutes the present invention.

  Various storage media for supplying the program code include magnetic disks such as floppy (registered trademark), optical disks such as CD and DVD, magneto-optical disks such as MO, and non-volatile semiconductor memories such as PC cards. Can be used.

  Further, by executing the program code read by the computer, not only the functions of the first to third embodiments are realized, but also an OS running on the computer based on the instruction of the program code. Needless to say, the present invention includes a case where the functions of the first to third embodiments are realized by performing part or all of the actual processing.

  Further, after the program code read from the storage medium is written to the memory provided in the extension function board inserted in the computer or the function extension unit connected to the computer, the function extension is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or function expansion unit performs part or all of the actual processing, and the functions of the first to third embodiments are realized by the processing.

In 1st-3rd Embodiment, it is a block diagram which shows the structure of the image processing apparatus to which this invention is applied. It is a flowchart for demonstrating operation | movement of the said image processing apparatus in 1st-3rd embodiment. It is a flowchart for demonstrating operation | movement of the said image processing apparatus in 1st Embodiment. It is a figure which shows the data, variable, constant, etc. which are used with the said image processing apparatus in 1st Embodiment. It is a figure which shows the example of a display of the said image processing apparatus in 1st Embodiment. It is a figure explaining the image composition in the 1st-3rd embodiment. It is a flowchart for demonstrating operation | movement of the said image processing apparatus in 2nd Embodiment. It is a figure which shows the example of a display of the said image processing apparatus in 2nd Embodiment. It is a figure which shows the data, variable, constant, etc. which are used with the said image processing apparatus in 2nd Embodiment. It is a figure which shows the data, variable, constant, etc. which are used with the said image processing apparatus in 3rd Embodiment. It is a figure which shows the example of a display of the said image processing apparatus in 3rd Embodiment. It is a flowchart for demonstrating operation | movement of the said image processing apparatus in 2nd Embodiment.

Explanation of symbols

100 Image processing apparatus 101 CPU
102 ROM
103 RAM
DESCRIPTION OF SYMBOLS 104 System bus 105 Control part 106 Operation part 107 Control part 108 Display part 109 Control part 110 Memory card 113 Control part 114 Power supply part 115 Clock 116 Control part 117 Solid-state image sensor 118 Control part 119 Lens 120 Control part 121 Shutter 200 Image processing apparatus 201 CPU
202 ROM
203 RAM
204 system bus 205 control unit 206 operation unit 207 control unit 208 display unit 209 control unit 210 fixed disk 211 removable disk 212 interface unit 401 image generation interval 402 image generation timer 403 exposure progress image 404 preview image 405 selection image list 406 preview image 501 Preview area 502 Exposure time adjustment knob 503 Determination button 801 Sample image 802 Sample image 803 Sample image 804 Sample image 805 Sample image 806 Selection indicator 807 Determination button 1102 Sample image 1103 Sample image 1104 Sample image 1105 Sample image 1106 Selection indicator 1107 Selection Marker 1108 Preview area 1109 Enter button

Claims (28)

  An image processing apparatus having an imaging function, an imaging instruction means for instructing start and end of imaging, and an imaging means for acquiring an image by imaging a plurality of times from an imaging start instruction to an imaging end instruction by the imaging instruction means, An image processing apparatus comprising: holding means for holding an image acquired by the imaging means.   2. The image processing apparatus according to claim 1, wherein the photographing instruction means issues a photographing start instruction by an operator's operation and issues a photographing end instruction by the operator's operation.   The image processing apparatus according to claim 1, wherein the photographing instruction means issues a photographing start instruction by an operation of an operator, and issues a photographing end instruction after a predetermined time has elapsed from the photographing start instruction.   4. An image processing apparatus according to claim 1, wherein said image pickup means picks up images every time a fixed time elapses from a shooting start instruction, and further picks up images when a shooting end instruction is issued.   A display means for displaying an image; a combining means for generating an image equivalent to an image obtained by exposure for an entire exposure time of an image to be combined by combining the images held by the holding means; and the shooting start instruction When the image is taken out by the image pickup means, an exposure state display means for combining all the images acquired after the shooting start instruction is given and displaying the image by the display means is provided. The image processing apparatus according to claim 1, 2, 3, 4.   An image processing apparatus having a function of combining a plurality of images, the holding means for holding a plurality of images acquired by one shooting start instruction in the apparatus having an imaging function, and the image held by the holding means And a combining unit that generates an image equivalent to an image acquired by exposure for an entire exposure time of the image to be combined, a display unit that displays the image, and an operation unit that receives an operation of the operator. An image processing apparatus.   The operation means is capable of inputting a value indicating time, and the synthesizing means obtains the time exposure input by the operation means by synthesizing the images held by the holding means. The image processing apparatus according to claim 6, wherein an image equivalent to the image is generated.   8. The image processing apparatus according to claim 7, wherein the operation means is capable of inputting a time having an upper limit of the total exposure time of images held by the holding means and a lower limit of 0.   A time generation unit configured to generate a plurality of values indicating time; and the synthesis unit combines the images held by the holding unit to obtain an image equivalent to the image obtained by the time exposure generated by the time generation unit. An image is generated, wherein the display means displays a list of images generated by the combining means, and the operation means can perform an operation of selecting the list-displayed image. The image processing apparatus according to claim 6.   The image processing apparatus according to claim 9, wherein the time generation unit generates a time having an upper limit of a sum of exposure times of images held by the holding unit and a lower limit of 0.   The display means displays a list of images held by the holding means, and the operation means is capable of selecting a single image or a plurality of images displayed in the list, and 7. The image processing apparatus according to claim 6, wherein the means combines the images selected by the operation means.   An image processing apparatus having an imaging function and an image processing function, wherein the function of the image processing apparatus according to any one of claims 1 to 5 and the function of the image processing apparatus according to any one of claims 6 to 11 are provided. An image processing apparatus comprising:   An image processing system in which a plurality of devices are communicably connected to each other, and at least one of the plurality of devices has the function of the image processing apparatus according to claim 1. An image processing system, wherein at least one other device among the plurality of devices has the function of the image processing apparatus according to any one of claims 6 to 11.   An image processing method including a processing step of imaging, an imaging instruction step for instructing the start and end of imaging, and an imaging step for acquiring images by imaging a plurality of times from an imaging start instruction to an imaging end instruction in the imaging instruction step And a holding step for holding the image acquired by the imaging step.   15. The image processing method according to claim 14, wherein the photographing instruction step includes a step of issuing a photographing start instruction by an operator's operation and issuing a photographing end instruction by an operator's operation.   15. The image processing method according to claim 14, wherein the photographing instruction step includes a step of issuing a photographing start instruction by an operation of an operator and issuing a photographing end instruction after a predetermined time has elapsed from the photographing start instruction.   17. The image processing method according to claim 14, 15 or 16, wherein the imaging step includes a step of performing imaging at every elapse of a predetermined time from an imaging start instruction and further performing imaging when an imaging end instruction is issued. .   A display step for displaying an image; a combining step for generating an image equivalent to an image acquired by exposure for an entire exposure time of the image to be combined by combining the images held by the holding step; and the shooting start instruction And an exposure state display step of combining all the images acquired after the shooting start instruction is issued and displaying the display step by the display step every time imaging is performed by the imaging step. The image processing method according to claim 14, 15, 16, or 17.   An image processing apparatus having a function of combining a plurality of images, a holding step for holding a plurality of images acquired by one shooting start instruction in a method including an imaging step, and a combination of images held by the holding step A composition step for generating an image equivalent to an image acquired by exposure for the entire exposure time of the image to be composed, a display step for displaying the image, and an operation step for accepting the operation of the operator. An image processing method.   The operation step includes a step capable of inputting a value indicating time, and the composition step performs the time exposure input by the operation step by compositing images held by the retention step. The image processing method according to claim 19, further comprising a step of generating an image equivalent to the image acquired in this way.   21. The image processing method according to claim 20, wherein the operation step includes a step of inputting a time having an upper limit of the total exposure time of images held by the holding step and a lower limit of 0.   A time generation step for generating a plurality of values indicating time, wherein the combining step is equivalent to an image obtained by time exposure generated by the time generation step by combining the images held by the holding step; A step of generating an image, wherein the display step includes a step of displaying a list of images generated by the combining step, and the operation step selects the image displayed in the list. The image processing method according to claim 19, further comprising a step capable of performing an operation.   23. The image processing method according to claim 22, wherein the time generation step includes a step of generating a time having an upper limit of a sum of exposure times of images held by the holding step and a lower limit of 0.   The display step includes a step of displaying a list of images held by the holding step, and the operation step includes a step capable of selecting a single image and a plurality of images displayed on the list. 20. The image processing method according to claim 19, wherein the synthesizing step includes a step of synthesizing the images selected in the operation step.   An image processing method including a processing step for imaging and a processing step for image processing, the processing step of the image processing method according to any one of claims 14 to 18 and the image according to any one of claims 19 to 24. An image processing method comprising processing steps of a processing method.   A storage medium in which a processing program for executing the function of the image processing apparatus according to claim 1 is stored in a computer-readable manner.   14. A storage medium storing a computer-readable processing program for implementing the functions of the image processing system according to claim 13.   A storage medium in which the processing steps of the image processing method according to any one of claims 14 to 25 are stored so as to be readable by a computer.

Images