JP2019213171A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

To start a next continuous photographing at a desired timing.SOLUTION: An image processing apparatus comprises: first recording means for recording a plurality of images obtained by continuous photographing by imaging means, in temporary storage means; second recording means for recording the images recorded in the temporary storage means, on a recording medium; and display control means for controlling display means to display image not completely recorded yet on the recording medium, together with a live image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  The digital camera accumulates photographed images in a memory such as a DRAM and sequentially performs development processing and recording processing on the accumulated images, thereby realizing continuous shooting operation. In recent digital cameras, there are cases where the number of pixels increases and the continuous shooting speed increases, and development processing and recording processing are continued for a while after the shooting is completed. In continuous shooting, the next continuous shooting cannot be started until the memory used for storing the shot images is empty. For this reason, the waiting time until the memory becomes empty becomes long, and the chance of the next continuous shooting may be missed. In order to deal with such a problem, Patent Document 1 adds a function for canceling all or a part of the captured images obtained by the last continuous shooting, thereby ensuring a free space in the memory. A technique for preparing for continuous shooting is disclosed.

JP 2003-274323 A

  When unnecessary images are present in a plurality of captured images obtained by continuous shooting, it is desirable not to record unnecessary images on a recording medium. However, in the prior art, it is not known how much the recording of the captured image obtained by continuous continuous shooting has been completed on the recording medium, and the recording could not be terminated at an appropriate timing. For this reason, there is a problem that the next continuous shooting cannot be started at a desired timing.

  The present invention has been made in view of such problems, and an object thereof is to start the next continuous shooting at a desired timing.

  Therefore, the present invention is an image processing apparatus, wherein a first recording unit that records a plurality of images obtained by continuous shooting by an imaging unit in a temporary storage unit, and a plurality of recording units recorded in the temporary storage unit Second recording means for sequentially recording images on a recording medium, and display control means for controlling to display on the display means, together with live images, images that have not been recorded on the recording medium. Features.

  According to the present invention, the next continuous shooting can be started at a desired timing.

It is a hardware block diagram of an imaging device. It is a flowchart which shows a continuous shooting process. It is a figure which shows the example of a display. It is a figure which shows the example of a display. It is a figure which shows the example of a display. It is a hardware block diagram of the imaging device which concerns on 2nd Embodiment. It is a flowchart which shows a continuous shooting process.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a hardware configuration diagram of the imaging apparatus 100. The imaging device 100 is an example of an image processing device. The imaging apparatus 100 includes a CPU 101, a memory 102, a display unit 103, an input unit 104, an imaging unit 105, a recording development unit 111, a display development unit 112, a live display development unit 113, and a recording. Part 106 and a recording medium 107. The CPU 101 reads the control program stored in the memory 102 and executes various processes. The memory 102 is used as a temporary storage area such as a main memory and a work area of the CPU 101. The memory 102 is a temporary storage device, and is a volatile memory such as a DRAM. Note that the functions and processing of the imaging apparatus 100 described later are realized by the CPU 101 reading out a program stored in the memory 102 and executing the program. The display unit 103 displays various information. The input unit 104 receives various operations by the user. The imaging unit 105 captures an image.

  The recording developing unit 111 performs a recording development process for obtaining a recording image (recording image). The display developing unit 112 performs display development processing for obtaining a display image (display image) before recording is completed. Here, the display development process is a process with a smaller calculation amount than the recording development process. In the live display development process, a live display development process for obtaining an image for live display is performed. The recording unit 106 records a recording image, which is a development result obtained by the recording development process, on the recording medium 107. The recording medium 107 is a non-volatile memory such as an SD card, for example. Each block in FIG. 1 is realized by a dedicated circuit or a general-purpose processor. One circuit or a processor may realize the functions of a plurality of blocks.

  FIG. 2 is a flowchart showing continuous shooting processing by the imaging apparatus 100. The continuous shooting process is executed when the CPU 101 receives a start instruction in response to the user pressing the release button or the like. In step S <b> 201, the CPU 101 controls to stop displaying the live display image. In step S <b> 202, the CPU 101 sequentially accumulates (records) captured images obtained by the imaging unit 105 in the memory 102. In step S <b> 203, the CPU 101 determines whether shooting has ended or the memory 102 has run out. If the shooting has been completed or the memory 102 has run out (YES in S203), the CPU 101 advances the process to S204. If none of these applies (NO in S203), the CPU 101 continues the process of S202 and repeats image accumulation. In step S204, the CPU 101 resumes displaying the live display image. In response to this, the live display development unit 113 resumes the live display development processing.

  Subsequently, the CPU 101 repeats the loop processing of S205 to S209 for each of the plurality of images stored in the memory 102. First, in step S <b> 205, the CPU 101 selects an image i to be processed and controls to perform display development processing on the image i. In response to this, the display development unit 112 performs display development processing. In step S <b> 206, the CPU 101 controls the display unit 103 to display the display image obtained by the display development process together with the live image. This process is an example of a display control process. The display contents will be described later. In step S <b> 207, the CPU 101 controls to perform recording development processing. In response to this, the recording developing unit 111 performs recording development processing. In step S <b> 208, the CPU 101 controls to record the recording image obtained by the recording development process on the recording medium 107. In the flowchart of FIG. 2, after performing the display development processing in S205 and the image display processing in S206, the recording development processing in S208 and the recording processing on the recording medium in S208 are performed. However, since the display development process and the recording development process are executed by different circuits (display development unit 112 and recording development unit 111), the display development process and the recording development process are performed in parallel. May be executed. When the display development process and the recording development process are executed in parallel for the same image, the display control process has a smaller calculation amount, and thus the process is completed before the recording development process. Therefore, the image display process of S206 is executed prior to the completion of the recording development process of S207, and is obtained by the display development process of S205 during the recording development process of S207 or during the recording process of S208. The displayed image is displayed on the display unit 103.

  Next, in S209, the CPU 101 determines whether or not an end instruction has been received according to a user operation during the processing period t of S205 to S208 performed immediately before. If the CPU 101 receives an end instruction (YES in S209), the process proceeds to S210. If the CPU 101 has not received an end instruction (NO in S209), the CPU 101 ends the process for the image i, returns to S205, newly selects an unprocessed image, and repeats the process. In S210, the CPU 101 discards the image stored in the memory 102, ends the loop processing of S205 to S209, and ends the continuous shooting process. After the sequence is completed, the next continuous shooting can be started immediately.

  FIG. 3 is a diagram illustrating a display example in S206. For example, it is assumed that images are obtained in the order of image 1, image 2, and image 3 by continuous shooting. In this case, while the development process for recording image 1 is being performed, the display image 301 of image 1 is superimposed on the live image 300 as shown in FIG. Thereafter, when the recording of the recording image of the image 1 to the recording medium 107 is completed and the development processing for recording the image 2 is started, the image 2 is displayed on the live image 300 as shown in FIG. A display image 302 is superimposed and displayed. At this time, the display image 301 of the image 1 that has already been processed is also continuously displayed. Further, when the recording of the recording image of the image 2 to the recording medium 107 is completed and the development processing for recording the image 3 is started, the image 3 is displayed on the live image 300 as shown in FIG. The display image 303 is superimposed and displayed. At this time, the display image 301 of image 1 and the display image 302 of image 2 that have already been processed are also continuously displayed. In this way, the CPU 101 displays a predetermined number N or less display images retroactively from the image being processed.

  In the present embodiment, as shown in FIG. 3D, the entire display screen of the display unit 103 is a live image display area 304 in which the live image 300 is displayed. Then, the image being processed (in the recording development process in S207 and in the recording process in S208) is displayed in the processing image display area 305 in a manner superimposed on the live image displayed in the live image display area 304. When the recording process is completed, the display image displayed in the in-process image display area 305 is displayed in the recorded image display area 1 (306) adjacent to the in-process image display area 305. The display image displayed in the recorded image display area 1 (306) before the recording process is completed is recorded in the recorded image display area adjacent to the recorded image display area 1 (306) after the recording process is completed. 2 (307). The display image displayed in the recorded image display area 2 (307) before the recording process is completed is recorded in the recorded image display area adjacent to the recorded image display area 2 (307) after the recording process is completed. 3 (308).

  In this way, each time the image recording process is completed, the display position of the display image is changed from the processing image display area (305) → the recorded image display area 1 (306) → the recorded image display area 2 (307). → Move to recorded image display area 3 (308). After the recording process is completed, the display image cannot be displayed in the in-process image display area (305) until the next image development process is completed and the display image is acquired. Therefore, the display position of the display image may be moved not at the timing when the recording process is completed, but at the timing when the development process for displaying the next image is completed. Alternatively, after completion of the recording process, until the next image development process is completed and a display image is acquired, characters such as “under development process” are displayed in the image processing area (305), A black image may be displayed.

  In FIG. 3, the processing image display area (305) and the recorded image display areas (306 to 308) have the same size. However, since the image being processed is an image that is not recorded on the recording medium when a cancellation instruction is received, the image being displayed is displayed in the image display area (305) being processed and the recorded image display areas (306 to 308). You may vary the magnitude | size of an area | region. For example, the processing image display area (305) is made smaller than the recorded image display areas (306 to 308). Thereby, a recorded image and an unrecorded image can be easily identified. Alternatively, the in-process image display area (305) may display an image that is not yet recorded by performing image processing on the display image and changing the brightness and color. Alternatively, a recorded image and an unrecorded image can be easily identified by displaying frames of different colors and shapes in the processing image display area (305) and the recorded image display areas (306 to 308). You may do it.

  As described above, the imaging apparatus 100 according to the present embodiment displays an image to be processed, that is, an image that has not been recorded, at a timing before recording on the recording medium is completed. Thereby, the user can confirm how far the recording process has been completed. Therefore, the user can input a stop instruction for stopping the recording process at a desired timing. When receiving the stop instruction, the CPU 101 of the imaging apparatus 100 controls to delete the image stored in the memory and stop the display development process, the recording development process, and the recording on the recording medium in response to the stop instruction. To do. This process is an example of a reception process and a stop process.

  As described above, the imaging apparatus 100 according to the present embodiment can stop the processing related to recording on the recording medium at a timing desired by the user. Therefore, for example, when a subsequent image is unnecessary, the user may perform an operation for inputting a process stop instruction related to the subsequent image. Thereby, the processing can be stopped at a desired timing, and the next continuous shooting can be started.

  In the first embodiment, the recording development unit and the display development unit are different circuits, and the recording development process and the display development process are executed in the respective circuits. However, as a first modification of the first embodiment, the recording development unit and the display development unit share part or all of the circuit, and the recording development process and the display development process are performed in a time-sharing manner. May be executed. As another example, the CPU 101 may read the program stored in the memory 102 and execute the program to execute the processing of the recording developing unit and the display developing unit.

  As a second modification, the imaging apparatus 100 only needs to display the display image at at least one timing during the development of the recording image and the recording of the recording image.

  As a third modification, the imaging apparatus 100 only has to display a display image, and the display form is not limited to the embodiment. As another example, the imaging device 100 may simultaneously display the live image 300 and the display images 301, 302, and 303 in different areas of the display unit 103 as illustrated in FIG. 4. As another example, the imaging apparatus 100 may display only the display image of the image being processed on the live image 300 as shown in FIG. That is, the imaging device 100 displays the display image 301 of the image 1 as shown in FIG. Then, the image capturing apparatus 100 displays only the display image 302 of the image 2 during the processing of the image 2 as shown in FIG. 5B, and the image as shown in FIG. 5C during the processing of the image 3. Only the third display image 303 is displayed.

(Second Embodiment)
Next, the difference between the imaging apparatus according to the second embodiment and the imaging apparatus 100 according to the first embodiment will be mainly described. FIG. 6 is a hardware configuration diagram of the imaging apparatus 600. The hardware configuration of the imaging apparatus 600 is substantially the same as the hardware configuration of the imaging apparatus 100 according to the first embodiment, but differs in that the display developing unit 112 is not provided.

  FIG. 7 is a flowchart showing continuous shooting processing by the imaging apparatus 600. Of the processes of the continuous shooting process shown in FIG. 7, the same processes as those of the continuous shooting process according to the first embodiment described with reference to FIG. Yes. In the continuous shooting process according to the second embodiment, after the process of S204, the CPU 101 repeatedly performs the loop processes of S701 to 703 and S209 for each of the plurality of images stored in the memory 102.

  First, in step S <b> 701, the CPU 101 selects an image i to be processed and controls to perform a recording development process on the image i. In response to this, the recording developing unit 111 performs recording development processing. In step S <b> 702, the CPU 101 controls the display unit 103 to display the recording image obtained by the recording development process together with the live image. In step S <b> 703, the CPU 101 controls to record a recording image on the recording medium 107. After that, the CPU 101 advances the process to S209. The other configuration and processing of the imaging apparatus 600 according to the second embodiment are the same as the configuration and processing of the imaging apparatus 100 according to the first embodiment.

  As described above, the imaging apparatus 600 according to the second embodiment displays the recording image after the recording image development is completed and until the recording of the recording image is completed. The first embodiment is suitable when the development process itself takes time, and the second embodiment is suitable when recording on the recording medium 107 takes time with respect to the continuous shooting speed. Embodiment.

  As described above, according to each embodiment described above, the next continuous shooting can be started at a desired timing.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100, 600 Imaging device 101 CPU
103 Display Unit 107 Recording Unit 111 Recording Development Unit 112 Display Development Unit 113 Live Display Development Unit

Claims (19)

First recording means for recording a plurality of images obtained by continuous shooting by the imaging means in the temporary storage means;
Second recording means for sequentially recording a plurality of images recorded in the temporary storage means on a recording medium;
An image processing apparatus comprising: a display control unit that controls to display an image that has not been recorded on the recording medium together with a live image on a display unit.   The display control means controls to display a plurality of images including an image that has not been recorded on the recording medium and an image that has been recorded on the recording medium together with a live image. The image processing apparatus according to claim 1.   The display control means controls to display an image that has not been recorded on the recording medium and an image that has been recorded on the recording medium immediately before the image together with a live image. The image processing apparatus according to claim 2.   The image processing apparatus according to claim 2, wherein the display control unit controls to display a plurality of images that have been recorded on the recording medium together with a live image.   The display control means displays an image that has not been recorded on the recording medium and an image that has been recorded on the recording medium immediately before the image in different display forms. The image processing apparatus according to any one of 2 to 4.   The display control means performs control so that an image that has not been recorded on the recording medium and an image that has been recorded on the recording medium immediately before the image are displayed in different sizes. The image processing apparatus according to claim 5.   The display control means displays a first image that has not been recorded on the recording medium in a processing image display area, and in response to completion of recording of the first image on the recording medium. The image processing apparatus according to claim 2, wherein the first image is changed so as to be displayed in a recorded image display area adjacent to the image processing area being processed.   The display control means completes the recording of the second image after the recording of the second image next to the first image onto the recording medium of the first image. The image processing apparatus according to claim 7, wherein control is performed so that the image is displayed in the processing image display area before. Further comprising developing means for performing development processing on the image recorded in the temporary storage means;
The display control means controls to display, together with a live image, a plurality of images that have been developed by the developing means but have not been recorded on the recording medium among the plurality of images. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   The display control means displays a first image that has not been recorded on the recording medium in a processing image display area, and displays a second image that has been recorded on the recording medium in the processing image display area. In response to the completion of the development processing of the second image next to the first image, the first image is recorded in the recorded image display area adjacent to the recorded image display area. The image processing apparatus according to claim 9, wherein the image processing apparatus is controlled to display in a display area and to display the second image in the processing-in-process image display area. The developing means includes
A first developing means for performing a recording development process for obtaining a recording image;
A second developing means for developing to perform a display developing process with a calculation amount smaller than that of the first developing means for obtaining a display image;
The second recording means records the recording image;
The image processing apparatus according to claim 9, wherein the display control unit controls the display image corresponding to the recording image to be displayed together with the live image during development of the recording image. .   The display control means controls to display the display image corresponding to the recording image together with the live image during recording of the recording image by the second recording means. The image processing apparatus according to 11. The developing means includes
A first developing means for performing a recording development process for obtaining a recording image;
A second developing means for developing to perform a display developing process with a calculation amount smaller than that of the first developing means for obtaining a display image;
The second recording means records the recording image;
The image processing apparatus according to claim 9, wherein the display control unit controls the recording image to be displayed together with the live image during recording by the second recording unit.   The image processing apparatus according to claim 11, wherein the developing unit executes the recording development process and the development process by switching in a time-sharing manner.   The image processing apparatus according to claim 11, wherein the developing unit executes the recording development process and the development process in parallel. Accepting means for accepting a recording stop instruction in response to a user operation;
16. The apparatus according to claim 1, further comprising stop processing means for deleting an image recorded in the temporary storage means and stopping recording on the recording medium when the stop instruction is received. The image processing apparatus according to any one of the above.   The image processing apparatus according to claim 1, further comprising the imaging unit. An image processing method executed by an image processing apparatus,
A first recording step of recording in the temporary storage means a plurality of images obtained by continuous shooting by the imaging means;
A second recording step of sequentially recording a plurality of images recorded in the temporary storage means on a recording medium;
A display control step of controlling to display an image that has not been recorded on the recording medium on a display unit together with a live image.   The program for functioning a computer as each means of the image processing apparatus of any one of Claims 1 thru | or 16.

Images