JP2014036237A - Image pickup device, program and image pickup method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform processing related to various recording in accordance with the photographing of an unnecessary portion in the case of photographing a moving image.SOLUTION: Whether or not the measurement value of a timer T is a threshold TT (for example, 5 seconds) or less is determined (step S14). When T≤TT, and the measurement value of the timer T is the threshold TT (for example, 5 seconds) or less, that is, when a period in which an unnecessary image has been picked up due to an intentional operation or an incidental event is a short time which is the threshold TT or less, processing is advanced from a step S14 to a step S15. Then, image data acquired from a point of time F=0 to F=1 among image data constituting a moving image temporarily stored in an SDRAM are recorded in an external memory with one file. On the contrary, when T>TT, the processing is advanced from the step S14 to a step S16, and whole image data constituting the moving image temporarily stored in the SDRAM are abandoned (deleted).

Description

  The present invention relates to an imaging apparatus, a program, and an imaging method for capturing a moving image.

  In general, an imaging device that captures a moving image starts capturing a moving image that is a temporally continuous image in response to a start key operation, sequentially records it in a memory, and stops recording in response to an end key operation To do. As a result, a moving image from the start key operation time to the end key operation time is recorded in the memory as one file.

  However, if the start and end of imaging is controlled depending on only the key operation in this way, even if a recording-free scene such as a dark scene occurs in the meantime, the image in that period is a moving image. Will be recorded in the memory. As a result, a moving image in which partially useless images are continuously recorded is recorded, and not only the workability of the entire recorded moving image is deteriorated but also the memory is used unnecessarily.

  For this reason, when the photographer covers the front of the lens with his / her hand, the moving image in the meantime is determined as an unnecessary portion, and the moving image determined as the unnecessary portion is deleted and recorded in the memory. Technology that suppresses the deterioration of workability and avoids unnecessary use of memory has also emerged (see, for example, Patent Document 1).

JP 2012-39395 A

  However, conventionally, only the process of deleting a moving image determined to be an unnecessary part is executed, so that the process related to recording executed in response to the determination is simple and single. Therefore, even if automatic processing is executed in accordance with the shooting of an unnecessary portion, the convenience of this is low, and therefore, the appearance of a technique for executing more various recording controls has been expected.

  The present invention has been made in view of such a conventional problem, and provides an imaging apparatus, a program, and an imaging method for performing processing related to various recordings in accordance with imaging of an unnecessary part at the time of moving image shooting. It is the purpose.

  In order to solve the above problems, an imaging apparatus according to the present invention includes an imaging unit that captures a moving image, a determination unit that determines whether or not the moving image captured by the imaging unit is an unnecessary image, A measuring unit that measures a period determined to be an unnecessary image by the determining unit, and a moving image captured by the imaging unit in a different processing mode according to the length of the period measured by the measuring unit. And a recording processing means for executing processing related to recording.

  Further, the program according to the present invention is readable by a computer included in an apparatus including an imaging unit that captures a moving image, and whether or not the moving image captured by the imaging unit is an unnecessary image. In a different processing mode according to the length of the period measured by the measuring means, a measuring means for measuring a period determined as an unnecessary image by the determining means, It is characterized by functioning as recording processing means for executing processing related to recording of moving images picked up by the image pickup means.

  The imaging method according to the present invention includes an imaging step for capturing a moving image, a determination step for determining whether or not the moving image captured by the imaging step is an unnecessary image, and an unnecessary determination by the determination step. Related to the recording of the moving image captured by the imaging step in a measuring step for measuring a period determined to be a correct image and a different processing mode according to the length of the period measured by the measuring step And a recording process step for executing the process.

  According to the present invention, it is possible to perform various processes related to recording according to shooting of an unnecessary portion at the time of moving image shooting.

It is a block diagram which shows the electric constitution of the digital camera which concerns on one embodiment of this invention. It is a flowchart which shows the process sequence of the embodiment.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a circuit configuration of a digital camera 10 to which an embodiment of the present invention is applied. The digital camera 10 includes AF (Auto Focus), AE (Auto Exposure), and AWB (Auto White Balance). ) And other general functions. The lens block 11 includes an optical system such as a zoom lens and a focus lens, and a drive mechanism for driving the optical system. The optical system is driven in the direction of the optical axis by a motor 12 provided in the drive mechanism. Driven by.

  A motor driver 16 is connected to a CPU 13 that controls the entire digital camera 10 via a bus 14 and a timing generator (TG) 15. The motor driver 16 is connected to a timing generator 15 according to a command from the CPU 13. The motor 12 is driven based on the generated timing signal.

  The digital camera 10 has a CCD 18 as an image sensor. The CCD 18 is disposed on the optical axis of the lens block 11, and the subject is imaged on the light receiving surface of the CCD 18 by the lens block 11. The CCD 18 is driven by a vertical and horizontal driver 19 based on a timing signal generated by the timing generator 15 in accordance with a command from the CPU 13, and outputs an analog imaging signal corresponding to the optical image of the subject to the unit circuit 20. The unit circuit 20 includes a CDS circuit that removes noise included in the output signal of the CCD 18 by correlated double sampling, an A / D converter that converts an imaging signal from which noise has been removed into a digital signal, and the like. The converted imaging signal is output to the image processing unit 21.

  The image processing unit 21 performs processing such as pedestal clamping on the input imaging signal, converts it into a luminance (Y) signal and a color difference (UV) signal, and improves image quality such as AWB, contour enhancement, and pixel interpolation. Digital signal processing for The YUV data converted by the image processing unit 21 is sequentially stored in the SDRAM 22, and is converted into a video signal every time one frame of data (image data) is accumulated in the REC through state, and includes a backlight unit 24. It is sent to a liquid crystal monitor (LCD) 23 and displayed on the screen as a through image.

  In the still image shooting mode, using the shutter key operation as a trigger, the CPU 13 instructs the CCD 18, the vertical and horizontal drivers 19, the unit circuit 20, and the image processing unit 21 to switch from the REC through state to the shooting process. To do. Image data is acquired by shooting processing in the still image shooting mode, and the acquired image data is temporarily stored in the SDRAM 22, compressed by the CPU 13, and finally stored in the external memory 25 as a still image file of a predetermined format. To be recorded.

  Further, in the movie recording mode, a switch from the REC through state to the photographing process is instructed by the first shutter key operation. Then, a plurality of image data acquired between the first shutter key operation and the second shutter key operation and sequentially stored in the SDRAM 22 are sequentially compressed by the CPU 13, and finally are converted into an external memory as a moving image file. 25. Details of the recording mode when the CPU 13 records the moving image file in the external memory 25 will be described later. The still image file and the moving image file recorded in the external memory 25 are read and expanded by the CPU 13 in accordance with the user's selection operation in the PLAY mode, and are expanded on the SDRAM 22 as YUV data, and then displayed on the liquid crystal monitor 23. Is done.

  The flash memory 26 stores various programs for causing the CPU 13 to control the respective units, for example, various programs such as a program for controlling AE, AF, and AWB.

  The digital camera 10 includes a key input unit 27 including a plurality of operation keys and switches such as a power switch, a mode selection key, a shutter key, and a zoom key, a rechargeable battery 28 such as a nickel metal hydride battery, and the power of the battery 28. Power supply control circuit 29 for supplying the power to each unit, and a microcomputer 30 for controlling them. The microcomputer 30 regularly scans the key input unit 27 for operation of the operation key, and when a user operates any operation key, sends an operation signal corresponding to the operation content to the CPU 13. .

  The digital camera 10 has a recording function for recording ambient sounds in the movie recording mode. The CPU 13 has a speaker (SP) 33 and a microphone via an audio chip 32 having an audio processing circuit. (MIC) 34 is connected. In the movie recording mode, the audio chip 32 processes the audio waveform input from the microphone 34 and inputs the audio waveform data to the CPU 13. Then, the CPU 13 compresses the audio waveform data input from the audio chip 32 between the first and second shutter key operations in the movie recording mode, and the moving image with sound including the compressed ambient sound data and the compressed moving image data. A file is generated and recorded in the external memory 25. The moving image file with sound recorded in the external memory 25 is reproduced by the speaker 33 after the surrounding sound data is converted into a sound waveform by the sound chip 32 when the moving image data is reproduced in the PLAY mode.

  In the present embodiment having the above configuration, the CPU 13 executes processing as shown in the flowchart of FIG. 2 based on the program stored in the flash memory 26. That is, in the REC through state in which the shooting mode is set, it is determined whether or not the first shutter key operation as the shooting start operation has been performed based on the scan result from the microcomputer 30 with respect to the key input unit 27 (step S1). ). When the shooting start operation, which is the first shutter key operation, is performed, the CPU 13 switches the CCD 18, the vertical and horizontal drivers 19, the unit circuit 20, and the image processing unit 21 from the REC through state to the shooting process. The image data output by the image processing unit 21 is acquired at a timing corresponding to a predetermined shooting frame rate (step S2).

  The acquired image data is temporarily stored in the SDRAM 22 and stored, and the image data is compressed at a variable bit rate (step S3). Further, the code amount of the image data compressed at the variable bit rate is detected, and it is determined whether or not the detected code amount is equal to or less than a predetermined amount (step S4).

  Here, the code amount being equal to or less than the predetermined amount means a case where an image represented by the compressed image data is entirely dark (substantially dark) and cannot be visually recognized. At this time, if the image represented by the image data is entirely dark and cannot be visually recognized, the code amount is much smaller than the code amount when the image data of the visible image is compressed at the variable bit rate. That is, in the present embodiment, an image that is dark and cannot be visually recognized is judged as an unnecessary image. Therefore, in either case where the lens environment included in the lens block 11 is covered with a hand and the shooting environment is intentionally darkened, or when the shooting environment is accidentally darkened due to, for example, a sudden power failure, step S4 is performed. The determination at is YES and it is determined that the image is unnecessary.

  However, as long as such an intentional operation or an accidental event does not occur and the normal shooting environment continues, the determination in step S4 is NO. Therefore, the CPU 13 advances the process from step S4 to step S5, and determines whether F = 1 and the flag F is set (step S5). This flag F is reset to F = 0 when the movie recording mode is set. As will be described later, if it is determined that the image is an unnecessary image in step S4, F is set to F = 0. = 1 is a flag set. Therefore, if the above-described normal photographing environment is continued, the state is F = 0, and as long as the normal photographing environment is continued, the determination in step S5 is NO.

  Therefore, the process proceeds to step S7, and it is determined whether or not the second shutter key operation, which is a photographing end operation, has been performed. If there is no photographing end operation, it is determined whether T = 0 and the count value of the timer T is “0” (step S8). The timer T is a measuring unit that measures a period during which the CPU 13 determines that the image is unnecessary during moving image shooting. As will be described later, the timer T counts up after determining that the image is an unnecessary image in step S4. It is. Therefore, as long as the normal shooting environment continues, the determination in step S8 is YES, and the CPU 13 returns to the processing from step S2.

  In other words, if the normal shooting environment continues and moving images are being shot, the CPU 13 repeats the processing in the loop of steps S 2 → S 3 → S 4 → S 5 → S 7 → S 8 → S 2, and thereby a predetermined shooting frame constituting the moving image. The image data acquired at the rate is compressed and sequentially stored in the SDRAM 22. When the second shutter key operation is performed to finish moving image shooting, the CPU 13 determines YES in step S7 and records all image data stored in the SDRAM 22 in the external memory 25 as one moving image file ( Step S9). Therefore, when moving image shooting is performed in a state where the normal shooting environment is continued as described above, a plurality of frame image data acquired from the shooting start operation to the end operation is stored in one frame as in normal movie shooting. It is recorded in the external memory 25 as a moving image file.

  However, if the intentional operation or an accidental event occurs during moving image shooting, the determination in step S4 is YES. Therefore, the CPU 13 proceeds from step S4 to step S10, and determines whether F = 0 and the flag F is in a reset state. If it is in the state of F = 0, this is set and F = 1 is set (step S11). Further, the timer T for measuring the period determined to be an unnecessary image is operated and counted up (step S12). Thereafter, the processing from step S7 in the loop described above is executed.

  That is, if the above-described intentional operation or an accidental event occurs during moving image shooting, the process proceeds in steps S2-> S3-> S4-> S10-> S11-> S12-> S7-> S8. At this time, since the timer T starts counting in step S12, the determination in step S8 is NO. Accordingly, the process proceeds from step S8 to S13, but the flag F is set in step S11 earlier, so the determination in step S13 is NO. Therefore, the CPU 13 returns from step S13 to step S2.

  And when the process from step S2 is repeated and the state where the above-mentioned intentional operation or accident occurred has continued, the determination in step S4 is YES. Therefore, the CPU 13 advances the process from step S4 to step S10. At this time, since F is already in the state of 1, the determination in step S10 is NO. Therefore, the timer T is incremented without performing the process of step S11. Therefore, if a state in which the above-described intentional operation or an accidental event has occurred while the movie is being taken continues, the CPU 13 proceeds to steps S2, S3, S4, S10, S12, S7, S8, and S13. The process by the loop of S2 is repeated, and the timer T is counted up.

  However, if the above-described intentional operation or accidental event disappears when the processing from step S2 is repeated, the determination in step S4 is NO. Therefore, the CPU 13 proceeds from step S4 to step S5. At this time, since F = 1, the determination in step S5 is YES. Therefore, the flag F is reset (step S6). If the movie is still being shot, the process proceeds from step S6 → S7 → S8 → S13 → S14 to determine whether the measured value of the timer T is equal to or less than a threshold value TT (for example, 5 seconds) (step S14). ).

  When T ≦ TT and the measured value of the timer T is equal to or less than a threshold value TT (for example, 5 seconds), that is, a period during which an unnecessary image is captured due to the above-described intentional operation or accidental event, If it is a short time that is equal to or less than the threshold value TT, the process proceeds from step S14 to step S15. Of the image data constituting the moving image temporarily stored in the SDRAM 22, a plurality of frame image data acquired from the time F = 0 to F = 1, that is, the code amount is equal to or less than a predetermined amount. Up to the frame image data immediately before the frame image data determined to be present is recorded in the external memory 25 as one file. That is, frame image data for which the code amount is determined to be less than or equal to a predetermined amount, and frame image data acquired after F = 1 becomes F = 0 (frame image for which the code amount is determined not to be less than the predetermined amount) Frame image data excluding frame image data after the data) is recorded in the external memory 25 as one file. Here, the frame image data stored in the SDRAM 22 and determined that the code amount is equal to or less than the predetermined amount and the frame image data recorded in the external memory 25 in step S15 are discarded (deleted). . Thereafter, the flag F and the timer T are reset (step S17), and the process returns to step S2.

Therefore, when the period in which the shooting environment is almost dark is a relatively short time such as 5 seconds or less, processing including the following recording mode is executed.
(1A) A moving image until a nearly dark state is detected is recorded as one file, and shooting of a new moving image is started.
(1B) In response to detecting the end of the almost dark state, the storage of the image data to be the next file is started.

  By executing (1A) and (1B), there is an effect that the moving images before and after the almost dark state is detected can be recorded in separate files. In addition, since unnecessary images are excluded in an almost dark state, it is possible to suppress a reduction in the workability of moving images and to avoid unnecessary use of the external memory 25.

  In this way, in this embodiment, when the period of the almost dark state is relatively short, the moving images before and after are recorded in separate files, but without being recorded in separate files. You may make it record with the same file. Even in this case, since unnecessary images shot in a substantially dark state are excluded, it is possible to suppress a reduction in the workability of the moving image and to avoid unnecessary use of the external memory 25. it can.

  On the other hand, if the determination in step S14 is NO and the measured value of the timer T exceeds the threshold value TT, that is, there is a period during which an unnecessary image is captured due to the above-described intentional operation or accidental event. If it is a relatively long time exceeding the threshold TT, the process proceeds from step S14 to step S16. Then, all image data constituting the moving image temporarily stored in the SDRAM 22 is discarded (erased). However, strictly speaking, frame image data excluding frame image data obtained after F = 1 becomes F = 0 (frame image data after the frame image data determined that the code amount is not equal to or less than the predetermined amount). Will be discarded (deleted). Thereafter, the flag F and the timer T are reset (step S17), and the process returns to step S2.

Therefore, when the period in which the shooting environment is almost dark is a relatively long time such as more than 5 seconds, processing including the following recording mode is executed.
(2A) The image data until the almost dark state is detected is discarded.
(2B) In response to detecting the end of the almost dark state, the storage of the image data to be the next file is started.

  By executing (2A) and (2B), there is an effect that a moving image can be retaken by an operation such as closing the lens for a predetermined time. Therefore, it is possible to quickly take a picture again with a simple operation, and unnecessary use of the external memory 25 can be avoided.

  In the above description, the recording mode of an image when a moving image is taken has been described. However, with respect to audio, only audio data corresponding to image data to be recorded may be compressed and recorded.

  In the embodiment, all the image data to be recorded in one file is once stored in the SDRAM 22 and then recorded in the external memory 25. However, the image data compressed in the SDRAM 22 is sequentially recorded in the external memory 25. You may make it do.

  In the embodiment, an image shot in a substantially dark shooting environment is set as an unnecessary image. However, the present invention is not limited to this, and an image in which camera shake occurs, the camera tilt is shot at a predetermined angle or more. Other images such as an image or an image whose luminance change is larger than the threshold may be used as an unnecessary image. Furthermore, an unnecessary image condition may be set by a manual operation, and an image that satisfies or does not satisfy a condition arbitrarily set by the user may be set as an unnecessary image.

  The embodiment of the present invention has been described above, but the present invention is not limited to this, and includes the invention described in the scope of claims and the equivalents thereof.

  The claims appended at the time of filing this application will be appended below.

<Claim 1>
An imaging means for capturing a moving image;
Determination means for determining whether or not the moving image captured by the imaging means is an unnecessary image;
Measuring means for measuring a period determined to be an unnecessary image by the judging means;
A recording processing unit configured to execute processing related to recording of a moving image captured by the imaging unit in a different processing mode according to the length of the period measured by the measuring unit. apparatus.

<Claim 2>
The imaging apparatus according to claim 1, wherein the determination unit determines whether the image is an unnecessary image based on brightness of a moving image captured by the imaging unit.

<Claim 3>
The processing mode of the recording processing unit includes a recording process of recording a moving image captured by the imaging unit as a single file until the determination unit determines that the image is unnecessary. The imaging device according to claim 1 or 2.

<Claim 4>
The processing mode of the recording processing unit includes a discarding process that discards and does not record the moving image captured by the imaging unit until the determination unit determines that the image is unnecessary. The imaging device according to claim 1, 2 or 3.

<Claim 5>
The imaging apparatus according to claim 1, wherein the recording processing unit processes a moving image in a different manner depending on whether the period measured by the measuring unit is shorter than a predetermined threshold or longer.

<Claim 6>
In the processing mode of the recording processing unit, when the period measured by the measuring unit is equal to or less than a predetermined threshold, the image is captured by the imaging unit until the determination unit determines that the image is unnecessary. 6. A recording process for recording the recorded moving image in one file and a discarding process for discarding and not recording the moving image captured by the imaging unit when the threshold is exceeded. The imaging device described.

<Claim 7>
The image processing apparatus further includes an imaging control unit that causes the imaging unit to perform an imaging operation when it is determined that the moving image is not an unnecessary image after the determination unit determines that the moving image is an unnecessary image. The imaging device according to any one of claims 1 to 6.

<Claim 8>
A computer included in an apparatus including an imaging unit that captures a moving image is readable, and the computer is
Determination means for determining whether or not the moving image captured by the imaging means is an unnecessary image;
Measuring means for measuring a period determined to be an unnecessary image by the judging means;
A program that functions as a recording processing unit that performs processing related to recording of a moving image captured by the imaging unit in a different processing mode according to the length of the period measured by the measuring unit. .

<Claim 9>
An imaging step of capturing a moving image;
A determination step of determining whether or not the moving image captured by the imaging step is an unnecessary image;
A measurement step for measuring a period determined to be an unnecessary image by the determination step;
A recording processing step for executing processing related to recording of a moving image captured by the imaging step in a different processing mode according to the length of the period measured by the measuring step. Method.

10 Digital Camera 11 Lens Block 13 CPU
14 bus 15 timing generator 16 motor driver 18 CCD
19 Vertical and Horizontal Driver 20 Unit Circuit 21 Image Processing Unit 22 SDRAM
25 External memory 26 Flash memory 27 Key input section

Claims (9)

An imaging means for capturing a moving image;
Determination means for determining whether or not the moving image captured by the imaging means is an unnecessary image;
Measuring means for measuring a period determined to be an unnecessary image by the judging means;
A recording processing unit configured to execute processing related to recording of a moving image captured by the imaging unit in a different processing mode according to the length of the period measured by the measuring unit. apparatus.   The imaging apparatus according to claim 1, wherein the determination unit determines whether the image is an unnecessary image based on brightness of a moving image captured by the imaging unit.   The processing mode of the recording processing unit includes a recording process of recording a moving image captured by the imaging unit as a single file until the determination unit determines that the image is unnecessary. The imaging device according to claim 1 or 2.   The processing mode of the recording processing unit includes a discarding process that discards and does not record the moving image captured by the imaging unit until the determination unit determines that the image is unnecessary. The imaging device according to claim 1, 2 or 3.   The imaging apparatus according to claim 1, wherein the recording processing unit processes a moving image in a different manner depending on whether the period measured by the measuring unit is shorter than a predetermined threshold or longer.   In the processing mode of the recording processing unit, when the period measured by the measuring unit is equal to or less than a predetermined threshold, the image is captured by the imaging unit until the determination unit determines that the image is unnecessary. 6. A recording process for recording the recorded moving image in one file and a discarding process for discarding and not recording the moving image captured by the imaging unit when the threshold is exceeded. The imaging device described.   The image processing apparatus further includes an imaging control unit that causes the imaging unit to perform an imaging operation when it is determined that the moving image is not an unnecessary image after the determination unit determines that the moving image is an unnecessary image. The imaging device according to any one of claims 1 to 6. A computer included in an apparatus including an imaging unit that captures a moving image is readable, and the computer is
Determination means for determining whether or not the moving image captured by the imaging means is an unnecessary image;
Measuring means for measuring a period determined to be an unnecessary image by the judging means;
A program that functions as a recording processing unit that performs processing related to recording of a moving image captured by the imaging unit in a different processing mode according to the length of the period measured by the measuring unit. . An imaging step of capturing a moving image;
A determination step of determining whether or not the moving image captured by the imaging step is an unnecessary image;
A measurement step for measuring a period determined to be an unnecessary image by the determination step;
A recording processing step for executing processing related to recording of a moving image captured by the imaging step in a different processing mode according to the length of the period measured by the measuring step. Method.

Images