JP2009050017A - Moving image recording apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving image recording apparatus, electronic camera apparatus and moving image recording method in which a long-time moving image meeting free capacity of a recording medium can be recorded with higher quality, without being affected by variation in a data writing speed or a state of use. <P>SOLUTION: When performing stream recording of a moving image onto a recording medium, if previous frame data are being written (SA4; YES) at a point of time for writing the latest frame data based on a frame term, the latest frame data are discarded and a dummy counter is added by one (SA9). Thereafter, at a point of time when writing is completed (SA4; NO), dummy frames just for the dummy counter are written onto the recording medium (SA11). By temporarily reducing an apparent frame rate during playback, video-recording processing can be prevented from being temporally ruptured, while maintaining normal moving image recording, and an upper limit of video-recording quality can be set higher. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a moving image recording device and an electronic camera device having a function of recording moving images in a stream, a moving image recording method, and a program.

  2. Description of the Related Art Conventionally, there is a moving image recording apparatus that performs stream recording in which an input moving image is compressed in real time and is recorded on a recording medium, for example, a digital camera having a moving image shooting function. In such digital cameras, various detachable memory cards are generally used as recording media, and image data (frame data) compressed for each frame is stored in a memory card or the like when shooting a movie (recording). Recorded sequentially. In general, the user can set the quality of a moving image to be recorded, that is, the recording quality (fine, normal, economy, etc.) in advance. Recording of moving images at the time of shooting (hereinafter, recording) is performed according to a plurality of recording parameters (mainly compression method, compression rate, image size, frame rate), and the values (contents) of the recording parameters are set at that time. It is fixed according to the recording quality being recorded. Furthermore, the amount of data that must be processed within a certain time during recording is also almost determined by the recording quality.

On the other hand, for example, the following Patent Document 1 describes a method for extending the recording time when a moving image is stream-recorded in a digital camera. In this method, a buffer area for a plurality of frames is secured in the internal memory in advance, and in parallel with the writing operation of the frame data to the internal memory, the previously stored image data is read and stored in a memory card or the like as needed. The frame data is erased from the internal memory, that is, the internal memory is used as a ring buffer.
JP 2000-232619 A

  However, in the above method, the moving image recording time (recording time) is determined by the capacity of the internal memory (ring buffer). Therefore, in order to be able to record for a long time according to the free space of the memory card that actually records the video data, the recording quality of the upper limit that can be set by the user or the recording quality that is fixedly set Is matched with the data writing speed to the memory card or the like to be used.

  However, as described above, the amount of data that must be processed within a certain time during recording is substantially determined by the recording quality, but varies depending on the content of the image to be captured. In addition, the writing speed of data to memory cards, etc. varies from manufacturer to manufacturer even if the media is the same standard, and the available capacity, the difference in the area where data is recorded, and the power supply voltage of the system Since it changes depending on the actual use environment such as changes in

  Therefore, even if the upper limit recording quality that can be set by the user or the recording quality that is fixedly set is determined according to the type of memory card etc., it must be processed within a certain time Due to the large increase in data volume and the significant decrease in data writing speed to memory cards, etc., the frame data writing process will not be in time and the recording process will fail in time. There is concern about the occurrence of situations such as out-of-synchronization of voice and writing illegal data. Therefore, in order to enable recording for a long time based on the free space of the memory card, etc., the upper limit of the recording quality that can be set by the user and the recording quality that is fixedly set are set to be low in advance. There was a problem that had to be left.

  The present invention has been made in view of the above-described conventional problems, and it is possible to increase a moving image for a long time corresponding to the free capacity of a recording medium without being affected by variations in data writing speed and usage conditions. It is an object of the present invention to provide a moving image recording apparatus, an electronic camera apparatus, a moving image recording method, and a program used for realizing the moving image recording apparatus, which can record with quality.

  In order to solve the above-mentioned problem, in the invention of claim 1, a moving image recording apparatus for sequentially recording image data constituting a moving image on a recording medium while performing image processing at a predetermined frame period. When it is determined that the delay has occurred in the writing process of the image data after the image processing, and whether or not the delay that hinders the normal recording of the moving image has occurred, And adjusting means for reducing the amount of data written to the recording medium.

  In such a configuration, when there is a delay that hinders normal recording of a moving image in writing processing of image data after image processing to the recording medium during recording of the moving image, the amount of data written to the recording medium is reduced. It will be.

  Therefore, by reducing the amount of write data even when there is a delay that hinders normal recording of moving images in the recording operation of image data after image processing to a recording medium during recording of moving images. Thus, it is possible to prevent the video recording process from failing in time while maintaining normal video recording.

  According to a second aspect of the present invention, when the determining means determines that the delay has occurred, the adjusting means writes image data after image processing of the next frame on the recording medium. Predetermined information for reproducing an image having the same content as any of the frames before and after the frame of the image data, instead of an image based on the image data for which the writing process has been canceled by the canceling unit. Was recorded on the recording medium.

  In such a configuration, when there is a delay that hinders normal recording of a moving image in the writing process of image data after the image processing to the recording medium during recording of the moving image, the image after the image processing of the next frame The data writing process is canceled, and in this case, instead of an image based on the image data for which the recording operation has been canceled, a predetermined image for reproducing an image having the same content as the previous frame of the image data Information is recorded on the recording medium.

  Therefore, even when a delay that hinders normal recording of moving images occurs in the recording operation of image data after image processing on a recording medium during recording of moving images, the apparent frame rate during reproduction By temporarily reducing the video recording time, it is possible to prevent the video recording process from failing in time while maintaining normal video recording.

  In the invention of claim 3, the image data after image processing for a plurality of frames recorded on the recording medium is accompanied by index information indicating the reproduction order of each image data, and the adjusting means The predetermined information is recorded on the recording medium as the index information.

  According to a fourth aspect of the present invention, the determination means is writing image data after the previous image processing at the time of writing new image data after image processing to the recording medium. At this time, it is determined that there is a delay that hinders normal recording of moving images.

  In such a configuration, even if a buffer for temporarily storing image data after image processing for a plurality of frames recorded on the recording medium is not provided, the normal operation of moving images is performed in the recording operation of the image data after image processing on the recording medium. When a delay that hinders recording occurs, it is possible to prevent the recording process from failing in time by reducing the amount of write data.

  The invention according to claim 5 further includes a buffer for temporarily storing image data after image processing for a plurality of frames to be recorded on the recording medium, wherein the determination means performs new image processing on the buffer. It is determined that there is a delay that hinders normal recording of moving images when the empty size of the buffer is equal to or less than a predetermined size at the time of later writing of image data.

  In such a configuration, even if there is a delay that hinders normal recording of moving images in the recording operation of image data after image processing on the recording medium from the beginning of recording of moving images, a certain time For the inside, the set frame rate can be secured as the frame rate at the time of reproduction.

  According to a sixth aspect of the present invention, when the determining means determines that the delay has occurred, the adjusting means prohibits writing of new image processed image data to the buffer. It was supposed to be.

  According to a seventh aspect of the invention, there is provided an informing means for informing that the set recording quality is not secured when it is judged by the judging means that the delay has occurred. did.

  In such a configuration, since the recording operation of the image data after the image processing to the recording medium has a delay that hinders the normal recording of the moving image, the set recording quality cannot be ensured. The user can be notified each time.

  According to an eighth aspect of the present invention, in the moving image recording method of sequentially recording image data constituting a moving image on a recording medium while performing image processing at a predetermined frame period, the image data after the image processing on the recording medium is performed. A step of determining whether or not there is a delay that hinders normal recording of moving images in the writing process of the image data, and if it is determined that there is a delay, the amount of data written to the recording medium is reduced. The process of performing the process to make.

  According to such a method, even when there is a delay that hinders normal recording of moving images in the recording operation of image data after image processing on a recording medium during recording of moving images, the amount of data to be written is reduced. By reducing it, it is possible to prevent the video recording process from failing in time while maintaining normal video recording.

  According to a ninth aspect of the invention, there is provided a computer having a moving image recording apparatus for sequentially recording image data constituting a moving image on a recording medium while performing image processing at a predetermined frame period. A determination means for determining whether or not there is a delay that hinders normal recording of moving images in the writing processing of the image data after processing, and when the determination means determines that the delay has occurred, The program is made to function as an adjusting means for reducing the amount of data written to the recording medium.

  According to the tenth aspect of the present invention, the image data constituting the moving image captured at a predetermined frame period by the imaging means is sequentially recorded on a removable recording medium while being compressed at the predetermined frame period. In an electronic camera device having a moving image shooting function, a determination means for determining whether or not there is a delay that hinders normal recording of a moving image in the writing process of image data after compression to the recording medium; When the determination unit determines that the delay has occurred in the writing process, the writing unit stops the writing process of the image data after compression of the next frame on the recording medium, and the writing unit stops the writing process. In place of the image based on the image data, predetermined information for reproducing an image having the same content as the frame immediately before the frame of the image data is stored in the recording medium. It was that an adjusting means for recording on.

  In such a configuration, even when there is a delay that hinders normal recording of the moving image in the recording operation of the image data after compression onto the recording medium during recording of the moving image including the captured image, By temporarily reducing the apparent frame rate at the time of reproduction, it is possible to prevent the video recording process from failing in time while maintaining normal moving image recording.

  In the apparatus and method of the present invention, even during recording of a moving image, even if there is a delay that hinders normal recording of the moving image in the recording operation of the image data after image processing on the recording medium, By reducing the amount of data, the video recording process can be prevented from failing in time while maintaining normal video recording. Therefore, the upper limit of the recording quality that can be set by the user and the recording quality that is fixedly set can be increased. Therefore, it is possible to record a high-quality moving image for a long time corresponding to the free capacity of the recording medium without being affected by variations in the data writing speed and usage conditions.

  In particular, according to the invention of claim 2, in order to reduce the amount of write data by temporarily lowering the apparent frame rate at the time of reproduction, the normal video recording is maintained by simple processing, It is possible to prevent the recording process from failing in time.

  According to the invention of claim 4, the above effect can be obtained without providing a buffer for temporarily storing image data after image processing for a plurality of frames recorded on a recording medium. Therefore, the memory included in the moving image recording apparatus can be used more effectively.

  According to a fifth aspect of the present invention, there is a case where a delay that hinders normal recording of moving images occurs in the recording operation of image data after image processing on a recording medium from the beginning of recording of moving images. Even in such a case, the set frame rate can be secured as the frame rate at the time of reproduction within a certain time. Therefore, usability can be improved.

  According to the seventh aspect of the present invention, the set recording quality can be secured by causing a delay that hinders normal recording of moving images in the recording operation of the image data after image processing on the recording medium. It is now possible to inform the user that there is no such information during recording. Also by this, usability can be improved.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
(Embodiment 1)
FIG. 1 is a block diagram of a digital camera common to each embodiment of the present invention. This digital camera has a moving image shooting function and has the following configuration.

  The digital camera includes a camera body 1 and a recording medium 20 that can be attached to and detached from the camera body 1, and the camera body 1 receives an optical system 2 composed of a plurality of lenses, and receives light through the optical system 2. A CCD 3 having a color filter such as a Bayer array, which is an imaging means for forming an optical image of a subject on the surface, is disposed. The CCD 3 is driven by a drive signal sent from the timing generator 7, photoelectrically converts the light image of the subject and outputs it as an imaging signal. The output signal from the CCD 3 is subjected to correlated double sampling and gain adjustment by the CDS circuit 4 and converted to a digital signal by the A / D conversion circuit 5. The A / D-converted Bayer data is input to the DSP unit 6 and subjected to processing such as pedestal clamping, and then converted into a luminance (Y) signal and a color difference (UV) signal by a luminance / color difference matrix circuit in the block. . Note that the DSP unit 6 also performs processing for improving image quality such as auto iris, auto white balance, and edge enhancement.

  The YUV data converted by the DSP unit 6 is converted to a preset image size by the resolution conversion block 8, and then one frame of data is sequentially stored in the built-in memory 14 (for example, SDRAM). The YUV data for one frame stored in the built-in memory 14 is sent to the display controller 11 where it is converted into a video signal and then displayed as a through image on an LCD (liquid crystal display) 12. The LCD 12 also functions as a notification unit of the present invention at the time of moving image recording described later.

  The YUV data stored in the built-in memory 14 at the time of moving image shooting is sequentially sent to the data compression / decompression block 9 and is encoded after data compression by a codec of a predetermined moving image recording method (for example, Motion-JPEG or MPEG). Are sequentially written in the recording medium 20 as frame data (video data). Such a series of operations is repeatedly executed for each frame, and the compressed data in the built-in memory 14 is sequentially rewritten. That is, stream recording is performed. The frame rate at that time is determined by the timing signal generated by the timing generator 7, and the compression rate of the encoded data is determined by the quantization table value in the data compression / decompression block 9. The memory capacity of the built-in memory 14 is a capacity corresponding to one frame of compressed image data (capacity taking into account the fluctuation range).

  Note that one frame of YUV data stored in the built-in memory 14 at the time of still image shooting is encoded after data compression by the JPEG method or the like in the data compression / decompression block 9 and converted into a file in the built-in memory 14. It is recorded as still image data on the recording medium 20 via the media controller 10. Further, the data compression / decompression block 9 decompresses still image or moving image data read from the recording medium 20 when reproducing a still image or moving image, and expands it in the built-in memory 14 as still image data or frame data.

  The voice processing block 15 converts voice input to the microphone 16 built in the camera body 1 into a digital signal at the time of moving image shooting, and sends it to the built-in memory 14 as audio data after data compression. The audio data sent to the built-in memory 14 is sequentially written to the recording medium 20 as stream data together with the frame data. The audio processing block 15 decodes the audio data sent from the built-in memory 14 and converts it into an analog audio signal, and then outputs the sound from the built-in speaker 17 built in the camera body 1 when reproducing the moving image.

  The key input block 18 includes a plurality of operation keys such as a shutter button, a power key, and a MENU key, and outputs a key input signal corresponding to the key operation by the user to the CPU 13. The shutter button also functions as a recording start / end button for moving image shooting.

  Each block described above is controlled by the CPU 13, and programs and data necessary for the CPU 13 to control each block are stored in the program memory 19. The CPU 13 operates based on the program and the key input signal, thereby functioning as determination means, cancellation means, and adjustment means of the present invention. The program memory 19 includes a rewritable non-volatile memory such as an EEPROM or a flash memory. In addition to the above program and data, the program memory 19 is set by a user and setting data relating to each function, for example, recording quality at the time of video shooting. Setting values (recording parameters such as compression method, compression rate, image size, frame rate) are stored as needed.

  Next, an operation according to the present invention when a moving image is recorded (recorded) in the digital camera having the above configuration will be described. FIG. 2 is a flowchart showing the processing contents executed by the CPU 13 during recording.

  The CPU 13 first initializes a dummy frame counter to be stored in a predetermined area of the built-in memory 14 in accordance with the start of the recording process according to the recording start operation by the user (step SA1). The dummy frame counter is data indicating the number of frames that cannot be recorded (frames dropped) due to the data writing time to the recording medium 20 being longer than the frame rate, among the frame images captured by the CCD 3. In the following description, for the above-described audio data acquired during recording, the data writing time to the recording medium 20 is short compared to the frame data, and is always irrespective of the type of the recording medium 20 and the like. It shall be recordable.

  Next, after the imaging process by the CCD 3 is started (step SA2), the frame cycle timing is waited (step SA3), and it is first checked whether there is data being written on the recording medium 20 at that time. If there is no data being written (NO in step SA4), the value of the dummy frame counter is continuously referred to, and if it is "0" (NO in step SA5), the compressed frame data is directly used as the recording medium. 20 is written (step SA6). Thereafter, if there is no recording end operation and there is free space on the recording medium 20 (NO in step SA7), the process returns to step SA3, and the above processing is repeated after waiting for the next frame cycle timing.

  In the meantime, when any of the frame cycle timings has arrived, if the writing of the data for which the writing process was last started is not completed and there is data being written to the recording medium 20 (in step SA4). YES) Discards the latest compressed frame data in the built-in memory 14 (allows overwriting) (step SA8) and increments one dummy frame counter (step SA9). Further, after displaying a warning message on the LCD 12 by the OSD function indicating that the set recording quality cannot be ensured, for example, “Recording is performed at a reduced frame rate” (step SA10). If there is no recording end operation (NO in step SA7), the process returns to step SA3. It should be noted that the processing of steps SA8 to SA10 is repeated even if the next frame cycle timing has arrived and the writing of the data that has started the last writing processing has not been completed (YES in step SA4). Is called.

  Then, after the processing of steps SA8 to SA10, when the next frame cycle timing has arrived and the writing of the data for which the writing processing was last started is completed (NO in step SA4), the dummy counter is Since it is 1 or more (YES in step SA5), the process proceeds to step SA11, and the dummy frames corresponding to the dummy counter and the latest compressed frame data are written in the recording medium 20 (step SA11). Here, the dummy frame is predetermined data for specifying to hold the display of the previous frame, and the data amount is extremely smaller than the actual frame data. For example, if the moving image format is MPEG-4, frame data “vop_coded = 0” corresponds to this.

  Thereafter, after the dummy frame counter is initialized at this point (step SA12), if there is no recording end operation and there is free space on the recording medium 20 (NO in step SA7), the process returns to step SA3 and continues as described above. The process is repeated, and the recording process is terminated when the recording end operation is performed or when the recording medium 20 is full (YES in step SA7).

  As described above, in the present embodiment, for example, the data writing speed in the recording medium 20 being used is the actual usage environment such as the difference in the free capacity, the area in which the data is recorded, the change in the power supply voltage of the system, etc. When the processing of writing frame data to the recording medium 20 is not in time due to the variation in the size of the frame data under a situation where the processing speed has greatly decreased due to a difference or due to an increase in processing load on the CPU 13, A dummy frame is recorded on the recording medium 20 in place of the actually captured and compressed frame data.

  Therefore, when the writing process of the frame data is not in time, the recording process is performed temporally while maintaining normal moving picture recording by temporarily reducing the apparent frame rate when playing the recorded moving picture. It can be prevented from failing. In other words, the synchronization between the image and the sound is not shifted, and illegal data is not written. Therefore, the upper limit of the recording quality that can be set by the user and the recording quality that is fixedly set can be increased. Therefore, it is possible to record a high-quality moving image for a long time corresponding to the free capacity of the recording medium 20 without being affected by variations in the data writing speed and usage conditions.

  In addition, when the recording medium 20 having a high writing speed is used, the recording with the recording quality set as it is can be performed without any problem.

  Further, in the present embodiment, it is not necessary to provide an area for storing a plurality of frames of compressed frame data in the built-in memory 14, so that the built-in memory 14 can be used effectively for other processing during recording operations. Can do. In addition, whenever a situation occurs in which a dummy frame is recorded on the recording medium 20 during recording, the above-described caution message is displayed on the LCD 12 to indicate that the set recording quality cannot be ensured. It is easy to use. For example, when recording without sound, instead of displaying a caution message, a predetermined alarm sound or voice message may be output from the speaker 17.

  In the present embodiment, the dummy frame to be recorded on the recording medium 20 when the writing process of the frame data on the recording medium 20 is not in time is compressed like frame data of “vop_coded = 0” in MPEG-4. Although the data is much smaller than the subsequent frame data, the dummy frame may be data having the same or similar size as the compressed frame data. For example, when the moving image format is Motion-JPEG, it can be appropriately determined according to the moving image format, such as the immediately preceding frame data, that is, copy data. In the case of copy data, information indicating that is recorded instead of frame data, and after the recording is completed, copying is performed based on the information. Also, if the data size of the dummy frame is made smaller and the writing time of the dummy frame is shortened, the number of dummy frames in the movie is reduced, and the apparent frame rate fluctuation (number of times) during movie playback is reduced. Since it can be suppressed, higher quality recording quality can be secured.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In the present embodiment, in the digital camera having the configuration shown in FIG. 1, the moving image file recorded on the recording medium 20 at the time of recording is an AVI (Audio Video Interleave) file.

  FIG. 3A is a schematic diagram showing a schematic data structure of the AVI file 100 recorded in the present embodiment, and the AVI file 100 includes a mobile chunk 101 and an index chunk 102 which are data bodies. At the same time, the movie chunk 101 is audio data compressed for three image chunks (video 1, video 2, video 3,... In the figure), each of which is compressed frame data (hereinafter referred to as video data). This is composed of one audio chunk (audio 1 in the figure,...), And index information indicating the pointer and size of each image chunk and audio chunk is recorded in the index chunk 102 in the order of recording. At the time of reproducing the moving image, the data of the image chunk and the audio chunk is reproduced according to the arrangement order of the index information of the index chunk 102.

In the present embodiment, the built-in memory 14 has a recording buffer 110 as shown in FIG. 3B for temporarily storing the image chunks and audio chunks. The recording buffer 110 is used as the ring buffer described above, and in this embodiment, the size is a size obtained by adding a margin to the total size of video and audio data for at least 60 seconds. In the following description, the video data has a frame rate = 15 fps, the average data size of one frame = 10 kb, the audio data has a sample rate frequency = 8 kHz, the number of bits per sample = 8 bits, and a channel = It is assumed that the recording buffer 110 is monaural.
It is assumed that [(10 kb × 15) +8000] × 60≈9.25 kb + margin.

  Next, an operation according to the present invention when a moving image is recorded (recorded) in the digital camera having the above configuration will be described. FIG. 4 is a flowchart showing the processing contents executed by the CPU 13 during recording.

  When the CPU 13 starts the recording process in response to the recording start operation by the user, the CPU 13 first stores the AVI file 100 having a provisional temporary header chunk (not shown) and not having the index chunk 102 added thereto as a recording medium. 20 (step SB1). Further, after creating a work index file 120 (see FIG. 5) for storing the index information that is the source of the index chunk 102 added to the AVI file 100 after the recording is finished in a predetermined area of the internal memory 14 ( Step SB2), imaging processing by the CCD 3, and storage of data (image chunks and audio chunks) in the recording buffer 110 described above are started (step SB3).

  Thereafter, every time there is a data write request from the data compression / decompression block 9 or the audio processing block 15 to the recording buffer 110 (YES in step SB4), whether or not the recording buffer 110 is in a buffer full state at that time. Is determined (step SB5). This determination is made according to the following determination criteria. That is, when the data requested to be written is image chunk data, the buffer size is a state in which the size of the data + 1, the average data size of the audio chunk + the free space for the margin does not remain, and the write request is If the existing data is audio chunk data, a buffer full state is defined in which no free space equal to or larger than the size of the data remains. This is to always ensure a free space for one audio chunk in the recording buffer 110.

  Since the recording buffer 110 is not full at the beginning of recording (NO in step SB5), data writing to the recording buffer 110 is permitted as it is (step SB6), and the pointer and size of the written data Is added to the work index file 120 (step SB7). Subsequently, data (first data) that has not yet been written to the AVI file 100 (recording medium 20) stored in the recording buffer 110 is written to the AVI file 100, and the data is read from the recording buffer 110. After erasing (permitting overwriting of the data) (YES in step SB8, step SB9), the process returns to step SB4 and the above operation is repeated. As a result, image chunks and audio chunks for a plurality of frames are stored in the AVI file 100 in the order of recording, and similarly, the index information of these chunks is stored in the work index file 120 in the order of recording.

  Here, the data writing to the recording buffer 110 (and addition of index information) and the data writing to the AVI file 100 (and erasing of the written data from the recording buffer 110) are performed asynchronously, and actually Even before data writing to the AVI file 100 is completed, data writing to the recording buffer 110 is performed at a fixed frame period (15 fps in this embodiment). Therefore, if there is a delay in writing data to the AVI file 100, unwritten data is accumulated in the recording buffer 110.

  FIG. 5A is a diagram illustrating an example of the state, and is a diagram illustrating a state after 60 seconds when the data writing speed to the recording medium 20 is 10 fps. In the present embodiment, since the frame rate is 15 fps, the amount of data written to the AVI file 100 during the storage of three frames of video data in the recording buffer 110 is two frames. Therefore, at the time point after 60 seconds, 2/3 of the data is written into the AVI file 100, the remaining 1/3 of the data remains in the recording buffer 110, and the size thereof is 1/3 of the recording buffer 110. It will be about. The work index file 120 is in a state where index information of all data written to the AVI file 100 is stored.

  On the other hand, if the recording buffer 110 becomes full while the above-described processing is repeated (YES in step SB5), the requested data writing to the recording buffer 110 is restricted (prohibited) ( In step SB10, the same index information as the data written immediately before is added to the work index file 120 (step SB11). In this embodiment, since the buffer full state is performed based on the above-described determination criteria, only the data of the image chunk is limited or discarded in step SB10.

  FIG. 5B is a diagram illustrating an example thereof, and is a diagram illustrating a state after 180 seconds when the data writing speed to the recording medium 20 is 10 fps. After 180 seconds, only 120 seconds of data is written to the AVI file 100, and the remaining data (video 1801 to audio 900 in the figure) is stored in the recording buffer 110. At this point, the recording buffer 110 is already in a buffer full state. Accordingly, when a new data write request is made to the recording buffer 110, the data in the recording buffer 110 remains unchanged, and the index of the previous data (video 2700 in the figure) is stored in the work index file 120. Information will be added again.

  Subsequently, a warning message indicating that the set recording quality cannot be ensured, such as “Recording is performed at a reduced frame rate”, is displayed on the LCD 12 by the OSD function (step SB12). Then, the process proceeds to the above-described step SB8, and thereafter, while data remains in the recording buffer 110 (YES in step SB8), data writing to the AVI file 100 is continued regardless of whether or not the recording end operation is performed ( Step SB9). If there is no more data in the recording buffer 110 and a recording end operation has already been performed (NO in step SB8, YES in step SB13), an index chunk is generated based on the data in the work index file 120 at that time. Then, it is added to the AVI file 100 to complete the AVI file 100 (step SB14), and all the recording processes are completed.

  As described above, in the present embodiment, the writing of data to the recording medium 20 is delayed due to the change in the size of the frame data under a situation in which the speed is greatly reduced due to the cause described above. When a new image chunk cannot be stored in the recording buffer 110 (ring buffer) during recording, index information indicating the previous image chunk is recorded in the index chunk.

  Therefore, when a new image chunk can no longer be stored in the recording buffer 110, normal movie recording is maintained by temporarily reducing the apparent frame rate during playback of the recorded movie. Thus, the recording process can be prevented from failing in time, and the upper limit of the recording quality that can be set by the user and the recording quality that is fixedly set can be increased.

  Therefore, as in the first embodiment, it is possible to record a high-quality moving image for a long time corresponding to the free capacity of the recording medium 20 without being affected by variations in the data writing speed and usage conditions. Can do. In addition, when the recording medium 20 having a high writing speed is used, the recording with the recording quality set as it is can be performed without any problem. Further, when a situation occurs in which a new image chunk cannot be stored in the recording buffer 110 during recording, the above-mentioned caution message is displayed on the LCD 12 each time, and the set recording quality is set. It is possible to inform the user that it has not been secured, and it is easy to use.

  Further, in the present embodiment, a recording buffer 110 for storing image chunks for a plurality of frames is provided in the built-in memory 14 and is used as a ring buffer, for example, from the beginning of recording. Even when the data writing speed to the recording medium 20 is slower than the frame rate, the initial fixed period (60 seconds in the present embodiment) is set as the frame rate at the time of reproduction. A frame rate can be secured. This is also convenient.

  In the present embodiment, the case where the moving image file to be recorded on the recording medium 20 is the AVI file 100 has been described. However, the moving image file format indicates the playback order of each frame data in the compressed frame data. Other types of files may be used as long as index information is attached.

  In addition, when recording a moving image as an AVI file 100 as in the present embodiment or as a file having a format having other index information, the first buffer is not provided in the built-in memory 14. As described in the embodiment, the compressed frame data may be directly written in the recording medium 20. In that case, whether or not there is a delay in data writing to the recording medium 20 may be determined based on the same criteria as in the first embodiment. Note that the place where the above-described work index file 120 and the like are provided is arbitrary, and this is the same in the present embodiment.

  In addition to the above, a configuration corresponding to the recording buffer 110 in the present embodiment is provided in the configuration described in the first embodiment, and whether data writing to the recording medium 20 has occurred. It may be determined based on the same criteria as in the first embodiment.

  In this embodiment, when the recording buffer 110 becomes full, it is determined that there has been a delay in writing data to the recording medium 20, but the recording buffer 110 has a predetermined amount of free space. You may make it judge that the time when it became below is the time when the delay arose. In this way, it is possible to reduce the reduction amount (reduction width) of the frame rate when it is temporarily reduced. That is, normal moving image recording can be performed without abruptly decreasing the frame rate, and higher recording quality can be ensured.

  Further, although the compressed image data (frame data) is sequentially stored in the recording buffer 110, the uncompressed image data may be sequentially stored in the recording buffer 110.

  Further, in the first and second embodiments described above, when the delay occurs, the write data is processed by the process for temporarily reducing the apparent frame rate at the time of reproducing the moving image as described above. Although the amount is reduced, the recording data amount is reduced by changing other recording parameters (compression rate, image size, etc.) other than the frame rate separately from or in parallel with the above processing. It may be.

  In the first and second embodiments, the case where the present invention is applied to a digital camera having a moving image shooting function has been described. However, the present invention is not limited to this, and the present invention is configured to stream-record moving images during recording. Can be employed in various electronic camera devices such as a digital video camera, a mobile phone with a camera, a PDA with a camera, and a personal computer with a camera. Even in that case, the above-described effects can be obtained.

  Furthermore, a moving image that is compressed and recorded in an arbitrary format may be a moving image input from a video input terminal or a broadcast image of an analog television broadcast, for example. In addition, a recording medium for recording a moving image is not limited to a semiconductor memory, and may be a hard disk or the like.

It is a block diagram of a digital camera common to each embodiment of the present invention. It is a flowchart which shows the processing content at the time of the video recording operation | movement in 1st Embodiment. It is a figure which shows 2nd Embodiment, (a) is a schematic diagram which shows an AVI file, (b) is a schematic diagram which shows the buffer for recording. It is a flowchart which shows the processing content at the time of video recording operation | movement in the embodiment. It is a state explanatory view showing a state (a) when the recording buffer is empty during the recording operation and a state (b) when the recording buffer is empty.

Explanation of symbols

1 Camera body 2 Optical system 3 CCD
12 LCD
13 CPU
14 Internal Memory 17 Internal Speaker 18 Key Input Block 19 Program Memory 20 Recording Media 100 AVI File 101 movi Chunk 102 Index Chunk 110 Recording Buffer 120 Work Index File

Claims (10)

In a moving image recording apparatus for sequentially recording image data constituting a moving image on a recording medium while performing image processing at a predetermined frame period,
Determination means for determining whether or not there is a delay that hinders normal recording of moving images in the writing processing of image data after image processing to the recording medium;
A moving image recording apparatus comprising: adjusting means for reducing the amount of data written to the recording medium when the determining means determines that the delay has occurred.   The adjusting means includes a stopping means for stopping the writing process of the image data after the image processing of the next frame on the recording medium when the determining means determines that the delay has occurred. Instead of an image based on image data for which the writing process has been canceled, predetermined information for reproducing an image having the same content as any of the frames before and after the frame of the image data is recorded on the recording medium. The moving image recording apparatus according to claim 1.   The image data after image processing for a plurality of frames recorded on the recording medium is accompanied by index information indicating the reproduction order of each image data, and the adjusting means records the predetermined information as the index information. The moving image recording apparatus according to claim 1, wherein the moving image recording apparatus is recorded on a medium.   The determination means delays the normal recording of moving images when the image data after the previous image processing is being written at the time of writing the image data after the new image processing to the recording medium. 4. The moving image recording apparatus according to claim 1, wherein the moving image recording apparatus determines that the image has occurred.   A buffer for temporarily storing image data after image processing for a plurality of frames to be recorded on the recording medium; and the determination means stores the buffer at the time of writing new image data after image processing to the buffer. 4. The moving image recording apparatus according to claim 1, wherein when the empty size is equal to or smaller than a predetermined size, it is determined that there is a delay that hinders normal recording of moving images.   6. The moving image according to claim 5, wherein the adjusting unit prohibits writing of image data after new image processing to the buffer when the determining unit determines that the delay has occurred. Recording device.   7. The information processing apparatus according to claim 1, further comprising notification means for notifying that the set recording quality is not secured when the determination means determines that the delay has occurred. Video recording device. In a moving image recording method for sequentially recording image data constituting a moving image on a recording medium while performing image processing at a predetermined frame period,
Determining whether or not there is a delay that hinders normal recording of moving images in the writing process of image data after image processing to the recording medium; and
And a process of reducing the amount of data written to the recording medium when it is determined that a delay has occurred. A computer having a moving image recording apparatus for sequentially recording image data constituting a moving image on a recording medium while performing image processing at a predetermined frame period;
Determination means for determining whether or not there is a delay that hinders normal recording of moving images in the writing processing of image data after image processing to the recording medium;
A program for functioning as an adjusting means for reducing the amount of data written to the recording medium when it is determined by the determining means that the delay has occurred. In an electronic camera device having a moving image photographing function for sequentially recording image data constituting a moving image captured by an imaging unit on a detachable recording medium while compressing at a predetermined frame cycle.
Determining means for determining whether or not there is a delay that hinders normal recording of moving images in the writing process of the image data after compression to the recording medium;
When it is determined by the determining means that the delay has occurred in the writing process, the stopping means for stopping the writing process of the image data after compression of the next frame on the recording medium;
Adjustment for recording on the recording medium predetermined information for reproducing an image having the same content as the previous frame of the image data, instead of an image based on the image data for which the writing process has been canceled by the canceling means. An electronic camera device comprising: means.

Images