KR101480406B1 - Recording apparatus, replaying apparatus, recording method, replaying method and program recording medium - Google Patents

Abstract

An image recording apparatus according to the present invention includes: an image processing unit for processing raw image data sequentially output in units of frames from an image pickup device into image data capable of being reproduced to generate processed image data for each frame; An image pickup condition acquiring unit for acquiring image pickup conditions when the still image pickup is performed for sequentially reproducing, for each frame at the time of recording the processed image data; And a medium recording section for sequentially recording photographing conditions of a frame in which image photographing has been performed on a recording medium.

Description

Technical Field The present invention relates to a recording apparatus, a reproducing apparatus, a recording method, a reproducing method, and a program recording medium,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recording apparatus, a playback apparatus, a recording method, a playback method, and a program recording medium. More particularly, , A reproducing apparatus, a recording method, a reproducing method, and a program recording medium.

2. Description of the Related Art Image pickup devices such as video cameras and camcorders capable of recording moving images generally perform predetermined image processing (development processing, image processing) on signals output from respective pixels of an image pickup element such as a CCD, Motion JPEG or the like to generate image data, and image data is recorded on a recording medium such as a flash memory, an HDD, or a DVD.

The image processing includes, for example, white balance control, exposure control, and the like. In addition, in the case of simultaneous shooting of moving images and still images, a process of cutting out a part of the frame for a moving image is performed with respect to the frame in which the still image is shot, and resolution and the like are adjusted to secure continuity for moving image reproduction do.

Japanese Patent Registration No. 3881168 discloses a technique in which moving image data is generated and recorded by decimating the output of an image pickup element at the time of capturing a moving image and compressed and decimated when a still image capturing instruction is given during moving image capturing And video data for moving pictures and still picture data are recorded in association with each other.

Further, in Japanese Patent Application Laid-Open No. 2006-41861, when a still image is photographed during motion picture shooting, the compression coding process of the still picture is performed, and the frame is decimated from the moving picture data, Frame picture data with the image data of the still picture data, and reinforces the still picture data by using the compressed moving picture data at the time of reproduction.

Since the compression processing is generally performed after the image processing, the reproduction quality of the recorded image is lowered compared with the data before the compression processing is performed. Therefore, in an image pickup apparatus such as a digital camera for recording a still image, an output signal of an image pickup element is recorded in the form of raw data (data) without compression processing. However, since an amount of data to be processed is increased in recording in a raw data format in an image pickup apparatus such as a camcorder for recording moving images, a reduced image is often used when an image is saved and developed or when the image is reproduced in an image pickup apparatus.

In the case of recording a still image during moving image shooting, since the reading method from the image pickup device is different between the case of still image and the case of moving image, as described above, Is cut for video reproduction. The position in the still image coinciding with the moving image in such a cutting process differs depending on the type of the imaging device, and also varies depending on the reading mode of the imaging device.

An object of the present invention is to provide a recording apparatus, a playback apparatus, a recording method, a playback method, and a program recording medium that can smooth moving picture playback by using raw image data recorded as a still image during motion picture shooting.

An image recording apparatus according to the present invention includes an image processing unit for processing raw image data sequentially output in units of frames from an image pickup device into image data capable of being reproduced to generate processed image data for each frame, An image pickup condition acquisition section for acquiring image pickup conditions when the still image pickup is performed sequentially for reproduction in frame-by-frame at the time of recording the processed image data, And a medium recording unit for sequentially recording, on a recording medium, the image pickup conditions of the frame-based raw image data, the frame-by-frame processed image data, and the frame in which the still image pickup is performed, Respectively.

In the present invention, the photographing condition may include positional relationship data between the resolution at the time of photographing the still image and the cut position data or the moving image reproduction frame for cutting a part of the area of the original image data in the frame.

The playback apparatus according to the present invention is a playback apparatus for performing frame-by-frame processed image data on the basis of frame-by-frame raw image data and image data in which raw image data is reproducible, and still image shooting A data reading section for reading out at least one of raw image data, image processing data and photographing conditions from a recording medium in which photographing conditions are recorded sequentially for each frame, The difference image data including the difference information of the original image data with respect to the processed image data; and a control unit that, when the original image data is sequentially reproduced frame by frame, the original image data And an image processing unit for performing image processing for moving image reproduction.

A recording method according to the present invention includes a step of processing raw image data sequentially output in frame units from an image pickup element with reproducible image data to generate processed image data on a frame basis, And a step of acquiring, for each frame at the time of recording of the processed image data, the image pickup condition when the still image pickup is performed, in order to reproduce the processed image data in the data readout area from the image pickup device, The difference between the original image data and the original image data, the raw image data on a frame basis, the processed image data on a frame basis, and the shooting conditions of a frame in which still image shooting has been performed are sequentially recorded on a recording medium for each frame .

The reproduction method according to the present invention is a reproduction method in which frame-wise raw image data and frame-wise processed image data obtained by processing raw image data with image data capable of being reproduced and still image data Reading out at least one of raw image data, image processing data and photographing conditions from a recording medium in which photographing conditions at the time of photographing are recorded sequentially for each frame, The image data including the difference information of the raw image data with respect to the processed image data; and a control unit that, when the raw image data is sequentially reproduced for each frame, the raw image data when the still image shooting is performed according to the read- And performing image processing for reproduction.

A computer-readable medium according to the present invention has a function of causing a computer to perform processing of raw image data sequentially output from an image pickup element on a frame-by-frame basis, with reproducible image data to generate processed image data for each frame, A function for acquiring, for each frame, the image pickup condition when the still image pickup is performed, in order to reproduce the raw image data sequentially for each frame, at the time of recording the processed image data, the image pickup condition being set in the data readout area And the difference between the original image data of the frame unit and the processed image data of the frame unit and the shooting conditions of the frame in which the still image shooting is performed are sequentially It is possible to realize the function of recording on the recording medium.

A computer-readable medium according to another aspect of the present invention is a computer-readable medium according to another aspect of the present invention, in which a computer is provided with processing unit for processing frame-by-frame processed image data obtained by processing raw image data in units of frames and image data capable of reproducing raw image data, A recording condition in which a photographing condition when a still image photographing is performed at the time of recording data is recorded sequentially for each frame, the photographing condition being a photographing condition of the original image data for the processed image data in the data reading area from the photographing device A function of reading at least one of the raw image data, the image processing data, and the photographing condition from the image data including the difference information, and the function of reading the original image data sequentially from frame to frame, The original image data at the time of photographing is subjected to image processing for moving image reproduction It is possible to realize the function.

The recording apparatus, the playback apparatus, the recording method, the playback method, and the program according to the present invention as described above can smoothly perform movie playback using raw image data recorded as a still image during movie shooting.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the structure and operation of a recording apparatus, a reproducing apparatus, and the like according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a motion picture recording apparatus 100 according to an embodiment of the present invention. 1, a moving picture recording apparatus 100 according to an embodiment of the present invention will be described.

1, the moving picture recording apparatus 100 includes a camera 102, a camera signal processing unit 104, a format processing unit 110, a development processing unit 120, a size processing unit 122, a JPEG encoder 124 A photographing condition control unit 130, a format processing unit 136, a filing processing unit 140, a media recording unit 150, a microphone 160, a voice signal processing unit 162, and a format processing unit 164.

The moving picture data outputted from the imaging element (a CCD (charge coupled device), a CMOS (complementary metal oxide semiconductor), or the like) of the camera 102 is input to the camera signal processing unit 104 every frame. The camera signal processing unit 104 includes an AD converter for performing AD (analog to digital) conversion on the input signal. The digital video signal output from the camera signal processing unit 104 is input to the format processing unit 110 and the development processing unit 120, respectively.

The format processing unit 110 performs processing for rearranging the digitally converted R, G, and B signals according to the pixel arrangement (e.g., bayer arrangement, three-plate CCD, etc.) of the image pickup element. In addition, the format processing unit 110 performs reversible compression processing in the frame with respect to moving picture data. The image data can be recorded and reproduced without degrading the image quality by the compression processing by the reversible compression method. Examples of the reversible compression scheme include entropy coding using Half Bay coding. In addition, the reversible compression method is not limited to the strict " reversible ". In this manner, in the format processing by the format processing unit 110, compression processing for impairing image quality is not performed in order to maintain image quality as raw image data. On the other hand, since raw image data has a very large file size, it is processed with data having a small redundancy. The moving image data formatted by the format processing unit 110 is input to the filing unit 140 while maintaining the image quality of the raw image data.

The development processing section 120 performs a series of development processing such as white balance processing, interpolation processing from a Bayer arrangement, noise removal, brightness and color correction, on the input image data. The data subjected to the development processing in the development processing section 120 is sent to the size processing section 122. [

The size processing unit 122 performs processing for reducing or enlarging the size of the moving image data. In addition, the size processing section 122 performs processing for changing the resolution for the moving image to the resolution for the still image when the still image is taken during the moving image shooting. The data output from the size processing unit 122 is sent to the JPEG encoder 124.

The size processor 122 may adjust the size of the moving picture data according to the screen size of a display device such as an electronic view finder (EVF) (not shown) or a liquid crystal display (LCD) . The data output from the size processor 122 is sent to the EVF and LCD and displayed on the screen. Accordingly, the user can confirm the image photographed by the camera 102 in real time.

The JPEG encoder 124 performs JPEG compression encoding processing on the input data and sends compressed image data (processed image data) to the filing processing unit 140. [

The photographing condition control unit 130 controls photographing conditions when the moving picture recording apparatus 100 performs photographing. For example, the photographing conditions controlled by the photographing condition control section 130 include switching between still image photographing and moving image photographing, and resolution switching at the time of moving image photographing. The photographing condition control unit 130 controls the camera 102, the camera signal processing unit 104, the format processing unit 110, the development processing unit 120, the size processing unit 122, the JPEG encoder 124, and the format processing unit 164 Shooting conditions are indicated. Each of these parts sets shooting conditions according to the instructions.

The photographing condition control unit 130 sends the photographing condition data to the format processing unit 136. The format processing unit 136 formats the photographing condition data and sends the data to the filing processing unit 140. [ The format processing unit 136, as an example of a photographing condition acquisition unit, acquires, for each frame, photographing conditions necessary for sequentially reproducing the raw image data for each frame when the processed image data is recorded. That is, the format processing unit 136 acquires, for each frame, the shooting conditions set by the shooting condition control unit 130 when the still image shooting is performed. The photographing conditions include resolution at the time of photographing the still image, cutting position data for cutting out a part of the area of the original image data, or positional relationship data with the moving image reproduction frame.

The filing processing unit 140 temporarily stores the raw image data transferred from the format processing unit 110, the compressed image data compressed by the JPEG encoder 124, and the photographing condition data transmitted from the format processing unit 136 . The compressed image data, raw image data, and photographing condition data stored in the filing processing unit 140 are transferred to the media recording unit 150 and recorded on the recording medium in accordance with the recording format of the recording medium. The recording medium may include, for example, an optical recording medium (CD, DVD, etc.), a magneto-optical disk, a magnetic disk, a semiconductor storage medium, and the like.

Further, the microphone 160 acquires the voice of the subject at the same time as capturing the moving picture by the camera 102, and sends the voice to the voice signal processor 162. The audio signal processing unit 162 includes an AD converter for AD-converting the analog signal of the input audio. The digital audio signal output from the audio signal processing unit 162 is transmitted to the format processing unit 164. In the format processing unit 164, audio data is formatted by compression processing such as an uncompressed PCM method, an ADPCM method, an AAC method, an AC3 method, and an MP3 method. The formatted audio data in the format processing unit 164 is input to the filing processing unit 140. [ The filing processing unit 140 temporarily stores the voice data.

Although not shown, the moving picture recording apparatus 100 may include a host CPU. The host CPU controls data transmission to the media recording unit 150 of the filing unit 140 and recording of data to the recording medium of the media recording unit 150. [ The host CPU transmits the compressed image data, raw image data, audio data, and photographing condition data accumulated in the filing processing unit 140 to the media recording unit 150 every predetermined amount (for example, a data amount of one frame) The filing processing unit 140 and the media recording unit 150 are controlled so as to sequentially record on the media. The host CPU records compressed image data, raw image data, audio data, and photographing condition data in a predetermined order on the recording medium.

The series of processes in the moving picture recording apparatus 100 may be processed by hardware, or may be realized by software processing by a program on a computer.

In the moving picture recording apparatus 100 according to the embodiment of the present invention configured as described above, the image digital data output from the image pickup element of the camera 102 and AD-converted is transmitted to the format processing unit 110, And recorded on the recording medium. Since the recording medium records high-quality raw image data as described above, it is possible to reproduce a high-quality image as compared with compressed image data by reading and displaying the raw image data.

On the other hand, since the raw image data has a large amount of data, real-time image display on the EVF and LCD can not be performed as it is with raw image data, and compression processing such as JPEG can not be directly performed. In the moving picture recording apparatus 100 according to the embodiment of the present invention, since the development processing, the reduction processing, and the compression processing of the moving picture data are performed together with the recording of the raw picture data, the EVF and the real- And the photographing can be performed while monitoring the display screen. Further, compressed image data subjected to compression processing together with raw image data is recorded on the recording medium. Therefore, at the time of reproduction, it is possible to search for an image and display a thumbnail image by compressed image data. As a result, high-quality reproduction can be performed by using raw image data for an important portion of the image, and temporary reproduction can be performed by reading compressed image data at high speed for a portion where the importance of the image is relatively low.

Further, the moving picture recording apparatus 100 of the embodiment of the present invention stores raw picture data as it is, and when recording the raw picture data in a compressed image necessary for sequentially reproducing frame by frame, the moving picture recording condition . Since the photographing condition data is recorded on the recording medium together with the raw image data, the photographing condition data can be read and developed when the original image data is developed during reproduction. As a result, the original image data recorded in the still image commercial frame can be subjected to image processing as a frame for moving image reproduction.

Next, the recording format in the recording medium will be described. 2 is a schematic diagram showing a recording format for a recording medium by the moving picture recording apparatus 100. As shown in FIG. For example, assuming that the image pickup device is a single plate of Bayer array, the output data is output in the order of the pixels arranged in Bayer array at a ratio of [R: G: B = 1: 2: 1]. Since the moving picture recording apparatus 100 records without degrading the image quality of the Bayer array data, the format processing unit 110 rearranges the data in the order of RGB, and records the data without compression processing that degrades image quality.

2 (A) shows one moving picture file from the start of recording (start of recording) to the stop of recording (stop of recording). 2 (B) shows data of one frame out of the recording data of Fig. 2 (A).

The Bayer arrangement RGB data is rearranged by the format processing unit 110 and recorded in the data area of the recording medium. Compressed image data encoded by the JPEG encoder 124 and audio data formatted by the format processing unit 164 are also recorded in the data area of the recording medium. As shown in Fig. 2 (A), a header is recorded at the head of the recording format. The header includes information such as the shooting date and time, the information of the image pickup device of the camera 102, the device name of the moving image recording apparatus 100, the number of channels of audio, the number of bits, recording format information of the recording medium, And the like are recorded. Data is recorded for each frame of the image following the header.

The data of one frame is composed of a frame header (frame headers 0, 1, ..., n) and frame data (F0, F1, ..., Fn). As shown in FIG. 2 (B), each frame data is repeatedly recorded in frame units in the order of audio data (Audio), compressed image data (compressed image data), and raw image data (G, do. A footer is recorded following the data of the last frame Fn.

In the frame header of each frame, for example, the data size of audio data, compressed image data, and raw image data of each frame is recorded. In the frame header of each frame, photographing condition data for each frame is recorded.

3 is a schematic view showing an image pickup surface of an image pickup element of the recording apparatus of Fig. An example of reading data for moving image reproduction from raw image data photographed for still image will be described with reference to FIG.

While capturing a moving image using the moving image recording apparatus 100, raw image data of a frame unit is sequentially output from the image pickup element. When a still image is photographed during moving picture shooting, data is output in a format in which a still image commercial frame is inserted between moving image frames. For example, FIG. 3A shows frames sequentially output, where I0 to I4, I6, and I7 are video frames, and I5 is a still image commercial frame.

The size of the still picture commercial frame is generally larger than the size of the frame for moving picture. In addition, the time taken for still image shooting is often longer than the time between one frame of moving image capture, and the time between the still image commercial frame and the moving image frame may be two or more frames for moving image capture.

As described above, the sizes of the still picture-use commercial frame and the moving picture frame are different from each other, and the position at which data is read out from the image pickup element during shooting is different as shown in Fig. 3 (B). That is, during still image shooting, since shooting is performed in an area wider than the moving image shooting area, it is necessary to receive data of the image sensor corresponding to the area outside the moving image shooting area. Thus, by recording the resolution at the time of still image photographing and the positional relationship data between the cut position data and the moving image reproduction frame for cutting a part of the area of the original image data under the photographing conditions, the original image data is developed It is possible to smoothly reproduce the moving image using the recording conditions recorded at the time of playback.

In the example shown in Fig. 3 (B), the coordinates of the upper left end of the frame at the time of capturing the moving image are held, and the coordinates of the upper left end of the frame at the time of capturing the still image are expressed as (X, Y) , And records it as a cutting position. Further, the difference between the moving image frame and the still image common frame may be recorded as photographing conditions. For example, data relating to a frame rate, a resolution, a width of a pixel region, and a positional relationship with a frame for moving picture reproduction may be recorded as photographing conditions.

4 is a block diagram showing a configuration of a moving picture reproducing apparatus 200 according to an embodiment of the present invention. Referring to FIG. 4, a moving picture reproducing apparatus 200 for reproducing moving picture data recorded in the moving picture recording apparatus 100 of FIG. 1 will be described.

4, the moving picture reproducing apparatus 200 includes a host CPU 202, a media reading unit 210, a de-multiplex (demultiplex) unit 212, an image position information extracting unit 220, An audio output unit 232, a JPEG decoding unit 240, an area cutting unit 250, a development processing unit 252, a size processing unit 254, a frame rate conversion unit 256, a MUX A flex 260, and a video output unit 262.

The media reading unit 210 reads data from the recording medium by an instruction from the host CPU 202. [ de-multiplex 212 temporarily collects the data read from the media reading unit 210 and sends it to the audio signal processing unit 230, the JPEG decoding unit 240, and the area cutting unit 250, respectively.

The image position information extracting unit 220 extracts the photographing condition data recorded in the frame header and sends it to the host CPU 202.

The host CPU 202 controls the image processing in the development processing unit 252, the size processing unit 254, or the frame rate conversion unit 256 in accordance with the image pickup condition data transmitted from the image position information extraction unit 220. [ Therefore, in the case where the photographing condition data is read out from the recording medium, the developing process, the size process and the frame rate conversion process are performed in accordance with the read photographing condition data, Frame, and smooth moving picture playback can be performed even when a moving image is reproduced in accordance with raw image data.

The audio signal processing unit 230 reformats the audio data, DA-converts the de-formatted signal, and sends it to the audio output unit 232. The audio output unit 232 outputs the analog-converted audio signal to the outside.

The JPEG decoding unit 240 decodes the compressed image data, reduces or enlarges the decoded image data, and sends the decoded image data to the MUX 260.

The area cutting unit 250 rearranges the raw image data into a Bayer arrangement by Bayer de-formatting, and sends it to the development processing unit 252. [ The area cutting unit 250 calculates a cut amount for moving image reproduction in accordance with the photographing condition data transmitted from the image position information extracting unit 220 via the host CPU 202 and cuts a part of the area of the still image commercial frame Crop processing is performed.

The development processing unit 252 performs a series of development processing such as white balance processing, interpolation processing from a Bayer arrangement, noise removal, brightness, and color correction on the deformed raw image data.

The size processing section 254 performs processing for reducing the size of the original image data subjected to the development processing.

When the time taken for still image photographing is longer than the time taken between one frame of moving image capture, the frame rate converter 256 performs processing such as duplicating two or more frames by adjusting the still image common frame to the moving image capture frame rate, .

The MUX 260 sends the video data transmitted from the JPEG decoding unit 240 or the size processing unit 254 to the video output unit 262. The video output unit 262 DA-converts the transmitted data to output analog signal data to the outside.

The series of processes performed in the moving picture reproducing apparatus 200 may be processed by hardware, or may be realized by software processing by a program on a computer.

The moving picture reproducing apparatus 200 according to an embodiment of the present invention having the above-described structure can perform the developing process and the size process using the photographing condition data recorded in each frame header of the file read out from the media reading unit 210 I do. In general, the position of the still image commercial frame matching the moving image frame is changed by the difference in the image pickup device of the moving image recording apparatus 100 and the difference in the reading mode. However, the moving image reproducing apparatus 200, Can be cut for a moving image frame, so that smooth reproduction of a moving image is possible.

At the time of reproduction of raw image data, raw image data of each of G, B, and R is read out from the recording medium, the data is developed, and raw image data is converted into a video signal. The video signal is reduced to a predetermined image size, and is output to the video output unit 262 in video form. Thus, the moving picture reproducing apparatus 200 can reproduce high-quality pictures.

When compressed image data is reproduced, compressed image data can be reproduced by sequentially reading the compressed image data from the recording medium frame by frame. In this case, the size of the data to be read is much smaller than that of the raw image data. The JPEG decoded video signal is reduced or enlarged to a predetermined image size and output, and reproduction can be performed with light processing compared with the case of reproducing the raw image data. The hardware configuration of the moving picture reproducing apparatus 200 can be greatly simplified by utilizing the simplified reproduction mode based on the compressed image data, thereby greatly reducing the power consumption.

As a special playback mode, JPEG data is also used for the fast playback mode, which enables processing with less load. In this case, only the necessary frames are scanned from the data size information of the audio data, the compressed image data, and the raw image data while the frame header is searched only in accordance with the reproduction speed-up rate, the compressed image data is read out and JPEG decoded is read out. Reproduction in the reverse rotation direction can be easily realized by using the same method.

It is also possible to display a list of shot images in a file as thumbnail images using compressed image data. In this case, for example, an image of one frame may be displayed as a thumbnail image for each of a plurality of moving image files, or each moving image file may be displayed as a thumbnail image by moving images.

As described above, according to the embodiment of the present invention, raw image data and compressed image data can be recorded in association with each other. Therefore, when high-quality reproduction is performed, raw image data is used, The compressed image data having a small amount of data can be used. This makes it possible to provide the moving picture recording apparatus 100 and the moving picture reproducing apparatus 200 that are excellent in operability in high picture quality.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the appended claims.

1 is a block diagram showing a configuration of a motion picture recording apparatus according to an embodiment of the present invention.

2 is a schematic diagram showing a recording format for a recording medium by an image recording apparatus.

3 is a schematic view showing an image pickup surface of an image pickup element of the recording apparatus of Fig.

4 is a block diagram showing a configuration of a moving picture reproducing apparatus according to an embodiment of the present invention.

DESCRIPTION OF THE REFERENCE NUMERALS

100: moving image recording apparatus 220: image position information extracting unit

102: camera 232: audio output unit

104: camera signal processing unit 240: JPEG decoding unit

124: JPEG encoder 250:

130: photographing condition control unit 256: frame rate conversion unit

140: Fileization processing unit 260: MUX

150: Media recording unit 262: Video output unit

160: microphone 120, 252: development processor

200: a moving picture reproducing apparatus 122, 254:

202: Host CPU 162, 230: Audio signal processor

210: media reading unit 110, 136, 164: format processing unit

212: demultiplex

Claims (8)

An image processing unit for processing the raw image data sequentially output from the image pickup element on a frame-by-frame basis with reproducible image data to generate processed image data for each frame; An image pickup condition acquisition section for acquiring image pickup conditions when the still image pickup is performed for each frame at the time of recording the processed image data so as to sequentially reproduce the raw image data frame by frame, The difference information of the raw image data with respect to the processed image data in a data read area; And And a medium recording section for sequentially recording the raw image data on a frame basis, the processed image data on a frame basis, and the photographing conditions of a frame in which the still image photographing is performed, in sequence on a recording medium. The method according to claim 1, Wherein the photographing condition includes positional relationship data between the resolution at the time of photographing the still image and the cut position data or the moving image reproduction frame for cutting a part of the area in the frame of the raw image data. Frame processed image data obtained by performing image processing on raw image data on a frame basis and image data capable of reproducing the raw image data and shooting conditions when still image shooting is performed on recording of the processed image data A data reading unit for reading at least one of the raw image data, the image processing data and the photographing condition from a recording medium sequentially recorded for each frame, The difference information of the raw image data with respect to the complete image data; And And an image processing section for performing image processing for moving image reproduction of the raw image data when the still image shooting is performed according to the read shooting condition when the raw image data is sequentially reproduced frame by frame. The method of claim 3, Wherein the photographing condition includes positional relationship data between the resolution at the time of photographing the still image and the cut position data or the moving image reproduction frame for cutting a part of the area in the frame of the raw image data. Processing the raw image data sequentially output in units of frames from the image pickup device with reproducible image data to generate processed image data for each frame; Acquiring, for each frame, the image pickup condition when the still image pickup is performed so as to sequentially reproduce the raw image data for each frame when recording the processed image data, the image pickup condition being a data read- The difference information of the raw image data with respect to the processed image data, Recording the raw image data on a frame-by-frame basis, the processed image data on a frame basis, and the photographing conditions of a frame in which the still image photographing has been performed, sequentially on a recording medium for each frame. Frame processed image data obtained by performing image processing on raw image data on a frame basis and image data capable of reproducing the raw image data and shooting conditions when still image shooting is performed on recording of the processed image data Reading at least one of the raw image data, the image processing data, and the photographing condition from a recording medium sequentially recorded for each frame, the photographing condition including at least one of Comprising difference information of the raw image data with respect to the data, And performing image processing for moving image reproduction of the raw image data when the still image shooting is performed according to the read shooting condition when the raw image data is sequentially reproduced frame by frame. A function of generating processed image data on a frame-by-frame basis by processing the raw image data output sequentially from the image pickup element on a frame-by-frame basis with reproducible image data; A function of acquiring a shooting condition when still image shooting is performed for each frame at the time of recording the processed image data in order to sequentially reproduce the raw image data frame by frame, The difference information of the raw image data with respect to the processed image data; And And a function of sequentially recording the photographing conditions of the frame in which the still image is photographed on a frame-by-frame basis, on the recording medium, based on the raw image data on a frame basis, the processed image data on a frame basis, Readable medium. A computer-readable storage medium storing a computer-readable program for causing a computer to execute: frame-by-frame processed image data obtained by processing raw image data on a frame basis and image data capable of reproducing the raw image data; A function of reading at least one of the raw image data, the image processing data, and the photographing condition from a recording medium in which photographing conditions are sequentially recorded frame by frame; The difference information of the raw image data with respect to the processed image data; And And a function of performing image processing for moving image reproduction of the raw image data when the still image shooting is performed according to the read shooting condition when the raw image data is sequentially reproduced frame by frame Recorded computer readable medium.

Images