KR101411902B1 - Apparatus for recording/reproducing moving picture and medium - Google Patents

Abstract

The present invention relates to a moving picture recording apparatus, a moving picture reproducing apparatus, and a recording medium, and a moving picture recording apparatus according to an embodiment of the present invention records moving picture data sequentially outputted frame by frame in an image pickup element as RAW image data An image processing unit for converting the RAW image data into image data capable of MPEG compression coding and an MPEG compression coding unit for performing MPEG compression coding processing on the image data output from the image processing unit to generate MPEG compression coded data, Quality RAW image data can be handled by the universal MPEG compression coded data by associating the address of the RAW image data on the recording medium with the randomly accessible data position of the MPEG compression coded data and recording them on the recording medium.

Moving image, recording, playback, RAW image data

Description

[0001] The present invention relates to a moving picture recording apparatus, a moving picture recoding apparatus,

The present invention relates to a moving picture recording apparatus, a moving picture recoding apparatus, and a recording medium on which a program for implementing the same is recorded.

As described in the prior art, for example, Japanese Patent Application Laid-Open No. 2005-312063, when a plurality of video streams exist, the playback position and the return position of each other are recorded in the user data, Technology is known.

An image pickup apparatus such as a video camera or a camcorder capable of recording a moving image generally performs predetermined image processing on a signal output from an image pickup element such as a CCD and then performs compression processing such as MPEG- DVD or the like. In the still image camera, it is known that the output from the image pickup device is directly recorded as raw (RAW) data.

However, the conventional technique does not disclose a technique of recording a moving image as RAW image data as it is. In addition, when a moving image is recorded as RAW data, it is possible to reproduce a high-quality image. However, since the data size becomes large, there is a problem that the throughput at the time of reproduction increases. Furthermore, since the versatility of RAW data is relatively low, it is difficult to reproduce easily with a versatile apparatus.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving picture recording apparatus, a moving picture reproducing apparatus, and a recording medium storing a program implementing the same, capable of handling RAW image data of high image quality by using general- Media.

According to one aspect of the present invention, there is provided an image pickup apparatus comprising: a recording section for recording moving image data sequentially output in units of frames in an image pickup device onto a recording medium as RAW image data; And an MPEG compression encoding unit for performing MPEG compression encoding processing on the image data output from the image processing unit to generate MPEG compression encoded data, wherein the recording unit records the address of the RAW image data on the recording medium And a data position at which the MPEG compression encoded data is randomly accessible, on the recording medium.

According to the above arrangement, the moving image data sequentially output from the image pickup element on a frame-by-frame basis is recorded on the recording medium as RAW image data, the RAW image data is converted into MPEG compressible image data, And the address of the RAW image data on the recording medium and the randomly accessible data position of the MPEG compression encoded data correspond to each other and recorded on the recording medium. Therefore, RAW data can be used for high-quality reproduction, and MPEG compression-coded data having a small amount of data can be used for real-time display and image retrieval. In addition, since the MPEG compression-coded data is highly versatile, it can be used universally by other apparatuses, and the moving picture can be easily reproduced even when it is reproduced by another apparatus.

The recording unit may record a random access table including a random accessable data position of the MPEG compression coded data on the recording medium. According to the above arrangement, since the random access table including the randomly accessible data position of the MPEG compression encoded data is recorded in the recording medium, the random accessable data position of the MPEG compression encoded data is stored in the address of the RAW image data on the basis of this table .

According to another aspect of the present invention, moving image data output sequentially in frame units in an image pickup device is recorded as RAW image data, and the moving image data is converted into MPEG compression- A data reading unit for reading out the RAW image data and the MPEG compression encoded data from the recording medium in which the MPEG compression encoded data subjected to the MPEG compression encoding process is recorded in correspondence with the RAW image data; There is provided a moving picture reproducing apparatus having a decoding unit and a development processing unit for developing the RAW image data.

According to the above arrangement, moving image data sequentially output in frame units in the image pickup device is recorded as RAW image data, the moving image data is converted into MPEG compressible image data, and the MPEG compression encoded data RAW image data and MPEG compression encoded data are read out from the recorded recording media corresponding to the RAW image data. The MPEG compression encoded data is decoded and the RAW image data is developed. Therefore, both MPEG compressed encoded data and RAW data read from the recording medium can be reproduced.

The data reading unit may extract a random access table including a random accessable data position of the MPEG compression encoded data recorded on the recording medium and read the data based on the random access table. According to the above arrangement, since the data can be read based on the randomly accessible data position in the random access table, the reading of the RAW data and the MPEG compression encoded data can be interlocked.

And a random accessable data position of the MPEG compression encoded data is recorded in correspondence with the address of the RAW image data, and the development processing section may perform the development processing of the RAW moving image data based on the data position. According to the above arrangement, since randomly accessible data positions of MPEG compression encoded data are recorded correspondingly to the addresses of the RAW image data in the recording medium, only the necessary portion of the RAW moving image data is reproduced on the basis of the randomly accessible data positions of the MPEG compression encoded data Development processing can be performed.

According to another aspect of the present invention, there is provided a method of recording moving image data sequentially output in units of frames in an image pickup device onto a recording medium as RAW image data, recording the RAW image data in MPEG compression- Means for generating MPEG compressed encoded data by performing MPEG compression encoding processing on the image data, means for associating the address of the RAW image data on the recording medium with data positions of randomly accessible data of the MPEG compression encoded data, There is provided a recording medium recording a program for causing a computer to function as means for recording on a recording medium.

According to the above arrangement, the moving image data sequentially output from the image pickup element on a frame-by-frame basis is recorded on the recording medium as RAW image data, the RAW image data is converted into MPEG compressible image data, And the address of the RAW image data on the recording medium and the randomly accessible data position of the MPEG compression encoded data correspond to each other and recorded on the recording medium. Therefore, RAW data can be used for high-quality reproduction, and MPEG compression-encoded data having a small amount of data can be used for real-time display and image retrieval. In addition, since the MPEG compression-coded data is highly versatile and can be used universally also in other apparatuses, it is possible to easily reproduce moving pictures even in the case of reproducing from other apparatuses.

According to another aspect of the present invention, moving image data output sequentially in frame units from an image pickup device is recorded as RAW image data, and the moving image data is converted into MPEG compressible image data, Means for reading out the RAW image data and the MPEG compression encoded data from the recording medium in which the MPEG compression encoded data subjected to compression encoding processing is recorded in correspondence with the RAW image data, means for decoding the MPEG compression encoded data, There is provided a recording medium recording a program for causing a computer to function as means for developing image data.

According to the above arrangement, the moving image output sequentially in frame units from the image pickup device is recorded as RAW image data, and the moving image data is converted into MPEG compressible image data, and the MPEG compression encoded data subjected to the MPEG compression encoding process is RAW RAW image data and MPEG compression encoded data are read out from the recorded recording medium corresponding to the image data. Further, the MPEG compression encoded data is decoded and the RAW image data is developed. Therefore, both MPEG compressed encoded data and RAW data read from the recording medium can be reproduced.

According to the present invention, it is possible to provide a moving picture recording apparatus, a moving picture reproducing apparatus, and a recording medium on which a program for implementing the moving picture recording apparatus and the moving picture reproducing apparatus can be handled with high-quality RAW image data by using general-

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, and redundant description will be omitted.

1 is a block diagram showing a configuration of a moving picture recording apparatus 100 according to an embodiment of the present invention. 1, the moving picture recording apparatus 100 has a moving picture recording apparatus 100 for recording moving picture data every frame output from an image pickup element (a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) And a camera signal processing unit 104 to be input. The camera signal processing unit 104 includes an AD converter for A / D converting the input signal.

The digital video signal output from the camera signal processing unit 104 is sent to both the format unit 106 and the development processing unit (B2Y) 108. When the image pickup device is a single plate sensor with a Bayer array, the formatting section 106 arranges the digital data sent from the camera signal processing section 104 in the form of R: G: B = 1: 2: , RAW data is converted into a file in accordance with the recording format of the recording medium. At this time, as will be described later, the random accessable data position sent from the system encoder 118 corresponds to RAW data. The media recording unit 112 records the RAW data sent from the format unit 106 on the recording medium. Examples of the recording medium include optical recording media (CD, DVD, etc.), magneto-optical disks, magnetic disks, semiconductor storage media, and the like.

In the development processing section 108, a series of development processing such as white balance processing, interpolation processing from Bayer arrangement, noise removal, brightness and color correction is performed on the input image data.

The data processed in the development processing unit 108 is sent to the resize unit 114. [ The resize section 114 performs processing for changing the size of the moving image data in accordance with the screen size of the display device, if necessary. The data output from the resize unit 114 is subjected to MPEG compression encoding processing by the MPEG encoder 118. [ The data subjected to the MPEG compression encoding process by the MPEG encoder 118 is sent to the system encoder 118.

The audio signal input unit 122 receives a voice signal from a microphone or the like. The input audio signal is digitized by an AD converter (not shown), then sent to the file unit 110 and filed, and is recorded on the recording medium together with the RAW data by the media recording unit 112. The audio signal is encoded by the audio encoder 124 and sent to the system encoder 118.

Alternatively, the series of processes in the moving picture recording apparatus 100 may be implemented by hardware processing or software processing by a program on a computer.

2 is a schematic diagram showing an example of a random access table used in the MPEG compression encoding process by the MPEG encoder 118, and shows a format widely used for MPEG / AVC called MP4. In the MPEG compression coding process, the positions (frame numbers 120, 188, 232, 298 and 336) of random accessable data called IDR pictures (IDR Picture) in the system stream shown in Fig. 2 are stored as a table. The location of the randomly accessible data is the minimum decodable unit GOPn, GOPn + 1 ... in the GOP (Group Of Picture) structure. . The unit of position of this randomly accessible data is called a sample. In the GOP structure, I (Intra-coded), P (Predictive-coded) and B (Bidirectional predictive-coded) frame types are prepared. The IDR picture is a picture made up of only I-slices or SI slices among I-pictures, and is a randomly accessible picture.

The system encoder 118 sends a random accessable data position to the format unit 106 so as to associate the frame number of the RAW data corresponding to the randomly accessible data position with the address on the recording medium. In the format unit 106, processing is performed to associate the randomly accessible data position with the address of the RAW data on the recording medium.

3 is a schematic diagram showing a state in which address information in RAW data is recorded along a random access table on RAW data. Addresses (2409, 3618, 4881, 6002, and 7390) of RAW data on the recording medium are recorded correspondingly to the randomly accessible data positions. The corresponding data is filed in the file unit 110 and recorded on the recording medium in the media recording unit 112. [ At this time, the data corresponding to the address of the RAW data on the recording medium with respect to the randomly accessible data position is recorded in the header or footer of the RAW data.

Since the link between the randomly accessible data in MPEG and the RAW data is formed in this way, it is easy to compare with the reference data in MPEG at the time of reproduction, so that the image retrieval at the time of development can be performed by a simple process.

The data subjected to the MPEG compression encoding process in the MPEG encoder 118 and the signal encoded in the audio encoder 124 are filed in the file section 120 and recorded on the recording medium together with the random access table. As a result, the RAW data of the moving image and the compression-encoded data of MPEG are recorded on the recording medium.

Next, the recording format in the recording medium will be described. 4 is a schematic diagram showing the recording format of the moving picture recording apparatus 100 on the recording medium. 4 (A) shows one moving image file from the start of recording of the image, that is, from the start of recording to the stop of recording, that is, the stop of recording. 4 (B) shows data for one frame of the record data in Fig. 4 (A).

As shown in Fig. 4 (A), a header is recorded at the head of the recording format. The header includes information on the setting such as language, manufacturer name, setting name, and the like, information about the recording, such as the shooting start date and time, the shooting end date and time, The number of bits of the audio, the number of bits of the audio, the recording format information of the recording medium, and the like of the camera lens, such as the frame rate, the RAW compression mode, the development data compression mode, And general information such as specification data is recorded. Data is recorded for each frame of the image following the header.

The data for each frame consists of a frame header (Frame Header 0, 1, ..., n) and data (F0, F1, ... Fn) for each frame. The frame header includes information about the frame, such as Absolute Frame number, time code, and the like, information about the shooting conditions such as aperture value, focus, ISO sensitivity, electronic shutter, Data, compressed data (development data), RAW data) are recorded. As shown in Fig. 4 (B), the data for each frame is repeated in the order of audio data (Audio), compressed data (compressed image) subjected to MPEG compression encoding, and RAW data (G, B, R) . Then, a footer is recorded following the data of the last frame Fn. The footer records information on all frames, for example, the number of previous frames, the frame header address, and the like, such as importance, scene type, and the like.

In the format shown in FIG. 4, the above-mentioned link with the randomly accessible data in the MPEG is recorded in the header or footer. As a result, RAW data and MPEG compression encoded data can be associated with each other when data is read from the recording medium. Alternatively, the compressed data and the RAW data subjected to the MPEG compression encoding process may be recorded on separate recording media.

The moving image data output from the image pickup element of the camera 102 in the moving image recording apparatus 100 of the present embodiment configured as described above are recorded on the recording medium in both RAW data and MPEG compression encoded data. Therefore, RAW data is read out from the recording medium on which high quality RAW data is recorded and displayed, so that a high quality image can be reproduced as compared with the compressed image data.

On the other hand, since RAW data has a large amount of data, when the data recorded on the recording medium is reproduced, the amount of computation of the CPU is relatively large in reproducing RAW data. Therefore, there may be a problem when it is checked in real time by software on a PC or the like. In this embodiment, since the MPEG compression encoded data is recorded on the recording medium, it is possible to use an MPEG stream for the image search operation and the like. Since the encoding method of the MPEG stream is complicated, in this embodiment, Is stored.

At the time of moving picture reproduction, MPEG decoding refers to a table to search for an IDR picture that can be decoded. Since the address information in the RAW data is recorded on the RAW data in accordance with this table, it is easy to compare the RAW data with the MPEG reference data, so that the image retrieval and the like at the time of development can be performed by a simple process, Only RAW data can be reproduced.

5 is a block diagram showing a configuration of a moving picture reproducing apparatus 200 for reproducing data recorded in the recording apparatus of FIG. 5, the moving picture reproducing apparatus 200 includes a host CPU 202, a media reading unit 204, a table extracting unit 206, a data separating unit 208, an MPEG system decoding An audio signal processor 212, an MPEG audio decoder 214, an MPEG sub-video decoder 216, a format unit 218, a development processor B2Y 220, a resize unit 222, MUXs 224 and 226, an audio output unit 228, and a video output unit 230.

The media reading unit 204 reads data from the recording medium by a command from the host CPU 202. [ The table extracting unit 206 extracts the random access table recorded in the recording medium and sends it to the host CPU 202. [ The host CPU 202 controls reading of data by the media reading unit 204 based on the table sent from the table extracting unit 206. [

The de-multiplexer 208 temporally collects the data read from the media reading unit 204 and sends it to the audio signal processing unit 212, the system decoding unit 210, and the formatting unit 218, respectively. At this time, the separating unit 208 sends the audio data not subjected to the MPEG compression encoding to the audio signal processing unit 212 and sends the RAW data to the de-formatting unit 218. [ The separating unit 208 sends the audio data and the image data subjected to the MPEG compression encoding processing to the system decoding unit 210 together with the system decoding information.

The system decoding section 210 obtains system decoding information as a randomly accessible data position and sends it to the host CPU 202. [ The host CPU 202 controls the reading of data by the media reading unit 204 based on the table sent from the table extracting unit 206 and the system decoding information sent from the system decoding unit 210. This makes it possible to read RAW data and MPEG compression encoded data in association with each other.

The audio signal processing unit 212 performs processing such as DA conversion on the audio signal and sends it to the MUX 224. [ The system decoding unit 210 sends the MPEG audio encoded data to the MPEG audio decoding unit 214. The MPEG audio decoding unit 214 decodes the audio data and sends the decoded audio data to the MUX 224. The MUX 224 selects one of the audio signal input from the audio signal processing unit 212 and the audio signal input from the MPEG audio decoding unit 214 and sends the selected audio signal to the audio output unit 228. The audio output unit 228 outputs a signal sent from the MUX 224 to a speaker or the like.

The system decoding unit 210 also sends the MPEG compression-encoded image data to the MPEG video decoding unit 216. The MPEG video decoding unit 216 decodes the image data and sends the decoded image data to the MUX 226.

The RAW data sent from the separation unit 208 to the format unit 218 is de-formatted by the de-format unit 218 and sent to the development processing unit 220. [ In the development processing section 220, a series of development processing such as white balance processing, interpolation processing from Bayer arrangement, noise removal, brightness and color correction is performed on the input RAW data. The developed data in the development processing unit 220 is sent to the resize unit 222. [ The resize unit 222 performs processing for changing the size of the moving image data in accordance with the screen size of the display device, if necessary. The processing of the development processing unit 220 and the resize unit 222 is performed based on a command sent from the host CPU 202. [ Thus, the development processing section 220 and the resize section 222 can perform development processing and resize according to the randomly accessible frame numbers of the image data subjected to the MPEG compression encoding processing. The signal output from the resize unit 222 is sent to the MUX 226. The MUX 226 selects one of the video signal input from the MPEG video decoding unit 216 and the video signal input from the resize unit 222 and sends the selected video signal to the video output unit 230. The video output unit 230 outputs a signal sent from the MUX 226 to a display device such as an LCD.

Alternatively, the series of processes in the moving picture reproducing apparatus 200 may be processed by hardware or by software processing by a program on a computer.

In the moving picture reproducing apparatus 300 of the present embodiment configured as described above, the host CPU 202 controls the RAW data and the MPEG decoding to cooperate with each other in accordance with the table extracted from the recording medium. Therefore, the MPEG decoded image is output from the video output unit 230 and monitored, and it becomes possible to perform processing such as switching from the time when a desired image is obtained to high-quality reproduction by RAW data.

As described above, according to the embodiment of the present invention, both RAW data and MPEG compression encoded data can be recorded in association with each other. Therefore, RAW data is used for high-quality reproduction, MPEG compression encoded data can be used. In addition, since the MPEG compression-coded data has high versatility and can be used universally also in other apparatuses, it is possible to easily reproduce the moving picture even when it is reproduced by another apparatus. This makes it possible to provide the moving picture recording apparatus 100 and the moving picture reproducing apparatus 200 that are excellent in high picture quality and operability.

Meanwhile, the present invention can be embodied in computer readable code on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also a carrier wave (for example, transmission via the Internet) . In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

While the preferred embodiments of the present invention have been described with reference to the accompanying drawings, it is needless to say that the present invention is not limited to the above examples. It will be understood by those skilled in the art that various changes or modifications can be made within the scope of the claims, and they are obviously also within the technical scope of the present invention.

1 is a block diagram showing a configuration of a moving picture recording apparatus 100 according to an embodiment of the present invention.

2 is a schematic diagram showing an example of a random access table used in the MPEG compression encoding process by the MPEG encoder.

3 is a schematic diagram showing a state in which address information in RAW data is recorded along a random access table on RAW data.

4 is a schematic diagram showing a recording format on a recording medium.

5 is a block diagram showing a configuration of a moving picture reproducing apparatus 200 for reproducing data recorded in the recording apparatus of FIG.

Description of the Related Art

100 moving image recording apparatus

112 media record

106 Format section

116 MPEG Encoder

118 System Encoder

200 moving picture reproducing apparatus

204 Media Readout

214 MPEG audio decoding unit

Claims (7)

A recording unit that records moving image data sequentially output in units of frames from an image pickup device as RAW image data to a recording medium; An image processing unit for converting the RAW image data into image data capable of MPEG compression encoding; And And an MPEG compression encoding unit for performing MPEG compression encoding processing on the image data output from the image processing unit to generate MPEG compression encoded data, Wherein, And records the address of the RAW image data on the recording medium and the randomly accessible data position of the MPEG compression encoded data in association with each other on the recording medium. The method according to claim 1, Wherein, And a random access table including a randomly accessible data position of the MPEG compression encoded data is recorded on the recording medium. The moving image data sequentially output from the image pickup element on a frame-by-frame basis is recorded as RAW image data, the moving image data is converted into MPEG compression-coded image data, and the MPEG compression- A data reading unit reading the RAW image data and the MPEG compression encoded data from the recording medium corresponding to the RAW image data; A decoding unit decoding the MPEG compression encoded data; And And a development processing unit for developing the RAW image data. The method of claim 3, Wherein the data reading unit comprises: Extracts a random access table including a randomly accessible data position of the MPEG compression coded data recorded on the recording medium, and reads the data based on the random access table. The method of claim 3, Wherein the recording medium is associated with a randomly accessible data position of the MPEG compression encoded data in correspondence with an address of the RAW image data, The development processing unit, And the RAW moving image data is developed based on the data position. Means for recording moving image data sequentially output in units of frames from an image pickup device to a recording medium as RAW image data; Means for converting the RAW image data into image data capable of MPEG compression encoding; Means for performing MPEG compression encoding processing on the image data to generate MPEG compression encoded data; And And recording the address of the RAW image data on the recording medium and the randomly accessible data position of the MPEG compression encoded data in association with each other on the recording medium. The moving image data sequentially output from the image pickup element on a frame-by-frame basis is recorded as RAW image data, the moving image data is converted into MPEG compression-coded image data, and the MPEG compression- Means for reading the RAW image data and the MPEG compression-coded data from the recording medium corresponding to the RAW image data; Means for decoding the MPEG compression encoded data; And And a program for causing a computer to function as means for developing the RAW image data.

Images