JP2003274357A - Image processor, imaging apparatus, system and method for image processing, storage medium, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus which is free of a decrease in efficiency of encoding of a photographed image even when a subject which moves large is photographed and enables diverse editing with a high degree of freedom for the photographed image. <P>SOLUTION: A first compressing means 109 compresses object image information by an in-frame compression system and a first recording means 110 records the first compressed image information obtained by the first compressing means 109. A second compressing means 111 compresses the first compressed image information recorded by the first recording means 110 by a frame correlative compression system and a second recording means 112 records the second compressed image information obtained by the second compressing means 111. The second compressing means 111 applies compression processing a plurality of number of times to the same image information to be processed. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to, for example, an image processing apparatus and an image pickup apparatus used in an apparatus or system for recording a still image and a moving image in a recording medium such as a flash memory, a hard disk drive, or a removable optical disk. The present invention relates to an image processing system, an image processing method, a computer-readable storage medium storing a program for implementing the same, and the program.

[0002]

2. Description of the Related Art Conventionally, for example, in a digital video camera, a subject light is imaged by an image pickup device, and output data (digital image data) of the image pickup device is recorded as DV (SD).
The mainstream method is to compress the compressed data and record the compressed data on a tape-shaped recording medium.

However, in recent years, as a digital video camera, digital image data output from an image pickup device is compressed by an MPEG method which is an inter-frame correlation compression, and the compressed data is removable such as a phase change optical disk or a magneto-optical disk. What is recorded on disk media has become popular.

The above-mentioned digital video camera using the removable disk medium has a problem in the digital video camera using the tape recording medium, that is, it is difficult to find an arbitrary point due to the trouble of fast-forwarding / rewinding, and the reliability is low due to the entanglement of the tape. It solves the drawbacks such as the risk of overwriting important cuts, and it is easy for the user to use.

[0005]

However, in a conventional image pickup device such as a digital video camera using a removable disk as described above, it takes a long time for the device to recognize the removable disk. I sometimes missed a shooting opportunity when exchanging.

Further, in the MPEG method of the compression codec, data reduction is performed by motion detection. However, since the processing for this is a heavy processing, the real-time property is regarded as the most important in photographing by the image pickup device. In some applications, sufficient motion detection cannot be performed, and when shooting a subject that moves rapidly, the compression efficiency may drop and the image quality may deteriorate.

Further, since the MPEG method is compression of inter-frame correlation, in the case of editing after shooting and recording, in order to process a target cut point, a considerable range including a correlation frame before and after the cut point is processed. Since it had to be expanded, a large-scale system and processing would be required.

Therefore, the present invention has been made in order to eliminate the above-mentioned drawbacks, and the efficiency of encoding the picked-up image does not deteriorate even when a subject having a lot of motion is photographed. An object of the present invention is to provide an image processing device, an imaging device, an image processing system, an image processing method, a computer-readable storage medium storing a program for implementing the same, and the program. Further, the present invention provides an image processing device, an imaging device, an image processing system, an image processing method, and a computer reading out a program for carrying out the same, which enables more diverse and flexible editing of a captured image. The purpose is to provide a possible storage medium and the program.

[0009]

[Means for Solving the Problems] Under such a purpose,
The present invention is an image processing apparatus for compressing and recording target image information, comprising first compression means for compressing target image information by an intra-frame compression method, and first compression means obtained by the first compression means. The first recording means for recording the compressed image information of the
Second compression means for compressing the first compressed image information recorded by the recording means by the frame correlation compression method, and second recording means for the second compressed image information obtained by the second compression means.
The second compression means is characterized in that the second compression means performs compression processing a plurality of times on the same image information to be processed.

The present invention further includes an image pickup means for picking up an image of a subject, a first compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the first image pickup means. Second recording means for recording the first compressed image information obtained by the first compression means, and second compression means for recompressing the first compressed image information recorded by the first recording means by a frame correlation compression method. And a second recording unit for recording the second compressed image information obtained by the second compression unit, wherein the second compression unit has the same processing target. This image information is subjected to compression processing a plurality of times.

The present invention further includes an image pickup means for picking up an image of a subject, a third compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the third aspect. Third recording means for recording the third compressed image information obtained by the third compressing means, and fourth compressing the third compressed image information recorded by the third recording means by the frame correlation compression method. And a fourth recording means for recording the fourth compressed image information obtained by the fourth compressing means, the battery operating integrally with or incorporated in the apparatus, or a predetermined connection. An image pickup apparatus which is operated by a power source externally supplied by a power adapter connected to a terminal, wherein the fourth compression unit and the fourth recording unit are operated by the externally supplied power source. To work only if And butterflies.

The present invention further includes an image pickup means for picking up an image of a subject, a fifth compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the fifth aspect. Fifth recording means for recording the fifth compressed image information obtained by the compression means, and sixth compression means for recompressing the fifth compressed image information recorded by the fifth recording means by a frame correlation compression method. And a sixth recording means for recording the sixth compressed image information obtained by the sixth compressing means, wherein the fifth recording means is a high-definition television. The fifth compressed image information of the standard is recorded, and the sixth recording means records the sixth compressed image information which is a standard television standard by the down-converting means in the sixth compression means. It is characterized by

The present invention further comprises an image pickup means for picking up an image of a subject, a seventh compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the seventh aspect. Seventh recording means for recording the seventh compressed image information obtained by the compression means, and the eighth recording means for recompressing the seventh compressed image information recorded by the seventh recording means by the frame correlation compression method. And an eighth recording means for recording the eighth compressed image information obtained by the eighth compression means, wherein the eighth compression means comprises the eighth compression means. When the recording unit records the eighth compressed image information of the still image, the still image information is not recompressed.

The present invention also includes an image pickup means for picking up an image of a subject, a ninth compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the ninth aspect. (9) recording means for recording the ninth compressed image information obtained by the compressing means, and tenth means for recompressing the ninth compressed image information recorded by the ninth recording means by the frame correlation compression method. And a tenth recording means for recording the tenth compressed image information obtained by the tenth compression means.
Recording means and the first recording means recorded by the tenth recording means.
An image pickup apparatus comprising: an editing unit that edits 0 compressed image information, wherein the editing unit re-compresses the 10th compressed image information to be edited by the 9th compression unit, and then It is characterized in that the tenth compressed image information is edited while being recorded by the ninth recording means.

Further, the present invention is an image processing method for compressing and recording target image information, comprising a first compression step of compressing the target image information by an intraframe compression method,
A first recording step of recording the first compressed image information obtained by the first compression step on a first recording medium, and a frame of the first compressed image information recorded on the first recording medium. The second compression step of compressing by the correlation compression method, and the second recording step of recording the second compressed image information obtained by the second compression step on the second recording medium. The compression step of includes a step of performing compression processing a plurality of times on the same image information to be processed.

The present invention is also a program for causing a computer to function as a predetermined means, wherein the predetermined means is an image pickup means for picking up an image of a subject, and a moving image or a still image output from the image pickup means. First image compression means for compressing the image information by the intra-frame compression method, first recording means for recording the first compressed image information obtained by the first compression means, and the first recording means Second compression means for recompressing the first compressed image information recorded in step 1 by the frame correlation compression method, and second recording means for recording the second compressed image information obtained by the second compression means. And including the second
The compression means is characterized by performing the compression processing a plurality of times on the same image information to be processed.

Further, the present invention is a program for causing a computer to function as a predetermined means, wherein the predetermined means is an image pickup means for picking up an image of a subject, and a moving image or a still image output from the image pickup means. Third image compression means for compressing the image information of the image by the intra-frame compression method;
Third recording means for recording the third compressed image information obtained by the third compressing means, and the third recording means for recording the third compressed image information.
And a fourth recording means for recording the fourth compressed image information obtained by the fourth compressing means. When operating with a battery that operates integrally with or built into the system, or with a power supply externally supplied by a power adapter that is connected with a predetermined connection terminal, the fourth compression unit and the fourth recording unit include: It is characterized in that it operates only when the device or system is operated by the power supplied externally.

Further, the present invention is a program for causing a computer to function as a predetermined means, wherein the predetermined means is an image pickup means for picking up an image of a subject, and a moving image or a still image output from the image pickup means. A fifth compression means for compressing the image information of the image by the intraframe compression method;
Fifth recording means for recording the fifth compressed image information obtained by the compression means, and the fifth recording means recorded by the fifth recording means.
And a sixth recording means for recording the sixth compressed image information obtained by the sixth compression means. The recording means of No. 5 is the above-mentioned No. 5 of the high definition television standard.
The compressed image information is recorded, and the sixth recording means records the sixth compressed image information which is a standard television standard by the down-converting means in the sixth compressing means. .

Further, the present invention is a program for causing a computer to function as a predetermined means, wherein the predetermined means is an image pickup means for picking up an image of a subject, and a moving image or a still image output from the image pickup means. And a seventh compression means for compressing the image information of the image by the intraframe compression method;
Recording means for recording the seventh compressed image information obtained by the compression means, and the seventh recording means recorded by the seventh recording means.
And an eighth recording means for recording the eighth compressed image information obtained by the eighth compression means. The compression means of 8 is the eighth of the still image in the eighth recording means.
When the compressed image information is recorded, the still image information is not recompressed.

The present invention is also a program for causing a computer to function as a predetermined means, wherein the predetermined means is an image pickup means for picking up an image of a subject, and a moving image or a still image output from the image pickup means. And a ninth compressing means for compressing image information of the image by the intraframe compression method;
Ninth recording means for recording the ninth compressed image information obtained by the compressing means, and the ninth recording means recorded by the ninth recording means.
10th compression means for re-compressing the compressed image information of 10) by the frame correlation compression method, 10th recording means for recording the 10th compressed image information obtained by the 10th compression means, and 10th above Editing means for editing the tenth compressed image information recorded by the recording means, wherein the editing means, after the tenth compressed image information to be edited is recompressed by the ninth compressing means, It is characterized in that the tenth compressed image information is edited while being recorded by the ninth recording means.

The present invention is also a program for causing a computer to execute predetermined steps, wherein the predetermined steps include a first compression step of compressing target image information by an intraframe compression method, and the first compression step. The first recording step of recording the first compressed image information obtained by the first compression step on the first recording medium, and the frame correlation compression of the first compressed image information recorded on the first recording medium. A second compression step of compressing by a method, and a second recording step of recording the second compressed image information obtained by the second compression step on a second recording medium. The step is characterized by including a step of performing compression processing a plurality of times on the same image information to be processed.

Further, the present invention is characterized in that the program according to any one of claims 10 to 15 is recorded in a computer-readable storage medium.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

[First Embodiment] The present invention is applied to, for example, a digital video camera 100 as shown in FIG. Digital video camera 100 of the present embodiment
Is an intraframe compression codec 109 for compressing image data of a moving image or a still image obtained by the camera head 101a by an intraframe compression method, and a hard disk drive for recording the compressed image data obtained by the intraframe compression codec 109. 110 and hard disk drive 1
MPEG codec 111 for recompressing the compressed image data recorded in 10 by the frame correlation compression method, and M
A removable disk 112 for recording the compressed image data obtained by the PEG codec 111.
The PEG codec 111 is configured to execute the processing a plurality of times on the same input image. Hereinafter, the configuration and operation of the digital video camera 100 of this embodiment will be specifically described.

<Structure of Digital Video Camera 100>
In FIG. 1, reference numeral 101 is a photographing lens that takes in subject light. Reference numeral 102 denotes an image sensor 10 described later.
3 is a diaphragm that controls the amount of light to the light source 3. 103 is a diaphragm 10
The image pickup device converts the subject light captured in 2 into an image signal. Reference numeral 104 denotes a CDS / AGC that samples and holds the image signal output from the image sensor 103 and outputs a signal having an appropriate signal level.

Reference numeral 105 denotes a digital processing circuit that performs analog / digital (A / D) conversion on the image signal output from the CDS / AGC 104 and digitally processes the digital image data generated by this conversion. 106 is
The image data processed by the digital processing circuit 104 is set to 1
It is a frame memory that stores each frame. 107
Is a pixel number adjustment circuit that adjusts the number of pixels so that the pixels forming the frame image in the frame memory 106 can be recorded by the DV system described later.

Reference numeral 101a denotes the above-mentioned components 101 to 107.
It is a camera head including. 108 is an image bus,
Data is exchanged between the components via the image bus 108.

Reference numeral 109 denotes an intraframe compression codec for compressing / decompressing image data by intraframe processing, and includes a JPEG codec 109a and a DV codec 109b which are hard disk drives built in and fixed to the digital video camera 100. The JPEG codec 109a uses the digital image data supplied via the image bus 108 as JPE as still image data.
The compressed data is compressed by the G method and the compressed data (JPEG compressed data) by the JPEG method recorded in the hard disk drive 110 described later is expanded. The DV codec 109b compresses the digital image data supplied via the image bus 108 as still image data by the DV system, and at the same time, the hard disk drive 1 described later.
The compressed data according to the DV system (DV compressed data) recorded in 10 is expanded.

The reference numeral 111 compresses the digital image data supplied via the image bus 108 as moving image data by the MPEG method by inter-frame correlation, and the compressed data by the MPEG method recorded on the removable disk 112 (MPEG compression). M) to expand the data)
It is a PEG codec. Reference numeral 112 denotes a removable disk that records MPEG compressed data obtained by the MPEG codec and is removable from the main body of the digital video camera 100.

Reference numeral 113 denotes an intra-frame compression codec 109 or MP in the reproduction mode via the image bus 108.
It is a liquid crystal display that displays a reproduced image obtained by decompression by the EG codec 111, and displays a through image obtained by the camera head 101a during shooting. 112
Is a liquid crystal driver for driving the liquid crystal display 113.

Reference numeral 115 is an NTSC encoder for converting the same image as the image displayed on the liquid crystal display 111 into an analog signal and outputting it through the video output terminal 116. Reference numeral 117 sends out the input digital data from the DV terminal 118 onto the image bus 108, and at the same time, the image bus 1
It is an IEEE 1394 interface that outputs digital image data supplied via 08 via a DV terminal 118 to the outside.

Reference numeral 119 has, for example, a microcomputer function, recognizes the operation states of the mode dial 121 and the operation keys 120, and controls the operation mode of the entire digital video camera 100 based on the operation states. It is the main microcomputer.

<Operation Mode and Data Flow of Digital Video Camera 100> FIG.
3 shows the flow of image data in the operation mode determined by.

First, FIG. 2A shows the flow of image data in the "camera mode" when the mode dial 121 is set to "CAMERA".

In the camera mode, the camera head 101a
The image data obtained in step D
It is supplied to the V codec 109b. DV codec 1
09b compresses the image data from the image bus 108 by the DV system and records the DV compressed image data in the hard disk drive 110 again via the image bus 108.

FIG. 2B shows the mode dial 121.
Shows the flow of image data in "hard disk playback mode" when is set to "HDD PLAY".

In the hard disk reproduction mode, the DV compressed image data recorded in the hard disk drive 110 is read out, and the DV compressed image data is supplied to the DV codec 109b via the image bus 108. The DV codec 109b decompresses the DV compressed image data from the image bus 108, and supplies the reproduced image data thus obtained to the liquid crystal driver 114 and the NTSC encoder 115 via the image bus 108 again. The liquid crystal driver 114 displays the reproduced image data from the image bus 108 on the liquid crystal display 113. NTSC
The encoder 115 converts the reproduced image data from the image bus 108 into an analog signal and outputs it as a video signal from the video output terminal 116.

FIG. 2C shows the mode dial 121.
7 shows the flow of image data in the "copy mode" when is set to "COPY". When the user presses the cache copy execution key 120a provided on the operation key 120 in the copy mode, the following copy operation is started.

In the copy operation, the DV compressed image data recorded in the hard disk drive 110 is read, and the compressed image data is supplied to the DV codec 109b via the image bus 108. The DV codec 109b decompresses the compressed image data from the image bus 108, and reproduces the reproduced image data by the decompression image data again.
And is supplied to the MPEG codec 111 via. MPE
The G codec 111 compresses the image data from the image bus 108 by the MPEG method and records the MPEG compressed image data on the removable disk 112 again via the image bus 108.

FIG. 2D shows the mode dial 121.
Shows the flow of image data in the "removable disk playback mode" when is set to "RD PLAY".

In the removable disk reproduction mode, the MPEG compressed image data recorded on the removable disk 112 is read and the compressed image data is supplied to the MPEG codec 111 via the image bus 108. The MPEG codec 111 uses the image bus 10
The compressed image data from 8 is expanded, and the reproduced image data by this is supplied to the liquid crystal driver 114 and the NTSC encoder 115 via the image bus 108 again. The liquid crystal driver 114 displays the reproduced image data from the image bus 108 on the liquid crystal display 113. The NTSC encoder 115 converts the reproduced image data from the image bus 108 into an analog signal and outputs it as a video signal to the video output terminal 1.
Output from 16.

<Structure and Operation of MPEG Codec 111> FIG. 3 shows the internal structure of the MPEG codec 111. Here, the internal configuration of the MPEG codec 111 of FIG. 3 and the operation of the MPEG codec 111 in the copy mode described above will be described.

First, as shown in FIG. 3, the MPEG codec 111 includes a pre-processing unit 301 that performs an appropriate resolution and pixel number conversion process on the input image data from the image bus 108, and the input image data of the input image data. Coding units 315 and 5 that perform coding to generate a bit stream, and a motion vector detection unit 313 that detects a motion amount between frames from the image data processed by the preprocessing unit 301 and supplies the motion amount to the coding unit 315. Includes and.

The encoding unit 315 is used by the motion vector detection unit 3
Based on the motion vector supplied from 13, the bit stream obtained by encoding the image data supplied from the pre-processing device 301 is sent to the image bus 108.

That is, as shown in FIG. 3, in the encoding unit 315, the discrete cosine transform (DCT) unit 304
Performs a discrete cosine transform process on the image data supplied via the adder 303 and supplies the converted image data to the quantizer 305. The quantizer 305 uses D
Quantization processing is performed on the image data from the CT unit 304, and the quantized image data is subjected to variable length coding (VLC).
To the dequantizer 306 and the dequantizer 308.

The inverse quantizer 308 performs inverse quantization processing on the quantized image data from the quantizer 305, and obtains the image data before quantization (image data after DCT) obtained by this inverse DCT. To the container 309. Inverse DCT device 3
09 performs inverse DCT conversion on the DCT image data from the inverse quantizer 308, and supplies the original image data before DCT acquired by this to the adder 310.

The adder 310 adds the image data from the inverse DCT unit 309 and the motion-compensated image data from the motion compensator 312, which will be described later, and supplies the image data as the addition result to the frame memory 311. To do. The frame memory 311 stores the image data from the adder 310 and supplies it to the motion compensator 312. The motion compensator 312 performs motion compensation on the image data from the frame memory 311, supplies the image data after the motion compensation to the adder 310, and also supplies it to the adder 303 via the switch 314.

The VLC unit 306 performs variable length coding processing on the image data from the quantizer 305 and supplies the processed image data to the buffer memory 307. The buffer memory 307 temporarily stores the image data from the VLC unit 306 and then supplies it to the code amount calculator 316.

The code amount calculator 316 uses the buffer memory 3
The code amount of the image data (encoded image data) from 07 is acquired, and the code amount data is supplied to the quantization parameter determiner 317. Quantization parameter determiner 317
Supplies a rate control signal for controlling the quantization rate to the quantizer 305 based on the code amount data (compression control signal) from the code amount calculator 316.

The image data (variable length coded image data) output from the buffer memory 307 is returned to the buffer memory 302.

Here, the frame forming the image data compressed by the MPEG system is composed of an I frame completed within the frame and frame data obtained by subtracting a temporal difference from the I frame in the backward direction. It is composed of three types of frames, a P frame and a B frame which is a frame obtained by temporally subtracting the difference from the P frame.

Further, in the MPEG system, a GOP in which the above-mentioned three types of frames are grouped into a predetermined number of frames
There is a unit called (Group Of Pictures), and the MPEG codec 111 in the present embodiment uses the GO
The processing is performed in units of P as one unit, and the compression operation is performed twice for one GOP.

Specifically, the MPEG codec 111
Examines the degree of compression difficulty in the target GOP in the first compression operation. Compression difficulty is MPE
This shows the tendency of the compression ratio of the compressed data obtained when the compression by the G method is performed under a certain condition. Generally, an image with a high frequency component and a detailed content, or a subject with a rapid movement is photographed. The difficulty level of the image becomes high.

The MPEG codec 111 has a second
In the second compression operation, depending on the distribution of the compression difficulty acquired in the second compression operation, the number of codes is increased by setting the quantization parameter in the frame of high difficulty, and the degree of difficulty is low. In the frame, control is performed so that the number of codes is small, and the compression operation is performed by the control.

Further, the MPEG codec 111 implements the motion detection in the motion vector detector 313 in a wider range to realize a highly accurate motion guarantee.

As described above, the MPEG codec 1
11 secures a constant code amount for each GOP and implements high-efficiency and high-quality encoding.

In the present embodiment, the digital video camera 200 is, for example, configured to operate with electric power supplied from the electric power line from the main body detachable rechargeable battery and the external terminal via the adapter. For example, the copy mode shown in FIG. 2C may be configured to operate only when power is supplied from the power line.

In the digital video camera 100, the JPEG compressed image data (still image data) recorded in the hard disk drive 110 in the above-mentioned camera mode is stored in the removable disk 112 in the copy mode shown in FIG. 2 (c). MPE when copying
It is also possible to adopt a configuration in which only the copy is performed as it is without executing the processing by the G codec 111.

Further, the camera head 101a is compatible with HDTV and has the specifications of the HDTV standard, the DV codec 109b is operated in the HD mode, and the hard disk drive 110 is operated.
Is recorded on the MPEG codec 111 in the copy mode shown in FIG.
The number of pixels may be reduced, MPEG compression may be performed according to the standard TV standard, and recording on the removable disk 112 may be performed.

Further, in the present embodiment, the hard disk drive 110 is used as the recording medium of the DV compressed image data, but the present invention is not limited to this, and for example, a solid memory such as a large capacity semiconductor memory is applied. It is possible.

The MPEG codec 111 and the removable disk 112 are connected to the digital video camera 10.
Configuration different from the main body of 0, for example, a station (stand)
The above configuration may be adopted, and the system configuration may be such that the copy mode shown in FIG. 2C operates when mounted in the station installed at home or the like.

[Second Embodiment] In the present embodiment, in the digital video camera 100 shown in FIG. 1, when the mode dial 121 is set to "EDIT", it is recorded on the hard disk drive 110. The DV compressed image data stored therein and the MPEG compressed image data recorded on the removable disk 112 can be edited in the edit mode.

Here, only the configuration and operation different from those of the first embodiment will be specifically described.

First, FIGS. 4A to 4C show an example of the contents of the hard disk drive 110.

In FIG. 4A, the hard disk drive 1 immediately after the digital video camera 100 performs a moving image shooting operation in the camera mode shown in FIG. 2A.
10 shows a recording state of 10. As shown in FIG. 4A, a captured image (take) of 10 minutes 10 seconds 21 frames is recorded from the start position of the hard disk drive 110. In this state, by setting the digital video camera 100 to the edit mode with the mode dial 121, the photographed image can be edited.

FIG. 4B shows a recording state of the hard disk drive 110 when the above-mentioned take is divided into three by a predetermined operation. FIG. 4 (a) above
As shown in, the take is divided at a point of 5 minutes 30 seconds 23 frames from the start of the hard disk drive 110 and a point of 7 minutes 42 seconds 15 frames from the start, and the take is divided into 5 minutes 30 seconds 23 frames, respectively. A take A having a length, a take B having a length of 2 minutes 11 seconds 22 frames, and a take C having a length of 2 minutes 28 seconds 6 frames are formed.

FIG. 4 (c) is the same as that shown in FIG. 4 (b).
It shows a recording state of the hard disk drive 110 when the takes A, B, and C are rearranged in order of a take B, a take A, and a take C by a predetermined operation.

The edited moving image data completed as described above can be stored in the removable disk 112 as MPEG compressed image data by the same operation as in the copy mode shown in FIG. 2 (c). .

When editing the MPEG compressed image data recorded on the removable disk 112, first, the MPE in which the editing range is specified by the user by a predetermined operation is performed.
The G-compressed image data is decompressed by the MPEG codec 111, transmitted to the image bus 108, and further DV
It is compressed by the DV system by the codec 109 and recorded in the hard disk drive 110.

After that, the same editing as in the case of the image editing on the hard disk drive 110 is performed, and the edited image data is re-recorded on the removable disk in the same manner as the copy mode shown in FIG. 2C, for example. 11
2 is recorded as MPEG compressed image data.

According to the present embodiment as described above, since the image (moving image) data to be edited is DV compressed image data in which all frames are I frames, it is possible to easily cut and paste in frame units. Therefore, it becomes possible to specify the edit point by a predetermined operation at any place in units of one frame.

In the present embodiment, the hard disk drive 110 is used as the recording medium for the DV compressed image data, but the present invention is not limited to this, and for example, a solid memory such as a large capacity semiconductor memory can be applied. Is.

The MPEG codec 111 and the removable disk 112 are connected to the digital video camera 10.
Configuration different from the main body of 0, for example, a station (stand)
The above configuration may be adopted, and the system configuration may be such that the copy mode shown in FIG. 2C operates when mounted in the station installed at home or the like.

Further, an object of the present invention is to supply a storage medium storing a program code of software for realizing the functions of the host and the terminal of the first and second embodiments to a system or an apparatus, and the system or the apparatus. It is needless to say that it is also achieved by the computer (or CPU or MPU) of the device reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the first and second embodiments, and the storage medium storing the program code and the program code constitute the present invention. Becomes A ROM, flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, non-volatile memory card, or the like can be used as a storage medium for supplying the program code. Further, by executing the program code read by the computer, not only the functions of the first and second embodiments are realized, but also based on the instruction of the program code,
Needless to say, this also includes the case where the OS or the like running on the computer performs a part or all of the actual processing, and the processing realizes the functions of the first and second embodiments. Further, after the program code read from the storage medium is written in the memory provided in the extended function board inserted in the computer or the extended function unit connected to the computer, the extended function is executed based on the instruction of the program code. The CPU provided on the board or function expansion unit performs some or all of the actual processing,
It goes without saying that the processing includes the case where the functions of the first and second embodiments are realized.

FIG. 5 shows the function 600 of the computer. As shown in FIG. 5, the computer function 600 includes a CPU 601, a ROM 602, and an R
AM 603, keyboard controller (KBC) 605 of keyboard (KB) 609, and CR as a display unit
T-display (CRT) 610 CRT controller (CRTC) 606 and hard disk (HD) 611
A disk controller (DKC) 607 of the flexible disk (FD) 612 and a network interface controller (NIC) 608 for connecting to the network 620 are connected to each other via a system bus 604 so that they can communicate with each other. .

The CPU 601 is a ROM 602 or HD.
By executing the software stored in 611 or the software supplied from FD612, each component connected to the system bus 604 is comprehensively controlled.
That is, the CPU 601 executes the processing program according to the predetermined processing sequence in the ROM 602 or the HD 61.
1 or by reading from FD612 and executing,
Control for realizing the operation in the first and second embodiments is performed.

The RAM 603 functions as the main memory or work area of the CPU 601. KBC605
Controls instruction input from the KB 609 or a pointing device (not shown). CRTC606 is C
It controls the display of the RT 610. The DKC607 is a boot program, various applications, edit files,
It controls access to the HD 611 and the FD 612 that store a user file, a network management program, and a predetermined processing program according to the present embodiment. N
The IC 608 bidirectionally exchanges data with a device or system on the network 620.

[0078]

As described above, according to the present invention, the target image information is compressed by the intra-frame compression method, the first compressed image information by the compression is recorded on the first recording medium, and the first compression is performed. When the image information is compressed by the frame correlation compression method and the second compressed image information by the compression is recorded in the second recording unit, the compression processing by the frame correlation compression method (MPEG method or the like) is performed by the same processing target image. Configured to run multiple times on the information.

As a result, for example, in a GOP group forming image data obtained by compression by the MPEG method as a frame correlation compression method, compression for estimating the code amount and actual compression are performed for the same GOP. Since it is possible to perform the compression processing at least twice, even if the image to be processed is an image obtained by shooting a subject having a lot of movement, the encoding efficiency does not decrease and the good compression is performed. And record.

Further, since the editing process of the target image can be performed on the compressed image recorded on the recording medium (first recording medium) and all the frames are in-frame compression, the target image ( More diverse and flexible editing can be performed on captured images, etc.).

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a digital video camera to which the present invention has been applied in a first embodiment.

FIG. 2 is a diagram for explaining an operation mode of the digital video camera.

FIG. 3 is a block diagram showing a configuration of an MPEG codec of the digital video camera.

FIG. 4 is a diagram for explaining an example of an editing process in the digital video camera in the second embodiment.

FIG. 5 is a block diagram showing a configuration of a computer that reads a program for causing a computer to realize the functions of the digital video camera from a computer-readable storage medium and executes the program.

[Explanation of symbols]

100 digital video camera 101 shooting lens 101a camera head 102 aperture 103 image sensor 104 CDS / AGC 105 Digital processing circuit 106 frame memory 107 pixel number adjustment circuit 108 image bus 109 In-frame compression codec 109a JPEG codec 109b DV codec 110 hard disk drive 111 MPEG codec 112 removable disk 113 LCD display 114 LCD driver 115 NTSC encoder 116 video output 117 IEEE 1394 interface 118 DV terminal 119 Main microcomputer 120 operation keys 120a cache copy execution key 121 Mode dial 301 Pre-processing unit 302 buffer memory 303 adder 304 DCT device 305 quantizer 306 VLC device 307 buffer memory 308 Dequantizer 309 Inverse DCT device 310 adder 311 frame memory 312 Motion Compensator 313 Motion vector detector 314 Changeover switch 315 Encoding unit 316 Code amount calculator 317 Quantization parameter determiner

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 7/24 H04N 5/91 NF term (reference) 5C052 AA02 AB04 CC11 DD02 EE02 EE03 5C053 FA07 FA14 FA17 FA23 GB05 GB36 GB37 KA24 KA25 LA01 5C059 KK27 MA01 MA23 MC11 ME01 PP01 PP04 SS14 TA46 TB03 TC10 TC12 TC25 UA02 UA39 5D044 AB07 DE02 DE15 DE43 GK08

Claims (16)

[Claims] 1. An image processing apparatus for compressing and recording target image information, comprising: first compression means for compressing target image information by an intraframe compression method; and first compression means obtained by the first compression means. First recording means for recording the first compressed image information, second compression means for compressing the first compressed image information recorded by the first recording means by a frame correlation compression method, and the second recording means. A second recording means for recording the second compressed image information obtained by the compression means, wherein the second compression means performs the compression process a plurality of times on the same image information to be processed. Image processing device. 2. An image pickup means for picking up an image of a subject, a first compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the first compression means. First recording means for recording the obtained first compressed image information, and second compression means for recompressing the first compressed image information recorded by the first recording means by a frame correlation compression method. And a second recording unit that records the second compressed image information obtained by the second compressing unit, wherein the second compressing unit converts the image information of the same object to be processed. On the other hand, an image pickup apparatus characterized by performing compression processing a plurality of times. 3. An image pickup means for picking up a subject, a third compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the third compression means. Third recording means for recording the obtained third compressed image information, and fourth compression means for recompressing the third compressed image information recorded by the third recording means by a frame correlation compression method. A fourth recording means for recording the fourth compressed image information obtained by the fourth compressing means, which is connected to a battery which operates integrally with or built in the apparatus, or a predetermined connection terminal. An image pickup apparatus which is operated by a power source externally supplied by a power adapter, wherein the fourth compression means and the fourth recording means are provided only when the apparatus is operated by the externally supplied power source. Shooting characterized by working Image device. 4. An image pickup unit for picking up an image of a subject, a fifth compression unit for compressing image information of a moving image or a still image output from the image pickup unit by an intraframe compression method, and the fifth compression unit. Fifth recording means for recording the obtained fifth compressed image information, and sixth compression means for recompressing the fifth compressed image information recorded by the fifth recording means by a frame correlation compression method. And a sixth recording unit for recording the sixth compressed image information obtained by the sixth compression unit, wherein the fifth recording unit is the high definition television standard. 5, wherein the sixth recording means records the sixth compressed image information which is a standard television standard by the down-conversion means in the sixth compression means. Image pickup device. 5. An image pickup device for picking up an image of a subject, a seventh compression device for compressing image information of a moving image or a still image output from the image pickup device by an intraframe compression method, and the seventh compression device. Seventh recording means for recording the obtained seventh compressed image information, and eighth compression means for recompressing the seventh compressed image information recorded by the seventh recording means by a frame correlation compression method. And an eighth recording unit for recording the eighth compressed image information obtained by the eighth compressing unit, wherein the eighth compressing unit is stationary by the eighth recording unit. When the eighth compressed image information of an image is recorded, the still image information is not recompressed. 6. An image pickup means for picking up an image of a subject, a ninth compression means for compressing image information of a moving image or a still image output from the image pickup means by an intraframe compression method, and the ninth compression means. Ninth recording means for recording the obtained ninth compressed image information, and tenth compression means for recompressing the ninth compressed image information recorded by the ninth recording means by a frame correlation compression method. A tenth recording means for recording the tenth compressed image information obtained by the tenth compression means, and an editing means for editing the tenth compressed image information recorded by the tenth recording means. An image pickup apparatus comprising: the editing means, wherein the tenth compressed image information to be edited is
After being recompressed by the ninth compression means, the ninth compression means
An image pickup apparatus, characterized in that the tenth compressed image information is edited while being recorded by the recording means. 7. An image processing system in which a plurality of devices are communicably connected to each other, wherein at least one device of the plurality of devices is the image processing device according to claim 1. 7. An image processing system having the function of the image pickup device according to any one of 6 above. 8. An image processing method for compressing and recording target image information, comprising: a first compression step of compressing the target image information by an intraframe compression method; and a first compression step obtained by the first compression step. A first recording step of recording the first compressed image information on the first recording medium, and a second recording step of compressing the first compressed image information recorded on the first recording medium by a frame correlation compression method. A compression step and a second recording step of recording the second compressed image information obtained by the second compression step on a second recording medium, wherein the second compression step is the same processing target. An image processing method comprising a step of performing compression processing on image information a plurality of times. 9. The image processing method according to claim 8, further comprising a photographing step of photographing a subject and acquiring a photographed image of the subject as target image information. 10. A program for causing a computer to function as a predetermined means, wherein the predetermined means includes an image pickup means for picking up an image of a subject and image information of a moving image or a still image output from the image pickup means. First compression means for compressing by the intraframe compression method, first recording means for recording the first compressed image information obtained by the first compression means, and recorded by the first recording means A second compression means for recompressing the first compressed image information by a frame correlation compression method, and a second recording means for recording the second compressed image information obtained by the second compression means, A program characterized in that the second compression means performs compression processing a plurality of times on the same image information to be processed. 11. A program for causing a computer to function as a predetermined means, wherein the predetermined means includes image pickup means for picking up an image of a subject and image information of a moving image or a still image output from the image pickup means. Third compression means for compressing by the intra-frame compression method, third recording means for recording the third compressed image information obtained by the third compression means, and third recording means for recording. A fourth compression means for recompressing the third compressed image information by a frame correlation compression method, and a fourth recording means for recording the fourth compressed image information obtained by the fourth compression means, When operating with a battery that operates integrally with or built in the device or system, or a power supply externally supplied by a power adapter connected through a predetermined connection terminal, the fourth compression means and the fourth recording device. Stage program characterized by operating only when the external supplied device or system by the power supply is operating. 12. A program for causing a computer to function as a predetermined means, wherein the predetermined means includes image pickup means for picking up an image of a subject and image information of a moving image or a still image output from the image pickup means. Fifth compression means for compressing by the intraframe compression method, fifth recording means for recording the fifth compressed image information obtained by the fifth compression means, and the fifth recording means for recording. A sixth compression means for recompressing the fifth compressed image information by a frame correlation compression method, and a sixth recording means for recording the sixth compressed image information obtained by the sixth compression means, The fifth recording means records the fifth compressed image information of the high-definition television standard, and the sixth recording means uses the down conversion means in the sixth compression means to obtain the standard television standard. On A program characterized by recording a sixth compressed image information. 13. A program for causing a computer to function as a predetermined means, wherein the predetermined means includes image pickup means for picking up an image of a subject and image information of a moving image or a still image output from the image pickup means. Seventh compression means for compressing by the intra-frame compression method, a seventh recording means for recording the seventh compressed image information obtained by the seventh compression means, and a seventh recording means for recording. An eighth compression means for recompressing the seventh compressed image information by a frame correlation compression method, and an eighth recording means for recording the eighth compressed image information obtained by the eighth compression means, The eighth compression means does not recompress the still image information when the eighth compressed image information of the still image is recorded by the eighth recording means. 14. A program for causing a computer to function as a predetermined means, wherein the predetermined means includes image pickup means for picking up an image of a subject and image information of a moving image or a still image output from the image pickup means. Ninth compression means for compressing by the intra-frame compression method, ninth recording means for recording the ninth compressed image information obtained by the ninth compression means, and the ninth recording means. A tenth compression means for recompressing the ninth compressed image information by a frame correlation compression method; a tenth recording means for recording the tenth compressed image information obtained by the tenth compression means; Editing means for editing the tenth compressed image information recorded by the ten recording means, wherein the tenth compressed image information to be edited is
After being recompressed by the ninth compression means, the ninth compression means
A program for performing editing of the tenth compressed image information in a state recorded by the recording unit. 15. A program for causing a computer to execute a predetermined step, wherein the predetermined step includes a first compression step of compressing target image information by an intraframe compression method, and the first compression step. A first recording step of recording the first compressed image information obtained by the method on a first recording medium, and compressing the first compressed image information recorded on the first recording medium by a frame correlation compression method. The second compression step includes a second recording step of recording the second compressed image information obtained by the second compression step on a second recording medium, and the second compression step is the same. A program including the step of subjecting the processing target image information of (1) to a plurality of times of compression processing. 16. A computer-readable storage medium having the program according to any one of claims 10 to 15 recorded therein.