JP2011049927A - Image processing device, and imaging apparatus with the same mounted thereon - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To simultaneously generate a plurality of coded data items in accordance with the purpose of use. <P>SOLUTION: A converter 200 performs conversion so as to reduce image quality of a moving image constituted of HD-size frame images, to produce a moving image constituted of SD-size frame images. An encoder 202 performs inter-frame prediction coding on the moving image constituted of the frame image in HD size to produce first image-quality coded data, and the coder 202 performs intra-frame prediction coding on the moving image constituted of the SD-size frame image to produce second image-quality coded data. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing apparatus for encoding a moving image and an imaging apparatus using the same.

  In recent years, digital movie cameras capable of shooting moving images have become widespread. Digital movie cameras have been improved in image quality year by year, and those corresponding to full HD (High Definiton) (1920 × 1080 pixels) image quality have been put into practical use. A moving image captured by such a digital movie camera is used for various purposes. For example, it is viewed on a television or PC (Personal Computer) or uploaded to a video sharing site.

  In Patent Document 1, an image captured by a digital camera is uploaded to a server as it is.

JP 2006-252152 A

  A moving image captured with full HD image quality has high image quality and is suitable for viewing on a high-definition television. However, since the encoded data of a moving image captured with full HD image quality has a large capacity, the time required for uploading becomes long. Also, many video sharing sites may impose a capacity limit on the uploaded data, and encoded data of moving images captured with full HD image quality must be uploaded to the video sharing site. It is not suitable.

  Therefore, when uploading encoded data of a moving image captured with full HD image quality to a video sharing site, the encoded image data with high image quality suitable for viewing is converted into encoded data with low image quality suitable for upload. , It is necessary to reduce its capacity. Such conversion processing increases the burden on the user.

  The present invention has been made in view of such a situation, and an object of the present invention is to provide an image processing apparatus capable of simultaneously generating a plurality of encoded data according to applications and an imaging apparatus equipped with the image processing apparatus. .

  One embodiment of the present invention is an image processing apparatus. The image processing apparatus includes: a conversion unit that converts the first moving image into a second moving image having a lower quality than the first moving image; and the first moving image is subjected to inter-frame predictive coding to perform first encoding. And an encoding unit that generates image quality encoded data and generates second image quality encoded data by performing intra-frame predictive encoding on the second moving image.

  In addition, it is preferable that the image processing apparatus further includes a control unit that generates related information that associates the first image quality encoded data with the second image quality encoded data.

  In addition, when generating the thumbnail information for the first image quality encoded data, the control unit preferably generates the thumbnail information from the second image quality encoded data with reference to the related information.

  When the control unit is instructed to edit the first image quality encoded data, the control unit sets the second image quality encoded data as an object of the edit operation, and responds to the edit operation on the second image quality encoded data. It is preferable that the edited content is recorded, the related information is referred to, and the edited content is reflected on the first image quality encoded data.

  The image processing apparatus further includes a decoding unit that decodes the first image quality encoded data and the second image quality encoded data, and the control unit performs special reproduction processing on the first image quality encoded data. When instructed, it is preferable to control the decoding unit so as to execute the special reproduction process on the second image quality encoded data with reference to the related information.

  According to the present invention, it is possible to simultaneously generate a plurality of encoded data according to the application.

The figure explaining inter-frame prediction coding 1 is a conceptual diagram illustrating a configuration of an imaging device 1 according to an embodiment of the present invention. Flow chart showing the procedure of recording operation Flow chart showing the editing procedure Flow chart showing the procedure of playback operation

  The outline will be described before the present invention is specifically described. An image processing apparatus according to an embodiment of the present invention is an MPEG series standard (MPEG-1, MPEG-2 and MPEG-4) or H.264. Compressive encoding conforming to the H.264 series standards (H.264 / AVC and H.264 / SVC) is performed.

  In the MPEG series standard, an I (Intra) frame is an image frame for intra-frame predictive encoding, P (Predictive) is an image frame for inter-frame predictive encoding with a past frame as a reference image, and past and future. An image frame that performs bidirectional inter-frame predictive coding using the above frame as a reference image is referred to as a B (Bi-directional prediction) frame.

  On the other hand, H. In the H.264 series standard, the frames that can be used as the reference image may be the past two frames as the reference image regardless of the time, and the future two frames may be the reference images. Further, three or more frames can be used as the reference image regardless of the number of frames that can be used as the reference image. Therefore, H.H. In the H.264 series standard, the B frame does not matter before and after the time of the reference image, and thus refers to a bi-predictive prediction (Bi-predictive prediction) frame.

  FIG. 1 is a diagram for explaining interframe predictive coding according to the MPEG series standard. In FIG. 1, a moving image to be encoded is shown in FIG. 1 (a), and encoded data generated using inter-frame prediction is shown in FIG. 1 (b). In FIG. 1, an arrow represents a reference relationship between frames, and a frame to which the end of the arrow refers is referred to and a frame to which the end refers. For example, frame # 3 is encoded as a B frame with reference to frame # 2 and frame # 5.

  Here, considering decoding of the encoded data shown in FIG. 1B, the referenced frame needs to be decoded when the referenced frame is decoded. For example, in order to decode frame # 3, frame # 2 and frame # 5 need to be decoded.

  For this reason, in order to specially reproduce a frame that has undergone interframe prediction encoding, it is necessary to decode in advance the frame that the frame refers to. For example, in the case where quad-rate reproduction is performed on the encoded data shown in FIG. 1B with frame # 1, frame # 4, frame # 7, and frame # 10, a frame that is referred to when decoding these frames # 1, frame # 5, frame # 8, frame # 11, etc. must be decoded as necessary. As described above, when special reproduction is performed on the inter-frame encoded data, the decoding process becomes complicated.

  Also, care must be taken when a frame subjected to interframe predictive coding is to be edited. For example, it is assumed that editing that combines frame # 3 and frame # 9 is performed on the encoded data shown in FIG. In order to realize a visual and easy-to-understand editing operation, it is conceivable to display a time axis scale on the editing screen and arrange frames # 3 and # 9 as index images along the time axis scale. However, in order to display frame # 3 and frame # 9 as index images, frame # 2, frame # 5, frame # 8, and frame # 11 referenced when decoding these frames are decoded as necessary. I have to keep it. Also, the editing content that combines frame # 3 and frame # 9 can be represented by, for example, jump playback from frame # 3 to frame # 9. Therefore, it is conceivable to confirm the edited content by performing jump playback from frame # 3 to frame # 9 before the edited content is reflected in the actual encoded data. Also in this case, it is necessary to decode the frame # 2, the frame # 5, the frame # 8, and the frame # 11 that are referred to when jump-reproducing these frames as necessary. As described above, if an attempt is made to realize a visually easy-to-understand editing operation for inter-frame encoded data, the processing becomes complicated.

  Furthermore, care must be taken when generating thumbnail information from a frame that has undergone interframe prediction encoding. For example, when moving image thumbnail information composed of frames # 3 to # 9 is created for the encoded data shown in FIG. 1B, frame # 3 is decoded into the moving image thumbnail information. Since the frame # 2 and the frame # 5 to be referred to at the time are not included, it is impossible to correctly decode the frame # 3 with the moving image thumbnail information alone. The same applies when still image thumbnail information is created from frame # 3.

  As described above, when inter-frame predictive encoding is performed, complicated processing is required in order to normally realize editing and special reproduction. However, inter-frame predictive coding can increase the compression rate by utilizing the temporal correlation of moving images, so it is suitable for compressing large-capacity, high-quality ornamental moving images such as full HD images. It can be said that it is a compression method.

  On the other hand, when intra-frame predictive encoding is performed, the temporal correlation of moving images is not used, so the compression rate cannot be increased as much as inter-frame predictive encoding, but since the encoding process is completed within the frame, editing is completed. Special reproduction can be realized with simple processing.

  In addition, since a low-quality upload moving image originally has a small capacity and does not require a high compression rate, intraframe predictive coding is suitable for compressing an upload moving image.

  Therefore, the image processing apparatus according to the embodiment of the present invention converts the image quality of a large-capacity and high-quality moving image for viewing, and generates a small-capacity and low-quality moving image for uploading. Then, an ornamental moving image is inter-frame predictively encoded to generate ornamental moving image encoded data, and an upload moving image is intra-frame predictively encoded to generate upload moving image encoded data. .

  As a result, a large-capacity, high-quality moving image for viewing can be reduced in the encoded data capacity by giving priority to the compression rate. In addition, a small-capacity, low-quality moving image for upload becomes encoded data suitable for editing and special reproduction. Therefore, the user can use two types of encoded data properly according to the application, and the convenience for the user can be improved.

  FIG. 1 is a conceptual diagram illustrating a configuration of an imaging apparatus 1 according to an embodiment of the present invention. The imaging device 1 includes an imaging unit 10, an image processing device 20, an operation unit 30 and a display unit 40.

  The imaging unit 10 acquires a moving image and supplies it to the image processing device 20. The imaging unit 10 is a solid-state imaging device such as a CCD (Charge Coupled Devices) sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or a signal processing unit that changes an analog three primary color signal from the solid-state imaging device to a digital luminance signal and a color difference signal. including.

  The image processing apparatus 20 uses a moving image acquired from the imaging unit 10 as an MPEG series standard or H.264 standard. According to the H.264 / AVC standard, encoded data is generated by compression encoding.

  The operation unit 30 is, for example, an operation button or the like, receives a user instruction, generates a control signal based on the instruction, and outputs the control signal to the image processing apparatus 20.

  The display unit 40 is, for example, a liquid crystal display, and displays a moving image being captured, a moving image decoded by the image processing device 20, and various setting screens and various status information.

  The image processing apparatus 20 includes a conversion unit 200, an encoding unit 202, a multiplexing unit 204, a recording unit 206, an input / output unit 208, a decoding unit 210, a display image generation unit 212, and a control unit 214. The encoding unit 202 includes a first encoding unit 2020 and a second encoding unit 2022.

  The conversion unit 200 converts the image quality of the first moving image input from the imaging unit 10, generates a second moving image having a lower image quality than the first moving image, and outputs the second moving image to the encoding unit 202.

  When converting the resolution, the conversion unit 200 reduces the resolution of the frame image included in the first moving image. The conversion unit 200 may reduce the resolution by extracting the central region of the frame image and deleting the peripheral region, or may reduce the resolution by thinning out pixels in the frame image. Various combinations of the resolution of the first moving image and the resolution of the second moving image are possible. For example, any two of 1920 × 1080 pixel size, 1280 × 720 pixel size, 640 × 480 pixel size, 448 × 336 pixel size, and 192 × 108 pixel size may be used.

  When converting the frame rate, the conversion unit 200 reduces the frame rate of the first moving image. The conversion unit 200 may reduce the frame rate by thinning out the frame images included in the first moving image. Various combinations of the frame rate of the first moving image and the frame rate of the second moving image are possible. For example, any two combinations of 60 fps, 30 fps, and 15 fps may be used.

  The encoding unit 202 encodes the first moving image input from the imaging unit 10 by the first encoding unit 2020 to generate first image quality encoded data. Also, the second moving image input from the conversion unit 200 is encoded by the second encoding unit 2022 to generate second image quality encoded data. These are output to the multiplexing unit 204. Further, the encoding unit 202 outputs information indicating the correspondence relationship between the frames included in the first image quality encoded data and the frames included in the second image quality encoded data to the control unit 214.

  The encoding unit 202 performs compression encoding based on a predetermined standard for the first moving image and the second moving image. For example, MPEG-2, MPEG-4, H.264. H.264 / AVC or H.264 Compressive encoding conforming to standards such as H.264 / SVC is performed. Here, the first encoding unit 2020 performs inter-frame predictive encoding defined by these standards. On the other hand, the first encoding unit 2022 performs only intra-frame prediction encoding defined by these standards. That is, the first encoding unit 2020 generates first image quality encoded data including I frames, P frames, and B frames, and the second encoding unit 2022 includes only I frames, and includes P frames and B frames. Second quality encoded data not included is generated.

  The encoding unit 202 may encode the first moving image and the second moving image in a time-sharing manner by software processing by one hardware encoder or DSP (Digital Signal Processor). Further, the first moving image and the second moving image may be encoded in parallel by software processing by two hardware encoders or a DSP.

  The multiplexing unit 204 multiplexes the first image quality encoded data, the second image quality encoded data input from the encoding unit 202, and the audio encoded data generated by the audio encoding unit (not shown) to generate one moving image. Create an image file. For example, a container file conforming to the MP4 file format is generated. This container file includes header information of each encoded data, thumbnail information, related information input from the control unit 214, and the like. By referring to this container file at the time of reproduction, the first moving image, the second moving image and the sound are synchronized, or the special reproduction for the first moving image is changed to the special reproduction for the second moving image. It can be replaced. The multiplexing unit 204 outputs the generated container file to the recording unit 206.

  The recording unit 206 records the container file input from the multiplexing unit 204 on a recording medium such as an HDD (Hard Disk Drive), an optical disk, or a flash memory.

  The input / output unit 208 communicates with an external device via a predetermined interface. For example, the container file recorded in the recording unit 206 is transferred to the PC by connecting to the PC with a USB cable. In addition, a D terminal, an S terminal, an HDMI terminal, or the like is connected to the television, and the first moving image or the second moving image is displayed on the television.

  The decoding unit 210 decodes the first image quality encoded data or the second image quality encoded data encoded by the encoding unit 202 and the audio encoded data encoded by the audio encoding unit (not shown). The decoding unit 210 outputs the decoded first moving image or second moving image to the display screen generation unit 212, and outputs the decoded sound to an audio reproduction unit (not shown). These are output to an external device via the control unit 214 and the input / output unit 208.

  The display image generation unit 212 generates a thumbnail screen based on the thumbnail of the still image input from the control unit 214 and outputs the thumbnail screen to the display unit 40. For example, the display image generation unit 212 may divide the entire screen into a plurality of areas, and display a plurality of thumbnails input from the control unit 214 in association with the respective areas. When the thumbnail input from the control unit 214 is a moving image thumbnail, the display image generating unit 212 initially displays the first frame image constituting the moving image thumbnail as a still image, and instructs the operation unit 30 to When one thumbnail is designated by, the designated thumbnail may be displayed as a moving image.

  Further, the display image generation unit 212 adds information related to the elapsed playback time input from the control unit 214 and the type of moving image to be played back to the first moving image or the second moving image input from the decoding unit 210. Superimpose and output to the display unit 40.

  The control unit 214 controls the entire imaging apparatus 1. Further, the control unit 214 performs the first image quality based on the information indicating the correspondence between the frames included in the first image quality encoded data input from the encoding unit 202 and the frames included in the second image quality encoded data. The related information for associating the encoded data with the second image quality encoded data is generated and output to the multiplexing unit 204. The control unit 214 extracts the related information from the container file input from the recording unit 6 at the time of reproduction, and refers to the related information, so that the second image quality encoding corresponding to the frame of the first image quality encoded data is performed. Know the frame of data.

  When the special reproduction process for the first image quality encoded data is instructed, the control unit 214 refers to the related information and identifies the corresponding frame of the second image quality encoded data that is to be the target of the special reproduction process. For example, when the special reproduction is a double speed reproduction from the A1 frame included in the first image quality encoded data, the frame of the second image quality encoded data to be subjected to the double speed reproduction processing is changed to the second image quality encoded data. Since the frames are included and arranged one by one from the A2 frame corresponding to the A1 frame, these are specified as frames to be decoded.

  Then, the control unit 214 controls the decoding unit 210 to decode the frame of the specified second image quality encoded data. The decoding unit 210 switches the encoded data to be decoded from the first image quality encoded data to the second image quality encoded data, and decodes the frame of the second image quality encoded data that is the target of the special reproduction process.

  At this time, the decoding unit 210 may perform interpolation processing on the frame image included in the decoded second moving image in order to suppress a sense of discomfort when switching from the first moving image to the second moving image.

  According to the configuration described so far, the special reproduction processing for the first image quality encoded data whose processing is complicated by the inter-frame coding is specially reproduced for the second image quality encoded data which can be simplified by the intra-frame coding. It can be replaced with a process, and the special reproduction process for the first image quality encoded data can be simplified.

  When the editing process for the first image quality encoded data is instructed, the control unit 214 causes the second image quality encoded data to be the target of the editing operation. Therefore, the control unit 214 controls the decoding unit 210 to decode the second moving image from the second image quality encoded data, and displays the decoded second moving image on the display unit 40. While confirming the displayed second moving image, the user performs an editing operation to be performed on the first image quality encoded data, such as scene cut or text insertion, via the operation unit 30. At this time, the control unit 214 generates an index image from the frame image included in the second image quality encoded data so that the user can perform a visual editing operation, and displays the index image on the editing screen together with the time axis scale. The display image generation unit 212 may be controlled. In addition, when there is an instruction to confirm the editing content from the user, the control unit 214 generates playback control information representing the editing content, and decodes the second image quality encoded data based on the playback control information. 210 may be controlled.

  The control unit 214 records the editing content corresponding to the editing operation for the second image quality encoded data. The control unit 214 refers to the edited content and the related information, and specifies a corresponding frame of the first image quality encoded data to be subjected to the editing process.

  For example, when N2 frame and M2 frame included in the second image quality encoded data are combined in the editing content, the frame of the first image quality encoded data that is to be reduced is included in the first image quality encoded data. Since the frames are arranged between the N1 frame corresponding to the N2 frame and the M1 frame corresponding to the M2 frame, these are specified as frames to be reduced.

  Then, the control unit 214 controls the decoding unit 210 so as to decode the first moving image from the first image quality encoded data. The control unit 214 deletes the specified frame from the decoded first moving image. The control unit 210 controls the encoding unit 202 to re-encode the first moving image from which the specified frame is deleted. In this way, the control unit 214 realizes editing processing for the first image quality encoded data.

  According to the configurations described so far, the second image quality encoded data that can easily realize visually easy-to-understand editing operations are targeted for editing operations, and the editing contents corresponding to the editing operations are set as the first image quality encoded data. Since it is reflected, the editing process for the first image quality encoded data is facilitated.

  When the thumbnail information generation process for the first image quality encoded data is instructed, the control unit 214 generates thumbnail information from the corresponding frame of the second image quality encoded data. For example, when still image thumbnail information is generated from a P1 frame included in the first image quality encoded data, still image thumbnail information is generated from a P2 frame corresponding to the P1 frame included in the second image quality encoded data. In addition, when moving image thumbnail information is generated from each frame from Q1 to R1 frame included in the first image quality encoded data, the Q2 frame corresponding to the Q1 frame included in the second image quality encoded data is changed to the R1 frame. Movie thumbnail information is generated from the corresponding frames up to R2. The control unit 214 stores the generated thumbnail information in the corresponding container file and records it in the recording unit 206.

  When the display of the thumbnail screen is instructed during playback, the control unit 214 extracts thumbnail information from the container file recorded in the recording unit 206 and outputs the thumbnail information to the decoding unit 210. When the decoded still image thumbnail or moving image thumbnail is received from the decoding unit 210, the thumbnail is output to the display image generation unit 212. Then, the control unit 214 controls the display image generation unit 212 so as to generate a thumbnail screen. Thereby, the thumbnail information generation process for the inter-frame encoded data can be replaced with the thumbnail information generation process for the intra-frame encoded data, and the thumbnail information for the first image quality encoded data can be correctly decoded by itself, The processing load related to the thumbnail information is reduced.

  Hereinafter, the operation of the imaging apparatus 1 according to the present embodiment is described as follows. The first moving image is a moving image composed of HD (1280 × 720 pixels) size frame images, and the second moving image is SD (640). A case where a moving image is composed of a frame image of (× 480 pixels) size will be described as an example.

(Recording operation)
First, an operation for recording a captured moving image will be described. FIG. 3 is a flowchart showing the procedure of the recording operation. When there is a recording start instruction from the operation unit 30, the imaging unit 10 outputs the captured HD frame image to the conversion unit 200 and the encoding unit 202. The conversion unit 200 converts an HD size frame image into an SD size frame image. Here, it is assumed that the central region of the HD size frame image is cut out and an SD size frame image is generated (S100).

  The second encoding unit 2022 performs intra-frame predictive encoding on the SD-sized frame image to generate second image quality encoded data (S102). The first encoding unit 2020 performs inter-frame predictive encoding on the HD size frame image to generate first image quality encoded data (S104). The encoding unit 202 outputs information indicating the correspondence relationship between the frames included in the first image quality encoded data and the frames included in the second image quality encoded data to the control unit 214.

  Based on the information input from the encoding unit 202, the control unit 214 creates related information that associates the frames included in the first image quality encoded data with the frames included in the second image quality encoded data, and multiplexes them. The data is output to the unit 204 (S106).

  The multiplexing unit 204 receives the first image quality encoded data input from the encoding unit 202, the second image quality encoded data, the audio encoded data input from the audio encoding unit (not shown), and the control unit 214. The related information is multiplexed and a container file is created and recorded in the recording unit 206 (S108).

  Thereafter, the above-described processing is repeated until an instruction to end recording is given from the operation unit 30 (N in S110). When there is an instruction to end recording from the operation unit 30 (Y in S110) and there is an instruction to create a thumbnail (Y in S112), the control unit 214 generates thumbnail information (S114).

  When the control unit 214 is instructed to generate thumbnail information for a moving image composed of HD size frame images, the control unit 214 is included in the first image quality encoded data and generates thumbnail information during imaging. Specifies the frame specified in.

  Next, the control unit 214 refers to the related information, and specifies a frame of the second image encoded data corresponding to the frame designated to generate thumbnail information. Then, the control unit 214 generates still image thumbnail information or moving image thumbnail information from the specified frame of the second image encoded data in response to a thumbnail information generation instruction, and stores the generated still image thumbnail information or moving image thumbnail information in a container file.

(Editing action)
Next, an operation for editing the first image quality encoded data will be described. FIG. 4 is a flowchart showing the procedure of the editing operation. When there is an instruction to start editing from the operation unit 30, the control unit 214 confirms whether or not the editing target is the first image quality encoded data (S200). If the editing target is the first image quality encoded data (Y in S200), the control unit 214 extracts related information from the container file that stores the first image quality encoded data to be edited (S202).

  The control unit 214 controls the decoding unit 210 and the display image generation unit 212 so that the user can perform an editing operation while confirming the second moving image decoded from the second image quality encoded data on the display unit 40. The control unit 214 records editing contents according to the editing operation of the user. (S204).

  The control unit 214 controls the decoding unit 210 to decode the first image quality encoded data when there is an instruction to reflect the edited content from the user. The control unit 214 refers to the related information and reflects the edited content on the decoded first moving image. The control unit 214 controls the encoding unit 202 so as to re-encode the first moving image reflecting the edited content (S206).

(Playback operation)
Next, an operation for reproducing the first image quality encoded data will be described. FIG. 5 is a flowchart showing the procedure of the reproduction operation. When there is an instruction to start reproduction from the operation unit 30, the control unit 214 confirms whether or not the reproduction target is the first image quality encoded data (S300). If the reproduction target is the first image quality encoded data (Y in S300), the control unit 214 confirms whether or not the special reproduction is performed on the first image quality encoded data (S302).

  If it is the special reproduction for the first image quality encoded data (Y in S302), the control unit 214 refers to the related information extracted from the container file storing the first image quality encoded data to be reproduced, and the first image quality Instead of directly decoding the frame to be specially reproduced included in the encoded data, the decoding unit 210 is controlled to execute a replacement reproduction mode for decoding the corresponding frame included in the second image quality encoded data ( S304).

  If it is not the special reproduction for the first image quality encoded data (S302N), the control unit 214 controls the decoding unit 210 to execute the normal reproduction mode in which the first image quality encoded data is decoded as it is (S306).

According to such an embodiment of the present invention, the following operational effects can be enjoyed. (1) The conversion unit 200 performs conversion so as to reduce the image quality of a moving image composed of HD size frame images, and generates a moving image composed of SD size frame images. The encoding unit 202 The first image quality encoded data is generated by performing inter-frame predictive encoding on the moving image composed of the HD size frame image, and the encoding unit 202 includes the moving image composed of the SD size frame image. Is subjected to intra-frame predictive encoding to generate second image quality encoded data. As a result, a large-capacity, high-definition HD-size moving image for viewing can be reduced in encoded data capacity by giving priority to the compression rate. In addition, an SD size moving image for uploading with a small capacity and low image quality becomes encoded data suitable for editing and special reproduction. Therefore, the user can use two types of encoded data properly according to the application, and the convenience for the user can be improved.
(2) The control unit 214 generates related information that associates a frame included in the first image quality encoded data with a frame included in the second image quality encoded data. Accordingly, the two types of encoded data can be used properly, and the convenience for the user can be further improved.
(3) When there is an instruction to generate thumbnail information for the first image quality encoded data, the control unit 214 refers to the related information and generates thumbnail information from the corresponding frame of the second image quality encoded data. The processing load related to can be reduced.
(4) When there is an instruction to edit the first image quality encoded data, the control unit 214, instead of directly editing the first image quality encoded data, edit contents corresponding to the editing operation for the second image quality encoded data. Is recorded, the related information is referred to, and the edited contents are reflected in the first image quality encoded data. Therefore, the editing operation of the first image quality encoded data can be realized with a simple process, which can realize a visual and easy-to-understand editing operation. It becomes easy.
(5) When there is an instruction for special reproduction processing for the first image quality encoded data, the control unit 214 refers to the related information, and instead of directly decoding the frame to be specially reproduced included in the first image quality encoded data. Since the decoding unit 210 is controlled so as to decode the corresponding frame included in the second image quality encoded data, the special reproduction process can be simplified.

  As mentioned above, although the form for implementing this invention has been demonstrated, this invention is not limited to the structure of this embodiment, It exists in the application range of this invention prescribed | regulated by the claim. Various modifications are possible as long as the functions of the configuration of the above-described embodiment can be achieved.

  For example, in the embodiment of the present invention, the second encoding unit 2022 is an MPEG series standard or H.264 standard. Intra-frame predictive encoding specified in the H.264 series standard is performed, but intra-frame predictive encoding may be performed in accordance with a standard such as JPEG or JPEG2000.

DESCRIPTION OF SYMBOLS 10 imaging part, 20 image processing apparatus, 200 conversion part, 202 encoding part, 2020 1st encoding part, 2022 2nd encoding part, 204 multiplexing part, 206 recording part, 208 input / output part, 210 decoding part, 212 display image generation unit, 214 control unit, 30 operation unit, 40 display unit.

Claims (6)

A conversion unit that converts the first moving image into a second moving image having a lower image quality than the first moving image;
An encoding unit that generates first image quality encoded data by performing inter-frame predictive encoding on the first moving image, and generates second image quality encoded data by performing intra-frame predictive encoding on the second moving image; ,
An image processing apparatus comprising:   The image processing apparatus according to claim 1, further comprising a control unit that generates related information that associates the first image quality encoded data with the second image quality encoded data.   3. The control unit according to claim 2, wherein when generating thumbnail information for the first image quality encoded data, the control unit generates the thumbnail information from the second image quality encoded data with reference to the related information. The image processing apparatus described.   When the control unit is instructed to edit the first image quality encoded data, the control unit sets the second image quality encoded data as an object of an edit operation, and edits corresponding to the edit operation for the second image quality encoded data The image processing apparatus according to claim 2, wherein the edited content is reflected on the first image quality encoded data by referring to the related information. A decoding unit for decoding the first image quality encoded data and the second image quality encoded data;
When the special reproduction process for the first image quality encoded data is instructed, the control unit refers to the related information and executes the special reproduction process for the second image quality encoded data. The image processing apparatus according to claim 2, wherein the image processing apparatus controls a decoding unit. An imaging unit for acquiring a moving image;
The image processing apparatus according to any one of claims 1 to 5, which processes a moving image acquired by the imaging unit;
An imaging apparatus comprising:

Images