JP4737003B2 - Editing apparatus, editing method, editing program, and editing system - Google Patents

Description

  The present invention relates to an editing apparatus, an editing method, an editing program, and an editing system for performing editing of video data compression-encoded using interframe compression at a higher speed.

Conventionally, as a recording medium suitable for recording AV (Audio / Video) data composed of video data and audio data, which can be recorded and removed from the recording / reproducing apparatus, has a relatively large recording capacity, A DVD (Digital Versatile Disc) having a recording capacity of 4.7 GB (Giga Byte) or more is widespread. Patent Document 1 describes an imaging apparatus that records in a DVD-Video format on a recordable DVD.
JP 2004-350251 A

  This recordable type DVD uses UDF (Universal Disk Format) as a file system and can be accessed by a computer device compatible with UDF. The UDF includes a format according to ISO (International Organization for Standarization) 9660, and can be accessed by various file systems used in computer devices. For this recordable type DVD, for example, video data captured by the imaging device and audio data obtained along with the imaging are recorded as files, so that the compatibility between the imaging device and other devices such as a computer device is achieved. Therefore, the recorded data can be used more effectively.

  By the way, since video data has an enormous amount of data, it is generally compressed and encoded by a predetermined method and recorded on a recording medium. An MPEG2 (Moving Picture Experts Group 2) system is known as a standard system for compressing and encoding video data. In recent years, the ITU-T (International Telecommunication Union-Telecommunication Standardization Sector) Recommendation H.264 has been proposed, which further promotes the MPEG2 compression coding system to enable efficient coding. H.264 or ISO (International Organization for Standarization) / IEC (International Electrotechnical Commission) International Standard 14496-10 (MPEG-4 Part 10) Advanced Video Coding (hereinafter abbreviated as H.264 | AVC) has also become widespread.

  These MPEG2 and H.264 In H.264 | AVC, intra-frame coding using orthogonal transformation or the like is performed, and inter-frame coding is further performed by predictive coding using motion compensation, thereby increasing the compression rate. Hereinafter, the interframe compression by predictive coding will be described by taking the MPEG2 system as an example.

  First, a data stream structure according to MPEG2 will be schematically described. MPEG2 is a combination of predictive coding using motion compensation and compression coding using DCT. The data structure of MPEG2 has a hierarchical structure, and from the lower order is a block layer, a macroblock layer, a slice layer, a picture layer, a GOP layer, and a sequence layer. The block layer is composed of DCT blocks that are units for performing DCT. The macroblock layer is composed of a plurality of DCT blocks. The slice layer is composed of a header part and one or more macroblocks. The picture layer is composed of a header part and one or more slices. A picture corresponds to one screen. The boundary of each layer can be identified by a predetermined identification code.

  The GOP layer includes a header part, an I (Intra-coded) picture that is a picture based on intra-frame coding, and a P (Predictive-coded) picture B (Bi-directionally predictive coded) picture that is a picture based on predictive coding. It consists of. The I picture can be decoded only by its own information, and the P and B pictures require the previous or previous image as a reference image and are not decoded alone. For example, a P picture is decoded using an I picture or a P picture temporally prior to itself as a reference image. In addition, the B picture is decoded using two pictures, an I picture or a P picture before and after itself, as reference pictures. A group completed by itself including at least one I picture is called GOP (Group Of Picture), and is the smallest unit that can be independently accessed in an MPEG stream.

  A GOP is composed of one or more pictures. In the following, it is assumed that the GOP is composed of a plurality of pictures. There are two types of GOPs: a closed GOP with a GOP-closed structure that can be completely decoded within the GOP, and an open GOP that can use the information of the previous GOP in the coding order when decoding. There is. An open GOP can be decoded using more information than a closed GOP, so that a high image quality can be obtained and is generally used.

Decoding processing of data subjected to inter-frame compression will be described with reference to FIG. Here, it is assumed that 1 GOP is composed of a total of 15 pictures of 1 I picture, 4 P pictures, and 10 B pictures, and the GOP type is an open GOP. As shown in FIG. 16A, the display order of the I, P, and B pictures in the GOP is “B ₀ B ₁ I ₂ B ₃ B ₄ P ₅ B ₆ B ₇ P ₈ B ₉ B ₁₀ P ₁₁ B is as ₁₂ B ₁₃ P ₁₄ ". The subscript indicates the display order.

In this example, the first two B ₀ and B ₁ pictures are predicted and decoded using the last P ₁₄ picture in the previous GOP and the I ₂ picture in this GOP. . The first P ₅ picture in the GOP is a picture predicted and decoded from the I ₂ picture. Other P ₈ picture, P ₁₁ picture and P ₁₄ are pictures decoded is predicted by using the preceding P-picture, respectively. Each B picture after the I picture is a picture predicted and decoded from the preceding and following I and / or P pictures.

  On the other hand, since B pictures are predicted and decoded using temporally preceding and following I or P pictures, the arrangement order of I, P, and B pictures on a stream or recording medium takes into account the decoding order in the decoder. It is necessary to decide. That is, an I and / or P picture for decoding a B picture must always be decoded before the B picture.

In the above example, the arrangement of each picture on the stream or the recording medium is “I ₂ B ₀ B ₁ P ₅ B ₃ B ₄ P ₈ B ₆ B ₇ P ₁₁ B ₉ B as illustrated in FIG. 16B. ₁₀ P ₁₄ B ₁₂ B ₁₃ ”and are input to the decoder in this order. The subscripts correspond to FIG. 16A and indicate the display order.

In the decoding process in the decoder, as shown in FIG. 16C, the I ₂ picture is first decoded, and the decoded I ₂ picture and the last P ₁₄ picture in the previous GOP (display order) are B _0. Predict and decode pictures and B ₁ pictures. Then, the B ₀ picture and the B ₁ picture are output from the decoder in the order of decoding, and then the I ₂ picture is output. Once the B ₁ picture is output, the P ₅ picture is then predicted and decoded using the I ₂ picture. Then, the B ₃ picture and the B ₄ picture are predicted and decoded using the I ₂ picture and the P ₅ picture. The decoded B ₃ picture and B ₄ picture are output from the decoder in the order of decoding, and then the P ₅ picture is output.

  Hereinafter, similarly, the P or I picture used for prediction of the B picture is decoded before the B picture, the B picture is predicted and decoded using the decoded P or I picture, and the decoded B picture is decoded. Is output, the process of outputting the P or I picture used to decode the B picture is repeated. A picture arrangement as shown in FIG. 16B on a recording medium or in a stream is generally used.

  H. Also in the H.264 | AVC format, video data encoding and decoding processes are generally performed in substantially the same manner as in the MPEG2 system. H. In the H.264 | AVC system, inter-frame prediction can be performed using pictures more flexibly. H. In the H.264 | AVC format, a randomly accessible picture corresponding to an I picture in the MPEG2 format is called an IDR (Instantaneous Decoding Refresh) picture. Hereinafter, the encoding method will be described as being representative of the MPEG2 method.

  Here, consider a case where video data compression-encoded by an encoding method using inter-frame compression as in the MPEG2 method is edited. As an example of editing processing, a case will be described in which an intermediate scene in a video image is deleted and before and after the deleted section are combined. For example, as shown in FIG. 17A, the video stream corresponding to the GOP structure such as GOP # 1, GOP # 2,..., GOP # 9,. Designate section A-B. Here, it is assumed that the editing point A at the front end and the editing point B at the rear end of the section A-B are pictures in the middle part of GOP # 3 and GOP # 7, respectively. The picture of the section AB is deleted by editing, and the editing point A and the editing point B are combined to obtain one edited video stream (FIG. 17B).

  When such editing is performed, if the picture in the section AB is simply deleted, the GOP structure is destroyed in GOP # 3 + 7 including the combined portion after combining, and there is a problem that normal reproduction cannot be performed. . For this reason, editing cannot be performed with frame accuracy, and editing is performed in units of GOPs.

Also, as an example of performing editing processing in units of GOP, a method of deleting GOP # 4 to GOP # 6 included in the deletion target section AB and combining the rear end of GOP # 3 and the beginning of GOP # 7 Can be considered. However, if the GOP has an open GOP structure, the G-picture # 7 from which the front-side GOP is deleted cannot decode the leading B-picture group (B picture ₀ and B ₁ picture in the example of FIG. 16). Inconvenience arises.

  In order to solve the inconvenience described above, a method is conceivable in which a video stream to be edited is once decoded, then edited with frame accuracy, and encoded again. However, if the entire target video stream is decoded and re-encoded for each editing, the processing time becomes enormous. Also, if the entire encoded video stream is decoded and re-encoded, the image quality is deteriorated over the entire video stream.

  These inconveniences also occur when a plurality of video streams are combined.

  Therefore, conventionally, a method for decoding and re-encoding only a necessary minimum section near the editing point is known. That is, only the GOP of the part to be deleted or combined and the GOP affected by the change of the GOP are decoded and re-encoded, and the other GOPs are copied in GOP units. As a typical example of a technique for decoding and re-encoding only a necessary minimum section near the editing point, a technique called smart rendering is generally known.

An example of the process of decoding and re-encoding only the necessary minimum section near the editing point will be schematically described with reference to FIG. When the section A-B by the editing point A and the editing point B is deleted, the parts that need to be decoded on the editing point A side are GOP # 3 including the editing point A and GOP # 2 immediately before GOP # 3. . When the GOP is an open GOP, GOP # 2 immediately before GOP # 3 including edit point A is necessary for decoding the _first B ₀ picture and B ₁ picture in the display order of GOP # 3. Further, the parts that need to be decoded on the editing point B side are GOP # 7 including the editing point B and GOP # 8 immediately after GOP # 7. In the open GOP, in order to decode the first B picture group in the display order of GOP # 8, it is necessary to use the data of GOP # 7.

In the state shown in FIG. 17A, for example, GOP # 4 to GOP # 6 are first deleted, and then GOP # 2 and GOP # 3, and GOP # 7 and GOP # 8 are respectively decoded. In GOP # 3, the pictures after the editing point A are deleted from the decoded pictures. Similarly, in GOP # 7, the pictures before the edit point B are deleted from the decoded pictures. Then, the editing point A and the editing point B are combined, and the newly created GOP # 3 + 7 is re-encoded with reference to the code amounts of the preceding and succeeding GOP # 2 and GOP # 8 (FIG. 17B). The head of the B ₀ picture and B ₁ picture GOP # 3 + 7 is encoded using the last P ₁₅ picture of the decoded GOP # 2, and I ₃ pictures GOP # 3 which is decoded. For GOP # 2 and GOP # 8, GOP # 2 and GOP # 8 before decoding can be stored in a memory and used.

  Such a process can be applied in the same manner to an editing process in which a plurality of video streams are combined.

  By the way, in order to perform editing using re-encoding as described above, the video stream to be combined needs to satisfy some restrictions. As described above, the video stream is stored in a file and recorded on a recording medium. At this time, the value of a predetermined parameter related to the video stream recorded in one file needs to be fixed in one file.

  For example, when a video stream having different values for a certain parameter is combined into one video stream by editing and stored in one file, and the video stream stored in this file is played back by a playback device, If the value changes during playback, the decoder of the player may not be able to cope with this parameter value change.

  Examples of parameters whose values need to be fixed include vertical and horizontal image frame sizes, aspect ratios (16: 9 or 4: 3, etc.), frame rates (29.97 Hz, 59.94 Hz, etc.) ), Frame structure, presence / absence of closed caption data, and the like. When re-encoding is performed by editing, it is necessary that the values of these parameters all match in the video streams before and after being combined in the re-encoding section.

  In the editing apparatus, if encoding corresponding to all of these parameters is possible, encoding may be performed by setting a predetermined value according to these attributes. However, in this case, the editing apparatus needs to support all combinations of values that the parameters can take for each parameter defined in the video stream format, which increases the scale of the encoder and the cost. There was a problem that it would be.

  In order to avoid this, it is conceivable that the editing apparatus can edit only a video stream recorded by a specific recording apparatus. By restricting the video stream to be edited in this way, the editing apparatus only needs to support only the parameters supported by the recording apparatus. However, in this case, when a video stream recorded by another recording device is supplied to the editing device, there is a problem that the editing device may malfunction.

  Accordingly, an object of the present invention is to provide an editing apparatus, an editing method, an editing program, and an editing system capable of appropriately performing editing processing of video data compression-encoded using inter-frame compression. is there.

In order to solve the above-described problem, the first invention is an editing apparatus that edits video data that has been compression-encoded using inter-frame compression, and includes video data that has been compression-encoded using inter-frame compression. An extraction unit that extracts identification information that identifies the device that generated the data stream, embedded in the data stream, a decoding unit that decodes the data stream, and compression encoding using inter-frame compression An encoding unit that encodes with a predetermined attribute, and an editing unit that decodes and encodes the data stream to edit the data stream based on the editing points set for the data stream, The editing unit recognizes the identification information extracted from the stream data by the extraction unit. It is determined whether or not a device capable of encoding with the same attribute as the predetermined attribute at the time of encoding by the video section is indicated, and if it is determined, editing is performed by decoding and encoding a predetermined section including the editing point. An editing apparatus characterized by performing

The second invention is an editing method for editing video data compression-encoded using interframe compression, embedded in a data stream composed of video data compression-encoded using interframe compression, An extraction step for extracting identification information for identifying a device that has generated the data stream from the data stream, a decoding step for decoding the data stream, and compression encoding using inter-frame compression with predetermined attributes. Thus, an encoding step for encoding and an editing step for editing the data stream by decoding and encoding the data stream based on the editing point set for the data stream are provided. It is extracted from the stream data in the extraction step It is determined whether or not the identified identification information indicates a device capable of encoding with the same attribute as the predetermined attribute at the time of encoding in the encoding step. An editing method is characterized in that editing is performed by decoding and encoding.

According to a third aspect of the present invention, there is provided an editing program for causing a computer apparatus to execute an editing method for editing video data compressed and encoded using interframe compression. The editing method is compressed and encoded using interframe compression. An extraction step for extracting from the data stream identification information identifying the device that generated the data stream embedded in the data stream comprising the video data, a decoding step for decoding the data stream, and inter-frame compression of the video data The data stream is edited by decoding and encoding the data stream based on the encoding step for encoding with a predetermined attribute and the editing point set for the data stream. Editing steps The step, step identification information extracted from the stream data in the extraction, it is determined whether shows encodable device in the same attribute and predetermined attributes during encoding by the encoding step, denoted If it is determined that there is an editing program, editing is performed by decoding and encoding a predetermined section including the editing point.

  Further, the fourth invention is an editing method in which video data is compressed and encoded using interframe compression, recorded on a recording medium, and the video data compressed and encoded using interframe compression reproduced from the recording medium is edited. In the system, a first encoding unit that encodes video data with a predetermined attribute by compression encoding using interframe compression and outputs the data stream as a data stream, and a data stream output from the first encoding unit A recording unit that records as a file on a recording medium, and includes a recording device that embeds identification information for identifying the device itself in the data stream and records the data on the recording medium, and reads the stream file recorded on the recording medium A playback unit for extracting the data stream and an extraction unit for extracting the identification information from the data stream A decoding unit that decodes the data stream, a second encoding unit that encodes video data with a predetermined attribute by compression encoding using inter-frame compression, and an editing point set for the data stream. And an editing unit that decodes and encodes the data stream to edit the data stream, and the editing unit encodes the identification information extracted from the stream data by the extracting unit by the second encoding unit. It is determined whether or not a device that can be encoded with the same attribute as the predetermined attribute at the time is indicated, and if it is determined, the predetermined section including the editing point is decoded and encoded to be edited. And an editing apparatus.

  As described above, according to the first, second, and third inventions, identification information for identifying a device that generates a data stream embedded in a data stream composed of video data compression-encoded using interframe compression. Is extracted from the data stream, and based on the edit points set for the data stream, the data stream is decoded and encoded to edit the data stream. During editing, the data is extracted from the stream data by the extraction unit. It is determined whether or not the identification information indicates a device capable of encoding video data with the same attribute as a predetermined attribute when video data is encoded by compression encoding using inter-frame compression. If you decide, you can edit by decoding and encoding the specified section including the edit point. Therefore, embedded in the data stream, only looking at the identification information for identifying the device that generated the data stream, it can be determined whether it is possible to editing by decoding and encoding of the predetermined section including the editing point.

  According to a fourth aspect of the present invention, a recording apparatus records a data stream output by encoding video data with a predetermined attribute by compression encoding using interframe compression as a stream file on a recording medium. At this time, identification information for identifying the device itself is embedded in the data stream and recorded on the recording medium. The editing apparatus reads the stream file recorded on the recording medium, extracts the data stream, and extracts the data stream from the data stream. Based on the editing points set for the data stream, the identification information is extracted, and the data stream is encoded with a predetermined attribute by decoding and compression encoding using inter-frame compression. The identification information extracted from the stream data at the time of editing is It is determined whether or not a device capable of encoding with the same attribute as the predetermined attribute at the time of encoding in the collecting device is indicated, and if it is determined, the predetermined section including the editing point is decoded and encoded. Since the editing is performed, the editing apparatus can know whether or not the data stream is recorded by the corresponding recording apparatus based on the identification information for identifying the apparatus that recorded the data stream. When it is determined that the data stream is recorded by the recording apparatus, it is possible to perform editing by decoding and encoding a predetermined section including the editing point.

  As described above, the first, second, and third inventions are identification information for identifying a device that generates a data stream embedded in a data stream composed of video data compression-encoded using interframe compression. Is extracted from the data stream, and based on the edit points set for the data stream, the data stream is decoded and encoded to edit the data stream. During editing, the data is extracted from the stream data by the extraction unit. It is determined whether or not the identification information indicates a device capable of encoding video data with the same attribute as a predetermined attribute when video data is encoded by compression encoding using inter-frame compression. If you decide, you can edit by decoding and encoding the specified section including the edit point. Therefore, it is possible to determine whether or not editing by decoding and encoding of a predetermined section including an editing point is possible only by looking at identification information for identifying a device that has generated the data stream embedded in the data stream. is there.

  According to a fourth aspect of the present invention, as described above, the recording apparatus records, as a stream file, a data stream output by encoding video data with predetermined attributes by compression encoding using inter-frame compression. In this case, identification information for identifying the device itself is embedded in the data stream and recorded on the recording medium, and the editing apparatus reads the stream file recorded on the recording medium and reads the data stream. The identification information is extracted from the data stream, and the data stream is encoded with a predetermined attribute by compression and encoding using inter-frame compression based on the edit point set for the data stream. The data stream is edited and extracted from the stream data during editing. It is determined whether the identification information indicates a device capable of encoding with the same attribute as the predetermined attribute at the time of encoding by the editing device, and if it is determined, the predetermined section including the editing point is decoded. Since the editing is performed by encoding, the editing device knows whether or not the data stream is recorded by the corresponding recording device based on the identification information for identifying the device that recorded the data stream. Thus, when it is determined that the data stream is recorded by the corresponding recording apparatus, there is an effect that editing by decoding and encoding of a predetermined section including the editing point can be performed.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First, in order to facilitate understanding, an example format (hereinafter referred to as AVCHD format) applicable to the present invention will be described. The AVCHD format is a recording format for recording an AV (Audio / Video) stream in which video data and audio data are multiplexed in a predetermined manner on a recordable recording medium, and recording the AV stream as a file on the recording medium, The recorded AV stream can be managed using a playlist for each clip.

  In AVCHD, as an encoding method, for example, ITU-T (International Telecommunication Union-Telecommunication Standardization Sector) recommendation H.264. H.264 or ISO (International Organization for Standarization) / IEC (International Electrotechnical Commission) International Standard 14496-10 (MPEG-4 Part 10) Advanced Video Coding (hereinafter abbreviated as H.264 | AVC) Is used to multiplex video data and audio data in accordance with the provisions of MPEG2 Systems.

  H. The bit stream encoded by the H.264 | AVC format and multiplexed in accordance with MPEG2 Systems is referred to as a clip AV stream (or AV stream). The clip AV stream is recorded on a recording medium as a file by a predetermined file system. Hereinafter, the file in which the clip AV stream is recorded is referred to as a stream file.

  The data structure according to the AVCHD format is H.264. It conforms to the bit stream structure defined in H.264 | AVC. Here, H. The bit stream structure defined in H.264 | AVC will be schematically described. H. In H.264 | AVC, a VCL (Video Coding Layer) that handles video coding processing itself and a NAL (Network Abstraction Layer) between a lower system that transmits and stores encoded information are defined. , VCL and NAL are separated. Also, parameter sets corresponding to sequence and picture header information can be handled separately from information generated by the VCL.

  H. The mapping of the H.264 | AVC bit stream to a lower system, for example, MPEG2 Systems, is performed in units of NAL units, which are a delimiter of NAL. FIG. 1 shows an exemplary configuration of a NAL unit. The NAL unit includes a NAL header and an RBSP (Raw Byte Sequence Payload). In the NAL header, information nal_ref_idc having a data length of 2 bits and information nal_unit_type having a data length of 5 bits are arranged following a fixed bit portion having a data length of 1 bit. Information nal_ref_idc indicates whether or not a slice that can be a reference picture is stored in this NAL unit. Information nal_unit_type indicates the type of this NAL unit. The RBSP stores raw data that is compression-encoded for moving images.

  The RBSP trailing bit is an adjustment bit for adjusting the bit length of the NAL unit to a multiple of 8 bits. The RBSP trailing bit starts from “1” and is followed by “0”, and the last bit position of the RBSP can be specified by detecting the first bit “1”. When “1” is detected after “0”, it is found that the position is the head of the NAL unit.

  The types of NAL units indicated by the information nal_unit_type include slices of various encoded pictures, SEI (Supplemental Enhancement Information), SPS (Sequence Parameter Set), PPS (Picture Parameter Set), AU (Access Unit) delimiters, and sequences. The end of sequence (EOS), the end of stream (End Of Stream: EOS), etc., and the value of the information nal_unit_type indicates which of these is stored in the RBSP.

  The SEI is supplementary additional information, and indicates additional information that is not essential for VCL decoding. As SEI, timing information of each picture related to the virtual reference decoder, information on the pan / scan function, information used for random access, information uniquely defined by the user (user data), and the like are defined. The SPS is a header including information related to encoding of the entire sequence. The PPS is a header including information related to the coding mode of the entire picture. The AU delimiter indicates the head of an access unit described later.

  In order to access the information in the bitstream in units of pictures, a section obtained by collecting several NAL units is called an access unit. FIG. 2 shows an exemplary configuration of the access unit. In the configuration of the access unit shown in FIG. 2, other information excluding the NAL unit corresponding to each slice of the main picture is optional information that does not necessarily need to exist in the access unit. When using these optional information, as shown in FIG. 2, the AU delimiter, SPS, PPS, SEI, main picture, redundant picture, EOS (End Of Sequence) and EOS (End Of Stream) are arranged in this order. It is necessary to be out. Each NAL unit is identified based on information in the NAL header. The redundant picture is not related to the present invention, and the description is omitted.

  FIG. 3 schematically shows a structure of an example of video data applicable to the embodiment of the present invention. In this embodiment, the video data has a GOP (Group Of Picture) structure, and the GOP includes at least one I picture and one or more P pictures and B pictures.

  A header is provided for each GOP. The header corresponds to the AU delimiter, SPS, PPS, and SEI shown in FIG. 2, and includes at least the AU delimiter and SEI. SEI H.264 | AVC defines a plurality of names, and different information is transmitted for each name. In the embodiment of the present invention, in particular, information unique to the recording apparatus is stored in “User Data Unregistered SEI” which is SEI that can be defined by the user among SEI.

  FIG. 4 shows syntax that represents an example of the structure of information stored in the SEI “User Data Unregistered SEI”. Here, the syntax is shown based on a description method in C language used as a program description language such as a computer device. This is the same in the diagrams representing other syntaxes.

  The SEI “User Data Unregistered SEI” is designated with the payload size, that is, the entire data length of the SEI “User Data Unregistered SEI”, as indicated by “user_data_unregistered (payloadSize)” in the first line of FIG. Referred to. In FIG. 4, a field uuid_iso_iec_11578 having a data length of 128 bits stores predetermined identification information. A field type_indicator whose next data length is 32 bits indicates the type of this SEI “User Data Unregistered SEI”. The value of the field type_indicator is “0x47413934”, and a block cc_data () in which closed caption data is stored is arranged according to the if statement. Since the closed caption is not related to the present invention, the description is omitted.

  In the numerical description, “0x” indicates that the numerical value is expressed in hexadecimal. This is common for the following similar notations.

  If the value of the field type_indicator is “0x4D44504D”, the block ModifiedDVPackMeta () is described according to the description of “else if” in the if statement. This block ModifiedDVPackMeta () stores information specific to the recording apparatus that records this data. In the block ModifiedDVPackMeta (), a field number_of_modified_dv_pack_entries having a data length of 8 bits indicates the number of data modified_dv_pack stored in the block ModifiedDVPackMeta (). According to the next for loop statement, data modified_dv_pack, that is, block one_modified_dv_pack () is stored in the number indicated in this field number_of_modified_dv_pack_entries.

  The block one_modified_dv_pack () includes a field mpd_id having a data length of 8 bits and a field mpd_data having a data length of 32 bits. FIG. 5 shows syntax that represents an example of the configuration of the block one_modified_dv_pack (). FIG. 5A is an example in which the block one_modified_dv_pack () is a block MAKER & MODEL ID pack () in which information indicating the recording device that has recorded this data is stored. FIG. 5B is an example in which the block one_modified_dv_pack () is a block MAKER OPTION pack () in which information indicating the image quality mode at the time of recording is stored.

  The block MAKER & MODEL ID pack () in FIG. 5A will be described. A field mpd_id has a data length of 8 bits and indicates the type of this block one_modified_dv_pack (). That is, it is indicated that the field mpd_id is a predetermined value, and this block one_modified_dv_pack () is a block MAKER & MODEL ID pack () in which information indicating the recording device that has recorded this data is stored. The field mpd_data shown in FIG. 4 is divided into a field maker_ID and a field maker_model_code each having a data length of 16 bits in the block MAKER & MODEL ID pack (). A field maker_ID indicates identification information for identifying the manufacturer of the recording apparatus that has recorded this data. A field maker_model_code indicates identification information for identifying the model number and model of the recording apparatus.

  The block MAKER OPTION pack () in FIG. 5B will be described. In this block MAKER OPTION pack (), information indicating the image quality mode at the time of recording is stored as described above. That is, in an apparatus for recording and reproducing video and audio, it is generally performed that the recording time and the image quality or the sound quality can be switched by gradually switching the bit rate. As an example, the highest bit rate and high image quality (or high sound quality) can be obtained, but HQ (High Quarity) mode with a short recordable time, practically sufficient image quality and recordable time are guaranteed, and the bit rate is medium. An LP (Long Play) mode with a low level and a low bit rate SP (Standard Play) mode giving priority to long-time recording is set.

  On the other hand, the image quality mode at the time of recording is not necessarily expressed on the video and audio recording formats, and is often a specification specific to, for example, the model number or model of the manufacturer or apparatus. In addition, it is desirable that the user can be notified of the recording mode in which the content to be reproduced is recorded during reproduction.

  Therefore, it is conceivable to define a block MAKER OPTION pack () that can describe a recording mode specific to the manufacturer, model number, and model. The block MAKER OPTION pack () is more preferably used in parallel with, for example, the block MAKER & MODEL ID pack () described above. As an example, a block MAKER & MODEL ID pack () and a block MAKER OPTION pack () are written together for SEI “User Data Unregistered SEI”.

  In FIG. 5B, a field mpd_id has a data length of 8 bits and indicates the type of this block one_modified_dv_pack (). That is, it is indicated that the field mpd_id is a predetermined value and this block one_modified_dv_pack () is a block MAKER OPTION pack () in which information indicating a recording mode relating to image quality when this data is recorded is stored.

  The field mpd_data shown in FIG. 4 includes SEI “User Data Unregistered SEI” in which the block MAKER OPTION pack () is stored in the field REC_MODE having a data length of 32 bits, for example, in the block MAKER OPTION pack (). A recording mode relating to image quality when the included video data is recorded is described. For example, when the value of the field REC_MODE is “0”, the HQ mode is indicated, “1” is the SP mode, and “2” is the LP mode. The number of recording modes is not limited to these three types, and may be increased, or only two types of HQ mode and SP mode may be used.

  As described above, for the video data, the block MAKER OPTION pack () in which the recording mode relating to the image quality when the video data is recorded in the SEI “User Data Unregistered SEI”, and the recorder that recorded the video data are recorded. By adding the block MAKER & MODEL ID pack () that describes the manufacturer, model number, and model, the video data from the block MAKER & MODEL ID pack () It can be discriminated whether or not the data is recorded by a recorder of the same manufacturer, model and model number. If it can be determined that the video data has been recorded by the recorder or a recorder of the same manufacturer, model, and model number, the interpretation and processing of data specific to the recorder can be performed.

  As an example, during playback, a recording mode relating to image quality when video data to be played back is recorded can be read from the block MAKER OPTION pack () and displayed, for example. As another example, by defining a recording mode related to image quality for a block one_modified_dv_pack () stored in SEI “User Data Unregistered SEI”, information indicating the recording mode is embedded in a stream of video data. Therefore, even when an editing operation is performed on the video data, the recording mode information can be taken over.

Next, an embodiment of the present invention will be described. When editing is performed by re-encoding only the necessary minimum section near the editing point, the value of a predetermined parameter included in the video stream to be edited needs to be fixed in the stream file. For example, the AVCHD format stipulates that the following parameters (1) to (6) must be constant within one stream file.
Parameter (1): Parameter indicating the size of the image frame in the horizontal direction Parameter (2): Parameter indicating the size of the image frame in the vertical direction Parameter (3): Parameter indicating the aspect of the display image Parameter (4): Frame rate Parameter parameter (5): Parameter parameter indicating the structure of the frame (6): Parameter indicating the presence or absence of closed caption data

  The specifics of these parameters (1) to (6) in AVCHD are described in H.264. Based on the H.264 | AVC rules, The parameter (1) is described as a code pic_width_in_mbs_minus1 in the SPS. The parameter (2) is described as a code pic_height_in_map_units_minus1 in the SPS. The parameter (5) is described as a code frame_mbs_only_flag in the SPS. The parameter (3) is described as a code aspect_ratio_idc in the SPS. The parameter (4) is obtained based on the code video_format in SPS, for example. These code aspect_ratio_idc and code video_format are described as options in the SPS. Further, the parameter (6) can be determined based on the value of the field type_indicator in the SEI “User Data Unregistered SEI” described above. That is, when the value of the field type_indicator is “0x47413934”, it is determined that the closed caption data exists.

  Here, if the editing apparatus can encode all the possible values of these parameters (1) to (6) in the stream file to be edited, a method of always re-encoding only the necessary minimum section near the editing point. It is possible to perform the editing process at high speed by applying the editing method in. However, if the editing apparatus is designed so as to be compatible with all possible values of the parameters (1) to (6), it is inevitable that the encoder becomes large, and the cost increases.

  Therefore, in the present invention, when a video stream is edited, information indicating the recording device that generated the video stream, which is arranged at a predetermined position of the video stream to be edited, is extracted, and the video stream to be edited is generated. It is determined whether or not the recording device is a specific recording device.

  With a specific recording device, for example, the editing device can encode with the attributes equivalent to the attributes shown in the values of the parameters (1) to (6) in the video stream generated by the recording device. It is a recording device that has a large value. For example, in the SEI “User Data Unregistered SEI” described with reference to FIGS. 4 and 5, the information indicating the specific recording device includes the field maker_ID in the block MAKER & MODEL ID pack () stored in the block ModifiedDVPackMeta (). And field maker_model_code.

  If it is determined that the recording apparatus that generated the video stream to be edited is a specific recording apparatus, the video stream is edited using a method of re-encoding only the necessary minimum section near the editing point. If it is determined that the recording device that generated the video stream to be edited is not a specific recording device, the entire video stream to be edited is decoded, and the decoded video data is edited in units of frames. And re-encode the entire edited video data.

  According to the present invention, at the time of editing a video stream, it can be easily determined based on information in the video stream to be edited whether a method of re-encoding only the necessary minimum section near the editing point can be applied. On the editing device side, when a stream file recorded by a specific recording device is a main editing target, the encoder of the editing device only supports parameters equivalent to the target specific recording device, Editing processing using a technique for re-encoding the necessary minimum interval can be performed.

  An example of a video stream editing method according to an embodiment of the present invention will be described. As illustrated in FIG. 6A, a video stream file including nine GOPs GOP # 1 to GOP # 9 is considered. Header # 1 to header # 9 are added to GOP # 1 to GOP # 9, respectively. Each of header # 1 to header # 9 stores SEI “User Data Unregistered SEI” in which the above-described block ModifiedDVPackMeta () including data modified_dv_pack indicating the information of the recording apparatus that recorded the file is described. .

  For the video stream stored in this file, as shown in FIG. 6B, an edit point A is set for a picture in GOP # 3, and an edit point B is set for a picture in GOP # 7. Then, the picture included in the section AB between the editing point A and the editing point B is deleted, and editing processing for combining the editing point A and the editing point B is performed. As shown in an example of FIG. 6C, the editing results indicate that GOP # 4 to GOP # 6 between editing point A and editing point B are deleted, GOP # 3 including editing point A, and GOP including editing point B. GOP # 3 + 7 is generated by combining # 7 with edit point A and edit point B. As a whole, from five GOPs of GOP # 1, GOP # 2, GOP # 3 + 7, GOP # 8 and GOP # 9 A video stream is generated. In FIG. 6B and FIG. 6C, the header is not shown in order to avoid complexity.

  FIG. 7 is a flowchart showing an example of editing processing by the editing method according to the embodiment of the present invention. When the file to be edited is designated, in step S10, the block MAKER & MODEL ID pack () of data modified_dv_pack indicating the information of the recording device that has recorded this file is selected from the stream file to be edited (FIG. 4 and FIG. 4). 5) is searched.

  For example, referring to FIG. 6A, the NAL unit of the first header # 1 of the video stream stored in the stream file to be edited is analyzed, and SEI “User Data Unregistered SEI” is extracted. Then, the block ModifiedDVPackMeta () including the data modified_dv_pack indicating the information of the recording device that has recorded this file is retrieved from the SEI “User Data Unregistered SEI”. & MODEL ID pack () is searched.

  In the next step S11, the field maker_ID and the field maker_model_code stored in the block MAKER & MODEL ID pack () are respectively acquired, and it is determined whether or not there is model data that can be encoded with the same attribute. Note that the same attribute means that, for example, the above parameters (1) to (6) can be encoded with the same parameter value.

  For example, the editing device stores in advance storage device specific information (field maker_ID and field maker_model_code values) for encoding with parameters compatible with the editing device in a storage means such as a ROM (Read Only Memory) or a hard disk drive. In addition, it is determined whether or not the stored values of the field maker_ID and the field maker_model_code have the same values of the field maker_ID and the field maker_model_code acquired from the video stream to be edited.

  If it is determined in step S11 that there is data of a model that can be encoded with the same attribute, the process proceeds to step S12 to re-encode only the necessary minimum section near the editing point of the video stream to be edited. On the other hand, if it is determined in step S11 that there is no model data that can be encoded with the same attribute, the process proceeds to step S13 to re-encode all sections of the video stream to be edited. Use to edit.

  When a plurality of stream files are to be edited, for example, when editing points are provided in each of the two stream files and the two files are combined based on the editing points, step S10 is performed for each of the editing targets. And the process of step S11 is performed. For example, the block MAKER & MODEL ID pack () is searched for two files to be edited (step S10), and the values of the field maker_ID and the field maker_model_code in each block MAKER & MODEL ID pack () are determined ( Step S11).

  If the values of the field maker_ID and the field maker_model_code in the two files to be edited both match the values stored in the editing device, only the necessary minimum section near the editing point in step S12 is re-encoded. Processing shall be performed.

  An example of the editing process by the method of re-encoding only the necessary minimum section near the editing point in step S12 will be schematically described with reference to FIG. Note that the configuration of the video stream illustrated in FIG. 8 corresponds to FIG. 6 described above and includes nine GOPs # 1 to GOP # 9. As described above, the editing point A is designated in GOP # 3, the editing point B is designated in GOP # 7, and the section AB is deleted.

  First, as illustrated in FIG. 8A, GOP # 4 immediately after GOP # 3 including edit point A to GOP # 6 immediately before GOP # 7 including edit point B are deleted in GOP units. GOP # 3 including edit point A and GOP # 2 immediately before GOP # 3 are decoded. Similarly, GOP # 7 including edit point B and GOP # 8 immediately after GOP # 7 are decoded.

  Next, as illustrated in FIG. 8B, in the decoded GOP # 3, from the editing point A to the end of GOP # 3 is deleted in units of frames. Similarly, in the decoded GOP # 7, the beginning of GOP # 7 to the edit point B are deleted in frame units. Then, as illustrated in FIG. 8C, edit point A and edit point B are combined, and GOP # 2, GOP # 3 + 7, and GOP # 8 are re-encoded.

  In the state shown in FIG. 8A, GOP # 2 before decoding is held in a memory or the like, re-encoding is performed on GOP # 3 + 7 and GOP # 8, and the held GOP # 2 before decoding is stored. It is also conceivable to overwrite and copy immediately before the encoded GOP # 3 + 7.

  An example of the editing process by the method of re-encoding all sections of the video stream to be edited in step S13 will be schematically described with reference to FIG. The configuration of the video stream to be edited is equivalent to that shown in FIGS. In this case, as illustrated in FIG. 9A, decoding is performed for the entire video stream to be edited (GOP # 1 to GOP # 9 in the example of FIG. 9), and the frame from editing point A to editing point B is framed. Edit point A and edit point B are combined and deleted in units. As a result of combining the editing point A and the editing point B, GOP # 3 + 7 is generated. When GOP # 3 + 7 is generated, the entire edited GOP # 1, GOP # 2, GOP # 3 + 7, GOP # 8, and GOP # 9 are re-encoded (FIG. 9B).

  In the above description, the example in which the editing point A and the editing point B are set and edited with respect to the video stream stored in one stream file has been described. However, the above-described processing is performed on the video stream stored in two stream files. However, the same can be applied to the case where the editing point A and the editing point B are respectively set and edited.

  FIG. 10 schematically shows an editing process performed on video streams stored in two stream files. Consider a first stream file in which a video stream 100 ending with GOP # m is stored and a second stream file in which a video stream 101 starting with GOP # 1 is stored (FIG. 10A). An edit point A is set in GOP # m-1 of the video stream 100, and an edit point B is set in GOP # 2 of the video stream 101. Then, the edit point A to the end of the video stream 100 are deleted, the edit point B is deleted from the head of the video stream 101 (FIG. 10B), and the edit point A and the edit point B are combined to form one video stream. 102 is created (FIG. 10C).

  With reference to FIG. 11, an example of the editing process by the method of re-encoding only the necessary minimum section near the editing point when editing the video streams stored in the two stream files in step S12 described above will be described. A brief description will be given. The configuration of the video stream exemplified in FIG. 11, the setting of the editing point A and the editing point B, the editing location, and the like are the same as those in FIG.

  First, as illustrated in FIG. 11A, in the video stream 100, GOP # m immediately after GOP # m-1 including edit point A is deleted in GOP units, and GOP # m-1 and GOP # m immediately before GOP # m-1 are deleted. -2 is decoded. Similarly, in the video stream 101, GOP # 1 immediately before GOP # 2 including edit point B is deleted in GOP units, and GOP # 2 and GOP # 3 immediately after are decoded.

  Next, as illustrated in FIG. 11B, in the decoded GOP # m-1 of the video stream 100, the edit point A to the end of GOP # m-1 are deleted in units of frames. Similarly, in the decoded GOP # 2 of the video stream 101, the beginning of GOP # 2 to the edit point B are deleted in units of frames. Then, as illustrated in FIG. 11C, the editing point A and the editing point B are combined, and GOP # m−2, GOP # (m−1) + (2), and GOP # 3 are re-encoded. A video stream 102 of the book is created.

  In the state shown in FIG. 11A, GOP # 2 before decoding is held in a memory or the like, re-encoding is performed on GOP # 3 + 7 and GOP # 8, and GOP # 2 before decoding is held. It is also conceivable to overwrite and copy immediately before the encoded GOP # 3 + 7.

  An example of processing by re-encoding all sections to be edited when editing the video streams stored in the two stream files in step S13 described above will be schematically described with reference to FIG. To do. The configuration of the video stream exemplified in FIG. 12, the setting of the editing point A and the editing point B, the editing location, and the like are the same as those in FIG. In this case, as illustrated in FIG. 12A, the entire video stream 100 to be edited and the entire video stream 101 are decoded, respectively. In the video stream 100, the process from the editing point A to the end is performed. Similarly, in the video stream 101, deletion from the head to the editing point B is deleted in frame units. Then, as illustrated in FIG. 12B, the editing point A and the editing point B are combined to re-encode the whole to obtain one video stream 102.

  Here, when the editing point A and the editing point B are combined to generate a new GOP as in the examples described with reference to FIGS. 8 and 9 and FIGS. 11 and 12, the editing point A is generated. Depending on the position of the editing point B in the GOP, the number of pictures included in the new GOP may be less than the predetermined number or may exceed the predetermined number. In such a case, it is considered that the number of pictures in the new GOP is kept within a predetermined number by duplicating or thinning out pictures.

  The procedure of the method of re-encoding only the necessary minimum section near the editing point described with reference to FIGS. 8 and 11 is an example for enabling one embodiment of the present invention to be implemented. The method is not limited.

  Further, in the above description, it is determined that there is no model data that can be encoded with the same attribute in step S11 in FIG. 7. As a result, it is determined that there is no data. Although it has been described that editing is performed using a method of re-encoding all the sections, this is not limited to this example. For example, a warning may be given using predetermined display means that the video stream to be edited may not be compatible with the device.

  FIG. 13 shows an example of the configuration of a recording apparatus 1 that can be applied to an embodiment of the present invention. The recording apparatus compresses and encodes input video data and audio data by a predetermined method, multiplexes the compressed and encoded video data and audio data into one data stream, and records the data stream as a file. It is recorded on the medium.

  The recording apparatus 1 illustrated in FIG. 13 is a recording block of a video camera apparatus that records video data based on a captured image signal on a recording medium in combination with, for example, a camera block including an optical system and an image sensor. It is used. However, the present invention is not limited to this, and the recording apparatus 1 can also be used as a single recording apparatus that records video data and audio data input from the outside on a recording medium.

  Various applicable compression encoding and multiplexing methods are conceivable. For example, H.M. H.264 | AVC can be applied as the compression coding according to the embodiment of the present invention. For example, MPEG2 Systems is applied as the multiplexing method.

  As the recording medium 20 for recording data, for example, a recordable type DVD (Digital Versatile Disc) can be used. It is also conceivable to apply a Blu-ray Disc (Blu-ray Disc: registered trademark) realizing a larger capacity as the recording medium 20. Not limited to this, a semiconductor memory can be applied as the recording medium 20, and a hard disk drive can also be applied.

  The control unit 5 includes, for example, a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory) (not shown). The control unit 5 stores the RAM as a work memory based on programs and data stored in advance in the ROM. To control the entire recording apparatus 1. A file system used in the recording apparatus is provided by a program operating on the control unit 5. For example, the control unit 5 associates the physical address of the recording medium 20 with the file in which the data is stored and records each data when the data is recorded on the recording medium 20 based on the file system. Generates logical management information of the file in which is stored.

  A UI (User Interface) unit 6 is provided with a predetermined operation element for a user to operate the operation of the recording apparatus, and outputs a control signal corresponding to an operation on the operation element. This control signal is supplied to the control unit 5. The control unit 5 controls the operation of each unit of the recording apparatus 1 by processing a program based on a control signal supplied from the UI unit 6 according to a user operation. For example, in response to an operation performed on the UI unit 6, the start and stop operations of the recording operation by the recording device are controlled by the control unit 5.

  Baseband digital video data is input from a terminal 10 and supplied to a video encoder 11. The video encoder 11 has a buffer memory capable of storing a plurality of frames of video data, stores the supplied baseband digital video data in the buffer memory, and compresses and encodes the data by a predetermined method. AVCHD format, ie H.264. In this example in which compression encoding is performed in accordance with a method defined in H.264 | AVC, for example, intra-frame compression is performed using DCT (Discrete Cosine Transform) and intra-frame prediction, and inter-frame compression using a motion vector is performed. And entropy coding to increase the compression efficiency.

  The video encoder 11 further generates predetermined information such as SPS, PPS, and SEI based on the compressed and encoded video data. At this time, the identification information for identifying the maker name of the recording apparatus 1 and the identification information for identifying the model and model number are used as the field maker_ID and the field maker_model_code in the block MAKER & MODEL ID pack () of SEI “User Data Unregistered SEI”. Generated as the value of The manufacturer name, model, and model number identification information are stored in advance in a ROM (not shown) of the recording apparatus 1. The video encoder 11 forms a NAL unit from the compression-coded video data and additional information such as SPS, PPS, and SEI. H.264 | AVC elementary stream (ES).

  H. According to H.264 | AVC regulations, in a decoder model, a coded picture buffer (CPB) that is a buffer on the input side of the decoder and a decoded picture buffer (DPB: Decoded Picture Buffer) that is a buffer on the output side. Are defined, and the encoder must generate a bit stream (elementary stream) so that the CPB and DPB do not fail. The video encoder 11 controls the encoding process of the video data so that the generated code amount satisfies this rule.

  At this time, based on the generated code amount, the stock amount information for the CPB, that is, the buffer on the input side of the decoder, can be obtained and inserted into the elementary stream obtained by the encoding. For example, in the NAL unit, the buffer stock amount information can be described in a code bit_rate_scale, a code cpb_size_scale, a code bit_rate_value_minus1, a code cpb_size_value_minus1, and the like, which are SPS options. This stock quantity information may be described for each picture or for each GOP.

  The multiplexer (MUX) 12 multiplexes an elementary stream output from the video encoder 11 and an elementary stream of audio data output from an audio encoder (not shown) by a predetermined method, and outputs the result as one data stream. In this example where multiplexing is performed in accordance with MPEG2 Systems, the supplied video data elementary stream and audio data elementary stream are multiplexed in a time division manner using an MPEG2 transport stream.

  For example, the multiplexer 12 has a buffer memory, and temporarily stores the supplied elementary stream in the buffer memory. The elementary stream stored in the buffer memory is divided into predetermined sizes, added with headers, and packetized PES (Packetized Elementary Stream) packets. The header stores predetermined information defined by MPEG2 Systems, such as PTS indicating the reproduction time of data stored in the packet and DTS indicating the decoding time.

  The PES packet is further divided and packed in the payload of a transport packet (TS packet). The header of the TS packet stores a PID (Packet Identification) for identifying the data type packed in the payload. A header having a predetermined data length is further added to the TS packet to form a source packet. The multiplexer 12 combines the source packets and outputs them as one data stream.

  The data stream output from the multiplexer 12 is temporarily stored in the stream buffer 13. By controlling the timing of writing the data stream to the stream buffer 13 and the timing of reading the data stream from the stream buffer 13 in units of source packets, the access speed to the recording medium 20 and the encoding of audio and video data are controlled. Is consistent with the signal processing speed.

  The source packet read from the stream buffer 13 is supplied to the recording processing unit 14 as a data stream. The recording processing unit 14 performs error correction coding processing and recording coding processing on the supplied data, modulates the obtained digital data to a predetermined value, and records the data on the recording medium 20. At this time, the recording processing unit 14 writes data to a designated address based on a command from a higher level such as a control unit.

  FIG. 14 shows an example of the configuration of the editing apparatus 2 applicable to the embodiment of the present invention. For example, the editing device 2 can edit a video stream stored in a stream file recorded on the recording medium 20 by the recording device 1 described above. That is, the editing apparatus 2 reproduces a stream file recorded on the recording medium 20 to extract a video stream, performs predetermined decoding and encoding, and records the video stream on the recording medium 20 again. Note that the editing device 2 has the same configuration as the recording device 1 described above as a configuration on the recording side, and the same reference numerals are given to portions common to FIG. 13 and detailed description thereof is omitted.

  The entire editing apparatus 2 is controlled according to a program by a control unit (not shown). The control unit includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and operates as a work memory based on programs and data stored in advance in the ROM. 2 exchanges commands, statuses, data, and the like with each unit 2 to control the operation of the editing apparatus 2. In addition, a file system used in the editing apparatus 2 is provided by a program operating on the control unit. For example, the control unit can access a file recorded on the recording medium 20 by the file system in accordance with a predetermined operation on the UI unit 41.

  The reproduction processing unit 30 controls reproduction of data recorded on the recording medium 20. That is, the reproduction processing unit 30 reads data from a specified address of the recording medium 20 based on a command from a higher order such as a control unit. The reproduction processing unit 30 demodulates the reproduction signal reproduced from the recording medium 20 by reading this data to obtain reproduction digital data, decodes the recording code of the reproduction digital data and decodes the error correction code to correct the error. To obtain a playback data stream. This reproduction data stream is a stream in which source packets are connected.

  The data stream output from the reproduction processing unit 30 is temporarily stored in the stream buffer 31. By controlling the timing of writing the data stream to the stream buffer 31 and the timing of reading the data stream from the stream buffer 31 in units of source packets, the access speed to the recording medium 20 and the decoding of audio and video data are controlled. Is consistent with the signal processing speed.

  The data stream read from the stream buffer 31 is supplied to a demultiplexer (DEMUX) 32. The demultiplexer 32 separates and takes out video data and audio data multiplexed in a predetermined data stream. In this example, the demultiplexer 32 extracts a source packet from the supplied data stream, and separates the extracted header of the source packet into TS packets. The demultiplexer 32 further detects the PID from the header of the TS packet, and distributes the TS packet for each data type stored in the payload. Then, for each of the sorted TS packets, the data stored in the payload is taken out and the PES packet is reconstructed. Further, compressed video data and compressed audio data stored in the payload of the PES packet are extracted, header information and the like are added based on the information stored in the PES header, and each is output as one elementary stream.

  The elementary stream of audio data output from the demultiplexer 32 is supplied to an audio processing unit (not shown).

  The elementary stream of video data output from the demultiplexer 32 is supplied to the video decoder 33. The video decoder 33 has a buffer memory capable of storing a plurality of frames of video data, accumulates the supplied compressed video data in the buffer memory, decodes it with a decoding method corresponding to the compression encoding method, Output as digital video data.

  The compression encoding of video data is H.264. In this example, which is performed in accordance with the method defined in H.264 | AVC, the video decoder 33 H.264 | AVC is used to perform decoding processing. That is, the video decoder 33 analyzes the NAL unit, and extracts compression-coded video data and additional information such as SPS, PPS, and SEI from the NAL unit. The video decoder 33 performs a decoding process on the video data compressed and encoded based on the information extracted from the NAL unit.

  The video decoder 33 can perform decoding and output based on a time indicated by a DTS (Decoding Time Stamp) and a PTS (Presentation Time Stamp) extracted by a demultiplexer (DEMUX) 32 described later. Baseband digital video data obtained by decoding by the video decoder 33 is output from a terminal 34. Further, when a monitor 35 for displaying video is connected to the editing apparatus 2, the baseband digital video data output from the video decoder 33 is also supplied to the monitor 35. The monitor 35 is assumed to support baseband digital video data.

  H. In the H.264 | AVC standard, the applicable image formats are extremely diverse. The AVCHD format is a recording format for a recordable recording medium, and an applicable image format is an HD (High Definition) format having an aspect ratio of 16: 9 and an image frame size of 1920 lines × 1080 pixels, and an aspect ratio. Is 4: 3 and the frame size is limited to 720 lines × 480 pixels SD (Standard Definition) format.

  Here, when comparing the compression encoding process of video data and the decoding process of compression encoded video data, generally, the load of the compression encoding process is greater than the load of the decoding process. It is said to be much larger. Therefore, in the editing apparatus 2 according to this embodiment, the function of the video encoder 11 is limited, and for example, the image format that can be encoded is only the HD format. On the other hand, the video decoder 33 with a relatively small processing load supports both the SD format and the HD format.

  The UI unit 41 is provided with various controls necessary for editing video data, and outputs a control signal corresponding to the operation of the controls. The editing unit 40 exchanges commands and data with a control unit (not shown) based on a control signal supplied from the UI unit 41 to control the entire editing apparatus 2 and stores it in a stream file recorded on the recording medium 20. Edit processing is performed on the video stream. The editing unit 40 includes a hard disk drive 42 and performs editing processing using the hard disk drive 42.

  The video encoder 11 converts the video data supplied from the editing unit 40 to H.264. H.264 | AV is compressed and encoded in accordance with the method defined in AVC. That is, the video data is compressed and encoded in the same manner as in the case of the recording apparatus 1 described with reference to FIG. 13, and additional information such as SPS, PPS, and SEI is determined in advance based on the compression-coded video data Generate. At this time, the identification information for identifying the manufacturer name of the editing apparatus 2 and the identification information for identifying the model and model number are used as the field maker_ID and the field maker_model_code in the block MAKER & MODEL ID pack () of SEI “User Data Unregistered SEI”. And is added to SEI “User Data Unregistered SEI”. The video encoder 11 forms a NAL unit from the compression-coded video data and additional information such as SPS, PPS, and SEI. H.264 | AVC elementary stream (ES).

  The multiplexer 12 multiplexes the elementary stream supplied from the editing unit 40 and the elementary stream of audio data output from an audio encoder (not shown) by a method according to MPEG2 Systems. That is, the multiplexer 12 divides the supplied elementary stream into predetermined sizes, adds a header storing predetermined information such as PTS and DTS, and forms a PES (Packetized Elementary Stream) packet. The multiplexer 12 further divides the PES packet and packs it into the TS packet payload, generates a predetermined PID, and adds a header. A source packet is formed by further adding a header having a predetermined data length to the TS packet, and the source packet is connected and output as one data stream.

  The data stream output from the multiplexer 12 is supplied to the recording processing unit 14 via the stream buffer 13, is subjected to predetermined error correction encoding and recording encoding, is subjected to modulation processing to be a recording signal, and is recorded on the recording medium 20. Is done.

  The editing process by the editing device 2 will be schematically described. As an example, a case will be described in which editing is performed by designating an editing point A and an editing point B with respect to a video stream stored in one stream file as described with reference to FIG. The user performs a predetermined operation on the UI unit 41 and designates a file to be edited among the stream files recorded on the recording medium 20. The edit unit 40 controls to read out the stream file to be edited from the recording medium 20 based on the control signal output from the UI unit 41. When the stream file is read from the recording medium 20, an elementary stream is extracted, and the extracted elementary stream is written to the hard disk drive 42.

  For example, the stream file read from the recording medium 20 is supplied to the demultiplexer 32 via the reproduction processing unit 30 and the stream buffer 31, the packet structure is decomposed, the header information is extracted, and the payload data is The elementary stream is taken out and reconstructed. This elementary stream is supplied to the editing unit 40 and written to the hard disk drive 42.

  An elementary stream is read from the hard disk drive 42 in response to a predetermined operation on the UI unit 41 and supplied to the video decoder 33 to be baseband digital video data. This digital video data is supplied to the monitor 35 and displayed. The user operates the UI unit 41 while viewing the video displayed on the monitor 35 and designates the editing point A and the editing point B. The editing point A and the editing point B are specified by, for example, a frame number or a time code. Information on the editing point A and the editing point B is supplied from the UI unit 41 to the editing unit 40 and held therein. For example, when an operation for instructing execution of editing is performed on the UI unit 41, the editing unit 40 starts editing processing based on a control signal from the UI unit 41.

  That is, as already described with reference to FIG. 7, the elementary stream written in the hard disk drive 42 is supplied to the video decoder 33. The video decoder 33 analyzes the NAL unit of the supplied elementary stream and extracts SEI “User Data Unregistered SEI”. The extracted SEI “User Data Unregistered SEI” is supplied to the editing unit 40.

  The editing unit 40 searches the supplied SEI “User Data Unregistered SEI” for a block ModifiedDVPackMeta () including data modified_dv_pack indicating the information of the recording device that has recorded this file, and further, from the block ModifiedDVPackMeta (), the field mpd_id The block MAKER & MODEL ID pack () is searched based on the value of (step S10 in FIG. 7). Based on the field maker_ID and the field maker_model_code stored in the retrieved block MAKER & MODEL ID pack (), the editing unit 40 determines whether there is model data that can be encoded with the same attribute in step S11 of FIG. Judgment is made.

  It is assumed that information on the model that can be encoded with the same attribute as that of the editing apparatus 2 is stored in advance in a ROM (not shown) of the control unit, a hard disk drive 42 connected to the editing unit 40, or the like. The information of SEI “User Data Unregistered SEI” in the stream file to be edited is acquired when the stream file is played back in order to specify the editing point A and the editing point B, and is stored in the editing unit 40. Also good.

  If it is determined that there is data of a model that can be encoded with the same attribute, editing processing is performed using a technique of re-encoding only the necessary minimum section in step S12 of FIG.

  As an example, as described with reference to FIG. 8, the editing unit 40, from the elementary stream written to the hard disk drive 42, GOP # 3 including the editing point A, GOP # 2 immediately before GOP # 3, Is read. For example, the editing unit 40 detects the position of the GOP while reading a predetermined NAL unit of the elementary stream, and reads out the desired GOP. The read GOP # 2 and GOP # 3 are supplied to the video decoder 33 and decoded. The decoded data is supplied to the editing unit 40 and written to the hard disk drive 42. You may write in RAM which the edit part 40 has which is not shown in figure. The editing unit 40 deletes the edit points A and later of the decoded GOP # 3 written in the hard disk drive 42.

  Similarly, the editing unit 40 reads GOP # 7 including the editing point B and GOP # 8 immediately after GOP # 7 of the elementary stream written to the hard disk drive 42. The read GOP # 7 and GOP # 8 are supplied to the video decoder 33 and decoded. The decoded data is supplied to the editing unit 40 and written to the hard disk drive 42 or the like. The editing unit 40 deletes the decoded GOP # 7 written in the hard disk drive 42 from the head to the editing point B.

  Next, the editing unit 40 connects GOP # 3 from which the edit point A and subsequent points are deleted to GOP # 7 from which the edit point B is deleted from the beginning, and creates a new GOP GOP # 3 + 7. . When GOPs are connected, if the number of pictures included in the connected GOP does not reach a predetermined number, interpolation or thinning out of pictures is performed so that the number of pictures becomes a predetermined number.

  The editing unit 40 supplies GOP # 2, GOP # 3 + 7, and GOP # 8 written in the hard disk drive 42 to the video encoder 11 and re-encodes them. The re-encoded GOP # 2, GOP # 3 + 7, and GOP # 8 are written to the hard disk drive. At this time, it is possible to overwrite GOP # 2 before decoding, which is first written in the hard disk drive 42, with GOP # 2 which is re-encoded and written in the hard disk drive 42. The editing unit 40 sequentially reads out GOP # 1, GOP # 2, GOP # 3 + 7, GOP # 8, and GOP # 9 written in the hard disk drive 42, thereby outputting one elementary stream. be able to.

  If the above-described buffer stock information is described in the elementary stream to be edited, the editing unit 40 controls the generated code amount to a predetermined value based on this stock information and encodes the GOP. Do. For example, NAL units are analyzed for GOP # 2 immediately before GOP # 3 including edit point A, GOP # 3 including edit point A, GOP # 7 including edit point B, and GOP # 8 immediately after GOP # 7. Then, the livestock amount information of the buffer is obtained, and the encoding process is performed based on the obtained livestock amount information so that each GOP is seamlessly connected and can be reproduced.

  On the other hand, in step S11 of FIG. 7, it is determined that there is no model data that can be encoded with the same attribute based on the information of the block MAKER & MODEL ID pack () in the block ModifiedDVPackMeta () in the SEI “User Data Unregistered SEI”. Then, the editing process is performed using the technique of re-encoding all the sections of the video stream to be edited in step S13 in FIG.

  As an example, as described with reference to FIG. 9, the editing unit 40 reads the elementary stream written in the hard disk drive 42 and supplies it to the video decoder 33. The video decoder 33 decodes all the supplied elementary streams. The decoded data is supplied to the editing unit 40 and supplied to the hard disk drive 42.

  The edit unit 40 deletes the decoded video data from the editing point A to the editing point B in units of frames and connects the editing point A and the editing point B. At this time, when the editing point A and the editing point B are connected, the editing unit 40 performs picture interpolation, thinning, etc. if the number of pictures included in the GOP including the connecting unit does not reach the predetermined number. The number of pictures is set to a predetermined number.

  The video data to which the editing point A and the editing point B are connected is supplied to the video encoder 11. The video encoder 11 re-encodes the supplied video data over the entire length and outputs it as a single elementary stream. This elementary stream is supplied to the editing unit 40 and written to the hard disk drive 42. This data written to the hard disk drive 42 may be read from the hard disk drive 42 and processed by the multiplexer 12, the stream buffer 13 and the recording processing unit 14 respectively, and written to the recording medium 20, or via an external interface (not shown). May be output externally.

  Note that the processing for setting one editing point A and editing point B for two stream files and editing to obtain one data stream is the same as the processing for editing point A and editing for one stream file described above. Since the processing is the same as when the point B is set and editing processing is performed, the description thereof is omitted.

  In the above description, the editing apparatus 2 is described as reproducing the recording medium 20 and editing the data stream stored in the stream file recorded in the recording medium 20, but this is not limited to this example. That is, the editing apparatus 2 may edit video data supplied from the outside.

  The video data is H.264. In the case of being supplied from the outside in the H.264 | AVC elementary stream format, for example, the elementary stream supplied from the outside is input to the editing unit 40 and written to the hard disk drive 42. Then, a determination process is performed based on the manufacturer information and the model or model number information embedded in the data stream in the procedure described with reference to FIG. 7, and only a necessary minimum section is re-encoded or edited depending on the determination result Edit by any method that re-encodes all sections of the target video stream.

  Further, when video data is supplied from the outside in the form of a data stream in which source packets are connected or in the form of a transport stream by MPEG2 Systems, for example, the data stream supplied from the outside is input to the demultiplexer 32, The packet structure is disassembled, header information is extracted, payload data is extracted, and an elementary stream is reconstructed. This elementary stream is supplied to the editing unit 40 and written to the hard disk drive 42. The subsequent processing is the same as described above.

  In FIG. 14 described above, the editing apparatus 2 that performs the editing process according to the embodiment of the present invention has been described as being configured as dedicated hardware. However, this is not limited to this example. It is also possible to configure the editing device with such a computer device.

  FIG. 15 schematically illustrates an exemplary configuration of a general computer device 3. A CPU 51, ROM 52 and RAM 53 are connected to the bus 50. The CPU 51 uses the RAM 53 as a work memory in accordance with programs and data stored in the ROM 52 and a hard disk drive 60 described later, and controls the operation of each unit in the computer device 3 while communicating with each unit via the bus 50.

  A graphics processing unit 54 and a communication interface (communication I / F) 55 are also connected to the bus 50. A monitor 54A is connected to the graphics processing unit 54, and a display control signal supplied from the CPU 51 can be converted into a video signal and supplied to the monitor 54A, and a predetermined image can be displayed on the monitor 54A. The communication I / F 55 is connected to a network such as the Internet or a LAN (Local Area Network), for example, and controls communication between the computer apparatus 3 and the outside via the network based on a command from the CPU 55.

  An input interface (input I / F) 56, a video interface (video I / F) 57, a drive device 58 and a hard disk drive 60 are further connected to the bus 50.

  For example, a pointing device such as a mouse 56A or a character input device such as a keyboard 56B is connected to the input I / F 56. The input device connected to the input I / F 56 is not limited to these examples, and is a rotary encoder that outputs a control signal according to the rotation angle, or a joystick that outputs a control signal according to the direction and degree of tilting the stick. It can be considered variously, such as a tablet that outputs a value by designating a position on a plane.

  The data I / F 57 is an interface for exchanging digital data between the computer apparatus 3 and an external device. For example, an interface such as USB (Universal Serial Bus) or IEEE 1394 (Institute Electrical and Electronics Engineers 1394) is used. Is applicable. When an external device corresponding to the interface is connected to the input / output terminal 57A, data is exchanged between the external device and the data I / F 57 according to the interface protocol, and data communication is possible between the external device and the computer apparatus 3. State.

  The drive device 58 corresponds to, for example, a disk-shaped recording medium, and can write data to and read data from the loaded recordable type recording medium. As a recordable type recording medium, for example, a recordable type DVD can be applied. However, the present invention is not limited to this, and the drive device 58 may be compatible with a recordable type CD (Compact Disc) or Blu-ray Disc. Furthermore, the drive device 58 can read data from not only a recordable recording medium but also a reproduction-only recording medium such as a DVD-ROM or a CD-ROM (Compact Disc-Read Only Memory). Further, the drive device 58 is not limited to being compatible with a disk-shaped recording medium, and may be a semiconductor memory such as a flash memory as the recording medium 59, for example.

  The hard disk drive 60 stores programs and data used by the CPU 51 as described above. Of course, other data supplied via the bus 50 can be written and read.

  By installing an editing program for executing the editing method according to the embodiment of the present invention in such a computer apparatus 3, the computer apparatus 3 operates as a video stream editing apparatus corresponding to the AVCHD format. Can be made. That is, with this editing program, the functions of the video encoder 11, the multiplexer 12, the demultiplexer 32, the video decoder 33, and the editing unit 40 in the editing apparatus 2 described with reference to FIG. Since the video encoder 11 has a heavy processing load, the video encoder 11 may be separate hardware connected to the bus 50 and controlled by the CPU 51.

  The editing program is provided by being recorded on a recording medium such as a CD-ROM or a DVD-ROM. As an example, when the editing program is recorded on a DVD-ROM, when the DVD-ROM is loaded in the drive device 58, for example, the recording is performed on the DVD-ROM loaded by the drive device 58 based on the control of the CPU 51. The program file storing the edited program is read out. The editing program is read out from the program file, developed in a predetermined manner by the CPU 51 and written in the hard disk drive 60, registered in the system, and made executable on the computer device 3.

  Note that the method for providing the editing program to the computer apparatus 3 is not limited to the method via a recording medium. For example, the program file may be prepared on a server connected to the network and acquired from the server via the communication I / F 55. In addition, the program file can be received via the data I / F 57.

  An example of processing executed when the editing method according to the embodiment of the present invention is executed by the computer apparatus 3 in which the editing program is mounted in an executable manner will be schematically described. For example, the recording medium 20 on which the stream file is recorded by the recording apparatus 1 shown in FIG. 13 is loaded into the drive 58, and the stream file recorded on the recording medium 20 is edited.

  The recording medium 20 on which the stream file is recorded is loaded into the drive device 58, and the user instructs to edit the stream file recorded on the recording medium 20 using the input device connected to the input I / F 56.

  The CPU 51 controls to copy the stream file recorded on the recording medium 20 to the hard disk drive 60. The CPU 51 reads the stream file written in the hard disk drive 60, disassembles the packet using the RAM 53 as a work memory, collects predetermined information from the header of each packet, and reconstructs the video and audio elementary streams. To do. The elementary stream is written to the hard disk drive 60. Hereinafter, an elementary stream of video data will be described.

  The CPU 51 reads and decodes the elementary stream written to the hard disk drive 60 to obtain baseband video data. The baseband video data is supplied to the graphics processing unit 54, converted into a video signal, and displayed on the monitor 54A. The user operates the input device connected to the input I / F 56 while viewing the video displayed on the monitor 54A, and designates the edit point A and the edit point B by a frame number, a time code, and the like. Information about the edit point A and the edit point B is held in the RAM 53, for example.

  When editing is instructed using the input device, the CPU 51 starts editing processing for the elementary stream written to the hard disk drive 60. That is, as already described with reference to FIG. 7, the CPU 51 analyzes the NAL unit of the elementary stream written in the hard disk drive 60 and extracts SEI “User Data Unregistered SEI”. Then, from the extracted SEI “User Data Unregistered SEI”, a block ModifiedDVPackMeta () including data modified_dv_pack indicating the information of the recording device that records the file in which the elementary stream to be edited is stored in the recording medium 20 is searched. Further, the block MAKER & MODEL ID pack () is retrieved from the block ModifiedDVPackMeta () based on the value of the field mpd_id (step S10 in FIG. 7).

  Note that the information of SEI “User Data Unregistered SEI” in the stream file to be edited may be acquired when the stream file is played back in order to designate the editing point A and the editing point B, and may be held in the RAM 53. .

  Based on the field maker_ID and the field maker_model_code stored in the searched block MAKER & MODEL ID pack (), the CPU 51 determines whether or not there is model data that can be encoded with the same attribute in step S11 of FIG. Make a decision.

  Note that information on the model that can be encoded with the same attribute as the editing program installed in the computer apparatus 3 is stored together with the editing program in a program file in which the editing program is stored, for example. However, the present invention is not limited to this, and the program file may be recorded and provided as a separate file, or may be provided via an external server connected to the network.

  If it is determined that there is data of a model that can be encoded with the same attribute, editing processing is performed using a technique of re-encoding only the necessary minimum section in step S12 of FIG.

  As an example, as described with reference to FIG. 8, the CPU 51 reads GOP # 3 including the editing point A and GOP # 2 immediately before GOP # 3 from the elementary stream written to the hard disk drive 60. For example, the editing unit 40 detects the position of the GOP while reading a predetermined NAL unit of the elementary stream, and reads out the desired GOP. The CPU 51 decodes the read GOP # 2 and GOP # 3 and writes them to the hard disk drive 60 or the RAM 53. The CPU 51 deletes the edit points A and later of the decoded GOP # 3 written in the hard disk drive 60 or the RAM 53. Similarly, the CPU 51 reads and decodes GOP # 7 including the editing point B and GOP # 8 immediately after GOP # 7 of the elementary stream written to the hard disk drive 60, and writes it to the hard disk drive 60 or RAM 53. . The CPU 51 deletes the decoded GOP # 7 written in the hard disk drive 60 or the RAM 53 from the head to the editing point B.

  Next, on the hard disk drive 60 or RAM 53, the CPU 51 connects GOP # 3 from which the edit point A and the subsequent edit points are deleted to GOP # 7 from which the edit point B is deleted from the beginning to create a new GOP. A certain GOP # 3 + 7 is created. When GOPs are connected, if the number of pictures included in the connected GOP does not reach a predetermined number, interpolation or thinning out of pictures is performed so that the number of pictures becomes a predetermined number.

  The CPU 51 re-encodes GOP # 2, GOP # 3 + 7, and GOP # 8 written in the hard disk drive 60 or RAM 53, and writes them in the hard disk drive 60. At this time, GOP # 2 before decoding, which is first written in the hard disk drive 60 or the RAM 53, can be overwritten on GOP # 2 which is re-encoded and written in the hard disk drive 60. The CPU 51 outputs one elementary stream by sequentially reading GOP # 1, GOP # 2, GOP # 3 + 7, GOP # 8 and GOP # 9 which are re-encoded and written to the hard disk drive 60. Can be made.

  When the above-described buffer stock amount information is described in the elementary stream to be edited, the CPU 51 performs GOP encoding by controlling the generated code amount based on the stock amount information.

  On the other hand, in step S11 of FIG. 7, it is determined that there is no model data that can be encoded with the same attribute based on the information of the block MAKER & MODEL ID pack () in the block ModifiedDVPackMeta () in the SEI “User Data Unregistered SEI”. Then, the editing process is performed using the technique of re-encoding all the sections of the video stream to be edited in step S13 in FIG.

  As an example, as described with reference to FIG. 9, the CPU 51 reads and decodes the elementary stream written in the hard disk drive 60. The decoded data is written to the hard disk drive 60. If the capacity of the RAM 53 is sufficiently large, the decoded data may be written into the RAM 53.

  The CPU 51 connects the editing point A and the editing point B by deleting the decoded video data from the editing point A to the editing point B in units of frames. At this time, when the editing point A and the editing point B are connected, if the number of pictures included in the GOP including the connection portion does not reach a predetermined number, the CPU 51 performs picture interpolation, thinning, etc. The number is set to a predetermined number. The CPU 51 re-encodes the video data to which the editing point A and the editing point B are connected over the entire length to generate one elementary stream. This elementary stream is written to the hard disk drive 60.

  Note that the processing for setting one editing point A and editing point B for two stream files and editing to obtain one data stream is the same as the processing for editing point A and editing for one stream file described above. Since the processing is the same as when the point B is set and editing processing is performed, the description thereof is omitted.

  The elementary stream written to the hard disk drive 60 after the editing process is converted to a PES packet, a TS packet, and a source packet by the CPU 51 to form a MPEG2 Systems transport stream. This data stream is supplied to the drive device 58 and recorded on a recording medium.

  The elementary stream of the edited result is not limited to being written on the recording medium loaded in the drive device 58, and may be stored in the hard disk drive 60 in an accumulative manner, for example. Further, the elementary stream can be read from the hard disk drive 60 and output to an external device via the data I / F 57. It can also be transmitted to the outside from the communication I / F 55 via a network. In addition, the elementary stream of the edited result is packetized into a predetermined packet as a transport stream, stored in the hard disk drive 60, output to an external device via the data I / F 57, and from the communication I / F 55 via the network. Transmission to the outside may be performed.

  Further, the video data to be edited is not limited to being read from the recording medium loaded in the drive device 58, and video data supplied from the outside can be the editing target. For example, video data to be edited is input from the input / output terminal 57A and written to the hard disk drive 60 via the data I / F 57. The CPU 51 performs editing processing on the video data written to the hard disk drive 60 in the same manner as described above.

  In the above description, it has been described that the elementary stream to which the video decoder 33 is input can be decoded in the decoding process during editing, but this is not limited to this example. That is, the video decoder 33 cannot always decode all the streams defined in the format. Therefore, for example, if it is determined that there is no data of a model that can be encoded with the same attribute in step S11 of FIG. 7, if the data does not exist, the elementary stream input to the video decoder 33 is There is also a possibility that the video decoder 33 cannot decode.

  In this case, it is conceivable to perform one of the following two methods. In the first method, as described above, even if it is determined that there is no model data that can be encoded with the same attribute in step S11 of FIG. Is input to the video decoder 33 for decoding, and if an error occurs in the video decoder 33, the decoding is failed. In this case, it is preferable to notify that the data could not be decoded using a predetermined display means.

  The second method uses attribute information of the elementary stream. For example, in the AVCHD format, an attribute information file in which attribute information indicating the attribute of the video stream is stored is created for the stream file in which the video stream in which the elementary stream is packetized is stored. The attribute information file is recorded together on a recording medium on which the file is recorded. In this attribute information file, the number of corresponding streams and parameters relating to encoding for each of the corresponding streams are described.

  Therefore, when decoding at the time of editing, the attribute information file is referred to extract parameters relating to encoding, and it is determined whether or not it can be handled. If it is determined that the response is not possible, the decoding process is stopped. At this time, for example, it is preferable to warn to that effect using a predetermined display means or the like. On the other hand, if it is determined that the response is possible based on the parameters, the elementary stream is input to the video decoder 33 and decoding is started. After starting the decoding, if an error occurs in the video decoder 33, the decoding is failed as in the first method described above.

It is a basic diagram which shows the structure of an example of a NAL unit. It is a basic diagram which shows the structure of an example of an access unit. It is a basic diagram which shows roughly the structure of an example of the video data applicable to one Embodiment of this invention. It is a basic diagram which shows the syntax showing the structure of an example of the information stored in SEI "User Data Unregistered SEI". It is a basic diagram which shows the syntax showing the example of a structure of block one_modified_dv_pack (). It is a basic diagram for demonstrating the edit method of an example of the video stream by one Embodiment of this invention. It is a flowchart which shows an example of an edit process by the edit method by one Embodiment of this invention. It is a basic diagram for demonstrating schematically an example of the edit process by the method of re-encoding only the required minimum area of the edit point vicinity. It is a basic diagram for demonstrating schematically an example of the edit process by the method of re-encoding all the sections of the video stream of edit object. It is a basic diagram which shows roughly the edit process performed with respect to the video stream stored in two stream files. FIG. 11 is a schematic diagram for schematically explaining an example of editing processing by a method of re-encoding only a necessary minimum section near an editing point when editing video streams stored in two stream files. . It is a basic diagram for demonstrating roughly an example of the process by the method of re-encoding all the edit object area | regions when editing with respect to the video stream stored in two stream files. 1 is a block diagram showing a configuration of an example of a recording apparatus applicable to an embodiment of the present invention. It is a block diagram which shows the structure of an example of the editing apparatus applicable to one Embodiment of this invention. It is a block diagram which shows roughly the structure of an example of a general computer apparatus. It is a basic diagram for demonstrating the decoding process of the data which performed the compression between frames. It is a basic diagram for demonstrating the edit which deletes the scene of the intermediate part in a video image, and combines before and after the deletion.

Explanation of symbols

1 recording device 2 editing device 3 computer device 11 video encoder 12 multiplexer 13 stream buffer 14 recording processing unit 20 recording medium 30 reproduction processing unit 31 stream buffer 32 demultiplexer 33 video decoder 40 editing unit 41 UI unit 42 hard disk drive 51 CPU
52 ROM
53 RAM
58 Drive device 60 Hard disk drive

Claims (8)

In an editing apparatus that edits video data compression-encoded using inter-frame compression,
An extraction unit that extracts identification information for identifying a device that has generated the data stream embedded in a data stream including video data that has been compression-encoded using inter-frame compression ;
A decoding unit for decoding the data stream;
An encoding unit that encodes video data with a predetermined attribute by compression encoding using inter-frame compression;
An editing unit configured to edit the data stream by performing the decoding and the encoding on the data stream based on the editing point set for the data stream,
The editorial department
It is determined whether or not the identification information extracted from the stream data by the extraction unit indicates a device that can be encoded with the same attribute as the predetermined attribute at the time of encoding by the encoding unit. And editing the predetermined section including the editing point by decoding and encoding the predetermined section. The editing apparatus according to claim 1,
When the editing unit determines that the identification information extracted from the stream data by the extraction unit does not indicate a device that can be encoded with the same attribute as the predetermined attribute at the time of encoding by the encoding unit. An editing apparatus for performing editing by decoding and encoding the entire data stream. The editing apparatus according to claim 1,
The editing apparatus according to claim 1, wherein the identification information includes information for identifying a manufacturer of the apparatus and information for identifying a model or model number of the apparatus. The editing apparatus according to claim 1,
The editing apparatus according to claim 1, wherein the attributes include an image frame size, an aspect ratio, a frame rate, a frame structure, and presence / absence of closed caption information of the video data. The editing apparatus according to claim 1,
The extraction unit further extracts buffer livestock information embedded in the stream data when decoding the stream data, and the encoding unit performs the above-described buffer livestock information extracted by the extraction unit. An editing apparatus characterized by encoding. In an editing method for editing video data compression-encoded using inter-frame compression,
An extraction step of extracting identification information from the data stream, which is embedded in a data stream composed of video data compressed and encoded using inter-frame compression, identifying the device that generated the data stream;
A decoding step for decoding the data stream;
An encoding step of encoding video data with predetermined attributes by compression encoding using inter-frame compression;
An editing step for editing the data stream by performing the decoding and the encoding on the data stream based on the editing point set for the data stream,
The editing steps above are
Step the identification information extracted from the stream data of the extraction, it is determined whether the shows encodable device in the same attribute and the predetermined attributes during the encoding by step of the encoding, An editing method comprising: editing the predetermined section including the editing point by decoding and encoding the predetermined section when it is determined that the editing point is indicated. In an editing program for causing a computer apparatus to execute an editing method for editing video data compressed and encoded using inter-frame compression,
The above editing method is
An extraction step of extracting identification information from the data stream, which is embedded in a data stream composed of video data compressed and encoded using inter-frame compression, identifying the device that generated the data stream;
A decoding step for decoding the data stream;
An encoding step of encoding video data with predetermined attributes by compression encoding using inter-frame compression;
An editing step for editing the data stream by performing the decoding and the encoding on the data stream based on the editing point set for the data stream,
The editing steps above are
Step the identification information extracted from the stream data of the extraction, it is determined whether the shows encodable device in the same attribute and the predetermined attributes during the encoding by step of the encoding, If it is determined that the editing point is indicated, the editing program is performed by performing the decoding and the encoding on a predetermined section including the editing point. In an editing system that compresses and encodes video data using inter-frame compression and records it on a recording medium, and edits the compressed and encoded video data using inter-frame compression reproduced from the recording medium.
A first encoding unit that encodes video data with a predetermined attribute by compression encoding using inter-frame compression and outputs as a data stream;
A recording unit that records the data stream output from the first encoding unit on a recording medium as a stream file;
A recording device in which identification information for identifying the device itself is embedded in the data stream and recorded on the recording medium;
A reproducing unit that reads out the stream file recorded on the recording medium and extracts the data stream;
An extractor for extracting the identification information from the data stream;
A decoding unit for decoding the data stream;
A second encoding unit that encodes video data with the predetermined attribute by compression encoding using inter-frame compression;
An editing unit configured to edit the data stream by performing the decoding and the encoding on the data stream based on the editing point set for the data stream,
The editorial department
It is determined whether or not the identification information extracted from the stream data by the extraction unit indicates a device that can be encoded with the same attribute as the predetermined attribute at the time of encoding by the second encoding unit. An editing system comprising: an editing device that performs editing by decoding and encoding a predetermined section including the editing point when it is determined that the editing point is indicated.

Images