JP4385987B2 - Video processing apparatus, video processing method, and computer program - Google Patents

Description

  The present invention relates to a video processing device, a video processing method, and a computer program.

  In recent years, with the development of information technology, it has become possible to record digitized video data on a semiconductor memory, a DVD (Digital Versatile Disc), a hard disk drive (HDD), or the like that has been reduced in capacity and price. ing.

  In addition, there is an apparatus that records video data retroactively from a certain point in time according to a recording command so that it can be captured without missing a shooting opportunity such as a decisive moment (see, for example, Patent Document 1). .

  When video data composed of digitized audio / images is recorded in a storage means such as a semiconductor memory, an information compression process is performed in which an input video signal is digitally processed and encoded into video data.

Japanese Patent Laid-Open No. 11-4410

  However, among the digitized video data, video data that needs to be rearranged (reordered) as a sequence of video signals rather than being compressed as input video signals in order to improve compression efficiency. However, in the case of such video data, extra data is included in the head part of the video data that has been recorded for a certain period of time after receiving a recording command. It was not possible to record normally.

  The present invention has been made in view of the above-mentioned problems, and the object of the present invention is to record from a point in time that has been traced back a predetermined time even in the case of video data by information compression that requires sequence rearrangement. A new and improved video processing apparatus, video processing method, and computer program are provided.

In order to solve the above-described problem, according to a first aspect of the present invention, there is provided a video processing apparatus that performs reordering to replace a sequence of image signals configured in a video signal and encodes the image signal into a picture. The The video processing apparatus includes an independent encoding unit that groups the pictures of one or more frames and encodes them into independent picture groups that are independent of at least the front or rear picture groups; and one or more frames or more; grouping the pictures, non-independent encoder for encoding and the non-independent picture group that relates to the at least one group of pictures of the front or rear, accepting an instruction for recording the recording start or recording end serial Recording instruction receiving unit; until the recording start instruction is received by the recording receiving unit, instructing either one of the independent encoding unit or the non-independent encoding unit to start encoding, An encoding instruction unit that instructs the non-independent encoding unit to perform encoding after the instruction is accepted; and the independent encoding unit or the non-independent encoding unit. A storage unit that stores the independent picture group or the non-independent picture group in the order in which they are output from one of them; and when a recording start instruction is received by the recording reception unit, a plurality of the independent pictures stored in the storage unit For a picture group or the above independent picture group, one or two or more independent picture groups or non-independent pictures in order from the independent picture group existing in the vicinity of the previous time point from the time when the recording start instruction is accepted. An acquisition unit for acquiring a group of pictures.

  According to the present invention, at least one of the independent picture group and the non-independent picture group is temporarily stored in the storage unit until a recording start instruction is issued, and when the recording start instruction is issued, the independent picture group stored in the storage unit is stored. Of the picture group or the non-independent picture group, the independent picture group corresponding to the time point that is traced back for a predetermined time is acquired at the head, and the independent picture group or the non-independent picture group is acquired in order thereafter. After the recording start instruction, the non-independent picture group is stored in the storage unit. According to such a configuration, a picture group corresponding to a point in time that is traced back for a predetermined time can be acquired independently of the preceding and subsequent picture groups, so that if a video is stored in advance, a video that is traced back for a predetermined time Can be obtained as a stream.

  The acquisition unit may be configured to acquire in order from the head position or head picture of the independent picture group existing in the vicinity of the retroactive time point. According to such a configuration, lip synchronization of images and sounds is facilitated.

  Each picture included in the independent picture group may be decoded independently within the independent picture group without referring to at least a picture included in the preceding picture group.

  Each picture included in the non-independent picture group may be decoded by referring to a picture included in the front or rear independent picture group or non-independent picture group.

  The video processing apparatus further includes a recording unit capable of recording on a recording medium, and the recording unit sequentially records the independent picture group or the independent picture group acquired by the acquiring unit on the recording medium. May be. According to such a configuration, the video processing apparatus can record a past video in the cache REC on a recording medium by going back a predetermined time from the current time, and can record without missing a decisive scene (or scene). it can.

  The recording unit records the independent picture group or the non-independent picture group acquired in order from the independent picture group existing in the vicinity of the retroactive time by the acquisition unit on the recording medium, and the recording start instruction After the acceptance, the non-independent encoding unit may be configured to record the non-independent picture group acquired by the acquisition unit and recorded on the recording medium.

  In parallel with recording the independent picture group or the non-independent picture group acquired in order from the independent picture group existing in the vicinity of the retroactive time point by the acquisition unit on the recording medium, After the recording instruction is received, the non-independent encoding unit may record the non-independent picture group acquired by the acquiring unit and recorded on the recording medium.

  The encoding instruction unit instructs the independent encoding unit to encode until the recording start instruction is received by the recording reception unit, and after the recording start instruction is received by the recording reception unit. May instruct the non-independent encoding unit to perform encoding.

  The picture is an I picture encoded by an intra-picture independent encoding method, a P picture encoded by a unidirectional prediction encoding method, or a B picture encoded by a bidirectional prediction encoding method. You may comprise so that it may be at least one of them.

  The independent picture group may be a CLOSED GOP, and the non-independent picture group may be an OPEN GOP.

  The video processing device includes: an audio encoding unit that encodes an audio signal configured in a video signal into audio data; at least one picture group of the independent picture group or the non-independent picture group; the audio data; And a media encoding unit that outputs media data including the picture group and the audio data.

  The video processing apparatus further includes a meta encoding unit that encodes an attribute signal related to an image signal and / or an audio signal configured in a video signal into metadata, and the media encoding unit includes the independent picture group or the non-picture group. It may be configured to synchronize at least one of the independent picture groups, the audio data, and the metadata, and output media data including the picture group, the audio data, and the metadata. .

  The media data may be configured to be one or more packet data. With this configuration, media data can be transferred internally within the apparatus, or can be transferred to an external apparatus via a network.

  The video processing apparatus includes: an audio encoding unit that encodes an audio signal configured in a video signal into audio data of one or more frames; and at least one picture group of the independent picture group or the independent picture group It may be configured to further include a media encoding unit that synchronizes the included picture and the audio data in units of one or more frames and outputs media data including the picture and the audio data.

  The video processing apparatus further includes a meta encoding unit that encodes an attribute signal related to an image signal and / or an audio signal configured in the video signal into metadata of one or more frames, and the media encoding unit includes: The picture included in at least one of the independent picture group or the non-independent picture group, the audio data, and the metadata are synchronized in units of one or more frames, and the picture, audio data, and metadata are synchronized. It may be configured to output media data including

  Note that the video signal may be configured to include at least one of an image signal, an audio signal, and an attribute signal.

  In order to solve the above-described problems, according to another aspect of the present invention, there is provided a video processing method for performing reordering to replace a sequence of image signals and encoding the image signals into pictures. The video processing method includes an independent encoding step of grouping pictures of one or more frames until a recording start instruction is received, and encoding the pictures into independent picture groups independent of at least the front or rear picture groups, Or, the code of any one of the non-independent coding steps for grouping pictures of one or more frames and coding them into a non-independent picture group related to at least one of the forward or backward picture group A first storage step of executing the conversion step and storing the independent picture group or the non-independent picture group in the storage unit; and when a recording start instruction is received, a plurality of independent pictures stored in the storage unit in the first storage step For a picture group or non-independent picture group, the independent time group dates back a predetermined time from the point in time when the recording start instruction is received, A first acquisition step of acquiring one or two or more independent picture groups or non-independent picture groups in order from the cutout group; a non-independent encoding step is executed after a recording start instruction is received, And a second storage step of storing in the storage unit.

  The video processing method may be configured to further include a first recording step of recording the independent picture group or the non-independent picture group acquired in the first acquisition step on a recording medium.

  The video processing method includes a second acquisition step of acquiring the non-independent picture group stored in the storage unit in the second storage step; and a second recording step of recording the non-independent picture group acquired in the second acquisition step on a recording medium. A recording step may be further included.

  The video processing method includes: an audio encoding step for encoding an audio signal into audio data; a meta encoding step for encoding an attribute signal related to the image signal and / or audio signal into metadata; and the independent picture group or A media data output step of synchronizing at least one of the non-independent picture groups, the audio data, and the metadata, and outputting media data including the picture group, the audio data, and the metadata; You may comprise so that it may be further included.

In order to solve the above-described problem, according to another aspect of the present invention, there is provided a computer program for causing a computer to execute a video processing method for performing reordering to replace a sequence of image signals and encoding the image signals into pictures. Is done. The computer program includes independent coding means for grouping the pictures of one or more frames and coding them into independent picture groups independent of at least the front or rear picture groups; and pictures of one or more frames grouping, forward or backward of at least one of the group of pictures and the non-independent coding means for coding the non-independent picture group is relevant; recording start or recording end recording instruction accepting ∎ you can record instruction An accepting means; until the recording accepting instruction is accepted by the recording accepting means, after either the independent encoding means or the non-independent encoding means is instructed to encode, and after the recording start instruction is accepted Is a coding instruction means for instructing the non-independent coding means to perform coding; an independent picture group or a non-independent picture group is stored in the storage unit A storage means for storing; when a recording start instruction is received by the recording receiving means, a plurality of independent picture groups or non-independent picture groups stored in the storage unit are traced back for a predetermined time from the time when the recording start instruction is received , The computer is caused to function as acquisition means for acquiring one or more independent picture groups or non-independent picture groups in order from the independent picture group existing in the vicinity of the retroactive time point.

  As described above, according to the present invention, even video data in a compressed format that requires sequence rearrangement can be recorded from a point in time that is traced back by the cache REC.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, components having substantially the same functions and configurations are denoted by the same reference numerals, and redundant description is omitted.

(About recording and playback devices)
First, a recording / reproducing apparatus (video processing apparatus) 101 according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing an example of a schematic configuration of the recording / reproducing apparatus according to the present embodiment.

  The recording / reproducing apparatus 101 encodes an input video signal into video data, records it on the recording medium 131, decodes the video data recorded on the recording medium 131, and outputs an output device (output device) such as a display device This is a device that also has a playback function that outputs to

  Note that the recording / reproducing apparatus 101 is connected to an external apparatus with a cable or the like, for example, and inputs a video signal transmitted from the external apparatus, or the recording / reproducing apparatus 101 includes an image pickup unit such as a CCD. Even when a video signal transmitted by the imaging means is input, the input video signal can be encoded and recorded on a recording medium.

  When the recording / reproducing apparatus 101 includes the above-described imaging means, the recording / reproducing apparatus 101 records the video data obtained by imaging the subject or the like on the recording medium by the recording / reproducing apparatus 101 itself, or is recorded on the recording medium. This can be said to be a so-called recordable / reproducible integrated camcorder device that reproduces video data by the recording / reproducing device 101 itself.

  As shown in FIG. 1, a recording / reproducing apparatus 101 according to the present embodiment includes a recording instruction receiving unit 111, a control controller (for example, an encoding instruction unit) 113, an image encoding unit 115, and an audio encoding unit. 119, a meta encoding unit 121, an image decoding unit 123, an audio decoding unit 125, a meta decoding unit 127, a storage device (storage unit, acquisition unit) 133, a recording / reproducing unit 135, and a media encoding Unit 137 and a media decrypting unit 139.

  The recording instruction accepting unit 111 includes one or more buttons (for example, one or two or more buttons that can receive a recording start instruction, a recording end instruction, a cache REC function (or cache recording) valid / invalid instruction, etc.) from the user. REC start button, REC end button, etc.), but is not limited to such an example, and the recording instruction receiving unit 111 may be a trackball, a trackpad, a stylus pen as long as it can receive various instructions from the user. , A dial log, or a pointing device such as a joystick or a keyboard.

  It should be noted that the cache REC according to the present embodiment refers to, for example, encoded video data in the storage device 133 after the recording / reproducing apparatus 101 is powered on until a recording start instruction is issued by pressing the REC start button or the like. Is temporarily stored, and when a recording start instruction is given, the function can record the video data on the recording medium 140 from the point in time after receiving the recording start instruction. Will be discussed later.

  Further, when receiving an instruction from the user, the recording instruction receiving unit 111 transmits an instruction signal such as a recording start instruction signal indicating the instruction content to the control controller 113. The controller 113 controls each unit to execute a recording process and the like based on the instruction signal.

  The controller 113 controls processing of each unit (recording instruction receiving unit 111 to media decoding unit 139) provided in the recording / reproducing apparatus 101. For example, the control controller 113 instructs the image encoding unit 115 to specify the value of the data rate (bit rate) to be encoded, or sets the position where the video data (picture group etc.) corresponding to the point in time that is traced back a predetermined time is stored. Ask for the address to show.

  The image encoding unit 115 inputs an image signal obtained by converting an image signal (video signal) corresponding to an image portion of a video signal into a predetermined format such as SIF (Source Input Format).

  Note that the image signal according to the present embodiment is included in the video signal and will be described mainly using a moving image as an example, but the present invention is not limited to this example.

  The image encoding unit 115 rearranges (reorders) the sequence of the input image signal and encodes it into a GOP (Group Of Picture or a group of pictures) composed of one or more pictures.

  When the image encoding unit 115 receives an input of an image signal, the image encoding unit 115 compresses the image in a format such as MPEG2 or MPEG4 according to the data rate (or bit rate) received from the controller 113, and the GOP An image stream including one or two or more is output. The indicated data rate can be exemplified by a high data rate such as 30 Mbps to 50 Mbps or a low data rate such as 1.5 Mbps to 2.0 Mbps, but is not limited to such an example.

  The image encoding unit 115 outputs an image stream at a high data rate when the data rate is instructed from the controller 113 at a high data rate, and outputs an image stream at a low data rate when instructed at a low data rate. can do.

  Further, the image encoding unit 115 will be described in detail. The image encoding unit 115 includes an independent encoding unit 116 and a non-independent encoding unit 117. Independent encoding unit 116 and non-independent encoding unit 117 perform encoding in accordance with an instruction signal transmitted from control controller 113.

  In other words, if the control controller 113 instructs the independent encoding unit 116 to perform encoding, the independent encoding 116 performs encoding, while the control controller 113 performs non-independent encoding 117 encoding. When instructed, the non-independent encoding 117 performs encoding.

  The independent encoding unit 116 rearranges (reorders) the sequence of frames of the input image signal and codes the OPEN GOP (or independent picture group) composed of one or more frames. Turn into.

  The non-independent encoding unit 117 rearranges (reorders) the sequence of frames of the input image signal, and a CLOSED GOP (or a non-independent picture group) composed of one or more frames. Is encoded.

  Details of the OPEN GOP or the CLOSED GOP will be described later. Hereinafter, the OPEN GOP may be referred to as an open GOP and the CLOSED GOP may be referred to as a closed GOP, but these are substantially the same. In addition, data including the open GOP and / or the closed GOP may be collectively referred to as video data or image data.

  One or more open GOPs or one or more closed GOPs output from the independent encoding unit 116 or the non-independent encoding unit 117 are temporarily stored in the storage device 133.

  When the audio encoding unit 119 receives an audio signal corresponding to the audio portion of the video signal, the audio encoding unit 119 encodes the audio signal into audio data. As described in the image encoding unit 115, when the audio encoding unit 119 is instructed at a high data rate from the controller 113, the audio signal is encoded at a high data rate, and the audio encoding unit 119 is instructed at a low data rate. Then, the audio signal is encoded at a low data rate.

  The audio data encoded by the audio encoding unit 119 is temporarily stored in the storage device 133.

  When the meta encoding unit 121 receives an input of an attribute signal (RT signal: real time signal) in the video signal, the meta encoding unit 121 encodes the attribute signal into metadata. The attribute signal is real-time information about each frame of image and / or audio (video data), and more specifically, time code of image and / or audio (video data), shooting date and time, zoom Although a magnification etc. can be illustrated, it is not limited to this example. The data content of the metadata after encoding is basically the same as the attribute signal.

  The storage device 133 automatically stores data such as open GOP, closed GOP, audio data, and metadata output from the independent encoding unit 116, the non-independent encoding unit 117, the audio encoding unit 119, and the meta encoding unit 121. It can be stored in a storage area in the apparatus.

  The storage device 133 will be described more specifically. The storage device 133 includes a storage unit 129 and an acquisition unit 131.

  The storage unit 129 has a storage area of a predetermined size, can store the various data described above, delete the data, and change the data. The storage unit 129 manages the stored data based on the storage address indicating the location of the storage area that stores the data.

  The storage unit 129 may store a table (not shown) in which the time at which the data is stored and the storage address are associated in addition to the various data. Based on the above table, for example, data acquired by the controller 113 to acquire data may be instructed retroactively for a predetermined time.

  In addition, although the memory | storage part 129 concerning this Embodiment can illustrate memories, such as SDRAM and DRAM, for example, it is not limited to this example.

  The acquisition unit 131 reads data such as the open GOP, closed GOP, audio data, and metadata from the storage area of the storage unit 129 and outputs the data to the recording / playback unit 135 or the media encoding unit 137.

  When reading the target data, the acquisition unit 131 reads the data from the storage area of the storage unit 129 based on the storage address instructed from the controller 113 and outputs the data to the recording / reproducing unit 135 or the like.

  For example, the acquisition unit 131 arranges the open GOP or the close GOP in the order in which the recording / playback unit 135 writes (records) the image stream as an image stream in the recording medium 140, and similarly, the audio data Are arranged in the order in which they are written as attribute streams, and output to the recording / reproducing unit 135 substantially simultaneously.

  Note that the frame (or frame) according to the present embodiment includes a minimum unit image (or picture), audio, attribute, or the like configured in an image signal, open GOP, closed GOP, audio data, and metadata. Although shown, it is not limited to such examples.

  The recording / playback unit 135 records the recording image stream, audio stream, and attribute stream (video data) received from the acquisition unit 131 on the recording medium 140 or reads the video data recorded on the recording medium 140. The data is sent to the storage device 133.

  The recording medium 140 according to the present embodiment will be described taking an example of an optical disk such as CD, DVD, or Blu-ray Disc, but is not limited to such an example, and can be implemented even in the case of a magnetic disk or the like. It is.

  Note that the video signal according to the present embodiment includes at least one of an image signal, an audio signal, and an attribute signal. In addition, the video data obtained by encoding the video signal according to the present embodiment includes at least one of image data, audio data, and metadata.

  The image decoding unit 123 is a decoder that inputs the encoded video data read by the recording / reproducing unit 135 from the storage device 133 and decodes it into an image signal.

  The image decoding unit 123 includes an independent decoding unit 124 and a non-independent decoding unit 126. The independent decoding unit 124 decodes the closed GOP included in the video data into an image signal, and the non-independent decoding unit 126 decodes the open GOP included in the video data into an image signal.

  The audio decoding unit 125 is a decoder that inputs audio data of the video data read by the recording / reproducing unit 135 from the storage device 133 and decodes the audio data into an audio signal. The meta decoding unit 127 receives the data from the storage device 133. It is a decoder that inputs metadata and decodes it into attribute signals.

  The media encoding unit 137 acquires each of open GOP, closed GOP, audio data, and media data stored in the storage device 133, and encodes them into media data. The encoded media data is transmitted as a series of packet data to an external device such as an information processing device via a network (not shown). Although the media data will be described in detail later, the data rate of the media data may be set to a low data rate so that it can be transmitted quickly according to the network load.

  The media decoding unit 139 decodes the media data, and sends each of open GOP, closed GOP, audio data, and media data to the storage device 133. When acquiring the above data, the acquiring unit 131 stores the data in the storage area of the storage unit 129. The media decoding unit 139 receives media data from an external device via a network.

  The media data according to the present embodiment has been described by way of example in which data is transmitted and received between the external apparatus and the recording / reproducing apparatus 101 via a network. The present invention can be implemented even when the apparatus and the recording / reproducing apparatus 101 are line-connected with a cable or the like and media data is transmitted / received via the cable.

  The network according to the present embodiment is a transmission medium capable of transmitting various data such as media data from the apparatus to the apparatus. More specifically, the network may be a cable connected to peer-to-peer, or a public line network such as the Internet connected by a similar method such as ADSL (Asymmetric Digital Subscriber Line) or FTTH (Fiber To The Home). It may be a closed line network, and also includes a satellite communication network regardless of wired / wireless.

  Although not shown in FIG. 1, the recording / reproducing apparatus 101 may further include a display device (not shown) that can output a video signal output from a decoder such as the image decoding unit 123. For example, the display device can display the image signal output from the image decoding unit 123 on the screen. The display device can be exemplified by a liquid crystal display, for example, and can output a still image, a moving image, audio, or any combination thereof.

(About GOP)
Next, the GOP according to this embodiment will be described. GOP is a collection of one or more pictures (image data) encoded by the image encoding unit 115.

  Note that the GOP according to the present embodiment is called a so-called Long GOP. For example, one GOP may include pictures of 60 frames or more. However, the GOP is not limited to this example. For example, one GOP includes 10 to 15 frames. It may be composed of the pictures.

  The picture includes an I picture (Intra picture or intra-frame encoded image), a P picture (Predictive picture or inter-frame forward prediction encoded image), and a B picture (Bidirectionally predictive encoded image). Or bi-predictive encoded image) and three types of pictures. In addition, the picture concerning this Embodiment means the image or data of each flame | frame comprised by the image data after encoding, However, It is not limited to this example.

  The I picture is an independent picture that does not use the correlation with the previous frame, the P picture is a picture that uses the correlation with the previous frame, and the B picture includes both the previous and next frames. It is a picture that uses the correlation of.

  In general, the image quality at the same bit rate is better when the B picture is sandwiched between the I picture or the P picture than when only the I picture and the P picture are used without using the B picture.

  Next, an open GOP or a closed GOP according to the present embodiment will be described with reference to FIG. FIG. 2 is an explanatory diagram showing a schematic configuration of an open GOP and a closed GOP according to the present embodiment.

  An open GOP is characterized in that a picture is referred to between preceding and following GOPs. Therefore, the open GOP has an advantage that the compression efficiency at the time of encoding is high, but on the other hand, the GOP is independent and the editing efficiency is low because the pictures configured in the preceding and following GOPs are referred to.

  As shown in FIG. 2A, OPEN GOP (open GOP) is an example in which there is an n-1 GOP that is the n-1st GOP and an nGOP that is the nth GOP thereafter. explain. Note that n is a natural number larger than 1.

  In the n-1 GOP, B0, B1,..., B13, P14 and a plurality of pictures are arranged. In this embodiment, in order to specify the picture configured in the GOP, for example, “B13” is described, but the left B of “B13” is the type of picture such as B picture. The numeral 13 on the right side indicates the frame number.

  In the open GOP, as shown in FIG. 2A, for example, B0 of the nGOPs needs to refer to the P14 picture of the n-1 GOP which is the preceding and following GOPs. Similarly, it is necessary to refer to P14 for B1 in the nGOP. That is, in the case of an open GOP, it is linked by the preceding and following GOPs.

  Next, the closed GOP is characterized in that, unlike the open GOP, the picture is not referred to between the preceding and succeeding GOPs. Therefore, the closed GOP has a drawback that the compression efficiency at the time of encoding is low, but on the other hand, since the pictures configured in the preceding and succeeding GOPs are not referred to, the GOP is independent and the editing efficiency is good.

  More specifically, in the case of a closed GOP, the B pictures of the first few frames in the GOP do not depend on the pictures configured in the previous GOP. When encoding to such a closed GOP, the independent encoding unit 117 receives an instruction from the control controller 113 and encodes to a closed GOP by setting a flag such as a closed GOP flag to GOP at the time of encoding.

  As shown in FIG. 2 (b), for example, B0 of nGOP in the CLOSED GOP (closed GOP) does not refer to the P14 picture of n-1 GOP. Similarly for B1 of nGOP, P14 is not referred to.

(About cache REC when open GOP is used)
As described above, an open GOP and a closed GOP exist in the GOP, and the open GOP and the closed GOP have been described. Next, the cache REC when encoded with such an open GOP will be described with reference to FIG. FIG. 3 is an explanatory diagram showing an outline of the cache REC in the case of the open GOP according to the present embodiment.

  As shown in FIG. 3, for example, when the power of the recording / reproducing apparatus 101 is turned on, the video is automatically and temporarily stored in the storage device 133 by the cache REC function.

  In one or more open GOPs corresponding to images in the video recorded in the storage device 133, as shown in FIG. 3, a plurality of pictures such as I2, B0, B1,. It is arranged. It should be noted that one open GOP is composed of pictures (B0 to P14) having frame numbers 0 to 13, and one open GOP is composed of pictures (B15 to P20) having frame numbers 15 to 19.

  Similarly, the audio data corresponding to the audio in the video is composed of A0, A1,..., A20 and a plurality of frames and stored in the storage device 133 as shown in FIG. Similarly, the metadata corresponding to the attribute is composed of R0, A1,..., A20 and a plurality of frames, and is stored in the storage device 133.

  As shown in FIG. 3, audio data (voice) and media data (attributes) before and after encoding are synchronized on a frame basis, but only the GOP data (image) is positioned backward and forward after encoding. It's off. This is because a process of rearranging by reordering occurs when encoding an image signal into a B picture, and is delayed by that amount.

  Here, for example, when the recording instruction receiving unit 111 receives an instruction to start recording from the user, the cache REC function acquires the video data temporarily stored before the recording start instruction by going back a predetermined time. However, it is assumed that, for example, the video data (B15, A15, R15) corresponding to the frame number “15” is the time point that is traced back by the predetermined time (the thick frame shown in FIG. 3).

  The audio data starting with A15 and the metadata starting with R15 are encoded independently for each frame, so that the data can be acquired without any problem. However, for the head B15 in the open GOP, , P14, I2, etc., need to be referenced, and since B15 alone cannot be decoded, GOP data cannot be acquired sequentially from B15. As a result, it is necessary to acquire GOP data from I2 shown in FIG.

  Therefore, when synchronizing the image (GOP) and the sound (audio data) or the attribute (metadata), it becomes difficult to determine which frame the image and the sound should be synchronized (or lip sync). It is difficult to realize the cache REC function.

  On the other hand, even when it is assumed that the time point that is a predetermined time later by the cache REC function is, for example, the video data (I17, A17, R17) corresponding to the frame number “17”, It is necessary to refer to a picture such as P14 configured in the GOP.

  Therefore, even if the recording / reproducing apparatus 101 does not record the picture such as P14 configured in the previous open GOP on the recording medium 140 but records it on the recording medium 140 with B17, B16,. When the GOPs B15 and B16 are decoded and played back, inconsistency occurs and extra data is displayed on the screen, which makes the user uncomfortable.

  As a result, in the case of an open GOP, it is difficult to realize the cache REC function. However, this problem can be solved by using the closed GOP described below. Next, the cache REC in the case of a closed GOP will be described.

(Cache REC for CLOSED GOP)
Next, with reference to FIG. 4, the cache REC in the case of encoding with the closed GOP according to the present embodiment will be described. FIG. 4 is an explanatory diagram showing an outline of the cache REC when the closed GOP according to the present embodiment is used.

  As shown in FIG. 4, one or more CLOSED GOPs (closed GOPs) corresponding to an image among videos recorded in the storage device 133 include I2, B0, B1,. Multiple pictures are arranged.

  Similarly, the audio data corresponding to the audio in the video is composed of A0, A1,..., A20 and a plurality of frames and stored in the storage device 133 as shown in FIG. Similarly, the metadata corresponding to the attribute is composed of R0, A1,..., A20 and a plurality of frames, and is stored in the storage device 133.

  As shown in FIG. 4, as described above, it can be seen that the encoded audio data (speech) and media data (attributes) are synchronized in units of frames, but there is a time delay due to reordering. Thus, only the GOP data (image) shifts the frame synchronization position backward.

  Here, for example, when the recording instruction receiving unit 111 receives an instruction to start recording from the user, for example, video data (B15, A15,. R15) (thick frame shown in FIG. 4).

  The audio data starting with A15 and the metadata starting with R15 are encoded independently in frame units, as in the case shown in FIG. 3, so that data can be acquired without any problem. Further, for B15 in the closed GOP, it is not necessary to refer to pictures such as P14 and I2 configured in the previous GOP, and only I17 need be referred to.

  Therefore, when the frame number 15 is the head, it is only necessary to obtain B15, B16,... Further, when video data is decoded and reproduced, the image (closed GOP) and audio (audio data) or attribute (metadata) are synchronized (or lip-synced) with frame number 15 (B15, A15, R15). It can be easily discriminated.

  From the above, it can be seen that in the case of a closed GOP, the cache REC function can be easily realized. However, in the case of a closed GOP, as described above, the compression efficiency is worse than that of an open GOP. Therefore, in the series of recording processing by the cache REC function according to the present embodiment, the closed GOP and the open GOP are used together to improve the compression efficiency. Next, a series of recording processes using a more specific cache REC function will be described.

(Recording processing using the cache REC function)
Next, a series of recording processes using the cache REC function according to the present embodiment will be described with reference to FIGS. FIG. 5 is a flowchart showing an outline of a recording process using the cache REC function according to this embodiment. FIGS. 6 to 7 show a recording process using the cache REC function according to this embodiment. It is explanatory drawing which shows an outline.

  As shown in FIG. 5, after the recording / reproducing apparatus 101 is turned on, for example, a button or switch (not shown) for switching the cache REC function provided in the recording instruction receiving unit 111 between valid / invalid is pressed by the user. Then, the controller 113 determines that the cache REC function is valid (S501). Note that the cache REC according to the present embodiment can be implemented even when it is determined in advance so that the cache REC function becomes effective when the power of the recording / reproducing apparatus 101 is turned on.

  The controller 113 constantly monitors the valid / invalid state of the cache REC function (S501), and if the cache REC function is valid, then the image signal is input and the independent encoding unit 116 encodes the closed GOP. And is written in the storage unit 129 in the storage device 133 (S503).

  Similarly, when an audio signal is input, the audio encoding unit 119 encodes the audio data, and writes the audio data in the storage unit 129 (S505). Also, the attribute signal is input, the meta encoding unit 121 encodes the metadata, and writes the metadata in the storage unit 129 (S507).

  The processes in steps S503 to S507 are repeatedly executed until the REC start button provided in the recording instruction receiving unit 111 is pressed by the user (S509).

  In the present embodiment, the case where each of the plurality of writing processes in steps S503 to S507 is performed in parallel and independently is described as an example. However, the present invention is not limited to this example. For example, step S505 may be performed after the process, and step S507 may be performed after the process. For example, the process may be repeatedly performed in the order of step S503, step S505, and step S507.

  Further, while the writing processes in steps S503 to S507 are continuously performed, it is necessary to temporarily store data such as a closed GOP in the storage area of the storage unit 129. If the data exceeds the capacity, return to the beginning of the storage area again, overwrite the existing data in order from the position corresponding to the start address, and store new data. Good. That is, the storage unit 129 may be a so-called ring buffer or the like in which addressing is devised by providing a pointer for reading video data such as a closed GOP and a pointer for writing.

  Next, when the REC start button provided in the recording instruction reception unit 111 is pressed by the user (S509), the control controller 113 receives a recording start signal indicating the start of recording by pressing the REC start button from the recording instruction reception unit 111. Then, recording processing (S511, S513) for recording video data on the recording medium 140 is started.

  The controller 113 instructs the image encoding unit 115 to encode an image signal input after receiving the recording start signal into a closed GOP. In the image encoding unit 115, the encoding process by the independent encoding unit 116 is stopped, and the encoding process by the non-independent encoding unit is started (S511).

  By switching from the closed GOP to the open GOP, the compression efficiency can be improved, and the recording time can be further extended compared to the recording time when only the closed GOP is recorded on the recording medium 140.

  On the other hand, when receiving the recording start signal, the controller 113 goes back by a predetermined time by the cache REC function and records the video data on the recording medium 140 from the past video data from the time when the user instructed to start recording. An address (address indicating a data storage position in the storage area of the storage unit 129) of the head portion of the video data corresponding to a time point that is back by a predetermined time is obtained.

  For example, the controller 113 calculates the GOP head position (or the position of the head picture) at a position retroactive for a predetermined time on the basis of the number of frames configured in one GOP, etc., and records the position on the recording medium 140 As the start position, the position of the audio data and metadata of the first frame (or picture) corresponding to the recording start position is also obtained.

  More specifically, the controller 113 obtains the total number of frames for a predetermined time determined by the cache REC based on, for example, the number of frames (frame rate) configured in the GOP, and the recording instruction receiving unit The address of the first frame (or picture) stored in the past for the determined number of frames from the time when the recording start signal is received by 111 (the time when the REC start button is pressed) is the GOP, audio data, and metadata. Find out about each. If the first frame is not the first picture configured in the GOP, the first picture configured in the closed GOP after correction is set as the first frame to start recording, but the present invention is not limited to this example. The found uncorrected frame may be used as the recording start position.

  Next, the acquiring unit 131 acquires the corresponding closed GOP, audio data, and metadata (video data) based on the address of the head portion of the recording start position obtained by the controller 113, and the recording / reproducing unit 135. Is recorded (written) on the recording medium 140 (S513). The process of recording on the recording medium 140 (S513) continues until the REC end button is pressed (S515).

  The video signal is encoded and stored in the storage area of the storage unit 129 continuously while the video data is being recorded on the recording medium 140 from the beginning of the GOP when the cache REC function goes back for a predetermined time. S511). The process of storing data such as GOP in the storage unit 129 (S511) continues until the REC end button is pressed (S515).

  Next, when the REC end button provided in the recording instruction receiving unit 111 is pressed by the user (S515), the control controller 113 receives a recording end signal indicating the recording end from the recording instruction receiving unit 111.

  Thereafter, the control controller 113 instructs the image encoding unit 115, the audio encoding unit 119, and the meta encoding unit 121 to stop the input of the video signal and end the encoding, and instructs the acquisition unit 131 to end the encoding. Even in this case, the GOP, audio data, and metadata up to the point when the REC end button is pressed are instructed to be transmitted to the recording / reproducing unit 135.

  When the recording / reproducing unit 135 records the GOP, audio data, and metadata (video data) up to the point when the REC end button is pressed on the recording medium 140, the series of recording processing ends (S517).

  Next, a series of recording processes using the cache REC function will be described with reference to FIG. 6 or FIG. 7. As shown in FIG. 6, an image signal, an audio signal, and an attribute signal are sent to each encoding unit. Input and encoded.

  When the image signal is encoded by the image encoding unit 115, the sequence of the image signals (B0, B1,..., B19, P20) needs to be rearranged. ) Or metadata (R0 to R20).

  For example, as shown in FIG. 6, when B0 or B1 configured in an image signal is encoded, B0 changes from frame number 0 to frame number 1 due to reordering, and B1 changes from frame number 1 to frame number 2. Therefore, both are subsequent frames of I2.

  The GOP shown in FIG. 6 is a closed GOP, and one GOP is formed by I2, B0,... B13, and one GOP is formed by I17, B15,.

  The GOP, audio data (A0 to A20), and metadata (R0 to R20) are data stored in the storage unit 129 by the cache REC function (S503 to S507).

  Here, for example, if the frame number corresponding to the time point that is a predetermined time after the user presses the REC start button is “15”, the encoded B15 picture is not the first frame in the GOP. Therefore, the controller 113 determines that I17 is the first frame.

  Accordingly, GOPs are similarly recorded on the recording medium 140 for B15, B16,... Audio data and metadata are recorded on the recording medium 140 in order from the frame number 15 (A15, R15).

  As shown in FIG. 7, it can be seen that audio data and metadata are similarly recorded on the recording medium 140 in order from the head position of the GOP that is back a predetermined time from when the REC start button is pressed.

  Further, until the time when the REC start button is pressed, the storage unit 129 always stores a CLOSED GOP (closed GOP). It can be seen that it is encoded in (open GOP).

  In a series of recording processes using the cache REC function according to the present embodiment, image signals, audio signals, and attribute signals are encoded, and GOP data, audio data, and metadata are stored in the storage unit 129 or the recording medium. However, the present invention is not limited to such an example. For example, at least one of an image signal, an audio signal, and an attribute signal is encoded and stored in the storage unit 129 or the recording medium 140. Or, even when recording in both, it is possible.

  The predetermined time that can be traced back by the cache REC function according to the present embodiment is, for example, 10 seconds. However, the predetermined time can be set according to the storage capacity of the storage unit 129. In addition, the user may freely change the set time.

(About media data)
Next, media data according to the present embodiment will be described with reference to FIG. FIG. 8 is an explanatory diagram showing an example of a schematic configuration of media data according to the present embodiment.

  As shown in FIG. 8A, the media data is composed of one or more packets. Therefore, the external device such as a PC (personal computer) as well as the other recording / reproducing devices 101 can receive the packet constituted by the media data from the recording / reproducing device 101 via the network.

  If all packets received by an external device such as a PC are reconstructed into a series of media data and the media data is decoded, a moving image can be displayed on the screen and audio can be output to a speaker or the like.

  As shown in FIG. 8B, in a packet configured as media data, an area (meta storage area) for storing one or more frames of metadata and an area for storing pictures or GOPs (meta storage area) An image storage area) and an area for storing audio data of one or more frames (audio storage area) are allocated. In addition, although the system information corresponding to the header etc. which contains a transmission destination address is further stored in the area | region where metadata is stored, it is not limited to this example.

  In addition, in the area where pictures or GOPs are stored, data may be stored in units of pictures of one or more frames, or data may be stored in units of one or more GOPs.

  As shown in FIG. 8C or FIG. 8D, if there is at least one storage area among the meta storage area, the image storage area, and the audio storage area, any area is allocated in each packet. However, it can be implemented.

  In addition, when media data encoded using the cache REC function is transmitted via a network, for example, if I17 shown in FIG. In 1, for example, data continuous for one or more frames from I17, A15, and R15 is set in each storage area.

  More specifically, for example, pictures of I17, B15, and B16 are stored in the image storage area, audio data of A15, A16, and A17 are stored in the audio storage area, and the meta storage area is stored. Stores metadata of R15, R16, and R17.

  An external device such as a PC that has received the packet can reproduce images, sounds, and the like synchronously by sequentially decoding from the frame number 15 (B15, A15, R15) of the first packet (packet 1) of the media data. .

  However, the present invention is not limited to this example. For example, the present invention can be implemented even when one or more GOPs are stored in the image storage area with the GOP having the I17 picture as the first frame as the first GOP. The metadata and / or audio data can be implemented even when, for example, data corresponding to the number of frames (or video time) configured in the GOP is stored in the meta storage area and the audio storage area.

(Regarding the recording apparatus 102)
Next, a recording apparatus (video processing apparatus) 102 will be described as a modification of the recording / reproducing apparatus 101 according to the present embodiment with reference to FIG. FIG. 9 is a block diagram showing a schematic configuration of the recording apparatus according to the present embodiment. In the following, the differences between the recording / reproducing apparatus 101 and the recording apparatus 102 according to the present embodiment will be particularly described in detail, and the other points are substantially the same, and the description thereof will be omitted.

  As shown in FIG. 9, when a recording / reproducing apparatus 101 according to the present embodiment is compared with a recording apparatus 102 which is a modified example thereof, the recording apparatus 102 is different in that it does not have a reproducing function.

  That is, since the recording apparatus 102 includes the recording unit 145 and does not include the recording / reproducing unit 135, the video data can be recorded on the recording medium 140, but the video data recorded on the recording medium 140 is read. Cannot be played.

  Further, since the recording device 102 does not include a decoder such as the image decoding unit 123, the space of the recording device 102 can be effectively utilized or the recording device 102 can be downsized accordingly. Others are the same as those of the recording / reproducing apparatus 101 described above.

(Variation of recording process using cache REC function)
Next, a modification of the recording process using the cache REC function according to the present embodiment will be described with reference to FIG. FIG. 10 is an explanatory diagram showing an outline of a recording process using the cache REC function according to this embodiment. In the following, the differences between the recording process shown in FIG. 7 and the recording process shown in FIG. 10 will be described in detail, and the other points are substantially the same, and the description thereof will be omitted.

  When the recording process shown in FIG. 10 is compared with the recording process shown in FIG. 6, in the recording process shown in FIG. 10, the OPEN GOP ( The difference is that open GOP) and CLOSED GOP (closed GOP) are mixed.

  That is, in the recording process shown in FIG. 6, all closed GOPs are stored in the storage unit 129 before the REC start button is pressed. However, in the recording process shown in FIG. 10, the closed GOP and the open GOP are mixed. Since the data is stored in the storage unit 129, the recording time can be further extended compared to the recording time recorded on the recording medium 140 by the recording process shown in FIG.

  Note that the control controller 113 needs to obtain the storage address of the first picture of the closed GOP corresponding to a point in time that is traced back a predetermined time, and at least one closed GOP is stored in the GOP before the REC start button is pressed. 129 need to be stored. If the GOP corresponding to the point in time that is a predetermined time later is not a closed GOP, the controller 113 obtains the storage address of the first picture of the closed GOP that is present at the closest position to the corresponding GOP. Others are the same as the series of recording processes shown in FIG. 6 described above.

  The series of recording processes described above can be performed by dedicated hardware or software.

  When the series of recording processes is realized by software, a program constituting the software is installed in an information processing apparatus such as a general-purpose computer or a microcomputer, and the program configures the information processing apparatus as the recording / reproducing apparatus 101 or the recording apparatus. Function as 102.

  The program can be recorded in advance on a hard disk, ROM, EEPROM, or the like as a recording medium built in the computer.

  Alternatively, the program is not limited to a hard disk drive, but a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, and a semiconductor memory. In addition, it can be stored (recorded) temporarily or permanently. Such a removable recording medium can be provided as so-called package software.

  The program is installed on the computer from the above-described removable recording medium, wirelessly transferred from the download site to the computer via a digital satellite broadcasting artificial satellite, a LAN (Local Area Network), and the Internet. Such a program can be transferred to a computer via a network, and the computer can receive the program transferred in this way and install it on a built-in hard disk.

  Here, in this specification, the processing steps for describing a program for causing a computer to perform various processes do not necessarily have to be processed in time series in the order described in the flowchart, but in parallel or individually. This includes processing to be executed (for example, parallel processing or processing by an object).

  The program may be processed by one computer, or may be processed in a distributed manner by a plurality of computers.

The detailed description of the recording process using the recording / reproducing apparatus 101, the recording apparatus 102, and the cache REC function according to the present embodiment has been finished. However, the recording / reproducing apparatus 101, the recording apparatus 102, or the recording process There are excellent effects as shown below.
(1) Even in the case of an encoding process in which reordering occurs, the cache REC function can be easily realized by encoding into a closed GOP until a recording start instruction is issued.
(2) If the closed GOP is temporarily stored, it is possible to easily lip-sync the GOP data corresponding to the point in time that is traced back by the cache REC function and the audio data or metadata.
(3) Since it is encoded into a closed GOP until a recording start instruction is issued and is encoded into an open GOP after the recording start instruction, the compression efficiency can be improved, and the recording time that can be recorded on the recording medium 140 is extended. be able to.
(4) Since the device for decoding media data can easily identify the start position of audio data or metadata to be lip-synced with GOP data, it can be decoded appropriately and can output video data to an output device.
(5) Until a recording start instruction is issued, at least one image signal is encoded in a closed GOP, and other image signals are encoded in an open GOP, thereby further improving the compression efficiency and the recording medium 140 The recordable recording time can be extended.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, this invention is not limited to this example. It is obvious for those skilled in the art that various changes or modifications can be envisaged within the scope of the technical idea described in the claims, and these are naturally within the technical scope of the present invention. It is understood that it belongs.

  In the above embodiment, encoding / decoding has been described by taking the case of applying MPEG such as MPEG1, MPEG2, MPEG4, etc. as an example. It is not limited to examples.

  In the above-described embodiment, the case where media data is transmitted / received between an external device and the recording / reproducing device 101 or the recording device 102 via a network has been described as an example. However, the present invention is not limited to this example. The present invention can be implemented even when the external device and the recording / reproducing device 101 or the recording device 102 are line-connected with a cable or the like and media data is transmitted / received via the cable.

  In the above embodiment, the frame (or field) indicates a minimum unit picture (image) or audio constituting the video data, but is not limited to this example. The present invention can also be implemented in the case of showing a GOP composed of a plurality of frames of the picture or audio and / or video (video data) in the GOP.

  In the above-described embodiment, when the recording start is instructed to the recording medium 140, or when the cache REC function is instructed to be valid / invalid, the buttons provided in the recording instruction receiving unit 111 (REC start button, cache REC valid button, etc.) However, the present invention is not limited to such an example as long as the user can instruct the recording / reproducing apparatus 101 to perform such processing, and any input means can be used. is there.

  In the above embodiment, the image encoding unit 115, the audio encoding unit 119, the meta encoding unit 121, the image decoding unit 123, the audio decoding unit 125, and the meta decoding unit 127 are exemplified as a case of hardware. Although described, the present invention is not limited to such examples. For example, each unit may be a program composed of one or two or more modules or components.

It is a block diagram which shows an example of a schematic structure of the recording / reproducing apparatus concerning this Embodiment. It is explanatory drawing which shows schematic structure of the open GOP and closed GOP concerning this Embodiment. It is explanatory drawing which shows the outline of cache REC at the time of setting it as the open GOP concerning this Embodiment. It is explanatory drawing which shows the outline of cache REC at the time of setting it as closed GOP concerning this Embodiment. It is a flowchart which shows the outline of the recording process using the cache REC function concerning this Embodiment. It is explanatory drawing which shows the outline of the recording process using the cache REC function concerning this Embodiment. It is explanatory drawing which shows the outline of the recording process using the cache REC function concerning this Embodiment. It is explanatory drawing which shows an example of a schematic structure of the media data concerning this Embodiment. 1 is a block diagram showing a schematic configuration of a recording apparatus according to an embodiment. It is explanatory drawing which shows the outline of the recording process using the cache REC function concerning this Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Recording / reproducing apparatus 102 Recording apparatus 111 Recording instruction reception part 113 Control controller 115 Image encoding part 116 Independent encoding part 117 Non-independent encoding part 119 Audio encoding part 121 Meta encoding part 129 Storage part 131 Acquisition part 133 Storage apparatus 135 Recording / Reproducing Unit 137 Media Encoding Unit 140 Recording Medium 145 Recording Unit

Claims (18)

A video processing device that performs reordering to replace a sequence of image signals and encodes the image signals into pictures:
An independent encoding unit that groups the pictures of one or more frames and encodes them into an independent picture group that is independent of at least a front or rear picture group;
A non-independent encoding unit that groups the pictures of one or more frames and encodes them into a non-independent picture group that is related to at least one of the front and rear picture groups;
Accepting an instruction to record the recording start or end of recording and the record instruction reception unit;
Until either the independent encoding unit or the non-independent encoding unit is instructed to encode until the recording start instruction is received by the recording reception unit, and after the recording start instruction is received Is an encoding instruction unit that instructs the non-independent encoding unit to perform encoding;
A storage unit that stores the independent picture group or the non-independent picture group in the order of output from either the independent encoding unit or the non-independent encoding unit;
When the recording start instruction is received by the recording receiving unit, the plurality of independent picture groups or non-independent picture groups stored in the storage unit are traced back by a predetermined time from the time when the recording start instruction is received. An image processing apparatus comprising: an acquisition unit configured to acquire one or more independent picture groups or non-independent picture groups in order from the independent picture group existing in the vicinity of the time point.   The video processing apparatus according to claim 1, wherein the acquisition unit acquires sequentially from a head position of the independent picture group existing in the vicinity of the retroactive time point.   The video processing apparatus according to claim 1, wherein each picture included in the independent picture group is decoded independently within the independent picture group.   The picture according to claim 1, wherein each picture included in the non-independent picture group is decoded by referring to a picture included in a front or rear independent picture group or non-independent picture group. Video processing device. The video processing apparatus further includes a recording unit capable of recording on a recording medium,
The video processing apparatus according to claim 1, wherein the recording unit sequentially records the independent picture group or the non-independent picture group acquired by the acquisition unit on the recording medium.   The recording unit records the independent picture group or the non-independent picture group acquired in order from the independent picture group existing in the vicinity of the retroactive time point by the acquiring unit on the recording medium, and the recording start instruction 2. The video processing apparatus according to claim 1, wherein after being received, the non-independent encoding unit records the non-independent picture group encoded and acquired by the acquisition unit on the recording medium.   The encoding instruction unit instructs the independent encoding unit to perform encoding until the recording start instruction is received by the recording reception unit, and after the recording start instruction is received by the recording reception unit. The video processing apparatus according to claim 1, wherein the instruction unit instructs the non-independent encoding unit to perform encoding.   The picture is an I picture encoded with an intra-picture independent encoding method, a P picture encoded with a unidirectional prediction encoding method, or a B picture encoded with a bidirectional prediction encoding method. The video processing apparatus according to claim 1, wherein the video processing apparatus is at least one of them. The video processing device includes an audio encoding unit that encodes an audio signal into audio data;
A media encoding unit that synchronizes the audio data with at least one picture group of the independent picture group or the non-independent picture group and outputs media data including the picture group and the audio data; The video processing apparatus according to claim 1, wherein: The video processing apparatus further includes a meta encoding unit that encodes an attribute signal related to the image signal and / or audio signal into metadata,
The media encoding unit synchronizes at least one picture group of the independent picture group or the non-independent picture group, the audio data, and the metadata, and combines the picture group, the audio data, and the metadata. The video processing apparatus according to claim 1, wherein the media data is output.   The video processing apparatus according to claim 1, wherein the media data is one or more packet data. The video processing apparatus includes an audio encoding unit that encodes an audio signal into audio data of one or more frames;
Media data including a picture included in at least one picture group out of the independent picture group or the non-independent picture group and the audio data in units of one or more frames and including the picture and audio data The video processing apparatus according to claim 1, further comprising: a media encoding unit that outputs. The video processing apparatus further includes a meta encoding unit that encodes an attribute signal related to the image signal and / or audio signal into metadata of one or more frames,
The media encoding unit synchronizes a picture included in at least one of the independent picture group or the non-independent picture group, the audio data, and the metadata in units of one or more frames. 2. The video processing apparatus according to claim 1, wherein media data including the picture, audio data, and metadata is output. A video processing method that performs reordering to replace a sequence of image signals and encodes the image signals into pictures:
Until the recording start instruction is received, an independent encoding step of grouping the pictures of one or more frames and encoding them into independent picture groups that are independent of at least the front or rear picture groups, or 1 or 2 Executes one of the non-independent encoding steps for grouping the pictures of frames or more into a non-independent picture group that is related to at least one of the forward or backward picture group. A first storing step of storing the independent picture group or the non-independent picture group in a storage unit;
When the recording start instruction is received, the plurality of independent picture groups or the non-independent picture groups stored in the storage unit in the first storage step is traced a predetermined time from the time when the recording start instruction is received, A first acquisition step of acquiring one or more independent picture groups or non-independent picture groups in order from the independent picture group existing in the vicinity of the retroactive time point;
A video processing method comprising: a second storing step of executing the non-independent encoding step after the recording start instruction is received and storing the non-independent picture group in the storage unit.   The video according to claim 14, wherein the video processing method further includes a first recording step of recording the independent picture group or the non-independent picture group acquired in the first acquisition step on a recording medium. Processing method. The video processing method includes a second acquisition step of acquiring the non-independent picture group stored in the storage unit in the second storage step;
16. The video processing method according to claim 15, further comprising a second recording step of recording the non-independent picture group acquired in the second acquisition step on the recording medium. The video processing method includes an audio encoding step of encoding an audio signal into audio data;
A meta-encoding step of encoding attribute signals relating to the image signal and / or audio signal into metadata;
At least one of the independent picture group or the non-independent picture group, the audio data, and the metadata are synchronized, and media data including the picture group, the audio data, and the metadata is output. The video processing method according to claim 14, further comprising a media data output step. A computer program for causing a computer to execute a video processing method for performing reordering to replace a sequence of image signals and encoding the image signals into pictures:
Independent coding means for grouping the pictures of one or more frames into at least one independent picture group independent of the front or rear picture group;
Non-independent encoding means for grouping the pictures of one or more frames and encoding them into a non-independent picture group associated with at least one of the front and rear picture groups;
And the record instruction receiving means for accepting an instruction to record the recording start or end of recording;
Until either the independent encoding unit or the non-independent encoding unit is instructed to encode until the recording start instruction is received by the recording receiving unit, and after the recording start instruction is received Encoding instruction means for instructing the non-independent encoding means to encode;
Storage means for storing the independent picture group or the non-independent picture group in a storage unit;
When a recording start instruction is received by the recording receiving means, a plurality of independent picture groups or non-independent picture groups temporarily stored in the storage unit are traced back for a predetermined time from the time when the recording start instruction is received. , A computer program for causing a computer to function as acquisition means for acquiring one or more independent picture groups or non-independent picture groups in order from the independent picture group existing in the vicinity of the retroactive time point.

Images