JP2009010714A - Moving picture encoded data converter - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently perform transcode operation and reduce hardware resources with controlling the increase of data. <P>SOLUTION: A moving picture encoded data converter has a decoder which decodes encoded moving image data, a synthesizer which synthesizes a plurality of moving images into one screen, and an encoder which encodes synthesized image data based on each picture information of the plurality of moving images and GOP interval information. The encoder encodes synthesized image data in a display order of the synthesized images, and encodes the synthesized image data displayed at a time interval according to the GOP interval information to generate I-pictures. In addition, the encoder encodes the synthesized image data displayed during the time interval to generate P-pictures, and then the synthesized images are encoded as I-pictures. If moving pictures that are I-pictures are included in the synthesized images that are encoded as P-pictures, parts that the moving pictures included in the synthesized images are displayed are encoded as black images, and the parts are remained as black images until the synthesized images are encoded as I-pictures. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a moving image encoded data conversion apparatus for converting the configuration of a digitally compressed image.

  A conventional moving image encoded data conversion apparatus performs transcoding that changes the configuration of a group of pictures (GOP) of moving image encoded data that has already been digitally compressed in a digital compression method such as MPEG2 or H.264. By doing so, it is possible to improve random accessibility when playing back moving images and facilitate special playback (for example, Patent Document 1). As defined in the MPEG standard, a GOP is a unit that has an I picture, a P picture, and a B picture and can start playback, as shown in FIG.

Japanese Patent No. 3321332

  In the conventional moving image coded data conversion apparatus described above, when adapting to a system that displays a plurality of digital compressed moving images on one multi-screen synthesized monitor, the GOP of each digital compressed moving image is set. Transcode in parallel while synchronizing. For this reason, depending on the relationship of the GOP configuration of each digital compressed moving image, transcoding cannot be performed efficiently, and random accessibility when reproducing a plurality of channels as a multi-screen synthesized image cannot be compensated. Therefore, when a desired multi-screen composite image is searched while searching in the reverse direction and is reproduced as a multi-screen composite image from the searched location, a large calculation time may be required. In addition, when a plurality of conventional moving image encoded data converters are used in parallel, hardware resources increase.

  The object of the present invention is to search for a multi-screen composite image in the reverse direction while efficiently transcoding and suppressing an increase in the amount of data even when applied to a system that synthesizes a plurality of moving images on one screen. An object of the present invention is to provide a moving image encoded data conversion apparatus capable of performing reproduction from a point in time at high speed and reducing hardware resources.

  The present invention relates to a decoder that decodes encoded moving image data, and a combining unit that combines a plurality of moving images obtained by the decoder decoding each of the plurality of encoded moving image data into one screen. And an encoder that encodes the composite image data obtained by the synthesis unit on the basis of each picture information and GOP interval information of the plurality of moving images, and stores the composite image data encoded by the encoder A storage unit that encodes the composite image data in the display order of the composite image, encodes the composite image data displayed at the time interval indicated by the GOP interval information, and outputs the I Generates a picture, encodes synthesized image data displayed during the time interval, generates a P picture, and is composed of the I picture and the P picture When the GOP of the synthesized image is generated, the synthesized image is encoded as an I picture, and a moving image in which the picture information indicates the I picture is included in the synthesized image encoded as the P picture, The portion of the composite image that is encoded as the P picture is encoded as a black image until the portion of the composite image where the moving image is displayed is encoded as a black image, and then the composite image is encoded as an I picture. Provided is a moving image encoded data conversion apparatus for encoding.

  In the moving image encoded data conversion apparatus, the encoder is a combined image in which the picture information of the last moving image that is not encoded as a black image in the combined image encoded as the P picture indicates an I picture. Information indicating the end of encoding by the encoder is added to the encoded data of the immediately preceding composite image.

  The moving image encoded data converter reads out the encoded data of the first I picture of the GOP including the specified time from the composite image display time from the storage unit and sends the encoded data to the decoder. A reproduction control unit is provided that reads encoded data of a P picture following the I picture from the storage unit and sends the encoded data to the decoder.

  In the moving image encoded data conversion device, the reproduction control unit encodes a portion corresponding to the black image when the black image is included in a composite image of the P picture read from the storage unit. The moving image data is sent to the decoding, and the synthesizing unit synthesizes the synthesized image of the P picture including the black image and the encoded moving image of the portion corresponding to the black image.

  According to the moving image encoded data conversion apparatus of the present invention, even when applied to a system that synthesizes a plurality of moving images on one screen, the transcoding is performed efficiently and the increase in the amount of data is suppressed while moving in the reverse direction. The multi-screen composite image can be retrieved and reproduced from that point in time, and the hardware resources can be reduced.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram illustrating a moving image encoded data conversion apparatus according to the first embodiment. As shown in FIG. 1, a moving image encoded data conversion apparatus 100 according to the first embodiment includes an interface 101, decoders 102a to 102d, a storage unit 103, memories 104a to 104d, a synthesis unit 105, a transformer, A code control unit 106, an encoder 107, a reproduction control unit 108, and an operation input unit 109 are provided. Digitally compressed data (digital compressed moving image data) of moving images captured by the cameras 110 a to 110 d is input to the moving image encoded data conversion apparatus 100 from each camera via the network 111.

  The decoders 102 a to 102 d decode the digital compressed moving image data input via the interface 101. The storage unit 103 stores the digital compressed moving image data of each camera and the composite image data digitally encoded by the encoder 107. The memories 104a to 104d temporarily hold the moving image data decoded by the decoders 102a to 102d. The synthesizing unit 105 has functions of enlarging and reducing the image size and synthesizing the image. When the combining unit 105 executes the combining function, the combining unit 105 reads out moving image data from at least two of the memories 104a to 104d and combines them into one image. The combined image data output from the combining unit 105 is supplied to the monitoring monitor 120 and the encoder 107.

  The encoder 107 receives the synthesized image data input from the synthesizing unit 105 based on the information of each moving image data stored in the memories 104a to 104d and the GOP interval information instructed from the transcode control unit 106. Digitally encode. Data digitally encoded by the encoder 107 is stored in the storage unit 103. The reproduction control unit 108 controls the reproduction of the synthesized image reproduced in the past using the digital compressed moving image data and the digitally encoded synthesized image data stored in the storage unit 103. The operation input unit 109 receives an operation by the user using the input interface, and sends operation information by the user to the transcode control unit 106 and the reproduction control unit 108.

  The operation of the moving image encoded data conversion apparatus 100 will be described with reference to the drawings. FIG. 2 is a diagram illustrating an example of a stream of digital compressed moving image data output from the cameras 110a to 110d. In FIG. 2, “I” indicates an I picture, “P” indicates a P picture, and picture data are arranged in the order of frames in the order of encoding from the left. In a GOP composed of an I picture and a P picture, the encoded order is the display order.

  FIG. 3 is a diagram illustrating examples of different streams output from the cameras 110a to 110d. Streams output from the cameras 110 a to 110 d are input to the interface 101 via the network 111. The interface 101 separates the input stream for each channel and inputs the stream of each channel to the decoders 102a to 102d. A reference numeral 400 shown in FIG. 3 indicates a stream portion decoded by each of the decoders 102a, 102b, 102c, and 102d at a certain decoding timing, a reference numeral 401 indicates the decoder 102a, a reference numeral 402 indicates the decoder 102b, and a reference numeral 403 indicates the decoder. Reference numeral 404 denotes a stream portion that is being decoded by the decoder 102d.

  FIG. 4 is a diagram illustrating an example of moving image data in which the stream illustrated in FIG. 3 is decoded and stored in the memories 104a to 104d. In FIG. 4, reference numeral 501 indicates the memory 104a, reference numeral 502 indicates the memory 104b, reference numeral 503 indicates the memory 104c, and reference numeral 504 indicates the moving image data stored in the memory 104d. Reference numeral 510 denotes a set of images to be displayed at a certain timing, and this set of image data is input to the combining unit 105. The combining unit 105 reduces and combines the images of the channels a to d to form a multi-screen combined image such as an image 520 illustrated in FIG. 4 and outputs the combined image data to the monitoring monitor 120.

  FIG. 5 is a diagram illustrating a first stage of transcoding performed by the encoder 107. The encoder 107 digitally encodes the synthesized images 621, 622, and 623 output from the synthesizing unit 105 at the timings (time intervals) 611, 612, and 613 indicated by the GOP interval information set by the transcode control unit 106 to obtain I Generate a picture. The generation interval of the I picture to the transcode control unit 106 can be arbitrarily set by the user, and the setting value set by the user is sent to the encoder 107 via the operation input unit 109. The digitally encoded data of the composite images 621, 622, and 623 is recorded in the storage unit 103 together with the picture information of each channel image that is the basis of the composite image. The picture information of the image of each channel is the picture information (I picture, P picture) of the image of each channel that is the basis of the composite image.

  FIG. 6 is a diagram illustrating a second stage of transcoding performed by the encoder 107. A composite image between a composite image 622 and a composite image 623 that are digitally encoded as an I picture will be described as an example. The encoder 107 digitally encodes the next synthesized image 701 after the synthesized image 622 to form a P picture. Data of the digitally encoded composite image 701 is recorded in the storage unit 103 together with picture information (I picture, P picture) of each channel image that is the basis of the composite image.

  Next, the encoder 107 digitally encodes the next synthesized image 702 to form a P picture. However, since the stream of channel c is an I picture, the portion corresponding to channel c in the synthesized image 702 Performs digital encoding as a black image. In this way, the encoder 107 sequentially performs digital encoding of the composite image, and when the stream of some channels is an I picture as in the composite image 702, the digital encoding that forms the P picture corresponds to that channel. Treat the part as a black drawing. That is, in the digital encoding of the composite image between the composite image 622 and the composite image 623, I pictures appear in all streams at the timing of reference numeral 707 in FIG. The images are composite images 701 to 706. Each piece of digitally encoded data of the composite images 701 to 706 is recorded in the storage unit 103 together with the picture information. In particular, the digitally encoded data of the composite image 706 that is finally digitally encoded between the composite image 622 and the composite image 623 that are digitally encoded as an I-picture is digitally encoded together with the picture information. EOS (End Of Sequence) information indicating that the process has ended is also added.

  In this way, the GOP composed of the I picture composite image 622 and the P picture composite images 701 to 706 is recorded in the storage unit 103 together with the picture information and the EOS information.

  Next, the operation of the moving image encoded data conversion apparatus 100 when reproducing the image at the time designated by the user will be described with reference to FIGS. The user designates, via the operation input unit 109, the reproduction control unit 108 to specify the reproduction time of a past synthetic image that is to be reproduced again from among the synthetic images reproduced up to the current time. The playback control unit 108 selects a composite image of the first I picture of the GOP including the specified time from the composite images of the I picture recorded in the storage unit 103, reads the data from the storage unit 103, and reads the decoder. 102a. For example, when the user specifies a time in the GOP indicated by reference numeral 800 in FIG. 7, the playback control unit 108 selects the I-picture composite image 811 and reads the data from the storage unit 103. Transfer to the decoder 102a.

  The synthesized image 811 of the I picture decoded by the decoder 102 a is output to the monitoring monitor 120 without being performed by the synthesizing unit 105. Next, the data of the composite image 812 of the P picture is read from the storage unit 103 and transferred to the decoder 102a. The synthesized image 812 of the P picture decoded by the decoder 102 a is also output to the monitoring monitor 120 without being performed by the synthesizing unit 105. Next, the data of the composite image 813 of the P picture is read from the storage unit 103 and transferred to the decoder 102a. A portion corresponding to the channel c in the composite image 813 of the P picture is encoded as a black image as in the composite image indicated by reference numeral 901 in FIG. Therefore, the playback control unit 108 reads out the digital compressed moving image data stream 833 of channel c starting from this time from the storage unit 103 and transfers it to the decoder 102b. The decoder 102b decodes this compressed moving image data. .

  The synthesizing unit 105 reduces the image 902 obtained by the decoder 102b decoding the stream 833 of the channel c, and the decoder 102a decodes the P picture synthesized image 813 of the channel c on the image 901 obtained. Synthesize to the relevant part. The composite image data is output to the monitor monitor 120. Also in the P picture composite image 814 and later, the portion of the image corresponding to the channel encoded as a black image is obtained by decoding the digital compressed moving image data streams 831, 832, 833, and 834 stored in the storage unit 103. It is obtained by reducing the image obtained in this way.

  Since EOS information is detected when the P picture composite image 817 is decoded, it is found that there is no subsequent composite image (after 818). For this reason, after 818, the stream of digital compressed moving image data of all channels stored in the storage unit 103 is read and decoded until the next I picture 851 appears in all channels. Synthesize.

  As described above, according to the moving image encoded data conversion apparatus 100 of the present embodiment, a synthesized image close to the time designated by the user is synthesized from synthesized images decoded and displayed in the past. Regardless of the GOP configuration of each moving image, it can be displayed immediately. In addition, when the forward reproduction is performed for each frame from the designated time, the decoding can be performed regardless of the GOP configuration of each moving image before synthesis. Further, since the image corresponding to the channel that does not need to be digitally encoded is digitally encoded as a black image, the processing amount can be reduced as compared with digitally encoding the images of all the channels. Further, by performing digital encoding only on the composite image, it is possible to perform digital encoding of a multi-screen image with one encoder.

  In the present embodiment, the number of cameras 110a to 110d, the number of decoders 102a to 102d, and the number of memories 104a to 104d are each four, but the number is not limited to four as long as it is other than zero or one.

(Second Embodiment)
FIG. 9 is a block diagram illustrating a moving image encoded data conversion apparatus according to the second embodiment. The difference between the moving image encoded data conversion apparatus 200 of the second embodiment and the moving image encoded data conversion apparatus 100 of the first embodiment is that a transcoded data storage memory 1031 is provided instead of the storage unit 103. is there. A transcoded data storage memory 1031 included in the moving image encoded data conversion apparatus 200 according to the present embodiment holds data digitally encoded by the encoder 107.

  In the present embodiment, means (storage unit 1042) corresponding to the storage unit 103 of the first embodiment is provided in the network recorder 1040 connected to the network 111. Digital compressed moving image data of moving images captured by the cameras 110 a to 110 d is stored in the storage unit 1042 in the network recorder 1040 via the network 111.

  In addition, the playback control unit 208 included in the moving image encoded data conversion apparatus 200 according to the present embodiment stores the digital compressed moving image data stored in the storage unit 1042 of the network recorder 1040 and the transcoded data storage memory 1031. The reproduction of the composite image reproduced in the past is controlled using the digitally encoded composite image data. When the playback control unit 208 uses the digital compressed video data stored in the storage unit 1042 of the network recorder 1040, the playback control unit 208 sends the digital compressed video data to the network recorder 1040 via the interface 101 and the network 111. Request acquisition of.

  Except for the points described above, the second embodiment is the same as the first embodiment. In FIG. 9, the same reference numerals are given to the same components as those in FIG. 1.

  In the first and second embodiments described above, the number of cameras 110a to 110d, the number of decoders 102a to 102d, and the number of memories 104a to 104d are each four. It is not limited to four.

  The moving image encoded data conversion apparatus according to the present invention is useful as a moving image processing apparatus or the like that displays and reproduces a plurality of digital compressed moving images on one multi-screen synthesized monitor.

1 is a block diagram showing a moving image encoded data conversion apparatus according to a first embodiment; The figure which shows the example of the stream of the digital compression moving image data output from each camera Diagram showing examples of different streams output from each camera The figure which shows the example of the moving image data which the stream shown in FIG. 3 is decoded and stored in each memory The figure which shows the mode of the 1st step of the transcoding which an encoder performs The figure which shows the mode of the 2nd step of the transcoding which an encoder performs The figure explaining reproduction | regeneration of the synthesized image by the moving image encoded data converter of 1st Embodiment The figure explaining an example of reproduction | regeneration of a composite image The block diagram which shows the moving image encoded data converter of 2nd Embodiment. The figure which shows the structural example of GOP

Explanation of symbols

100, 200 Moving picture coded data converter 101 Interfaces 102a-102d Decoders 103, 1042 Storage units 104a-104d Memory 105 Combining unit 106 Transcode control unit 107 Encoder 108, 208 Playback control unit 109 Operation input unit 1031 Transcode data storage Memory 1040 Network recorder

Claims (4)

A decoder for decoding the encoded moving image data;
A synthesizing unit that synthesizes a plurality of moving images obtained by the decoder decoding each of the plurality of encoded moving image data;
An encoder that encodes data of the synthesized image obtained by the synthesizing unit based on each picture information and GOP interval information of the plurality of moving images;
A storage unit for storing data of a composite image encoded by the encoder,
The encoder is
The composite image data is encoded in the display order of the composite image, and the I picture is generated by encoding the composite image data displayed at the time interval indicated by the GOP interval information, and is displayed during the time interval. Encoding the synthesized image data to generate a P picture, generating a GOP of the synthesized image composed of the I picture and the P picture,
After a synthesized image is encoded as an I picture, if the synthesized image encoded as the P picture includes a moving image whose picture information indicates an I picture, the moving image in the synthesized image is displayed. The part to be encoded as a black image,
The moving image encoded data conversion apparatus characterized in that the portion in the composite image encoded as the P picture is encoded as a black image until the composite image is encoded as an I picture. The moving image encoded data conversion device according to claim 1,
The encoder includes, in the encoded data of the composite image immediately before the composite image in which the picture information of the moving image of the last part not encoded as a black image in the composite image encoded as the P picture indicates an I picture, A moving image encoded data conversion apparatus, wherein information indicating the end of encoding by the encoder is added. The moving image encoded data conversion device according to claim 1,
The encoded data of the first I picture of the GOP including the specified time within the display time of the composite image is read from the storage unit and sent to the decoder, and then the encoded data of the P picture following the I picture A video encoded data conversion apparatus comprising: a reproduction control unit that reads out the data from the storage unit and sends the data to the decoder. The moving image encoded data conversion device according to claim 3,
The reproduction control unit, when the black picture is included in the composite picture of the P picture read from the storage unit, sends the encoded moving image data of the portion corresponding to the black picture to the decode,
The moving image encoded data conversion apparatus characterized in that the combining unit combines a combined image of a P picture that includes the black image and an encoded moving image of a portion corresponding to the black image. .

Images