JP2007274229A - Information processing apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology of efficiently converting a format of image coded data by using a plurality of video transcoders whose processing capabilities are not always uniformized. <P>SOLUTION: In determining a distribution ratio of first image coded data to four sets of the video transcoders to be 1:2:1:2, break-points of the first image coded data are determined to be positions of L:2L:L:2L as shown in Fig.5A in the processing in a step S1. Further, the first image coded data with tag information and overlapped parts as shown in Fig.5B to Fig.5E are supplied to the video transcoders 15-1 to 15-4 in the processing in steps S2 to S4. Moreover, the respective first image coded data are changed into second image coded data in the processing in a step S5, and the coupled second image coded data as shown in Fig.5J are output to a post-stage in the processing in a step S6. The technology above can be applied to personal computers and video recorders or the like. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program, and more particularly, to an information processing apparatus, an information processing method, and a program that are suitable for use when a plurality of video transcoders are operated in parallel.

  2. Description of the Related Art Conventionally, there are a wide variety of electronic devices that can reproduce video data (hereinafter referred to as video reproduction devices), such as television receivers, video recorders, personal computers, PDAs (Personal Digital Assistants), and cellular phones. , Portable players, portable game machines, and the like.

  However, since the format of video data that can be played back by the video playback device is not necessarily common, when the existing video data is played back by an arbitrary video playback device, the video data format is changed using the video transcoder. It is necessary to convert to a format that can be supported by any video playback device.

  Here, the format conversion includes not only the case where the encoding method is converted but also the case where the bit rate, resolution, or frame rate is converted using the same encoding method.

  Specifically, when a television program is recorded by a video recorder, for example, video data encoded by the MPEG (Moving Picture Experts Group) 2 format can be obtained, but this video data is a portable game that supports only the MPEG4 format. When viewing on a machine, it is necessary to convert the video data format from MPEG2 format to MPEG4 format.

  In addition, for example, a video content distributor needs to prepare in advance video data converted into a plurality of different formats respectively corresponding to various video playback devices.

  By the way, the format conversion of video data requires an enormous amount of calculation, and requires many times the processing time as compared with the reproduction time of the video data. In order to reduce the time required for format conversion processing, a method has been proposed in which one video data is divided into a plurality of parts, the divided video data is distributed to a plurality of video transcoders, and the plurality of video transcoders are operated in parallel. (For example, refer to Patent Document 1).

JP 2005-176069 A

  However, the existing method of operating a plurality of video transcoders in parallel is based on the premise that the plurality of video transcoders have the same processing capability, and corresponds to a state in which video transcoders having different processing capabilities are included. Absent.

  Therefore, for example, even if there is a plurality of video transcoders that have a high processing ability by taking a group, the ability cannot be fully utilized. On the other hand, if one of the plurality of video transcoders is inferior in processing capability, it becomes a bottleneck and efficient format conversion cannot be performed.

  The present invention has been made in view of such a situation, and makes it possible to efficiently convert the format of encoded image data using a plurality of video transcoders whose processing capabilities are not necessarily unified. .

  An information processing apparatus according to one aspect of the present invention, in an information processing apparatus that converts a format of image encoded data, a plurality of conversion means whose processing capabilities for converting the format of image encoded data are not necessarily unified; Based on the processing capability of the plurality of conversion means, a determination means for determining a break position when dividing the encoded image data in the time axis direction, and an overlapping portion with a previous section in the time axis direction based on the break position A dividing unit that divides the encoded image data, a distributing unit that distributes the divided encoded image data to the plurality of converting units, and an image code after format conversion output from the plurality of converting units And combining means for combining the data.

  The conversion unit may include a decoding unit that decodes the encoded image data and an encoding unit that encodes a decoding result obtained by the decoding unit.

  The decoding means may decode a portion following the overlapping portion using the overlapping portion.

  The encoding means may perform a close process for enabling decoding with only the first GOP for the first GOP following the overlapped portion.

  The dividing unit may divide the encoded image data by providing the overlapping portion corresponding to a predetermined number of GOPs and a previous section in the time axis direction based on the delimiter position.

  The determining unit may further determine a delimiter position when dividing the encoded image data in the time axis direction based on a load state of the plurality of converting units.

  The conversion means can perform at least one conversion process among a conversion process of a coding method, a bit rate conversion process, a resolution conversion process, or a frame rate conversion process of the encoded data. .

  The distribution unit adds tag information indicating an original arrangement order to the divided image encoded data and distributes the plurality of conversion units to the plurality of conversion units, and the combination unit performs the plurality of conversions based on the tag information. The encoded image data after format conversion output from the means can be combined.

  An information processing method according to one aspect of the present invention is an information processing method of an information processing apparatus including a plurality of video transcoders whose processing capabilities for converting the format of encoded image data are not necessarily unified. Based on the processing capability of the coder, the division position when dividing the encoded image data in the time axis direction is determined, and based on the division position, an overlapping portion with the previous section in the time axis direction is provided and the image encoding is performed. Data is divided, the divided image encoded data is distributed to the plurality of video transcoders, and the image encoded data after format conversion output from the plurality of video transcoders is combined.

  A program according to an aspect of the present invention is a program for controlling an information processing apparatus including a plurality of video transcoders whose processing capabilities for converting the format of encoded image data are not necessarily unified. Based on the processing capability of the transcoder, the division position when dividing the encoded image data in the time axis direction is determined, and based on the division position, an overlapping portion with the previous section in the time axis direction is provided, and the image code Processing comprising: dividing divided encoded data, distributing the divided image encoded data to the plurality of video transcoders, and combining the image encoded data after format conversion output from the plurality of video transcoders Is executed on the computer.

  In one aspect of the present invention, based on the processing capability of a plurality of video transcoders whose processing capabilities are not necessarily unified, a delimiter position when dividing encoded image data in the time axis direction is determined, and based on the delimiter position The encoded image data is divided by providing an overlapping portion with the previous section in the time axis direction, and the divided image encoded data is distributed to a plurality of video transcoders. The encoded image data after format conversion output from the plurality of video transcoders is combined.

  According to one aspect of the present invention, the format of encoded image data can be efficiently converted using a plurality of video transcoders whose processing capabilities are not necessarily unified.

  Embodiments of the present invention will be described below. Correspondences between constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  The information processing apparatus according to claim 1 (for example, the encoded data conversion apparatus 1 in FIG. 1) has a plurality of conversion units (for example, FIG. 1) whose processing capabilities for converting the format of the image encoded data are not necessarily unified. Video transcoders 15-1 to 15-4) and a determination unit (for example, FIG. 1) that determines a delimiter position when dividing the encoded image data in the time axis direction based on the processing capabilities of the plurality of conversion units. A scheduler 11) and a dividing unit (for example, the data dividing unit 12 in FIG. 1) that divides the encoded image data by providing an overlapping portion with the previous section in the time axis direction based on the delimiter position; Distribution means for distributing the encoded image data to the plurality of conversion means (for example, the data distribution unit 14 in FIG. 1), and after the format conversion output from the plurality of conversion means Coupling means for coupling the encoded image data (e.g., data combining section 17 in FIG. 1) and a.

  The conversion unit includes a decoding unit (for example, the decoding unit 21 in FIG. 2) for decoding the image encoded data and an encoding unit (for example, the encoding unit 23 in FIG. 2) for encoding a decoding result by the decoding unit. .

  An information processing method according to claim 9 and a program according to claim 10 determine a break position when dividing encoded image data in a time axis direction based on processing capabilities of a plurality of video transcoders ( For example, step S1 in FIG. 3), based on the delimiter position, the image encoded data is divided by providing an overlapping portion with the previous section in the time axis direction (for example, step S2 in FIG. 3) and divided. The image encoded data is distributed to the plurality of video transcoders (for example, step S5 in FIG. 3), and the format-converted image encoded data output from the plurality of video transcoders is combined (for example, FIG. 3 step S6).

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  FIG. 1 shows a configuration example of an encoded data conversion apparatus according to an embodiment of the present invention. The encoded data conversion apparatus 1 converts the format of the input first image encoded data by operating a plurality of video transcoders (in this case, 4) in parallel, and obtains the result obtained as a result. 2 image encoded data is output.

  Here, the format conversion includes not only the case of converting the encoding method but also the case of converting the bit rate, resolution, or frame rate by the same encoding method.

  The encoded data conversion apparatus 1 includes a scheduler 11 that determines a delimiter position in GOP (Group of Pictures) units when dividing the first image encoded data in the time axis direction, and an overlapping portion based on the determined delimiter position. A data dividing unit 12 provided to divide the first encoded image data, a tag generating unit 13 that generates tag information indicating the arrangement order of the divided first encoded image data, and generated tag information Is added to the divided first image encoded data and distributed to the plurality of video transcoders 15, and the divided first image encoded data with the tag added thereto is the second image code. A plurality of video transcoders 15 for converting into encoded data, a plurality of data storage units 16 for storing the second image encoded data respectively output from the plurality of video transcoders 15, and The data combination unit 17 is configured to combine the accumulated second image encoded data based on tag information.

  The video transcoder 15 may be realized by hardware or software. Further, there may be a difference in processing capability between the plurality of video transcoders 15. Further, a video transcoder 15 having a high processing capability may be added.

  Instead of the plurality of data storage units 16 for storing the outputs of the plurality of video transcoders 15, a data storage unit for storing the outputs of the plurality of video transcoders 15 in a lump may be provided.

  FIG. 2 shows a configuration example of the video transcoder 15-1. The video transcoder 15-1 includes a decoding unit 21 that decodes the divided first image encoded data, a scaling unit 22 that changes the image frame size of the image signal that is the decoding result, and the image frame size is changed. The encoded image signal is configured by an encoding unit 23 that encodes the encoded image signal into second image encoded data. Note that predetermined data obtained by the decoding process of the decoding unit 21 may be supplied to the encoding unit 23 and used for the encoding process.

  Since the configuration examples of the video transcoders 15-2 to 15-4 are the same as the configuration example of the video transcoder 15-1, description thereof will be omitted.

  Next, conversion processing by the encoded data conversion apparatus 1 will be described with reference to the flowchart of FIG.

  In step S1, the scheduler 11 responds to the processing capability originally possessed by the video transcoders 15-1 to 15-4 and the respective current load states notified from the video transcoders 15-1 to 15-4. The distribution ratio of the first encoded image data to the video transcoders 15-1 to 15-4 is determined, and the delimiter position when dividing the first encoded image data in the time direction is set to GOP (Group of Pictures). ) Is determined in units, and the determination result is output to the data dividing unit 12.

  In step S2, the data dividing unit 12 provides a portion that overlaps the previous data in the time axis direction by a predetermined number of GOPs (for example, 1 GOP) based on the delimiter positions determined in the process of step S1. One piece of image encoded data is divided, and the divided first image encoded data is output to the data distribution unit 14. By providing the overlapping portion in this way, even if an image that cannot be decoded without referring to an image located before the delimiter position is present in the delimiter, the transcoders 15-1 to 15-4 do not fail. Decoding processing can be performed.

  In step S3, the tag generation unit 13 generates tag information indicating the arrangement order of the divided first image encoded data. In step S4, the data distributor 14 adds the generated tag information to the divided first image encoded data, and distributes it to the video transcoders 15-1 to 15-4. By adding the tag information, it is possible to combine the second encoded image data whose original order has been accurately restored in the subsequent data combining unit 17.

  In step S5, the video transcoders 15-1 to 15-4 perform transcoding processing on the divided first image encoded data with tag information, and the second image encoded data obtained as a result thereof. Are output to the data storage units 16-1 to 16-4, respectively.

  The transcode processing of the video transcoders 15-1 to 15-4 in step S5 will be described in detail with reference to the flowchart of FIG.

  In step S <b> 11, the decoding unit 21 decodes the divided first image encoded data with tag information supplied from the data distribution unit 14 by 1 GOP, and outputs the resulting image signal to the scaling unit 22. To do. In step S <b> 12, the scaling unit 22 enlarges or reduces the image frame size of the image signal input from the decoding unit 21 to a target size and outputs the image frame size to the encoding unit 23. If it is not necessary to change the image frame size, the process of step S12 is omitted.

  In step S13, the encoding unit 23 encodes the image signal whose image frame size has been changed into second image encoded data.

  In step S14, the encoding unit 23 determines whether or not the currently processed GOP is the first GOP following the overlapping portion of the divided segment, and determines that it is the first GOP following the overlapping portion. Then, the process proceeds to step S15, and a close process is performed so that an image in the GOP can be decoded without referring to an image of another GOP. Conversely, if it is determined that the GOP currently being processed is not the first GOP following the overlapped portion, the process of step S15 is skipped.

  In step S16, the encoding unit 23 determines whether or not the currently processed GOP is a GOP of an overlapping portion. If the encoding unit 23 determines that the GOP is an overlapping portion, the encoding unit 23 proceeds to step S17 and deletes the GOP. On the other hand, if it is determined that the GOP currently being processed is not an overlapped GOP, the process of step S17 is skipped.

  In step S <b> 18, the decoder unit 21 determines whether or not an unprocessed GOP remains among the GOPs included in the divided first image encoded data with tag information supplied from the data distribution unit 14. If it is determined and it is determined that an unprocessed GOP remains, the process returns to step S1 and the subsequent processing is repeated. If it is determined that no unprocessed GOP remains, the transcoding process is terminated, and the process proceeds to step S6 in FIG.

  In step S6, the data combining unit 17 reads the second encoded image data stored in the data storage units 16-1 to 16-4, and combines them in the original arrangement order based on the added tag information. To output to the subsequent stage.

  For example, when the distribution ratio of the first image encoded data to the video transcoders 15-1 to 15-4 is determined to be 1: 2: 1: 2, in the process of step S1, as shown in FIG. The delimiter position of the first encoded image data is determined at a position of L: 2L: L: 2L. Here, L is the data amount in GOP units.

  Then, in the processes of steps S2 to S4, the video transcoder 15-1 is supplied with 1 L of first encoded image data with tag information shown in FIG. 5B. The video transcoder 15-2 is supplied with 2L of first encoded image data with tag information shown in FIG. The video transcoder 15-3 is supplied with 1L of first encoded image data with tag information shown in FIG. The video transcoder 15-4 is supplied with 2L of first encoded image data with tag information shown in FIG.

  Thereafter, in the process of step S5, the video transcoder 15-1 outputs the second image encoded data for 1L shown in FIG. 5F. The video transcoder 15-2 outputs 2L second encoded image data for which the closing process is performed on the first GOP shown in FIG. 5G. From the video transcoder 15-3, the second image encoded data for 1L in which the close processing is performed on the first GOP shown in FIG. 5H is output. The video transcoder 15-4 outputs 2L second encoded image data for which the closing process is performed on the first GOP shown in FIG. 5I.

  Then, in the process of step S6, the combined second image encoded data shown in FIG. 5J is output to the subsequent stage by the data combining unit 17.

  As described above, according to the conversion process by the encoded data conversion apparatus 1, the processing capacity of the video transcoders 15-1 to 15-4 and the current load state of the video transcoders 15-1 to 15-4 are set. Accordingly, since the first encoded image data is distributed, the transcoding process can be executed without wasting the capabilities of the video transcoders 15-1 to 15-4.

  Note that the data amount L in GOP units can be changed depending on the application of the second image encoded data.

  For example, as shown in FIG. 6A, if the data amount L in GOP units is set to a relatively small value, the overlapping portion increases, but the time required for one transcoding process is reduced. The time (delay time) required to convert the encoded image data into the second encoded image data is shortened. Therefore, this setting is suitable for an application in which the second image encoded data is viewed immediately. In the figure, the number 1 means that the video transcoder 15-1 processes the data in that section. Similarly, numerals 2 to 4 mean that the corresponding video transcoders 15-2 to 15-4 are processed.

  Further, for example, as shown in FIG. 6B, if the data amount L in GOP units is set to a relatively large value, the overlapping portion can be reduced, so that efficient transcoding processing can be performed. This setting is suitable for an application in which the second encoded image data is stored without being viewed immediately.

  By the way, the series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer as shown in FIG.

  The personal computer 100 includes a CPU (Central Processing Unit) 101. An input / output interface 105 is connected to the CPU 101 via the bus 104. A ROM (Read Only Memory) 102 and a RAM (Random Access Memory) 103 are connected to the bus 104.

  The input / output interface 105 includes an input unit 106 including an input device such as a keyboard and a mouse for a user to input operation commands, and a display such as a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) for displaying a setting screen. And an output unit 107, a storage unit 108 including a hard disk drive for storing first and second image encoded data, programs, and various data, a modem, a LAN (Local Area Network) adapter, and the like, and is represented by the Internet. A communication unit 109 that executes communication processing via a network is connected. Also, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc)), a magneto-optical disk (including an MD (Mini Disc)), or a semiconductor A drive 110 for reading / writing data from / to a recording medium 111 such as a memory is connected.

  A program for causing the personal computer 100 to execute the above-described series of processing is supplied to the personal computer 100 in a state stored in the recording medium 111, read by the drive 110, and installed in a hard disk drive built in the storage unit 108. Has been. The program installed in the storage unit 108 is loaded from the storage unit 108 to the RAM 103 and executed in response to a command from the CPU 101 corresponding to a command from the user input to the input unit 106.

  In this specification, the steps executed based on the program are executed in parallel or individually even if they are not necessarily processed in time series, as well as processes executed in time series according to the described order. It also includes processing.

  The program may be processed by a single computer, or may be distributedly processed by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the structural example of the encoding data converter to which this invention is applied. It is a block diagram which shows the structural example of the video transcoder of FIG. It is a flowchart explaining the conversion process by an encoding data converter. 3 is a flowchart for explaining the transcoding process of step S5. It is a figure for demonstrating an example of a conversion process. It is a figure for demonstrating the effect when the data amount L of a GOP unit is changed. It is a block diagram which shows the structural example of a general purpose personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Encoding data converter, 11 Scheduler, 12 Data division part, 13 Tag production | generation part, 14 Data distribution part, 15 Transcoder, 16 Data storage part, 17 Data coupling part, 21 Decoding part, 22 Scaling part, 23 Encoding part

Claims (10)

In an information processing apparatus that converts the format of encoded image data,
A plurality of conversion means whose processing capabilities for converting the format of the encoded image data are not necessarily unified;
A determining unit that determines a delimiter position when dividing the encoded image data in the time axis direction based on the processing capabilities of the plurality of converting units;
A dividing unit that divides the encoded image data by providing an overlapping portion with a previous section in the time axis direction based on the delimiter position;
Distribution means for distributing the divided image encoded data to the plurality of conversion means;
An information processing apparatus comprising: combining means for combining the encoded image data after format conversion output from the plurality of conversion means. The converting means includes
Decoding means for decoding the encoded image data;
The information processing apparatus according to claim 1, further comprising: an encoding unit that encodes a decoding result obtained by the decoding unit. The information processing apparatus according to claim 1, wherein the decoding unit decodes a portion following the overlapping portion using the overlapping portion. The information processing apparatus according to claim 1, wherein the encoding unit performs a closing process for enabling decoding of the first GOP (Group of Pictures) following the overlapped portion only with the first GOP. The information processing apparatus according to claim 1, wherein the dividing unit divides the encoded image data by providing the overlapping portion corresponding to a predetermined number of GOPs and a previous section in a time axis direction based on the delimiter position. The information processing apparatus according to claim 1, wherein the determination unit further determines a break position when dividing the encoded image data in the time axis direction based on a load state of the plurality of conversion units. 2. The conversion unit according to claim 1, wherein the conversion unit performs at least one conversion process among a conversion process of an encoding method of the encoded data, a conversion process of a bit rate, a conversion process of a resolution, or a conversion process of a frame rate. Information processing device. The distribution means adds tag information indicating an original arrangement order to the divided image encoded data and distributes the plurality of conversion means,
The information processing apparatus according to claim 1, wherein the combining unit combines the encoded image data after format conversion output from the plurality of converting units based on the tag information. In an information processing method of an information processing apparatus including a plurality of video transcoders whose processing ability to convert the format of image encoded data is not necessarily unified,
Based on the processing capabilities of the plurality of video transcoders, determine a delimiter position when dividing the encoded image data in the time axis direction,
Based on the delimiter position, the image encoded data is divided by providing an overlap with the previous section in the time axis direction,
Distributing the divided image encoded data to the plurality of video transcoders;
An information processing method including a step of combining encoded image data after format conversion output from the plurality of video transcoders. A program for controlling an information processing apparatus including a plurality of video transcoders whose processing capabilities for converting the format of encoded image data are not necessarily unified,
Based on the processing capability of the plurality of video transcoders, determine the delimiter position when dividing the encoded image data in the time axis direction in GOP (Group of Pictures) units,
Based on the delimiter position, the image encoded data is divided by providing an overlap with the previous section in the time axis direction,
Distributing the divided image encoded data to the plurality of video transcoders;
A program that causes a computer to execute processing including a step of combining image encoded data after format conversion output from the plurality of video transcoders.

Images