JP2009225380A - Encoding processing device, encoding processing program, encoding processing method, and encoding processing distributed system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To encode large capacity data without lowering processing efficiency. <P>SOLUTION: In encoding processing associated with the embodiment, section groups divided such that continuous parts of video data 100 that is an encoding object overlap are encoded in parallel. Encoded video data are generated by combining the encoded section groups. Then, an encoding processing part has an input section B in the divided section groups, and encodes the section B from the head of the same, and detects divided points suitable for division of video data from among overlapping sections with a section A of a front stage of the section B. The encoding processing part further notifies detected division points and data quantities after encoding of the divided points to a section A as information concerning encoding termination point. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an encoding processing apparatus, an encoding processing program, an encoding processing method, and an encoding processing distribution system that execute an encoding process on data to be processed in a distributed manner in parallel.

  In recent years, high-quality images corresponding to high-definition images have been improved in various image processing fields including the field of television broadcasting. In such a high-definition video, the amount of video data increases on the order of several times that of a conventional video. Therefore, when processing high-definition video, data processing such as video data compression / expansion and format conversion requires a long processing time as the data amount increases.

  Also, in the case of high-definition video, H.264 is considered in consideration of the distribution load due to the huge amount of data. Application of a high compression rate encoding method such as H.264 is desirable. However, such a high compression technology has advanced and complicated processing contents, and enormous calculation processing is required for the actual encoding processing. Therefore, in the end, the encoding processing is several times the actual reproduction time. Time was needed.

  Therefore, in order to perform the encoding process in a practical time using software, the following high-speed process is adopted in addition to the optimization of the single encoding operation process.

1. Higher specifications for computing environment hardware (such as higher CPU clocks)
2. 2. Utilization of acceleration function of arithmetic processing by hardware (GPU etc.) Multi-thread support for the encoding process (requires a computing environment that supports multi-thread processing)
4). Distributed parallel processing for multiple computing environments

  In the case of the above processes 1 to 3, the degree of dependence on hardware is high, and there is an upper limit for performance improvement due to hardware specifications. Therefore, the distributed parallel processing described in 4 above, in which the performance improvement can be easily solved by the amount of the physical computing environment, is widely applied to the encoding system.

  Specifically, there are a spatial direction division method and a time direction division method as video data division methods for distributed parallel processing of video encoding. In the spatial direction division method, all the frames in the video data are divided by a predetermined area. On the other hand, the time direction division method divides video data by data within a certain section on the time axis (see, for example, Patent Documents 1 and 2 below).

JP 2002-199392 A JP 2005-176069 A

  However, in the case of the spatial direction division described above, the quality of the encoded video may not be guaranteed. FIG. 10 is an explanatory diagram showing video data division processing by spatial direction division. As shown in FIG. 10, in the case of spatial direction division, one frame 1000 is divided into a plurality of areas 1 to N, and each area is encoded in a different environment. Therefore, there is a problem in that an unnatural line appears on the boundary of the region on the screen unless encoding under the same condition is performed on the encoding process of the boundary portion between adjacent regions.

  FIG. 11 is an explanatory diagram showing video data division processing by time direction division. As shown in FIG. 11, in the case of time direction division, since one frame is encoded in a single environment, an unnatural boundary such as space division does not occur, but the temporal division point of the video data 1100 When decoding the vicinity (between sections), there was a problem that errors such as buffer overflow and underflow may occur.

  Therefore, when performing distributed parallel processing for encoding video data, it is necessary to perform data division / combination and encoding processing so that the video itself and buffer control do not break down. For example, in the technique of the above-mentioned Patent Document 1, it is possible to use time direction division, detect the scene change timing in the video data before the data division as the division point, and divide the video data at the detected timing. However, since the division process is performed after checking the scene change timing of the video data, there is a problem that the scene check process becomes a bottleneck and requires a lot of processing time.

  In the technique disclosed in Patent Document 2, as a pre-processing for distributing the encoding process, first, a function unit for performing a scene change extraction process for all video data is provided independently. After the processing is distributed, the detection result of the scene change is reflected, and the video data of the section before the detected scene change is re-executed by another encoding processing unit optimal for ensuring data continuity. Encode. Therefore, the processing time can be shortened as compared with the technique disclosed in Patent Document 1.

  However, the technique of Patent Document 2 also requires enormous processing time for re-encoding processing when handling highly compressed data such as high-definition video. Therefore, the processing speed is not necessarily shortened and the processing efficiency is lowered. In addition, when shared resources such as a network are used between distributed encoding processing units, the amount of data handled is large, and there is a further problem that there is a risk of performance degradation due to competition of shared resources. .

  In order to solve the above-described problems caused by the prior art, the present invention provides an encoding processing apparatus, an encoding processing program, an encoding processing method, and encoding capable of encoding a large amount of data without reducing processing efficiency. An object is to provide a distributed processing system.

  In order to solve the above-described problems and achieve the object, the encoding processing device, the encoding processing program, the encoding processing method, and the encoding processing distribution system encode a part of video data to be encoded. A second interval in encoding processing, wherein an arbitrary frame from the beginning to the end of the first interval in the video data is a first frame, and an arbitrary frame after the end is an end frame A process of encoding from the first frame, a process of detecting a division point suitable for the division of the video data from the video data of the overlapping section of the second section and the first section, The detected division point and the data amount after the encoding of the video data of the division point by the encoding means are used as information regarding the end of the encoding in the first interval. And require that and a processing to notify the other of the encoding apparatus that performs coding of video data of said first section to and parallelization.

  According to the encoding processing device, the encoding processing program, the encoding processing method, and the encoding processing distribution system, the optimal division in the overlapping section is performed with respect to the preceding section subjected to the encoding processing in parallel. A point can be notified. In addition, since the information about the data amount of the division point is notified together with the division point, the encoding process in the preceding section can be controlled.

  According to the encoding processing device, the encoding processing program, the encoding processing method, and the encoding processing distribution system, it is possible to encode large-capacity data without reducing the processing efficiency.

  Exemplary embodiments of an encoding processing device, an encoding processing program, an encoding processing method, and an encoding processing distribution system will be described below in detail with reference to the accompanying drawings.

(Outline of encoding processing distribution)
First, an overview of encoding processing distribution according to the present embodiment will be described. FIG. 1 is an explanatory diagram showing an overview of encoding processing distribution according to the present embodiment. In FIG. 1, video data 100 to be encoded is divided into a section A and a section B, and the encoding process is performed for each section. At this time, the video data 100 is divided so that the adjacent sections A and B overlap at least partially.

  The section A and the section B are respectively input to different encoding processing units (for example, the encoding processing units A and B), and are encoded in parallel. In each encoding processing unit, the optimum division point in the section is detected simultaneously with the encoding. The optimum dividing point means a frame suitable for dividing video data, such as a scene change portion or a portion where the relationship between the preceding and following frames is low. In the case of the present embodiment, the optimum division point is detected for the optimum division point detection section S which is a portion where the section A and the section B overlap.

  The encoding process and the optimum division point detection process described above are executed in order from the first frame of each section data. Therefore, when encoding processing is started simultaneously by the encoding processing units A and B, the encoding processing unit A executes only encoding processing for the section A, and the encoding processing unit B performs encoding processing for the section B. Both the detection of the optimal division point is performed. In FIG. 1, the optimum division point (☆ in FIG. 1) detected in the section B is set as the optimum division point Pab.

  When the encoding processing unit B detects the optimum division point Pab in the section B, a flag (closed-GOP flag) corresponding to the GOP structure for a GOP (Group Of Picture) located after the detected optimum division point Pab is detected. Or a blocken-link flag) and encoding is performed. In addition, the encoding processing unit A is notified of information regarding the position and information amount of the detected optimum division point Pab.

  In the encoding processing unit A, a division point (★ in FIG. 1) corresponding to the optimum division point Pab in the section B is set as a connection point Pa. When the encoding processing unit A performs encoding in the vicinity of the connection point Pa, the information amount after encoding is made as close as possible to the information amount of the optimum division point Pab notified from the encoding processing unit B. Adjust the quantization parameters. By adjusting so as to approach the information amount of the optimum division point Pab, it is possible to prevent a buffer failure or the like when the encoded data of the sections A and B are combined at the optimum division point Pab.

  Therefore, when the encoding processing in the encoding processing units A and B is completed, the encoded video data is generated by combining the encoded data of the section A and the encoded data of the section B with the optimum division point Pab as a reference. As described above, in the encoding process distribution according to the present embodiment, the video data 100 to be encoded is divided into a plurality of sections. Therefore, the encoding process and the dividing point detection process for each section are performed using the respective codes. Distributed to the processing unit. Further, in the case of encoding processing distribution according to the present embodiment, unlike conventional time division processing, re-encoding is not required because data continuity is ensured.

  As described above, by using the encoding process distribution according to the present embodiment, the encoding process of the video data is distributed and the re-encoding process is avoided. As a result, even when a large amount of video data is encoded by a high compression technique, high-speed encoding processing can be realized without reducing processing efficiency.

(Configuration of encoding processing distribution system)
Next, the configuration of a specific encoding process distribution system for realizing the above-described encoding process distribution will be described. FIG. 2 is an explanatory diagram illustrating a configuration example of the encoding processing distribution system. As shown in FIG. 2, the encoding processing distribution system 200 includes a division processing unit 210, an encoding processing unit 220, and a combination processing unit 230.

  The division processing unit 210 divides the encoding target video data 201 into N sections. The divided video data are section 1 video data, section 2 video data,..., Section N-1 video data, and section N video data, which are different encoding processing units 220 (encoding processing unit 1 to encoding processing unit). N).

  The encoding processing unit 220 encodes the video data for each section input from the division processing unit 210. The encoded data of each section encoded by the encoding processing unit 220 (section 1 encoded data to section N encoded data) is output to the combination processing unit 230.

  The combination processing unit 230 combines the encoded data (section 1 encoded data to section N encoded data) respectively input from the N encoding processing units 220 and outputs the encoded video data 202. To do.

  In the coding processing unit 220 of the coding processing distribution system 200, as described with reference to FIG. 1, the overlapping section of the continuous sections is set as the optimum dividing point detection section S, and the optimum dividing point is detected by paying attention to this section. In each section, there are two optimum division point detection sections S, which are an overlapping section with the previous section and an overlapping section with the next section. As described above, the encoding processing unit 220 The video data for each section is input, and processing is performed in order from the first frame. Therefore, in each encoding processing unit, the optimum division point detection section S in the first half, which is an overlapping section with the previous section, among the optimum division point detection sections S in the input section is detected as the optimum division point. set to target.

  Then, the encoding processing unit 220 notifies the optimal dividing point detected from the optimal dividing point detection section S to the encoding processing unit 220 that processes the video data of the immediately preceding section having the overlapping section of the video data. That is, it means that the encoding processing unit in each section receives information on the optimum division point from the encoding processing unit that processes the next section.

  Specifically, the encoding processing unit 220 that processes the video data of the section 2 notifies the optimal division point to the encoding processing unit 220 that processes the video data of the section 1 and processes the video data of the section 3. The information of the optimal division point is received from the encoding processing unit 220.

  At this time, as an exception, in the section 1 including the first frame of the video data 100, there is no previous section, and therefore there is no notification of the optimum division point. Therefore, the encoding processing unit 220 that processes the video data of the section 1 only accepts the information on the optimum division point from the encoding processing unit 220 that processes the video data of the section 2.

  In the section N including the last frame of the video data 100, there is no section that follows. Therefore, the encoding processing unit 220 that processes the video data of the section N only notifies the encoding processing unit 220 that processes the video data of the section N-1 of the optimum division point.

  As described above, in the encoding processing distribution system 200 according to the present exemplary embodiment, the divided section groups (section 1 to section N) are processed in parallel by different encoding processing units 220. And the optimal division | segmentation point which exists in an overlap area is notified with respect to the area before one. Accordingly, the section that receives the notification may be subjected to the encoding process up to the optimum division point. Further, since the information on the data amount (encoded video data) at the optimum division point is received together with the optimum division point, the optimum encoding can be performed.

  Hereinafter, the encoding process performed by the encoding processing unit 220 and the process related to the detection of the optimum division point will be described in detail.

(Hardware configuration of encoding processing unit in encoding processing distributed system)
First, a hardware configuration of the encoding processing unit 220 in the encoding processing distribution system 200 according to the present embodiment will be described. FIG. 3 is a block diagram illustrating a hardware configuration of the encoding processing unit 220.

  In FIG. 3, the encoding processing unit 220 includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, a magnetic disk drive 304, a magnetic disk 305, and an optical disk. A drive 306, an optical disk 307, a communication I / F (interface) 308, an input device 309, and an output device 310 are provided. Each component is connected by a bus 300.

  Here, the CPU 301 governs overall control of the encoding processing unit 220. The ROM 302 stores a program such as a boot program. The RAM 303 is used as a work area for the CPU 301. The magnetic disk drive 304 controls the reading / writing of the data with respect to the magnetic disk 305 according to control of CPU301. The magnetic disk 305 stores data written under the control of the magnetic disk drive 304.

  The optical disk drive 306 controls the reading / writing of the data with respect to the optical disk 307 according to control of CPU301. The optical disc 307 stores data written under the control of the optical disc drive 306, and causes the encoding processing unit 220 to read data stored on the optical disc 307.

  As the optical disk 307, a CD (Compact Disk), a DVD (Digital Versatile Disk), an MO (Magneto Optical), a memory card, or the like can be used.

  The communication I / F 308 is connected to a network (NET) 311 such as the Internet through a communication line, and is connected to the encoding processing unit 220 via the network 311. At this time, it may be directly connected to another encoding processing unit 220, but may be connected to a predetermined center server and connected to another encoding processing unit 220 under the management of this center server (for example, Example 1 which will be described later. The communication I / F 308 controls an internal interface with the network 311 and controls data input / output from an external device. For example, a modem or a LAN (Local Area Network) adapter may be employed as the communication I / F 308.

  The input device 309 is a device that accepts input from an administrator or user of the encoding processing distribution system 200 and further from the host system. Examples of the input device 309 include a keyboard and a mouse.

  The keyboard has keys for inputting characters, numbers, various instructions, etc., and inputs data. Moreover, a touch panel type input pad or a numeric keypad may be used. The mouse moves the cursor, selects a range, or moves and changes the size of the window. A trackball or a joystick may be used as long as they have the same function as a pointing device.

  The output device 310 is a device that visually represents the processing status relating to the encoding by the encoding processing unit 220 and the detection of the optimum division point. The output device 310 includes a cursor, an icon, a tool box, a document, an image, Display data such as function information. Specifically, a CRT (Cathode Ray Tube), a TFT (Thin Film Transistor) liquid crystal display, a plasma display, or the like can be employed as the output device 310.

(Functional configuration of encoding processing unit)
Next, a functional configuration of the encoding processing unit 220 in the encoding processing distribution system 200 will be described. FIG. 4 is a block diagram illustrating a functional configuration of the encoding processing unit 220. As described with reference to FIG. 2, the encoding processing unit 220 includes N devices, and video data of one section among the sections divided into N by the division processing unit 210 is input to each device. The

  Each of the individual encoding processing units 220 has the same configuration, and includes an encoding unit 401, a detection unit 402, a notification unit 403, a reception unit 404, and a control unit 405 as shown in FIG. Among these functions, the encoding unit 401 is a process related to the encoding of the input section, the detection unit 402 and the notification unit 403 are processes related to the notification of the optimal division point, and the reception unit 404 and the control unit 405 are the subsequent sections. The function which performs the process which reflects the information regarding the optimal division | segmentation point notified from is provided.

  First, an arbitrary section in the section group divided by the dividing section processing section 210 is input to the encoding section 401. At this time, the division processing unit 210 sets an arbitrary frame from the beginning to the end of the first section (for example, section A in FIG. 1) in the encoding target video data as the first frame, and an arbitrary frame after the end. Is divided into a second section (for example, section B in FIG. 1). Then, the encoding unit 401 encodes the input sections in order from the first frame.

  Video data in the same section as the encoding unit 401 is input to the detection unit 402. At this time, a flag representing an overlapping section with the preceding section is added to the input video data. Therefore, the detection unit 402 detects a division point (optimal division point) suitable for dividing the video data from the overlapping sections. The division points suitable for dividing the video data are, for example, scene change locations and locations where the relevance of successive frames is lower than a threshold value. Therefore, the detection unit 402 sets the optimum division points when these portions are extracted.

  The notification unit 403 performs an encoding process for performing the encoding process of the preceding section on the division point detected by the detection unit 402 and the data amount after the video data relating to the division point is encoded by the encoding unit 401. This is notified to the unit 220 as information related to the encoding end point. The above is the process related to the notification of the optimal division point.

  Then, the reception unit 404 receives a notification of a division point suitable for dividing video data in a section overlapping with the section and a data amount of the division point from a subsequent stage of the arbitrary section. That is, the notification received here is a processing result related to the notification of the optimal division point executed by the detection unit 402 and the notification unit 403 in the subsequent section.

  The control unit 405 ends the encoding by the encoding unit 401 at the division point received by the reception unit 404 and controls the data amount after encoding of the division point to approximate the notified data amount. . Thus, by adjusting so that there is no difference in the data amount before and after the division point, when reproducing the encoded video data, it is possible to show a smooth video with little difference in image quality. The above is the process for reflecting the information regarding the optimum division point.

  Note that when the above-described processing is executed in parallel by the encoding processing units 220, only the encoding processing unit 220 to which video data of the first section and the last section is input is an exceptional process.

  Specifically, the encoding processing unit 220 to which the head section is input does not perform the division point detection processing by the detection unit 402. In addition, the encoding processing unit 220 to which the last section has been input does not accept the notification by the accepting unit 404.

  In addition, the division processing unit 210 basically only needs to divide each section so that overlapping sections are generated, but preferably, the first half part when any one section in the section group is equally divided The video data is divided so that is an overlapping section with the preceding section, and the latter half is an overlapping section with the following section.

  2 and 4, the division processing unit 210, the encoding processing unit 220, and the combination processing unit 230 are realized by independent devices, but functional units corresponding to the processing units 210 to 230 are included in the same device. You may provide as an encoding processing apparatus provided. In such a case, as a matter of course, a plurality of encoding processing units 220 are arranged to perform processing in parallel.

(Processing of video data)
Next, specific processing when the video data is output as encoded video data using the optimum division point will be described. FIG. 5 is an explanatory diagram showing data processing in the encoding process. Here, as an example, a description will be given of an encoding processing distribution system 200 that is executed by a total of six encoding processing units 220 of the encoding processing units 1 to 6.

  As shown in FIG. 5, video data 500 to be encoded is first divided into section data groups 510 of section 1 to section 6 by the division processing unit 210. At this time, the division processing unit 210 performs a division process in consideration that the optimum division point detection process is performed by the subsequent encoding processing unit 220. For example, it is desirable to divide by a simple method as much as possible, such as dividing into fixed section lengths by time direction dispersion.

  Further, as described above, the division processing unit 210 performs division so that a part of the preceding and following sections overlap. At this time, most preferably, as in the section data group 510 of FIG. 5, all the sections other than the first half of the first section and the second half of the last section 6 are overlapped sections. Divide so that By performing division like the section data group 510, all sections except for a part (the first half part of the section 1 and the second half part of the section 6) can be detected as the optimum division points.

  The encoding processing unit 220 performs an encoding process on each distributed section data. In parallel with the encoding process, the encoding processing unit 220 detects the optimum position for dividing the video data in the first half of the optimum dividing point detection section S. The position detected here is called the optimum dividing point P.

  The detection target section data group 520 represents a detection result and a notification result by the encoding processing unit 220 (1 to 6). When the optimum dividing point P is detected in each encoding processing unit 220, the position information and the data amount of the optimum dividing point are notified to the encoding processing unit in charge of the immediately preceding section. In the detection target section data group 520, the detected optimum division point P is represented by ☆, and the notified optimum division point P is represented by ★.

  The encoding processing unit 220 that has been notified of the optimal division point P is notified of the amount of data after encoding when performing the encoding in the vicinity of the connection point (★ in the figure) connected to the notified optimal division point P. Encoding is performed by adjusting quantization parameters and the like so as to be as close to the data amount as possible. If encoding of the corresponding optimum division point P is not finished before encoding the coupling point, a waiting time occurs. Therefore, it is desirable that the processing performance of each encoding processing unit 220 (1 to 6) is equal. As a matter of course, since the encoded data of the encoding processing unit 220 at the subsequent stage is used after the coupling point, it is not necessary to encode the video data in the section after the optimum division point P.

  Further, in the section 3 in the detection target section data group 520, the optimum division point P cannot be detected from the section overlapping with the section 2. In such a case, the information in the initial state of encoding for the section 4 is set in the encoding processing unit 220 of the section 2 in advance, so that the end part of the section 2 and the head part of the section 4 can be combined. .

  Therefore, when the sections are arranged using the optimum division point P from which the detection target section data group 520 is detected as a coupling point, the section data group 530 is obtained. Then, the encoded video data 540 is generated by combining the data of the white portions of the section data group 530.

(Encoding procedure)
Next, the procedure of the encoding process for each section for performing data processing as described in FIG. 5 will be described. FIG. 6 is an explanatory diagram showing a frame configuration for each section. Like the video data 600 of the section 3 in FIG. 6, the video data of each section is composed of frames 601 to 605. Among these frames, the first frame 601, the intermediate frame 603, and the last frame 605 can be uniquely extracted from the video data, but optimum division point frames 602 and 604 are detection of optimum division points described later. This is a frame determined by

  FIG. 7 is a flowchart showing the procedure of the encoding process for each section. Here, a case will be described in which video data in section 3 among a plurality of encoding processing units 220 is processed, but the same processing is performed for other encoding processing units 220.

  In the flowchart of FIG. 7, first, the data of the target section is read (step S701), and the encoding conditions of the first frame and the last frame are further read from the data of the read section (step S702), thereby setting the encoding conditions. To do.

  Next, in order to perform encoding sequentially from the first frame, n representing the frame number is set to 1 (step S703). Then, the frame n corresponding to the set number n is encoded (step S704). Thereafter, it is determined whether or not an optimal division point has been detected in frame n (step S705). If an optimal division point has been detected (step S705: Yes), the detected optimum division point is adjacent. It is determined whether or not notification has been made to the encoding unit that encodes the section (step S706).

  In step S706, when the optimal division point detected in step S705 is not notified to the encoding unit that encodes the next adjacent section (step S706: No), the encoding unit that encodes the next section. Is notified of the optimum division point (step S707), and the process proceeds to step S708. On the other hand, if the optimum division point is not detected in step S705 (step S705: No), or if the optimum division point has been notified in step S706 (step S706: Yes), the optimum division point in step S707 is obtained. The point is not notified, and the process directly proceeds to step S708.

  If the optimum division point is not detected in frame n (step S705: No), or if the detected optimum division point has been notified (step S706: Yes or step S707 is completed), the codes up to the intermediate frame It is determined whether or not conversion is completed (step S708). The intermediate frame means a frame that is ½ of the total number of frames constituting the target section. If the encoding up to the intermediate frame has not been completed (step S708: No), n is incremented (step S709), and the processing from step S704 is performed on the next frame n.

  In step S708, when encoding up to the intermediate frame is completed (step S708: Yes), it is determined whether or not the optimum division point has been notified to the next section in the current section being processed (step S710). Here, when the optimal division point is notified to the next section (step S710: Yes), the process proceeds to step S712 as it is. On the other hand, if not notified (step S710: No), it is determined that there is no optimal division point in the first half of the target section being processed, and the next section is notified that there is no optimal division point (step S711). Thereafter, the process proceeds to step S712.

  From step S712, encoding processing regarding frames subsequent to the intermediate frame 603 is described. First, it is determined whether or not there is a notification from the previous section (section 2 in this case) (step S712). Here, it waits until the notification from the section 2 is accepted (step S712: No loop). When the notification is accepted (step S712: Yes), the next frame of the intermediate frame 603 is set as the frame m (step S713). Encoding is performed on the frame m (step S714).

  Thereafter, it is determined whether or not the frames up to the optimal division point frame 604 notified in step S712 have been encoded (step S715). If it is notified from section 2 that there is no optimal division point in step S712, the final frame 605 is determined as the frame 604 of the optimal division point.

  If it is determined in step S715 that the frame up to the optimal division point frame 604 has not been encoded (step S715: No), the frame m is incremented (step S716), and the process returns to step S714 to return to the next frame m. Is encoded. In step S715, if it is determined that the frames up to the optimal division point frame 604 have been encoded (step S715: Yes), the series of encoding processing ends.

  As described above, in the encoding processing unit 220, adjustment of the preceding and following sections is facilitated by performing processing control according to the detection of the optimal dividing point and the notification of the optimal dividing point together with the encoding. Encoded video data can be generated.

  Next, a specific configuration example of a distributed processing system using the above-described encoding processing unit 220 will be described. Each of the devices constituting the distributed processing system described below applies the processing of the above-described division processing unit 210, encoding processing unit 220, and combination processing unit 230. In the first and second embodiments described below with reference to FIGS. 8 and 9, the pre-encoding data is represented by a solid line and the encoded data is represented by a broken line.

Example 1
First, the configuration of the first embodiment will be described. FIG. 8 is an explanatory diagram illustrating a configuration of the distributed processing system according to the first embodiment. In the first embodiment, a single apparatus is configured to centrally manage the distribution of processing to each encoding apparatus. As shown in FIG. 8, the distributed processing system 800 includes a video data DB 810, a distributed processing management device 820, six encoding processing devices 830 (830-1 to 830-6), and an encoded video data DB 840. Is included.

  When the distributed processing management device 820 acquires the video data to be encoded from the video data DB 810, it divides it into six sections. The division performed here is the same processing as the division in the division processing unit 210 described above.

  Then, the distributed processing management device 820 distributes the divided section data to the encoding processing device 830. At this time, the distributed processing management apparatus 820 records which section each unit of the encoding processing apparatus 830 is in charge of along with the section context.

  The encoding processing device 830 (830-1 to 830-6) performs the same processing as that of the encoding processing unit 220 described above. In addition, when notifying the detected optimum division point, the distributed processing management device 820 is notified without directly reporting to the encoding processing device 830 in charge of the processing of the previous section. Therefore, also when receiving the notification of the optimal division point, the notification is received from the distributed processing management device 820 instead of the encoding processing device 830 that is in charge of the processing of the subsequent section.

  In addition, encoded video data for each section for which the encoding processing has been completed by the encoding processing device 830 is also transmitted to the distributed processing management device 820. Therefore, the distributed processing management device 820 receives encoded video data from the encoding processing device 830 (830-1 to 830-6), and generates encoded video data by the same processing as the above-described combination processing unit 230. The encoded video data DB 840 can be stored.

(Example 2)
Next, the configuration of the second embodiment will be described. FIG. 9 is an explanatory diagram illustrating a configuration of a distributed processing system according to the second embodiment. The second embodiment does not have an independent management device as in the first embodiment, and determines which section of the video data is being processed by each encoding device.

  The distributed processing system 900 includes a video data DB 810, a division processing device 910, six encoding processing devices 920 (920-1 to 920-6), a combined processing device 930, and an encoded video data DB 840. Contains. At this time, the six encoding processing devices 920 (920-1 to 920-6) are connected to the preceding and following encoding processing devices 920, respectively.

  When the division processing device 910 acquires the video data to be encoded from the video data DB 810, the division processing device 910 divides the video data into six sections and distributes them to the encoding processing device 920. At this time, information for determining which section constitutes the video data is added to each distributed section data.

  The encoding processing device 920 (920-1 to 920-6) performs the same processing as that of the encoding processing unit 220 described above. When the detected optimum division point is notified, it is directly notified to the encoding processing device 920 in charge of processing of the previous section together with information (for example, the device address and identifier) represented by the device itself. In addition, the encoding processing device 920 receives a notification of information related to the division point directly from the encoding processing device 920 that is in charge of processing of the subsequent section.

  When the encoding processing device 920 completes the encoding processing, the encoded video data for each section is transmitted to the combination processing device 930. Then, the combination processing device 930 can generate encoded video data by the same process as the above-described combination processing unit 230 and store the encoded video data in the encoded video data DB 840.

  As described above, according to the present embodiment, when the encoding processing is completed in all the encoding processing units 220, the combined processing unit 230 stores encoded data for each section based on the optimum division point. The combined video data corresponding to the input video data is generated. Therefore, since re-encoding is not required, the processing efficiency does not drop greatly even when a large amount of data is handled. In addition, since the calculation environment serving as the encoding processing unit 220 can be prepared relatively easily, it can be applied to a wide range of systems.

  Note that the encoding processing method described in the present embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a magnetic disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The program may be a medium that can be distributed via a network such as the Internet.

  In addition, each of the devices 210 to 230 included in the coding processing distribution system 200 described in the present embodiment is an application specific IC (hereinafter simply referred to as “ASIC”) such as a standard cell or a structured specific integrated circuit (ASIC). And PLD (Programmable Logic Device) such as FPGA. Specifically, for example, by defining the functions of the above-described division processing unit 210, encoding processing unit 220, and combination processing unit 230 by HDL description, logically synthesizing the HDL description and giving it to the ASIC or PLD, An encoding processing apparatus that satisfies the functions of the encoding processing distribution system 200 can be manufactured.

  The following additional notes are disclosed with respect to the embodiment described above.

(Supplementary note 1) An encoding processing device for encoding a part of video data to be encoded,
For the partial video data in the second section, in the video data, any frame from the beginning to the end of the first section is the first frame, and any frame after the end is the end frame. Encoding means for encoding from the beginning;
Detecting means for detecting a dividing point suitable for dividing the video data from video data of an overlapping section of the second section and the first section;
The division point detected by the detection unit and the data amount after the encoding of the video data of the division point by the encoding unit are used as information regarding the end of encoding in the first section, as the first segment. Notifying means for notifying other encoding processing devices that execute encoding of the video data of the section;
An encoding processing apparatus comprising:

(Supplementary note 2) An arbitrary frame from the end of the first section to the end of the second section in the video data is set as a first frame, and an arbitrary frame after the end of the second section From another encoding processing device that performs encoding of video data in the third section, with the last frame as the end frame, the video data in the overlapping section between the third section and the second section Receiving means for receiving notification of a division point suitable for division and a data amount of the division point;
When the reception unit receives a notification of a division point suitable for dividing the video data and a data amount of the division point, the encoding unit encodes the video data of the second section. And a control means for controlling so that the data amount after encoding of the division point is approximated to the notified data amount.
The encoding processing device according to supplementary note 1, comprising:

(Supplementary note 3) The encoding process according to Supplementary note 1 or 2, wherein the detection means stops the division point detection function when video data of a head section in the video data is input. apparatus.

(Supplementary Note 4) When the video data of the last section in the video data is input, the reception unit is configured to divide the video data in an overlapping section of the third section and the second section. 4. The encoding processing apparatus according to appendix 2 or 3, wherein a reception function of notification of a suitable division point and a data amount of the division point is stopped.

(Additional remark 5) The said detection means detects the scene change location of video data as a division | segmentation point from the video data of the overlapping area of the said 2nd area and the said 1st area. 5. The encoding processing device according to any one of 4.

(Additional remark 6) The said detection means detects the location where the relevance of a continuous flame | frame is lower than a threshold value from the video data of the overlapping area of the said 2nd area and the said 1st area as a dividing point. The encoding processing device according to any one of appendices 1 to 4, characterized in that:

(Supplementary note 7) An encoding processing apparatus for encoding a part of video data to be encoded,
The first partial video data in the second section in which the first frame is an arbitrary frame from the beginning to the end of the first section, and the arbitrary frame after the end is the end frame. Encoding means for encoding from:
An arbitrary frame from the end of the first interval to the end of the second interval is a first frame, and an arbitrary frame after the end of the second interval is an end frame. A division point suitable for dividing the video data in an overlapping section of the third section and the second section from another encoding processing device that performs encoding of the video data, and the division point Receiving means for receiving notification of the amount of data;
When the reception unit receives a notification of a division point suitable for dividing the video data and a data amount of the division point, the encoding unit encodes the video data of the second section. And a control means for controlling so that the data amount after encoding of the division point is approximated to the notified data amount.
An encoding processing apparatus comprising:

(Supplementary note 8) A computer for encoding a part of video data to be encoded,
In the video data of the second section, the arbitrary frame from the beginning to the end of the first section in the video data is the first frame, and the arbitrary frame after the end is the end frame. Encoding means for encoding from
Detecting means for detecting a dividing point suitable for dividing the video data from video data of an overlapping section of the second section and the first section;
The division point detected by the detection unit and the data amount after the encoding of the video data of the division point by the encoding unit are used as information regarding the end of encoding in the first section, as the first segment. Notification means for notifying other encoding processing devices that perform encoding of the video data of the section;
An encoding processing program characterized in that it is made to function as:

(Supplementary Note 9) An arbitrary frame from the end of the first section to the end of the second section in the video data is set as a first frame, and an arbitrary frame after the end of the second section From the encoding processing device that performs encoding of the video data of the third section, with the last frame as the end frame, for dividing the video data in the overlapping section of the third section and the second section Receiving means for receiving notification of a suitable dividing point and the amount of data of the dividing point;
When the reception unit receives a notification of a division point suitable for dividing the video data and a data amount of the division point, the encoding unit encodes the video data of the second section. And a control means for controlling the data amount after encoding at the division point to be approximate to the notified data amount.
The encoding processing program according to appendix 8, wherein the encoding processing program is made to function as:

(Additional remark 10) The computer which encodes a part of video data used as encoding object,
In the video data of the second section, the arbitrary frame from the beginning to the end of the first section in the video data is the first frame, and the arbitrary frame after the end is the end frame. An encoding process for encoding from:
A detection step of detecting a dividing point suitable for dividing the video data from video data of an overlapping section of the second section and the first section;
The division point detected by the detection step and the amount of data after encoding of the video data at the division point by the encoding step are used as information regarding the end of encoding in the first section, A notification step of notifying an encoding processing device that performs encoding of video data in a section;
An encoding processing method comprising:

(Supplementary Note 11) An arbitrary frame from the end of the first section to the end of the second section in the video data is set as a first frame, and an arbitrary frame after the end of the second section From another encoding processing device that performs encoding of video data in the third section, with the last frame as the end frame, the video data in the overlapping section between the third section and the second section A reception step for receiving notification of a division point suitable for division and a data amount of the division point;
When the notification of the division point suitable for dividing the video data and the data amount of the division point is received in the reception step, the encoding of the video data of the second section by the encoding unit is performed. An encoding process control step that terminates at the division point received by the reception unit and controls the data amount after encoding of the division point to be approximate to the notified data amount;
The encoding processing method according to appendix 10, characterized by comprising:

(Supplementary note 12) An encoding processing distribution system in which a distributed processing device that has acquired video data to be encoded causes a plurality of encoding processing devices to distribute the encoding of the video data,
The distributed processing apparatus includes:
Of the consecutive sections in the video data, the latter section is an arbitrary frame from the beginning to the end of the previous section video data as the first frame, and an arbitrary frame after the end is the last frame, Dividing means for dividing the video data of the preceding and following sections so as to partially overlap, and providing the video data of each section to different encoding processing devices,
Combining means for combining the video data groups of the sections encoded by the different encoding processing devices to generate one encoded video data;
Notification means for notifying other designated encoding processing devices of information received from the plurality of encoding processing devices,
The encoding processing device includes:
Encoding means for inputting video data of an arbitrary section in the section group divided by the dividing means, and encoding the video data of the section from the beginning;
Detecting means for detecting a division point suitable for dividing video data from video data in an overlapping section between the arbitrary section and a preceding section of the arbitrary section;
The division point detected by the detection means and the amount of data after encoding of the video data of the division point by the encoding means are transmitted to the distributed processing device, and the notification means of the distributed processing device Notification means for notifying the encoding processing means to which the video data of the preceding stage of the arbitrary section is input;
Receiving means for receiving notification from the distributed processing device of a division point suitable for dividing video data from video data of an overlapping section between the arbitrary section and a subsequent section, and a data amount of the division point;
When the reception unit receives a notification of a division point suitable for dividing the video data and a data amount of the division point, encoding by the encoding unit is terminated at the division point received by the reception unit. And control means for controlling the encoded data amount of the video data at the division points to approximate the notified data amount;
An encoding processing distribution system comprising:

(Additional remark 13) The said division | segmentation means makes the first half area which equally divided the said arbitrary sections become the video data of an overlapping section with the said latter section, and becomes a video data of the overlapping section with the said latter section of the latter half section. The encoding processing distribution system according to attachment 12, wherein the encoding processing distribution system is divided into two.

It is explanatory drawing which shows the outline | summary of the encoding process distribution concerning this Embodiment. It is explanatory drawing which shows the structural example of an encoding process distribution system. It is a block diagram which shows the hardware constitutions of an encoding process part. It is a block diagram which shows the functional structure of an encoding process part. It is explanatory drawing which shows the data process in an encoding process. It is explanatory drawing which shows the frame structure for every area. It is a flowchart which shows the procedure of the encoding process for every area. 1 is an explanatory diagram illustrating a configuration of a distributed processing system in Embodiment 1. FIG. FIG. 10 is an explanatory diagram illustrating a configuration of a distributed processing system according to a second embodiment. It is explanatory drawing which shows the division | segmentation process of the video data by a space direction division | segmentation. It is explanatory drawing which shows the division | segmentation process of the video data by a time direction division | segmentation.

Explanation of symbols

200 Encoding processing distribution system 201 Encoding target video data 202 Encoded video data 210 Division processing unit 220 Encoding processing unit 230 General processing unit 401 Encoding unit 402 Detection unit 403 Notification unit 404 Reception unit 405 Control unit

Claims (8)

An encoding processing device that encodes a part of video data to be encoded,
For the partial video data in the second section, in the video data, any frame from the beginning to the end of the first section is the first frame, and any frame after the end is the end frame. Encoding means for encoding from the beginning;
Detecting means for detecting a dividing point suitable for dividing the video data from video data of an overlapping section of the second section and the first section;
The division point detected by the detection unit and the data amount after the encoding of the video data of the division point by the encoding unit are used as information regarding the end of encoding in the first section, as the first segment. Notifying means for notifying other encoding processing devices that execute encoding of the video data of the section;
An encoding processing apparatus comprising: An arbitrary frame from the end of the first section to the end of the second section in the video data is set as a first frame, and an arbitrary frame after the end of the second section is set as a end frame. Suitable for dividing the video data in an overlapping section of the third section and the second section from another encoding processing device that performs encoding of the video data of the third section. Receiving means for receiving notification of the dividing point and the data amount of the dividing point;
When the reception unit receives a notification of a division point suitable for dividing the video data and a data amount of the division point, the encoding unit encodes the video data of the second section. And a control means for controlling so that the data amount after encoding of the division point is approximated to the notified data amount.
The encoding processing apparatus according to claim 1, further comprising:   3. The encoding processing apparatus according to claim 1, wherein the detection unit stops the division point detection function when video data of a head section in the video data is input.   The reception means, when the video data of the last section in the video data is input, a dividing point suitable for dividing the video data in the overlapping section of the third section and the second section 4. The encoding processing device according to claim 2, wherein the function of accepting the notification of the division point data amount is stopped. A computer that encodes a part of video data to be encoded,
In the video data of the second section, the arbitrary frame from the beginning to the end of the first section in the video data is the first frame, and the arbitrary frame after the end is the end frame. Encoding means for encoding from
Detecting means for detecting a dividing point suitable for dividing the video data from video data of an overlapping section of the second section and the first section;
The division point detected by the detection unit and the data amount after the encoding of the video data of the division point by the encoding unit are used as information regarding the end of encoding in the first section, as the first segment. Notification means for notifying other encoding processing devices that perform encoding of the video data of the section;
An encoding processing program characterized in that it is made to function as: An arbitrary frame in the video data from the end of the first section to the end of the second section is set as a head frame, and an arbitrary frame after the end of the second section is set as a end frame. A dividing point suitable for dividing the video data in an overlapping section of the third section and the second section from an encoding processing device that performs encoding of the video data of the third section And a receiving means for receiving notification of the data amount of the division point,
When the reception unit receives a notification of a division point suitable for dividing the video data and a data amount of the division point, the encoding unit encodes the video data of the second section. And a control means for controlling the data amount after encoding at the division point to be approximate to the notified data amount.
The encoding processing program according to claim 5, wherein the encoding processing program is made to function as: A computer that encodes a part of video data to be encoded,
In the video data of the second section, the arbitrary frame from the beginning to the end of the first section in the video data is the first frame, and the arbitrary frame after the end is the end frame. An encoding process for encoding from:
A detection step of detecting a dividing point suitable for dividing the video data from video data of an overlapping section of the second section and the first section;
The division point detected by the detection step and the amount of data after encoding of the video data at the division point by the encoding step are used as information regarding the end of encoding in the first section, A notification step of notifying an encoding processing device that performs encoding of video data in a section;
An encoding processing method comprising: A distributed processing apparatus that acquires video data to be encoded is an encoding processing distribution system that causes a plurality of encoding processing apparatuses to perform distributed processing of encoding of the video data,
The distributed processing apparatus includes:
Of the consecutive sections in the video data, the latter section is an arbitrary frame from the beginning to the end of the previous section video data as the first frame, and an arbitrary frame after the end is the last frame, Dividing means for dividing the video data of the preceding and following sections so as to partially overlap, and providing the video data of each section to different encoding processing devices,
Combining means for combining the video data groups of the sections encoded by the different encoding processing devices to generate one encoded video data;
Notification means for notifying other designated encoding processing devices of information received from the plurality of encoding processing devices,
The encoding processing device includes:
Encoding means for inputting video data of an arbitrary section in the section group divided by the dividing means, and encoding the video data of the section from the beginning;
Detecting means for detecting a division point suitable for dividing video data from video data in an overlapping section between the arbitrary section and a preceding section of the arbitrary section;
The division point detected by the detection means and the amount of data after encoding of the video data of the division point by the encoding means are transmitted to the distributed processing device, and the notification means of the distributed processing device Notification means for notifying the encoding processing means to which the video data of the preceding stage of the arbitrary section is input;
A receiving unit that receives notification from the distributed processing device of a dividing point suitable for dividing video data from video data of an overlapping section between the arbitrary section and a subsequent section, and a data amount of the dividing point;
When the reception unit receives notification of a division point suitable for dividing the video data and the data amount of the division point, the encoding unit ends the encoding at the division point received by the reception unit. And control means for controlling the encoded data amount of the video data at the division points to approximate the notified data amount;
An encoding processing distribution system comprising:

Images