JP2010272993A - Video recorder - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress the enlargement of a circuit scale concerning a video recorder for performing the encoding processing of N-kinds of video data. <P>SOLUTION: A plurality of kinds of video data is inputted from the video input part of the video recorder (1). A frame buffer (201) stores the respective kinds of video data. An encoding processing part (2022) performs the encoding processing of the video data. An encoder control part (205) performs control about which video data is encoding-processed among the plurality of kinds of stored video data. The encoder control part determines an assignment time to be given to each kind of encoding processing concerning the plurality of kinds of video data, and switches the video data to be encoded by the encoding processing part into the video data to be subsequently encoding-processed after the video data of the encoding processing in the assignment time when the assignment time elapses. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a video recording apparatus and video recording method for compressing and recording video data.

  FIG. 1 is a block diagram of a conventional video recording apparatus 100x that records video data using the MPEG (Moving Picture Experts Group) encoding method.

  A conventional video recording apparatus 100x includes a frame buffer 100, an encoding unit 101, a stream buffer 102, an encoding buffer 103, a first video input control unit (non-recording medium) 104, and a second video input control unit (recording medium) 105. The recording medium 106 is configured.

  The frame buffer 100 is a memory that temporarily stores input video data, and can store a plurality of video frames. The stream buffer 102 is a memory that temporarily stores encoded data obtained by encoding the stored video frame by the video recording apparatus 100x. The encoding buffer 103 is a memory that stores data temporarily necessary for encoding by the encoding unit 101. The first video input control unit (non-recording medium) 104 is a block that handles video data without using a recording medium. For example, the first video input control unit 104 is a block that receives broadcast data, decodes a video stream, generates video data, or captures video data from the outside. The second video input control unit (recording medium) 105 is a block that generates video data by decoding stream data recorded on a recording medium such as an HDD (Hard Disk Drive), an optical disk, or a semiconductor memory. . The recording medium 106 is a block that stores the stream stored in the stream buffer 102 in an HDD, an optical disk, a semiconductor memory, or the like.

  On the other hand, Japanese Patent No. 3910606 proposes a recording method in which mixed video data obtained by mixing a plurality of video data in a time division manner is encoded and output by a single encoding unit.

Japanese Patent No. 3910606

  However, the conventional video recording apparatus 100x requires N video recording apparatuses for encoding the N video data. In other words, conventionally, N video recording apparatuses 100x are necessary for encoding N video data. Therefore, there is a problem that the more video data to be processed, the more video recording devices (video recording device 100x) are required, leading to an increase in circuit area and cost.

  In Japanese Patent No. 3910606, a plurality of input video data is mixed before being input to the encoding unit, and therefore, a plurality of independent video data cannot be recorded as an independent stream.

  In addition, when a plurality of video data is encoded by a video recording device that encodes the video data, the encoding processing time given to each of the plurality of input video data is guaranteed when performing the time-division encoding processing. There is a need to. In other words, if this guarantee is not made, for example, the result of the encoding process is not displayed at an appropriate time, and there is a problem that the display is disturbed.

  Therefore, in order to suppress the expansion of the circuit scale, the present invention performs a time division for encoding a plurality of video data, and uses processing time allocated to video data encoding processing using information available when video encoding is performed. Are provided, and a video recording apparatus and a video recording method are provided. That is, it is an object to prevent N video recording apparatuses and mixing of video data even when a plurality of video data can be encoded. In addition, an object is to reduce the circuit scale.

  In order to solve at least a part of the above problems, a video recording apparatus of the present invention stores a video input unit to which a plurality of video data is input, and each of the plurality of video data to be input from the video input unit. A frame buffer, an encoding processing unit that performs encoding processing of video data, and control of which video data is encoded by the encoding processing unit among a plurality of video data stored in the frame buffer An encoder control unit configured to determine an allocation time to be assigned to each encoding process of the plurality of video data, and when the allocation time has elapsed, the video data of the encoding process of the allocation time Next, the target video data to be encoded by the encoding processing unit is switched to the video data to be encoded by the encoding processing unit.

  In a video recording apparatus that encodes video data, a plurality of video data can be encoded, but N video recording apparatuses are not required and mixing of video data is not required. . As a result, the circuit scale of the video recording apparatus can be reduced.

FIG. 1 is a block diagram of a conventional video recording apparatus. FIG. 2 is a block diagram of the video recording apparatus. FIG. 3 is a diagram for explaining the operation of the video recording apparatus. FIG. 4 is a diagram for explaining the operation of the video recording apparatus. FIG. 5 is a diagram for explaining the operation of the video recording apparatus. FIG. 6 is a diagram for explaining the operation of the video recording apparatus. FIG. 7 is a diagram for explaining the operation of the video recording apparatus. FIG. 8 is a diagram for explaining the operation of the video recording apparatus. FIG. 9 is a diagram for explaining the operation of the video recording apparatus. FIG. 10 is a diagram for explaining the operation of the video recording apparatus. FIG. 11 is a flowchart of the video recording apparatus.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  The video recording apparatus (video recording apparatus 1 in FIG. 2) according to aspect A1 of the present invention has a plurality of video data (first video data, second video data) to a predetermined input destination (frame buffer 201). And a video input unit (first video input control unit (non-recording medium) 207, video input control unit 200) input by the video input unit, and a plurality of the video data input from the video input unit. A frame buffer (frame buffer 201) that stores each of them, an encoding processing unit (encoding processing unit 2022) that performs encoding processing of video data, and which video among a plurality of video data stored in the frame buffer An encoder control unit (encoder control unit 205) that controls whether the encoding processing unit encodes data, and the encoder control unit includes a plurality of the video data. When an allocation time (for example, allocation time from time T01 to time T02 in FIG. 3) given to each encoding process of the data is determined and the allocation time elapses, video data (for example, first data) of the allocation processing of the allocation time is determined. The video recording apparatus switches the target video data encoded by the encoding processing unit to the video data (for example, second video data) encoded by the encoding processing unit next to (1 video data). .

  In other words, in the video recording apparatus of aspect A1, for each video data of the plurality of video data, the encoder control unit obtains the video data (for example, the video data in FIG. 3) from the video data other than the video data. To 1), the target video data to be encoded by the encoding processor is changed. Then, after the initial change, the encoder control unit changes the target video data to another video data again. Thereby, the encoding process of the video data is performed from the first change to the subsequent change (for example, between time T03 and time T04). When the encoder control unit repeats the change twice in this way, all the encoding processing of the video data is performed. Thereby, the encoder control unit causes each of the plurality of video data to be encoded.

  The encoder control unit encodes the second other video data different from the first other video data to be encoded before the first change into the encoding processing unit after the subsequent change. It may be processed.

  Therefore, a plurality of pieces of video data can be encoded with a simple configuration in which only one encoding processing unit that performs only one video data is simultaneously processed. Moreover, the target video data to be encoded by the encoding process need not be data in which a plurality of video data is mixed. For this reason, it is not necessary to mix a plurality of video data. As a result, a video recording apparatus with a small circuit scale can be realized.

  In addition, the video data may include specific information that is inappropriately specified by a third party, such as copyright information, encryption key information, personal information, or authentication information. With this video recording apparatus, the video data to be processed changes every time video data that is target video data is changed. As a result, it is difficult to determine which video data is processed, and thus it is difficult to specify (analyze) the content of the video data processing. Therefore, it is possible to make it difficult for a third party to specify specific information such as copyright information of the video data included in the encoded video data. As a result, it is possible to prevent unauthorized use of unauthorized copying of video data and other unauthorized use.

  Note that, for example, when the target video data is changed from the first video data to the second video data, the encoder control unit differs from the time during which the first video data is encoded before the change. The encoding processing unit may be made to perform encoding processing of the second video data after the change by time. In this way, the specific information can be made difficult to understand reliably and sufficiently.

  The video recording apparatus according to aspect A2 is the video recording apparatus according to aspect A1, in which the encoder control unit switches (changes) the allocation time assigned to the encoding process of the first predetermined unit (frame) of the video data. The predetermined unit is a predetermined unit.

  In the video recording apparatus of aspect A3, the encoder control unit inputs the resolution information of each video data to be encoded as input video data information (input video data information of the embodiment or a part thereof). The video recording apparatus of aspect A2 that uses the resolution information that is input to switch the allocation time of the video data of the resolution information.

  In the video recording apparatus of aspect A4, the encoder control unit inputs as input video data information whether or not video data should be encoded in real time or non-real time as input video data information. The video recording apparatus of aspect A2 that uses the video data information to switch the allocation time of the video data.

  Further, in the video recording apparatus of aspect A5, when the encoder control unit has passed the allocated time, the encoding process should be completed by the time of the lapse of the first predetermined unit in the video data. When the encoding processing unit has completed the encoding process, the target video data is switched to the next video data to be encoded by the encoding processing unit after the video data of the allocated time (change) This is a video recording apparatus of aspect A1 that outputs a switching signal (for example, a time T02 switch switching signal in FIG. 3).

  Further, in the video recording apparatus according to aspect A6, the encoder control unit performs the encoding processing unit before the allotted time elapses before the allotted time elapses (for example, before time T02 in FIG. 4). Confirming that the encoding processing unit has completed the encoding process of the first predetermined unit in the video data, which should be completed during the encoding process, next to the video data of the allocated time The video recording apparatus according to aspect A1, wherein a switching signal for switching the target video data to the next video data to be encoded by the encoding processing unit is output before the time of the previous period (time T02).

  Further, in the video recording apparatus according to aspect A7, when the encoder control unit passes the allocation time (for example, time T09 to time T10 in FIG. 6), the encoding processing unit performs encoding until the allocation time elapses. If the encoding processing unit has not completed the encoding processing of the first predetermined unit in the video data (first video data) that should be completed during the encoding process, the encoding processing unit The current encoding process after waiting for the completion of the encoding process of the second predetermined unit (macroblock, slice, etc.) included in the first predetermined unit during the encoding process (after waiting until time T10a) The encoding information of the video data in the video data is saved in a predetermined storage area (for example, the first encoding buffer 2041) as encoding restart information, and after the saving, the video data is preceded by Encoding unit is a video recording apparatus aspects A1 to output a switching signal for switching the target video data to the next video data to encoding processing (switching signal at time T10a).

  The encoding information is information that is used (necessary) by the encoding processing unit so that the encoding processing unit resumes the encoding process of the first predetermined unit that has not been completed. The encoding restart information is the encoding information stored in the storage area.

  Further, in the video recording apparatus according to aspect A8, when the encoder control unit has passed the allocation time, the encoding processing unit should have completed the encoding process by the first predetermined time in the video data. When the encoding process of the unit is not completed, the second processing unit included in the first predetermined unit in which the encoding processing unit has already completed the encoding process within the allocated time. After the encoded information is saved in a predetermined storage area as encoded resumption information, the target video data is added to the next video data that is encoded by the encoding processing unit next to the video data of the allocated time. It is the video recording apparatus of aspect A1 which outputs the switching signal for switching.

  In the video recording apparatus according to aspect A9, the second predetermined unit includes the first predetermined unit by one or more second predetermined units, and each of the one or more second predetermined units is The video recording apparatus according to aspect A7, in which the first predetermined unit is a processing unit to be encoded by being encoded.

  Further, in the video recording apparatus according to aspect A10, in the encoding process immediately before the encoding process for the video data to be encoded by the encoding processing unit, the first processing unit of the video data is processed. When all of the encoding processing is completed (for example, at time T07 in FIG. 6), the encoding processing (image 3) of the first processing unit next to the first processing unit in the video data is performed. If all of the encoding processes of the first processing unit are not completed in the immediately preceding encoding process (in the case of time T11 in FIG. 6), the immediately preceding encoding is performed. The video recording apparatus according to aspect A1, wherein the encoding processing unit restarts the immediately preceding encoding process (the encoding process of the image 4) using the encoding restart information saved in a predetermined storage area in the process. .

  The video recording apparatus according to aspect A11 is the video recording apparatus according to aspect A2 in which the first predetermined unit includes M (M = 1, 2, 3,... Natural number) pictures.

  In addition, the video recording apparatus of aspect A12 is the video recording apparatus of aspect A11 in which the first predetermined unit can select different M sheets.

  Further, in the video recording apparatus according to aspect A13, the encoder control unit controls a predetermined input control unit (first video input control unit (non-recording unit) that controls timing at which video data is input to the encoding processing unit. This is a video recording apparatus of aspect A1 instructing the timing to the video input control unit 200) such as (medium) 207.

  In the video recording apparatus of aspect A14, the second predetermined unit is a slice composed of a plurality of macroblocks that are the minimum unit of encoding or a macroblock that is the minimum unit of encoding. Video recording device.

  In the video recording apparatus of aspect A15, when the encoder control unit has passed the allocated time (for example, time T09 to time T10 in FIG. 8), the encoding processing unit has completed the encoding process by that time. If the encoding processing of the first predetermined unit in the video data is not completed, the allocation time (time T10) of the encoding processing by the encoding processing unit of the video data other than the video data is completed. To time T11) (for example, the first half of the allocated time) is added to the allocated time of the video data for which the allocated time has elapsed, and the video recording of aspect A1 in which the allocated time of the video data is extended Device.

  In the video recording apparatus of aspect A16, the video of aspect A1 in which the encoding processing unit encodes one video data to be encoded with a plurality of different recording settings to generate a plurality of stream data. It is a recording device (see description of FIG. 10).

  More specifically, the video recording apparatus according to aspect A1 may further include the following features, for example. That is, the video recording apparatus of aspect A1 further specifies target video data to be encoded from a plurality of video data, inputs the specified video data to the encoding processing unit, and inputs the video An input switch (input switch 2021) for causing the encoding processing unit to perform data encoding processing, and a plurality of output destinations (first stream buffer 2031, each corresponding to one of the plurality of video data) The output destination corresponding to the target video data is specified from the second stream buffer 2032), and the data after encoding by the encoding process is output to the specified output destination to the specified output destination. An output switch (output switch 2023) may be provided. In the video recording apparatus according to aspect A1, the encoder control unit inputs the input so that the target video data is input to the encoding processing unit among the first video data and the second video data. Controlling the switch, controlling the output switch so that the encoded data is output to the output destination corresponding to the target video data, and encoding the target video data You may be allowed to do.

  More specifically, in the video recording apparatus according to aspect A1, for example, the encoder control unit performs the encoding at the allocated time until the allocated time (for example, time T01 to time T02 in FIG. 4) elapses. When the process is completed, video data other than the video data (first video data) corresponding to the allocated time from the completion time to the time when the allocated time elapses (time T02). You may make the said encoding process part perform the encoding process of (2nd video data).

  Further, the recording apparatus according to the aspect A1 has, for example, the length of the allocation time (for example, time T01 to time T03 in FIG. 5) of video data (first video data) encoded by the allocation time. 1 frame processing time in which a frame is encoded by the encoding processing unit is a length of time multiplied by a predetermined integer of 2 or more (for example, 2), and the encoding processing unit The integer number of frames may be encoded during the allocation time.

  Further, in the video recording apparatus of aspect A1, for example, the encoder control unit completes the video data encoding process performed at the initial allocation time (for example, times T09 to T10 in FIG. 6) at the initial allocation time. If not, the portion of the first allocation time encoding process that has not been completed at the allocation time after the initial allocation time (time T11 to time T12) is transferred to the encoding processing unit. It may be performed (the first half of the times T11 to T12).

  Further, in the video recording apparatus of aspect A1, for example, the encoder control unit completes the video data encoding process performed at the initial allocation time (for example, at times T09 to T10 in FIG. 7) at the initial allocation time. Even if it is not, it is possible to cause the encoding processing unit to perform the portion that has not been completed at a later allocation time (time T11 to time T12). Only the encoding process of the portion (frame) corresponding to time may be performed.

  In addition, the video recording apparatus according to aspect A1, for example, does not complete the video data encoding process performed during the initial allocation time (for example, time T09 to T10 in FIG. 8) in the initial allocation time. In this case, the encoding processing unit may be caused to perform encoding processing for the allocation time continuously for a predetermined time (until time T10a) from the time when the allocation time has elapsed.

  Also, the video recording apparatus of aspect A1, for example, when the encoder control has completed the encoding process at the allocated time (time T02a in FIG. 9), the remaining time after the completion of the allocated time (Time T02a to Time T03) is specified as the other time other than the assigned time, and the encoding processing unit performs the encoding process of the second video data at the specified other time. May be. More specifically, for example, the encoder control unit encodes a predetermined frame of the second video data before the other specified time elapses (by time T13). Is completed (time T12a), the code of the frame (image 4) next to the frame (image 3) of the second video data until the other time elapses (by time T13). The encoding processing unit may perform the encoding process. Further, more specifically, for example, the encoder control unit specifies only the remaining time as the other time, and performs encoding processing of the second video data at an irrelevant time other than the remaining time. It is good also as what is not made (refer FIG. 9).

  In addition, the video recording apparatus of aspect A1 is, for example, first video data (video data 1 in FIG. 10) that records video in the first format and second video that records the same video as the video in the second format. 2 specifying video data (video data 2 in FIG. 10) (for example, the frame buffer 201 or the video input control unit 200 including the resizing unit described above), and the encoding processing unit The second encoded data having the same video as the first encoded data output from the encoding processing unit may be output.

  Moreover, the video recording apparatus of aspect B1 is a video recording apparatus in which the following problems are solved. That is, in the conventional video encoding device, one video encoding device is required for encoding processing of one video data. For this reason, when a plurality of video data are encoded at the same time, a plurality of video encoding devices are required, which leads to an increase in circuit area and cost. This problem is solved. And according to the video recording device (video encoding device) and the method (video encoding method) of aspect B1, when encoding processing while switching a plurality of video data to time division by one encoding processing unit, Using each information of the plurality of data to be encoded, for each of the plurality of video data to be encoded, an allocation time that can be used for the encoding process of the video data is determined, and according to this allocation time The video data to be encoded is switched. This solves the above problem.

  With such a video recording apparatus and video recording method, when a plurality of video data is encoded by switching to time division by one encoding processing unit, each of a plurality of input video data to be encoded is a target. Using the input video data information, the setting of the input control unit, and the user setting, an allocation time that can be used for each encoding process of a plurality of input video data to be encoded is determined. When this allocation time has elapsed, the input video data (target video data) to be encoded is switched to the next input video data.

  Thereby, the processing time given to each of the plurality of input video data to be encoded can be independently guaranteed. Therefore, when guaranteeing the processing time of the input video data, the processing can be appropriately ensured without being influenced by the encoding processing of other input video data other than the input video data.

  On the other hand, when the encoding process of the predetermined unit (first predetermined unit) is not completed within the allocated time, the encoding process of all the macroblocks in the slice composed of a plurality of macroblocks is completed. Alternatively, when the macroblock process being interrupted is completed, the encoding process is interrupted, and the input video data to be encoded is switched to the next input video data. However, the restart information and the data stored in the encode buffer are held in a predetermined storage area so that the encoding process of the stream in which the encoding process was interrupted before switching can be restarted at the next encoding timing. To do.

  As described above, even when the encoding process of a predetermined unit is not completed within the allocated time, the processing time can be independently guaranteed. In addition, since processing is not switched to time division simply by time, but processing is switched in units of encoding such as slices or macroblocks, control is facilitated as encoding processing.

  In addition, in such a video recording apparatus and video recording method, when non-real-time encoding processing is included, the allocation time that can be used for encoding processing is not a fixed value, but allocation time of other real-time encoding processing May be set to the idle time, that is, the time from the completion of the encoding process to the process switching.

  What is necessary is just to calculate the allocation time of the other real-time encoding process by setting the allocation time of the non-real-time encoding process to 0.

  Thus, it is possible to allocate the allocation time for the non-real time encoding processing while guaranteeing the encoding processing time to be given to each of the input video data having the real time property.

  In addition, with such a video recording apparatus and video recording method, when it is desired to perform the encoding process at an equal magnification or more, the encoding process can be performed at high speed by increasing the allocated time that can be used for the encoding process in accordance with the recording multiple. Can be

  Thereby, compared with the case where such a thing is implement | achieved by cooperating a some encoding part, an encoding process can be speeded up easily. Even when the recording multiples are different, the encoding processing time given to each of the plurality of input video data can be independently guaranteed.

  Also, according to such a video recording apparatus and video recording method, a plurality of encoded data having different recording settings can be created from one video data by inputting the same video input data to each frame buffer.

  Thus, even when one video data is to be converted into a plurality of encoded data having different recording settings, the processing time given to each of the plurality of input video data to be encoded can be guaranteed.

  A more detailed description is given below.

  A main body according to an embodiment of the present invention and a modification of the present embodiment will be described with reference to FIGS.

  FIG. 2 is a diagram illustrating a block configuration of a main body and a modified example of the embodiment.

  3 to 10 are diagrams for explaining the operation of the main body and the modification of the embodiment.

  In the embodiment of the present invention, the basic configuration, the switching pattern, the control pattern when the encoding process is not completed, and the like in aspects A1, A2, A6, A7, A8, A9, A10, A13, and A14 will be described. To do.

  In the modification of the embodiment, encoding processing other than the same magnification, encoding processing with non-real-time performance, and a plurality of encodings from one video data in aspects A3, A4, A5, A11, A12, and A15 A description will be given of the encoding process for creating the.

  As shown in FIG. 2, the video recording apparatus 1 in the main body and the modification of the embodiment of the present invention includes a video input control unit 200, a frame buffer 201, an encoding unit 202, a stream buffer 203, an encoding buffer 204, and an encoder control unit. 205, a clock 206, a first video input control unit (non-recording medium) 207, a second video input control unit (recording medium) 208, a recording medium 209, and the like.

  In the main body and the modification of the embodiment of the present invention, the video recording apparatus 1 stores two video data, that is, video data 1 (first video data) and video data 2 (second video data). 1 is assumed to be input. Also, the output data of the video recording apparatus 1 is a video stream 1 (first output stream) and a video stream 2 (second output stream) both compressed by H.264 (H.264 / AVC). .

  The input video data is stored in the frame buffer 201 from the first video input control unit (non-recording medium) 207 or the second video input control unit (recording medium) 208 under the control of the video input control unit 200. The frame buffer 201 includes a buffer 1 (first frame buffer 2011) and a buffer 2 (second frame buffer 2012), and video data 1 is input to the first frame buffer 2011. Further, the video data 2 is input to the second frame buffer 2012.

  Specifically, the encoding unit 202 includes an input switch 2021, an encoding processing unit 2022, an output switch 2023, an intermediate switch 2024, and the like.

  The input switch 2021 is a means for reading from the frame buffer 201. Further, the setting of the input switch 2021 is switched in accordance with a switch switching signal output from the encoder control unit 205, and the read data from the frame buffer 201 is input to the encoding processing unit 2022. The input switch 2021 encodes video data, which is target video data, among video data 1 stored in the first frame buffer 2011 and video data 2 stored in the second frame buffer 2012. Enter. The target video data will be described in detail later.

  The output switch 2023 is an output unit from the encoding unit 202. The output switch 2023 switches the setting according to the switch switching signal output from the encoder control unit 205, and outputs the encoded data generated by the encoding processing unit 2022 to the stream buffer 203. Specifically, the output switch 2023 outputs the generated encoded data as encoded data of the target video data. That is, when the target video data is video data 1, the output switch 2023 outputs the generated encoded data to the first stream buffer 2031 described in detail later. Further, when the target video data is video data 2, the output switch 2023 outputs the generated encoded data to the second stream buffer 2032 described in detail later.

  The intermediate switch 2024 is a temporary data storage unit from the encoding unit 202. The intermediate switch 2024 has its setting switched according to a switch switching signal output from the encoder control unit 205, and stores information necessary for encoding performed by the encoding processing unit 2022 in an encode buffer 204 (first 1 Encoding buffer 2041 and second encoding buffer 2042).

  The stream buffer 203 has a stream buffer that can store a plurality of frames according to the number of input video data (for example, 2). That is, the stream buffer 203 includes a plurality of stream buffers each storing a plurality of different frames. Specifically, the main body of the present embodiment has two input video data. Thus, the stream buffer 203 has two stream buffers, a first stream buffer 2031 and a second stream buffer 2032. Then, the encoding result of the video data 1 is temporarily stored in the first stream buffer 2031, and the encoding result of the video data 2 is temporarily stored in the second stream buffer 2032. These stored encoding results are finally stored in the recording medium 209, respectively.

  The encoder control unit 205 acquires information from the clock 206, user settings, the video input control unit 200, and the encoding unit 202, respectively.

  The user setting is, for example, a setting stored in a predetermined setting storage unit. Here, this setting memory | storage part is a memory | storage part with which the video recording device 1 is provided, for example.

  Then, the encoder control unit 205 acquires time information serving as a reference time for the operation of the video recording apparatus 1 from the clock 206.

  Also, the encoder control unit 205 acquires encoding recording setting, switching frame number setting (recording speed), and processing setting information when encoding is interrupted from user settings.

  Further, the encoder control unit 205 acquires the number of video data, the input video data resolution, the real-time property of the input video data, and video input timing information from the video input control unit 200.

  Further, the encoder control unit 205 acquires an encoder processing completion signal and encoding interruption information from the encoding unit 202.

  Then, the encoder control unit 205 uses the acquired information as input data to determine processing time allocation and processing switching.

  The encoder control unit 205 outputs the encoding start signal, the encoding interruption signal, the encoding resumption signal, the process setting information at the time of encoding interruption, the information at the time of resumption of encoding, and the switch switching signal by performing such processing as allocation. The encoder control unit 205 controls (the operation of) the encoding unit 202 by performing these outputs.

  Note that the switch switching signal is simultaneously input to the input switch 2021, the output switch 2023, and the intermediate switch 2024 by the encoder control unit 205. That is, for example, it is input to the output switch 2023 or the like at the same time as the time input to the input switch 2021. Specifically, when the encoding processing unit 2022 processes the video data 1, the encoder control unit 205 sets the input switch 2021, the output switch 2023, and the intermediate switch 2024 so that the terminal A is connected to the encoding processing unit 2022. A switch switching signal for switching is output to these input switches 2021 and the like. When the encoding processing unit 2022 processes the video data 2, the encoder control unit 205 sends a switch switching signal for switching the input switch 2021 and the like so that the terminal B is connected to the encoding processing unit 2022. Etc. respectively.

  Of the video data 1 and the video data 2, the video data processed by the encoding processing unit 2022 is called target video data. The target video data is changed from one of video data 1 and video data 2 to the other when a switch switching signal is output by the encoder control unit 205. The switch switching signal that is output identifies the target video data before the output as one video data before the change, and the control video data after the output is changed. And the other video after.

  The first video input control unit (non-recording medium) 207 is a block that handles video data without using a recording medium. For example, the first video input control unit 207 is a block that receives broadcast data, decodes a video stream, and generates video data, or captures video data from the outside.

  The second video input control unit (recording medium) 208 is a block that decodes stream data recorded on a recording medium such as an HDD, an optical disk, and a semiconductor memory to generate video data.

  The recording medium 209 is a block that stores a stream in an HDD, an optical disk, a semiconductor memory, or the like. The recording medium 209 may be, for example, an HDD.

  Further, when the encoding process performed by the encoding processing unit 2022 is a real-time encoding process, the video input control unit 200 notifies the encoding processing unit 2022 of video input timing information (not shown). On the other hand, in the case of non-real-time encoding processing, the encoding processing unit 2022 notifies the video input control unit 200 of video input timing information.

  That is, when the processing by the encoding processing unit 2022 requires real-time processing, the video input control unit causes the encoding processing unit 2022 to finish processing that should be completed by the time of the video input timing information by that time. Video input timing information is output to the encoding processing unit 2022. Here, the necessity for real time means that the process to be terminated needs to be terminated by the time at which the termination is to be performed.

  In addition, when the real time property is not necessary, the encoding processing unit 2022 provides video input timing information for causing the video input control unit 200 to perform control for inputting appropriate data to the encoding processing unit 2022 every time the processing is completed. And output to the video input control unit 200. Here, the appropriate data is data used by the encoding processing unit 2022 in the next process of the process.

  Next, the operation of the main body of the present embodiment will be described with reference to FIGS.

  In the description of the operation of the main body of the present embodiment, the encoding unit 202 encodes 1080I video data for two frames within the display time of one frame (two fields for interlace and one frame for progressive). Suppose you have the performance you can. The 1080I video data is video data having 1080 effective scanning lines.

  In the description of the operation of the main body of the present embodiment, it is assumed that the encoding unit 202 encodes one frame of each stream for two input streams basically at a display time of one frame.

  In the main body of the present embodiment, one unit time is divided by the encoder control unit 205 into the same number of allocation times as the number of video data (two). Here, the unit time is the display time of one frame described above. Each video data is processed by the encoder control unit 205 during the execution time of the video data allocation time. The execution time occupies a part or all of the allocated time including the execution time. The length of the allocation time is, for example, a length obtained by dividing the unit time length by the number of video data. For example, the length of the allocation time is equal to the length of time for which the encoding unit 202 processes one frame.

  3 to 8, the video input data (video data 1 and video data 2) are 1080I and 480I, the output stream 1 is a bit stream of a 1080I interlace signal of High profile@level4.1, and the output stream 2 is This is an example of a bit stream of a 480I interlace signal of High profile@level4.1.

  First, the encoder control unit 205 inputs the following information as input video data information to the encoder control unit 205.

  Since the processing amount of the video data n per frame is proportional to the resolution of the video data and the recording speed, the allocation time can be allocated as shown in (Equation 1) below.

time (n): Allocation time of video data n per frame
frame_time: 1 frame display time
mb (n): Number of MB per frame of video data n
speed (n): Recording multiple of video data n

  Since the video data 1 is a 1080I stream and the video data 2 is a 480I stream, the encoder control unit 205 mb (1) = 8160, mb (2) = 1350, speed (1), speed (2) = Identified as 1. When these values are applied to (Equation 1), they are as follows.

time (1) = frame_time × 8160 × 1 / (8160 × 1 + 1350 × 1) = frame_time × 0.86
time (2) = frame_time × 1350 × 1 / (8160 × 1 + 1350 × 1) = frame_time × 0.14

  Therefore, of the display time of one frame, the allocation time time (1) of the encoding process of the video data 1 is 1.7 field time, the allocation time time (2) of the encoding process of the video data 2 is 0.3 field time, and the encoder control unit 205 Is specific. That is, the encoder control unit 205 calculates the allocation time length of the video data 1 and the allocation time length of the video data 2 based on information from the video input control unit 200 and the like.

  The following three switching patterns of the encoding process will be described. The timing at which the encoder control unit 205 outputs the switch switching signal may be in various modes. A switching pattern for how the target video data is changed (switched) is determined according to the mode. In the following, three examples (X1) to (X3) are shown.

  (X1) Encoding processing is switched for each allocation time for one frame (FIG. 3). That is, every time the allocation time elapses, a switch switching signal is output, and the video data of the allocation time next to the allocation time is processed.

  (X2) When one frame is completed, the encoding process is switched (FIG. 4). That is, even before the allotted time has elapsed, when the execution time is completed, the switch switching signal is output.

  (X3) Encoding processing is switched for each of the allocation times for Nframes (FIG. 5). That is, the allocation time is a time obtained by multiplying the length of time for which the encoding unit 202 processes one frame by an integer N of 2 or more.

  This will be described in detail below.

  First, the switching pattern (X1) will be described.

  FIG. 3 is a diagram illustrating processing of the video recording apparatus 1 in an example in which a switch switching signal is output for each allocation time.

  Since the video input timing information (setting) is the video input control unit 200 (see the table of input video data information above), the encoder control unit 205 uses the time information from the clock 206 as shown in FIG. A switch switching signal is output every field time (16.7 msec) (see the upward arrow in FIG. 3). The encoder control unit 205 outputs an encoding start signal together with the output. Here, one field time is a time for the encoding processing unit 2022 to process one frame (= 2 fields).

  When the switch switching signal is output, the encoding unit 202 reads the internal information of the encoding processing unit and video data necessary for motion compensation prediction (if necessary) from the encoding buffer 204 and performs the encoding process. When the encoding process is completed, the information held in the encoding unit 202 and the video data necessary for motion compensation prediction are encoded in the encoding buffer 204 until the next allocation time for the current target video data starts. The unit 202 is saved.

  If the current frame encoding process is completed within the current allocation time among the current target video data processing, the video data input to the encoding unit 202 every field time as shown in FIG. Are switched to video data 1, video data 2, video data 1, and so on.

  Next, the switching pattern (X2) will be described.

  FIG. 4 is a diagram illustrating processing of the video recording apparatus 1 in an example in which a switch switching signal is output when the execution time is completed.

  Also, as shown in FIG. 4, a part of the timing at which the switch switching signal is output may be set as the other encoding process completion time. If the encoding process is completed within the allotted time, the video data input to the encoding unit 202 is switched to video data 1, video data 2, video data 1,... Every field time as shown in FIG. It will be.

  Finally, the switching pattern (X3) will be described.

  FIG. 5 is a diagram illustrating processing of the video recording apparatus 1 in an example in which the length of the allocation time is a length obtained by multiplying the processing time of one frame (time of one field) by N (= 2).

  Further, as shown in FIG. 5, the number of switching sheets may be set to 2 frames, and the output timing of the switch switching signal may be set to a processing time for 2 frames (2 field times). Since the number of times of switching is reduced, the number of times that the internal information of the encoding processing unit is restored and saved can also be reduced.

  When the number of switching sheets is 2 frames as shown in FIG. 5, the video data input to the encoding unit 202 is switched to video data 1, video data 2, video data 1... Every two field times. Become.

  Although not described, there are other patterns such as switching after completion of N frames.

  As described above, the encoder control unit 205 makes a determination based on the input video data information, and performs encoding processing for one frame in one field time while switching, so that two streams are output from one encoding unit 202. Can be output.

  As described above, the processing performance of the encoding unit 202 in the description of the main body of the present embodiment can process two frames in one frame display time with respect to 1080I video data. The encoding process is completed in one field time. However, it is necessary to assume a case where the encoding process is not completed in one field time due to external factors. By determining the encoding process allocation according to the video size as described above, it is possible to set the process allocation time in consideration of external factors.

  If the encoding process before switching is not completed, the following control is performed. That is, in the following examples (Y1) to (Y3), the processing when only a part of the processing of the frame to be processed in the allocation time is completed during the allocation time will be described. .

  (Y1) The processing for 1 frame is interrupted, restarted at the next allocation time, and the remaining 1 frame is encoded (FIG. 6). In other words, the remaining processing of the frame processing other than the partial processing performed is performed at the next allocation time allocated for the video data after the allocation time during which the partial processing is performed. .

  (Y2) Processing for one frame is interrupted, and the next one frame is encoded in the next allocation time (FIG. 7). That is, the remaining processing is not executed in the next allocation time.

  (Y3) The processing for one frame is extended, and encoding is continued when there is room in other allocation time (FIG. 8). That is, after the allocation time of a part of the processing that has been performed, the remaining processing is performed at the allocation time allocated for video data other than the video data of the allocation time. That is, a part (or all) of the other video data allocation time is changed to the video data allocation time for the remaining processing, and the video data allocation time is extended.

  First, the case of control (Y1) will be described.

  FIG. 6 is a diagram illustrating a process when the encoding process of video data is not completed in one field time (time T09 to time T10). In FIG. 6, time T02a, time T04a,... Time T14a are also illustrated.

  If the encoding process before switching is not completed, the encoder control unit 205 outputs the processing setting information and the encoding interruption signal at the time of encoding interruption to the encoding unit 202. After this output, the encoder control unit 205 receives an encoder processing completion signal and a notification of encoding processing interruption information from the encoding unit 202, and then outputs an encoding start signal to the encoding unit 202.

  If the encoder control unit 205 specifies that there is an interrupted encoding process (process interrupted at time T10a) when an encoding start signal is generated by the encoder control unit 205 (time T11), The encoder control unit 205 outputs the following. That is, in this case, the encoder control unit 205 outputs the encode restart signal to the encode unit 202 together with the encode restart time information instead of the encode start signal.

  Since the number of switching frames is set to 1 (see the table of input video data information), the encoding unit 202 performs an encoding process for one frame when detecting the encoding start signal from the encoder control unit 205. The encoding unit 202 notifies the encoder control unit 205 of an encoder processing completion signal and encoding interruption information while performing encoding processing according to the H.264 (H.264 / AVC) encoding method. In the processing of the image 4 of the video data 1 in FIG. 6 (processing of the hatched area of the image 4 having a wide pitch), an encoding processing delay occurs, and the video data 1 is allocated within the time (time T09 to time T10). An example in which the encoding process has not been completed is shown.

  The encoder control unit 205 can determine that the encoding process has not been completed since the encoding process completion signal is not transmitted from the encoding unit 202 within the allocated time after starting the encoding. If it is determined that the encoding process has not been completed within the allocated time, the encoder control unit 205 outputs an encoding interruption signal and processing setting information at the time of encoding interruption to the encoding unit 202. When the encoding unit 202 receives the encoding interruption signal, the encoding unit 202 performs processing based on the processing setting information at the time of encoding interruption output to the encoding unit 202 together with the encoding interruption signal. Specifically, the encoding unit 202 performs the encoding processing up to the encoding processing unit specified by the output processing setting information at the time of the encoding interruption, among slices or macroblocks. The encoding unit 202 interrupts the encoding process when the encoding process is completed up to the encoding process unit (time T10a).

  In this way, when the encoding unit 202 interrupts the encoding process, the encoding unit 202 outputs information at the time of encoding interruption such as resume position information. However, the encoding unit 202 has a part or all of some data, that is, information held in the large-capacity frame buffer 201 and the encoding unit 202, and video data necessary for motion compensation prediction. The data is saved in the encode buffer 204. The encoding unit 202 may guard the interrupted frame buffer (the first frame buffer 2011 or the second frame buffer 2012) from being overwritten when the free space of the frame buffer 201 is large.

  Upon receiving the encoding interruption information (described above) from the encoding unit 202, the encoder control unit 205 outputs a switch switching signal (time T10a). Thereby, the encoder control unit 205 changes each setting of the input switch 2021, the output switch 2023, and the intermediate switch 2024 to a setting different from the current setting. Specifically, in the example of FIG. 6, the encoder control unit 205 outputs a switch switching signal at time T <b> 10 a so that the setting of the input switch 2021 and the like is set to the terminal B so as to process the video data 2. The setting is switched to the setting for connection to the encoding processing unit 2022. As a result, the encoding unit 202 starts encoding processing of the image 4 of the video data 2 (processing of the hatched area of the image 4 having a narrow pitch).

  Then, the encoder control unit 205 outputs the switch switching signal again when the encoding allocation time of the video data 2 has elapsed (time T11). By this switch switching signal, the settings of the input switch 2021, the output switch 2023, and the intermediate switch 2024 are switched to a setting in which the encoding processing unit 2022 is connected to the terminal A. The encoder control unit 205 outputs the encoding restart signal and the encoding restart time information to the encoding unit 202 because the previous processing of the video data 1 was not completed but interrupted (time T10a). Thereby, the encoding unit 202 resumes the encoding process of the image 4 of the interrupted video data 1 (time T11 to time T11). At this time, the encoding unit 202 restores the storage area written in the encoding process of the video data 2 to the state when the video data 1 is interrupted based on the encoding restart information and the data in the encoding buffer 204. To do. Then, after the restoration, the encoding unit 202 performs the encoding process of the image 4 of the interrupted video data 1 and the encoding process of the image 5 of the video data 1 that is originally processed (time T11 to time T12). First half and second half). Here, the storage area is, for example, a part of the encoding unit 202.

  Next, the control (Y2) will be described.

  FIG. 7 is a diagram illustrating processing of the video recording apparatus 1 in an example where the remaining processing is not performed.

  In the process of resuming interruption described with reference to FIG. 6, if the real-time property of the encoding process cannot be guaranteed, after the interruption (time T10a in FIG. 6), the recording data is processed by skipping to the next picture. Although it is missing, system failure can be avoided. The operation will be described with reference to FIG. The encoder control unit 205 may add information to be skipped at the time of interruption to the process setting information at the time of interruption of encoding output to the encoding unit 202.

  In the processing of the image 4 of the video data 1 in FIG. 7 (processing of the wide hatched area of the image 4), a delay of the encoding processing occurs, and within the allocation time of the video data 1 (time T09 to time T10). An example in which the encoding process has not been completed is shown.

  The encoder control unit 205 can determine that the encoding process has not been completed since the encoding process completion signal is not sent from the encoding unit 202 within the allocated time (from time T09 to time T10) after starting the encoding. . If it is determined that the encoding process has not been completed, the encoder control unit 205 outputs an encoding interruption signal and processing setting information at the time of encoding interruption to the encoding unit 202.

  When receiving the encoding interruption signal, the encoding unit 202 forcibly terminates the encoding process immediately because the processing setting information at the time of encoding interruption output together with the encoding interruption signal is a skip setting (time T10a). . Since the data is skipped, the encoding processing unit 2022 (encoding unit 202) does not save the information held in the encoding processing unit 2022 or video data necessary for motion compensation prediction in the encoding buffer 204.

  In the case of forced termination, the encoding unit 202 outputs an encoding process completion signal to the encoder control unit 205.

  Upon receiving the encoding process completion signal from the encoding unit 202, the encoder control unit 205 outputs a switch switching signal to the encoding unit 202 (time T10a). As a result, the encoder control unit 205 switches the settings of the input switch 2021, the output switch 2023, and the intermediate switch 2024 to settings for connecting the terminal B to the encoding processing unit 2022 so as to process the video data 2. As a result, the encoding unit 202 starts encoding processing of the image 4 of the video data 2 (hatching processing in which the pitch of the image 4 is narrow) in response to the switching.

  Then, the encoder control unit 205 outputs a switch switching signal when the encoding allocation time of the video data 2 has elapsed (time T11). By this switch switching signal, each setting of the input switch 2021, the output switch 2023, and the intermediate switch 2024 is switched to a setting in which the encoding processing unit 2022 is connected to the terminal A. Further, the encoder control unit 205 outputs an encoding start signal to the encoding unit 202 because the previous processing of the video data 1 has been completed (time T10a). As a result, the processing of the image 4 of the video data 1 interrupted at the time T10a (the region of the image 4 by the wide pitch hatching) is skipped (the remaining processing of the processing is not performed), and the image 4 The encoding processing unit 2022 performs encoding processing for the next image 5. At this time, the encoding unit 202 stores, for example, the storage area in which the video data 2 is written by the encoding process of the video data 2 based on the encoding restart information and the data from the encoding buffer 204, in the state when the video data 1 is interrupted ( For example, the state returns to the state at time T10a). Then, after the restoration, the encoding unit 202 encodes the image 5 of the video data 1 (processing with a wide hatching of the image 5).

  Finally, the control (Y3) will be described.

  FIG. 8 is a diagram illustrating processing of the video recording apparatus 1 when the allocation time is extended.

  If the loss of recorded data is not allowed, the system failure can be avoided by changing the allocation time at one time as described below. The operation will be described with reference to FIG. The encoder control unit 205 may add information indicating that the processing is to be extended at the time of interruption to the processing setting information at the time of interruption of the encoding that is output to the encoding unit 202.

  In the processing of the image 4 of the video data 1 in FIG. 8 (processing of wide hatching of the image 4), a delay of the encoding processing occurs, and the encoding processing is performed within the allocation time of the video data 1 (time T09 to time T10). It shows an example that was not completed.

  The encoder control unit 205 can determine that the encoding process has not been completed since the encoding process completion signal is not transmitted from the encoding unit 202 within the allocated time after starting the encoding. When it is determined that the encoding process has not been completed, the encoder control unit 205 outputs an encoding interruption signal and processing setting information at the time of encoding interruption to the encoding unit 202. When receiving the encoding interruption signal, the encoding unit 202 continues the encoding process because the process setting information at the time of encoding interruption output together with the encoding interruption signal has an extension setting. Specifically, the encoding unit 202 continues the encoding process by taking over the allocation time from the time of the encoding process of the video data 2 (the process of the area by the narrow pitch hatching). However, the extended time extended by the transfer is performed within a range that does not affect the completion of the encoding process of the video data 2 on the transfer side. When the encoding process is completed within the extension period, the encoder control unit 205 outputs an encoding process completion signal to the encoding unit 202 as in the normal completion.

  By doing so, the delay of the encoding process of each video data does not affect the encoding process of other video data other than the video data, so that the performance of each encoding process can be easily guaranteed.

  In the modification of the embodiment, in the above-described aspects A3, A4, A5, A11, A12, and A15, encoding processing other than equal magnification, non-real-time performance encoding processing, and a plurality of encodings from one video data An encoding process for creating subsequent data will be described.

  In the modification, it is assumed that the encoding unit 202 has a processing performance capable of processing one frame for two frames display time with respect to 1080I.

  In FIG. 9, video data (video input data) is 1080I and 480I data, output stream 1 is a bit stream of a 1080I interlaced signal of High profile @ level 4.1, and output stream 2 is High profile @ level4. This is an example of a bit stream of 1 480I interlace signal.

  First, the encoder control unit 205 inputs the following information as input video data information to the encoder control unit 205.

  Since the recording speed of the video data 1 is double speed, the input video data of the video data 2 is not real-time, and the recording speed of the video data 2 may be high, the free time for the encoding process of the video data 1 This is used as the processing time of the video data 2. That is, of the first allocation time allocated to the processing of the video data 1, the free time that does not have a harmful effect even if it is changed to the processing time of the video data 2 is the second allocation for the processing of the video data 2. The time is changed (processing of the narrow hatched area in FIG. 9). That is, the video recording apparatus 1 calculates the processing time of each video data by setting the number of MBs mb (2) per frame of the video data 2 to 0 in the above-described (Formula 1). As a result, the encoder control unit 205 specifies the entire display time of one frame as the allocation time of the encoding process of the video data 1 in principle. Since the video data 1 is a 1080I stream and the video data 2 is a 480I stream, the encoder control unit 205 does not reflect that mb (2) = 0, mb (1) = 8160, mb ( 2) = 1350, speed (1) = 2, speed (2) = 1. However, since it is calculated as mb (2) = 0, it is as follows.

time (1) = frame_time × 8160 × 2 / (8160 × 2 + 0 × 1) = frame_time × 1
time (2) = frame_time × 0 × 1 / (8160 × 2 + 0 × 1) = 0

  However, the actual processing time of time (2) is as follows. That is, the second allocation time after the change that is changed so as to include the above-described free time is as follows.

    frame_time-encoding time for 2 frames of video data 1

  Since the video input timing information (setting) is the encoder control unit 205, when the encoding process of the video data 1 (even frame thereof) is completed (time T02), the encoder control unit 205 further transfers the video data. To the video input controller 200. Thus, the video input control unit 200 performs video input according to the double speed encoding process (time T02 to time T02a).

  If the video input control unit 200 controls to multiply the allocation time of the encoding process by the double speed, the discussion can proceed as in the above description.

  Since the video input timing information (setting thereof) is the encoder control unit 205, when the encoding process of the video data 1 (even number frame thereof) is completed (time T02), the next video data (odd frame) is transferred to the encoder control unit 205. Can be prepared. Therefore, after completion of the above, the encoding processing unit 2022 performs the second encoding process of the video data 1 (time T02 to time T02a). The encoder control unit 205 may output a switch switching signal (switch switching signal at time T02a) simultaneously with the completion of the second encoding process.

  On the other hand, regarding the encoding process of the video data 2, video input timing information (setting) is the encoder control unit 205. For this reason, when the encoding process of the video data 2 is completed (time T12a), as long as there is a remaining second allocation time for the video data 2 (time T12a to time T13), the next frame data after the process is completed. The encoding processing unit 2022 encodes the frame data. When the second allocation time ends (time T13), the encoding processing unit 2022 interrupts the processing, and the processing to be performed is switched to the encoding processing of the video data 1.

  On the other hand, the encoding process of the video data 2 will be described. Since mb (2) = 0, there is no predetermined allocation time for the second video data. That is, although the allocation time of the video data 2 is basically 0, the idling time (free time) of the encoding process of the video data 1 is the allocation time for the encoding 2 (encoding of the video data 2).

  Since the video input timing information (setting) is the encoder control unit 205, the video input control is performed so that new video data (next frame data) is input when the encoding process of 1 frame is completed (time T12a). The encoder control unit 205 controls the unit 200. By performing this control, the encoder control unit 205 causes the encoding processing unit 2022 to continue encoding processing of the video data 2 during the allocation time of the video data 2 (until time T13). Each time a switch switching signal is generated, the encoder control unit 205 performs control of interruption and resumption.

  In consideration of the above points, the encoder control unit 205 ensures that the video data 1 can be encoded at double speed and that the video data 1 is encoded at double speed. The second allocation time is appropriately determined. That is, the encoder control unit 205 secures the video data 2 so that the video data 2 is encoded using the idle time of the allocated time for processing the video data 1. The second allocation time of is determined.

  By applying the present invention, non-real time encoding processing is performed in the idle time while guaranteeing the encoding processing time for encoding at a specified recording speed within the time at the specified recording speed. Can do.

  Next, FIG. 10 is a diagram illustrating an example in which one video data is recorded in two different streams. Specifically, the video data (video input data) is in a 1080I format, and the output stream 1 is a high profile @ level 4.1 1080I bit stream, the stream 2 is a Baseline profile @ level 1.2, QVGA bit stream It is an example.

  First, the video input control unit 200 inputs video data to the first frame buffer 2011. Further, after the input video data is resized to a QVGA data by a predetermined resize unit (for example, the video input control unit 200), the resized data is stored in the second frame buffer 2012 to the resize unit. Is controlled to input. According to this, discussion can be advanced similarly to said description. The following information is input to the encoder control unit 205 as input video data information. Note that the resizing process may be a process using a known technique, for example.

  The encoding record setting of the video data 1 is High profile @ level 4.1 and 1080I, while the encoding recording setting of the video data 2 is Baseline profile @ level 1.2 and QVGA. The encoder control unit 205 specifies that the video data 1 is a 1080I stream, the video data 2 is a QVGA stream, and the recording speed of both video data is 1 × recording. Then, the encoder control unit 205 determines that the video data 1 is a 1080I stream and the video data 2 is a 480I stream, while mb ( Specify 1) = 8160, mb (2) = 240, speed (1), speed (2) = 1.

time (1) = frame_time × 8160 × 1 / (8160 × 1 + 240 × 1) = frame_time × 0.97
time (2) = frame_time × 240 × 1 / (8160 × 1 + 240 × 1) = frame_time × 0.03

  Therefore, of the display time of one frame, the allocation time (first allocation time) of the video data 1 is 1.9 (approximately 0.97 × 2) field time, and the encoding processing allocation time of the video data 2 (second time) (Allocation time) is 0.1 (approximately 0.03 × 2) field time. Thereafter, the encoder control unit 205 performs the same control as described above, thereby realizing an appropriate encoding process.

  In the main body and the modification of the embodiment of the present invention, two video data input examples are shown. On the other hand, the number of video data that can be input is two or more if the number is equal to or less than the upper limit determined by the encoding processing performance of the encoding unit 202, the resolution of the input video data, and the real-time performance of the input video data. There may be.

  As described above, when the number of input video data is increased, the number of terminals of the frame buffer 201, the stream buffer 203, the encode buffer 204, the input switch 2021, etc. is added by the number of lines, that is, the number of input video data. Good.

  In the main body and modification of the embodiment of the present invention, the encoding unit 202 outputs the H.264 (H.264 / AVC) encoded stream, but the present invention is not limited to this. The output stream may be a hierarchically encoded stream, or simply an encoded stream.

  In the main body and the modification of the embodiment of the present invention, the allocation time is calculated using (Equation 1), but (Equation 1) can be changed and used according to the parameters to be considered.

  That is, FIG. 2 shows the video recording apparatus 1.

  The video recording apparatus 1 includes a video input control unit 200, an encoding unit 202, and an encoder control unit 205.

  The video input control unit 200 identifies first video data (video data 1) and second video data (video data 2). The video input control unit 200 stores the video data in the first frame buffer 2011, thereby identifying the video data stored in the first frame buffer 2011 as the first video data. Further, the video input control unit 200 stores the video data in the second frame buffer 2012, thereby identifying the video data stored in the second frame buffer 2012 as the second video data.

  The encoding unit 202 includes an input switch 2021, an encoding processing unit 2022, and an output switch 2023.

  The input switch 2021 acquires a switch switching signal output by the encoder control unit 205 described in detail later, and inputs the acquired switch switching signal to the input switch 2021. The switch switching signal is a signal that specifies timing for changing the video data (target video data) encoded by the encoding processing unit 2022 from one of the first video data and the second video data to the other. It is. The switch switching signal specifies, for example, the timing at which the switch switching signal is output as the timing of the change. Depending on whether the switch switching signal is before or after the timing specified by the switch switching signal, if the time is before, the video data before the change (for example, video data 1) is the target video. Specify as data (above). On the other hand, if the switch switching signal is later, the changed video data (video data 2) is specified as the target video data. The input switch 2021 inputs video data as target video data, out of the first video data and the second video data, to the encoding processing unit 2022.

  The encoding processing unit 2022 encodes video data (target video data) input to the encoding processing unit 2022 by the input switch 2021. Then, the encoding processing unit 2022 outputs the encoded data after this encoding.

  The output switch 2023 inputs the same switch switching signal output from the encoder control unit 205 as the switch switching signal input to the input switch 2021 to the output switch 2023. The output switch 2023 causes the encoded data output by the encoding processing unit 2022 to be output as encoded data obtained by encoding the target video data when the encoded unit 202 outputs the encoded data to the outside. Specifically, when the target video data is video data 1, the output switch 2023 stores the output encoded data in the first stream buffer 2031. Further, when the target video data is the video data 2, the output switch 2023 stores the output encoded data in the second stream buffer 2032. Thus, the output switch 2023 stores the video data in the stream buffer corresponding to the target video data, and outputs the video data as encoded data obtained by encoding the target video data.

  The encoder control unit 205 outputs a switch switching signal. The output switch switching signal is input to the input switch 2021 and the output switch 2023, respectively. The encoder control unit 205 outputs the switch switching signal to change the video data processed by the encoding unit 202 from one of the first video data and the second video data to the other. Then, the encoder control unit 205 causes the encoding unit 202 to perform the processing of the first video data and the processing of the second video data in parallel (by time division processing) by repeating the control for making this change.

  FIG. 3 shows the processing of the video recording apparatus 1.

  The horizontal axis in FIG. 3 indicates time. As for the time from time T01 to time T02, the time from time T02 to time T03, etc., the encoding unit continuously encodes one video data of the first video data and the second video data. This is the allocated time that the encoder control unit 205 performs in 202. Specifically, the allocation time is, for example, a time longer than the time required for the encoding unit 202 to process one frame of video data processed in the allocation time. For example, the encoding unit 202 performs processing of two fields constituting one frame of an interlace signal within one field time (see the uppermost stage in FIG. 3). For this reason, in the example of FIG. 3, the allocation time is a time having the same length as the length of one field time, as shown in the uppermost stage of FIG.

  An upward arrow line in the “switch switching signal output timing” column at the bottom of FIG. 3 indicates a timing at which the encoder control unit 205 outputs a switch switching signal.

  The graph in the second column from the bottom of FIG. 3 shows the operation of each switch such as the input switch 2021. During the time when the graph takes a high value, the target video data is the first video data, and the input switch 2021 inputs the first video data to the encoding processing unit 2022. During the time when the graph takes a low value, the target video data is the second video data, and the input switch 2021 inputs the second video data to the encoding processing unit 2022. That is, during the time when the graph takes a high value, the encoding unit 202 processes the first video data. During the time when the graph takes a low value, the encoding unit 202 processes the second video data.

  The third column from the bottom of FIG. 3 shows each first implementation time in which the first video data is processed by each hatched area having a wide pitch. Also, each second implementation time during which the second video data is processed is indicated by each hatched area with a narrow pitch.

  The implementation time occupies a part or all of the allocated time including the implementation time (for example, time T01 to time T02).

  The allocation time is a time at which the switch switching signal is output at the start time of the allocation time and the switch switching signal next to the switch switching signal is output at the end time of the allocation time. The allocation time is a time during which the video data corresponding to the allocation time is processed during the allocation time among the first video data and the second video data.

  These matters are the same in FIG. 4 and the like.

  FIG. 11 shows a flowchart of the video recording apparatus 1.

  In step S 1, the encoding processing unit 2022 encodes the target video data input by the input switch 2021, and outputs the encoded data after encoding through the output switch 2023.

  In step S2, the encoder control unit 205 determines whether or not to change the target video data. If the encoder control unit 205 determines not to end the process (step S2: NO), the encoder control unit 205 subsequently causes the video recording apparatus 1 to perform the process of encoding the current target video data (step S1).

  In step S3, when it is determined in step S2 that the process is to be ended (step S2: YES), the encoder control unit 205 performs all the processing of the next target video data to be processed next to the current target video data. Is determined by the video recording apparatus 1. If it is determined that the processing of the next video data has been completed (step S3: NO), the video recording apparatus 1 may end the processing of FIG. 11, for example.

  In step S4, when it is determined in step S3 that the processing of the next video data has not been completed (step S3: YES), the encoder control unit 205 outputs a switch switching signal. By performing this output, the encoder control unit 205 causes the encoding unit 202 to process the next video data in the subsequent step S1.

  Note that the determination in step S2 is performed when it is determined to end (step S2: YES), and a switch switching signal is output, and it is determined that the process is not ended (step S2: NO). This is a determination that the switch switching signal is not output. That is, in the determination in step S2, the encoder control unit 205 determines whether or not to output a switch switching signal.

  The video recording apparatus 1 performs the following process by the process of FIG.

  In the first step S1, the encoding processing unit 2022 performs encoding processing of the first video data (for example, times T03 to T04 in FIG. 3).

  Next, in the first step S4, the encoder control unit 205 changes the target video data to the second video data after the encoding process in the first step S1 is completed (time T04).

  Next, in the second step S1, the encoding processing unit 2022 performs an encoding process on the target video data after the change (second video data) changed in the first step S4 (time T04 to time T05). ).

  Next, in the second step S4, the encoder control unit 205 changes the target video data to the next video data (first video data) after the encoding process in the second step S1 is completed. (Time T06).

  Next, in the third step S1, the encoding processing unit 2022 performs an encoding process on the target video data after the change (first video data) changed in the second step S4 (time T06 to time T07). ).

  By repeating such processing, the processing of the first video data and the processing of the second video data are performed in parallel (by time division processing).

  In this way, the encoding processing unit (encoding processing unit 2022) performs encoding processing of video data. Also, the encoder control unit (encoder control unit 205) performs a time other than a predetermined allocation time (for example, time T03 to time T04 in FIG. 3) for the first video data (time T04 to time T05, time). (T02 to time T03, etc.), the encoding processing unit performs encoding processing of second video data different from the first video data. Here, in the allocation time, the encoding processing unit performs the encoding process of the first video data. Such a video recording apparatus is configured.

  In addition, each technical matter explained as described above is appropriately combined with other technical matters described in other places other than the place where the technical matters are described without departing from the spirit of the invention. May be.

  As described above, the video recording method and video recording apparatus of the present invention are effective for video recording apparatuses that compress and record any video on an optical disk, semiconductor memory, hard disk, or the like.

200 Video Input Control Unit 201 Frame Buffer 202 Encoding Unit 203 Stream Buffer 204 Encoding Buffer 205 Encoder Control Unit 206 Clock 207 First Video Input Control Unit 208 Second Video Input Control Unit 209 Recording Medium 2011 First Frame Buffer 2012 First 2 frame buffer 2021 input switch 2022 encoding processing unit 2023 output switch 2024 intermediate switch 2031 first stream buffer 2032 second stream buffer 2041 first encode buffer 2042 second encode buffer

Claims (16)

A video input unit for inputting a plurality of video data;
A frame buffer for storing each of the plurality of video data input from the video input unit;
An encoding processing unit for encoding video data;
An encoder control unit that controls which video data is encoded by the encoding processing unit among the plurality of video data stored in the frame buffer;
The encoder control unit determines an allocation time to be given to each encoding process of the plurality of video data, and when the allocation time elapses, the encoding processing unit follows the video data of the encoding process of the allocation time A video recording apparatus that switches the target video data encoded by the encoding processing unit to the video data to be encoded.   The video recording apparatus according to claim 1, wherein the encoder control unit switches an allocation time given to encoding processing of a first predetermined unit of video data.   The encoder control unit inputs resolution information of each video data to be encoded as input video data information, and switches the allocation time of the video data of the resolution information using the input resolution information. Item 2. The video recording apparatus according to Item 2.   The encoder control unit inputs, as input video data information, whether video data should be encoded in real time or non-real time, and uses the input video data information to assign the allocation time of the video data The video recording apparatus according to claim 2, wherein the video recording device is switched.   When the allocated time elapses, the encoder control unit performs an encoding process of a first predetermined unit in the video data, which should have been completed by the time the elapsed time, 2. The switching signal for switching the target video data to the next video data to be encoded by the encoding processing unit next to the video data of the allocation time when the video data has been completed. Video recording device.   The encoder control unit is a first predetermined unit in the video data that the encoding processing unit should complete during the encoding process before the allocation time elapses before the allocation time elapses. When it is confirmed that the encoding processing unit has completed the encoding process, the target video data is switched to the next video data to be encoded by the encoding processing unit after the video data of the allocated time. The video recording apparatus according to claim 1, wherein the switching signal is output before the elapsed time.   When the allocation time has elapsed, the encoder control unit performs encoding processing of a first predetermined unit in video data that the encoding processing unit should have completed during the encoding process before the allocation time elapses When the encoding processing unit is not completed, the encoding processing unit waits for the completion of the encoding process of the second predetermined unit included in the first predetermined unit currently being encoded. Then, the encoding information of the video data currently being encoded is saved in a predetermined storage area as encoding restart information, and after the saving, the encoding processing unit encodes the video data next to the video data. The video recording apparatus according to claim 1, wherein a switching signal for switching the target video data to the next video data to be processed is output.   When the allocated time has elapsed, the encoder control unit has not completed the first predetermined unit of encoding processing in video data that the encoding processing unit should have completed the encoding process by that time. In this case, the encoding information of the second processing unit included in the first predetermined unit, in which the encoding processing unit has already completed the encoding process within the allocated time, is preliminarily set as the encoding restart information. And a switching signal for switching the target video data to the next video data to be encoded by the encoding processing unit after the video data of the allocated time after saving to a predetermined storage area. Item 2. The video recording apparatus according to Item 1.   The second predetermined unit constitutes the first predetermined unit by one or more second predetermined units, and each of the one or more second predetermined units is encoded, whereby the first predetermined unit is encoded. 8. The video recording apparatus according to claim 7, wherein one predetermined unit is a processing unit to be encoded.   The encoding processing unit completes all the encoding processing of the first processing unit of the video data in the encoding processing immediately before the encoding processing for the video data to be encoded. In this case, the encoding process of the first processing unit next to the first processing unit in the video data is started, and all the encoding processes of the first processing unit are performed in the immediately preceding encoding process. 2. The previous encoding process is restarted by using the encoding resumption information saved in a predetermined storage area by the encoding processing unit in the immediately preceding encoding process when not completed. Video recording device.   The video recording apparatus according to claim 2, wherein the first predetermined unit is composed of M (M = 1, 2, 3 natural numbers) pictures.   The video recording apparatus according to claim 11, wherein the first predetermined unit can select different M sheets.   The video recording apparatus according to claim 1, wherein the encoder control unit instructs a predetermined input control unit that controls a timing at which video data is input to the encoding processing unit.   The video recording apparatus according to claim 9, wherein the second predetermined unit is a slice composed of a plurality of macroblocks that are the minimum unit of encoding, or a macroblock that is the minimum unit of encoding.   When the allocated time has elapsed, the encoder control unit has not completed the first predetermined unit of encoding processing in video data that the encoding processing unit should have completed the encoding process by that time. In this case, the time included in the allocation time of the encoding process by the encoding processing unit of the video data other than the video data is added to the allocation time of the video data after the allocation time has elapsed, and the video 2. The video recording apparatus according to claim 1, wherein the data allocation time is extended.   The video recording apparatus according to claim 1, wherein the encoding processing unit encodes one video data to be encoded with a plurality of different recording settings to generate a plurality of stream data.

Images