JP2009284521A - Frame rate converting apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To conduct a time code conversion automatically and to release a hand from troublesome work as the time code conversion is essential to a frame rate converting apparatus, the time code conversion becomes further complicated because time changes before and after conversion when handling a variable speed frame rate, a technique established to the time code conversion which does not exist, and stopgap measures are used as the present condition. <P>SOLUTION: An addition system of a time code in the conversion of the variable speed frame rate is actualized by methods as follows; (1) a method to make starting points the same, (2) a method to record continuous time codes, (3) a method to provide a sync point, (4) a method to perform 00 rounding, (5) a method to store the time code in a user's bit, and (6) a method to store a changed part of a frame rate, are used. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a frame rate conversion apparatus for converting a variable frame rate video to a predetermined frame rate, and more particularly to a time code calculation method.

  A number of methods for converting the frame rate, such as a 2: 3 pull-down process from film video to NTSC and a conversion process from NTSC to PAL, and methods for efficiently performing the process have been proposed. These technologies are characterized in that the length of the video before and after conversion does not change.

  On the other hand, there is a method in which the video length changes before and after the conversion, that is, a frame rate conversion method in which the video after the conversion is slowed or fastened before the conversion. For example, there has been proposed a system that realizes a smooth 1 / 2.5 slow by converting a video shot at a frame rate of 60 frames / second into 24 frames / second.

  There has also been proposed a variable frame rate shooting camera that allows a photographer to freely change the frame rate during shooting. For example, an image captured by this camera is recorded at 60 frames / second for one scene and 12 frames / second for another scene.

  A frame rate conversion system compatible with this camera has also been proposed. When the above video is converted to 24 frames / second, a 60 frame / second scene is 1 / 2.5 slow, and a 12 frame / second scene is double speed. It is converted to video.

  In such a frame rate conversion system, a problem is how to attach a time code to the converted video.

  Since converting the frame rate is changing the number of frames displayed per second, it is essential to convert the time code. In frame rate conversion in which the video length changes before and after conversion, the time code of all digits may change, not just the last two digits. For example, when converting a frame with a time code of 01: 15: 24: 30 of a video of 60 frames / second to 24 frames / second, if the length of the video does not change before and after the conversion, 01:15:24: However, when the video length changes before and after conversion, a time code such as 01: 15: 24: XX is not always attached. The method for calculating the time code when the video length changes before and after the frame rate conversion has not been established, and it has been entrusted to the operation in the past.

  When video shot at a variable frame rate is converted to frame rate and the output video is used as video material for editing, it is clear during editing that it is better to convert only the necessary section than converting all video. It is possible to proceed with the editing work efficiently without the need to examine a new NG image. However, it is a time-consuming task to attach a time code that does not overlap with the input video. In this case, it is desirable to automatically add a new time code during the frame rate conversion process, rather than manually attaching the time code.

If it is determined that the time code of the output video starts from 0 as an automation method, the input video of 30: 0/00: 00-00: 03: 59: 29, 01: 01: 00: 00 When the input video of −01: 03: 59: 29 is converted to 24 frames / second, the length of the converted video is 00: 05: 00: 00: 00, so that 00: 00: 00: 00-00: An output video with the same time code of 04:59:23 is created, and the converted time codes overlap. Further, the time code of the input video cannot be inferred from the output video, and the correspondence with the input video cannot be obtained.

  It is an object of the present invention to establish a method of attaching a time code to an output video that is compatible with an input video and has no overlap in a variable frame rate conversion system.

In order to solve the above-mentioned problems, here, methods for re-assigning time codes are listed and their characteristics are described.
The frame rate conversion apparatus according to the present invention is basically configured as shown in FIG.

  1. A time code detection unit 103 that extracts a time code from an input video with a time code, and calculates the detected time code based on the frame rate of the input video, the frame rate of the output video, and the like to obtain a time code to be put on the output video This is a frame rate conversion system including a time code calculation unit 104, a frame rate conversion unit 101 for converting the frame rate of the input video, and a time code synthesis unit 102 for changing the time code of the output video. The time code calculation unit 104 determines the start point of the video, and performs a process of sequentially incrementing the time code so as to be linked with the output video.

  Further, as shown in FIG. 2, the system includes a mechanism capable of external input. The time code input by the user to the time code input unit 205 is adopted as the time code at the start point of the output video, and fine adjustment by the user is performed.

  2. As a process of the time code calculation unit 104, a frame rate conversion system having a method of adopting a start time code of an input video as a start time code of an output video.

  3. The processing of the time code calculation unit 104 is a frame rate conversion system having a method in which an internal counter is provided in the time code calculation unit 104 and the time code is reset so that it becomes continuous in the converted order.

4). First, a sync point is set at one point on the time code. This sync point has the property that the time code of the input video and the output video at that point always coincide.
As the processing of the time code calculation unit 104, the number of frames of the input time code and the sync point is calculated, the time code when the time code is converted from the sync point from the frame rate of the output video and the number of frames is obtained, and the time of the sync point is calculated. This is a frame rate conversion system having a method for obtaining an output time code by applying a code. In other words, when TI is an input time code, TO is an output time code, TS is a sync point, FRI is an input frame rate, and FRO is an output frame rate, TO is obtained so that the following equation is established.

TI-TS: FRI = TO-TS: FRO
5. After any of the time code replacement methods proposed in the present invention, the frame display portion is rounded for 24P A frame alignment, and the time code of ab: cd: ef: gh is replaced with ab: cd: ef: 00. It is a method.

  6). A frame rate conversion system having a function of storing the time code of the input video detected by the time code detection unit 403 in the user bits of the output video by the user bits synthesis unit after any time code replacement method proposed in the present invention It is.

  7. The frame rate change point detection unit 406 receives the frame rate of the input video detected by the frame rate detection unit 405 and the time code detected by the time code detection unit 403 as input, recognizes the location where the frame rate has changed, The time code and frame rate at that time are stored in the frame rate change point data storage unit 407 as frame rate change point data. Based on the section specified by the user by the output section specifying section 408 and the frame rate change point data, the input section calculating section 409 obtains the input video conversion section.

  By inputting the input video conversion section and the input video to the input video selection unit 400, only the designated section in the input video is extracted. The extracted input video is converted by the frame rate conversion system. This process is shown in FIG.

As described above in detail, according to the present invention, addition of a time code when converting a variable frame rate video to a predetermined frame rate can be performed quickly and efficiently without human intervention.
In addition, since it is possible to specify the input video from the output video, not only re-conversion is possible, but also the portion of the time code desired as the output video can be converted.

Configuration diagram of frame rate converter Processing diagram of frame rate conversion device receiving user input Configuration diagram of frame rate conversion device for storing time code of input video Frame rate conversion configuration diagram for storing frame rate change points The figure when the starting point of Embodiment 1 in this invention corresponds. The figure when attaching the continuous time code of Embodiment 3 in this invention The figure when providing the sync point of Embodiment 4 in this invention The figure when the starting point of Embodiment 5 in this invention corresponds. The figure when attaching the continuous time code of Embodiment 6 in this invention The figure when providing the sync point of Embodiment 7 in this invention The figure when using the frame change point of Embodiment 9 in this invention

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

(Embodiment 1)
FIG. 1 shows a time code detection unit 103 that acquires a time code in an input video, and calculates the time code of the output video by calculating the acquired time code based on the frame rate of the input video, the frame rate of the output video, and the like. This is a variable speed frame rate conversion device including a time code calculation unit 104, a frame rate conversion unit 101 that performs frame rate conversion of an input video, and a time code synthesis unit 102 that changes a time code of an output video. The time code calculation unit 104 determines the start point of the video, and performs a process of sequentially incrementing the time code so as to be linked with the output video.

  Regarding the frame rate conversion apparatus configured as described above, a time code conversion method will be described below.

A process of converting an image shot at 30 frames / second into 24 frames / second will be described. In the input video, two places from 00:04:00 to 00: 07: 59: 29 and 00:16:00 to 00: 21: 59: 29 are converted. The former is called section (1) and the latter is called section (2). For simplicity, the time code is calculated in a non-drop frame.

  FIG. 5 shows an example in which the start points of the input video and the output video match. 24 frames / second is 1.25 times longer than 30 frames / second. For this reason, the length of the output video in the section (1) is 00: 05: 00: 00, which is 1.25 times 00:04:00, and the length of the output video in the section (2) is 00:00. It becomes 00: 07: 33: 00 at 1.25 times of 06:00:00. Accordingly, the respective time codes are changed from 00:04:00 to 00: 08: 59: 23, and from 00:16:00 to 00: 23: 29: 23.

  This method has the advantage that the time code of the input video can be easily inferred from the time code of the output video, while the time code of the output video is greatly influenced by the conversion section.

(Embodiment 2)
In the first embodiment, when the starting point of (1) is 00: 03: 59: 29 one frame earlier, there is no time code of 00: 03: 59: 29 in 24 frames / second, so this time code Cannot be used as the time code of the output video. The start time code outside the valid range is rounded to 00 to correct the time code to be within the valid range. An input video of 00: 03: 59: 29 is given a time code of 00: 03: 55: 00 and converted to a time code that can exist at 24 frames / second. In the case of starting from 00: 03: 59: 24 to 00: 03: 59: 28, the time code is similarly converted from 00: 03: 55: 00.

  In the 2: 3 pull-down processing for converting film video to NTSC, a timing called A frame is generally used to indicate 2: 3: 2: 3 timing. In the A frame, the last two digits of the time code are 00. And 2: 3: 2: 3 are coincident with each other.

  When 00 rounding is performed as in the present embodiment, it is guaranteed that the 00 position is always an A frame, and connection with an existing 2: 3 pull-down system can be ensured.

(Embodiment 3)
This example is an example of a time code conversion method in the variable frame rate conversion apparatus of FIG. 1 described in the first embodiment.

  FIG. 6 shows an example in which the time code is calculated so that the time code of the output video is continuous. In this example, the start time code is set to 00:00:00. As described above, the output section of the (1) section is 00:05:00, and the output section of the (2) section is 00:07:30. If this is packed in order from the front, (1) section becomes 00:00:00 to 00: 04: 59: 23, and (2) section becomes 00:05:00 to 00: 12: 29: 23. .

  This method has the advantage that the uniqueness of the output time code is maintained, although the relevance of the time code between input and output is lost.

(Embodiment 4)
This example is an example of a time code conversion method in the variable frame rate conversion apparatus of FIG. 1 described in the first embodiment.

  FIG. 7 is a diagram of a time code conversion method provided with a sync point.

  A sync point is a certain point where the time codes of the input video and the output video always coincide. That is, in the conversion method in which sync points are provided, the number of frames from the sync points is held before and after conversion.

  In this embodiment, the sync point is set to 00:00:00. The number of frames from the sync point at 00:04:00 at 30 frames / second is 7200 (= 4 × 30 × 60) frames. If this frame is set to 24 frames / second, it becomes 00:05:00 (7200 ÷ 24 ÷ 60 minutes). Since the length of the output video of the section (1) is 00:05:00 as determined in the previous embodiment, the section (1) is changed from 00:05:00 to 00: 09: 59: 23. Converted. (2) If the same calculation is performed for the section, it is converted from 00:20:00 to 00: 27: 29: 23.

  (1) When the input time code is obtained from the output time code of the section, the number of frames from the sync point at 00:05:00 at 24 frames / second is 7200 (= 5 × 24 × 60) frames, Of course, this is consistent with the previous example. If this frame is set to 30 frames / second, it becomes 00:04:00 (7200 ÷ 30 ÷ 60 minutes), and the input time code of (1) section is obtained.

  In this embodiment, the time code of 24 frames / second and the time code of 30 frames / second have a one-to-one relationship. However, not only a specific frame rate but also when the input video has a constant frame rate, The feature of this method is that the input time code and the output time code have a one-to-one relationship.

  In summary, in this method, the input time code can be obtained from the output time code, and the uniqueness of the output time code is ensured when the input video has a constant frame rate.

(Embodiment 5)
In this example, a time code conversion method in the case of converting a variable frame rate video to 24 frames / second in the variable frame rate conversion apparatus of FIG. 1 described in the first embodiment will be described.

  It is assumed that shooting was performed at 30 frames / second from 00:00:00 to 00: 15: 59: 29, and shooting at 12 frames / second thereafter. The position and name of the conversion section are the same as in the previous embodiment.

  FIG. 8 shows an example in which the start points of the input video and the output video match. 24 frames / second is 1.25 times longer than 30 frames / second, whereas the playback time is halved compared to 12 frames / second. For this reason, the length of the output video in the section (1) is 1: 00: 00: 00: 00, which is 25: 00:05:00: 0, and the length of the output video in the section (2) is 0: It becomes 00:03:00, half of 06:00:00. Accordingly, the respective time codes are changed from 00:04:00 to 00: 08: 59: 23 and from 00:16:00 to 00: 18: 59: 23.

  This method has the advantage that the time code of the input video can be easily inferred from the time code of the output video, while the time code of the output video is greatly influenced by the conversion section.

(Embodiment 6)
This example is an example of a time code conversion method in the variable frame rate conversion apparatus of FIG. 1 described in the first embodiment. The input video and the conversion position conform to the fifth embodiment.

  FIG. 9 shows an example in which the time code is calculated so that the time code of the output video is continuous. In this example, the start time code is set to 00:00:00. As described above, the output section of (1) section is 00: 05: 00: 00: 00, and the output section of (2) section is 00: 03: 00: 00: 00. When this is packed in order from the front, (1) section becomes 00:00:00 to 00: 04: 59: 23, and (2) section becomes 00:05:00 to 00: 07: 59: 23. .

  This method has the advantage that the uniqueness of the output time code is maintained, although the relevance of the time code between input and output is lost.

(Embodiment 7)
This example is an example of a time code conversion method in the variable frame rate conversion apparatus of FIG. 1 described in the first embodiment. The input video and the conversion position conform to the fifth embodiment.

  FIG. 10 shows an example in which the sync points match. The sync point is assumed to be 00: 00: 00: 00. (2) Since the frame rate at the point of 00: 16: 00: 00: 00 which is the head of the section is 12 frames / second, if this is adopted in the conversion formula, the number of frames from the sync point is 11520 (= 12 × 16 × 60) Frame. When this frame is set to 24 frames / second, 00: 08: 00: 00 (11520 ÷ 24 ÷ 60) is obtained. Since the length of the output video of the section (2) is 00:03:00 as determined in the previous embodiment, the section (2) is from 00:08:00 to 00: 10: 59: 23. It becomes. (2) When the head of the section is inversely converted, the number of frames from the sync point at 24:00:00 at 00:08:00 is 11520 (= 8 × 24 × 60) frames. Match. If this frame is set to 12 frames / second, it becomes 00:16:00: 00 (11520 ÷ 12 ÷ 60 minutes), and the input time code can be obtained from the output time code.

  In the case of the variable frame rate, since there is a one-to-many mapping, the time code from 00:08:00 to 00: 09: 59: 23 is duplicated in the (1) section and (2) section. As can be seen from the above, the uniqueness of the output time code is not guaranteed. On the other hand, if the input frame rate is known, the input time code can be obtained from the output time code.

(Embodiment 8)
FIG. 3 is a system diagram of a variable frame rate conversion apparatus having a function of writing a time code of an input video into user bits of an output video.

  In the method of matching the start point and the method of providing the sync point, it is possible to calculate the time code of the input video from the output video using the start point and the frame rate of the input video. However, in this reverse lookup process, the input frame rate must be recorded in the output video, and the conversion start point must always be managed. If the information of the input video is included in the output video, recording the time code of the input video in the output video requires no calculation and the process is simple. In this embodiment, a method of writing the time code of the input video into the user bits of the output video is taken. In FIG. 3, a user's bit synthesizing unit 303 for rewriting the user's bit of the output video by the user's bit synthesizing unit 303 is added to the time code of the input video detected by the time code detecting unit 304 of FIG. The time code of the input video is obtained from the user bits of the output video. When it is necessary to reconvert, such as when the video is disturbed during the conversion process or recording on the tape, the time code of the input video can be obtained from the user bits of the output video and reconverted.

(Embodiment 9)
FIG. 4 is a system configuration diagram of a variable frame rate conversion apparatus that realizes reversible time code conversion.

  Embodiment 8 shows that the same section as the original video can be reconverted. However, in the case of the variable frame rate, there is a drawback that the time codes of the output video overlap, that is, the uniqueness of the output time code cannot be maintained. This is because the number of frames from the sync point is converted at the frame rate at the conversion point.

  Further, the method of the eighth embodiment is not sufficient for a request to extend the use period of the output video. Even if re-conversion is attempted 10 frames before, the time code cannot be calculated unless the input frame rate for 10 frames is known. It is necessary to count the effective frames for 10 frames while rewinding the input video and to perform conversion from there.

  In order to solve these problems, it is necessary to accurately calculate the number of frames from the sync point by accumulating so far. FIG. 4 is a system diagram of a variable frame rate conversion system that performs this processing. FIG. 11 shows an example in which this technique is applied to the example of FIG. 10 of the seventh embodiment.

  The frame rate change point detection unit 406 first sends the frame rate change point data {30 frames / second, 00: 00: 00: 00} to the frame rate change point data storage unit 407. Next, it is detected that the frame has been switched from 30 frames / second to 12 frames / second at the point of 00: 12: 00: 00: 00, and frame rate change point data {12 frames / second, 00: 12: 00: 0} is framed. The data is sent to the rate change point data storage unit 407. As described above, each time the frame rate is changed, a frame rate / time code pair is stored as frame rate change point data. The time code calculation unit 404 performs time code conversion based on the frame rate change point data.

  (2) The number of frames from the sync point at 00: 16: 00: 0 at the beginning of the section is 30 frames / second based on the frame rate change point data {12 frames / second, 00: 12: 00: 00: 00}. The number of frames 21600 (= 12 × 30 × 60) and the number of frames 2880 at 12 frames / second (= (16−12) × 12 × 60) are combined to obtain 24480 frames. When this frame is set to 24 frames / second, it becomes 00:17:00: 00 (24480 ÷ 24 ÷ 60 minutes). (2) Since the length of the output video in the section is 00:03:00, the section (2) is from 00:17:00 to 00: 19: 59: 23.

The input section calculation unit 409 specifies the input time code from the output time code using the frame rate change point data. The process of obtaining the input time code from the output time code 00:17:00: 00 is shown. First, the frame rate range of 00:17:00: 00 is checked. 00: 17: 00: 00 is converted into a frame and considered as 24480. Since the 30 frame / second interval is from 0 to 21600, it does not enter here. Since the end of the next 12 frames / second is not specified, the time code after 21600 is found to be included here. The number of frames within 12 frames / second at 00:17:00: 00 is 24480-21600 = 2880 frames. This length corresponds to 00:04:00 (2880 ÷ 12 ÷ 60 minutes). The frame rate change point data {12 frames / second, 00: 12: 00: 00: 00} is added to 00: 12: 00: 00: 00 to obtain 00: 16: 00: 00: 00. This is the time code start point of the input video in (2) section. When the end point is also obtained in the same manner, it is found that the section is from 00: 16: 00: 00: 00 to 00: 21: 59: 29.

  This method maintains the uniqueness of the output time code even at a variable frame rate, and can uniquely identify the input time code from the output time code.

  In all the embodiments, it is apparent that the present invention is effective even when converting at an arbitrary frame rate both during shooting and during playback.

  This is useful for a frame rate conversion system in which a time code is re-attached as the frame rate is converted so that the length of the video material changes before and after conversion.

101 Frame rate conversion unit 102 Time code conversion unit 103 Time code detection unit 104 Time code calculation unit

Claims (4)

A frame rate conversion unit that converts video material shot at an arbitrary frame rate into a predetermined frame rate so that the length of the video material changes before and after conversion, and
A time code detector for detecting the time code of the input video;
A time code calculation unit that calculates the time code of the output video by changing the time code at a rate that is the same as the rate at which the length of the video material changes before and after the conversion, including digits of seconds or more,
A frame rate conversion apparatus comprising: a time code synthesizing unit that synthesizes the time code calculated by the time code calculation unit with the video signal converted by the frame rate conversion unit. 2. The frame rate conversion apparatus according to claim 1, wherein the time code of the start frame of the input video is matched with the time code of the start frame of the output video. 2. The frame rate conversion apparatus according to claim 1, wherein the time code of the start frame of the output video is output following the time code of the video frame output immediately before. 4. The system according to claim 1, further comprising: a user's bit synthesizing unit that stores a time code of the input video detected by the time code detecting unit in a user's bit of the video output by the time code synthesizing unit. The frame rate conversion apparatus described in 1.

Images