JPH08289331A - Method for converting two-dimensional video into three-dimensional video - Google Patents

Abstract

PURPOSE: To obtain a delayed sub-video image, to decrease the number of field (Fi) memories, and to obtain a three-dimensional image by writing only one Fi included in an Fi group into an Fi memory in every Fi of a two-dimensional image that includes the continuous same frames. CONSTITUTION: A CPU 20 controls an Fi memory 11 via a memory control circuit 24 based on the detection result of a motion vector detection circuit 16 which detects the two-dimensional video signals (a) received from a telecine. Thus only the final Fi is saved into the memory 11 out of an Fi group where the same frames are continuous, and a video switch 13 and the phase control circuits 14 and 15 change the number of delayed Fi to set the delay value of LR frames at a constant level. After this change is carried out, 2 to 3 Fis are allocated per frame together with the number of delayed Fi fixed so as to secure the delay of a prescribed number of frames in a normal mode. Thus it is possible to convert the signals (a) obtained by applying the telecine conversion to a movie film into TV signals into the three-dimensional images L and R with use of a small number of Fi memories.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for converting a two-dimensional image output from a VTR, a video camera or the like, or transmitted by CATV broadcasting, TV broadcasting or the like into a three-dimensional image.

[0002]

2. Description of the Related Art Most of the 3D image software used in the 3D image display system, which has been talked about recently, is 3D.
It was created specifically for the 3D video display system. Such three-dimensional video software is generally recorded by picking up a left-eye video and a right-eye video using two cameras. The left and right images recorded in the three-dimensional image software are superimposed and displayed on the display device almost at the same time. Then, the left-eye image and the right-eye image that are displayed in an overlapping manner are separately incident on the left and right eyes of the observer, so that the observer recognizes the three-dimensional image.

By the way, a lot of two-dimensional video software currently exists. Therefore, if a 3D image can be generated from these 2D image software, it is possible to save the trouble of recreating the 3D image software having the same contents as the existing 2D image software from the beginning.

Under these circumstances, a method for converting a two-dimensional image into a three-dimensional image has already been proposed. The following is a conventional method for converting a 2D image into a 3D image. That is, in the case of a two-dimensional image showing an object moving from left to right, the original two-dimensional image is the left-eye image, and the image several frames before the left-eye image is the right-eye image. Is the way. In this case, a parallax occurs between the left-eye image and the right-eye image, so that by displaying both images on the screen almost at the same time, the moving object is projected forward with respect to the background.

An image several frames before the image for the left eye can be obtained by storing the original two-dimensional image in the field memory and reading the image delayed by a predetermined number of fields. The conventional method as described above will be referred to as a field delay method.

[0006]

In the above conventional method, when the delay amount of one of the left-eye image and the right-eye image is constant, the parallax becomes larger as the moving object moves faster. The three-dimensional effect changes, making it difficult to see 3D images.

Therefore, in order to obtain a stable stereoscopic effect, the applicant of the present invention has devised to decrease the delay amount of one of the left-eye image and the right-eye image as the moving object moves faster. In this way, a relatively new field is presented as a delayed image for a fast moving image, and a relatively old field is presented as a delayed image for a slow moving image.

As described above, when changing the delay amount of one of the left-eye image and the right-eye image, the field memory corresponding to the maximum delay amount of the other of the left-eye image and the right-eye image. Is required.

Therefore, the applicant writes the input video in the field memory for each field when the movement of the input video is fast, and when the movement of the input video is slow, the input video is spaced one field at a time. We have already developed a method to convert 2D video to 3D video that can reduce the number of fields by writing in the field memory, and filed a patent application on November 22, 1994 (1994 patent). Wish No. 287657).

According to the present invention, the same frame appears continuously such as a two-dimensional image created by telecine converting a movie film into a television signal, and an image output from a TV game machine (for example, 3DO). 3D image
An object of the present invention is to provide a method for converting a two-dimensional image into a three-dimensional image, which requires a small number of field memories when converting the three-dimensional image signal.

[0011]

According to the method of converting a 2D image into a 3D image according to the present invention, a 2D image in which the same frame appears continuously is converted into a main image and a main image using a field memory. In the method of converting a 2D image into a 3D image by generating a delayed sub-image, a plurality of fields within each field group are generated for each field group in which the same frame appears consecutively. The feature is that only the video of one field is written in the field memory.

The selection of the sub-picture is performed as follows, for example. That is, the delay amount of the sub-image frame with respect to the main image frame is calculated based on the moving speed of the main image, and the sub-image is selected based on the calculated delay amount. In this case, the delay amount of the sub-video frame relative to the main video frame is determined such that the slower the main video frame is, the larger the delay amount of the sub-video frame with respect to the main video frame becomes.

It is preferable to select one image written in the field memory from each field group so that the field attributes of the images written in the field memory all have the same field attribute.

[0014]

For each field group in which the same frame appears consecutively, only the video of one field among the plurality of fields in each field group is written in the field memory. Therefore, the number of field memories can be reduced.

[0015]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows the configuration of a 2D / 3D conversion device for converting a 2D image into a 3D image. In this embodiment, the 2D / 3D conversion device inputs a two-dimensional image in which the same frame appears continuously, such as a two-dimensional image created by telecine converting a movie film into a television signal. And

This 2D / 3D converter generates parallax by generating a left-eye image and a right-eye image by the field delay method, and shifts the phase of the generated left-eye image and right-eye image or both. The positional relationship between the subject and the reference screen surface is changed by applying.

A two-dimensional video signal a, which is a two-dimensional video created by telecine conversion, is input to the input terminal 1. The two-dimensional video signal a is sent to the motion vector detection circuit 16, the plurality of field memories 11 and the video switching circuit 13, respectively.

As is well known, the motion vector detection circuit 16 generates data for detecting a motion vector based on the representative point matching method.
The data generated by the motion vector detection circuit 16 is sent to the CPU 20.

The representative point matching method will be briefly described. A plurality of motion vector detection areas are set in the video area of each field, and each motion vector detection area is divided into a plurality of small areas. A plurality of sampling points and one representative point are set for each small area.

The difference (correlation value at each sampling point) between the video signal level at the sampling point in each small area in the current field and the video signal level at the representative point in the corresponding small area in the previous field is detected as each motion vector. Required for each area. Then, the correlation values of the sampling points having the same deviation with respect to the representative point are cumulatively added between the small areas in the respective motion vector detection areas. Then, in each motion vector detection area, the deviation of the point with the smallest correlation cumulative value, that is, the deviation of the point with the highest correlation is extracted as the motion vector (motion of the subject) in the motion vector detection area. It

The field memory 11 is provided to delay and output the two-dimensional video signal a in units of fields, and a plurality of field memories are provided. Writing and reading of each field memory 11 are controlled by the memory control circuit 24.

The output b (delayed two-dimensional video signal) of the field memory 11 is sent to the video switching circuit 13 and the interpolation circuit 12, respectively. The interpolation circuit 12 generates an interpolation signal in the vertical direction with respect to the input signal b. The output c of the interpolation circuit 12 (vertical interpolation signal of the delayed two-dimensional video signal) is sent to the video switching circuit 13.

Therefore, the video switching circuit 13 receives the input two-dimensional video signal a and delayed two-dimensional video signal b.
And the vertically-interpolated signal c of the delayed two-dimensional video signal b is input. The video switching circuit 13 supplies one of the signals b and c (sub video signal) to the left image phase control circuit 14 and the right image phase control circuit 15.
The signal a (main video signal) is switched and output according to the moving direction of the subject. However, if the delay amount is 0,
Left image phase control circuit 14 and right image phase control circuit 15
The signal a is sent to both the and.

One of the signals b and c is selected based on whether the two-dimensional video signal a is an odd field or an even field. That is, the one corresponding to the field type (odd field or even field) of the two-dimensional video signal a is selected from the signals b and c. Switching of images by the image switching circuit 13 is performed by CP
Controlled by U20.

The phase control circuits 14 and 15 are provided to move the display position of the input image in the horizontal direction by shifting the phase of the input image signal. The phase shift amount and the shift direction are controlled by the memory control circuit 24. Left image phase control circuit 14
Is sent to the left image output terminal 2. The output of the right image phase control circuit 15 is sent to the right image output terminal 3.

The CPU 20 controls the memory control circuit 24 and the video switching circuit 13. The CPU 20 includes a ROM 21 that stores the program and the like and a RAM 22 that stores necessary data. Data necessary for motion vector detection is sent from the motion vector detection circuit 16 to the CPU 20. Further, the CPU 20 is connected with an operation / display unit 23 including various input means and a display.

The CPU 20 determines, based on the motion vector,
The delay amount (the number of delay fields) by the field memory 11 is calculated. That is, in principle, the delay amount is determined so that the delay amount is small when the motion vector is large, and the delay amount is large when the motion vector is small.

The CPU 20 also controls the video switching circuit 13 based on the direction of the motion vector. That is, if the direction of the motion vector is from left to right, the input 2
The two-dimensional video signal a is supplied to the left-eye phase control circuit 14, and the delayed two-dimensional video signal b or c is supplied to the right-eye phase control circuit 15.
Send to When the direction of the motion vector is from right to left, the input two-dimensional video signal a is supplied to the right-eye phase control circuit 14
Then, the delayed two-dimensional video signal b or c is sent to the left-eye phase control circuit 15.

In this 2D / 3D conversion device, parallax is generated by generating a left-eye image and a right-eye image by the field delay method, and the generated left-eye image and right-eye image are phase-shifted to one or both. The positional relationship between the subject and the reference screen surface is changed by applying.

FIG. 2 shows a 2D / 3D conversion processing procedure by the CPU.

The 2D / 3D conversion processing by the CPU is performed every time the field switching timing of the input video signal a comes.

(1) In step 1, the value 1 input this time is input.
Data indicating whether to write a two-dimensional video signal for a field or not, data indicating a field memory (write memory) to be written when writing, 2
Data indicating the field memory (readout memory) from which the dimensional video signal should be read is output to the memory control circuit 24. These data are generated in the field memory control data generation process of step 11 of the previous 2D / 3D conversion process.

In step 1, each phase control circuit 1
Data indicating the phase shift amount and the direction due to 4 and 15 are output to the memory control circuit 24. Further, a video switching control signal is output to the video switching circuit 13. The phase shift amount and direction by each phase control circuit 14 and 15 are determined based on the data already captured and stored in step 2 of the previous 2D / 3D conversion process.

One of the delayed two-dimensional video signals b and c is selected by selecting the field type of the two-dimensional video signal b to be read from the field memory 11.
It is determined based on the field type of the 2D video signal a. Furthermore, the switching between the selected signal b or c and the signal a is determined based on the direction of the horizontal motion vector obtained in the previous 2D / 3D conversion process.
The switching direction between the selected signal b or c and the signal a is represented by the polarity of the delay amount.

(2) In step 2, the operation / display unit 23
Various input signals from are captured and stored. For various input signals, a signal for setting the phase shift amount and direction, an automatic / manual mode setting signal indicating whether the delay amount is automatically calculated (automatic mode) or manually (manual mode),
There are a delay amount magnification setting signal performed when the automatic mode is set, a delay amount setting signal performed when the manual mode is set, and the like.

(3) In step 3, the previous 2D / 3D
Only the reliable motion vector is extracted based on the reliability result of the motion vector for each motion vector detection area obtained in step 10 of the conversion process.

(4) In step 4, of the reliable motion vectors extracted in step 3, only those with vertical components smaller than a predetermined value are extracted.

(5) In step 5, the average value of the horizontal component (effective horizontal motion vector) of the reliable motion vector extracted in step 4 is calculated.

(6) In step 6, a delay amount calculation process is performed based on the average value of the effective horizontal motion vectors calculated in step 5. Details of this delay amount calculation processing will be described later.

(7) In step 7, the automatic mode or the manual mode is determined based on the data captured and stored in step 2.

(8) If it is determined in step 7 that the manual mode is set, the delay amount is fixed to the set value fetched in step 2 (step 8).

(9) If it is determined in step 7 that the automatic mode is set, the history data used in the delay amount calculation processing in step 6 is updated (step 9).

(10) In step 10, the data required for motion vector detection is fetched from the motion vector detection circuit 16 and the motion vector for each motion vector detection area is calculated. Further, the reliability of the motion vector is determined for each motion vector detection area based on the average value and the minimum value of the correlation cumulative values for each motion vector detection area. Then, the calculated motion vector and the reliability determination result are stored in the RAM 22.

(11) In step 11, field memory control data generation processing is performed. That is, when the delay amount setting mode is the automatic mode, based on the delay amount (delay field number) calculated in step 6, data indicating whether or not to write the 2D video signal for the next field, The data indicating the write memory and the data indicating the read memory are generated at.
Details of the field memory control data generation process will be described later.

FIG. 3 shows the detailed procedure of the delay amount calculation processing in step 6 of FIG.

First, based on the delay amount multiplication set value set and stored in step 2 and the average value v of the effective horizontal direction motion vector obtained in step 5 (hereinafter, referred to as motion vector average value). , The first delay amount d1
Is required (step 21).

FIG. 4 shows the relationship between the motion vector average value and the delay amount. The relationship as shown in FIG. 4 is stored in the ROM 21 as a delay amount table. Then, first, the delay amount corresponding to the motion vector average value is obtained from the delay amount table.

Even with the same three-dimensional video signal, the parallax differs depending on the conditions of the stereoscopic display device (monitor), that is, the type of monitor and the conditions for viewing the monitor. Therefore, regardless of the monitor conditions, in order to obtain the same stereoscopic effect or to meet the preference of the observer, the delay amount multiplying set value set and stored in the above step 2 is used as the delay amount table. The first delay amount d1 is obtained by integrating the delay amount obtained from the above.

In order to obtain a similar stereoscopic effect regardless of the monitor conditions, a plurality of types of delay amount tables are stored, and the operation / display section 23 is used to meet the monitor conditions or the observer's preference. You may make it input the command for selecting a delay amount table.

The first delay amount may be calculated based on a predetermined relational expression instead of the delay amount table. How to obtain the relational expression in this case will be described with reference to FIG.

A suitable distance between the monitor surface S and the eyes 31 and 32 of the observer is defined as an appropriate viewing distance A [mm]. Further, the distance between the right image R and the left image L of the gaze object on the monitor surface S is defined as parallax B [mm]. Further, the inter-eye distance is C [mm]. The suitable viewing distance A is determined by the condition of the monitor.
The parallax B of the gazing object differs depending on the monitor conditions even if the three-dimensional video signals are the same.

The stereoscopic image position P of the gazing object is determined by the appropriate viewing distance A, the parallax B, and the inter-eye distance C. That is, the protruding amount D [mm] of the gaze object from the monitor surface S is determined by the appropriate viewing distance A, the parallax B, and the interocular distance C.

The parallax B for making the protruding amount of the gazing object from the monitor surface S to be a constant amount D is expressed by the following formula 1 regardless of the monitor condition.

[0055]

[Equation 1] B = D · C / (A−D)

When the horizontal length of the monitor is H [mm], the number of pixels in the horizontal direction of the monitor is h [pixel], the average value of the motion vector is v [pixel / field], and the first delay amount is d1 [field]. The following relationship holds.

[0057]

[Formula 2] d1 · v = (h / H) · B

Here, the pixel conversion amount of the parallax B (= (h /
If H) and B) are adjustment amounts X (data relating to monitor conditions or data according to the observer's preference) set by the operation / display unit 23, the first delay amount d1 is obtained by the following relational expression. To be

[0059]

## EQU00003 ## d1 = X / v

In step 21, when the first delay amount d1 is obtained, based on the delay amount history data, the past 9
The average value of the delay amount of 10 fields from the previous time to the past 9 times, the average value of the delay amount of 10 fields from the previous time to the past 9 times, and the average value of the delay amount of 10 fields from the previous time to the past 9 times Each is calculated (Step 2
2).

The delay amount history data used in step 22 is the first delay amount d1 obtained in step 21 in the past.

Next, if two or more of the three sets of average values have the same value, that value (a large number) is selected as the second delay amount d2, and if all are different, the intermediate value thereof. Is selected as the second delay amount d2 (step 23).

Next, the second delay amount d2 selected in step 23, the second delay amount d2 of one before 12 to 18 fields (for example, 15 fields before), and the second delay amount of 30 fields before. The delay amount d2 is compared (step 24). The delay amount history data used in step 24 is the second delay amount d2 obtained in step 23 in the past.

If all the second delay amounts d2 match (YES in step 25), the target delay amount Pd is changed to the second delay amount selected in step 23 (Pd = d
2) (Step 26) and the process proceeds to Step 30. Therefore, as shown in FIG. 6, when the three second delay amounts d2 (represented by d2-1, d2-2, and d2-3 in the order from the past) change, and all the second delay amounts d2 match. , The target delay amount Pd is changed to the second delay amount (d2-3).

If all the second delay amounts d2 do not match (NO in step 25), all the second delay amounts d2 are larger than the current target delay amount Pd, or all the second delay amounts d2.
It is determined whether or not 2 is smaller than the current target delay amount Pd or the conditions are not met (step 27).

When all the second delay amounts d2 are larger than the current target delay amount Pd, the target delay amount Pd is incremented by 1 (Pd = Pd + 1) (step 28), and then step 30
Proceed to. For example, as shown in FIG. 7, three second delay amounts d2 (d2-1, d2-2, d2 in order from the past one)
-3) changes and all the second delay amounts d2 are larger than the current target delay amount Pd, the target delay amount Pd is incremented by +1.

When all the second delay amounts d2 are smaller than the current target delay amount Pd, the target delay amount Pd is decremented by 1 (Pd = Pd-1) (step 29), and then step 30
Proceed to. All the second delay amounts d2 are the current target delay amounts Pd
When it is not larger and all the second delay amounts d2 are not smaller than the current target delay amount d, the process proceeds to step 30 without changing the target delay amount Pd.

At step 30, it is judged if the target delay amount Pd and the delay amount currently set (the set delay amount d3) match. If the target delay amount Pd and the set delay amount d3 do not match, it is judged whether or not the current set delay amount d3 has already continued for four fields (step 31). When the current set delay amount d3 has already continued for 4 fields, the set delay amount d3 is changed by 1 in the direction toward the target delay amount Pd (d3 = d).
3 ± 1) (step 32). And step 7 of FIG.
Move to

If it is determined in step 30 that the target delay amount and the current set delay amount match, or if the current set delay amount has not continued for 4 fields in step 31, the delay amount is set. Without changing, the process proceeds to step 7 in FIG.

That is, in this example, the set delay amount d3 is 4
It is controlled so as to approach the target delay amount Pd for each field period and for each one field.

After the power is turned on, step 21
In the above, when the first delay amount d1 is calculated for the first time, the second delay amount d2, the target delay amount Pd, and the set delay amount d3 become equal to d1.

In the processing of FIG. 3, in step 22, only the average value of the delay amounts for 10 fields from this time to the past 9 times is calculated, and this is set as the target delay amount, and step 2
The processing of 3, 24, 25, 26, 27, 28, 29 may be omitted.

Further, in step 22, only the average value of the delay amounts of 10 fields in the past 9 times from this time may be calculated and used as the second delay amount, and the process of step 23 may be omitted.

The second delay amount obtained in step 23 is set as the target delay amount, and steps 24, 25, 26 and 2 are performed.
The processes of 7, 28 and 29 may be omitted.

The processing of steps 22 and 23 may be omitted. In this case, the first delay amount d1 obtained in step 21 is used as the second delay amount used in step 24.

Next, the field memory control data generation process of step 11 of FIG. 2 will be described with reference to FIGS.

Before describing the field memory control data generation processing, an outline of telecine conversion will be described.

The difference between the number of images per second (frame number) of a movie film and the number of frames per second of a television is adjusted by the telecine system. The number of frames per second of 35 mm and 16 mm standard motion picture film is 24 frames per second. An 8 mm motion picture film has 16 or 18 frames per second.
On the other hand, the number of frames per second of NTSC is 30 frames (60 fields).

As a telecine system, a general intermittent projection machine, as shown in Table 1, intermittently feeds a film,
The image aperture is illuminated during the period when the film is stopped, and this is received by the film camera and converted into a video signal.

[0080]

[Table 1]

When an image obtained by the telecine system is frame-by-field forwarded, fields without motion appear at regular intervals. Therefore, with respect to the motion vector detected for each field, if the disturbance such as noise is ignored, the vector of motion 0 is detected at regular intervals.

FIG. 8 shows an example of the change of the motion vector with respect to the image obtained from the motion picture film of 24 frames per second. In this example, the motion vector is α1 → 0 → β1 → 0 → 0 → α2 → 0 → β2 → 0 for each field break.
→ 0

Video signal a input to the input terminal 1 of FIG.
The motion vector is a parameter that determines what kind of telecine conversion has been performed. That is, it is possible to grasp the telecine conversion rule and the periodic pattern by knowing the regularity of the motion vector to be zero. Actually, the telecine conversion rule and the periodic pattern are grasped based on the sum of the minimum values of correlation accumulated values (each value of the region forming one field) obtained at the time of motion vector detection by the representative point matching method. .

By the way, when the maximum value of the delay amount (maximum delay number) calculated in step 6 of FIG. 2 is 6, the two-dimensional video signal a of each field to be input is sequentially written in the field memory 11. When you go out,
Six field memories are required.

In the telecine-converted image, as shown in FIG. 10, the same frame appears continuously in several fields. In this embodiment, as shown in FIG. 9, for each field group in which the same frame appears consecutively, only the last field of the plurality of fields of each field group is saved in the field memory, so that the field memory We are trying to reduce the number. Here, the number of field memories is 6
An example in which the number is reduced to 3 will be described.

The field memory control data generation process when a two-dimensional video signal that has been telecine converted by the 2-3 pulldown method is input will be described.

The write / read rules for the field memory in this case are as follows. (A) When the telecine cycle is stable, only the final field is saved in the field memory among a plurality of fields in which the same frame appears continuously. (B) The number of delay fields is converted so that the amount of delay between coma of both eyes is as constant as possible. (C) The number of fields assigned to one frame after conversion is
There are 2 to 3 fields. (D) As for the number of delay fields after conversion (the number of delay fields of the next field), the number of delay fields in the normal state (the set delay amount d3 determined in step 6 of FIG. 2) is 1 to 2 (-
1--2), 1-frame delay, when the number of delay fields in the normal state is 3-4 (-3-4), 2-frame delay,
When the number of delay fields in the normal state is 5 to 6 (-5 to -6), it is allocated so that it is delayed by 3 frames. (E) When the number of delayed frames changes to increase,
Allocate 3 fields to 1 frame. On the contrary, when the number of delayed frames changes in the direction of decreasing, two fields are assigned to one frame.

The video signal which has been telecine converted in the 2-3 pulldown mode is shown in FIG. Here, the symbols A, B, C ... Indicate the types of frames, and the subscripts 1, 2, 3 ...
Indicates the field number.

11 to 16, the input video signal a is shown in FIG.
The delay image actually output is shown when the video signal is 0.

FIG. 11 shows that the number of delay fields in the normal case is one.
The delay image (signal b) actually output in the case of ~ 2 (-1 to -2) is shown. In this case, there is a one-frame delay. In this figure, the image corresponding to the thru in the upper column is
The image of the current field output as a video signal for one eye is shown. A, B, and C in the upper column indicate field memories. The image enclosed in parentheses shows the delayed image that is actually output.

FIG. 12 shows that the number of delay fields in the normal case is three.
The delay images actually output in the case of 4 (-3 to -4) are shown. In this case, there is a delay of two frames.

In FIG. 13, the number of delay fields in the normal case is 5
The delay images actually output in the case of ~ 6 (-5 to -6) are shown. In this case, there is a delay of three frames.

FIG. 14 shows that the number of delay fields in the normal case is 2
The delay image actually output when changing as → 3 → 4 → 5 is shown.

In FIG. 15, the number of delay fields in the normal case is 5
The delay image actually output when changing as → 4 → 3 → 2 is shown.

Next, the field memory control data generation processing when a two-dimensional video signal which has been telecine converted by the 2-2 pulldown method is input will be described.

The write / read rules for the field memory in this case are as follows. (A) When the telecine cycle is stable, only the final field is saved in the field memory among a plurality of fields in which the same frame appears continuously. (B) The number of delay fields is converted so that the amount of delay between coma of both eyes is as constant as possible. (C) The number of fields assigned to one frame after conversion is
There are 1 to 3 fields. (D) As for the number of delay fields after conversion (the number of delay fields of the next field), the number of delay fields in the normal state (the set delay amount d3 determined in step 6 of FIG. 2) is 1 to 2 (-
1--2), 1-frame delay, when the number of delay fields in the normal state is 3-4 (-3-4), 2-frame delay,
When the number of delay fields in the normal state is 5 to 6 (-5 to -6), it is allocated so that it is delayed by 3 frames. (E) When the number of delayed frames changes to increase,
Allocate 3 fields to 1 frame. On the contrary, when the number of delayed frames changes in the direction of decreasing, one field is assigned to one frame.

The video signal which has been telecine converted in the 2-2 pulldown mode is shown in FIG. Here, the symbols A, B, C ... Indicate the types of frames, and the subscripts 1, 2, 3 ...
Indicates the field number.

17 to 20, the input video signal is shown in FIG.
The delay image actually output is shown for the video signal shown in FIG.

In FIG. 17, the number of delay fields in the normal state is 1
The delay images actually output in the case of ~ 2 (-1 to -2) are shown. In this case, there is a one-frame delay.

FIG. 18 shows that the number of delay fields in the normal case is three.
The delay images actually output in the case of 4 (-3 to -4) are shown. In this case, there is a delay of two frames.

In FIG. 19, the number of delay fields in the normal case is 5
The delay images actually output in the case of ~ 6 (-5 to -6) are shown. In this case, there is a delay of three frames.

In FIG. 20, the number of delay fields in the normal case is 2
The delay image actually output when changing as → 3 → 4 → 5 → 6 is shown.

Table 2 shows an allocation table of periodic patterns according to peak histories of motion vectors of images that have been telecine-converted by the 2-3 pulldown method. In the image that has been telecine-converted by the 2-3 pulldown method, fields without motion (motion vector 0) appear at regular intervals, and the periodic pattern thereof is any one of 0 to 4 in Table 2. Such an allocation table is stored in the ROM 21 as a periodic pattern allocation table.

[0104]

[Table 2]

In Table 2, the number of delay fields in the listing is 0.
Indicates the current field, and the delay field numbers 1 to 6 are
The fields that are 1 to 6 behind the current field are shown.

Table 3 shows an allocation table of periodic patterns according to peak histories of motion vectors of images that have been telecine converted by the 2-2 pulldown method. In the image that has been telecine-converted by the 2-2 pulldown method, fields without motion appear at regular intervals, and the periodic pattern thereof is either 0 or 1 in Table 3. Such an allocation table is stored in the ROM 21 as a periodic pattern allocation table.

[0107]

[Table 3]

The field memory control data generation process will be described below with reference to FIG. Here, 2
It shows a case where either a video signal that has been telecine converted by the -3 pulldown method or a video signal that has been telecine converted by the 2-2 pulldown method is input.

First, based on the motion vector detected this time and the past motion vector history, the input video signal becomes 2
It is determined whether the signal is converted by the -3 pulldown method or the signal converted by the 2-2 pulldown method, the periodic pattern in the current field is determined, and the determination result is stored in the RAM 22 (step 1). .

Next, it is judged whether or not the write flag F is set (F = 1) (step 2). The write flag F stores whether or not the input video signal of the current field is written in the field memory. When the write flag F is set, it indicates that the input video signal of the current field is written in the field memory.

When the write flag F is set, since the input video signal of the current field has been written in the field memory, the number of the field memory in which the data should be written next is updated (step 3). . The order of writing data to the three field memories A, B, and C is predetermined, for example, A → B → C → A.

The expected delay frame number n is incremented by 1. The expected number of delayed frames n is the number of delayed frames, which is the number of delayed frames of the input video presented for the other eye, relative to the frame of the input video presented for the other eye. This is the number of delayed frames in the next field, assuming that the delayed frame displayed in the current field is displayed in the next field. When the write flag F is set in step 2 above, the frame of the image input in the next field is one frame newer than the frame of the image input in the current field, and therefore the expected delay frame number n Will be updated.

After this, the write flag F is updated (step 4). That is, if the next field is the last field of the plurality of fields in which the same frame appears consecutively, the write flag F is set, and if not, the write flag F is reset.

When the input signal is a signal subjected to telecine conversion by the 2-3 pull-down method, when the periodic pattern is 0 and when the periodic pattern is 2, a plurality of consecutive same frames appear in the input field. It is the last field of the fields. Since the update of the write flag in step 4 is for designating whether or not the input video signal is written in the field memory in the next field, the periodic pattern in the current field determined in step 1 is 4 Alternatively, when it is 1, the write flag F is set.

In the case where the input signal is a signal subjected to telecine conversion by the 2-2 pulldown method, when the periodic pattern is 0, the input field is the last field of a plurality of fields in which the same frame appears continuously. Become. Therefore, when the periodic pattern in the current field determined in step 1 is 1, the write flag F is set.

In the step 2, the write flag F
When F is not set (F = 0), the number of the write memory and the number of delayed frames n do not change, so the process proceeds to step 4 without updating these (process of step 3) and the update process of the write flag F is performed. Is done.

When the process of step 4 is performed, the number of delayed frames (hereinafter referred to as the desired delayed frame number m) is determined in accordance with the writing / reading rules for the field memory (step 5). That is, the delay field number (d
When 3) is 1 or 2, the desired delay frame number m is 1. When the delay field number (d3) in the normal state is 1 or 2, the desired delay frame number m is determined to be 1. When the normal delay field number (d3) is 3 or 4, the desired delay frame number m is determined to be 2. When the normal delay field number (d3) is 5 or 6, the desired delay frame number m is determined to be 3.

Next, the desired delay frame number m and the expected delay frame number n are compared, and m = n, m <n, or m <n 3
It is divided into two cases (step 6).

(1) When the desired delay frame number m is equal to the expected delay frame number n (m = n) First, the outline of the processing contents when m = n will be described.

(I) The delayed frame displayed in the current field is also displayed in the next field as a delayed frame.

(Ii) However, if the number of continuous display of delayed frames (the number of continuous display of the same frame) K displayed in the current field has reached a predetermined maximum number of continuous display Kmax, the current field is displayed. The frame that is one newer than the delayed frame displayed in 1 is displayed as a delayed frame in the next field.

(Iii) Even in the case of (ii), if there is not one frame newer than the delayed frame displayed in the current field in the next field, the delayed frame displayed in the current field is It is displayed as a delayed frame in the next field.

When the desired delayed frame number m and the expected delayed frame number n are equal, first, the number of continuous display of the delayed frame displayed in the current field (the number of continuous display of the same frame)
It is determined whether K is equal to or greater than a predetermined maximum continuous display count Kmax (step 7). Whether the input signal is a signal that has been telecine-converted by the 2-3 pull-down method or the input signal is a signal that has been telecine-converted by the 2-3 pull-down method, according to the rules for writing / reading to / from the field memory, The maximum continuous display count Kmax is 3.

When the continuous display number K of the same frame is smaller than the maximum continuous display number Kmax, the desired delayed frame number m is set in the next field in order to display the same delayed frame in the current field as the delayed frame. The expected delay frame number n is set (m ← n), and the number K of consecutive displays of the same frame is incremented by 1 (step 9).

When the continuous display number K of the same frame is equal to or larger than the maximum continuous display number Kmax, whether or not the expected delayed frame number n is 0, that is, the image displayed as the delayed frame in the current field is in the next field. Is also determined to be a through image (input image signal a) (step 8).

When the expected number of delayed frames n is not 0, the image displayed as a delayed frame in the current field is
Since it is not a through image in the next field, a frame newer than the delayed frame displayed in the current field exists in the next field. Therefore, in the next field, in order to display one new frame as a delayed frame than the delayed frame displayed in the current field, the desired delayed frame number m is set to a value smaller by 1 than the expected delayed frame number n. Together with (m ← n-1), the number K of consecutive displays of the same frame is set to 1 (step 10).

When the expected number of delayed frames n is 0, the image displayed as a delayed frame in the current field is
Since it is a through image also in the next field, there is no new frame in the next field. Therefore, in order to display the same delayed frame in the current field as the delayed frame in the next field, the desired delayed frame number m is set to the expected delayed frame number n (m ←
n), the number K of consecutive displays of the same frame is incremented by 1 (step 9).

(2) When the desired delay frame number m is smaller than the expected delay frame number n (m <n) First, the outline of the processing contents when m <n is described.

(I) One frame newer than the delayed frame displayed in the current field is displayed as a delayed frame in the next field.

(Ii) However, if the number of continuous display of delayed frames (the number of continuous display of the same frame) K displayed in the current field has not reached the predetermined minimum continuous display number Kmin, the current field is displayed. The delayed frame displayed at is displayed as a delayed frame in the next field.

(Iii) Even in the case of (ii), when the delayed frame displayed in the current field does not exist in any of the field memories in the next field, it is stored in the field memory in the next field. The oldest existing frame is displayed as a delayed frame in the next field.

(Iv) Even if the continuous display count K of delayed frames displayed in the current field has reached a predetermined minimum continuous display count Kmin, one frame is newer than the delayed frame displayed in the current field. If it does not exist in the next field, the delayed frame displayed in the current field is displayed as a delayed frame in the next field.

When the desired delay frame number m is smaller than the expected delay frame number n, first, the number of continuous display of the delayed frame displayed in the current field (the number of continuous display of the same frame)
It is judged whether or not K is smaller than a predetermined minimum continuous display count Kmin (step 11).

When the input signal is a signal that has been telecine-converted by the 2-3 pull-down method, the minimum continuous display count Kmin is 2, and when the input signal is a signal that has been telecine-converted by the 2-2 pull-down method. Is the minimum number of continuous display Kmin.

When the continuous display number K of the same frame is equal to or larger than the minimum continuous display number Kmin, whether or not the expected delayed frame number n is 0, that is, the image displayed as the delayed frame in the current field is displayed in the next field. Is also determined to be a through image (input image signal a) (step 8).

When the expected number of delayed frames n is not 0, the image displayed as a delayed frame in the current field is
Since it is not a through image in the next field, a frame newer than the delayed frame displayed in the current field exists in the next field. Therefore, in the next field, in order to display one new frame as a delayed frame than the delayed frame displayed in the current field, the desired delayed frame number m is set to a value smaller by 1 than the expected delayed frame number n. Together with (m ← n-1), the number K of consecutive displays of the same frame is set to 1 (step 10).

When the expected number of delayed frames n is 0, the image displayed as a delayed frame in the current field is
Since it is a through image also in the next field, there is no new frame in the next field. Therefore, in order to display the same delayed frame in the current field as the delayed frame in the next field, the desired delayed frame number m is set to the expected delayed frame number n (m ←
n), the number K of consecutive displays of the same frame is incremented by 1 (step 9).

If the continuous display number K of the same frame is smaller than the minimum continuous display number Kmin in step 11, it is determined whether or not the predicted delay frame number n is larger than the total number L of field memories (3 in this example). In the next field, it is judged whether or not the delayed frame displayed in the current field is not present in the entire field memory (step 12).

If the expected number of delayed frames n is less than or equal to the total number of field memories L, the delayed frame displayed in the current field in the next field exists in any of the field memories, so In order to display the same delayed frame as the delayed frame, the desired delayed frame number m is set to the expected delayed frame number n (m ← n), and the number K of times the same frame is displayed is incremented by 1 (step 9).

If the expected number n of delayed frames is larger than the total number L of field memories, the delayed frame displayed in the current field in the next field does not exist in any field memory. Therefore, the delay in the current field in the next field is delayed. The same thing as a frame cannot be displayed as a delayed frame. Therefore, in the next field, in order to display the oldest frame in all the field memories as a delayed frame, the desired delayed frame number m is set to the total number of field memories L (m ← L), and the number of times the same frame is displayed K Is 1
Is set (step 13).

(3) When the desired delay frame number m is larger than the expected delay frame number n (m> n) First, the outline of the processing contents when m> n is described.

(I) According to the desired delay frame number m, in the next field, frames older than the delay frame displayed in the current field are displayed. Therefore, in order to prevent this, the delayed frame displayed in the current field is displayed as a delayed frame in the next field.

(Ii) However, if the continuous display count K of the delayed frames displayed in the current field has reached the maximum continuous display count Kmax, in the next field, only one is displayed after the delayed frame displayed in the current field. Display the frame as a delayed frame.

(Iii) Even in the case of (ii), in the next field, if there is only one newer frame than the delayed frame displayed in the current field, the delayed frame displayed in the current field is used. It is also displayed as a delayed frame in the next field.

(Iv) Even if the continuous display count K of the delayed frames displayed in the current field has reached the maximum continuous display count Kmax, the delayed frame displayed in the current field in the next field exists in any field memory. If it does not occur, the oldest frame in the entire field memory in the next field is displayed as the delayed frame in the next field.

If the desired delay frame number m is larger than the expected delay frame number n, first, the number of continuous display of the delayed frame displayed in the current field (the number of continuous display of the same frame)
It is determined whether K is equal to or larger than the maximum continuous display count Kmax (step 14).

When the continuous display number K of the same frame is equal to or larger than the maximum continuous display number Kmax, whether or not the expected delay frame number n is 0, that is, the image displayed as the delayed frame in the current field is in the next field. Is also determined to be a through image (input image signal a) (step 8).

If the expected number of delayed frames n is not 0, the image displayed as a delayed frame in the current field is
Since it is not a through image in the next field, a frame newer than the delayed frame displayed in the current field exists in the next field. Therefore, in the next field, in order to display one new frame as a delayed frame than the delayed frame displayed in the current field, the desired delayed frame number m is set to a value smaller by 1 than the expected delayed frame number n. Together with (m ← n-1), the number K of consecutive displays of the same frame is set to 1 (step 10).

When the expected number of delayed frames n is 0, the image displayed as a delayed frame in the current field is
Since it is a through image also in the next field, there is no new frame in the next field. Therefore, in order to display the same delayed frame in the current field as the delayed frame in the next field, the desired delayed frame number m is set to the expected delayed frame number n (m ←
n), the number K of consecutive displays of the same frame is incremented by 1 (step 9).

If the continuous display count K of the same frame is smaller than the maximum continuous display count Kmax in step 14, it is determined whether or not the predicted delay frame count n is larger than the total number L of field memories (3 in this example), that is, Then, it is determined whether or not the delayed frame displayed in the current field in the next field does not exist in any of the field memories (step 12).

If the expected number of delayed frames n is less than or equal to the total number of field memories L, since the delayed frame displayed in the current field in the next field exists in any of the field memories, the current field in the next field is In order to display the same delayed frame as the delayed frame, the desired delayed frame number m is set to the expected delayed frame number n (m ← n), and the number K of times the same frame is displayed is incremented by 1 (step 9).

When the expected number n of delayed frames is larger than the total number L of field memories, the delayed frame displayed in the current field in the next field does not exist in any field memory, so that the delay in the current field in the next field is delayed. The same thing as a frame cannot be displayed as a delayed frame. Therefore, in the next field, in order to display the oldest frame in all the field memories as a delayed frame, the desired delayed frame number m is set to the total number of field memories L (m ← L), and the number of times the same frame is displayed K Is 1
Is set (step 13).

When the desired delay frame number m is determined in step 9, 10 or 13, the process proceeds to step 15. In step 15, the expected delay frame number n is set to the desired delay frame number m determined in step 9, 10 or 13 (n ← m). Then, the processing of this time ends.

In the case of an image having a portion in which fields belonging to the same frame are consecutive odd times, such as a telecine-converted image by the 2-3 pull-down method, each field group in which the same frame appears consecutively as in the above embodiment. In addition, if only the final field of the plurality of fields in each field group is written to the field memory, the video of the odd field and the video of the even field are mixed in the field memory, and the delayed video flickers. It may occur. That is, if there is a line that exists only in one of the odd field and the even field, line flicker that is invisible or visible depending on the number of fields in which the same frame continues.

Therefore, in the field memory control data generation process for the telecine-converted video by the 2-3 pull-down system, for each field group in which the same frame appears consecutively, a predetermined number of fields in each field group is determined. 1 with field attributes (odd or even)
It is preferable to write only one field to the field memory.

By the way, the telecine-converted video is a two-dimensional video signal in which the same frames continuously appear, and is a video in which a cycle in which the same frames continue can be specified.

On the other hand, TV game machines (for example, 3D)
There is a video such as the video output from O), which is a two-dimensional video signal in which the same frames appear continuously and whose period in which the same frames continue cannot be specified. Hereinafter, such an image will be referred to as an intermittent image in order to distinguish it from a telecine converted image.

The field memory control data generation process when an intermittent image is input will be described below with reference to FIGS. 22 and 23. Here, a field memory control data generation process for an intermittent video in which the same frame is always continuous for three fields or more will be described.

First, it is determined whether or not the write flag F1 for storing whether or not the input video signal of the current field is written in the field memory is set (F = 1) (step 21). When the write flag F1 is set, it indicates that the input video signal of the current field is written in the field memory.

When the write flag F1 is set, since the input video signal of the current field has been written in the field memory, the number of the field memory in which the data should be written next is updated (step 2).
2). The order of writing data to the three field memories A, B, and C is predetermined, for example, A → B → C → A.

Further, the delay frame number n with respect to the latest written frame is incremented by 1. The number of delayed frames n with respect to the latest written frame represents how many frames before the delayed frame displayed in the current field is based on the latest frame written in the field memory. Since the number of the field memory to which the data is to be written next is updated in step 22, the number n of delayed frames for the latest written frame is updated.

After that, the write flag F1 indicating whether or not the through image (input image) is written in the field memory in the next field is updated (step 23).

In principle, the image input in the field next to the field in which the frame update is detected is stored in the field memory. However, in the intermittent image, the same frame may be repeated an odd number of times, so it is preferable to prevent line flicker. That is, it is preferable that the filled attributes of the images stored in the field memory are always the same.

Therefore, when the attribute of the field in which the frame update is detected is the same as the field attribute at the start of the field memory control data generation processing, the field next to the field in which the frame update is detected is detected. When the input image is stored in the field memory and the attribute of the field in which the frame update is detected differs from the field attribute at the start of the field memory control data generation process, the field in which the frame update is detected is detected. , The image input in the next field is stored in the field memory.

The update process of the write flag F1 is shown in FIG.
As shown in, the attribute flag F2 for storing that the update of the frame is detected in the previous field and it is determined that the attribute of the field is different from the field attribute at the start of the field memory control data generation process is set. It is checked whether or not it is set (step 41).

When the attribute flag F2 is not set, that is, when the frame update is not detected in the previous field or the frame update is detected, the attribute of the field is the field memory control data generation. If it is determined that the field attribute is the same as the field attribute at the start of the process, it is determined based on the frame change detection flag F3 whether the frame is updated in the current field (step 42). The frame change detection flag F3 is set (F3 = 1) when it is detected that the frame is updated in the current field.

To detect whether or not a frame has been updated in the current field, the minimum value of the correlation cumulative values obtained in each motion vector detection area is added, and the addition result is divided by the total number of motion vector detection areas. It is performed based on the value obtained by (the average value MIN of the minimum values of the correlation cumulative values). That is, MIN _{j of} the current field and MIN of the previous field
It is assumed that a frame is updated in the current field when the difference from _j-1 is larger than a predetermined value.

In step 42, when the frame change detection flag F3 is set, it is determined whether or not the attribute of the current field is the same as the field attribute at the start of the field memory control data generation process (step 43). ).

When the attribute of the current field is the same as the field attribute at the start of the field memory control data generation process, the write flag F1 is set to store the image input in the next field in the field memory. (Step 44). Further, the attribute flag F2 is reset (F2 = 0) (step 45).

In step 44, if the attribute of the current field is different from the field attribute at the start of the field memory control data generation process, the image input in the next next field is stored in the field memory. ,
The attribute flag F2 is set (F2 = 1) (step 46). In addition, the write flag F1 is in the reset state (F
1 = 0) (step 47).

In step 42, when the frame change detection flag F3 is not set, the write flag F1 is reset (F1 = 0) (step 48) and the attribute flag F2 is reset (F1).
2 = 0) (step 49).

In step 41, the attribute flag F
When 2 is set, that is, when a frame update is detected in the previous field and it is determined that the field attribute is different from the field attribute at the start of the field memory control data generation process. Is
The write flag F1 is set to store the video input in the next field in the field memory (step 44). Further, the attribute flag F2 is reset (F2
= 0) (step 45).

Returning to FIG. 22, when the write flag F1 is not set in the above step 21, (F1 =
0), the number of the writing memory and the delayed frame number n with respect to the latest frame to be written do not change. Therefore, the process proceeds to step 23 without updating them (processing of step 22), and the writing flag F1 is updated.

When the processing of step 23 is performed, the desired delay frame number m is determined (step 24). The desired delay frame number m is determined as follows. That is, the number of consecutive fields in each of the past frames stored in the field memory is set to PC ₁ , PC ₂ ... P in order from the new frame.
Let C _L. Here, L is the total number of field memories.

First, it is judged whether or not the consecutive field continuous PC _{1 of} the latest written frame exceeds the delay field number d3 at the normal time, and if it exceeds, the desired delay frame number m is set to 1. .

If not, it is determined whether or not the sum ((PC ₁ + PC ₂ )) of the number of consecutive fields of the two frames from the latest written frame to the frame one older is more than the delay field number d3 at the normal time. It is determined whether or not, and if it exceeds, the desired delay frame number m is set to 2.

If not exceeded, the sum of the number of consecutive fields of three frames from the latest written frame to the frame two older frames ((PC ₁ + PC ₂ + PC ₃ ) exceeds the delay field number d3 in the normal state). Whether or not it is determined, and if it exceeds, the desired delay frame number m is set to 3. By such processing, the desired delay frame number m is determined.

For example, the total number L of field memories is 3
If it is, it is first determined whether or not the condition of PC ₁ > d3 is satisfied. If this condition is met,
The desired delay frame number m is 1. If PC ₁ ≦ d3, it is determined whether or not the condition of (PC ₁ + PC ₂ )> d3 is satisfied. If this condition is satisfied, the desired delay frame number m is 2. If this condition is not satisfied, the desired delay frame number m is set to 3.

Next, the desired delay frame number m is compared with the delay frame number n for the latest written frame, and m = n, m <
It is divided into three cases of n or m <n (step 2
5). The processing of steps 25 to 34 is almost the same as the processing of steps 6 to 15 in FIG. In the processes of steps 25 to 34 and the processes of steps 6 to 15 of FIG. 21, the maximum continuous display count Kma
Since only the method of determining x and the minimum continuous display count Kmin is different, the maximum continuous display count Kmax and the minimum continuous display count Kmi used in steps 25 to 34 of FIG.
Only n will be described.

The maximum continuous display number Kmax and the minimum continuous display number Kmin used in the processing of steps 25 to 34 in FIG. 22 are the continuous field numbers of the past four frames because the continuous field number of each frame cannot be specified in the intermittent video. The maximum value PCmax of the number and the maximum value PCmin of the number of consecutive fields of the past four frames are used to determine by the following formula 4.

[0181]

[Equation 4]

In steps 25 to 34, the final desired delay frame number m is determined (steps 28 and 29).
Alternatively, 32), the value of the number of delayed frames n for the latest written frame is set to the determined desired number of delayed frames m (step 34).

When the processing of steps 25 to 34 is completed,
It is determined whether or not the frame change detection flag F3 is set (step 35). If the frame change detection flag F3 is not set (Fa = 0), the process this time ends. If the frame change detection flag F3 is set (F = 1), the maximum continuous display count K based on the history data
After max and the minimum continuous display count Kmin have been updated (step 36), the current process ends.

[0184]

According to the present invention, the same frame such as a two-dimensional image created by telecine converting a movie film into a television signal, an image output from a TV game machine (for example, 3DO), or the like is displayed. The number of field memories can be small when converting continuously appearing 2D images into 3D image signals.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a 2D / 3D conversion device.

FIG. 2 is a flowchart showing an overall procedure of 2D / 3D conversion processing by a CPU.

FIG. 3 is a flowchart of a detailed procedure of a delay amount calculation process in step 6 of FIG.

FIG. 4 is a graph showing a relationship between a motion vector average value and a first delay amount.

FIG. 5 is a schematic diagram for explaining how to derive a relational expression for obtaining a first delay amount from a motion vector average value.

FIG. 6 is a time chart showing how the target delay amount is changed when all the three second delay amounts match.

FIG. 7 is a time chart showing how the target delay amount is changed when all of the three second delay amounts become larger than the current target delay amount.

FIG. 8 is a graph showing a change of a motion vector with respect to a field of a video which has been telecine converted by a 2-3 pulldown method.

FIG. 9 is an explanatory diagram for explaining the basic idea of the field memory control data generation processing performed in the present embodiment.

FIG. 10 is a schematic diagram showing, for each field, a frame of a video that has been telecine-converted by a 2-3 pulldown method.

FIG. 11 is a schematic diagram showing a delay image that is actually output when the number of delay fields in the normal state is 1 or 2 when a video that has been telecine converted by the 2-3 pulldown method is input.

FIG. 12 is a schematic diagram showing a delay image that is actually output when the number of delay fields in a normal case is 3 or 4 when a video that has been telecine-converted by the 2-3 pulldown method is input.

FIG. 13 is a schematic diagram showing a delay image that is actually output when the number of delay fields in a normal case is 5 or 6 when a video that has been telecine-converted by the 2-3 pulldown method is input.

FIG. 14 is a diagram illustrating a delay image actually output when the number of delay fields in the normal state changes in the order of 2 → 3 → 4 → 5 when a video that has been telecine-converted by the 2-3 pulldown method is input. It is a schematic diagram which shows.

FIG. 15 shows a delay image actually output when the number of delay fields in a normal state changes in the order of 5 → 4 → 3 → 2 when a video that has been telecine converted by the 2-3 pulldown method is input. It is a schematic diagram which shows.

FIG. 16 is a schematic diagram showing, for each field, frames of a video that has been telecine-converted by the 2-2 pulldown method.

FIG. 17 is a schematic diagram showing a delay image that is actually output when the number of delay fields in the normal state is 1 or 2 when a video that has been telecine converted by the 2-2 pulldown method is input.

[Fig. 18] Fig. 18 is a schematic diagram showing a delay image actually output when the number of delay fields in a normal case is 3 or 4 when a video that has been telecine-converted by the 2-2 pulldown method is input.

FIG. 19 is a schematic diagram showing a delayed image that is actually output when the number of delay fields in a normal case is 5 or 6 when a video that has been telecine converted by the 2-2 pulldown method is input.

FIG. 20 is a delay that is actually output when the number of delay fields in the normal state changes in the order of 2 → 3 → 4 → 5 → 6 when a video that has been telecine converted by the 2-3 pulldown method is input. It is a schematic diagram which shows an image.

FIG. 21 is a flowchart showing a field memory control data generation processing procedure for a telecine converted image.

FIG. 22 is a flowchart showing a field memory control data generation processing procedure for an intermittent video.

FIG. 23 is a flowchart showing details of the process of step 23 of FIG. 22.

[Explanation of symbols]

 11 Field Memory 12 Interpolation Circuit 13 Video Switching Circuit 14, 15 Phase Control Circuit 20 CPU 21 ROM 22 RAM 23 Operation / Display 24 Memory Control Circuit

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Inventor Shin Tanase 2-5-5 Keihan Hondori, Moriguchi City, Osaka Prefecture Sanyo Electric Co., Ltd. (72) Inventor Haruhiko Murata 2-5 Keihan Hondori, Moriguchi City, Osaka Prefecture No. 5 within Sanyo Electric Co., Ltd. (72) Inventor Yukio Mori 2-5-5 Keihan Hondori, Moriguchi City, Osaka Prefecture Within Sanyo Electric Co., Ltd. (72) Hidekazu Uchida 2 Keihan Main Street, Moriguchi City, Osaka Prefecture 5th-5th Sanyo Electric Software Co., Ltd.

Claims (4)

[Claims] 1. A two-dimensional image is three-dimensionally generated by generating a main image and a sub-image delayed from the main image using a field memory from a two-dimensional image in which the same frame appears continuously. In the method of converting into a video, for each field group in which the same frame appears consecutively, only one field video among a plurality of fields in each field group is written into a field memory. To convert 3D image to 3D image. 2. A delay amount of a sub-image frame with respect to a main video frame is calculated based on a moving speed of the main video image, and the sub-video image is selected based on the calculated delay amount. The method for converting the two-dimensional image described in 1. into a three-dimensional image. 3. The delay amount of the sub-image frame with respect to the main image frame is determined such that the slower the main image moves, the greater the delay amount of the sub-image frame with respect to the main image frame becomes. The method for converting a two-dimensional image into a three-dimensional image according to any one of claims 1 and 2. 4. One image written in the field memory is selected from each field group so that all the field attributes of the images written in the field memory have the same field attribute.
The method for converting a 2D image into a 3D image according to any one of 2 and 3.