JP2000259146A - Image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image display device which is suitable for a display device such as PDP and a micromirror device. SOLUTION: A moving vector detection part 7 detects a moving vector MV needed for a movement compensating process from an input image signal S1. An MCIP part 1 generates an interpolation signal through the movement compensating process using a movement compensating vector MV1 generated by a moving vector conversion part 8 through converting operation and converts it into a line-sequential image signal S2. An MCFRC part 2 generates an interpolating frame signal by the movement compensating process with a movement compensating vector MV2 generated by a moving vector conversion part 9 and converts it into an image signal S3 of the same frame frequency as the frame frequency of the display device. An MC correction part 5 performs a signal process for moving picture false outline disturbance suppression of movement compensation with a movement compensating vector MV3 generated by a moving vector conversion part 10 and converts it into a display image signal S6. Then the image is displayed at a display device part 6 such as PDP and a micromirror device.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device and, more particularly, to an image display device suitable for displaying a high-quality image on a display device which performs color or gradation display of an image by combining a plurality of subfields. It relates to signal processing of a device.

[0002]

2. Description of the Related Art Conventionally, devices for displaying images are CR.
T (cathode ray tube) has been used. However, in recent years, research and development of new display devices such as a PDP, a micromirror device, and a liquid crystal for displaying a color or gradation of an image by a combination of a plurality of subfields have been advanced.

[0003] Electronic Journal Inc., "1998 FPD Technology-Taizen", published on July 10, 1998, p353-p
As described in 358, the PDP displays the gradation of an image by a pulse number modulation method in a plurality of subfields. For this reason,
When the gradation changes, the position of the light-emitting block in the field may change significantly. At this time, if the line of sight moves following the image, the temporal non-uniformity is converted into a spatial non-uniformity. And false contours of moving images with distorted display colors occur.

The above-mentioned "1998 FPD Technology-Taizen"
As described on pages 508 to 511, the micromirror device is a Texas Instruments DMD (Digital Micro
mirror Device: a registered trademark of Texas Instruments), which tightens a large number of minute mirrors and displays brightness in the direction of the minute mirrors. It is displayed as a group of a plurality of subfields. At this time, similar to the PDP, a false contour disturbance of a moving image in which the gradation is disturbed occurs. Furthermore, since the colors are reproduced by one chip, the colors are also RGB primary color sub-fields.
In this case, so-called frame-sequential color reproduction is performed, so that not only the gradation but also the color can cause false contour interference of the moving image.

[0005] Further, since the display is in the form of progressive scanning,
Interlaced scanning image signals require scan conversion signal processing for converting them into progressively scanned image signals. Further, for an image signal different from the frame frequency of the display device, signal processing for frame number conversion is also required.

Therefore, in order to display high-quality images on these display devices, signal processing such as scan conversion and frame number conversion with little image quality deterioration is required in addition to suppression of false contour interference of moving images. You.

Heretofore, for suppressing the false contour interference of a moving image, a motion compensation equalizing pulse method, a modified binary coded light emitting method, and the like, which detect the direction and speed of the image motion and control the light emitting method, have been devised. I have.

Further, as a method for realizing scanning conversion and frame number conversion with high quality, a method has been devised in which a motion compensation process for detecting an image moving direction and speed and generating an interpolation signal is performed.

However, in a configuration in which the scan conversion, the frame number conversion, and the signal processing of the moving image false contour interference suppression are independently performed by applying these invented methods, the image necessary for the motion compensation processing is obtained. It is necessary to independently and independently detect the direction and speed of the motion, that is, the motion vector of the image. For this reason, the operation speed and circuit scale of signal processing become extremely large, and there are many problems in realizing this configuration.

[0010] Therefore, these PDPs and micromirrors
It is an issue to realize an image display device using a display device such as a device or a liquid crystal at high quality and at low cost.

[0011]

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and provides a high-quality, low-cost image display apparatus suitable for a display device such as a PDP or a micro mirror device. With the goal.

[0012]

Means for Solving the Problems In order to achieve the above object, the present invention employs the following technical means.

The detection of the direction and speed of the motion of an image, that is, the detection of a motion vector usually requires an enormous amount of calculation. This affects the operation speed and circuit scale of signal processing.
Therefore, motion vector detection is performed collectively, and in scan conversion, frame number conversion, and moving image false contour interference suppression signal processing, motion compensation processing is performed using the motion compensation vector generated by this motion vector conversion operation processing. Adopt configuration.

That is, in the detection of the motion vector, the motion vector is detected with the highest accuracy among the motion vector detection accuracy required for the scan conversion, the frame number conversion, and the motion compensation processing for suppressing the false contour interference of the moving image. For example, in the case of scan conversion, the vertical direction is h / 4 (h is the interval of one scanning line in the sequential scanning) between fields, and in the case of frame number conversion and the suppression of false contour interference in moving images, the vertical direction is h. If accuracy is required, a motion vector MV is detected between four fields. In the scan conversion, a motion compensation vector MV / 4 having an accuracy of h / 4 in the vertical direction is generated and used between the fields by a conversion operation for multiplying this by 1/4. On the other hand, in the frame number conversion and the moving image false contour interference suppression, although the accuracy is the over specification, the motion compensation vector MV / 4 is generated and used by the conversion operation to multiply by 1/4.

In the detection of a motion vector, signal processing of setting, smoothing, and mini-block division search of a representative vector using a reference vector is employed, and the amount of calculation required for the detection is greatly reduced.

By the technical means described above, signal processing for detecting a motion vector can be greatly reduced.
It is possible to realize an image display device such as a DP or a micro-mirror device that performs gradation display by a pulse number modulation method in a plurality of sub-fields at high quality and at low cost.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described.
This will be described with reference to FIGS.

FIG. 1 shows an example of this block configuration, in which an MCIP unit 1, an MCFRC unit 2, a scaling unit 3, an RGB conversion unit 4, an MC correction unit 5, a display device unit 6, a motion vector detection unit 7, a motion vector conversion unit It is composed of the units 8, 9, 10 and the control unit 11.

The input image signal S1 (luminance signal and color difference signal) is
The information is supplied to the MCIP unit 1, the motion vector detecting unit 7, and the control unit 11.

The motion vector detecting section 7 detects the motion vector MV by the above-described setting of the representative vector by the reference vector, smoothing, and signal processing of the mini-block division search.

The MCIP unit 1 performs a signal process of generating an interpolation signal on the input image signal of the interlaced scanning by the motion compensation process using the motion compensation vector MV1 generated by the conversion operation process of the motion vector conversion unit 8, A signal of a scanning line that has been skipped in the interlaced scanning is generated and converted into a progressively scanned image signal S2.

The MCFRC unit 2 is a frame of a display device.
Frame number conversion is performed on an image signal having a frequency different from the frame frequency by signal processing of interpolation frame signal generation by motion compensation processing using the motion compensation vector MV2 generated by the conversion operation processing of the motion vector conversion unit 9. The display device frame
It is converted into an image signal S3 having the same frame frequency as the frame frequency.

The scaling unit 3 compresses / compresses the image size.
The signal processing such as expansion is performed, and the image signal is converted into an image signal S4 having the same number of pixels as that of the display device.

The RGB conversion unit 4 performs signal processing for converting luminance and color difference signals into RGB signals of three primary colors and inverse gamma correction processing.
(Because a CRT has a non-linear input / output characteristic called a gamma characteristic, gamma correction is performed on the image pickup side to correct the linear input / output characteristic. However, a PDP or a micromirror device has an input / output characteristic. Since the characteristics are linear, the gamma correction on the imaging side is corrected by the inverse gamma correction processing) to convert the image into a linear three-primary-color image signal S5.

The MC correction unit 5 includes a motion vector conversion unit 10
The motion compensation processing using the motion compensation vector MV3 generated by the conversion operation processing of FIG. 3 performs signal processing of moving image false contour interference suppression and pulse number modulation, and converts it into a display image signal S6.

For example, the display device section 6 causes a predetermined pixel to emit light with the display image signal S6 in a PDP, and the micromirror device rotates a mirror of a predetermined pixel in the micromirror device with the display image signal S6. Perform the operation and display the image.

The control section 11 generates signals necessary for the operation of each section, and controls the MCI according to the form of the input image signal S1.
The P section 1, the MFCRC section 2, and the MC correction section 5 control motion compensation signal processing. Table 1 shows an example of this control in the case where the frame frequency of the display device is 60 Hz.
Symbol I in the table indicates interlaced scanning, P indicates sequential scanning, and numbers indicate field frequency / frame frequency.

[0028]

[Table 1]

In the MCIP unit 1, the input image signal S1 is
For a general image signal of (interlaced scanning with a field frequency of 60 Hz), 60I → 60P scan conversion is performed by motion compensation processing. In the case of a telecine signal obtained by converting a film image into a television signal by 2-3 pull-down processing at 60I, 60I → 24P scan conversion is performed by frame synthesis processing. For an image signal of 50I (interlaced scanning at a field frequency of 50 Hz) (for example, a PAL television signal), the MCIP unit 1 performs a scan conversion of 50I → 50P by a motion compensation process. On the other hand, the signal processing is omitted for the progressively scanned image signals indicated by 60P and 24P.

In the MCFRC section 2, signal processing is omitted for a 60P image signal. On the other hand, the 50P and 24P image signals are subjected to 50P → 60P and 24P → 60P frame number conversion by motion compensation processing, and are converted into progressive scanning image signals having a frame frequency of 60 Hz.

The MC correction unit 5 performs signal processing for suppressing false contour interference of a moving image by motion compensation processing on the 60P progressively scanned image signal, that is, all image signals.

The example of the block configuration has been described above, and the configuration and operation of each block will be described in detail below.

First, the motion vector detecting section will be described with reference to FIGS.

FIG. 2 shows an example of this configuration, in which a frame generating unit 12, a low-pass filter unit 13, and a delay unit 14 are used in combination to detect a motion vector from a luminance signal of the input image signal S1, for example. Image signals S11 and S12 are generated. Further, the motion vector MV is detected by a combination of the block matching unit 15, the smoothing unit 16, the mini-block division search unit 17, and the reference vector generation unit 18.

The frame synthesizing unit 12 generates a frame image signal S10 from the interlaced image signal S1 by field synthesis or simple interpolation signal processing. FIG. 3 shows an outline of this operation. FIG. 7A shows the detection of a motion vector.
(B) for each frame period, and (c) for a telecine signal.

In the case of (a) for each field cycle, in field synthesis, signals of two consecutive fields of the input image signal S1 (for example, symbols 1, 2, 2, 3, 3, 4, .. Are combined to generate frames of symbols 1, 2, 3,... Of the frame image signal S10. On the other hand, in simple interpolation, the input image signal
The signals 2, 3, 4,... Of each field of S1 are subjected to intra-field interpolation processing to generate the frames of 1, 2, 3,... Of the frame image signal S10.

Also, in the case of each frame period of (b), two consecutive fields of the input image signal S1 are used in the field synthesis.
Field signals (for example, fields indicated by symbols 1,2,3,4,5,6, ...)
) Are combined to generate frames of symbols 1, 2, 3,... Of the frame image signal S10. On the other hand, in the simple interpolation, the signals 2, 4, 6,... Of the respective fields of the input image signal S1 are subjected to intra-field interpolation processing, and the frames 1, 2, 3,. Generate a system.

On the other hand, in the case of the telecine signal of (c), signals of fields belonging to the same film frame in the input image signal S1 (eg, 1, 2, 3, 4, 6, 7,...) Into a frame
The frame signals of symbols 1, 2, 3,... Of the frame image signal S10 are generated.

Returning to FIG. 2, the low-pass filter section 13 is composed of, for example, a filter having low-pass characteristics of two-dimensional horizontal and vertical directions, and removes a noise component which causes a malfunction when detecting a motion vector. The image signal S11 is generated.

The delay unit 14 has a field period determined by the vertical detection accuracy of the motion vector (for example, as described above, an accuracy of h / 4 between fields used in the scan conversion of the motion compensation processing). To detect the motion vector, a signal S12 delayed by four field periods is generated. In the case of telecine, scan conversion of the motion compensation processing is not performed as described in Table 1. Therefore, the delay is set to one frame period so as to detect a motion vector necessary for the motion compensation process after the frame number conversion process, and the frame image signal is delayed by one frame period. Generate

The block matching processing section 15 sets a representative vector BTV for each block (for example, horizontal 8 pixels × vertical 8 pixels) based on the reference vector RV. That is, as shown in the flowchart of FIG.
It is determined for each block whether it is a still block or a moving image block in accordance with the signal level of the difference component of S1 and S12. Then, for the stationary block, zero is set to the representative vector BTV. On the other hand, for a moving image block, as shown in FIG. 3B, the motion vector of a block around the block of interest is set as a reference vector RV, and a reference vector (RV + ΔRV) having a minimum prediction error ER shown in Expression 1 is represented. Set to vector BTV.

[0042]

(Equation 1)

Here, S11 (x, y) is the value of the signal S11 of the pixel (x, y) in the target block, and S12 (x, y, RV + ΔRV) is the pixel (x, y).
y) to the reference vector RV + ΔRV (horizontal component RVx, vertical component RVy)
Is the absolute value of the signal S12 at the point where the position has been moved, and | is the sum of the pixels of the block of interest.

For a block whose representative vector BTV is equal to or larger than the threshold, a predetermined search area is searched again by block matching processing, and a representative vector is set.

The smoothing section 16 corrects the singular vector of the flowchart of FIG. 4A and smoothes the peripheral motion vector. That is, as shown in FIG. 4C, the correlation between the motion vector of the target block and the motion vectors of the upper, lower, right, and left blocks adjacent thereto is detected. If the correlation is less than the threshold value, it is determined to be a singular vector, and the motion vector of the adjacent block is replaced with the motion vector having the smallest prediction error shown in Expression 1. Next, smoothing is performed using the average value of the motion vectors of, for example, 3 × 3 peripheral area blocks around the target block as the motion vector BV of the target block.

The reference vector generation unit 18 stores the motion vector BV and stores the reference vector corresponding to the block of interest.
Generate RV.

The mini-block division search unit 17 performs the operation shown in FIG.
The motion vector MV for each pixel is set by the mini-block division search of the flowchart of FIG. That is, as shown in FIG. 4 (d), for each mini-block (the size is, for example, 2 pixels horizontally × 2 pixels vertically) obtained by subdividing the block in the horizontal and vertical directions, the motion vector of the block of interest and the peripheral block is The one with the smallest prediction error shown in Equation 1 is set as the motion vector of the pixel in the mini-block.

Next, the MCIP unit will be described with reference to FIGS.

FIG. 5 shows an example of the configuration. The still image interpolation unit 19 generates an interpolation signal IPS suitable for a still region by performing a calculation between fields. Further, the moving image interpolation unit 20 generates an interpolation signal IPM suitable for the moving image region by performing an operation in the field or a two-dimensional interpolation filter process in the vertical time region.

On the other hand, the motion compensation interpolation unit 21 is, for example, a GST (general sampling theorem) that generalizes the sampling theorem.
y) Generate an interpolation signal IPMC by motion compensation processing based on theory. That is, the signal sequence of the interlaced scanning of the current field ..., L1 (2kh-3h), L1 (2kh-h), L1 (2kh + h), L1 (2kh + 3h), ...
And the signal sequence of the interlaced scanning in the previous field is represented by the vertical motion vector y (y = 2h (q + r), q is an integer, and r is a decimal number).
, L2 (2kh-4h + y), L2 (2
kh-2h + y), L2 (2kh + y), L2 (2kh + 2h + y),..., and a signal L1 (2kh) of the interpolation scanning line is generated by the following equation (2).

[0051]

(Equation 2)

Here, the coefficients h1 (j) and h2 (j) are determined by the following equations (3) and (4).

[0053]

(Equation 3)

[0054]

(Equation 4)

In Equations 3 and 4, sinc {x} is sin
Indicates (x) / x.

The coefficients h1 and h2 necessary for generating the interpolation signal for the motion compensation processing are supplied from the parameter setting section 26.

The coefficient weighting units 22-1, 22-2, 22-3 are:
The weighting coefficient Wp (Wp1, Wp
2, Wp3) are added, and these are added by the adder 23 to generate an interpolation signal IP by the motion compensation processing.

The double-speed conversion unit 25 performs a half-compression process on the time axis and a time-series rearrangement process on the signal S1D obtained by adjusting the time delay associated with the signal processing in the delay unit 24 and the interpolation signal IP, respectively. The image signal S2 (luminance signal and color difference signal) of the progressive scanning is output.

The parameters required for the motion compensation processing are generated by the motion vector conversion unit 8 and the parameter setting unit 26.

As described above, the motion vector conversion unit 8 generates the motion compensation vector MV1 from the motion vector MV, and its operation is schematically shown in FIG. The figure shows an example in which the detection accuracy in the vertical direction is set to h / 4. The motion vector MV of the interlaced scanning signal sequence S1 (60I) detected by the above-described motion vector detection unit in four field periods.
For example, in the field cycle detection, a motion compensation vector MV1 (MV1 = MV / 4) is generated by a conversion operation process of multiplying the motion vector MV by 1/4 in each field. On the other hand, in the frame period detection, a motion compensation vector MV1 (MV1 = MV / 4) generated by a conversion operation for multiplying the motion vector MV by 1/4 is output in two fields of the frame period. .

The parameter setting unit 26 calculates the motion compensation vector
Variables q and r using the vertical component MV1y of MV1 as the vertical motion vector y
Is calculated, and coefficient values h1 and h2 shown in Expressions 3 and 4 are output.
Also, according to the speed of the motion compensation vector MV1, the weight coefficient W
Set p. For example, the weighting factor is set such that the interpolation signal IPS is mainly used when MV1 = 0, the interpolation signal IPMC is mainly used for speeds V1 to V2 at which the line of sight can follow, and the interpolation signal IPM is mainly used for speeds higher than this.

Next, the MCFRC section will be described with reference to FIGS.
This will be described with reference to the drawings.

The image signal S2 of the progressive scan and the signal S2 delayed by one frame period of the progressive scan by the frame delay unit 27
D is used to generate the interpolated frame signals required for frame number conversion. The time direction interpolation unit 28 generates a signal IFT of an interpolation frame by linear interpolation processing in the time direction. That is, a signal (k · ・) obtained by weighted addition of the interpolation coefficients k and 1−k (k changes from 0 to 1 according to the interpolation frame order) to the signals S2 and S2D.
The signal IFT is generated by S2 + (1-k) · S2D).

On the other hand, the combination of the motion compensation interpolation units 29 and 30 and the addition unit 31 causes the interpolation frame by the motion compensation processing.
Generate the signal IFM of the system. That is, the motion compensation interpolation unit 2
9 is a signal IFc (IFc = S2 (x, y, Vct)) obtained by moving the signal S2 to the position of the pixel (x, y) on the interpolation frame by the interpolation vector Vct.
Generated by Further, the motion compensation interpolation unit 30 outputs a signal IFp (IFp = S2D (x, y, Vpr) obtained by moving the signal S2D to the position of the pixel (x, y) on the interpolation frame by the interpolation vector Vpr. ). Adder 31 outputs the average value of both signals to signal IFM.

The coefficient weighting units 32-1 and 32-2 are provided with a weighting coefficient Wf
1 and Wf2 are weighted, and the two are added by an adder 33 to generate an interpolated frame signal sequence FMC.

The buffer section 34 performs a time-series rearrangement process on the signal S2 for each predetermined frame period (the signal in the frame order 1 described in FIG. 8) and the interpolated frame signal sequence FMC. To output the frame-converted progressively scanned image signal S3.

The motion vector conversion unit 9 and the parameter setting unit 3
5 sets parameters required for frame number conversion in the motion compensation processing based on the motion vector MV.

The motion vector converter 9 generates the motion compensation vector MV2 from the motion vector MV as described above. For example, the signal sequence S1 (60
In the motion vector MV detected in the four field period of I),
In the field cycle detection, the motion vector MV in each field
Is converted by a factor of 1/4, and a motion compensation vector MV corresponding to a motion vector in one frame period of progressive scanning is obtained.
2 (MV2 = MV / 4) is generated. On the other hand, in the frame period detection, the motion vector is calculated in two fields during the frame period.
A motion compensation vector MV2 corresponding to a motion vector in one frame period of progressive scanning in a conversion operation process for multiplying MV by 1/4.
(MV2 = MV / 4) is generated and used in two frames of progressive scanning. In the case of a telecine image, the motion vector MV is detected in one frame period of 24P sequential scanning.
Therefore, no conversion operation is performed, and this is used as it is for the motion compensation vector MV2.

The parameter setting unit 35 performs the operation shown in FIG. 8 based on the motion compensation vector MV2, and generates interpolation vectors Vct and Vpr, an interpolation coefficient k, and a weighting coefficient Wf.

FIG. 9A shows the operation in the case of converting the number of frames from 50P to 60P. Frame of progressive scan image signal S2 (50P)
A signal sequence of frame order 1,2,3,4,5,6 is generated from a signal sequence of system order 1,2,3,4,5 and converted to a 60P progressive scanning image signal S3. The signal of frame order 1 is a 50P frame.
The signals in the same order as the frame order 1 and the remaining signals in the frame order 2, 3, 4, 5, and 6 are signals of interpolation frames generated by linear interpolation processing and motion compensation processing in the time direction.

First, the interpolation vectors Vct and Vpr are generated by the above-described conversion operation of the motion compensation vector MV2. That is, the interpolation vector Vpr is (5/6) · MV in the interpolation frame 2.
2, (4/6) MV2 in interpolation frame 3, (3/6) in interpolation frame 4
/ 6) MV2, interpolation frame 5 (2/6) MV2, interpolation frame 6
Then, it is generated by (1/6) · MV2 conversion operation processing. On the other hand, the interpolated vector Vct is (−1/6) · MV2 in the interpolated frame 2, (−2/6) · MV2 in the interpolated frame 3, and (−3) in the interpolated frame 4. / 6) ・ MV
2, (-4/6) MV2 in interpolation frame 5, and in interpolation frame 6
(-5/6)-Generated by MV2 conversion operation.

The interpolation coefficient k is 5/5 in the interpolation frame 2.
6. Interpolated frame 3 generates 4/6, interpolated frame 4 generates 3/6, interpolated frame 5 generates 2/6, and interpolated frame 6 generates 1/6.

On the other hand, when the accuracy of the interpolation vector is high, the weighting coefficient Wf is mainly based on the signal IFM generated by the motion compensation processing.
When the accuracy is low, the coefficient values Wf1 and Wf in the range of 0 to 1 so that the signal IFT generated by the linear interpolation processing in the time direction is mainly used.
Set 2.

FIG. 11B shows the operation in the case of converting the number of frames from 24P to 60P. The frame of the progressive scanning image signal S2 (24P)
A signal sequence of frame order 1, 2, 3, 4, 5 is generated from the signal sequence of frame order 1 and 2, and is converted into a 60P progressively scanned image signal S3. Of these, the signal of frame order 1 is the same signal as frame order 1 of 24P, and the remaining signals of frame order 2, 3, 4, 5 are subjected to linear interpolation processing and motion compensation processing in the time direction. This is the signal of the interpolation frame to be generated.

First, the interpolation vectors Vct and Vpr are generated by performing a conversion operation on the above-described motion compensation vector MV2. That is, the interpolation vector Vpr is (2/5) · in the interpolation frame 2.
For MV2 and interpolated frame 3 (4/5) ・ MV2 and for interpolated frame 4
In the interpolation frame 5, (1/5) .MV2 is generated by the conversion operation processing of (3/5) .MV2. On the other hand, the interpolation vector Vct is
(-3/5) MV2 for frame 2, (-1/5) MV2 for interpolated frame 3, (-4/5) MV2 for interpolated frame 4, interpolated frame 5 Then (-2/5)
-Generated by MV2 conversion operation.

The interpolation coefficient k is 2/2 in the interpolation frame 2.
5. Interpolated frame 3 generates 4/5, interpolated frame 4 generates 1/5, and interpolated frame 5 generates 3/5.

On the other hand, the weighting coefficient Wf is mainly based on the signal IFM generated by the motion compensation processing when the accuracy of the interpolation vector is high.
When the accuracy is low, the coefficient values Wf1 and Wf in the range of 0 to 1 so that the signal IFT generated by the linear interpolation processing in the time direction is mainly used.
Set 2.

Finally, regarding the MC correction unit, FIGS.
This will be described with reference to FIG.

FIG. 9 shows a first example of the configuration, which is suitable for a three-panel projector using a PDP or three micromirror devices.

The motion vector converter 10 calculates the motion vector
In the MV conversion operation processing, the motion vector is converted into the motion compensation vector MV3 in one frame period of the progressive scanning. For example, the motion vector MV
Is a 4-field period of interlaced scanning, a motion compensation vector MV3 = MV / 4 is generated by a 1/4 conversion operation. On the other hand, for a telecine image, a motion compensation vector MV3 = (2/5) · MV is generated by a 2/5 conversion operation.

The motion compensation pulse generator 36 generates a correction control signal MMCT for suppressing the false contour interference of the moving image based on the motion compensation vector. For example, in the modified binary encoded light emission display method, an encoded light emission control signal is generated, and in the motion compensation equalization pulse method, a weighted equalized pulse signal is generated.

The data driver processing section 37 generates a display image signal S6 corrected according to the correction control signal MMCT. This operation is schematically shown in FIG. (A) of FIG.
1 shows a form of a hexadecimal encoded light emitting display system. One field period
(Equivalent to one frame period in the progressive scanning system) is divided into a plurality of subfields A, D1, D2, D3, and D4, and these subfields are divided.
The gradation of the image is expressed by lighting and non-lighting of the field.

FIG. 9B shows an example of a light pulse for motion compensation. The arrows in the figure indicate the movement of the image during one field period. That is, the image is a sub-field on the pixel.
It moves to the area indicated by the dotted line every field period. Therefore, in the motion compensation light emission pulse method, the light emission pulse for motion compensation is changed according to the motion correction control signal MMCT, and the gradation is corrected to the same as the original image. In the modified binary coded light emission display system, the lighting field of the sub-field is controlled according to the motion compensation control signal MMCT.
By controlling the cans, the gradation is displayed in a mode in which false contour interference is less noticeable.

FIG. 11 shows a second example of the structure, which is suitable for a sequential color light emitting type projector comprising one micromirror device and a light source whose color is sequentially switched.

The motion vector converter 10 calculates the motion vector
In the MV conversion operation processing, the motion vector is converted into the motion compensation vector MV3 in one frame period of the progressive scanning. For example, the motion vector MV
Is a 4-field period of interlaced scanning, a motion compensation vector MV3 = MV / 4 is generated by a 1/4 conversion operation. On the other hand, for a telecine image, a motion compensation vector MV3 = (2/5) · MV is generated by a 2/5 conversion operation.

As will be described later, the motion compensation parameter setting section 40 suppresses interpolation vectors Vg and Vb for generating three primary color signals at positions obtained by dividing one field period into three, and suppresses false contour interference in a moving image. To generate a correction control signal MMCT for the purpose. For example, in the modified binary encoded light emission display method, an encoded light emission control signal is generated, and in the motion compensation equalization pulse method, a weighted equalized pulse signal is generated.

The MC interpolation units 38-1 and 38-2 generate interpolation frame signals SG and SB using interpolation vectors. This is schematically shown in FIG. In a sequential color light emitting type projector composed of one micromirror device, one field period is divided into three, and R, G, B signal components of three primary colors are sequentially displayed in each section. In the figure, the R signal is displayed at the head of the field, the G signal is displayed at a position 1/3 away, and the B signal is displayed at a position 2/3 away. The gradation of each of the R, G, B signals is performed by the same pulse number modulation method as in the first configuration example.

Therefore, MC interpolation section 38-1 outputs signal S
With respect to the G signal component of FIG. 5, an interpolation frame signal SG at a position separated by 1/3 of one field period is generated by a motion compensation process using an interpolation vector Vg shown in FIG. Also, MC
The interpolation section 38-2 performs the motion compensation processing using the interpolation vector Vb on the B signal component of the signal S5, and performs the interpolation frame signal at a position separated by 2/3 of one field period. Generate SB.

The multiplexing unit 39 compresses the time axis of the R signal of the signal S5, the signal SG, and the signal SB to 1/3 compression and rearranges the time series, and performs R, G, B signal components in one field period. Is generated by time-division multiplexing.

The data driver processing section 41 generates a display image signal S6 corrected according to the correction control signal MMCT. This operation may be performed in the same manner as in the first configuration example, and the description is omitted.

As described above, according to the first embodiment of the present invention, a high-quality and low-cost image display device can be realized. In addition, a remarkable effect is obtained in improving the image quality of multimedia image display in the future.

Next, a second embodiment of the present invention will be described with reference to FIG.
This will be described with reference to FIGS. This embodiment is suitable for using a sequentially scanned signal for detecting a motion vector.

FIG. 13 shows an example of this block configuration.
Unit 1, MCFRC unit 2, scaling unit 3, RGB conversion unit 4, MC correction unit 5, display device unit 6, motion vector detection unit 42, motion vector conversion units 8, 9, 10, control unit 1.
It is composed of 1.

The blocks other than the motion vector detecting section 42 have the same configuration and operation as those in the first embodiment.
That is, the MCIP unit 1 generates an interpolation signal by the motion compensation processing using the motion compensation vector MV1 of the motion vector conversion unit 8, and converts it into an image signal S2 of progressive scanning. Also, MCF
The RC unit 2 calculates the motion compensation vector of the motion vector conversion unit 9.
MV2 generates an interpolated frame signal by motion compensation processing,
The image signal is converted into an image signal S3 having the same frame frequency as that of the display device.

The scaling section 3 converts the image signal into an image signal S4 having the same number of pixels as that of the display device by signal processing such as compression / expansion of the image size. And the RGB conversion unit 4
Performs signal processing for converting the luminance and color difference signals into RGB signals of three primary colors and inverse gamma correction processing to convert the signals into linear three primary color image signals S5.

The MC correction unit 5 includes a motion vector conversion unit 10
The motion compensation vector MV3 performs motion-compensated motion image false contour interference suppression signal processing, and converts it into a display image signal S6. Then, an image is displayed on a display device section 6 such as a PDP or a micro mirror device.

The control unit 11 generates signals necessary for the operation of each unit and controls the signal processing operation.

FIG. 14 shows an example of the configuration of the motion vector detecting section 42. The low-pass filter section 13, the delay section 14, the block matching section 15, the smoothing section 16, and the mini-block division search section 1
7. The motion vector MV is detected by the combination of the reference vector generation unit 18.

The luminance signal of the progressively scanned image signal S2 is subjected to a low-pass filter section 13 to remove noise components using, for example, a two-dimensional horizontal / vertical low-pass filter characteristic, thereby obtaining a frame image signal S21.
Generate

The delay section 14 generates a signal S22 delayed by a predetermined frame period. For example, to obtain a motion compensation vector with vertical accuracy of h / 4 per field in scan conversion, the delay is set to 4 frame periods. In the case of a telecine image, since scan conversion of the motion compensation processing is unnecessary, a delay is set to one frame period in order to obtain a motion compensation vector necessary for the subsequent frame number conversion processing and the like.

Using the frame image signals S21 and S22, the subsequent blocks detect the motion vector MV by the same operation as in the first embodiment. That is, the block matching processing unit 15 performs the block matching based on the reference vector RV.
A representative vector BTV is set for each (the size is, for example, 8 horizontal pixels × 8 vertical pixels). The smoothing unit 16 corrects the singular vector and smoothes the peripheral motion vector to generate a block motion vector BV. Then, the reference vector generation unit 1
8 stores the motion vector BV and generates a reference vector RV corresponding to the block of interest.

The mini-block division search unit 17 determines, for each mini-block (for example, horizontal 2 pixels × vertical 2 pixels) obtained by subdividing the block in the horizontal and vertical directions, out of the motion vector of the target block and the peripheral blocks. A process with the smallest prediction error as a motion vector of a pixel in the mini-block is performed, and a motion vector MV is output.

As described above, according to the second embodiment of the present invention, a high-quality and low-cost image display device can be realized. In addition, a remarkable effect is obtained in improving the image quality of multimedia image display in the future.

Now, in the field of broadcasting and communication, in the future, image signals will be transmitted by compressing the amount of information by high-efficiency coding. In the compression of this image signal, it is expected that a predictive coding method of motion compensation represented by MPEG video coding will be frequently used. This is because the transmitting side detects a difference component between the signal of the predicted frame generated by moving the position by the motion vector and the signal of the current frame as a prediction error signal, and this is detected by DCT coding or the like. Encode. Then, on the receiving side, the original image is decoded using the transmitted prediction error component and the motion vector. Therefore, it becomes possible for the receiving side to obtain motion vector information during the decoding process.

An embodiment utilizing this motion vector information will be described below.

First, a third embodiment of the present invention will be described with reference to FIG.
This will be described with reference to FIGS.

FIG. 15 shows an example of this block configuration.
Unit 1, MCFRC unit 2, scaling unit 3, RGB conversion unit 4, MC correction unit 5, display device unit 6, motion vector detection unit 43, motion vector conversion units 8, 9, 10, control unit 1.
It is composed of 1.

The blocks other than the motion vector detecting section 43 have the same configuration and operation as in the first embodiment.
That is, the MCIP unit 1 generates an interpolation signal by the motion compensation processing using the motion compensation vector MV1 of the motion vector conversion unit 8, and converts it into an image signal S2 of progressive scanning. Also, MCF
The RC unit 2 calculates the motion compensation vector of the motion vector conversion unit 9.
MV2 generates an interpolated frame signal by motion compensation processing,
The image signal is converted into an image signal S3 having the same frame frequency as that of the display device.

The scaling section 3 converts the image signal into an image signal S4 having the same number of pixels as that of the display device by signal processing such as compression / expansion of the image size. And the RGB conversion unit 4
Performs signal processing for converting the luminance and color difference signals into RGB signals of three primary colors and inverse gamma correction processing to convert the signals into linear three primary color image signals S5.

The MC correction unit 5 includes a motion vector conversion unit 10
The motion compensation vector MV3 performs motion-compensated motion image false contour interference suppression signal processing, and converts it into a display image signal S6. Then, an image is displayed on a display device section 6 such as a PDP or a micro mirror device.

The control unit 11 generates signals necessary for the operation of each unit and controls the signal processing operation.

FIG. 16 shows an example of the configuration of the motion vector detecting section 43. This is the configuration shown in FIG.
Frame generator 12, low-pass filter 13, delay unit 1
4, a reference vector conversion unit 44 is newly added to the block matching unit 15, the smoothing unit 16, the mini-block division search unit 17, and the reference vector generation unit 18. Then, the reference vector conversion unit 44 performs a process of generating a reference vector RVD that can be used for motion vector detection based on the motion vector information DMV.

FIG. 17 shows the outline of this operation. This is an example of MPEG video coding which is a typical motion compensation prediction coding. The image signal sequence is classified into three types of symbols I, P and B shown in FIG. In the frame indicated by the symbol I, DCT coding in the frame is performed. On the other hand, in the frame indicated by the symbol P, the symbols I, P
One-way motion compensated prediction coding is performed between the frames indicated by. That is, the difference component between the predicted frame generated in the P vector (3 frame period in the figure) and the signal of the current frame is encoded. In the frame indicated by the symbol B, the symbols I,
Bidirectional motion compensated prediction coding is performed between frames indicated by B and P. At this time, an example of a motion vector used for generating a predicted frame is shown as a B vector (one frame period in the figure). Therefore, a suitable conversion operation is performed on the motion vector information DMV in which the P vector and the B vector are mixed to generate a reference vector RVD. For example, when the motion vector MV is detected in two frame periods, the reference vector RVD is generated by a conversion operation for multiplying the P vector by 2/3 and a conversion operation for the B vector by 2 times.

Returning to FIG. 16, the block matching processing unit 15 sets a representative vector BTV using the newly obtained reference vector RVD. In the subsequent blocks, the same operation as that shown in FIG.
Is detected. As described above, according to the third embodiment of the present invention, a high-quality and low-cost image display device can be realized. In addition, a remarkable effect is obtained in improving the image quality of multimedia image display in the future.

Next, FIG. 18 shows a block configuration example of the fourth embodiment of the present invention. In the figure, MCIP unit 1, MCFRC
Unit 2, scaling unit 3, RGB conversion unit 4, MC correction unit 5, display device unit 6, motion vector conversion units 8, 9, 1
0, the control unit 11 performs the same configuration and operation as in the second embodiment. Further, the motion vector detection unit 45 is configured by adding the above-described reference vector conversion unit 44 to the configuration illustrated in FIG. Then, the motion vector is detected using the reference vector RVD generated by the conversion operation processing of the motion vector information DMV. The operation in this embodiment is as follows.
The description is omitted because it can be easily understood from the embodiments described above.

As described above, according to the fourth embodiment of the present invention, a high-quality and low-cost image display device can be realized. In addition, a remarkable effect is obtained in improving the image quality of multimedia image display in the future.

As described above, the color or gradation is displayed in a plurality of subfields by the signal processing circuit using the common motion vector in the image decoding unit, the scan conversion unit, the frame number conversion unit and the moving image false contour interference suppression unit. It has been described that a low-cost, high-quality image display device can be obtained by using a display device such as a PDP or a micromirror device, which poses a problem of false contouring of a moving image.

On the other hand, monthly FPD Intelligence 1998.11 p8
As described in p.2 to p.84, in a liquid crystal or PDP in which display light is held for one field, moving image blur occurs due to the influence of human visual characteristics.
It is known that it can be improved by driving at twice or more. Therefore, a hold type display such as a liquid crystal is driven at a higher frame frequency than the input signal by using a signal processing circuit that uses a common motion vector in the image decoding unit, the scan conversion unit, and the frame number conversion unit. It should be added that by doing so, the response speed can be improved.

Finally, an embodiment of an AV system apparatus to which the present invention is applied will be described with reference to the drawing of FIG.

The digital broadcast signal S30 is subjected to a predetermined decoding process in the digital AV decoding section 46, and the video signal VS
Decode 1 and audio signal AS1.

The analog broadcast signal S31 is subjected to a predetermined demodulation process in an analog AV demodulation section 47, and the video signal VS2
And the audio signal AS2.

The AV package decoding unit 48 decodes various package media and decodes the video signal VS3 and the audio signal AS3.

The switcher section 49 selects an input signal system by a control signal (not shown in the drawing) from the control section 54 and outputs a video signal VS and an audio signal AS.

The video signal VS is subjected to predetermined signal processing in the video quality enhancement section 50 having the configuration according to the embodiment of the present invention to generate a display image signal S40, and to display an image on a PDP, micromirror device, liquid crystal or the like. The image data is supplied to the device unit 51 to display a high-quality image.

[0125] The audio signal AS is input to the audio quality improving section 52, where it performs a predetermined signal processing for improving the audio quality to generate an audio reproduction signal S41. Then, the sound is supplied to the sound reproducing unit 53 to reproduce the high quality sound.

The control section 54 generates control signals necessary for the operation of each section.

According to the embodiment described above, it is possible to realize a low-cost AV system apparatus for reproducing high-quality images and sounds.

[0128]

According to the present invention, an image display apparatus for displaying a high-quality image on a display device such as a PDP, a micromirror device, and a liquid crystal can be realized at a low cost, and a high multimedia quality can be realized. A remarkable effect on image quality is obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an example of a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration example of a motion vector detection unit according to the first embodiment.

FIG. 3 is an operation schematic diagram of a motion vector detection unit in the first embodiment.

FIG. 4 is a schematic diagram of motion vector detection in the first embodiment.

FIG. 5 is a diagram illustrating a configuration example of an MCIP unit according to the first embodiment.

FIG. 6 is an operation schematic diagram of a motion vector conversion unit of the MCIP unit.

FIG. 7 is a diagram illustrating a configuration example of an MCFRC unit according to the first embodiment.

FIG. 8 is an operation schematic diagram of a parameter setting unit of the MCFRC unit.

FIG. 9 is a diagram illustrating a first configuration example of an MC correction unit according to the first embodiment.

FIG. 10 is an operation schematic diagram of a data driver processing unit of the MC correction unit.

FIG. 11 is a diagram illustrating a second configuration example of an MC correction unit according to the first embodiment.

FIG. 12 is an operation schematic diagram of an MC interpolation unit.

FIG. 13 is a diagram illustrating an example of a block configuration according to a second embodiment of the present invention.

FIG. 14 is a diagram illustrating a configuration example of a motion vector detection unit according to the second embodiment.

FIG. 15 is a diagram illustrating an example of a block configuration according to a third embodiment of the present invention.

FIG. 16 is a diagram illustrating a configuration example of a motion vector detection unit according to a third embodiment.

FIG. 17 is an operation schematic diagram of a reference vector conversion unit of the motion vector detection unit.

FIG. 18 is a diagram illustrating an example of a block configuration according to a fourth embodiment of the present invention.

FIG. 19 is a diagram showing an embodiment of an AV system to which the present invention is applied.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... MCIP part, 2 ... MCFRC part, 3 ... Scaling part, 4 ... RGB conversion part, 5 ... MC correction part, 6 ... Display device part, 7,42,43,45 ... Motion vector detection part, 8,
9,10: motion vector conversion unit, 11,54: control unit, 1
2 ... Frame generation unit, 13 ... Low-pass filter unit, 14,2
4 delay unit, 15 block matching processing unit, 16 ...
Smoothing unit, 17 miniblock division search unit, 18 reference vector generation unit, 19 still image interpolation unit, 20 moving image interpolation unit, 21 motion compensation interpolation unit, 22, 32 coefficient weighting unit,
23, 31, 33: adder, 25: double speed converter, 26, 3
5: Parameter setting unit, 27: Frame delay unit, 28: Temporal interpolation unit, 29, 30: Motion compensation interpolation unit, 34: Buffer unit, 36: Motion compensation pulse generation unit, 37, 41 ...
Data driver processing unit, 38 MC interpolation unit, 39 multiplexing unit, 40 motion compensation parameter setting unit, 44 reference vector conversion unit, 46 digital AV decoding unit, 47 analog AV demodulation unit, 48 AV A package decoding unit; 49, a switcher unit; 50, an image quality improvement unit; 51, an image display device unit; 52, an audio quality improvement unit;

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Yasutaka Tsuru 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Prefecture Inside the Multimedia Systems Development Division of Hitachi, Ltd. (72) Inventor Tomoo Kobori Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa 292, Hitachi, Ltd. Multimedia System Development Division (72) Inventor Mitsuo Nakajima 292, Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Prefecture F-term in Hitachi Multimedia System Development Division 5C058 AA11 AA18 BA01 BA07 BA33 BB03 BB15 BB16 BB17 BB25 5C080 AA05 AA09 AA10 BB05 CC03 DD01 EE19 EE29 FF12 JJ01 JJ02 JJ04 JJ07 5C082 BA34 BA35 BA41 BC07 BD02 CA22 CA85 CB01 DA51 MM10

Claims (10)

[Claims] An image display apparatus for displaying a color or a gradation of an image by combining a plurality of subfields is a frame for performing a signal processing for converting a frame frequency of an image signal into a frame frequency of a display device. A number-of-images conversion unit, an MC correction unit for performing signal processing for suppressing false contour interference of a moving image generated in the multiple subfield display system, and a motion vector detection unit for performing signal processing for detecting the direction and speed of image motion. Wherein the frame number conversion unit and the MC correction unit perform signal processing of motion compensation using a motion compensation vector generated by a conversion operation process of the motion vector detected by the motion vector detection unit. Image display device. 2. A scanning conversion section for performing signal processing for converting an interlaced scanning image signal into a progressive scanning image signal, wherein the scanning conversion section has a motion compensation common to a frame number conversion section and an MC correction section. The image display device according to claim 1, wherein signal processing for motion compensation using a vector is performed. 3. The motion vector detecting section converts a motion vector information generated in a process of decoding an image signal subjected to motion compensation prediction encoding to generate a reference vector, and uses the reference vector together. The image display device according to claim 1, wherein a motion vector is detected. 4. The motion vector detecting section detects a motion vector from a frame image signal generated by a process of synthesizing two consecutive fields of an interlaced scanning image signal. Item 3. The image display device according to Item 2. 5. The motion vector detecting section according to claim 2, wherein the motion vector detecting section detects a motion vector using a frame image signal generated by performing an inter-field interpolation process on an interlaced scanning image signal. Image display device. 6. The image display device according to claim 2, wherein said motion vector detecting section detects a motion vector based on a sequentially scanned image signal output from said scan converting section. 7. The MC correcting section performs signal processing for suppressing false contour interference of a moving image by a motion compensation equalizing pulse method for adding an equalizing pulse weighted according to the direction and speed of a motion. The image display device according to claim 1, wherein: 8. The MC correcting section performs signal processing for suppressing false contour interference of a moving image by a modified binary coded light emitting display method in which a coding method is switched according to a direction and a speed of a motion. The image display device according to claim 1. 9. An image display apparatus for improving a response speed of a display element by combining a plurality of subfields, wherein a signal processing for converting a frame frequency of an image signal into a frame frequency of a display device is performed. A number-of-frames conversion unit; and a motion vector detection unit that performs signal processing for detecting the direction and speed of the motion of the image. The frame number conversion unit converts the motion vector detected by the motion vector unit. Performs motion compensation signal processing using a motion compensation vector generated in the arithmetic processing. In the motion vector detection unit, the motion vector information generated in the process of decoding the motion compensated predictive coded image signal is converted, processed, and referred to. An image display device comprising: generating a vector; and detecting a motion vector by using the reference vector. 10. An AV system device, wherein an image is displayed on the image display device according to claim 1.