US7339629B2 - Method and system for time constant for a 3D comb filter - Google Patents
Method and system for time constant for a 3D comb filter Download PDFInfo
- Publication number
- US7339629B2 US7339629B2 US10/943,587 US94358704A US7339629B2 US 7339629 B2 US7339629 B2 US 7339629B2 US 94358704 A US94358704 A US 94358704A US 7339629 B2 US7339629 B2 US 7339629B2
- Authority
- US
- United States
- Prior art keywords
- value
- combing
- multiplier
- mesh
- accumulated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000002156 mixing Methods 0.000 claims description 47
- 239000000203 mixture Substances 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 6
- 210000001520 comb Anatomy 0.000 claims 2
- 241000023320 Luma <angiosperm> Species 0.000 description 66
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 65
- 239000002131 composite material Substances 0.000 description 33
- 238000010586 diagram Methods 0.000 description 32
- 230000002123 temporal effect Effects 0.000 description 25
- 230000002457 bidirectional effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000002596 correlated effect Effects 0.000 description 5
- 238000001914 filtration Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000000875 corresponding effect Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 102000001690 Factor VIII Human genes 0.000 description 1
- 108010054218 Factor VIII Proteins 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 238000011045 prefiltration Methods 0.000 description 1
- 238000011410 subtraction method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/77—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
- H04N9/78—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase for separating the brightness signal or the chrominance signal from the colour television signal, e.g. using comb filter
Definitions
- Certain embodiments of the invention relate to processing of video signals. More specifically, certain embodiments of the invention relate to a method and system for time constant for a 3D comb filter of a video signal.
- a composite video signal is the sum of a luminance (brightness) signal and a chrominance (color) signal. These signals may be referred to as luma and chroma signals, respectively.
- the frequency ranges of the luma and chroma signals are designed to overlap.
- the luma and chroma signal components are added together in order to generate a composite video signal.
- the luma and chroma video elements are integrated and broadcasted as a single composite video stream. Once the broadcasted composite signal is received, the luma and chroma signal components must be separated in order for the video signal to be processed and displayed.
- a comb filter may be utilized for separating the chroma and luma video signal components.
- a television may be adapted to receive a composite video input and utilize an integrated comb filter to separate the chroma and luma video signal components.
- the chroma and luma video components have to be separated.
- FIG. 1 is a diagram illustrating generation of a conventional composite video signal.
- a conventional composite video signal 105 may be generated from a luma component 103 and a chroma component 101 .
- the composite video signal 105 may be generated by adding the chroma video signal component 101 and the luma video signal component 103 .
- the chroma signal component 101 may be modulated at 3.58 megahertz and it may or may not comprise a constant chroma across the entire line.
- the luma signal component 103 may increase in amplitude in a stair step fashion or it may not.
- FIG. 2A is a diagram illustrating modulated chroma signals in contiguous composite video frames.
- the chroma component may be modulated so that a frequency of each successive line of video may be phase-shifted by 180 degrees with respect to the previous line.
- the previous frame 201 may comprise a previous line 203 , a current line 205 , and a next line 207 .
- the current frame 209 may comprise a previous line 211 , a current line 213 , and a next line 215 .
- the current line 213 in the current frame 209 may be phase-shifted by 180 degrees from the previous line 211 in the current frame 209 , as well as from the next line 215 in the current frame 209 .
- the current line 205 in the previous frame 201 may be phase-shifted by 180 degrees from the previous line 203 in the previous frame 201 , as well as from the next line 207 in the previous frame 201 .
- frames in the contiguous composite video signal are at a frequency rate of 59.94 Hz, there may be a 180-degree phase shift between two adjacent frames, for example, the current frame 209 and the previous frame 201 .
- the current line 213 in the current frame may be 180 degrees phase-shifted from the current line 205 in the previous frame 201 .
- the luma and chroma video components there are three ways to separate the luma and chroma video components and these include combing horizontally, combing vertically, and combing temporally.
- combing horizontally there are three bandwidth directions that may incur losses in the separation process and in the separated signal.
- the separated signal may have reduced vertical bandwidth, horizontal bandwidth, and/or temporal bandwidth.
- the first way to separate the luma and chroma-video components is by horizontal combing.
- Horizontal combing may be accomplished by utilizing a notch filter, for example. Since the chroma signal component in a composite video signal may be modulated at 3.58 MHz, a notch filter set at 3.58 MHz may be utilized.
- Combing vertically may also be utilized to separate the luma and chroma video components. Combing vertically may be achieved in three different ways—the current line may be combed with the previous and the next line, the current line may be combed with the line just before it, or the current line may be combed with the line just after it.
- the vertical combing is performed spatially, which involves combing only within one field at a time and without any temporal combing.
- the chroma content may cancel out and two times the luma content may be obtained.
- the previous line 211 is subtracted from the current line 213 , the luma content may cancel out and two times the chroma content may be obtained.
- vertical combing may result in a reduced vertical bandwidth.
- a third way to comb a composite signal is to comb temporally.
- Combing temporally comprises combing between two adjacent frames, for example, the current frame 209 and the previous frame 201 .
- temporal combing may be characterized by a reduced temporal bandwidth.
- Luma and chroma content may be separated by utilizing the same addition and subtraction method between a current line and a previous line as it was utilized with vertical combing.
- FIG. 2B is a diagram illustrating combing of a correlated current line 224 and a previous line 222 in a current frame 220 .
- the current line 224 may be added with the previous line 222 and two times luma may be obtained.
- the previous line 222 may be subtracted from the current line 224 so that two times chroma may be obtained.
- FIG. 2C is a diagram illustrating combing of a non-correlated current line 234 and a previous line 232 in a current frame 230 .
- the vertical bandwidth may be high enough so that there may be no correlation between the current line 234 and the previous line 232 .
- the current line 234 and the previous line 232 are combed together, there may be significant error in both the luma and chroma. This may produce combing artifacts in the obtained combed video signal.
- a substantially the same result may be obtained when combing temporally when there is temporal bandwidth, which indicates motion. Higher bandwidth in a given direction may cause combing in that direction to result in more incorrectly separated luma and chroma.
- a weight may be assigned to a 3D comb mesh value and combing may be blended according to the assigned weight of the 3D comb mesh value.
- the weighted 3D comb mesh value may be accumulated in order to generate an accumulated mesh value. If the accumulated mesh value exceeds a saturation value, the accumulated mesh value may be reduced to the saturation value. If the 3D comb mesh value is smaller than a first threshold value, the accumulated mesh value may be reset to zero.
- a multiplier may be generated according to the accumulated mesh value. If the accumulated mesh value is between a second threshold value and a third threshold value, the multiplier may be blended.
- Blending of the multiplier may be varied over a determined range between the second threshold value and the third threshold value. If the accumulated mesh value is at most equal to the second threshold value, the multiplier may be set to zero. If the accumulated mesh value is at least equal to the third threshold value, the multiplier may be set to one. Combing may be blended according to the blended multiplier and the 3D comb mesh value. If the multiplier is zero, 3D combing may be disabled. If the multiplier is one, the video signal may be 3D combed according to the 3D comb mesh value.
- Another aspect of the invention may provide a machine-readable storage, having stored thereon, a computer program having at least one code section executable by a machine, thereby causing the machine to perform the steps as described above for combing a video signal.
- the system for combing a video signal may include at least one processor that assigns a weight to a 3D comb mesh value and blends combing according to the assigned weight of the 3D comb mesh value.
- a first circuitry may accumulate the weighted 3D comb mesh value to generate accumulated mesh value. If the accumulated mesh value exceeds a saturation value, second circuitry may reduce the accumulated mesh value to the saturation value. If the 3D comb mesh value is smaller than a first threshold value, reset circuitry may reset the accumulated mesh value to zero.
- Third circuitry may generate a multiplier according to the accumulated mesh value. If the accumulated mesh value is between a second threshold value and a third threshold value, the third circuitry may blend the multiplier.
- the third circuitry may vary blending over a determined range between the second threshold value and the third threshold value. If the accumulated mesh value is at most equal to the second threshold value, the third circuitry may set the multiplier to zero. If the accumulated mesh value is at least equal to the third threshold value, the third circuitry may set the multiplier to one.
- the processor may blend combing according to the blended multiplier and the 3D comb mesh value. If the multiplier is zero, the processor may disable 3D combing. If the multiplier is one, the processor may 3D comb according to the 3D comb mesh value.
- the third circuitry may comprise an estimation circuitry.
- the second circuitry may comprise a saturation circuitry.
- the first circuitry may comprise an adder.
- FIG. 1 is a diagram illustrating generation of a conventional composite video signal.
- FIG. 2A is a diagram illustrating modulated chroma signals in contiguous composite video frames.
- FIG. 2B is a diagram illustrating combing of a correlated current line and a previous line in a current frame.
- FIG. 2C is a diagram illustrating combing of a non-correlated current line and a previous line in a current frame.
- FIG. 3A is a diagram illustrating 2D and 3D comb filtering, in accordance with an embodiment of the invention.
- FIG. 3B is a diagram of a blending decision factor related to blending to previous line versus blending to next line, in accordance with an embodiment of the invention.
- FIG. 3C is a diagram of a blending decision factor related to blending vertically versus blending horizontally, in accordance with an embodiment of the invention.
- FIG. 3D is a diagram of a blending decision factor related to enabling horizontal combing versus disabling horizontal combing, in accordance with an embodiment of the invention.
- FIG. 3E is a diagram of a blending decision factor related to horizontal combing, in accordance with an embodiment of the invention.
- FIG. 4A is a diagram of coarse luma determination, in accordance with an embodiment of the invention.
- FIG. 4B is a diagram of a 3D comb filter mesh mask, in accordance with an embodiment of the invention.
- FIG. 4C is a diagram of a 3D comb filter mesh mask, in accordance with an embodiment of the invention.
- FIG. 4D is a diagram of a 3D comb filter mesh, in accordance with an embodiment of the invention.
- FIG. 5 is a block diagram of a time constant calculation circuit, in accordance with an embodiment of the invention.
- FIG. 6 is a flow diagram of an exemplary method for 3D comb filter time constant determination, in accordance with an embodiment of the invention.
- FIG. 7 is a block diagram of an exemplary system that may be used in accordance with an embodiment of the invention.
- a 3D comb mesh value may be generated.
- the 3D comb value may indicate, for example, to what extent a composite video signal may be 3D and 2D combed.
- a 3D comb mesh value may be generated by a unidirectional or bidirectional 3D comb filter.
- a unidirectional comb filter is more fully described in U.S. patent application Ser. No. 10/943,267, filed Sep. 17, 2004, entitled “Method and System for 3D Comb Filtering of a Video Signal,” which is incorporated herein in its entirety.
- a bidirectional comb filter is more fully described in U.S. patent application Ser. No. 10/943,593, filed Sep. 17, 2004, entitled “Method and System for 3D Bidirectional Comb Filtering,” which is incorporated herein in its entirety.
- a weight may be assigned to the 3D comb mesh value and combing may be blended according to the assigned weight of the 3D comb mesh value.
- the weighted 3D comb mesh value may be accumulated in an accumulator. If the 3D comb mesh value is smaller than a determined first threshold, then the accumulator may be reset. Accumulated 3D comb mesh value from the accumulator may not be allowed to exceed a saturation value S. If the accumulated mesh value exceeds S, then the accumulated mesh value may be set to S.
- a multiplier may be generated according to the accumulated mesh value. If the accumulated mesh value is at most a second threshold, then the multiplier may be set to zero and 3D combing may be disabled.
- the multiplier may be set to one and 3D combing may be allowed in accordance with the 3D comb mesh value. If the accumulated mesh value is between the second and third threshold values, the multiplier may be blended. The 3D comb mesh value may then be blended in accordance with the blended multiplier.
- FIG. 3A is a diagram illustrating 2D and 3D comb filtering, in accordance with an embodiment of the invention.
- FIG. 3A there is illustrated a sample of pixels from three adjacent lines in a current frame 304 , a current line 307 , a previous line 305 , and a next line 309 , as well as a same (current) line 311 but in a previous frame 310 .
- the subcarrier phase 301 of the incoming composite video signal may be 3.58 MHz, and the incoming analog video signal may be digitized at 27 MHz, for example.
- the composite video signal may be run through a filter that interpolates pixel samples 303 at four times the frequency of the sub-carrier. For example, if the subcarrier frequency is at 3.58 MHz, the pixel samples 303 may be interpolated at 14.32 MHz.
- Pixels A, B and C may be true sample pixels. However, all the remaining pixels to the left and to the right of the true sample pixels A, B and C, such as pixels BL, Br, AL, AL 2 , AL 3 , AL 4 , Ar, Ar 2 , Ar 3 , Ar 4 , CL, and Cr, may be interpolated pixels.
- each pixel may be shifted by a quarter subcarrier cycle from the adjacent pixel.
- each line may be 180 degree phase-shifted from its adjacent line.
- pixel A and interpolated pixel AL 4 to the left of pixel A in the current line 307 , may be in phase with each other, whereas pixel A and interpolated pixel AL may be quarter cycle phase-shifted from each other.
- interpolated pixel Ar may be a quarter cycle phase-shifted to the right of pixel A, and interpolated pixel Ar 4 may be in phase with pixel A. Since the current line 307 may be 180 degrees phase-shifted from either the previous line 305 or the next line 309 , pixel A may also be phase-shifted 180 degrees from either pixel B in the previous line 305 or pixel C in the next line 309 .
- the amount of frequency content movement may be approximated between pixels within a given pixel line, between pixel lines within the same video frame, and between similar pixel lines in adjacent frames, and the corresponding combing method may be applied with a minimum bandwidth loss. For example, if vertical combing is applied with regard to pixel A, then pixel A may be subtracted from pixel B resulting in two times the luma, or pixel A may be subtracted from pixel C to obtain two times the luma, or pixel A may be subtracted from the average of B and C to obtain two times the luma.
- pixels in the current line 307 and the previous line 305 may be compared.
- interpolated pixel AL in the current line 307 may be compared with interpolated pixel Br in the previous line 305 , where interpolated pixel AL is in phase with interpolated pixel Br since there is 360 degree phase difference between them.
- interpolated pixel Ar may be compared with interpolated pixel BL, where interpolated pixel Ar is in phase with interpolated pixel BL since there is 360 degrees phase difference between them as well.
- a large frequency content between pixel A and pixel C may indicate that a vertical transition has happened immediately after the current line. Conversely, there may be a lot of frequency content between pixel B and pixel A, and no frequency content between pixel A and pixel C. This may be characterized by the fact that the current line and the next line are very similar, but the current line and the previous line are different. In this case, vertical combing may be performed between the current line and the next line.
- a final comparison may be performed between pixels A, B and C, in order to determine whether vertical combing may be applied with a minimum bandwidth loss. If pixels A, B and C are, for example, all in phase with each other, this may be indicative that there is no chroma component and pixels A, B and C contain only luma components, for example, if the video signal comprises a white character or a black background. In this case, since there is no frequency content between the current line 307 , the previous line 305 and the next line 309 , vertical combing may be applied without a significant loss in bandwidth.
- pixel A may be compared with interpolated pixels AL 4 and Ar 4 in the current line 307 , which are in phase with pixel A. This may provide an indication of the horizontal frequency content in the current line 307 . If pixel A is very different from either of interpolated pixels AL 4 or Ar 4 , it may indicate that there is significant frequency content in the current line 307 . If, on the other hand, the pixels are very similar, it may indicate that there is less frequency content and horizontal combing may be applied.
- a wide band pass filter may be utilized in order to horizontally filter a composite signal and eliminate the luma component that is not near the chroma subcarrier frequency, for example, a 3.58 MHz subcarrier frequency.
- 3D combing may also be implemented taking into consideration temporal signal comparison for purposes of applying temporal combing with a minimum temporal bandwidth loss.
- pixels in the same line/previous frame 311 may be considered.
- GA may be an actual pixel similar to pixel A, but it may be phase-shifted 180 degrees from pixel A in the previous frame.
- Pixel GA may be the same pixel as pixel A in the previous frame
- interpolated pixel GAL may be one quarter of a 3.58 MHz subcarrier frequency off to the left in the previous-frame
- interpolated pixel GAR may be one-quarter of a subcarrier cycle off to the right on the same line in the previous frame. Since pixels Ar and GAL are phase-shifted at 360 degrees and are in phase with each other, they may be compared for temporal frequency content.
- pixels AL and GAR may also be compared for temporal frequency content. If these two comparisons indicate that the pixels are similar, then this may indicate that pixel A is very similar to pixel GA and that there is no temporal frequency content movement from the previous frame. In this case, temporal combing may be performed since there will be no significant temporal bandwidth loss. If, on the other hand, the two comparisons show a large difference, then it may be indicative of a significant temporal frequency content between the current and the previous frame, and temporal combing, therefore, may not be desirable since it may involve temporal bandwidth loss.
- a comparison between pixel A and pixel GA may be useful in instance where there is a pixel that bears no color, for example, a black and/or a white pixel. Such pixels are characterized only by a luma component and, therefore, have no phase difference between each other. In this case, temporal combing may be applied without any resulting temporal bandwidth loss.
- a 3D comb filter in accordance with an embodiment of the present invention may be implemented by first horizontally combing a composite video signal.
- the horizontal combing may be accomplished by running the composite video signal through a very wide band pass filter, for example, so that it may pre-filter the very low frequency luma component within the composite video signal. In this way, if there is very coarse (VC), slow moving luma changes, such VC luma may be eliminated and not be considered in subsequent vertical and/or temporal combing processes.
- a subcarrier frequency of 3.58 MHz is utilized, chroma components may be centered around 3.58 MHz, or approximately between 2 and 5 MHz.
- any frequency content below 2 MHz may be considered a luma component and may be filtered out by the band pass filter.
- vertical combing and/or temporal combing may be utilized without significant bandwidth loss.
- horizontal and vertical combing, or 2D combing may be the only useful combing methods in one embodiment of the present invention.
- horizontal, vertical and temporal combing, or 3D combing may be applied without significant bandwidth loss.
- a final combing decision as to a specific composite signal may include a blend of 2D and 3D combing. In this case, a certain percentage of a pixel may be only vertically or horizontally combed, and the remaining percentage of the pixel may be combed vertically and temporally.
- FIG. 3B is a diagram 330 of a blending decision factor related to blending to previous line versus blending to next line, in accordance with an embodiment of the invention.
- a decision as to the quality of combing with the previous line versus combing with the next line may be accomplished by calculating a ratio k_blend of the previous line compares to the next line compares, for example.
- the k_blend ratio may be calculated using compares and constant multiplies so that it is a value between zero and one. This is a non-linear ratio between the comparison to the previous line and the comparison to the next line.
- a constant value in the k_blend calculation may be utilized to bias strongly against luma only comparisons.
- K_blend may be calculated as a function of next_max and prev_max.
- Next_max may be a measure of the bandwidth difference between a current line and a next line, for example.
- Prev_max may be a measure of the bandwidth difference between a current line and a previous line, for example.
- K_blend may be a function of the ratio of prev_max to next_max. The larger the ratio, the smaller the value of k_blend.
- the previous and next lines may be alpha blended together to comb with the current line.
- the blend tends toward the smaller of prev and next. The blend will skew toward next_line when next_max/prev_max is small, and skew toward prev_line when prev_max/next_max is small.
- a different blending decision factor may be determined.
- a notch filter may be utilized for horizontal combing.
- a notch filter may be compared to a vertical comb filter by calculating a ratio of the quality of the vertical comb using the previous line, to the quality of the horizontal comb.
- a different ratio my be related to the quality of the vertical comb using the next line, to the quality of the horizontal comb.
- FIG. 3C is a diagram 340 of a blending decision factor related to blending vertically versus blending horizontally, in accordance with an embodiment of the invention.
- a blending decision factor may be determined from a ratio notch_prev, where notch_prev may indicate whether to blend vertically and/or horizontally between a current line and a previous line.
- Notch_prev may be determined as a function of prev_line_max and next_pix_max.
- Prev_line_max may be a measure of the bandwidth difference between a current line and a previous line.
- Next_pix_max may be a measure of the bandwidth difference between two sets of in-phase pixels in a current line.
- a higher notch_prev ratio may indicate a preference towards notching versus vertical blending.
- a notch_next ratio may be determined in a similar way, where notch_next may indicate whether to blend vertically and/or horizontally between a current line and a next line.
- the top line may be given more weight in judging the relative goodness of notching. If the k_blend combing decision tends towards combing with the bottom line, the bottom line may be given more weight in judging the relative goodness of notching.
- a notch filter may be gradually disabled. This is because the notch filter tends to put most of the signal that is left, after an initial high pass filter, into chroma. If the combed signal is mostly luma, it may be inefficient to allow it to be put into chroma.
- FIG. 3D is a diagram 350 of a blending decision factor related to enabling horizontal combing versus disabling horizontal combing, in accordance with an embodiment of the invention.
- a disable notch signal dis_notch_prev may be generated by a ratio of the previous/next line compare with the previous/next line luma only compare. If the point is mostly luma, the luma only compare will be much smaller than the in phase compare.
- Dis_notch_prev may be determined as a ratio between prev_line_min and same_pix_max, for example.
- Prev_line_min may be associated with a bandwidth difference between in-phase pixels in a current and previous lines.
- Same_pix_max may be associated with a bandwidth difference between out-of-phase pixels in a current, previous and next line.
- a dis_notch_next may be determined as a ratio between next_line_min and same_pix_max, for example, where next_line_min may be associated with a bandwidth difference between in-phase pixels in a current and next lines.
- Dis_notch_next and dis_notch_prev therefore, may be determined by the ratio of the previous or next line luma and chroma compare to the previous or next line luma only compare.
- the disable notch parameter is not an accurate measure. In this case, the disable notch may not be used.
- a disable vertical notch, dis_vert_notch, parameter may be utilized.
- FIG. 3E is a diagram 360 of a blending decision factor related to horizontal combing, in accordance with an embodiment of the invention.
- a dis_vert_notch may be calculated as a ratio of notch_a_abs_filt and min_vert, for example.
- Notch_a_abs_filt may measure the absolute value of an amplitude of a signal on a current line.
- Min_vert may be associated with the minimum of bandwidth difference between current line and a previous line, and/or a current line and a next line.
- dis_vert_notch if dis_vert_notch is zero, then it has no effect. Dis_notch is allowed to mask or not mask notch. If dis_vert_notch is one, then dis_notch has no effect and dis_notch may be disabled. In this case notch is never masked, and the decision to notch or vertically comb is utilized without modification.
- points A and GA are 180 degrees out of phase with each other, in chroma, they may not be directly compared, except in the case where there is no chroma at this point.
- Points A, B, C and G are actual sampled points sampled at 27 MHz. All the other points may be interpolated to give 4FSC sample points.
- Points AL and AR may be one quarter of a subcarrier cycle away from point A.
- Points GAL and GAR may be one quarter of a subcarrier cycle away from point GA. Since points A and GA may be 180 degrees out of phase with each other, AL may be in phase with GAR and AR may be in phase with GAL. Since they are in phase they can be directly compared.
- points G may be compared directly with point A.
- the actual measure of the temporal bandwidth may be calculated by comparing the temporal bandwidth in the case With chroma and the case of luma only. The results may be low pass filtered.
- An estimate may be obtained of the quality of the 2D comb. This may be calculated based on the difference between the current pixel and the pixel that the 2D combing logic decided to comb with. First the vertical difference may be calculated according to the ratio of k_blend. Next this may be blended with the horizontal quality according to the ratio of notch. The qualities of the vertical blends, previous and next, may be weighted together to give an overall vertical quality measure. This vertical quality measure may then be weighted together with the horizontal quality, giving an overall quality measure of the 2D comb.
- FIG. 4A is a diagram 400 of coarse luma determination, in accordance with an embodiment of the invention.
- a coarse estimate of luma may be obtained for both the current frame and the previous frame as illustrated in FIG. 4A . This may be accomplished by subtracting the band passed signal from the composite signal. In this way, the part of luma that is clearly outside the chroma bandwidth range may be obtained.
- the coarse estimate of luma may be used to mask off the 3D combing decision. If the luma part of the composite signal does not match between the two frames, it may be determined that there is motion. This may be true even if the band passed part of the signal matches perfectly.
- FIG. 4B is a diagram 410 of a 3D comb filter mesh mask, in accordance with an embodiment of the invention.
- a mesh mask may be utilized in order to ascertain whether 3D combing may be utilized for a specific composite signal.
- the output of a wide band pass filter may be subtracted from an original composite signal input, and a low frequency luma component may be obtained, or a rough estimate of the low frequency luma.
- Such estimate of low frequency luma may be calculated for a current frame and for a previous frame, for example.
- the two resulting rough values of luma may then be compared on a pixel-by-pixel basis.
- 3D combing may be disabled by the mask, at 401 , and 2D combing be the only method that may be applied to separate luma and chroma components in the composite video signal. If the two rough luma values are very similar, then 3D combing may be allowed by the mesh mask, at 403 , and the composite video signal may be combed horizontally, vertically and temporally. For any value of the luma difference, which is between 401 and 403 , a blended mask 405 may be applied to separate the luma and chroma components of the composite video signal.
- the blended mask 405 may be applied in cases where the two rough luma values are not very different.
- a blended mask may indicate, for example, that a certain percentage of the 3D combing, for example 30%, may be “trusted” and the remaining percent, for example the remaining 70%, may be combed via 2D combing.
- the blended mask may re-adjust the ratio between 3D combing and 2D combing for a given pixel depending on how close the two rough luma values are to being very different and how close they are to being very similar.
- FIG. 4C is a diagram 420 of a 3D comb filter mesh mask, in accordance with an embodiment of the invention.
- Mesh_mask may be determined as a ratio between coarse_minus and coarse_plus, for example.
- Coarse_minus may be the difference between lumas of previous and current frames.
- Coarse_plus may be the sum of lumas of previous and current frames.
- Mesh_mask ratio may tend towards masking 3D combing if the luma between the two consecutive frames is very different. It may also tend towards allowing 3D combing if the luma between the two consecutive frames is very similar.
- FIG. 4D is a diagram 430 of a 3D comb filter mesh, in accordance with an embodiment of the invention.
- a mesh ratio may be determined as a measure of combing quality of 2D combing versus 3D combing.
- Mesh may be determined as a ratio between prev_field_max_filt — 3d and quality — 2d.
- Prev_field_max_filt — 3d may be a measure of bandwidth difference between a pixel in a current frame and the same pixel in a previous frame.
- Quality — 2d may be a measure of quality of 2D combing, as measured, for example, by various ratios as specified above in this application.
- mesh may tend towards the smaller of quality — 2d (error term of 2D comb) and prev_field_max_filt — 3d (error term of, 3D comb).
- prev_field_max_filt — 3d error term of 2D comb
- the larger prev_field_max_filt — 3d is (or the worse the quality of the 3D comb), the more mesh may tend to 2D comb.
- the larger quality — 2d (or the worse the quality of the 2D comb), the more mesh may tend to 3D comb.
- a final blend of 3D combing and 2D combing may be based on the product of the mesh and the mesh mask.
- the final mesh value may be used to alpha blend the chroma and luma between 2D and 3D combing.
- a time constant may be utilized to attenuate, or affirm, a 3D comb filter mesh value for a current frame based on 3D comb filter mesh values of preceding frames. For example, if the 3D comb filter mesh values of the preceding frames allow for 3D combing, then the time constant may be utilized to affirm the current 3D comb filter mesh value and allow for 3D combing in the current frame. Similarly, if the 3D comb filter mesh value of the preceding frames indicate that 2D combing, rather than 3D combing, may be utilized for minimum bandwidth loss, then the time constant may be utilized to attenuate the 3D comb filter mesh value thus indicating a higher likelihood for 2D combing in the current frame.
- a 3D mesh value may be generated by a unidirectional or bidirectional 3D comb filter, for example.
- FIG. 5 is a block diagram of a time constant calculation circuit, in accordance with an embodiment of the invention.
- the time constant calculation circuit 500 may comprise a mesh input block 501 , an accumulator 511 , a saturation circuit 515 , a reset circuit 512 , a multiplier circuit 519 , and a multiplier 523 .
- the mesh input block 501 may be adapted to provide a 3D comb filter mesh value received from a unidirectional or a bidirectional 3D comb filter, for example.
- Each received 3D mesh value may be compared to threshold values 503 .
- threshold values K 1 , K 2 , and K n may be utilized.
- the threshold values K 1 , K 2 , and K n may be associated with multipliers 505 , M 1 , M 2 , and M n , respectively, so that if a threshold value is satisfied, the corresponding threshold multiplier may be applied to the mesh value. After a multiplier is applied to a mesh value, the result may be stored in the accumulator 511 .
- the threshold value K off may be associated with an accumulator reset function. If a 3D comb mesh value generated by the mesh input block 501 is smaller than the threshold K off , the accumulator 511 may be reset by the reset circuit 512 .
- the saturation circuit 515 may be adapted to accumulate the received mesh values for each frame and saturate at a predetermined value S. For example, five subsequent 3D comb mesh values may indicate 3D combing and may saturate the saturation circuit 515 .
- a mesh enable value (mesh_enb) may be communicated to the mesh multiplier estimation block 519 .
- Mesh_enb may be equal to the weighted mesh value stored in the accumulator 511 .
- the multiplier circuit 519 may be adapted to calculate a mesh multiplier value based on the mesh enable value, where the mesh multiplier value may be between zero and one. For example, the multiplier circuit 519 may determine whether the mesh enable value is a value between a lower threshold T 1 and a higher threshold T 2 . The values of lower threshold T 1 and a higher threshold T 2 may be determined for different embodiments of the present invention and may be programmable. If mesh_enb is at most the threshold T 1 , then the multiplier circuit 519 may return a zero value for the mesh multiplier value. Similarly, if mesh_enb is higher than the threshold T 2 , then the multiplier circuit 519 may return a value of one for the mesh multiplier value.
- the multiplier circuit 519 may blend the mesh multiplier and may return a value between zero and one for the mesh multiplier value.
- the mesh multiplier value may then be communicated to the multiplier 523 , where the current 3D mesh value received from the mesh input block 501 and the mesh multiplier value are multiplied.
- the mesh multiplier value therefore, may be utilized as a 3D comb filter time constant as it attenuates, or affirms, a 3D comb filter mask for a current frame based on 3D comb filter mask values of preceding frames. In this way, if the mesh multiplier is zero, final 3D comb mesh value 525 will be zero and as a result 3D combing will be disabled. If the mesh multiplier is one, final 3D comb mesh value 525 will be equal to the initial 3D comb mesh value received from the mesh input block 501 . In this way, 3D combing will be performed in accordance with the original 3D comb mesh value.
- a mesh multiplier value or a time constant value, may be determined by utilizing the following exemplary code:
- FIG. 6 is a flow diagram of an exemplary method 600 for 3D comb filter time constant determination, in accordance with an embodiment of the present invention.
- a 3D comb mesh value CMV
- weight may be assigned to the CMV. For example, a plurality of multipliers may be utilized depending on the value of the CMV.
- the weighted CMV may be stored in an accumulator.
- At 611 it may be determined whether the accumulated CMV is greater than a saturation value S. If the CMV is greater than the saturation value S, then, at 613 , the accumulated CMV may be set to the saturation value S.
- a multiplier may be generated according-to the accumulated CMV.
- the multiplier may be set to zero and 3D combing may be disabled, at 621 .
- the multiplier may be blended over a determined range between the second and third threshold values.
- combing may be blended according to the blended multiplier and the 3D comb mesh value.
- FIG. 7 is a block diagram of an exemplary system that may be used in accordance with an embodiment of the invention.
- the system 700 may comprise a host 701 and a comb filter 703 .
- the host 701 may comprise a processor 705 and a host memory 707 .
- the host 701 may be communicatively coupled to the comb filter 703 via an interface bus 715 .
- the comb filter 703 may be a part of the host 701 .
- the comb filter 703 may comprise a unidirectional or a bidirectional comb filter, for example.
- the comb filter 703 may comprise suitable logic, circuitry and/or code and may be adapted to receive a video signal 709 , separate the chroma and luma components, and then output the chroma component 711 and the luma component 713 separately.
- the comb 703 may be adapted to generate a 3D comb mesh value.
- the 3D comb value may indicate, for example, to what extent a composite video signal may be 3D and 2D combed.
- the processor 705 may be adapted to assign a weight to a 3D comb mesh value and may blend combing according to the assigned weight of the 3D comb mesh value.
- a first accumulating circuitry may accumulate the weighted 3D comb mesh value to generate accumulated mesh value.
- second circuitry may reduce the accumulated mesh value to the saturation value. If the 3D comb mesh value is smaller than a first threshold value, a reset circuitry may reset the accumulated mesh value to zero.
- Third circuitry may generate a multiplier according to the accumulated mesh value. If the accumulated mesh value is between a second threshold value and a third threshold value, the third circuitry may blend the multiplier. The third circuitry may vary blending over a determined range between the second threshold value and the third threshold value. If the accumulated mesh value is at most equal to the second threshold value, the third circuitry may set the multiplier to zero. If the accumulated mesh value is at least equal to the third threshold value, the third circuitry may set the multiplier to one.
- the processor 705 may blend combing according to the blended multiplier and the 3D comb mesh value. If the multiplier is zero, the processor 705 may disable 3D combing. If the multiplier is one, the processor 705 may 3D comb according to the 3D comb mesh value.
- the third circuitry may comprise an estimation circuitry.
- the second circuitry may comprise a saturation circuitry.
- the first circuitry may comprise an adder.
- the present invention may be realized in hardware, software, or a combination of hardware and software.
- the present invention may be realized in a centralized fashion in at least one computer system, or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system or other apparatus adapted for carrying out the methods described herein is suited.
- a typical combination of hardware and software may be a general-purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein.
- the present invention may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which when loaded in a computer system is able to carry out these methods.
- Computer program in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code or notation; b) reproduction in a different material form.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Of Color Television Signals (AREA)
Abstract
Description
- U.S. application Ser. No. 10/943,267
- filed Sep. 17, 2004;
- U.S. application Ser. No. 10/943,587
- filed Sep. 17, 2004;
- U.S. application Ser. No. 10/943,593
- filed Sep. 17, 2004;
- U.S. application Ser. No. 10/943,596
- filed Sept. 17, 2004;
- U.S. application Ser. No. 10/869,395
- filed Jun. 16, 2004; and
- U.S. application Ser. No. 10/943,641
- filed Sep. 17, 2004.
notch=notch_next.*k_blend+notch_prev.*(1−k_blend)
dis_notch=max(dis_notch, dis_vert_notch)
notch=dis_notch^2*notch^3
mesh=mesh*mesh_mask
The final mesh value may be used to alpha blend the chroma and luma between 2D and 3D combing.
- The equation add_to_enb=(mesh>K1)*M1+(mesh>K2)*M2+(mesh>Kn)*Mn represents the assigning of weight to a 3D comb mesh value by utilizing the
multipliers 505, M1, M2, and Mn, if the 3D comb mesh value is greater than the threshold values K1, K2, and Kn, respectively. - The equation mesh_enb=(mesh_enb+add_to_enb)*(mesh>Koff) represents the accumulation of the weighted 3D comb mesh values and resetting of the accumulation if the 3D comb mesh value is smaller than the threshold value Koff.
- The equation mesh_enb=min(mesh_enb, 16) represents the saturation of mesh_enb that may be utilized in a saturation block, for example. A saturation value of S=16 is utilized in this example, but the invention is not limited in this way. In another aspect of the invention, other saturation values may be utilized.
- The equation mesh_mult=max(0, mesh_enb−8)/8 represents blending of a mesh multiplier, that may be utilized in a multiplier circuit, for example. Subtraction and dividing by a factor of 8 may be utilized to achieve the blending. The factor 8 is selected to correspond to the saturation value S=16, but the invention is not limited in this way. In another aspect of the invention, other subtraction and divide factors that correspond to the saturation value may be selected.
- The equation mesh=mesh*mesh_mult represents the final blending of the 3D comb mesh value utilizing the blended mesh multiplier value.
Claims (75)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/943,587 US7339629B2 (en) | 2004-01-30 | 2004-09-17 | Method and system for time constant for a 3D comb filter |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US54089004P | 2004-01-30 | 2004-01-30 | |
US10/943,587 US7339629B2 (en) | 2004-01-30 | 2004-09-17 | Method and system for time constant for a 3D comb filter |
Publications (2)
Publication Number | Publication Date |
---|---|
US20050168647A1 US20050168647A1 (en) | 2005-08-04 |
US7339629B2 true US7339629B2 (en) | 2008-03-04 |
Family
ID=34811420
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/943,587 Active 2026-03-01 US7339629B2 (en) | 2004-01-30 | 2004-09-17 | Method and system for time constant for a 3D comb filter |
Country Status (1)
Country | Link |
---|---|
US (1) | US7339629B2 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090013513A (en) * | 2007-08-02 | 2009-02-05 | 삼성전자주식회사 | Video processing method and video processing apparatus using the same |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5006927A (en) * | 1988-09-23 | 1991-04-09 | Sony Corporation | Apparatus and method for separating a component of a composite digital video signal |
US5990978A (en) * | 1996-03-23 | 1999-11-23 | Lg Electronics Inc. | Luminance/chrominance signal separating device |
US6674488B1 (en) * | 2000-02-08 | 2004-01-06 | Oki Electric Industry Co., Ltd. | Luminance and color difference signal separator for adaptively selecting color difference signals output from comb and line filters |
US6774954B1 (en) * | 2001-06-28 | 2004-08-10 | Ndsp Corporation | Apparatus and method for adaptive three dimensional television Y/C separation comb filter bank |
-
2004
- 2004-09-17 US US10/943,587 patent/US7339629B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5006927A (en) * | 1988-09-23 | 1991-04-09 | Sony Corporation | Apparatus and method for separating a component of a composite digital video signal |
US5990978A (en) * | 1996-03-23 | 1999-11-23 | Lg Electronics Inc. | Luminance/chrominance signal separating device |
US6674488B1 (en) * | 2000-02-08 | 2004-01-06 | Oki Electric Industry Co., Ltd. | Luminance and color difference signal separator for adaptively selecting color difference signals output from comb and line filters |
US6774954B1 (en) * | 2001-06-28 | 2004-08-10 | Ndsp Corporation | Apparatus and method for adaptive three dimensional television Y/C separation comb filter bank |
Also Published As
Publication number | Publication date |
---|---|
US20050168647A1 (en) | 2005-08-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7535515B2 (en) | Motion detection in video signals | |
US7397515B2 (en) | Method and system for cross-chrominance removal using motion detection | |
US8218083B2 (en) | Noise reducer, noise reducing method, and video signal display apparatus that distinguishes between motion and noise | |
CA1310401C (en) | Circuit for detecting motion of television signal | |
KR20060065478A (en) | Sub-carrier detection (scd) for motion threshold logic | |
US20070247554A1 (en) | Noise reduction apparatus of frame recursive type | |
JPH09224260A (en) | Y/c separator | |
US7453525B2 (en) | Motion detector for a video display system | |
US20110075042A1 (en) | Method and System for Advanced Motion Detection and Decision Mechanism for a Comb Filter in an Analog Video Decoder | |
US7573530B2 (en) | Method and system for video noise reduction based on moving content detection | |
US7391478B2 (en) | Method and system for 3D comb filtering of a video signal | |
JP2853298B2 (en) | Television signal processor | |
US7339630B2 (en) | Method and system for a correlation sharpening filter | |
US7339629B2 (en) | Method and system for time constant for a 3D comb filter | |
US7391479B2 (en) | Method and system for 3D bidirectional comb filtering | |
US5457501A (en) | Spectrum distribution adaptive luminance/color signal separating device | |
JPH0584112B2 (en) | ||
US20080055481A1 (en) | Method and System for Efficiently Increasing the Temporal Depth of a 3D Comb Filter | |
JP2617622B2 (en) | Motion adaptive color signal synthesis method and circuit | |
US7394502B2 (en) | Method and system for 2D comb filtering of a PAL video signal | |
LEE | CROSS-REFERENCE TO RELATED APPLICATIONS/INCORPORATION BY REFERENCE | |
US8026980B2 (en) | Method and system for improving video combing decisions | |
US8243202B2 (en) | Method and system for a generalized multi-dimensional filter device | |
JPH0338991A (en) | Luminance signal/chrominance signal separating circuit | |
US7688387B2 (en) | 2-D combing in a video decoder |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:JOHNSON, SHAWN V.;REEL/FRAME:015376/0042 Effective date: 20040915 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
SULP | Surcharge for late payment |
Year of fee payment: 7 |
|
AS | Assignment |
Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 |
|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041712/0001 Effective date: 20170119 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: MERGER;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:047195/0658 Effective date: 20180509 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF MERGER PREVIOUSLY RECORDED ON REEL 047195 FRAME 0658. ASSIGNOR(S) HEREBY CONFIRMS THE THE EFFECTIVE DATE IS 09/05/2018;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:047357/0302 Effective date: 20180905 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITE Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ERROR IN RECORDING THE MERGER PREVIOUSLY RECORDED AT REEL: 047357 FRAME: 0302. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:048674/0834 Effective date: 20180905 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |