CN100583960C - Video de-interlacing strategy decision method and system - Google Patents

Video de-interlacing strategy decision method and system Download PDF

Info

Publication number
CN100583960C
CN100583960C CN200610162581A CN200610162581A CN100583960C CN 100583960 C CN100583960 C CN 100583960C CN 200610162581 A CN200610162581 A CN 200610162581A CN 200610162581 A CN200610162581 A CN 200610162581A CN 100583960 C CN100583960 C CN 100583960C
Authority
CN
China
Prior art keywords
field
difference
video
block
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200610162581A
Other languages
Chinese (zh)
Other versions
CN101193225A (en
Inventor
陈翠琴
罗伟仁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Novatek Microelectronics Corp
Original Assignee
Novatek Microelectronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novatek Microelectronics Corp filed Critical Novatek Microelectronics Corp
Priority to CN200610162581A priority Critical patent/CN100583960C/en
Publication of CN101193225A publication Critical patent/CN101193225A/en
Application granted granted Critical
Publication of CN100583960C publication Critical patent/CN100583960C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Television Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A method and apparatus for determining video de-interlacing strategy, the method includes the following steps: correspondingly subtracting all pixels in the ith field and the (i + 2) th field to obtain a difference field; finding out a specific checking block according to the difference field; combining the ith field and the (i + 1) th field into a specific frame; and checking whether the specific check block in the specific frame has a comb phenomenon or not to determine a de-interlacing mode for pixels in the specific check block.

Description

视讯解交错策略决定方法与系统 Method and system for determining video deinterlacing strategy

技术领域 technical field

本发明涉及一种处理视讯的技术,特别是涉及一种视讯解交错策略决定方法与系统。The present invention relates to a video processing technology, in particular to a video deinterlacing strategy decision method and system.

背景技术 Background technique

视讯的解交错,传统上有三种方法,第一种是“单场插值法”(Bob),第二种是“场合并法”(Weave),第三种是“适应性动态解交错法”(MotionAdaptive)。单场插值法主要是将每一个场扩大为完整的一帧。场中扫描线间失去的列是用其上下行的数据内插演算来填充的,如图14所示,如欲对第一场1401或第三场1403进行解交错,可利用偶数列的数据内插出奇数列的数据;同样的,如欲对第二场1402或第四场1404进行解交错,可利用奇数列的数据内插出偶数列的数据。如果做得不好,图像看起来会有斑驳的马赛克。即使做得好,图像看起来也会偏柔,不可避免地损失了分辨率。场合并法则是利用相邻的偶场与奇场合成为一张完整的帧,在这种算法下,两个连续的场被合并为一帧,如图14所示,可结合第一场1401与第二场1402形成一完整帧,亦或结合第二场1402与第三场1403形成一完整帧。这通常只在两场之间移动量(motion)极少情况下才工作得比较好,例如两场是一个电影帧的情况。但如果场与场之间有移动(motion),合成的帧就会有梳形(Combing)现象。Traditionally, there are three methods for video de-interlacing, the first is "single-field interpolation" (Bob), the second is "field merging" (Weave), and the third is "adaptive dynamic de-interlacing" (Motion Adaptive). The single-field interpolation method mainly expands each field into a complete frame. The lost columns between the scanning lines in the field are filled by the data interpolation calculation of the upper and lower rows, as shown in Figure 14, if you want to de-interleave the first field 1401 or the third field 1403, you can use the data of the even-numbered columns The data of the odd columns is interpolated; similarly, if the second field 1402 or the fourth field 1404 is to be deinterleaved, the data of the odd columns can be used to interpolate the data of the even columns. If done poorly, the image will look mosaic. Even when done well, images can look soft, with an inevitable loss of resolution. The field merging method is to use the adjacent even field and odd field to form a complete frame. Under this algorithm, two consecutive fields are merged into one frame, as shown in Figure 14. The first field 1401 and The second field 1402 forms a complete frame, or combines the second field 1402 and the third field 1403 to form a complete frame. This usually only works well when there is very little motion between the two fields, such as when the two fields are one movie frame. However, if there is motion between fields, the synthesized frame will have combing phenomenon.

适应性动态解交错法则是综合单场插值法以及场合并法的一种综合体,截取双方的优点。此方法主要是要先对所接收的场以点为单位作动态检测,当检测出来此点为静态,该点就使用场合并法解交错,以得到最佳分辨率的结果。当检测出来此点为动态,该点就使用单场插值法解交错,以避免梳形(Combing)现象的发生。所以此种适应性动态解交错法所作出来解交错的画面的优劣,主要取决于动态检测的能力。The adaptive dynamic deinterleaving method is a combination of the single field interpolation method and the field combination method, which intercepts the advantages of both. This method is mainly to perform dynamic detection on the received field in units of dots. When the dot is detected to be static, the dot is deinterleaved using the field combining method to obtain the result of the best resolution. When it is detected that this point is dynamic, the single field interpolation method is used to de-interleave this point to avoid combing (Combing) phenomenon. Therefore, the quality of the deinterlaced picture made by this adaptive dynamic deinterlacing method mainly depends on the ability of dynamic detection.

动态检测,在现有技术中有两种做法,一种称之为帧动态(frame motion)检测法,另一种称之为场动态(field motion)检测法。图16A示出了现有帧动态检测法的示意图。请参考图16A,在此图16A中,有4个场F161~F164。帧动态检测法主要是以相同场(例如F162与F164)中,同位置像素1601与1602来判断是否为动态,当像素1601与1602的差异值大于某个默认值,则表示此像素1602为动态,因此像素1602必须与像素1603作单场插值法以得到像素1604。Motion detection, there are two methods in the prior art, one is called frame motion (frame motion) detection method, and the other is called field motion (field motion) detection method. FIG. 16A shows a schematic diagram of an existing frame motion detection method. Please refer to FIG. 16A, in this FIG. 16A, there are 4 fields F161-F164. The frame motion detection method mainly uses pixels 1601 and 1602 at the same position in the same field (for example, F162 and F164) to determine whether it is dynamic. , so pixel 1602 must be interpolated with pixel 1603 to obtain pixel 1604 by single-field interpolation.

图16B示出了现有场动态检测法的示意图。请参考图16B,在此图16B中,同样有4个场F161~F164。帧动态检测法主要是以相邻场(例如F161与F162)中,相邻位置像素1607来判断像素1605与1606是否为动态,当像素1607与1605、1606的差异值大于某个默认值,则表示F162中的像素1607与F161中的像素1605、1606为动态,若判断出为静态,则使用场合并法,也就是直接用像素1605,1606与像素1607作合并。Fig. 16B shows a schematic diagram of the existing field dynamic detection method. Please refer to FIG. 16B. In FIG. 16B, there are also four fields F161-F164. The frame motion detection method mainly judges whether the pixels 1605 and 1606 are dynamic based on adjacent pixels 1607 in adjacent fields (such as F161 and F162). Indicates that the pixel 1607 in F162 and the pixels 1605 and 1606 in F161 are dynamic. If it is judged to be static, use the field combining method, that is, directly combine pixels 1605, 1606 and pixel 1607.

由于上述现有的动态检测,常常会发生下述几种问题,造成解交错算法选择错误,而使得解交错画面不良。请参照图1,其示出了虚拟静态的示意图。其中101与103为奇场,102与104为偶场。在取样线105上可以看出103与101在遮阳棚上所取样的点都是白色,而在102与104所取样的点都是黑色。若用帧动态检测法(frame motion)比较相邻的奇场或相邻的偶场,例如将101与103作比较、102与104作比较,其比较出的结果将会是静态(still)。若因使用帧动态检测法造成上述误判为静态,导致图1的场101~104作场合并,则会产生如图2的202结果。在图2的结果202中,遮阳棚部分出现很严重的梳形现象。相对的,若采用

Figure C20061016258100051
场动态(field motion)检测法比较相邻不同奇偶的场,如将101与102作比较、102与103作比较,其比较出的结果将会是动态(motion)。导致图1于动态的单场插值法解出的帧如图2的201所示,遮阳棚部份并没有出现梳形现象。Due to the above-mentioned existing dynamic detection, the following problems often occur, resulting in wrong selection of de-interlacing algorithm, resulting in poor de-interlacing pictures. Please refer to FIG. 1 , which shows a schematic diagram of virtual static. Among them, 101 and 103 are odd fields, and 102 and 104 are even fields. On the sampling line 105, it can be seen that the points sampled by 103 and 101 on the awning are all white, while the points sampled by 102 and 104 are all black. If a frame motion detection method (frame motion) is used to compare adjacent odd fields or adjacent even fields, such as comparing 101 with 103, and comparing 102 with 104, the result of the comparison will be still. If the above-mentioned misjudgment is static due to the frame motion detection method, resulting in the combination of fields 101-104 in FIG. 1, the result of 202 in FIG. 2 will be produced. In the result 202 of FIG. 2 , a very serious comb phenomenon appears in the awning part. In contrast, if the
Figure C20061016258100051
The field motion detection method compares adjacent fields with different parities, such as comparing 101 with 102, 102 with 103, and the comparison result will be motion. As shown in 201 in FIG. 2, the frame solved by the dynamic single-field interpolation method in FIG. 1 shows no comb phenomenon in the sunshade part.

请参考图3,其示出了与图1不同的虚拟静态的示意图。其中301与303为奇场,302与304为偶场。在取样线305上可以看出303与301在「O」图示上所取样的点是白色,而在302与304在「O」图示所取样的点是黑色。303与301在「K」图示上所取样的点是黑色,而在302与304在「K」图示所取样的点是白色。若用场动态检测法(field motion)比较相邻不同奇偶的场,例如以301与302作比较、303与304作比较,其比较出的结果将会是动态(motion)。若因使用场动态检测法造成上述误判为动态导致图3的场301~304作“单场插值”,则会产生如图4的结果。在图4的结果401中,「OK」部分出现很严重的闪烁现象。Please refer to FIG. 3 , which shows a schematic diagram of a virtual static that is different from FIG. 1 . 301 and 303 are odd fields, and 302 and 304 are even fields. On the sampling line 305, it can be seen that the points sampled on the “O” diagram by 303 and 301 are white, while the points sampled on the “O” diagram by 302 and 304 are black. The points sampled on the "K" graph at 303 and 301 are black, while the points sampled at 302 and 304 on the "K" graph are white. If a field motion detection method (field motion) is used to compare adjacent fields with different parities, for example, 301 is compared with 302, and 303 is compared with 304, the result of the comparison will be motion. If the field 301-304 in FIG. 3 is "single-field interpolated" due to the above misjudgment as dynamic due to the use of the field dynamic detection method, the result as shown in FIG. 4 will be produced. In the result 401 of FIG. 4 , the "OK" part appears to flicker very seriously.

若以现有帧动态检测法(frame motion),仅判断相邻且相同的场以判定帧的动态与否时,在输入场为图3的301~304的情况下会得到如图4中的402结果(不会闪烁),然而在输入场为在图1的101~104情况下,则会出现如图2中的202的结果(严重的梳型)。若以现有场动态检测法(field motion),仅判断相邻且不同的场以判定帧的动态与否时,在输入场为图1的101~104情况下会出现如图2的201结果(没有梳型产生),然而在输入场为图3的301~304情况下会出现图4中401结果(画面严重闪烁)。If the existing frame motion detection method (frame motion) only judges adjacent and identical fields to determine whether the frame is dynamic or not, when the input fields are 301-304 in Fig. 3, it will be as shown in Fig. 4 The result of 402 (no flickering), but when the input field is 101-104 in Figure 1, the result of 202 in Figure 2 (severe comb) will appear. If the existing field motion detection method (field motion) only judges adjacent and different fields to determine whether the frame is dynamic or not, the result of 201 as shown in Figure 2 will appear when the input field is 101-104 in Figure 1 (There is no comb generation), but when the input field is 301-304 in Figure 3, the result of 401 in Figure 4 will appear (severe flickering of the screen).

现有的技术都只能处理上述图1或图3其中之一的情形,不能同时将两种情形做正确的处理。然而,图1的情形应当要判断为动态,图3的情形应当要判断为静态,才能都得到最佳结果。Existing technologies can only handle one of the above-mentioned situations in FIG. 1 or FIG. 3 , and cannot handle both situations correctly at the same time. However, the situation in Figure 1 should be judged as dynamic, and the situation in Figure 3 should be judged as static, in order to obtain the best results.

发明内容 Contents of the invention

本发明的目的就是在提供一种视讯解交错策略决定方法,用以正确的判定视讯的解交错策略,以增进视讯解交错后的画质。The purpose of the present invention is to provide a method for determining a video deinterlacing strategy, which is used to correctly determine the video deinterlacing strategy, so as to improve the image quality of the video after deinterlacing.

本发明的再一目的是提供一种视讯解交错策略决定系统,避免现有技术所发生的解交错策略错误,改善影像画质。Yet another object of the present invention is to provide a system for determining a video deinterlacing strategy, which avoids errors in deinterlacing strategies in the prior art and improves image quality.

本发明提出一种视讯解交错策略决定方法,此方法包括下列步骤:将第i场与第i+2场中所有像素对应相减得到一差异场;根据此差异场,找出一特定检查区块;合并第i场与第i+1场为一特定帧;并且检查此特定帧中的特定检查区块的梳形现象,以决定对特定检查区块内的像素的解交错方式,其中i为自然数。The present invention proposes a method for determining a video deinterlacing strategy. The method includes the following steps: subtracting all pixels in the i-th field and the i+2-th field correspondingly to obtain a difference field; finding a specific inspection area according to the difference field block; merge the i-th field and the i+1-th field into a specific frame; and check the comb phenomenon of the specific inspection block in the specific frame to determine the de-interlacing method for the pixels in the specific inspection block, where i is a natural number.

依照本发明的较佳实施例所述的视讯解交错策略决定方法,上述「根据该差异场,找出一特定检查区块」的步骤包括:从上述差异场中,将像素差异大于一默认值像素所围成的区块作为特定检查区块。在另一实施例中,「根据该差异场,找出一特定检查区块」的步骤包括:从上述差异场中,将像素差异大于一默认值像素所围成的一第一区块加上一延伸范围,作为特定检查区块。According to the video de-interlacing strategy determination method described in the preferred embodiment of the present invention, the above-mentioned step of "finding a specific inspection block according to the difference field" includes: from the above-mentioned difference field, set the pixel difference greater than a default value The block surrounded by pixels is used as a specific inspection block. In another embodiment, the step of "finding a specific inspection block according to the difference field" includes: adding a first block surrounded by pixels with pixel differences larger than a default value from the above difference field to An extended range, as a specific inspection block.

依照本发明的较佳实施例所述的视讯解交错策略决定方法,上述「检查此特定帧中的特定检查区块的梳形现象,以决定特定检查区块内的像素的解交错方式」的步骤包括:当特定帧中的特定检查区块内的像素无梳形现象时,决定该像素用场合并解交错。在另一实施例中,上述「检查此特定帧中的特定检查区块的梳形现象,以决定对特定检查区块内的像素的解交错方式」的步骤包括:当特定帧中的特定检查区块内的像素有梳形现象时,决定该像素用单场插值解交错。According to the video de-interlacing strategy determination method described in the preferred embodiment of the present invention, the above-mentioned "check the comb phenomenon of the specific inspection block in this specific frame to determine the de-interlacing method of the pixels in the specific inspection block" The steps include: when there is no comb phenomenon in the pixel in the specific inspection block in the specific frame, determine the application of the pixel and de-interlace. In another embodiment, the above-mentioned step of "checking the comb phenomenon of the specific inspection block in the specific frame to determine the de-interlacing method for the pixels in the specific inspection block" includes: when the specific inspection block in the specific frame When a pixel in the block has a comb phenomenon, it is determined that the pixel is de-interlaced by single-field interpolation.

依照本发明的较佳实施例所述的视讯解交错策略决定方法,上述第i场与第i+1场为不同型态的场,且第i场与第i+2场为相同型态的场。According to the video deinterlacing strategy determination method described in a preferred embodiment of the present invention, the above-mentioned i-th field and the i+1-th field are fields of different types, and the i-th field and the i+2-th field are of the same type field.

本发明提出一种视讯解交错策略决定系统,此系统包括:像素差异单元、检查区块定义单元、梳形检测单元以及解交错格式决定单元。像素差异单元接收第i场与第i+2场,将第i场与第i+2场中所有像素对应相减得到一差异场。检查区块定义单元接收并根据该差异场,找出一特定检查区块。梳形检测单元接收第i场与第i+1场,用以合并第i场与第i+1场为一特定帧。一解交错格式决定单元,检查特定帧中的特定检查区块内的像素的梳形现象,以决定对该特定检查区块内的像素的解交错方式,其中i为自然数。The present invention proposes a system for determining a video deinterlacing strategy, which includes: a pixel difference unit, a check block definition unit, a comb detection unit and a deinterlacing format determination unit. The pixel difference unit receives the i-th field and the i+2-th field, and subtracts all the pixels in the i-th field and the i+2-th field correspondingly to obtain a difference field. The inspection block definition unit receives and finds out a specific inspection block according to the difference field. The comb detection unit receives the i-th field and the i+1-th field for merging the i-th field and the i+1-th field into a specific frame. A de-interlacing format determination unit checks the comb phenomenon of pixels in a specific inspection block in a specific frame to determine a de-interlacing method for the pixels in the specific inspection block, where i is a natural number.

依照本发明的较佳实施例所述的视讯解交错策略决定系统,上述检查区块定义单元还用以从差异场中,将像素差异大于一默认值像素所围成的区块作为特定检查区块。在另一实施例中,检查区块定义单元还用以从差异场中,将像素差异大于一默认值像素所围成的一第一区块加上一延伸范围,作为特定检查区块。According to the video deinterlacing strategy decision system described in the preferred embodiment of the present invention, the inspection block definition unit is also used to use the block surrounded by pixels with pixel differences greater than a default value as a specific inspection area from the difference field piece. In another embodiment, the inspection block definition unit is further configured to add an extension range to a first block surrounded by pixels with pixel differences larger than a default value from the difference field as the specific inspection block.

依照本发明的较佳实施例所述的视讯解交错策略决定系统,当上述特定帧中的特定检查区块内的像素无梳形现象时,解交错格式决定单元决定该像素用场合并解交错。当上述特定帧中的特定检查区块内的像素有梳形现象时,解交错格式决定单元决定该像素用单场插值解交错。According to the video de-interlacing strategy determination system described in the preferred embodiment of the present invention, when the pixel in the specific inspection block in the specific frame has no comb phenomenon, the de-interlacing format determining unit determines the use of the pixel and de-interleaves. When the pixel in the specific inspection block in the specific frame has a comb phenomenon, the de-interlacing format determining unit determines that the pixel is de-interlaced by single-field interpolation.

依照本发明的较佳实施例所述的视讯解交错策略决定系统,上述第i场与第i+1场为不同型态的场,且第i场与第i+2场为相同型态的场。According to the video deinterlacing strategy determination system described in the preferred embodiment of the present invention, the i-th field and the i+1th field are of different types, and the i-th field and the i+2th field are of the same type field.

本发明因采用根据差异场,找出特定检查区块,并利用检查相邻场所合成的帧中的特定检查区块内的像素的梳形现象,以决定对场该像素的解交错方式,因此除了能保证正确的判定视讯的解交错策略之外,更可避免现有技术所发生的解交错策略错误,以增进视讯解交错后的画质。The present invention finds out a specific inspection block according to the difference field, and uses the comb phenomenon of pixels in the specific inspection block in the frame synthesized by inspecting adjacent fields to determine the de-interlacing method for the pixel in the field. In addition to ensuring the correct determination of the video de-interlacing strategy, errors in the de-interlacing strategy in the prior art can be avoided, so as to improve the image quality of the video after de-interlacing.

为让本发明的上述和其它目的、特征和优点能更明显易懂,下文特举较佳实施例,并结合附图详细说明如下。In order to make the above and other objects, features and advantages of the present invention more comprehensible, preferred embodiments are specifically cited below and described in detail with reference to the accompanying drawings.

附图说明 Description of drawings

图1示出了现有虚拟静态的示意图。Fig. 1 shows a schematic diagram of an existing virtual static.

图2示出了图1的场用不同的视讯解交错算法所产生的不同结果。FIG. 2 shows different results of the field of FIG. 1 with different video deinterlacing algorithms.

图3示出了另一现有虚拟静态的示意图。Fig. 3 shows a schematic diagram of another existing virtual static.

图4示出了图3的场用不同的视讯解交错算法所产生的不同结果。FIG. 4 shows different results of the field of FIG. 3 with different video deinterlacing algorithms.

图5示出了本发明实施例的视讯解交错策略决定系统的系统方块图。FIG. 5 shows a system block diagram of a system for determining a video deinterlacing strategy according to an embodiment of the present invention.

图6示出了本发明实施例的视讯解交错策略决定方法流程图。FIG. 6 shows a flowchart of a method for determining a video deinterlacing strategy according to an embodiment of the present invention.

图7示出了本发明实施例以场101与场103所构成的差异场。FIG. 7 shows the difference field formed by field 101 and field 103 according to the embodiment of the present invention.

图8A与图8B示出了上述特定检查区决定义方式的示意图。FIG. 8A and FIG. 8B are schematic diagrams showing the manner of defining the above-mentioned specific inspection area.

图9示出了检查区块定义单元502在图7中定义出的特定检查区块图。FIG. 9 shows the specific inspection block diagram defined by the inspection block definition unit 502 in FIG. 7 .

图10示出了本发明实施例以场101与102合并为一特定帧并检测像素梳形现象是否存在的结果。FIG. 10 shows the result of merging the fields 101 and 102 into a specific frame and detecting whether the pixel comb phenomenon exists according to the embodiment of the present invention.

图11示出了本发明实施例以场301与场303所构成的差异场。FIG. 11 shows the difference field formed by field 301 and field 303 according to the embodiment of the present invention.

图12示出了检查区块定义单元502在图11中定义出的检查区块图。FIG. 12 shows the inspection block diagram defined by the inspection block definition unit 502 in FIG. 11 .

图13示出了本发明实施例以场301与302合并为一特定帧并检测像素梳形现象是否存在的结果。FIG. 13 shows the result of merging the fields 301 and 302 into a specific frame and detecting whether the pixel comb phenomenon exists according to the embodiment of the present invention.

图14示出了现有偶场与奇场的示意图。Fig. 14 shows a schematic diagram of an existing even field and an odd field.

图15示出了现有梳型(combing)的示意图。Fig. 15 shows a schematic diagram of a conventional combing.

图16A示出了现有帧动态检测法的示意图。FIG. 16A shows a schematic diagram of an existing frame motion detection method.

图16B示出了现有场动态检测法的示意图。Fig. 16B shows a schematic diagram of the existing field dynamic detection method.

附图符号说明Description of reference symbols

101、103、301、303、1402、1404:奇场101, 103, 301, 303, 1402, 1404: odd field

102、104、302、304、1401、1403:偶场102, 104, 302, 304, 1401, 1403: even field

105、305:取样线105, 305: sampling line

201:用图1的场作单场插值的结果201: The result of single-field interpolation using the field in Figure 1

202:用图1的场作场合并的结果202: Combined results using the scenarios in Figure 1

401:用图3的场作单场插值的结果401: The result of single-field interpolation using the field in Figure 3

402:用图3的场作场合并的结果402: The result of merging with the scene in Figure 3

501:像素差异单元501: Pixel difference unit

502:检查区块定义单元502: Check block definition unit

503:梳形检测单元503: Comb detection unit

504:解交错格式决定单元504: deinterleaving format determination unit

601~604:本发明实施例的步骤601-604: steps in the embodiment of the present invention

80:阈值80: Threshold

801、802:扫描线的数据801, 802: data of scan lines

81:较高阈值81: Higher Threshold

82:较低阈值82: lower threshold

803:扫描线的数据802超越较高阈值81之前所接收的数据803: Scanline data 802 received data before exceeding the upper threshold 81

804:扫描线的数据802超越较高阈值81之后所接收的数据804: data received after scanline data 802 crosses upper threshold 81

901:遮阳棚的部分901: Part of the awning

1001:遮阳棚区块1001: Sunshade block

1301:「OK」区块1301: "OK" block

P151~P156、1601~1609:像素P151~P156, 1601~1609: pixels

F161~F164:场F161~F164: field

具体实施方式 Detailed ways

在先前技术中的两种动态检测法,分别只能对上述图1或图3其中之一的情况,作正确的处理。本发明提出一种方法与装置,分别可以正确的处理上述两种情况。以下便以实施例文字配合图标以说明本发明。The two dynamic detection methods in the prior art can only correctly handle one of the situations in FIG. 1 or FIG. 3 . The present invention proposes a method and a device that can correctly handle the above two situations respectively. In the following, the present invention will be described with examples of words and figures.

图5示出了本发明实施例的视讯解交错策略决定系统的系统方块图。请参考图5,此系统包括像素差异单元501、检查区块定义单元502、梳形检测单元503以及解交错格式决定单元504。图6示出了本发明实施例的视讯解交错策略决定方法流程图。以下用图6的流程图、图5的系统图以便说明本发明的实施例。FIG. 5 shows a system block diagram of a system for determining a video deinterlacing strategy according to an embodiment of the present invention. Please refer to FIG. 5 , the system includes a pixel difference unit 501 , an inspection block definition unit 502 , a comb detection unit 503 and a deinterleaving format determination unit 504 . FIG. 6 shows a flowchart of a method for determining a video deinterlacing strategy according to an embodiment of the present invention. The following uses the flowchart of FIG. 6 and the system diagram of FIG. 5 to illustrate the embodiment of the present invention.

首先,先假设本实施例的视讯解交错策略决定系统所接收的场为现有图1的四个场101~104。像素差异单元501便开始对相邻的奇场(或相邻的偶场)101、103作相减的动作,把奇场101与103中的每个像素对应相减,得到一差异场,如图7(步骤601)。图7中,较黑色的部分表示像素值的差异较大。较淡色的部分表示像素值的差异较小。像素值差异较大,相对的就表示物体的动态(motion)较严重。像素值差异较小,相对的就表示物体的动态较轻微。由图7可以看出,遮阳棚的部分动态较少。First, it is assumed that the fields received by the system for determining the video deinterlacing strategy in this embodiment are the four fields 101 - 104 shown in FIG. 1 . The pixel difference unit 501 starts to subtract the adjacent odd fields (or adjacent even fields) 101, 103, subtract each pixel in the odd fields 101 and 103 correspondingly, and obtain a difference field, as Fig. 7 (step 601). In Fig. 7, the darker parts represent larger differences in pixel values. Lighter shades indicate less variance in pixel values. Larger differences in pixel values indicate that the motion of the object is relatively serious. The smaller the difference in pixel values, the relatively slight dynamics of the object. It can be seen from Figure 7 that some parts of the awning are less dynamic.

接下来,检查区块定义单元502接收如图7的差异场,并且根据此差异场找出一特定检查区块(步骤602)。在此,先假设检查区块定义单元502所接收的差异场是以串行(Serial)数据的方式传输,也就是把差异场分成多条扫描线,并且把每一条扫描线的数据用串行的方式传送给检查区块定义单元502。在此,以图8A与图8B解释如何定义出特定检查区块的方式。Next, the inspection block definition unit 502 receives the difference field as shown in FIG. 7 , and finds a specific inspection block according to the difference field (step 602 ). Here, it is assumed that the difference field received by the inspection block definition unit 502 is transmitted in the form of serial (Serial) data, that is, the difference field is divided into multiple scanning lines, and the data of each scanning line is transmitted in a serial format. sent to the inspection block definition unit 502 in a manner. Here, how to define a specific inspection block is explained with FIG. 8A and FIG. 8B .

首先,在说明检查区块的定义方法之前,先定义图8A以及图8B的纵轴表示为检查区块定义单元502所接收的串行数据的大小。再定义图8A以及图8B的横轴为时间。因此,图8A以及图8B的扫描线的数据801、802,若以图7作为例子来说,指的就是从图7的其中一条扫描线的第一个像素的像素值到最后一个像素的像素值依照时间排成一串的示意图。First, before explaining the method of defining the inspection block, it is defined that the vertical axis in FIG. 8A and FIG. 8B represents the size of the serial data received by the inspection block definition unit 502 . Redefine the horizontal axis of FIG. 8A and FIG. 8B as time. Therefore, the data 801 and 802 of the scanning lines in FIG. 8A and FIG. 8B, if taking FIG. 7 as an example, refers to the pixel value from the first pixel to the last pixel of one of the scanning lines in FIG. 7 A schematic diagram of the values arranged in a row according to time.

第一种检查区块的定义方式请参考图8A,在图8A上有定义一阈值80。当所接收的扫描线的数据801在T1时间超过阈值,则将超过阈值的部分,连同左右固定延伸的范围,都定义在特定检查区块中。第二种方式请参考图8B,在图8B定义了较高阈值81以及较低阈值82。当所接收的扫描线的数据802在T2时间大于较高阈值81时,便把T2之前(T2~T0)固定延伸的这段期间所接收的数据803定义在特定检查区块中,并且T2之后所接收的数据802也定义在特定检查区块中,直到所接收的数据802低于较低阈值82(T3时间)。Please refer to FIG. 8A for the first method of defining the inspection block. A threshold 80 is defined in FIG. 8A . When the received scan line data 801 exceeds the threshold at time T1 , the portion exceeding the threshold, together with the range extending left and right, are defined in a specific inspection block. For the second way, please refer to FIG. 8B . In FIG. 8B , a higher threshold 81 and a lower threshold 82 are defined. When the received data 802 of the scanning line is greater than the upper threshold 81 at the time T2, the data 803 received during the period of fixed extension before T2 (T2-T0) is defined in a specific inspection block, and the data after T2 Received data 802 is also defined in a particular check block until the received data 802 falls below the lower threshold 82 (time T3).

请参考图9,图9示出了检查区块定义单元502利用步骤602的方式所定义出的特定检查区块图,其中灰色的区块即为上述的特定检查区块。在此可以看出,遮阳棚的部分901完全被定义在特定检查区块中。Please refer to FIG. 9 , which shows a specific inspection block diagram defined by the inspection block definition unit 502 in step 602 , wherein the gray blocks are the above-mentioned specific inspection blocks. Here it can be seen that the part 901 of the awning is completely defined in the particular inspection block.

下一步骤,合并场101与102为一特定帧(步骤603)。相对于图5实施例,梳形检测单元503接收场101与102,将其合并成一帧。合并后梳形现象的检测结果可以参考图10(黑色部份表示有梳形现象存在)。请注意,图10的遮阳棚区块可以看到,两个连续场合并后,此遮阳棚区块会产生严重梳形(combing)的现象。In the next step, fields 101 and 102 are merged into a specific frame (step 603). Compared with the embodiment in FIG. 5 , the comb detection unit 503 receives the fields 101 and 102 and combines them into one frame. The detection results of the combined comb phenomenon can refer to Figure 10 (the black part indicates the existence of the comb phenomenon). Please note that it can be seen from the awning block in Fig. 10 that after two consecutive fields are merged, the awning block will have a severe combing phenomenon.

最后的步骤,在如图10所示的帧梳形现象检查结果输出,并配合之前所定义的特定检查区块,以决定对场的解交错方式(步骤604)。在图5的实施例中,解交错格式决定单元504接收上述梳形检测单元503所输出的特定帧梳形现象检查结果,并且以检查区块定义单元502去检查此特定帧的梳形现象。尽管由像素差异单元501判断上述连续场101~104中的检查区块内的像素为静态,然而,经过本实施例再次判断检查区块中的像素,便可以决定检查区块内可能发生梳型的像素作单场插值(BOB)的解交错处理,检查区块内不会发生梳型的像素则跟据501的差异场所得的像素差值做motionadaptive的解交错处理,检查区块外的像素亦同。The final step is to output the inspection result of the frame comb phenomenon as shown in FIG. 10 , and cooperate with the previously defined specific inspection block to determine the de-interlacing method for the field (step 604 ). In the embodiment shown in FIG. 5 , the deinterleaving format determining unit 504 receives the inspection result of the comb phenomenon of the specific frame output by the comb detection unit 503 , and uses the inspection block definition unit 502 to check the comb phenomenon of the specific frame. Although the pixel difference unit 501 judges that the pixels in the inspection blocks in the above-mentioned continuous fields 101-104 are static, however, after this embodiment judges the pixels in the inspection blocks again, it can be determined that the comb-shaped pixels in the inspection blocks may occur. The pixels of the single-field interpolation (BOB) are de-interlaced, and the pixels that do not have combs in the inspection block are de-interlaced with motionadaptive based on the pixel difference obtained from the 501 difference field, and the pixels outside the block are checked. Same.

请注意,虽然上述实施例的步骤603仅提出合并场101与102的方式,本领域的技术人员参考本实施例之后应当知道,梳形检测单元503除了如上述实施例合并场101与102之外,仍可以预先作梳型检测,其检测的方式例如检测合并场101与102后的帧的每三个垂直相邻像素是否符合图15的两种情况,第一种情况是如像素P151、P152、P153一般的亮暗亮的情况,第二种情况则是如像素P154、P155、P156一般的暗亮暗的情况。在梳型检测单元503预先检测好之后,在把检测结果送到解交错格式决定单元504。之后,解交错格式决定单元504再根据所定义的特定检查区块,以判断上述在特定检查区块中的像素应作如何的解交错处理。Please note that although step 603 of the above-mentioned embodiment only proposes the way of combining fields 101 and 102, those skilled in the art should know after referring to this embodiment that the comb detection unit 503, in addition to combining fields 101 and 102 in the above-mentioned embodiment , comb-type detection can still be done in advance, the way of detection is, for example, to detect whether every three vertically adjacent pixels of the frame after merging fields 101 and 102 conform to the two situations in Figure 15, the first situation is that pixels P151, P152 , P153 are generally bright and dark, and the second case is the general dark and bright conditions of pixels P154, P155, and P156. After the comb detection unit 503 pre-detects, the detection result is sent to the deinterleaving format determination unit 504 . Afterwards, the de-interleaving format determining unit 504 judges how de-interleave processing should be performed on the above-mentioned pixels in the specific inspection block according to the defined specific inspection block.

另外,虽然此实施例的步骤603在步骤602之后,本领域的技术人员参考本实施例之后应当知道,步骤603与步骤602应当是可以平行处理,而本实施例仅为了说明方便而作如此排序,因此本发明不应当限制于此实施例。In addition, although step 603 in this embodiment is after step 602, those skilled in the art should know after referring to this embodiment that step 603 and step 602 should be processed in parallel, and this embodiment is only for the convenience of description. , so the present invention should not be limited to this embodiment.

同样的道理,在此可以以上述图5及图6的实施例,对图3的场作正确的解交错处理。以下便以图3结合图5与图6作说明。首先,像素差异单元501便开始对相邻的奇场(或偶场)301、303作相减的动作,把奇场301与303中的每个像素对应相减,得到一差异场,如图11(步骤601)。在图11中可以看出,「OK」的部分几乎完全无动态(motion)发生,因此,此「OK」的部分的像素将会被判定为静态(也就是适用于场合并处理)。In the same way, the above-mentioned embodiments of FIG. 5 and FIG. 6 can be used to perform correct deinterleaving processing on the field in FIG. 3 . In the following, FIG. 3 will be combined with FIG. 5 and FIG. 6 for illustration. First, the pixel difference unit 501 starts to subtract the adjacent odd field (or even field) 301, 303, and subtracts each pixel in the odd field 301 and 303 correspondingly to obtain a difference field, as shown in the figure 11 (step 601). It can be seen from FIG. 11 that almost no motion occurs in the "OK" part, therefore, the pixels in the "OK" part will be judged as static (that is, suitable for scene merge processing).

接下来,检查区块定义单元502接收如图11的差异场,并且根据此差异场找出一特定检查区块(步骤602)。同样的,以上述图8A或图8B的手段,便可以圈出特定检查区块,如图12灰色部分。然而,在图12中可以明显看出,「OK」的部分并不在特定检查区块中,特定检查区块所圈出的检查区域会落在单摆摆动的区域。Next, the inspection block definition unit 502 receives the difference field as shown in FIG. 11 , and finds a specific inspection block according to the difference field (step 602 ). Similarly, by means of the above-mentioned FIG. 8A or FIG. 8B , a specific inspection block can be circled, as shown in the gray part in FIG. 12 . However, it can be clearly seen from FIG. 12 that the part of "OK" is not in the specific inspection block, and the inspection area circled by the specific inspection block falls in the swinging area of a single pendulum.

下一步骤,合并场301与302为一特定帧(步骤603)。相对于图5实施例,梳形检测单元503接收场301与302,将其合并成一帧。合并的梳形现象检查结果可以参考图13(黑色部份表示有梳形现象存在)。请注意,图13的「OK」区块1301可以看到,两个连续场合并后,会产生亮暗交错的梳形(combing)的现象,由于此部分不会被圈入特定检查区块中,因此此区块的像素仍会依照先前结果的判定为静态。最后,通过解交错格式决定单元504接收上述梳形检测单元503所输出的特定帧,并且以检查区块定义单元502所定义的特定检查区块去检查此特定帧的梳形现象,由于「OK」区块1301落在检查区块之外,检查结果仍为像素差异单元的判断结果,「OK」区块1301仍然使用场合并(WEAVE)的方式作解交错(步骤604)。因此,也解决了现有技术所造成画面闪烁的缺陷。In the next step, fields 301 and 302 are merged into a specific frame (step 603). Compared with the embodiment in FIG. 5 , the comb detection unit 503 receives the fields 301 and 302 and combines them into one frame. The combined comb inspection results can refer to Figure 13 (the black part indicates the presence of comb). Please note that in the "OK" block 1301 in Figure 13, it can be seen that after two consecutive fields are merged, there will be a comb-shaped phenomenon of interlaced light and dark, because this part will not be enclosed in a specific inspection block , so the pixels of this block will still be static according to the previous result. Finally, the specific frame output by the comb detection unit 503 is received by the deinterleaving format determination unit 504, and the specific inspection block defined by the inspection block definition unit 502 is used to check the comb phenomenon of the specific frame, because "OK ” block 1301 falls outside the check block, the check result is still the judgment result of the pixel difference unit, and the “OK” block 1301 still uses the field merge (WEAVE) method for de-interleaving (step 604 ). Therefore, the defect of picture flicker caused by the prior art is also solved.

同样的,虽然在此实施例的步骤603仅提出合并场301与302的方式,但是本领域具有通常知识者参考本实施例之后应当知道,梳形检测单元503除了如上述实施例合并场301与302之外,仍可以预先作如先前所述的梳型检测,之后,解交错格式决定单元504再根据所定义的特定检查区块,检查在上述特定检查区块中,以判断上述在特定检查区块中的像素应作如何的解交错处理。Similarly, although step 603 of this embodiment only proposes the method of merging fields 301 and 302, those skilled in the art should know after referring to this embodiment that comb detection unit 503, in addition to merging fields 301 and 302 as in the above-mentioned embodiment In addition to 302, comb detection as previously described can still be performed in advance, and then, the deinterleaving format determination unit 504 checks in the above-mentioned specific inspection block according to the defined specific inspection block to determine the above-mentioned specific inspection block. How the pixels in the block should be de-interlaced.

综上所述,本发明因采用根据差异场,找出特定检查区块,并利用检查相邻场所合成的帧中的特定检查区块的梳形现象,以决定对场的解交错方式,因此除了能保证正确的判定视讯的解交错策略之外,还可避免现有技术所发生的解交错策略错误,以实现增进解交错后的视讯的品质。In summary, the present invention uses the difference field to find out the specific inspection block, and uses the comb phenomenon of the specific inspection block in the frame synthesized by inspecting adjacent fields to determine the de-interlacing method for the field. In addition to ensuring the correct determination of the de-interlacing strategy of the video, it can also avoid the error of the de-interlacing strategy in the prior art, so as to improve the quality of the de-interlaced video.

虽然本发明已经以较佳实施例披露如上,然其并非用以限定本发明,本领域的技术人员在不脱离本发明的精神和范围的前提下可作若干的更动与润饰,因此本发明的保护范围以本发明的权利要求为准。Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Those skilled in the art can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of protection is based on the claims of the present invention.

Claims (15)

1. video de-interleaving solution strategy determining method comprises:
Subtract each other corresponding with a plurality of pixels in the i+2 field of i field obtained a difference field;
According to this difference field, difference and the one or more acquiescence pixel value that is received compared, find out a specific inspection block;
Merge i field and i+1 field or merge the i+1 field and the i+2 field is a particular frame; And
Check the comb shape phenomenon of this specific inspection block in this particular frame, in the release of an interleave mode of decision to the pixel in this specific inspection block,
Wherein i is a natural number.
2. video de-interleaving solution strategy determining method as claimed in claim 1, wherein the step of " finding out a specific inspection block " comprises:
From this difference field, the block that pixel difference is surrounded greater than a default value pixel is as this specific inspection block.
3. video de-interleaving solution strategy determining method as claimed in claim 1, wherein the step of " finding out a specific inspection block " comprises:
From this difference field, pixel difference is added an expanded range greater than one first block that a default value pixel is surrounded, as this specific inspection block.
4. video de-interleaving solution strategy determining method as claimed in claim 1 is prejudged a pre-release of an interleave mode according to this difference field.
5. video de-interleaving solution strategy determining method as claimed in claim 4, when the comb shape phenomenon of this specific inspection block in this particular frame during less than one first default value, decision with this pre-release of an interleave mode as the release of an interleave mode.
6. video de-interleaving solution strategy determining method as claimed in claim 4, when the comb shape phenomenon of this specific inspection block in this particular frame during greater than one second default value, decision is the release of an interleave mode with the another way that is different from this pre-release of an interleave mode.
7. video de-interleaving solution strategy determining method as claimed in claim 1, wherein i field and i+1 field are the field of different shape.
8. video de-interleaving solution strategy determining method as claimed in claim 1, wherein i field and i+2 field are the field of same modality.
9. video de-interleaving solution strategy decision systems comprises:
One pixel difference unit receives i field and i+2 field, and subtract each other corresponding with a plurality of pixels in the i+2 field of i field obtained a difference field;
One checks the block definition unit, couples this pixel difference unit, receives and according to this difference field, with difference and the comparison of one or more acquiescence pixel value that is received, finds out a specific inspection block;
One comb shape detecting unit receives i field and i+1 field, is a particular frame in order to merge i field and i+1 field; And
One release of an interleave format determination unit, couple this pixel difference unit, check block definition unit and this comb shape detecting unit, according to the testing result of the comb shape phenomenon of this specific inspection block in this particular frame, in the release of an interleave mode of decision to the pixel in this specific inspection block
Wherein i is a natural number.
10. video de-interleaving solution strategy decision systems as claimed in claim 9 wherein should be checked block definition unit more in order to from this difference field, and the block that pixel difference is surrounded greater than a default value pixel is as this specific inspection block.
11. video de-interleaving solution strategy decision systems as claimed in claim 9, should check wherein that the block definition unit was more in order to from this difference field, pixel difference is added an expanded range greater than one first block that a default value pixel is surrounded, as this specific inspection block.
12. video de-interleaving solution strategy decision systems as claimed in claim 9, when the comb shape phenomenon of this specific inspection block in this particular frame during less than one first default value, the pre-release of an interleave mode that this release of an interleave format determination unit decision is judged with difference field.
13. video de-interleaving solution strategy decision systems as claimed in claim 9, when the comb shape phenomenon of this specific inspection block in this particular frame during greater than one second default value, this release of an interleave format determination unit decision is the release of an interleave mode with the another way that is different from this pre-release of an interleave mode.
14. video de-interleaving solution strategy decision systems as claimed in claim 9, wherein i field and i+1 field are the field of different shape.
15. video de-interleaving solution strategy decision systems as claimed in claim 9, wherein i field and i+2 field are the field of same modality.
CN200610162581A 2006-11-28 2006-11-28 Video de-interlacing strategy decision method and system Expired - Fee Related CN100583960C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200610162581A CN100583960C (en) 2006-11-28 2006-11-28 Video de-interlacing strategy decision method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200610162581A CN100583960C (en) 2006-11-28 2006-11-28 Video de-interlacing strategy decision method and system

Publications (2)

Publication Number Publication Date
CN101193225A CN101193225A (en) 2008-06-04
CN100583960C true CN100583960C (en) 2010-01-20

Family

ID=39487941

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200610162581A Expired - Fee Related CN100583960C (en) 2006-11-28 2006-11-28 Video de-interlacing strategy decision method and system

Country Status (1)

Country Link
CN (1) CN100583960C (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9014685B2 (en) 2009-06-12 2015-04-21 Microsoft Technology Licensing, Llc Mobile device which automatically determines operating mode

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6348949B1 (en) * 1998-12-22 2002-02-19 Intel Corporation Deinterlacing a video signal using a motion detector
JP2003289511A (en) * 2002-03-27 2003-10-10 Toshiba Corp Image scan converting method and apparatus
US6734916B1 (en) * 2000-10-04 2004-05-11 Karl Sims Video field artifact removal
CN1540994A (en) * 2003-04-23 2004-10-27 矽统科技股份有限公司 Method for detecting frame type of adjustable critical value
JP2006165800A (en) * 2004-12-03 2006-06-22 Canon Inc Image processor and image processing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6348949B1 (en) * 1998-12-22 2002-02-19 Intel Corporation Deinterlacing a video signal using a motion detector
US6734916B1 (en) * 2000-10-04 2004-05-11 Karl Sims Video field artifact removal
JP2003289511A (en) * 2002-03-27 2003-10-10 Toshiba Corp Image scan converting method and apparatus
CN1540994A (en) * 2003-04-23 2004-10-27 矽统科技股份有限公司 Method for detecting frame type of adjustable critical value
JP2006165800A (en) * 2004-12-03 2006-06-22 Canon Inc Image processor and image processing method

Also Published As

Publication number Publication date
CN101193225A (en) 2008-06-04

Similar Documents

Publication Publication Date Title
CN1812553A (en) Method of edge based pixel location and interpolation
US8072540B2 (en) Apparatus and method for low angle interpolation
US8743281B2 (en) Alias avoidance in image processing
US20090016633A1 (en) Image processor, display device, image processing method, and program
CN100394793C (en) Pixel interpolating apparatus, pixel interpolating method, and program and recording medium
CN1258288C (en) Motion tester and testing method
US8000534B2 (en) Alias avoidance in image processing
US8289452B2 (en) Method and system for determining video deinterlacing scheme by checking combing phenomenon
US8743280B2 (en) Scan conversion image filtering
CN101088290B (en) Spatio-temporal adaptive video de-interlacing method, device and system
TWI323610B (en) Apparatus and method for video de-interlace
US8576337B2 (en) Video image processing apparatus and video image processing method
US9495728B2 (en) Method for edge detection, method for motion detection, method for pixel interpolation utilizing up-sampling, and apparatuses thereof
CN100583960C (en) Video de-interlacing strategy decision method and system
JPH1141565A (en) Image data interpolation device
JP3304162B2 (en) Scratch correction circuit
JPH09200575A (en) Image data interpolation device
US7733420B2 (en) Judder detection apparatus, de-interlacing apparatus using the same, and de-interlacing method
JP2009177524A (en) Scanning line interpolating device and scanning line interpolating method
JP2009265688A (en) Movement detection device
CN101753949A (en) Dynamic adaptive de-interlacing device and method
US20060033839A1 (en) De-interlacing method
CN101536509B (en) Scanning line interpolating device and scanning line interpolating method
TWI425840B (en) Robust Adaptive Decoupling Device and Method for Displacement Compensation Using Overlapping Blocks
JP2007235300A (en) Video processing apparatus, and video processing method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100120

Termination date: 20121128