WO2014122812A1 - 画像処理装置、フレームレートコントロール処理判定装置またはその方法 - Google Patents
画像処理装置、フレームレートコントロール処理判定装置またはその方法 Download PDFInfo
- Publication number
- WO2014122812A1 WO2014122812A1 PCT/JP2013/073088 JP2013073088W WO2014122812A1 WO 2014122812 A1 WO2014122812 A1 WO 2014122812A1 JP 2013073088 W JP2013073088 W JP 2013073088W WO 2014122812 A1 WO2014122812 A1 WO 2014122812A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frame
- motion region
- image processing
- motion
- region
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/144—Movement detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/215—Motion-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
- G06F2218/08—Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20112—Image segmentation details
Definitions
- the present invention relates to an image processing apparatus capable of determining a frame rate control process, and particularly to detect a frame rate control process.
- Patent Document 1 discloses a moving image area detecting process for detecting a moving image area in a part of one screen.
- Patent Document 2 discloses a frame rate control process (hereinafter referred to as FRC process) as a gradation display driving method for a liquid crystal display device.
- the FRC process is to display halftone luminance in a pseudo manner by alternately displaying different gradation luminances for each frame.
- the moving image area When the moving image area is detected for the image that has been subjected to the FRC process, the moving image area may be erroneously detected regardless of the still image area. This is because the image value changes for each frame even in the portion that is the still image region by the FRC process.
- the FRC process may detect a moving image area (image area) regardless of the text area.
- noise removal processing when noise removal processing is performed after FRC processing, changes in pixel values due to FRC processing may be recognized as noise and may be removed.
- An object of the present invention is to provide an FRC processing determination device that solves the above problems, determines whether or not FRC processing has been performed, and enables post-processing image processing using the result. It is another object of the present invention to provide an image processing apparatus that performs image processing using a detection result that FRC processing has been performed.
- An image processing apparatus includes a front frame motion region detection unit that detects a previous frame motion region in a previous frame, a rear frame that detects a rear frame motion region in a rear frame located behind the front frame.
- the determination unit determines that the frame rate control process is performed when the shift determination is repeated a plurality of times in successive frames. Therefore, even if there is noise, it can be accurately determined.
- each frame motion region is composed of a block composed of a plurality of pixels. Therefore, the frame memory becomes unnecessary.
- the image processing means is a rectangular motion area determination means, and when the parameter change command is received, the threshold value for determining whether or not it is a motion area is highly varied. . Therefore, even when the frame rate control process is performed, the subsequent rectangular motion region detection can be appropriately processed.
- the image processing means is a text area determination means, and when the parameter change command is received, the threshold value for determining as a text area is changed low. Therefore, even when the frame rate control process is performed, the subsequent text area detection can be appropriately processed.
- the image processing means is a noise removing means, and when the parameter change command is received, the threshold value for judging as noise is changed to be high. Therefore, even when the frame rate control process is performed, the subsequent noise removal process can be appropriately processed.
- the rectangular motion region detection device is a rectangular motion region detection device provided with a rectangular motion region detection means for detecting a rectangular motion region when image data of each frame is given. Detect a previous frame rectangular motion region and a rear frame rectangular motion region in a rear frame located behind the previous frame, and a deviation between the previous frame rectangular motion region and the rear frame rectangular motion region is less than a region displacement threshold.
- the determination unit includes a determination unit that determines that the frame rate control process is being performed and outputs a parameter change command; and a data addition unit that supplies image data of a part of the frames to the determination unit.
- the detection of the frame motion region in the means is the rectangular motion region determination in the rectangular motion region detection means. Remote, it is performed with high accuracy. Therefore, it is possible to detect the frame rate control process without increasing the computational load in the post-processing rectangular motion region process.
- the frame rate control process detection device is provided with a frame rectangular motion region detection means for detecting a frame rectangular motion region in each frame when image data of a plurality of frames is given, and the frame rectangular motion region detection means. If the difference between the detected previous frame rectangular motion region in the previous frame and the subsequent frame rectangular motion region in the rear frame located behind the previous frame is equal to or smaller than the region shift threshold, frame rate control processing is performed. And determining means for outputting a parameter change command for changing the threshold value of the image processing parameter. In this way, it is possible to determine whether or not the frame rate control process is performed using the region shift of the motion region.
- front frame and rear frame include, of course, the case where frames are continuous, and other than that, they may be relatively front and back frames.
- Frae rate control processing includes at least all temporal frame rate control processing.
- FIG. 3 is a functional block diagram of a motion area determination device 20.
- FIG. It is an example of the hardware structure at the time of comprising the motion area
- FIG. 3 is a detailed flowchart of a motion image region determination process in steps S105 and 107 in FIG. A display area 100 in which motion image areas 110 to 112 exist is shown. It is a flowchart of a motion block determination process. It is a figure which shows the result of having detected a motion block. It is a flowchart of a motion image area
- FIG. It is a figure which shows a motion sequence block. It is a flowchart (continuation) of a moving image area
- FIG. It is a flowchart of a boundary determination process. It is a figure which shows 32 * 32 pixel in 1 unit block.
- FIG. 1 shows a functional block diagram of an image processing determination device 20 having a frame rate control processing (hereinafter abbreviated as FRC processing) device 1 according to an embodiment of the present invention.
- the image processing apparatus 20 includes an FRC process determination apparatus 1, a switching unit 3, and an image processing unit 11.
- the FRC process determination device 1 includes a front frame motion region detection unit 5, a rear frame motion region detection unit 6, and a determination unit 7.
- the previous frame motion region detection means 5 detects the previous frame motion region in the previous frame.
- the rear frame motion region detecting means 6 detects a rear frame motion region in a rear frame located behind the front frame.
- the determination means 7 determines that the frame rate control process is being performed if the shift between the previous frame motion area and the subsequent frame motion area is equal to or smaller than the area shift threshold, and changes the parameter for changing the threshold of the image processing parameter. Output instructions.
- the switching means 3 gives some frames of the input image to the FRC processing determination device 1 and gives the rest to the image processing means 11.
- the image processing means changes the threshold value of the image processing parameter and performs image processing on the given input image.
- FIG. 2 shows a hardware configuration of the image processing apparatus 20.
- the image processing apparatus 20 includes a CPU 23, a RAM 25, and a flash memory 26.
- the flash memory 26 stores a program 26p.
- the program 26p stores an FRC process determination and a program for performing image processing in response to the determination result.
- the RAM 25 stores calculation results and the like.
- the CPU 23 determines whether or not the FRC process is performed based on the pixel values constituting the display area stored in the memory 27 according to the program 26P, and stores the result in the RAM 25.
- the background portion 203 is a still image C
- a rectangular moving image area 201 is part of one frame
- moving image data having a frame rate of 16 FPS is displayed on a monitor at 60 FPS.
- the same image as the nth frame is inserted into the (n + 1) th frame and the (n + 2) th frame from the (n-1) th frame to the (n + 3) th frame, and the FRC process is not performed.
- FRC processing is performed will be described as an example.
- the CPU 23 initializes the processing frame number i and the FRC processing candidate flag f (step S101 in FIG. 3).
- a known detection method may be employed for detection of the motion region in each frame. In the present embodiment, a rectangular motion region detection method described later is employed.
- FIG. 4 it is assumed that the motion region 205 is obtained as the nth frame detection result from the (n ⁇ 1) th frame and the nth frame.
- the CPU 23 detects a motion area for the rear frame (step S107 in FIG. 3).
- the detection method is the same as in step S103. In this case, since the nth frame and the (n + 1) th frame are the same frame image, the difference is zero. Therefore, no motion region is detected.
- the CPU 23 determines whether or not the difference between the motion areas of the previous frame and the subsequent frame is equal to or less than a threshold value (step S109). This is determined based on whether the shift of the boundary line of the motion region between the nth frame detection result and the (n + 1) th frame detection result is smaller than the threshold value. That is, it is determined from the size and position shift of each motion region.
- the CPU 23 determines that the difference is larger than the threshold value.
- the CPU 23 stores that there is no FRC processing (step S111), increments the processing frame number i (step S121), and repeats step S103 and subsequent steps.
- the CPU 23 detects a motion area for the rear frame (step S107 in FIG. 3). Also in this case, since the (n + 1) th frame and the (n + 2) th frame are the same frame image, the difference is zero. Therefore, no motion region is detected.
- the CPU 23 determines whether or not the difference between the motion areas of the previous frame and the subsequent frame is equal to or less than a threshold value (step S109). In this case, since there is no motion region, the difference is zero.
- the CPU 23 detects a motion area for the rear frame (step S107).
- a motion region 207 is obtained from the (n + 2) th frame and the (n + 3) th frame. This is because the background portion is the same for the still image C, and the rectangular moving image area 201 is different for the images B and D.
- the CPU 23 determines whether or not the difference between the motion areas of the previous frame and the subsequent frame is equal to or less than a threshold value (step S109). In this case, since there is no motion region for the previous frame, the difference between the motion regions exceeds the threshold value. Accordingly, the CPU 23 stores that there is no FRC processing (step S111), increments the processing frame number i (step S121), and repeats step S103 and subsequent steps.
- step S101 initializes processing frame number i and FRC processing candidate flag f (step S101).
- the background portion 203 as shown in FIG. 5 is different in the n ⁇ 1th frame and the nth frame regardless of the still image.
- the motion region 201 differs between the n ⁇ 1th frame and the nth frame by FRC processing. Therefore, the entire screen is detected as a motion region from the nth frame detection result obtained from the (n ⁇ 1) th frame and the nth frame.
- the CPU 23 detects a motion area for the rear frame (step S107).
- the nth frame and the (n + 1) th frame are the same frame image, they are all different because they are subjected to FRC processing. Therefore, in the (n + 1) th frame detection result obtained from the nth frame and the (n + 1) th frame, the entire screen is detected as the motion region.
- the CPU 23 detects a motion area for the rear frame (step S107).
- the (n + 1) th frame and the (n + 2) th frame are the same frame image, they are all different because they are FRC processed. Accordingly, in the (n + 2) th frame detection result obtained from the (n + 1) th frame and the (n + 2) th frame, the entire screen is detected as the motion area.
- step S109 determines whether or not the difference between the motion areas is equal to or less than a threshold value. In this case, in all cases, the entire screen is the motion area. Therefore, since the difference between the motion regions is zero, the CPU 23 determines that the difference is smaller than the threshold value.
- the CPU 23 detects a motion area for the rear frame (step S107).
- the background portion 203 is subjected to FRC processing in the (n + 2) th frame and the (n + 3) th frame, and the motion region 201 is different. Therefore, in the (n + 3) th frame detection result obtained from the (n + 2) th frame and the (n + 3) th frame, the entire screen is detected as a motion region.
- step S109 determines whether or not the difference between the motion areas is equal to or less than a threshold value. In this case, in all cases, the entire screen is the motion area. Therefore, since the difference is zero for the motion region, the CPU 23 determines that the difference is smaller than the threshold value.
- the CPU 23 switches the parameter of the image processing to be executed after the present detection process, specifically, the parameter of the motion region detection so that the detection threshold value of the motion region is lowered.
- the CPU 23 increments the processing frame number i (step S121) and repeats the steps after step S103.
- pixels are arranged in a matrix in the row direction ⁇ and the column direction ⁇ .
- CPU 23 performs block division (step S1 in FIG. 6).
- 32 * 32 pixels are defined as one block, and the display area 100 shown in FIG. 7 is divided into a plurality of blocks in a matrix.
- the block is divided into n + 1 blocks in the ⁇ direction and m + 1 blocks in the ⁇ direction.
- CPU 23 determines representative values for all blocks (step S3 in FIG. 6).
- the representative value the average value of the pixel values in one block, the first pixel value, and the hash value such as a CRC value may be used as the representative value instead of using the value as it is.
- the average value can be expressed in 18-bit length in a 32 * 32 * 8-bit image, but the upper and lower 10 bits may be rounded down and only the middle 8 bits may be used.
- (n + 1) * (m + 1) block representative values are stored in the RAM 25. It is desirable to use a representative value with high accuracy that can detect FRC processing.
- CPU 23 determines a motion block among (n + 1) * (m + 1) blocks (step S5).
- the motion block determination process will be described with reference to FIG.
- CPU 23 initializes processing block numbers i and j (steps S11 and S13 in FIG. 8).
- the block (0, 0) is compared with the representative value of the previous frame (step S15).
- the representative values at time t and time t ⁇ 1 are compared.
- the CPU 23 determines whether or not the difference between the representative values exceeds the threshold value thb (step S17). If the difference between the representative values exceeds the threshold value thb, it is determined as a motion block (step S19). On the other hand, if the difference between the representative values does not exceed the threshold thb, it is determined as a non-motion block (step S21).
- step S23 if the processing block number j is final, the process proceeds to step S27, and the CPU 23 determines whether or not the processing block number i is final. In this case, since it is not final, the processing block number i is incremented (step S29), and step S13 and subsequent steps are repeated. If the process block number i is the last in step S27, the process is terminated.
- a motion block is determined for (n + 1) * (m + 1) blocks.
- blocks (4, 2), (4, 3), (4, 4)... are determined as motion blocks.
- the CPU 23 performs a motion image area determination process (step S7 in FIG. 6). Details of the moving image region determination processing will be described with reference to FIGS.
- step S31 in FIG. 10 The CPU 23 initializes processing block number j (step S31 in FIG. 10).
- the CPU 23 determines whether or not there is at least one motion block in the block of the column to which the block (0, 0) belongs (step S33). In this case, as shown in FIG. 9, since there is no motion block in the block (0,0) and its vertical blocks (1,0) to (m, 0), such a sequence is a non-motion sequence. Is determined (step S37 in FIG. 10).
- the CPU 23 determines that the column is a non-motion column (step S37).
- the CPU 23 determines whether there is a temporary motion sequence that has been added and stored (step S39). If there is, the CPU 23 determines whether the adjacent set has a width that exceeds the threshold thw (step S39).
- the threshold thw is set to 2 blocks or more. In this case, since the temporary motion sequence stored in addition exists from blocks (0, 2) to (0, 8), the threshold value thw is exceeded, so the temporary motion sequence is set as a motion sequence (step S45).
- the CPU 23 determines whether or not the processing block number j is final (step S46).
- the CPU 23 determines that the column is a non-motion column (step S37). The CPU 23 determines whether or not the detected temporary motion sequence exists (step S39). In this case, since it does not exist, the CPU 23 determines whether or not the processing block number j is final (step S46).
- the CPU 23 determines that the column is a non-motion column (step S37). The CPU 23 determines whether or not the detected temporary motion sequence exists (step S39). If there is, the CPU 23 determines whether or not the adjacent set has a width exceeding the threshold thw (step S41). ). In the present embodiment, since the threshold thw is 2 blocks or more, the width of the temporary motion sequence does not exceed the threshold thw, so the temporary motion sequence is set as a non-motion sequence (step S43). Thereby, it is possible to prevent an image area such as a mouse from being erroneously recognized as a moving image area.
- step S49 it is determined whether or not the provisional motion sequence that has been added and stored exists, and if it exists, the processing from step S41 is executed.
- Fig. 11 shows the motion sequence after detection.
- the region 121 is determined as a motion sequence.
- the regions 122 and 123 to which the motion blocks (6, n-3) and (m-3, n-6) belong do not have a width equal to or greater than the threshold thw in the direction of the arrow ⁇ . Is not determined.
- the CPU 23 initializes the processing block number i (step S51 in FIG. 12).
- the CPU 23 determines whether or not there is at least one motion block in the row of the block (0, 0) (step S53). In this case, as shown in FIG. 9, since there is no motion block in the block (0,0) and its horizontal blocks (0,1) to (0, n), such a row is a non-motion row. Is determined (step S57).
- step S57 The CPU 23 determines whether there is a motion row that has been added and stored (step S59). In this case, since there is a motion row that has been added and stored, it is determined whether or not the set has a width that exceeds the threshold thw (step S61).
- the threshold thw is set to 2 blocks or more. In this case, since there are detected motion rows from block (4,0) to (8,0), the threshold thw is exceeded, so the temporary motion row is set as a motion row (step S65).
- step S69 is the same as that of step S49, description thereof is omitted.
- Fig. 13 shows the motion line after detection.
- the area 131 is determined as a movement line.
- the motion block (6, n-3) belongs to the region 131.
- the region 132 to which the motion block (m ⁇ 3, n ⁇ 6) belongs does not have a width equal to or larger than the threshold thw in the arrow ⁇ direction, and is not determined as a motion row.
- the CPU 23 determines a block belonging to both the motion sequence and the motion row as a motion image area (step S70 in FIG. 12).
- a block belonging to an area 140 where the area 121 and the area 131 overlap shown in FIG. 14 is determined as a moving image area.
- the motion blocks (6, n-3) and (m-3, n-6) are excluded, the block (4,5) and the like are determined as motion image regions. . In this way, it is possible to prevent spillage in relation to the surrounding blocks.
- step S9 in FIG. 6
- the boundary of the motion image area in the block composed of 32 * 32 pixels is obtained.
- the boundary 150 of the motion image area in units of one pixel can be obtained. Details of step S9 will be described with reference to FIG.
- step S80 extracts the upper block (step S80 in FIG. 15). In this case, a total of seven blocks (4,2) to (4,8) shown in FIG. 16 are extracted.
- the CPU 23 initializes the processing row number P (step S81), extracts all the pixels in the P row of the extracted block, and calculates the representative value (step S83). In this case, 32 pixels in the 0th row of the block (4,2), 32 pixels... And 7 * 32 pixels in the 0th row of the block (4,3) are extracted, and their representative values are calculated. In this embodiment, the representative value is the average value of the extracted pixels.
- the CPU 23 extracts all the pixels in the processing row number P + 1 row of the extracted block and calculates the representative value (step S85).
- 32 pixels in the first row of the block (4, 2), 32 pixels... And 7 * 32 pixels in the first row of the block (4, 3) are extracted, and their representative values are calculated.
- step S87 determines whether or not the representative value obtained in step S83 is different from the representative value obtained in step S85 (step S87). If both are different in step S87, it is determined that the row of the pixel (P, 0) is a boundary (step S93). If they are not different in step S87, the process row number P is incremented (step S89), and step S83 and subsequent steps are repeated until the final pixel of the extraction block (32 pixels in this case) is reached (step S91). If both are not different in step S87 even for the last pixel, it is determined that the end of the extracted block is a boundary (step S95).
- pixels for one column are extracted in the vertical direction, and the representative values may be compared with adjacent columns.
- This device can automatically detect the motion image area.
- the determination can also be detected in several frames. Therefore, even if the moving image area itself dynamically changes on the monitor, the moving image area can be detected almost in real time.
- a shift between the motion region of the previous frame and the motion region of the subsequent frame is detected to determine whether the FRC process is performed.
- the present invention is not limited to this, and the following target frame may be calculated for one of the frames, and the motion region of this and the other frame may be compared.
- the calculation of the target frame is performed as follows, for example. The difference between the leftmost pixel and the adjacent pixel in the horizontal direction of the screen is calculated. When such a display area such as a black band exists, the value suddenly becomes a large value after the difference continues for 0 for a while. The same applies to the right side of the screen.
- the target area can be determined by obtaining this from the horizontal direction of the screen and the vertical direction.
- the difference from the top to the bottom is always 0, and when the difference is detected, the difference is detected thereafter. All rows may be detected in this way, or only a part may be taken out and judged.
- the determination is made based on whether or not a plurality of frames in which the shift of the motion area between the previous frame and the rear frame is equal to or less than the threshold value are consecutive. Thereby, noise can be removed. Further, it can be distinguished from a normal moving image. This is because even in the case of a normal moving image, a moving image region may be detected once every several frames, but it is hardly detected multiple times in succession.
- the present invention is not limited to continuous cases, and it may be determined that FRC processing is performed if the deviation is less than or equal to the threshold value even once.
- FRC processing is performed if the shift between the motion areas of the previous frame and the back frame is within a threshold.
- the present invention is not limited to this. If the non-detection is not repeated, it may be determined that the FRC process is being performed.
- the detection in the FRC detection device may be set to have higher accuracy than the normal motion detection.
- a value that can extract the feature amount of the block more precisely may be employed.
- the detection in the subsequent image processing may use the block feature amount as the block motion detection feature amount by using the average value of the pixels, and in the calculation in the FRC detection, a CRC value that can be determined more precisely.
- a frame memory may be prepared and a motion region may be determined by comparison in units of pixels.
- the FRC detection is performed in the previous 4 frames out of the 16 frames, and the image processing threshold is changed in the subsequent 12 frames based on the FRC determination. You may make it be the threshold value of the next 12 frames which was delayed.
- the frame rate of the input image and the display rate of the monitor are arbitrary.
- the entire screen when the entire screen is detected as the moving image area in the previous frame and the subsequent frame, the entire screen is detected as the motion area. In this case, it is determined that the motion area is not detected. May be.
- the luminance value is adopted as the pixel value, but it may be an RGB value or the like.
- the motion region determination device has been described as the image processing device, but other image processing devices such as a text detection device or a noise removal device are also based on the detection result of the FRC processing. Similarly, by changing the threshold value of image processing in post-processing, appropriate image processing can be performed even for an FRC-processed image.
- the apparatus may be configured as a monitor further including an FRC processing unit, or may be configured as a video board further including an FRC processing unit. Further, the FRC processing unit may be mounted on a video board and configured as a monitor including this apparatus.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Television Systems (AREA)
Abstract
Description
図1に、本発明の1実施形態にかかるフレームレートコントロール処理(以下FRC処理と略す)装置1を有する画像処理判断装置20の機能ブロック図を示す。画像処理装置20は、FRC処理判断装置1、切換手段3,画像処理手段11を有する。
図2に画像処理装置20のハードウェア構成を示す。画像処理装置20は、CPU23、RAM25、フラッシュメモリ26を備えている。フラッシュメモリ26には、プログラム26pが記憶されている。プログラム26pには、後述するように、FRC処理判断およびこの判断結果を受けて、画像処理を行うプログラムが記憶されている。RAM25は演算結果等を記憶する。
以下では、画像処理手段11(図1参照)が行う画像処理として、矩形動き領域を検出する場合について説明する。
FRC処理がなされていない場合について図4を用いて説明する。
つぎに、FRC処理がなされている場合について、図3,図5を用いて説明する。ここでは、FRC処理により、フレームnとフレームn+2について、必要な画素の画素値が変更されているものとして説明する。
本実施形態において採用したFRC処理判断における矩形動き領域の決定手法(図3ステップS105,S107)について、説明する。
本実施形態においては、前フレームの動き領域と後フレームの動き領域のずれを検出して、FRC処理がなされているかを判断するようにした。しかし、これに限定されず、いずれかのフレームについて、下記のような目標フレームを算出して、これともう一方のフレームの動き領域を比較するようにしてもよい。目標フレームの算出は、例えば、以下のように行われる。画面の横方向にて左端の画素から隣の画素との差分を計算する。このような黒い帯のような表示領域が存在する場合、しばらく差分が0が続いた後、いきなり大きな値となる。画面の右側についても同様である。これを画面横方向の左右、縦方向の上下、求めることにより目標領域を決定することができる。例えば、横方向であれば、上から数行はずっと差分0となり、差分が検出される行になると、それ以降は差分が検出される。すべての行についてこのように検出してもよく、一部だけを取り出して、判断するようにしてもよい。このようにFRC判断の目標領域を決めることにより、画面解像度が小さい場合には、FRC処理がなされていない周辺領域を除外することができる。
上記実施形態においては、前フレームと後ろフレームの動き領域のズレが閾値以下のフレームが複数連続するか否かで判断するようにした。これによりノイズを除去できる。また、通常の動画と区別することができる。なぜなら、通常の動画であっても、数フレームに一回動画領域が検出されることもあるが、連続して複数回の検出はほとんどないからである。
25 RAM
26 フラッシュメモリ
Claims (10)
- 前フレームにおける前フレーム動き領域を検出する前フレーム動き領域検出手段、
前記前フレームよりも後ろに位置する後ろフレームにおける後フレーム動き領域を検出する後フレーム動き領域検出手段、
前記前フレーム動き領域と前記後フレーム動き領域とのずれが領域ずれ閾値以下であれば、フレームレートコントロール処理されていると判断して、画像処理パラメータの閾値を変動させるパラメータ変更命令を出力する判断手段、
前記パラメータ変更命令を受け取ると、画像処理パラメータの閾値を変動させる画像処理手段、
を備えた画像処理装置。 - 請求項1の画像処理装置において、
前記判断手段は、前記ずれ判断が連続するフレームで複数回繰り返される場合に、フレームレートコントロール処理されていると判断すること、
を特長とする画像処理装置。 - 請求項1または請求項2の画像処理装置において、
前記各フレーム動き領域は、複数画素で構成されたブロックで構成されていること、
を特長とする画像処理装置。 - 請求項1~請求項3のいずれかの画像処理装置であって、
前記画像処理手段は、矩形動き領域判断手段であり、前記パラメータ変更命令を受け取ると、動き領域か否かを判断するための閾値を高く変動させること、
を特長とする画像処理装置。 - 請求項1~請求項3のいずれかの画像処理装置であって、
前記画像処理手段は、テキスト領域判断手段であり、前記パラメータ変更命令を受け取ると、テキスト領域として判断するための前記閾値を低く変動させること、
を特長とする画像処理装置。 - 請求項1~請求項3のいずれかの画像処理装置であって、
前記画像処理手段は、ノイズ除去手段であり、前記パラメータ変更命令を受け取ると、ノイズとして判断するための前記閾値を高く変動させること、
を特長とする画像処理装置。 - 各フレームの画像データが与えられると、矩形動き領域を検出する矩形動き領域検出手段を備えた矩形動き領域検出装置であって、
前フレームにおける前フレーム矩形動き領域および前記前フレームよりも後ろに位置する後ろフレームにおける後フレーム矩形動き領域を検出し、前記前フレーム矩形動き領域と前記後フレーム矩形動き領域とのずれが領域ずれ閾値以下であれば、フレームレートコントロール処理されていると判断して、パラメータ変更命令を出力する判断手段、
前記各フレームの一部のフレームについての画像データを前記判断手段に与えるデータ付与手段、
を備え、
前記判断手段におけるフレーム動き領域の検出の方が、前記矩形動き領域検出手段における矩形動き領域判断よりも、高精度で実行されること、
を特長とする矩形動き領域検出装置。 - 複数フレームの画像データが与えられると、各フレームにおけるフレーム矩形動き領域を検出するフレーム矩形動き領域検出手段、
前記フレーム矩形動き領域検出手段によって、検出された前フレームにおける前フレーム矩形動き領域と、前記前フレームよりも後ろに位置する後ろフレームにおける後フレーム矩形動き領域とのずれが領域ずれ閾値以下であれば、フレームレートコントロール処理されていると判断して、画像処理パラメータの閾値を変更するパラメータ変更命令を出力する判断手段、
を備えたフレームレートコントロール処理検出装置。 - 前フレームにおける前フレーム動き領域を検出する前フレーム動き領域検出ステップ、
前記前フレームよりも後ろに位置する後ろフレームにおける後フレーム動き領域を検出する後フレーム動き領域検出ステップ、
前記前フレーム動き領域と前記後フレーム動き領域とのずれが領域ずれ閾値以下であれば、フレームレートコントロール処理されていると判断して、画像処理パラメータの閾値を変動させるパラメータ変更命令を出力する判断ステップ、
前記パラメータ変更命令を受け取ると、画像処理パラメータの閾値を変動させる画像処理ステップ、
を備えた画像処理方法。 - 前フレームに関連する複数フレームの画像データが与えられると、前フレームにおけるフレーム矩形動き領域を検出する前フレーム矩形動き領域検出ステップ、
前記前フレームよりも後ろに位置する後ろフレームに関連する複数フレームの画像データが与えられると、後フレームにおけるフレーム矩形動き領域を検出する後フレーム矩形動き領域検出ステップ、
前記前フレーム矩形動き領域と、前記後フレーム矩形動き領域とのずれが領域ずれ閾値以下であれば、フレームレートコントロール処理されていると判断して、画像処理パラメータの閾値を変更するパラメータ変更命令を出力する判断ステップ、
を備えたフレームレートコントロール処理検出方法。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2013377249A AU2013377249B2 (en) | 2013-02-06 | 2013-08-29 | Image processing apparatus, frame rate control process determination apparatus, and method |
EP13874634.2A EP2955695A4 (en) | 2013-02-06 | 2013-08-29 | IMAGE PROCESSING DEVICE, AND DEVICE OR METHOD FOR EVALUATING IMAGE FREQUENCY CONTROL PROCESS |
CN201380072464.7A CN104981843A (zh) | 2013-02-06 | 2013-08-29 | 图像处理装置、帧速率控制处理判定装置及其方法 |
RU2015137670/08A RU2603547C1 (ru) | 2013-02-06 | 2013-08-29 | Устройство обработки изображения, устройство определения проведения процесса управления частотой кадров и способ реализации этих задач |
US14/818,248 US9451206B2 (en) | 2013-02-06 | 2015-08-04 | Image processing apparatus, frame rate control process determination apparatus, and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013-020975 | 2013-02-06 | ||
JP2013020975A JP5542981B1 (ja) | 2013-02-06 | 2013-02-06 | 画像処理装置、フレームレートコントロール処理判定装置またはその方法 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/818,248 Continuation US9451206B2 (en) | 2013-02-06 | 2015-08-04 | Image processing apparatus, frame rate control process determination apparatus, and method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014122812A1 true WO2014122812A1 (ja) | 2014-08-14 |
Family
ID=51299421
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/073088 WO2014122812A1 (ja) | 2013-02-06 | 2013-08-29 | 画像処理装置、フレームレートコントロール処理判定装置またはその方法 |
Country Status (7)
Country | Link |
---|---|
US (1) | US9451206B2 (ja) |
EP (1) | EP2955695A4 (ja) |
JP (1) | JP5542981B1 (ja) |
CN (1) | CN104981843A (ja) |
AU (1) | AU2013377249B2 (ja) |
RU (1) | RU2603547C1 (ja) |
WO (1) | WO2014122812A1 (ja) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210066619A (ko) | 2019-11-28 | 2021-06-07 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002287709A (ja) | 2001-03-28 | 2002-10-04 | Hitachi Ltd | 液晶表示装置 |
JP2010085515A (ja) * | 2008-09-30 | 2010-04-15 | Hitachi Ltd | 表示装置 |
WO2011001726A1 (ja) * | 2009-07-03 | 2011-01-06 | シャープ株式会社 | 液晶表示装置および光源制御方法 |
JP2011227118A (ja) * | 2010-04-15 | 2011-11-10 | Seiko Epson Corp | 画像処理装置、表示システム、電子機器及び画像処理方法 |
JP4980486B1 (ja) | 2011-06-14 | 2012-07-18 | 株式会社ナナオ | 動き画像領域判定装置またはその方法 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5903673A (en) * | 1997-03-14 | 1999-05-11 | Microsoft Corporation | Digital video signal encoder and encoding method |
US7046729B2 (en) * | 2002-08-27 | 2006-05-16 | Ess Technology, Inc. | Bit rate control for motion compensated video compression system |
US20040146108A1 (en) * | 2003-01-23 | 2004-07-29 | Shih-Chang Hsia | MPEG-II video encoder chip design |
TWI317599B (en) * | 2006-02-17 | 2009-11-21 | Novatek Microelectronics Corp | Method and apparatus for video mode judgement |
US20090190029A1 (en) * | 2008-01-28 | 2009-07-30 | Te-Hao Chang | Video processing methods and related apparatus |
CN101911175B (zh) * | 2008-01-30 | 2012-12-12 | 夏普株式会社 | 视频显示装置 |
US8411738B2 (en) * | 2009-03-12 | 2013-04-02 | Samsung Electronics Co., Ltd. | System and method for identification of vertical scrolling regions in digital video |
-
2013
- 2013-02-06 JP JP2013020975A patent/JP5542981B1/ja not_active Expired - Fee Related
- 2013-08-29 EP EP13874634.2A patent/EP2955695A4/en not_active Withdrawn
- 2013-08-29 CN CN201380072464.7A patent/CN104981843A/zh active Pending
- 2013-08-29 WO PCT/JP2013/073088 patent/WO2014122812A1/ja active Application Filing
- 2013-08-29 RU RU2015137670/08A patent/RU2603547C1/ru not_active IP Right Cessation
- 2013-08-29 AU AU2013377249A patent/AU2013377249B2/en not_active Ceased
-
2015
- 2015-08-04 US US14/818,248 patent/US9451206B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002287709A (ja) | 2001-03-28 | 2002-10-04 | Hitachi Ltd | 液晶表示装置 |
JP2010085515A (ja) * | 2008-09-30 | 2010-04-15 | Hitachi Ltd | 表示装置 |
WO2011001726A1 (ja) * | 2009-07-03 | 2011-01-06 | シャープ株式会社 | 液晶表示装置および光源制御方法 |
JP2011227118A (ja) * | 2010-04-15 | 2011-11-10 | Seiko Epson Corp | 画像処理装置、表示システム、電子機器及び画像処理方法 |
JP4980486B1 (ja) | 2011-06-14 | 2012-07-18 | 株式会社ナナオ | 動き画像領域判定装置またはその方法 |
JP2013020602A (ja) * | 2011-06-14 | 2013-01-31 | Nanao Corp | 動き画像領域判定装置またはその方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2955695A4 |
Also Published As
Publication number | Publication date |
---|---|
AU2013377249B2 (en) | 2015-11-19 |
EP2955695A1 (en) | 2015-12-16 |
CN104981843A (zh) | 2015-10-14 |
US9451206B2 (en) | 2016-09-20 |
AU2013377249A1 (en) | 2015-09-17 |
JP2014153786A (ja) | 2014-08-25 |
RU2603547C1 (ru) | 2016-11-27 |
JP5542981B1 (ja) | 2014-07-09 |
EP2955695A4 (en) | 2016-11-16 |
US20150341592A1 (en) | 2015-11-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8116593B2 (en) | Image processing apparatus, image processing method, and program for determining a zoom area for a displayed zoom image | |
JP4980486B1 (ja) | 動き画像領域判定装置またはその方法 | |
JP2009095029A (ja) | イメージ評価方法及び装置 | |
JP6809613B2 (ja) | 画像前景の検出装置、検出方法及び電子機器 | |
JP6758834B2 (ja) | 表示装置、表示方法及びプログラム | |
JP6191517B2 (ja) | 検出装置、検出プログラム、及び検出方法 | |
JP5542981B1 (ja) | 画像処理装置、フレームレートコントロール処理判定装置またはその方法 | |
JP2020170252A5 (ja) | ||
JP5690800B2 (ja) | 動き画像領域判定装置またはその方法 | |
JP2009042897A (ja) | 画像処理装置及び画像処理方法 | |
KR20090048596A (ko) | 디지털 이미지의 모스키토 노이즈를 감소시키기 위한 방법 및 시스템 | |
CN106507157B (zh) | 广告投放区域识别方法及装置 | |
JP5656964B2 (ja) | シーンチェンジ判定装置またはその方法 | |
WO2015166518A1 (ja) | アノテーション線判断装置、アノテーション線除去装置、医療用の表示装置およびそれらの方法 | |
EP2538657A1 (en) | Motion detection device, control programme, and integrated circuit | |
JP2009290301A (ja) | 映像信号処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13874634 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013874634 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2015137670 Country of ref document: RU Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2013377249 Country of ref document: AU Date of ref document: 20130829 Kind code of ref document: A |