CN100407766C

CN100407766C - Method and apparatus for processing image, recording medium and computer program

Info

Publication number: CN100407766C
Application number: CN2005101288604A
Authority: CN
Inventors: 西亨; 上田和彦; 浅野光康
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2004-12-07
Filing date: 2005-12-07
Publication date: 2008-07-30
Anticipated expiration: 2025-12-07
Also published as: CN1787606A

Abstract

An image processing apparatus includes a corrector for correcting a pixel value of each of a plurality of pixels forming each access unit to be processed, based on at least one of the parameter values corresponding to the access unit to be processed. The corrector includes an acquisition unit for acquiring input pixel values, a first mean value calculating unit for calculating a first mean pixel value, a second mean value calculating unit for calculating a second mean pixel value, a correction value determination unit for determining a correction value, and an adding unit for adding the correction value to the input pixel value of a target pixel.

Description

Be used to handle the method and apparatus of image

The present invention comprises the theme of the Japanese patent application JP2005-168428 that is involved in the Japanese patent application JP 2004-354576 that submitted in Japan Patent office on December 7th, 2004 and submits in Japan Patent office on June 8th, 2005, and its full content is incorporated by reference herein.

Technical field

The present invention relates to be used to handle method and apparatus, recording medium and the computer program of image, relate in particular to and be used for by control because image blurring (blur) image quality decrease of causing shows more information processing method and equipment, recording medium and the computer program of distinct image.

Background technology

In the open No.7-59054 of the patent application of Japanese unexamined, disclosed a kind of frame-rate conversion technology.According to the disclosure, the vision signal conversion equipment that is used for display video (comprising moving image) is adjusted frame rate, come not reduce the mode display video of picture quality, even when not having fixing synchronized relation in frame rate between input TV format and the output TV format or the field frequencies range, also be like this.

Summary of the invention

When the frame-rate conversion technology that discloses among the open No.7-59054 of the patent application of using Japanese unexamined increases frame rate, image blurring (below be called pick up fuzzy) who does not consider during image pickup, to send.Thereby, cause on the screen that shows, being difficult to the image of clear display owing to pick up the fuzzy image quality decrease that causes and be not improved yet.

Therefore, hope can be controlled the image of image blurring and clear display after frame-rate conversion.

The Japanese patent application No.2004-234051 that is submitted to by the assignee identical with the present invention has disclosed image processing equipment, method, recording medium and the computer program that is used for clear display image after frame-rate conversion.It would also be desirable to provide information processing method and equipment, recording medium and the computer program different with treatment step with the structure disclosed in the Japanese patent application No.2004-234051.

In one embodiment of the invention, provide a kind of image processing equipment to be used for obtaining at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place based on each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, this image processing equipment comprises adjuster, is used for the pixel value according to each of a plurality of pixels of proofreading and correct formation each access unit to be processed corresponding at least one parameter value of access unit to be processed.This adjuster comprises: acquiring unit, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and to obtain with the object pixel be the input pixel value of n pixel (n is equal to or greater than 3 the integer) center, that be adjacent to align on the direction of motion as this moving image of first direction; First average calculation unit, be used in the middle of the input pixel value that obtains by acquiring unit, according to the computer capacity of determining to be arranged in the input pixel value of individual (k is the integer less than the n/2) pixel of k on the first direction corresponding to the parameter value of object pixel further from object pixel ground, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction; Second average calculation unit, be used in the middle of the input pixel value that obtains by acquiring unit, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction; The corrected value determining unit, be used for the input pixel value according to the first direction average pixel value that calculates by first average calculation unit, object pixel, the relation between the second direction average pixel value that calculates by second average calculation unit, be identified for the corrected value of the input pixel value of correction target pixel; With first adder unit, be used for input pixel value addition by determined corrected value of corrected value determining unit and object pixel, and will obtain and as the output of the output pixel value of object pixel.

Image processing equipment can also comprise the 3rd average calculation unit, and the mean value that is used to calculate the input pixel value of object pixel and m the pixel adjacent with object pixel is used as target average pixel value (m is equal to or greater than 1 integer).The corrected value determining unit comprises: the candidate determiner, be used for the first direction average pixel value of object pixel and the difference between the input pixel value are defined as first candidate, the second direction average pixel value of object pixel and the difference between the input pixel value are defined as second candidate; The adjusted value determiner, be used on second defined plane by first of the remarked pixel position and remarked pixel value, second point of the object pixel average pixel value that first point, indication that uses indication first direction average pixel value calculated by the 3rd average calculation unit and indication second direction average pixel value thirdly between the position relation be identified for adjusting the adjusted value of corrected value; Adjuster is used to use the adjusted value of being determined by the adjusted value determiner, adjusts first candidate and second candidate determined by the candidate determiner; And selector, be used under the preset selection criterion selecting first and second candidates adjusted by adjuster and predetermined fixed value one, and selected value is set to corrected value.

The adjusted value determining unit can be with the absolute value in second the flection value of locating that connects first point, and straight line thirdly at second, divided by between first and second along second distance, and determine adjusted value according to the merchant who obtains.

In first average calculation unit and second average calculation unit each can determine whether change in first polarity with second defined plane cathetus slope of remarked pixel value by the remarked pixel position, the straight line tie point is indicated k the input pixel value that falls into definite computer capacity respectively.Do not change if determine the polarity of straight slope, then use k input pixel value to calculate one of first direction average pixel value and second direction average pixel value.If determine the reversing of straight slope, then basis is by the indicated input pixel value of point before the reversing, correction by the indicated input pixel value of point after the reversing, and uses input pixel value calibrated in k input pixel value and all the other uncorrected input pixel values to calculate one of first direction average pixel value and second direction average pixel value in k input pixel value.

Adjuster also comprises first adjuster and second adjuster.First adjuster comprises acquiring unit, first average calculation unit, second average calculation unit, corrected value determining unit and first adder unit.Second adjuster comprises: the average filter unit is asked in motion, be used to respond one of parameter value corresponding to object pixel and change the characteristic that average filter is asked in the fuzzy motion of indicating image, it is that the average filter operation is asked in the motion of feature that each input pixel value of pixel in the predetermined block that comprises object pixel is carried out with the characteristic after the conversion, and input pixel value that will obtain, calibrated, object pixel is exported as first value; Subtractor unit is used to calculate the input pixel value of object pixel and asks poor between first value of average filter unit output from motion, and should differ to be worth as second and export; With second adder unit, being used for will be from second value of subtractor unit output and the input pixel value addition of object pixel, and will obtain and export as the output pixel value of object pixel.

The parameter value that image processing equipment can be used as respective pixel to constitute the motion vector in each a plurality of pixels of a plurality of access units each, and wherein said a plurality of access units constitute moving images.

During when pick up a plurality of access units that constitute moving image by image pick-up device in each, image processing equipment can be used as the shutter speed that parameter value obtains image pick-up device.

Image processing equipment can also comprise the rate transition unit that is used to carry out the rate transition operation, and the rate transition operation is transformed into second speed higher than first rate with the speed of the access unit in the moving image from current first rate.Adjuster was proofreaied and correct each pixel value of a plurality of pixels of constituting access unit to be processed before or after the rate transition operation is carried out to access unit to be processed in the rate transition unit.

Best, first rate is 30Hz, and second speed is 120Hz.

Best, first rate is 60Hz, and second speed is 120Hz.

Best, first rate is 60Hz, and second speed is 240Hz.

Best, first rate is 50Hz, and second speed is 100Hz.

Best, first rate is 50Hz, and second speed is 200Hz.

According to another embodiment of the present invention, provide a kind of image processing method to be used for detecting and obtain at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place based on each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, and this image processing method comprises step: according to each the pixel value of proofreading and correct corresponding at least one parameter value of access unit to be processed in a plurality of pixels that constitute each access unit to be processed.This aligning step comprises: obtain substep, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and to obtain with the object pixel be the input pixel value of n pixel (n is equal to or greater than 3 the integer) center, that be adjacent to align on the direction of motion as this moving image of first direction; The first mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k the pixel (k is the integer less than n/2) on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction; The second mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction; Corrected value is determined substep, be used for being identified for the corrected value of the input pixel value of correction target pixel according to the relation between the input pixel value of first direction average pixel value that the first mean value calculation substep calculates, object pixel, the second direction average pixel value that in the second mean value calculation substep, calculates; With the addition substep, be used for and will determine the input pixel value addition of determined corrected value of substep and object pixel at corrected value, and will obtain and as the output of the output pixel value of object pixel.

According to another embodiment of the present invention, provide a kind of computer program to be used to make computer based to obtain at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place in each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, and this computer program comprises that program code comes execution in step: according to each the pixel value of proofreading and correct corresponding at least one parameter value of access unit to be processed in a plurality of pixels that constitute each access unit to be processed.This aligning step comprises: obtain substep, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and to obtain with the object pixel be the input pixel value center, that be adjacent to be arranged in n the pixel (n is equal to or greater than 3 integer) on the first direction; The first mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k the pixel (k is the integer less than n/2) on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction; The second mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction; Corrected value is determined substep, be used for being identified for the corrected value of the input pixel value of correction target pixel according to the relation between the input pixel value of first direction average pixel value that the first mean value calculation substep calculates, object pixel, the second direction average pixel value that in the second mean value calculation substep, calculates; With the addition substep, be used for and will determine the input pixel value addition of determined corrected value of substep and object pixel at corrected value, and will obtain and as the output of the output pixel value of object pixel.

According to another embodiment of the present invention, a kind of recorded medium stores computer program is provided, computer program is used to make computer based to obtain at least one parameter value that is used to refer to the image blurring characteristic that takes place during the moving image of predetermined image pick device picks up in each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, and this computer program comprises that program code comes execution in step: according to each the pixel value of proofreading and correct corresponding at least one parameter value of access unit to be processed in a plurality of pixels that constitute each access unit to be processed.This aligning step comprises: obtain substep, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and to obtain with the object pixel be the input pixel value center, that be adjacent to be arranged in n the pixel (n is equal to or greater than 3 integer) on the first direction; The first mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k the pixel (k is the integer less than n/2) on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction; The second mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction; Corrected value is determined substep, be used for being identified for the corrected value of the input pixel value of correction target pixel according to the relation between the input pixel value of first direction average pixel value that the first mean value calculation substep calculates, object pixel, the second direction average pixel value that in the second mean value calculation substep, calculates; With the addition substep, be used for and will determine the input pixel value addition of determined corrected value of substep and object pixel at corrected value, and will obtain and as the output of the output pixel value of object pixel.

According to the embodiment of the invention, obtain at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place.The pixel value of each in a plurality of pixels of correction formation each access unit to be processed.Specifically, in each of a plurality of access units that constitute moving image, in the middle of a plurality of pixels that constitute access unit to be processed, an interesting pixel is provided as object pixel.Obtaining with the object pixel is the input pixel value of corresponding n pixel (n is equal to or greater than 3 the integer) center, that be adjacent to align on the direction of motion as this moving image of first direction.In the middle of the input pixel value that during obtaining substep, obtains, determine further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the first direction.Calculating falls into the mean value of the input pixel value in this computer capacity, as the first direction average pixel value.Similarly, calculate the wide pixel, be arranged in the mean value of k pixel on the second direction opposite as the second direction average pixel value with first direction.Value k determines according to parameter value, that is, variable along with parameter value.According to the input pixel value of first direction average pixel value, object pixel and the relation between the second direction average pixel value, be identified for the corrected value of the input pixel value of correction target pixel.Input pixel value addition with corrected value and object pixel.With obtain and as the output of the output pixel value (that is the pixel value of calibrated object pixel) of object pixel.

According to embodiments of the invention, correct the pixel value of each pixel that constitutes each access unit, access unit constitutes moving image.Correcting pixel value makes owing to picking up the fuzzy image quality decrease that causes controlled.Before or after handling in frame-rate conversion moving image is carried out correct operation, the moving image after the frame-rate conversion shows more clearly.

Description of drawings

Fig. 1 is the functional-block diagram of the image processing equipment of one embodiment of the invention;

Fig. 2 is the figure that is illustrated in the image blurring frequency characteristic that forms on the human retina;

Fig. 3 is the flow chart of diagram by the image processing operations of the image processing equipment execution of Fig. 1;

The figure that picks up fuzzy frequency characteristic that Fig. 4 diagram is responsive to motion vector (movement velocity);

Fig. 5 is the functional-block diagram that picks up fuzzy controller of the image processing equipment of Fig. 1;

Fig. 6 is the block diagram of the high fdrequency component arrester that picks up fuzzy controller of Fig. 5;

Fig. 7 is the figure of characteristic of high-frequency limitations device of the high fdrequency component arrester of Fig. 6;

Fig. 8 is the functional-block diagram that picks up the filter module in the fuzzy controller of Fig. 5;

Fig. 9 is the functional-block diagram of gain controller of the filter module of Fig. 8;

The characteristic of the adjusted value determiner of the gain controller of Figure 10 diagram Fig. 9;

Figure 11 is the functional-block diagram that picks up the ambiguity correction device in the fuzzy controller of picking up of Fig. 5;

Figure 12 is the functional-block diagram that picks up the ALTI module in the ambiguity correction device of Figure 11;

The processing of the ALTI module of Figure 13 diagram Figure 12 is used for correction pixels value when calculating the average pixel value of the pixel value that is adjacent to one group of pixel of aligning on the right of object pixel;

The pixel value bearing calibration of the further diagram of Figure 14 when calculating the average pixel value that is adjacent to one group of pixel of aligning on the right of object pixel;

Figure 15 is the flow chart of processing of the ALTI module of diagram Figure 12;

The characteristic of the adjustment calculation device in the ALTI module of Figure 16 diagram Figure 12;

Figure 17 is the functional-block diagram of another different ALTI module of picking up of Figure 11 ALTI module in the ambiguity correction device and Figure 12;

Figure 18 is the functional-block diagram that picks up the gain controller in the ambiguity correction device of Figure 11;

Figure 19 is the figure of the characteristic of the adjusted value determiner in the gain controller of Figure 18;

Figure 20 be in the image processing equipment of Fig. 1 with Fig. 5 pick up the different functional-block diagram that picks up fuzzy controller of fuzzy controller;

Figure 21 be in the image processing equipment of Fig. 1 with Fig. 5 and 20 pick up the different functional-block diagram that picks up fuzzy controller of fuzzy controller;

Figure 22 is camera shutter speed (shuttle speed) and picks up the figure of fuzzy behaviour;

Figure 23 is the functional-block diagram that is different from image processing equipment image processing equipment, another embodiment of the present invention of Fig. 1;

Figure 24 is the functional-block diagram that is different from image processing equipment image processing equipment, yet another embodiment of the invention of Fig. 1 and 23;

Figure 25 is the functional-block diagram that is different from Fig. 1,23 and 24 image processing equipment image processing equipment, yet another embodiment of the invention;

Figure 26 is the functional-block diagram that is different from Fig. 1,23,24 and 25 image processing equipment image processing equipment, yet another embodiment of the invention; And

Figure 27 realizes the part of image processing equipment of the present invention or the block diagram of whole hardware configuration.

Embodiment

Before describing the embodiment of the invention, below the corresponding relation between the disclosed specific factor in the feature of claim and the embodiment of the invention is discussed earlier.This description is intended to guarantee describe in this manual support inventive embodiment required for protection.Like this, even the key element among the following embodiment is not described to relate to the special characteristic of claim, that means not necessarily that also this key element does not relate to the feature of claim.On the contrary, even key element is described to relate to the special characteristic of claim here, that means not necessarily that also this key element does not relate to other features of claim.

In addition, this description not will be understood that it is all restrictions of description in the claims of all aspects of invention disclosed among the embodiment.Promptly; this description does not deny existing those to describe in an embodiment and do not have aspect claimed the present invention in the application's invention; that is, exist in the future and can also can pass through to revise and the aspect of the present invention of extra demand protection by the claimed aspect of the present invention of dividing an application.

In one embodiment of the invention, image processing equipment (for example, the image processing equipment 201 of the image processing equipment 1 of Fig. 1, the image processing equipment 212 of Figure 25, Figure 23, the image processing equipment 202 of Figure 24, each comprise be used for parameter values for detection pick up fuzzy behaviour detector 12; And the image processing equipment 231 of the image processing equipment 212 of Figure 25 and Figure 26, each is from the outside value of getting parms) obtain at least one parameter value that is used to refer to during the moving image of predetermined image pick device picks up the image blurring characteristic that takes place based on each access unit (access unit), perhaps from the outside value of getting parms, a plurality of access units constitute the moving image that is picked up by image pick-up device.Image processing equipment described herein is relevant with the image processing equipment 1 of Fig. 1.This image processing equipment comprises adjuster (for example Fig. 1 pick up fuzzy controller 13), is used for according to each the pixel value of proofreading and correct a plurality of pixels of constituting each access unit to be processed corresponding at least one parameter value of access unit to be processed.Adjuster (for example, one of fuzzy controller 13 among Fig. 5,20 and 21, each comprises the ALTI module 81 of Figure 12) comprising: acquiring unit (the DL unit 91-1 of Figure 12 is to 91-n), one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and to obtain with the object pixel be the input pixel value center, that be arranged in n the pixel (n is equal to or greater than 3 integer) on the first direction; First average calculation unit (for example, the average value calculator 93 of Figure 12), be used in the middle of the input pixel value that obtains by acquiring unit, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k the pixel (k is the integer less than n/2) on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction (for example, the value La of Figure 12); Second average calculation unit (for example, the average value calculator 94 of Figure 12), be used in the middle of the input pixel value that obtains by acquiring unit, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction (for example, the value Ra of Figure 12); The corrected value determining unit (for example, the adjuster determiner 95 of Figure 12), (for example be used for according to the input pixel value of the first direction average pixel value that calculates by first average calculation unit, object pixel, the value N of Figure 12), the relation between the second direction average pixel value that calculates by second average calculation unit, be identified for the corrected value (for example, the value ADD of Figure 12) of the input pixel value of correction target pixel; With first adder unit (adder 96 of Figure 12), be used for input pixel value addition by determined corrected value of corrected value determining unit and object pixel, and will obtain and as the output of the output pixel value of object pixel.

Image processing equipment (for example also comprises the 3rd average calculation unit, the average value calculator 92 of Figure 12), (m is equal to or greater than 1 integer to be used to calculate object pixel and a m pixel adjacent with object pixel, be 2 under the situation of Figure 12) the mean value of input pixel value be used as target average pixel value (for example, the value Na of Figure 12).The corrected value determining unit comprises: the candidate determiner (for example, the candidate determining unit 121 that comprises subtracter 101 and subtracter 102 among Figure 12), be used for the first direction average pixel value of object pixel and the difference between the input pixel value (for example are defined as first candidate, the value ADDL of Figure 12), the second direction average pixel value and the difference between the input pixel value of object pixel are defined as second candidate (for example, the value ADDR of Figure 12); The adjusted value determiner (for example, comprise the adjusted value determining unit 122 of subtracter 103 among Figure 12) to adjustment calculation device 109, be used on first and second defined plane of remarked pixel value by the remarked pixel position, second point of the object pixel average pixel value that first point, indication that uses indication first direction average pixel value calculated by the 3rd average calculation unit and indication second direction average pixel value thirdly between the position relation be identified for adjusting the adjusted value (for example, the value c of Figure 12) of corrected value; Adjuster (for example, comprising the adjustment unit 123 of multiplier 110 and multiplier 111 among Figure 12) is used to use the adjusted value of being determined by the adjusted value determiner, adjusts first candidate and second candidate determined by the candidate determiner; And selector (for example, the selector 124 that comprises fixed value generator 112 and determiner 113 among Figure 12), (for example be used under the preset selection criterion selecting first and second candidates adjusted by adjuster and predetermined fixed value, 0) in one, and selected value is set to corrected value.

The adjusted value determining unit will be at the absolute value of second the flection value of locating that connects first point, and straight line thirdly at second (for example, among Figure 12 as the value b of ABS element output signal), divided by between first and second along second distance (for example, among Figure 12 as the value h of absolute difference computation device 107 output signals), and determine adjusted value based on the merchant who obtains (for example, merchant b/n).

In first average calculation unit and second average calculation unit each (is for example determined in by second defined plane of first of the remarked pixel position and remarked pixel value, the plane of Figure 13) whether the polarity of straight slope changes, straight line connects respectively, and indication (for example falls into definite computer capacity, the point of the input pixel value of the k scope D of Figure 13) (for example, the point 132 of Figure 13, the point 133 and put 134).Do not change if determine the polarity of straight slope, then use one of each calculating first direction average pixel value in k the input pixel value and second direction average pixel value.If determine the reversing of straight slope, then according to (for example by the indicated input pixel value of the point before the reversing, the pixel value α that the point 133 of Figure 13 is indicated), by the indicated input pixel value of the point after the reversing (for example proofread and correct in k input pixel value (for example according to the equation of discussing later (3)), the pixel value β that the point 134 of Figure 13 is indicated), and use input pixel value calibrated in k input pixel value (for example shown in Figure 13, at the pixel value of the pixels of proofreading and correct back point 134 indications according to equation (3) is that pixel value γ=α) and all the other uncorrected input pixel values (for example shown in Figure 3, as in statu quo to use each pixel value α of the pixel of point 132 and 133) calculate one of first direction average pixel value and second direction average pixel value.As shown in figure 13, point 131 is object pixels, and pixel value α is the second direction average pixel value that calculates.

Adjuster also comprise first adjuster (for example, comprise Figure 12 ALTI module 81 Fig. 5 pick up ambiguity correction device 23) and second adjuster (filter module 22 that for example, has Fig. 5 of structure shown in Figure 8).First adjuster comprises acquiring unit, first average calculation unit, second average calculation unit, corrected value determining unit and first adder unit.Second adjuster comprises: motion (is for example asked the average filter unit, average filter 51 is asked in the motion of Fig. 8), be used to respond one of parameter value corresponding to object pixel and (for example change characteristic that the fuzzy motion of indicating image asks average filter, convert characteristic H2, H3 and H4 in the frequency domain to), it is that the average filter operation is asked in the motion of feature that each input pixel value of pixel in the predetermined block that comprises object pixel is carried out with the characteristic after the conversion, and input pixel value that will obtain, calibrated, object pixel is exported as first value; Subtractor unit (for example, the subtracter 52 of Fig. 8) is used to calculate the input pixel value of object pixel and asks poor between first value of average filter unit output from motion, and should differ to be worth as second and export; With second adder unit (for example, the adder 54 of Fig. 8), being used for will be from second value of subtractor unit output and the input pixel value addition of object pixel, and will obtain and export as the output pixel value of object pixel.

Image processing equipment can also comprise be used to carry out the rate transition operation the rate transition unit (for example, the frame rate converter 11 of Fig. 1), the rate transition operation is transformed into second speed higher than first rate with the speed of the access unit in the moving image from current first rate.Adjuster is (being under the situation at Fig. 1 after the rate transition operation) before or after the rate transition operation is carried out to access unit to be processed in the rate transition unit, the pixel value of each of a plurality of pixels of correction formation access unit to be processed.

Another embodiment of the present invention relates to the image processing method of image processing equipment (image processing equipment of the treatment step among the step S3 of execution graph 3), be used for detecting and obtain at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place based on each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device.This image processing method comprises step: according to each the pixel value of proofreading and correct corresponding at least one parameter value of access unit to be processed in a plurality of pixels that constitute each access unit to be processed (for example, the step S4 of Fig. 3).This aligning step comprises: obtain substep, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and obtaining with the object pixel is input pixel value (for example, the step S21 of Figure 15 and the S22) center, that be adjacent to be arranged in n the pixel (n is equal to or greater than 3 integer) on the first direction; The first mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k the pixel (k is the integer less than n/2) on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction (for example, the step S24 of Figure 15); The second mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction (for example, the step S25 of Figure 15); Corrected value is determined substep, be used for according to the relation between the input pixel value of first direction average pixel value that the first mean value calculation substep calculates, object pixel, the second direction average pixel value that in the second mean value calculation substep, calculates, be identified for the corrected value (for example, the step S26 of Figure 15 is to S29) of the input pixel value of correction target pixel; With the addition substep, be used for and will determine the input pixel value addition of determined corrected value of substep and object pixel at corrected value, and will obtain and as the output pixel value of object pixel output (for example, the step S30 of Figure 15).

According to embodiments of the invention, also provide according to the computer program of this image processing method and the recording medium of storage computation machine program.As hereinafter described, computer program is stored in the recording medium removable recording medium 311 and the hard disk in being included in memory cell 308, and is carried out by the computer with structure shown in Figure 27.

The image processing equipment of one embodiment of the invention is used as part or all of whole TV system.Here, television system refers to and comprises that at least one has the system of the audio-video device of television receiver.

Embodiments of the invention are described with reference to the accompanying drawings.

Fig. 1 is the functional-block diagram of the image processing device of one embodiment of the invention.

Image processing device 1 is carried out multiple image processing process based on each access unit.Access unit is meant the unit (for example frame or) of moving image, and means the part or all of of the entire frame that constitutes moving image.Here frame is meant the single frame of rest image.For the purpose of interest of clarity, 1 pair of motion image data of image processing equipment serves as that various image processing process are carried out on the basis with every frame.

As shown in Figure 1, image processing equipment 1 comprises frame rate converter 11, picks up fuzzy behaviour detector 12 and picks up fuzzy controller 13.

Frame rate converter 11 is that basic receiving moving pictures signal (as television broadcasting signal) is as motion image data with every frame.

If there is no need between moving image and motion image data thereof, to distinguish, so these data be referred to as moving image.Similarly, if there is no need between frame and frame data thereof, to distinguish, so these data are referred to as frame.

Behind the moving image that receives first frame rate, the moving image of 11 pairs of inputs of frame rate converter is carried out high frame-rate conversion and is handled, and the moving image with second frame rate higher than first frame rate that will obtain offers and picks up fuzzy behaviour detector 12 and pick up fuzzy controller 13.

Carrying out high frame-rate conversion when first frame rate of importing is lower than second frame rate of output handles.Create new frame and be inserted between the consecutive frame of moving image of input, thereby convert moving image to second frame rate higher than first frame rate.

First frame rate refers to the frame rate of the moving image that is input to frame rate converter 11.First frame rate can be any speed, and normally the image pick-up device (not shown) picks up the image pickup frame rate of moving image.

Pick up the parameter value that fuzzy behaviour detector 12 detects the captured image fuzzy behaviour on the every frame that is used to indicate the moving image that formation provides from frame rate converter 11.Pick up the testing result of fuzzy behaviour detector 12, that is, indicate the parameter value that picks up fuzzy behaviour to be fed to and pick up fuzzy controller 13.

The parameter that fuzzy behaviour is picked up in indication is not limited to any specific one.The object lesson of the parameter of the characteristic of indication captured image will be described later.

Detected number of parameters is not limited to any particular value from a frame.For example, can detect indication from a frame or from each pixel that constitutes this frame and pick up a parameter value of fuzzy characteristic.Perhaps, a frame can be divided into several, and can be that a parameter value of fuzzy characteristic is picked up in basis detection indication with the piece.

In response to every frame that the moving image that provides from frame rate converter 11 is provided, pick up fuzzy controller 13 according to detected corresponding to one of parameter value frame to be processed, every frame that the moving image that provides from frame rate converter 11 is provided, proofread and correct the pixel that constitutes frame to be processed by picking up fuzzy behaviour detector 12.Specifically, pick up fuzzy controller 13 in response to pick up fuzzy behaviour (parameter value) in frame to be processed, the pixel value of the frame of treatment for correcting picks up fuzzy with control.

The pixel value of proofreading and correct each pixel of configuration frame does not have fuzzy moving image to produce.Moving image with second frame rate higher than first frame rate externally outputs to image processing equipment 1 by picking up fuzzy controller 13.

As shown in Figure 1, use with frame rate converter 11 with the combination of picking up fuzzy controller 13 picking up fuzzy behaviour detector 12.Can use this combination individually, also can use with another image processing function module (not shown).

Only pick up fuzzy behaviour detector 12 and still can be used to control image blurring purpose with the combination of picking up fuzzy controller 13.In order to realize more images fuzzy control effect, preferably with frame rate converter 11 with picking up fuzzy behaviour detector 12 and picking up fuzzy controller 13 and use.The reason of doing like this is described below.

When the moving image that shows on the display unit (not shown) focuses on human retina, the people discerned fuzzy take place when being the maintenance fuzzy (holdblur) that when the moving object that occurs in people's pursuit movement image, takes place and image pickup at moving image pick up fuzzy combination.

Pick up fuzzy characteristic and represent that with low-pass filter signal this will describe with reference to Fig. 4 in the back.Being subjected to picking up the fuzzy picture signal that influences is equivalent to by the low-pass filter signal to there not being fuzzy picture signal (that is ideal image signal) the execution low-pass filtering operation of captured image to obtain.Therefore, being picked up the fuzzy picture signal that influences descends more severely on frequency domain characteristic than picking up fuzzy picture signal before.Specifically, compare with picking up fuzzy picture signal before, frequency is high more, and the gain of being picked up the fuzzy picture signal that influences descends many more.

Similarly, keep fuzzy characteristic also to represent with low-pass filter signal.Specifically, kept the fuzzy picture signal that influences to be equivalent to the low-pass filtering version of the picture signal (that is, being picked up the fuzzy picture signal that influences) before maintenance is fuzzy.Compare with the picture signal before keeping fuzzy the generation, kept the fuzzy video frequency characteristic that influences to reduce.Specifically, compare with the picture signal that does not have to keep fuzzy, frequency is high more, is kept the gain of the fuzzy picture signal that influences to descend many more.Keeping fuzzy only takes place when display unit is fixed pixel maintenance display unit.

Can be kept the fuzzy picture signal that influences to carry out high frame-rate conversion handling to control and keep fuzzy by what frequency characteristic was reduced.Handle even carry out high frame-rate conversion, pick up and fuzzyly also still can not change.Image blurring purpose on the control human retina has only realized half.With reference to Fig. 2 this is discussed.

The fuzzy frequency characteristic of the image that Fig. 2 diagram focuses on human retina when image pick-up device (below be called video camera) picks up object (4 pixel/frame) with movement velocity 4 motions in the image pickup territory.As shown in Figure 2, abscissa is represented frequency, and ordinate is represented gain.The value representation of dividing on the abscissa is 1 o'clock relative value at nyquist frequency.

As shown in Figure 2, the curve h0 that dot-dash is alternate represents the fuzzy frequency characteristic of the image that forms on human retina when not carrying out the processing that improves fuzzy (comprise pick up fuzzy and keep fuzzy).The moving image that is input to the image processing equipment 1 of Fig. 1 is not handled and is shown on display unit through image processing equipment 1.When the people watched such moving image, the fuzzy frequency characteristic of the image that forms on human retina was represented by curve h0.

If high frame-rate conversion is handled display speed is doubled, it is fuzzy then only to have improved maintenance.The fuzzy frequency characteristic of the image that forms on human retina as a result, is represented by bent dotted line h1.The moving image that 11 pairs of frame rate converters are input to the image processing equipment 1 of Fig. 1 is carried out high frame-rate conversion and is handled, and resulting then moving image is not input to and picks up fuzzy controller 13 (be used for improving pick up fuzzy) and show on display unit.The fuzzy frequency characteristic of the image that forms on human retina is represented by bent dotted line h1.

If display speed doubles in high frame-rate conversion is handled (improved and kept fuzzy) and further improved half and picked up fuzzy degree, it is represented that the fuzzy frequency characteristic of the image that then forms on human retina becomes the solid line h2 of Fig. 2.Specifically, the moving image that 11 pairs of frame rate converters are input to the image processing equipment 1 of Fig. 1 is carried out high frame-rate conversion and is handled, and it is fuzzy to pick up picking up of fuzzy controller 13 controlled motion images.On display screen, show the moving image that obtains.When the people watched moving image on the display screen, the fuzzy frequency characteristic of the image that forms on human retina was represented by curve h2.

Comparison curves h1 and curve h2.Only handle the fuzzy behaviour that can not on human retina, produce enough levels to the improvement that keeps bluring by high frame-rate conversion.Need further pick up blur.Usually carry out high frame-rate conversion simply and handle, do not pick up fuzzy importance and do not note improving.

Each image processing equipment of the embodiment of the invention shown in Fig. 1,23 and 24 also comprises except frame rate converter 11 and picks up fuzzy behaviour detector 12 and pick up fuzzy controller 13, so as to improve pick up fuzzy.Specifically, as shown in Figure 2, the fuzzy behaviour on the human retina is improved to curve h2 from curve h0.Picking up fuzzy behaviour detector 12 is not the essential element of the image processing equipment of the embodiment of the invention, and this describes with reference to Figure 25 and 26.

Picking up fuzzy controller 13 is picked up fuzzy behaviour and corresponding to one of parameter value of frame to be processed, is proofreaied and correct the pixel value of each pixel that constitutes frame to be processed by what pick up that fuzzy behaviour detector 12 detects according to expression.Picking up fuzzy controller 13 controls thus owing to the fuzzy image quality decrease that causes of picking up on the frame after the high frame-rate conversion processing.Specifically, will offer the display unit (not shown) from the picture signal of image processing equipment (as image processing equipment 1) output.Display unit display image thus worsens the clear video that is under control.

Use rightly with frame rate converter 11 with the combination of picking up fuzzy controller 13 picking up fuzzy behaviour detector 12.

The image processing operations of image processing equipment 1 that has the functional structure of Fig. 1 with reference to the flow chart discussion of Fig. 3.

In step S1, frame rate converter 11 receives the moving image with first frame rate.

In step S2, frame rate converter 11 with the frame rate of moving image from first frame-rate conversion to second frame rate higher than first frame rate.

Moving image with second frame rate is provided to from frame rate converter 11 and picks up fuzzy behaviour detector 12 and pick up the fuzzy controller 13 each.Processing advances to step S3.

In step S3, pick up fuzzy behaviour detector 12 at least one expression of detection from the every frame that constitutes moving image and pick up the parameter value of fuzzy behaviour.

The parameter value that picks up fuzzy behaviour that constitutes in every frame of moving image when at least one expression is provided to when picking up controller 13 from picking up fuzzy behaviour detector 12, handles advancing to step S4.

In step S4, pick up fuzzy controller 13 according to pick up at least one parameter value that fuzzy behaviour detector 12 is detected every frame that the moving image that provides from frame rate converter 11 is provided, proofread and correct the pixel value of each pixel that constitutes frame to be processed.

In step S5, pick up fuzzy controller 13 and proofread and correct the pixel value of every frame, and export moving image resulting, that have second frame rate higher than first frame rate.

Finished the image processing operations of Fig. 3 like this.

In above-mentioned discussion,, the treatment step of the moving image execution in step S1 of unit to S4 handled in conduct for purposes of simplicity of explanation.Yet the unit of processing is a frame in fact, under many circumstances.

In the image processing of Fig. 3, handling unit in each step is moving image.Specifically, be under such condition, to carry out in step S1 step transitions from a step to another step in the S5, that is, any step that provides is all finished on whole moving image.

If handling unit in the image processing of Fig. 3 is frame, be under such condition, to carry out then in step S1 step transitions from a step to another step in the S5, that is, any step that provides is all finished on entire frame.In other words, if the processing unit in each step is a frame, then the series of processing steps from step S1 to S4 is (to walk abreast) to carry out separate frame.For example, can be in first frame execution in step S3, execution in step S2 in second frame simultaneously.

In fact, in the middle of the pixel that constitutes frame to be processed, be provided with the pixel (below be called object pixel) of interest continuously, and individually object pixel carried out step S3 and S4 at least under many circumstances.In other words, the processing unit of step S3 and S4 is a pixel.

In the following discussion, the processing unit of step S3 and S4 is a pixel.Specifically, the treatment step among the step S3 is carried out by picking up fuzzy behaviour detector 12, and the treatment step among the step S4 is carried out by picking up fuzzy controller 13.Therefore each the processing unit that picks up fuzzy behaviour detector 12 and pick up in the fuzzy controller 13 is a pixel.

Describe in detail below and pick up fuzzy controller 13 in the image processing equipment 1 of Fig. 1.Specifically, the processing of picking up fuzzy controller 13 is described below, wherein the absolute value of motion vector is picked up the parameter of fuzzy behaviour as expression.

The absolute value of motion vector is called movement velocity, and the direction of motion vector is called the direction of motion.The direction of motion can be any direction in the two dimensional surface.Image processing equipment 1 can be set to carry out under the situation of any direction in the two dimensional surface multiple processing in the direction of motion.For purposes of simplicity of explanation, the direction of motion is aimed at horizontal direction.

Pick up the parameter of fuzzy behaviour as expression if use movement velocity, then pick up fuzzy behaviour detector 12 in the middle of the frame that constitutes moving image, with constitute every frame to be processed each continuous pixels be set to object pixel, detect motion vector continuously, and motion vector offered as the parameter value that picks up fuzzy behaviour at expression object pixel place pick up fuzzy controller 13 at each object pixel place.

Pick up fuzzy controller 13 in the middle of the frame that constitutes moving image, with constitute every frame to be processed each continuous pixels be set to object pixel, and according to the movement velocity of the object pixel that provides from pixel fuzzy behaviour detector 12, the pixel value of correction target pixel.

Describe below why moving image can be used as the reason that the parameter of fuzzy behaviour is picked up in expression.

Picking up fuzzy behaviour represents with the form that depends on object of which movement speed usually.

When the video camera shot object, object itself can move in real space, and video camera is fixed.The movement velocity of object comprises the movement velocity with the object (image) of frame motion.When the object in being fixed on real space was taken, video camera was owing to the shake of hand is moved.In addition, during taking, object and video camera all may move in real space.In this case, occur in the speed of related movement of the object in the real space.This speed is also included within the movement velocity.

Therefore, picking up fuzzy behaviour represents with the form of the movement velocity of each pixel of depending on the image that constitutes object.

The movement velocity of pixel refers to pixel in the frame to be processed and the space length between the respective pixel in the former frame.If the space length between the respective pixel in pixel in the frame to be processed and the tight former frame is v pixel (v is equal to or greater than 0 arbitrary integer), then the movement velocity of this pixel is the v pixel/frame.

Be set to object pixel if will constitute one of the pixel of the image of object, then the fuzzy behaviour of picking up of this object pixel is represented with the form of the movement velocity value v pixel/frame that depends on the object pixel place.

Specifically, if the movement velocity of object pixel is 2,3 and 4 pixel/frame, then the fuzzy behaviour of picking up of object pixel is represented to H4 by curve H2 shown in Figure 4 respectively.

Fig. 4 illustrates the figure that picks up fuzzy behaviour of the object pixel that has movement velocity 2,3 and 4 pixel/frame respectively.As shown in Figure 4, abscissa is represented frequency, and ordinate is represented gain.The value of dividing on the abscissa is to be 1 o'clock relative value at nyquist frequency.

Discussed why vector speed can be used as the reason that the parameter of fuzzy behaviour is picked up in expression.

, pick up fuzzy behaviour and can ask average filter (low pass filter) expression to shown in the H4 as the frequency characteristic H2 among Fig. 4 by the motion in the spatial domain.

Specifically, make H represent to move and ask (picking up fuzzy) transfer function of average filter (low pass filter), F represents not pick up fuzzy ideal image signal in the frequency domain (promptly, at the signal that picks up before bluring), and h represents to stand to pick up fuzzy picture signal in the frequency domain (promptly, in the picture signal of picking up after bluring), represent by following equation (1) at the picture signal G that picks up after bluring:

G＝H×F ...(1)

For eliminate pick up fuzzy, from picking up the known signal G after fuzzy and picking up fuzzy known transfer function H prediction and calculation at the signal F that picks up before fuzzy.The prediction and calculation of expressing in the following execution equation (2):

F＝inv(H)×G ...(2)

In equation (2), inv (H) is the inverse function of picking up fuzzy transfer function.Because picking up fuzzy transfer function has the low pass filter feature, so inverse function inv (H) has the high pass filter feature.

As mentioned above, pick up fuzzy transfer function H and change its characteristic in response to movement velocity.Specifically, the frequency characteristic of picking up fuzzy transfer function H at object pixel place with movement velocity of 2,3 and 4 pixel/frame is represented uniquely by curve H2, H3 and H4 shown in Figure 4.

Pick up fuzzy controller 13 and revise in response to movement velocity and pick up the characteristic of fuzzy transfer function H, and determine to have the inverse function inv (H) of transfer function H of the characteristic of modification.Use inverse function inv (H), pick up the arithmetic processing that fuzzy controller 13 is carried out by equation (2) expression.Picking up fuzzy controller 13 eliminates (control) thus and picks up fuzzy.

In frequency domain, carry out the arithmetic processing shown in the equation (2).To pick up fuzzyly in order controlling, to pick up fuzzy controller 13 and can in spatial domain, carry out and the processing of arithmetic processing equivalence shown in the equation (2).Specifically, pick up fuzzy controller and can carry out first to the 3rd following processing.

In first handles, pick up fuzzy controller 13 in response to from picking up the movement velocity of the object pixel that fuzzy behaviour detector 12 provides, the characteristic that average filter (low pass filter) asked in fuzzy motion is picked up at conversion expression object pixel place.Specifically, for average filter is asked in each warm-up in a plurality of movement velocitys, and selection is asked one of average filter corresponding to the motion of the movement velocity of object pixel.

Second processing comprises handles 2-1 to 2-3.

In handling 2-1, ask average filter to carry out Fourier transform to motion with the characteristic that in first handles, is converted, ask average filter with expression motion in frequency domain.Specifically, curve H2, H3 shown in Figure 4 and H4 are respectively that object pixel at the movement velocity with 2,3 and 4 pixel/frame obtains.If in frequency domain, consider, then carry out and handle 2-1 to determine in the fuzzy transfer function H of picking up of each object pixel place.

In handling 2-2, calculate in handling 2-1 and ask the contrary of average filter in the motion of frequency domain representation.If in frequency domain, consider, carry out and handle 2-2 to generate the inverse function inv that picks up fuzzy transfer function H (H) shown in the equation (2).

In handling 2-3, ask the contrary inverse fourier transform of carrying out of average filter to handling the motion that calculates among the 2-2, represent in the frequency domain.Specifically, in handling 2-3, generate high pass filter (Weiner filter) corresponding to inverse function inv (H).In other words, generate the inverse filter that average filter is asked in motion.The high pass filter that generates in handling 2-3 is called contrary motion and asks average filter.

In the 3rd handles, input and picture signal g in the corresponding spatial domain of the frequency-region signal G that picks up the equation (2) after bluring.Then, the filtering operation of average filter is asked in the picture signal g of the input contrary motion that is subjected to being generated in handling 2-3.In the 3rd handles, recover (prediction and calculation) and signal f in the corresponding spatial domain of the frequency-region signal F that picks up the equation (2) before bluring.Specifically, the predetermined block that comprises object pixel in the frame to be processed is subjected to the filtering operation that average filter is asked in contrary motion.Like this, the pixel value of correction target pixel in the 3rd handles.

In Fig. 5 of the Japanese patent application 2004-234051 that transfers the assignee identical, disclosed and carried out first to the 3rd embodiment who picks up fuzzy controller 13 who handles with the present invention.

The fuzzy controller 113 that picks up with the configuration disclosed in Fig. 5 of Japanese patent application 2004-234051 has another shortcoming.To shown in the H4, the frequency that fuzzy motion asks average filter (and frequency characteristic) to comprise to cause 0 gain is picked up in expression as the frequency characteristic H2 among Fig. 4.For this reason, pick up fuzzy controller and be difficult to generate the complete inverse filter (the contrary fully average filter of asking) that moves and ask average filter.As a result, increased noise.This is first shortcoming.

Picture signal is used the 3rd of high pass filter (average filter is asked in contrary motion) to be handled and means that to make the edge of filter precipitous.Known the precipitous definition technique in filter edge is comprised be called " LTI (luminance transient improvement) " (luminance transient improvement) and sharp keen (sharpness).These known technology can be applied to pick up fuzzy controller 13.

Pick up fuzzy controller 13 if the technology that these are known is applied to, second to the 5th new shortcoming then occurs.

In the open No.2000-324364 of the patent application of Japanese unexamined, disclosed " LTI " technology.According to the open No.2000-324364 of the patent application of Japanese unexamined, use the brightness (pixel value) of replacing object pixel to come the brightness of correction target pixel with the brightness (pixel value) of object pixel adjacent pixels.As a result, make the edge precipitous.Yet the LTI technology is for noise unhealthy and strong (robust), thereby the processing image that obtains may be damaged by noise.This is second shortcoming.Make all edges become precipitous, and do not consider to use LTI technology view data before.This is the 3rd shortcoming.

In image processing, use known technology " LTI " and " sharp keen ".In the 4th shortcoming, will not have image blurring rest image and picked up fuzzy rest image to handle comparably.In the 5th shortcoming, use known technology equably and no matter pick up fuzzy degree.

Inventor of the present invention developed thus have Fig. 5 functional structure pick up fuzzy controller 13.Fig. 5 is the functional-block diagram that picks up fuzzy controller 13.

As shown in Figure 5, picking up fuzzy controller 13 comprises high fdrequency component arrester 21, filter module 22 and picks up adjuster 23.

In to the description of picking up fuzzy controller 13, be input to the signal that constitutes the square frame (comprising the arithmetical unit such as adder) pick up fuzzy controller 13 and be commonly referred to input signal, rather than such as moving image, constitute the frame of every frame and constitute input signal unit each pixel value of every frame.Similarly, the signal of exporting from each the function square frame that picks up fuzzy controller 13 is commonly referred to output signal, rather than the output signal unit.In other words,, just use name (as pixel value) based on the unit if require to use input signal unit and output signal unit, otherwise, input signal and output signal used simply.

As shown in Figure 5, the output signal conduct from frame rate converter 11 is fed to high fdrequency component arrester 21 to the input signal that picks up fuzzy controller 13.Offer filter module 22 and pick up in the ambiguity correction device 23 each from the output signal of picking up fuzzy behaviour detector 12.The output signal of high fdrequency component arrester 21 offers filter module 22.The output signal of filter module 22 is provided to picks up ambiguity correction device 23.The output signal of picking up ambiguity correction device 23 is as the final output signal output of picking up fuzzy controller 13.

To go through high fdrequency component arrester 21, filter module 22 below successively and pick up ambiguity correction device 23.

Describe high fdrequency component arrester 21 in detail with reference to Fig. 6 and 7.

Fig. 6 is the functional-block diagram of high fdrequency component arrester 21.Fig. 7 is the performance plot of high-frequency limitations device 32 of the high fdrequency component arrester 21 of Fig. 6.

As shown in Figure 6, high fdrequency component arrester 21 comprises high pass filter 31, high-frequency limitations device 32 and subtracter 33.

As shown in Figure 6, the output signal of frame rate converter 11 as be fed to the input signal of high fdrequency component arrester 21 in high pass filter 31 and the subtracter 33 each.

Have the high frequency filter 31 of high pass filter function thereby from the signal that is input to high fdrequency component arrester 21, extract high fdrequency component, and high fdrequency component is offered high-frequency limitations device 32.

High-frequency limitations device 32 has the function shown in the solid line 41 of Fig. 7.The high fdrequency component that provides from high pass filter 31 is applied to function as input parameter, and the output (output of Fig. 7) of this function is offered subtracter.As the solid line 41 of Fig. 7 is clearly shown that, if the input high fdrequency component that provides from high pass filter 31 is lower than a constant value or is higher than a constant value, high-frequency limitations device 32 restriction input high fdrequency components then.In other words, high-frequency limitations device 32 provides the characteristic shown in the solid line 41 of Fig. 7.

Get back to Fig. 6, subtracter 33 calculates the input signal of high fdrequency component arrester 21 and poor by between the high fdrequency component of high-frequency limitations device 32 restriction, and the difference signal that obtains is offered filter module 22 as the output signal of high fdrequency component arrester 21.

High fdrequency component arrester 21 is eliminated the high fdrequency component such as noise from input signal, and the signal that obtains is offered filter module 22 as output signal.

Describe filter module 22 in detail below with reference to Fig. 8 to 10.

Fig. 8 is the detailed functional block diagram of filter module 22.Fig. 9 is the detailed functional block diagram of gain controller 53 of the filter module 22 of Fig. 8.Figure 10 is the performance plot of adjusted value determiner 64 of the gain controller 53 of Fig. 9.

As shown in Figure 8, filter module 22 comprises that motion asks average filter 51 to subtracter 54.

As shown in Figure 8, the output signal of high fdrequency component arrester 21 offers motion as the input signal of filter module 22 and asks in average filter 51, subtracter 52 and the adder 53 each.The output signal of picking up fuzzy behaviour detector 12 offers motion and asks in average filter 51 and the gain controller 53 each.

Motion asks the input signal of 51 pairs of filter modules 22 of average filter to carry out Filtering Processing motion is asked average.Specifically, motion asks average filter 51 in the middle of the input signal of filter module 22, the pixel value of each pixel of constituting predetermined block is carried out motion ask the average filter operation, and predetermined block comprises the object pixel in the frame to be processed.The pixel value of average filter 51 thereby correction target pixel is asked in motion.In this was handled, motion asked average filter 51 to ask the characteristic of average filter in response to the movement velocity converting motion of the object pixel of the output signal of picking up fuzzy behaviour detector 12.Specifically, if the movement velocity of object pixel is 2,3 and 4 pixel/frame, then the characteristic that average filter 51 is converted to its characteristic as previously discussed, is represented by curve H2, H3 and the H4 of Fig. 4 is asked in motion in frequency domain.Ask the pixel value of the object pixel of average filter 51 corrections to offer subtracter 52 through motion.

Subtracter 52 determine filter modules 22 input signal object pixel correction preceding pixel value and ask poor between the pixel value of the object pixel that average filter 51 proofreaies and correct through motion, and the difference that obtains is supplied with gain controller 53.The output signal of subtracter 52 is called motion and asks the average filter front and back poor.

Gain controller 53 is adjusted motion and is asked the average filter front and back poor, and adjusted difference is offered adder 54 as output signal.To describe gain controller 53 in detail with reference to Fig. 9 in the back.

Adder 54 is the output signal addition of the input signal and the gain controller 53 of filter module 22, and will offer as output signal with signal and pick up ambiguity correction device 23.Specifically, the pixel value addition of the object pixel before adder 54 will be asked difference before and after the average filter and proofread and correct as the motion of adjusted value, and will obtain and offer the outside ambiguity correction device 23 that picks up as the pixel value of calibrated object pixel.

The above-mentioned processing of the filter module 22 that consideration is carried out in spatial domain in frequency domain below.

It is poor before and after the average filter that the motion of supposing to be considered as the output signal of subtracter 52 in frequency domain is asked, the gain of the output signal of the subtracter 52 of following surface analysis on interested frequency.On interested frequency, the gain of the input signal of filter module 22 and passed through motion and asked gain inequality between the gain of input signal of average filter 51 to become the gain of the output signal of subtracter 52.The gain of the output signal of subtracter 52 is called motion and asks average filter front and back gain inequality.

Gain inequality was adjusted by gain controller 53 before and after average filter was asked in motion.Gain adjustment will be described later.

If in frequency domain, consider the output signal of the filter module 22 (subtracter 54) of Fig. 8, then the gain of output signal on interested frequency be by the gain of the input signal of subtracter 54 and the motion adjusted of being subjected to gaining are asked the gain inequality addition obtains before and after the average filter and gain.On each frequency, the gain of output signal is from gain rising gain inequality before and after average filter is asked in the adjusted motion of gain of input signal.

In other words, whole filter module 22 is carried out the processing of handling equivalence basically with high-pass filtering.

Describe gain controller 53 in detail below with reference to Fig. 9.

As shown in Figure 9, gain controller 53 comprises that delay cell 61-1 is to 61-n (below be called DL 61-1 to DL 61-n), maximum/minimum (MAX/MIN) calculator 62, subtracter 63, adjusted value determiner 64 and multiplier 65.

As shown in Figure 9, will ask average filter front and back gain inequality to offer DL unit 61-1 as the motion of subtracter 52 output signals as the input signal of gain controller 53.The output signal of picking up fuzzy behaviour detector 12 offers MAX/MIN calculator 62.

Gain controller 53 is configured to control the damped oscillation (ringing) that may take place in high signal level zone.

The functional structure (the connection configuration of square frame) and the operation of gain controller 53 are described below.

DL unit 61-1 connects with cascade system to DL unit 61-n.When a delay cell received the output signal of last delay cell, delay cell postponed predetermined time of delay with input signal, and delayed signal is offered back one delay cell as its output signal.The output signal of DL unit 61-1 each in the DL unit 61-n also offers MAX/MIN calculator 62.The output signal of DL unit 61-n/2 also offers multiplier 65.

From asking as the motion of the input signal of gain controller 53 before and after the average filter in the middle of the gain inequality, will be respectively be the center with the object pixel, be arranged in the corresponding value of n pixel on the direction of motion (being horizontal direction) (below be called pixel value before and after poor) here continuously and be input to DL unit 61-n in proper order continuously with from right to left pixel arrangement.Equal the n time of delay time doubly if passed through, then DL unit 61-1 will output to MAX/MIN calculator 62 with n the pixel corresponding pixel value front and back difference that is the center with the object pixel, is adjacent to align respectively to DL unit 61-n on the direction of motion.Difference is provided for MAX/MIN calculator 62 and multiplier 65 before and after the pixel value of the target pixel value of DL unit 61-n/2 output.

DL unit 61-1 is not limited to any optional network specific digit to the numeral " n " of DL unit 61-n, is maximum movement speed " pixel/frame ".From the movement velocity of picking up the object pixel that fuzzy behaviour detector 12 provides is the v pixel/frame.Here, v is any more than or equal to 0 integer.

MAX/MIN calculator 62 determines to comprise that the movement velocity v with object pixel is as scope poor before and after the pixel value of v the pixel at scope center, as computer capacity.Definite maximum MAX and the minimum value MIN the difference before and after v pixel value that comprise the computer capacity of MAX/MIN calculator 62 difference before and after n the pixel value that provides to DL unit 61-n by DL unit 61-1, and maximum MAX and minimum value MIN offered subtracter 63.

Why the movement velocity v of selection with object pixel as computer capacity, is because damped oscillation influences the tap number of high pass filter as the scope of difference before and after the pixel value of v the pixel at its center, in other words, and movement velocity.

Poor between the maximum MAX that provides from MAX/MIN calculator 62 and the minimum value MIN is provided for subtracter 63, and with difference (=MAX-MIN) be provided to adjusted value determiner 64.

Difference (MAX-MIN) is big more, and near the damped oscillation the object pixel is just big more.Difference (MAX-MIN) is as near the indicating device of the damped oscillation size the object pixel.

In response to the difference (MAX-MIN) that subtracter 63 provides, adjusted value determiner 64 is determined the adjusted value to difference before and after the pixel value of object pixel, and this adjusted value is offered multiplier 65.

Specifically, adjusted value determiner 64 keeps by the function shown in the solid line 71 of Figure 10, and will supply with this function as parameter from the difference (MAX-MIN) that subtracter 63 provides, and the output (output of Figure 10) of function will be offered multiplier 65 as the adjusted value to difference before and after the pixel value of object pixel.Shown in the shape of the solid line 71 of Figure 10 is clear,, then reduce the generation that adjusted value (output) is controlled damped oscillation if the difference (MAX-MIN) that provides from subtracter 63 surpasses a constant value.Adjusted value determiner 64 thereby have the characteristic shown in the solid line 71 of Figure 10.

Get back to Fig. 9, the pixel value front and back difference that multiplier 65 provides DL unit 61-(n/2) multiply by (falling in the 0-1 scope shown in Figure 10) adjusted value that adjusted value determiner 64 provides, and product is offered adder 54 as difference before and after the pixel value of adjusted object pixel.Difference is provided to adder 54 continuously as the output signal of gain controller 53 before and after the pixel value of each pixel that process is adjusted.

If the difference (MAX-MIN) as the output signal of subtracter 63 surpasses this constant value, and become big, then adjusted value (output) is reduced to 1 or 0 gradually.If greater than this constant value, then difference multiply by adjusted value less than 1 before and after the pixel value of object pixel as the difference (MAX-MIN) of the output of subtracter 63.As a result, difference diminishes before and after the pixel value of object pixel.Thereby controlled near the object pixel damped oscillation.

In spatial domain the processing of gain controller 53 therefore be equivalent to be used to control damped oscillation, ask gain inequality is carried out before and after the average filter frequency domain gain to adjust to motion to handle.

Pick up ambiguity correction device 23 below with reference to Figure 11 to 19 description.

Figure 11 is the detailed functional block diagram of picking up ambiguity correction device 23.

As shown in figure 11, pick up ambiguity correction device 23 and comprise ALTI module 81, subtracter 82, gain controller 83 and adder 84.

As shown in figure 11, the output of filter module 22 is input in ALTI module 81, subtracter 82 and the adder 84 each as the input signal that picks up ambiguity correction device 23.The output signal of picking up fuzzy behaviour detector 12 offers each of ALTI module 81 and gain controller 83.

Processing that the pixel value of the object pixel of the input signal that picks up ambiguity correction device 23 is carried out, ALTI module 81 each in the adder 84 is described below.

The pixel value that is provided to the object pixel that picks up ambiguity correction device 23 is proofreaied and correct by high fdrequency component arrester 21 and filter module 22, and different with the pixel value that picks up fuzzy controller 13 that is input to Fig. 5 usually.As discussing after a while, the pixel value of object pixel is suitably proofreaied and correct in picking up ambiguity correction device 23.For purposes of simplicity of explanation, the pixel value that is input to each square frame that picks up ambiguity correction device 23 is called input pixel value, and the pixel value of exporting from each square frame that picks up ambiguity correction device 23 is called output pixel value.One of function square frame receives a plurality of different pixel value of same pixel from the function square frame before a plurality of.In this case, the pixel value (mainly, the pixel value before proofreading and correct) near original pixel value is called input pixel value, and other pixel values are called the output pixel value of function square frame afterwards.For example, subtracter 82 is from the different pixel values of ALTI module 81 and filter module 22 receiving target pixels.Be called input pixel value from the pixel value of filter module 22 inputs, and be called the output pixel value of ALTI module 81 from the pixel value of ALTI module 81 inputs.

ALTI module 81 is in response to determining corrected value from the movement velocity of picking up the object pixel that fuzzy behaviour detector 12 provides, with the input pixel value addition of corrected value and object pixel, and will obtain and offer subtracter 82 as the output pixel value of object pixel.With reference to Figure 12 ALTI module 81 is discussed further.

Subtracter 82 calculates poor between the input pixel value of the output pixel value of object pixel of ALTI modules 81 and object pixel, and poor (below be called the object pixel difference) that will obtain offers gain controller 83.

Gain controller 83 is in response to from picking up the movement velocity of the object pixel that fuzzy behaviour detector 12 provides, adjustment is from the object pixel difference of subtracter 82, and object pixel difference that will be through adjusting offers adder 84 as the correction of a final proof value of object pixel.

Adder 84 is the input pixel value of object pixel and correction of a final proof value addition from gain controller 83, and will obtain and output to the outside as the pixel value of the object pixel of correction of a final proof.

ALTI module 81 and the gain controller 83 that picks up in the ambiguity correction device 23 described in more detail below successively.

Describe ALTI module 81 in detail with reference to Figure 12 to 17.

Figure 12 is the detailed functional block diagram of ALTI module 81.

As shown in figure 12, ALTI module 81 comprises that delay cell 91-1 is to 91-n (below be called DL unit 91-1 to DL unit 91-n), average value calculator 92 to 94, corrected value determiner 95 and adder 96.

The functional structure (that is the connection of function square frame configuration) and the operation of ALTI module 81 are described below.

DL unit 91-1 is to DL unit 91-n cascade successively.When a delay cell received the output signal of last delay cell, delay cell postponed predetermined time of delay with input signal, and delayed signal is offered back one delay cell as output signal.The output signal of DL unit 91-1 each in the DL unit 91-(n/2-1) also offers average value calculator 93.Pixel value from DL unit 91-(n/2-1), DL unit 91-(n/2) and DL unit 91-(n/2+1) output also offers average value calculator 92 respectively.The pixel value of output offers average value calculator 94 from DL unit 91-(n/2+1) to DL unit 91-n.Also offer corrected value determiner 95 and the adder 96 each from the pixel value of DL unit 91-(n/2) output.

The pixel value that is the center with the object pixel, is adjacent to n the pixel of aligning here on the direction of motion (being horizontal direction) is input to DL unit 91-1 with pixel arrangement order from right to left from filter module 22.Equal the n time of delay time doubly if passed through, then DL unit 91-1 to DL unit 91-n export respectively and be the center with the object pixel, be adjacent to arrange the pixel value of n pixel in the horizontal direction.

In being discussed below, be called the input pixel value of ALTI module 81 to the pixel value of each step output of DL unit 91-n at DL unit 91-1.

Specifically, the input pixel value N of DL unit 91-(n/2) export target pixel.The input pixel value of n/2-1 pixel that is adjacent to be arranged in the left side of object pixel is exported from DL unit 91-1 to DL unit 91-(n/2-1) respectively.The input pixel value of n/2-1 pixel that is adjacent to be arranged in the right of object pixel is exported from DL unit 91-(n/2+1) to DL unit 91-n respectively.

DL unit 91-1 is not limited to any optional network specific digit to the numeral " n " of DL unit 91-n, is maximum movement speed " pixel/frame ".As previously discussed, be the v pixel/frame from the movement velocity of picking up the object pixel that fuzzy behaviour detector 12 provides.

The input pixel value N of average value calculator 92 receiving target pixels, at the input pixel value of the pixel on the object pixel left side with at the input pixel value on object pixel the right.Average value calculator 92 calculates the input pixel value N of object pixels, at the input pixel value of the pixel on the object pixel left side with at the mean value Na (Na is called the average pixel value of object pixel) of the input pixel value of the pixel on object pixel the right, and average pixel value Na offered corrected value determiner 95.

Determine by corrected value determiner 95, the corrected value ADD of object pixel is adjusted by predetermined adjusted value c.Adjusted value c is not a fixed value, but the variable value of in predetermined process (below be called adjusted value determine handle), determining.In the adjusted value of present embodiment is determined to handle, use the average pixel value Na of object pixel.Can in determining to handle, use adjusted value the input pixel value N of object pixel.If object pixel is affected by noise, then may damage the image after the processing.Image after handling damages, and uses the average pixel value Na of object pixel.

The input pixel value of n/2-1 the pixel that is adjacent to be arranged in the object pixel left side is provided for average value calculator 93.Average value calculator 93 select from the pixel that is being close to object pixel, be adjacent to arrange on the left side of object pixel, quantity is approximately half k pixel (k is about v/2) of object pixel movement velocity, and will comprises that the scope of the input pixel value of k pixel is defined as computer capacity.The mean value La that is included in k input pixel value in the computer capacity average pixel value La of left pixel (below be called) is provided from n/2-1 the input pixel value that is provided average value calculator 93, and the average pixel value La of left pixel is offered corrected value determiner 95.

The input pixel value of n/2-1 the pixel that is adjacent to be arranged in object pixel the right is provided for average value calculator 94.Average value calculator 94 select from the pixel that is being close to object pixel, be adjacent to arrange on the right of object pixel, quantity is approximately half k pixel (k is about v/2) of object pixel movement velocity, and will comprises that the scope of the input pixel value of k pixel is defined as computer capacity.The mean value Ra that is included in k input pixel value in the computer capacity average pixel value Ra of right pixel (below be called) is provided from n/2-1 the input pixel value that is provided average value calculator 94, and the average pixel value Ra of right pixel is offered corrected value determiner 95.

Determine to handle and be used for determining processing (below be called candidate determine to handle) the average pixel value La of the left pixel of use of corrected value candidate and the average pixel value Ra of right pixel at adjusted value.

In the known LTI technology that discloses in the patent disclosure No.2003-324364 of Japanese unexamined, the difference of being separated by between the input pixel value of the single pixel (below be called left pixel) of preset distance and object pixel on the object pixel left side is confirmed as the first corrected value candidate.The difference of being separated by between the input pixel value of the single pixel (below be called right pixel) of preset distance and object pixel on object pixel the right is confirmed as the second corrected value candidate.One of first candidate and second candidate are defined as not adding the corrected value of any adjusted value.In known LTI technology,, then can not suitably determine corrected value (with two corrected value candidates) if the input pixel value of one of left pixel and right pixel comprises noise.

In order to overcome this shortcoming, candidate in one embodiment of the invention uses the average pixel value La of left pixel and the average pixel value Ra of right pixel in determining to handle, suitably determining the corrected value candidate, rather than use the input pixel value of one of left pixel and right pixel simply.

The rate of change that falls into the input pixel value of the pixel in the computer capacity may not be constant.Pixel value can reduce after increasing, and also can increase after reducing.At abscissa remarked pixel horizontal level, in the plane of ordinate remarked pixel value (plane of the Figure 13 of Tao Luning after a while), the slope polarity of straight line that connects the point (as the point 131 to 134 of Figure 13 of discussing after a while) of the input pixel value that comprises in the expression computer capacity may be reversed.If the simple average value of the input pixel value that comprises in the employing computer capacity as the average pixel value La of left pixel or the average pixel value Ra of right pixel, the new shortcoming of corrected value (candidate) then can occur suitably determining.

The average value calculator 93 of one embodiment of the present of invention and average value calculator 94 be following to have overcome this new shortcoming.In the input pixel value that comprises from computer capacity, first represented input pixel value β after the reversing is updated to pixel value γ by the right of calculating equation (3).The input pixel value α of second expression of the right of equation (3) before by reversing represents.By calculating one of the average pixel value La of left pixel and average pixel value Ra of right pixel as the pixel value γ after upgrading by the input pixel value of the pixel of first expression:

γ＝α-H×f(H) ...(3)

Wherein H represents poor between the input pixel value β of the input pixel value α of second point (intermediate point 133 of Fig. 3) before the reversing and first point after the reversing (intermediate point 134 of Fig. 3), that is, and and alpha-beta.

Figure 13 illustrates 12 pixels that are adjacent to be arranged on the horizontal direction that comprises object pixel 121.As shown in figure 13, abscissa is represented the location of pixels on the horizontal direction, and ordinate remarked pixel value.(that is, the average pixel value Ra of right pixel) computer capacity is scope D to the computer capacity of average value calculator 94, and scope D comprises pixel value α, α and the β of three respective point 132 to 134 on point 131 the right of representing object pixel.

In Figure 13, determine the polarity of the straight slope of tie point 133 and 134.Point 134 is the points of first after the reversing, is second preceding points of reversing and put 133.Average value calculator 94 will be put 133 remarked pixel value α and input pixel value α and be placed on the right of equation (3) by the poor H (=alpha-beta) between the input pixel value β of point 134 expressions, be modified as pixel value γ thereby will put the 134 input pixel value β that represent.Average value calculator 94 adopt pixel value γ as in the computer capacity D, by the input pixel value after the renewals of point 134 expressions, and adopt the input pixel value of all the

other points

132 and 133 that are in its original pixel value α to calculate the average pixel value Ra of right pixel.Specifically, Ra=(α+α+γ)/3.

According to the right of embodiment of the invention calculation equation (3) time, the function with characteristic shown in the solid line 141 of Figure 14 is as function f (H).

As shown in figure 14, if pixel value α before the reversing and the poor H between the pixel value β after the reversing are value H2 or bigger, function f (H) becomes 0.Big poor H means that the slope after reversing is steep.If the constant value that the slope ratio after the reversing is scheduled to (that is, value H2) is steeper, then by equation (3), the pixel value γ after the renewal becomes pixel value α.Specifically, if the predetermined constant value of the slope ratio after the reversing is steeper, the input pixel value of the pixel of point 134 expressions after then using pixel value α as reversing, rather than pixel value β.Thereby the average pixel value Ra of the right pixel of calculating in computer capacity D.Specifically, and Ra=(α+α+α)/3=α, thus the average pixel value Ra of right pixel is defined as α.

As shown in figure 14, if pixel value α before the reversing and the difference value of the being not more than H1 between the pixel value β after the reversing, then function f (H) is 1.Little poor H means straight slope mild after reversing.If the value that the slope ratio after the reversing is scheduled to is milder, in other words,,, also remain pixel value β even upgrade back pixel value γ then according to equation (3) if difference H is not more than H1.If the straight slope after the reversing equals or is milder than predetermined value, the input pixel value of the pixel of point 134 expressions when then using pixel value β, after the reversing as the average pixel value Ra that in computer capacity D, calculates right pixel.Specifically, the average pixel value Ra of right pixel is defined as Ra=(α+alpha+beta)/3.

Owing to following reason, if the straight slope after the reversing equals or be milder than predetermined value, then in statu quo use original pixel value β, and do not upgrade the some pixel value of 134 expressions.When the straight slope after the reversing equaled or be milder than predetermined value, reversing was in response to noise easily and takes place.Yet the average pixel value Ra of right pixel more suitable, that do not have noise asks on average rather than to the pixel value after the renewal input pixel value to ask average acquisition.

The calculating of the average pixel value Ra of right pixel has been discussed with reference to Figure 13.When calculating the average pixel value La of left pixel, according to equation (3), the input pixel value of the pixel that the point after the reversing is represented is updated to pixel value γ from pixel value β.

Get back to Figure 12, corrected value determiner 95 is determined corrected value ADD based on from the input pixel value N of the object pixel of DL unit 91-(n/2), from the average pixel value Na of the object pixel of average value calculator 92, from the average pixel value La of the left pixel of average value calculator 93 with from the average pixel value Ra of the right pixel of average value calculator 94.Corrected value ADD offers adder 96 then.

Adder 96 self-correctings in the future are on the occasion of the corrected value ADD of determiner 95 and input pixel value N addition from the object pixel of DL unit 91-(n/2), and it is that will obtain and offer the subtracter 82 of ALTI module 81 outsides as the output pixel value (that is the pixel value of calibrated object pixel) of object pixel.

Before the detailed functional block diagram that corrected value determiner 95 is discussed, below with reference to the processing of the flow chart description ALTI module 81 of Figure 15.

In step S21, ALTI module 81 is provided with object pixel.

In step S22, the DL unit 91-1 in the ALTI module 81 is to DL unit 91-n reference n input pixel value of input pixel value N acquisition as the object pixel of central value.

In step S23, the average value calculator 92 in the ALTI module 81 is calculated the average pixel value Na of object pixel as previously discussed, and the average pixel value Na that obtains is offered corrected value determiner 95.

In step S24, the average value calculator 93 in the ALTI module 81 is calculated the average pixel value La of left pixel as previously discussed, and the average pixel value La that obtains is offered corrected value determiner 95.

In step S25, the average value calculator 94 in the ALTI module 81 is calculated the average pixel value Ra of right pixel as previously discussed, and the average pixel value Ra that obtains is offered corrected value determiner 95.

As shown in figure 12, average value calculator 92 to 94 is carried out its processing with being mutually independent.Step S23 is not limited to order shown in Figure 15 to the order of S25.Thereby execution in step S23 is to S25 independently of one another.

In step S26, the corrected value determiner 95 in the ALTI module 81 is based on from the input pixel value N of the object pixel of DL unit 91-(n/2), determine two corrected value candidate ADDL and ADDR from the average pixel value La of the left pixel of average value calculator 93 with from the average pixel value Ra of the right pixel of average value calculator 94.Processing among the step S26 refers to above-mentioned candidate and determines to handle.Corrected value candidate ADDL and ADDR are respectively the subtracter 101 discussed later and the output of subtracter 102.Definite processing of candidate among the step S26 and corrected value candidate ADDL and ADDR will describe in detail after a while.

In step S27, corrected value determiner 95 is based on from the average pixel value Na of the object pixel of average value calculator 92, determine adjusted value c from the average pixel value La of the left pixel of average value calculator 93 with from the average pixel value Ra of the right pixel of average value calculator 94.The adjusted value of mentioning before processing among the step S27 refers to is determined to handle.Adjusted value c is the output signal of the adjustment calculation device 109 discussed later.Adjusted value among the step S27 is determined to handle and adjusted value c will describe in detail after a while.

Step S26 and S27 carry out independently of each other.The order of step S26 and S27 is not limited to the order described in Figure 15.

In step S28, corrected value determiner 95 uses adjusted value c to adjust corrected value candidate ADDL and ADDR.Processing among the step S28 is called to adjust to be handled.Adjust and handle and to describe in detail after a while.

In step S29, corrected value determiner 95 determine (selections) through according to one of the corrected value candidate ADDL of adjusted value c (being 0 under the preset selection criterion) adjustment and ADDR as corrected value ADD, and selected value offered adder 96.Processing among the step S29 is called corrected value and selects to handle.Corrected value is selected to handle and will be described (comprising selection criterion) after a while in detail.

In step S30, the adder 96 in the ALTI module 81 is the input pixel value N addition of corrected value ADD and object pixel, and will obtain and offer subtracter 82 as the output pixel value of object pixel.

In step S31, ALTI module 81 determines whether to have handled all pixels.

If in step S31, determine also not handle all pixels, then handle turning back to step S21 and come the repetition above-mentioned steps.Specifically, another pixel is set to object pixel, with the input pixel value N addition of corrected value ADD and object pixel, and will obtain and output to outside subtracter 82 as the output pixel value of object pixel.Pixel is different usually with pixel value N and corrected value ADD between the pixel.

Along with each pixel be made as object pixel and repeating step S21 to the circular treatment of S31, if in step S31, determine to have handled all pixels, then finish the processing of ALTI module 81.

ALTI module 81 is parts that pick up fuzzy controller 13 of Figure 13, thereby a part of handling among the step S4 of processing as Fig. 3 of the ALTI module 81 of Figure 15 and carrying out.

The processing of corrected value determiner 95 execution in step S26 in the S29.Return Figure 12, describe the detailed functions of corrected value determiner 95 below with step S26 to the processing among the S29.

As shown in figure 12, corrected value determiner 95 comprises subtracter 101 and subtracter 102, is used for carrying out definite processing of candidate of Figure 15.In other words, the candidate among the candidate determining unit 121 execution in step S26 that are made of subtracter 101 and subtracter 102 is determined to handle.

Subtracter 101 calculate from the average pixel value La of the left pixel of average value calculator 93 and between the input pixel value N of the object pixel of DL input unit 91-(n/2) poor (=La-N), and the difference that will obtain offers multiplier 110 as corrected value candidate ADDL.

If as discussing after a while, corrected value candidate ADDL is confirmed as corrected value ADD and needn't adjusts (using adjusted value c=1), then adder 96 with corrected value ADD (=La-N) with the input pixel value N addition of object pixel, and output obtain and (=La).If corrected value candidate ADDL (=La-N) as corrected value ADD, then be corrected (substituting) and be the average pixel value La of left pixel as the original pixel value N of the pixel value of object pixel.

Subtracter 102 calculate from the average pixel value Ra of the right pixel of average value calculator 94 and between the input pixel value N of the object pixel of DL input unit 91-(n/2) poor (=Ra-N), and the difference that will obtain offers multiplier 111 as corrected value candidate ADDR.

If as discussing after a while, corrected value candidate ADDR is confirmed as corrected value ADD and needn't adjusts (using adjusted value c=1), then adder 96 with corrected value ADD (=Ra-N) with the input pixel value N addition of object pixel, and output obtain and (=Ra).If corrected value candidate ADDR (=Ra-N) as corrected value ADD, then be corrected (substituting) and be the average pixel value Ra of right pixel as the original pixel value N of the pixel value of object pixel.

As shown in figure 12, corrected value determiner 95 comprises subtracter 103 to adjustment calculation device 109, and the adjusted value that is used for carrying out among the step S27 of Figure 15 is determined to handle.In other words, the adjusted value among the adjusted value determiner 122 execution in step S27 that are made of to adjustment calculation device 109 subtracter 103 is determined to handle.

Subtracter 103 calculate from the average pixel value Na of the object pixel of average value calculator 92 and between the average pixel value La of the left pixel of average value calculator 93 poor (=Na-La), and the difference that will obtain offers adder 105.

Subtracter 104 calculate from the average pixel value Na of the object pixel of average value calculator 92 and between the average pixel value Ra of the right pixel of average value calculator 94 poor (=Na-Ra), and the difference that will obtain offers adder 105.

Adder 105 is the output signal addition of subtracter 103 and subtracter 104, and will obtain and output to ABS unit 106.

The absolute value b of the output signal of ABS unit 106 computation adder 105, and absolute value b offered divider 108.

In the defined plane of abscissa by the location of pixels on the ordinate of remarked pixel value and the expression horizontal direction, first point of the average pixel value La that will the left pixel of expression that draws a straight line, the average pixel value Na of expression object pixel second and represent thirdly being linked in sequence of average pixel value Ra of right pixel with this.This straight line is calculated by subtracter 103, subtracter 104 and adder 105 second flection value of locating.ABS unit 106 calculates the absolute value b of flection value, and absolute value b is offered divider 108.The absolute value b of 106 outputs is called flection absolute value b from the ABS unit.

Consider the straight line thirdly of the average pixel value Ra of first of the average pixel value La that connects the left pixel of expression in the plane and the right pixel of expression, second of the average pixel value Na of flection absolute value b representative expression object pixel with line at a distance of how far.

Corrected value determiner 95 is adjusted corrected value candidate ADDL and ADDR in response to the value of flection absolute value b, and determines that one of corrected value candidate ADDL through adjusting and ADDR are corrected value ADD.Specifically, adder 96 is exported as the output pixel value of object pixel with the input pixel value N of object pixel with according to the corrected value ADD sum that the value of flection absolute value b is adjusted.Thereby the edge part of the output signal of adder 96 (frame to be processed) rises thereon along mild.

Given same flection absolute value b, the absolute value h of the difference between the average pixel value La of left pixel and the average pixel value Ra of right pixel, that is, and in the plane first may be different with the distance h on ordinate thirdly (below be called height h).If like this, the meaning of the value of flection absolute value b will dissimilate.Specifically, if on the value certain degree of flection absolute value b less than height h, in other words, if by flection absolute value b be in height h the merchant (=b/h) less, then be easy to generate noise around the object pixel.On the contrary, so not little if the value of flection absolute value b is compared with height h, in other words, if the merchant (=b/h) relatively large, then be not easy to produce noise around the object pixel.

Iff adjusting corrected value candidate ADDL and ADDR in response to the value of flection absolute value b, then the corrected value ADD of the input pixel value N of object pixel can become identical no matter whether noise occurs.This causes another shortcoming, that is, and and the input pixel value N of correction target pixel suitably.

In order to overcome this new shortcoming, the adjusted value determiner 122 in the corrected value determiner 95 of present embodiment of the present invention also comprises absolute difference computation device 107, divider (b/h calculator) 108 and adjustment calculation device 109 except subtracter 103 to ABS unit 106.

Absolute difference computation device 107 calculates from the average pixel value La of the left pixel of average value calculator 93 and poor between the average pixel value Ra of the right pixel of average value calculator 94, and the absolute value h (h=|La-Na|) of calculating difference, promptly, the height h that before mentions, and highly h offers divider 108.

Divider 108 will be from the flection absolute value b of ABS unit 106 divided by the height h from absolute difference computation device 107, and the merchant that will obtain (=b/h) offer adjustment calculation device 109.The merchant (=b/h) be the value of determining by with height h standardization flection absolute value b.The merchant (=be called standardization flection value below b/h).

In response to the standardization flection value from divider 108, adjustment calculation device 109 calculates the adjusted value c to corrected value candidate ADDL and ADDR, and adjusted value c is provided in multiplier 110 and the multiplier 111 each.

Adjustment calculation device 109 keeps having the function by characteristic shown in the solid line 151 of Figure 16.Adjustment calculation device 109 will be used as function parameters from the standardization flection value of divider 108, and the output (output of Figure 16) of function is offered multiplier 110 and multiplier 111 as adjusted value c.

Shown in the shape of the solid line 151 of Figure 16, if standardization flection value (b/h) is not more than constant value b1, then adjusted value c (output) is 0.This be because pixel to be the probability of noise very high.As will discussing after a while, it is that 0 adjusted value c adjusts that corrected value candidate ADDL and ADDR multiply by.Thereby become 0 adjusting post-equalization value candidate ADDL and ADDR.Corrected value ADD also becomes 0, so the input pixel value of object pixel is not calibrated.

When standardization flection value was increased to greater than constant value b1, adjusted value c (output) also increased.As will discussing after a while, corrected value candidate ADDL and ADDR multiply by respectively to less than 1 adjusted value c.In adjusting post-equalization value candidate ADDL and ADDR each all becomes littler than its original value.Corrected value ADD is less than one of the corrected value candidate ADDL of original value separately and ADDR.The pixel value of the object pixel after the correction is greater than the average pixel value La of left pixel or less than the average pixel value Ra of right pixel.

If standardization second corrected value is equal to or greater than constant value b2, then adjusted value c (output) is 1.As will discussing after a while, it is 1 adjusted value c that each when adjusting among corrected value candidate ADDL and the ADDR multiply by.Thereby keep its original value constant (in other words, not carrying out adjustment) at corrected value candidate ADDL and ADDR.Corrected value ADD is in one of the corrected value candidate ADDL of its original value and ADDR.The pixel value of object pixel is one of the average pixel value La of left pixel and average pixel value Ra of right pixel.

According to present embodiment, adjusted value c is to use the function of characteristic shown in the solid line 151 with Figure 16 to determine.Standardization flection value is input in the function.Use adjusted value c to adjust corrected value ADD (or rather, adjusting corrected value candidate ADDL and ADDR) with adjusted value.The output signal of adder 96 (frame to be processed) therefore gently rises in its edge part.In known LTI, the pixel value of object pixel is proofreaied and correct by hardware switch (in other words, the only switching of pixel value), thereby can not realize mild rising edge part in the output signal of pixel value.According to present embodiment, ALTI module 81 has overcome this problem.

Get back to Figure 12, continue to discuss corrected value determiner 95.Corrected value determiner 95 comprises that multiplier 110 and multiplier 111 are with the processing of the adjustment among the step S28 that carries out Figure 15.In other words, the set-up procedure among the adjustment unit 123 execution in step S28 that constitute by multiplier 110 and multiplier 111.

Multiplier 110 will multiply by the adjusted value c from adjustment calculation device 109 from the corrected value candidate ADDL of subtracter 101, and the product that obtains is offered determiner 113 as the corrected value candidate ADDL through adjusting.

Multiplier 111 will multiply by the adjusted value c from adjustment calculation device 109 from the corrected value candidate ADDR of subtracter 102, and the product that obtains is offered determiner 113 as the corrected value candidate ADDR through adjusting.

Corrected value determiner 95 comprises that fixed value generator 112 and determiner 113 are with the selection of the corrected value among the step S29 that carries out Figure 15 processing.In other words, the corrected value among the selector 124 execution in step S29 that are made of fixed value generator 112 and determiner 113 is selected to handle.

Fixed value generator 112 in the present embodiment constantly generates " 0 " signal shown in Figure 12, and " 0 " signal is offered determiner 113.

Determiner 113 receives the output signal from subtracter 103, subtracter 104, adder 105, multiplier 110, multiplier 111 and fixed value generator 112.Determiner 113 is according to the selection criterion of being determined by the output of subtracter 103, subtracter 104 and adder 105, select from fixed value generator 112 " 0 " signal, from the corrected value candidate ADDL of multiplier 110 and from one of corrected value candidate ADDR of multiplier 111 as corrected value ADD.Determiner 113 offers adder 96 with selected signal.

In the defined plane of abscissa, line is made as the straight line thirdly of the average pixel value Ra of first of the average pixel value La that connects the left pixel of expression and the right pixel of expression by the ordinate of remarked pixel value and remarked pixel position.If the change direction of this line upwards and second of the average pixel value Na of expression object pixel be positioned at the line top, then the selection criterion of present embodiment is to select corrected value candidate ADDR as corrected value ADD.On the contrary, if the change of line is directed downwards and second be positioned at line below, choice criteria then of the present invention is to select corrected value candidate ADDL as corrected value ADD.

Determiner 113 concerns according to the change direction of the signal identification line of subtracter 103, subtracter 104 and adder 105 outputs and line and position between second.

If determiner 113 identifies change direction that line makes progress and second point that is positioned at the line top according to the output signal of subtracter 103, subtracter 104 and adder 105, then determiner 113 selects corrected value candidate ADDR from multiplier 111 as corrected value ADD, and this corrected value ADD is offered adder 96.

If determiner 113 identifies change direction that line makes progress and second point that is positioned at the line below according to the output signal of subtracter 103, subtracter 104 and adder 105, then determiner 113 selects corrected value candidate ADDL from multiplier 110 as corrected value ADD, and this corrected value ADD is offered adder 96.

If object pixel is positioned at the place outside the edge part, then the selection criterion of present embodiment is to select " 0 " as corrected value ADD.If each output that determiner 113 identifies from subtracter 103, subtracter 104 and adder 105 is about 0, in other words, if the input pixel value N of the average pixel value La of left pixel, object pixel and the average pixel value Ra of right pixel be approximately equal each other, then determiner 113 identifies object pixel and is positioned at place outside the edge part.Determiner 113 is selected to offer adder 96 from " 0 " signal of fixed value generator 112 and with " 0 " signal then.

The ALTI module 81 of Figure 12 has been described.As long as ALTI module 81 is carried out the processing that is equivalent to above-mentioned series processing step, ALTI module 81 can be taked any functional structure.For example, ALTI module 81 can be taked the functional structure of Figure 17.The structure of the ALTI module 81 that Figure 17 diagram is different with the functional structure of Figure 12.

As shown in figure 17, ALTI module 81 comprises mask signal generator 161, LTI processor 162 and asks averaging unit 163.

The output signal of mask signal generator 161 receiving filter modules 22 is as its input signal, and each continuous pixels that constitutes frame to be processed is set to object pixel.The pixel in the pixel on mask signal generator 161 ferret out pixel right sides and object pixel left side.Each of a left side pixel quantity and right pixel quantity all is half of movement velocity of object pixel.161 pairs of demonstrations of mask signal generator are carried out shielding processing corresponding to the signal of the pixel value of the pixel count that equals movement velocity.As previously discussed, the movement velocity of object pixel provides by picking up fuzzy behaviour detector 12.Signal through shielding is provided to LTI processor 162 from mask signal generator 161.

LTI processor 162 is carried out LTI to each through signal of shielding and is handled, and the signal that obtains offered as output signal asks averaging unit 163.

Ask the 163 pairs of LTI processors of averaging unit 162 and the output signal of mask signal generator 161 number of searches equal numbers to ask on average, and the signal that obtains is offered outside subtracter 82 as output signal.

ALTI module 81 in the pickup model adjuster 23 of Figure 11 has been discussed with reference to Figure 12 to 17.

The gain controller 83 in the ambiguity correction device 23 of picking up of Figure 11 is described below with reference to Figure 18 and 19.

Figure 18 is the detailed functional block diagram of gain controller 83.The characteristic of the adjusted value determiner 171 in the gain controller 83 of Figure 19 diagram Figure 18.

The gain controller 83 of Figure 18 is made of adjusted value determiner 171 and multiplier 172.

Function shown in the solid line 181 of adjusted value determiner 171 maintenance Figure 19.Adjusted value determiner 171 will offer function as parameter from the movement velocity of picking up the object pixel that fuzzy behaviour detector 12 provides, and the output (output of Figure 19) of function is offered multiplier 172 as adjusted value.In other words, adjusted value determiner 171 has the characteristic of the solid line 181 of Figure 19.

Multiplier 172 receives from the adjusted value of adjusted value determiner 171 with from the output signal of subtracter 82.Discuss with reference to the functional-block diagram of Figure 11 as the front, the output signal of subtracter 82 is correction of a final proof value candidates, and it will be by the input pixel value addition of picking up adder 84 and object pixel in the ambiguity correction device 23.Multiplier 172 multiply by adjusted value from adjusted value determiner 171 with correction of a final proof value candidate, and the product that obtains is offered adder 84 as final adjusted value.

From the functional-block diagram that picks up ambiguity correction device 23 of the solid line shape of Figure 19 and Figure 11 as can be seen, gain controller 83 is carried out control and treatment, and the processing output of the ALTI module 81 when slow with convenient movement velocity (below be called ALTI) can not produce big influence to the correction of a final proof value of the pixel value of object pixel.When movement velocity was slow, gain was owing to picking up fuzzy little decline.Gain descends to increasing to gain by the filter module 22 by Fig. 5 and 8 simply and compensates.The output signal of filter module 22 can be used as final output signal and is provided to without the correction of any reality picks up ambiguity correction device 23.

Discussed and picked up fuzzy controller 13 in the image processing equipment 1 of Fig. 1 with reference to Fig. 5 to 19.

Pick up fuzzy controller 13 and be not limited to the functional structure of Fig. 5.Figure 20 and 21 diagrams are according to the functional structure of picking up fuzzy controller 13 of other embodiments of the invention.

With Fig. 5 to pick up fuzzy controller 13 the same, the fuzzy controller 13 that picks up of Figure 20 comprises high fdrequency component arrester 21, filter module 22 and picks up ambiguity correction device 23.

The same with picking up in the fuzzy controller 13 of Fig. 5, the output signal of frame rate converter 11 is fed to high fdrequency component arrester 21 as the input signal that picks up fuzzy controller 13 to Figure 20.Offer filter module 22 and pick up in the ambiguity correction device 23 each from the output signal of picking up fuzzy behaviour detector 12.

As shown in figure 20, the output signal of high fdrequency component arrester 21 offers picks up ambiguity correction device 23, and the output signal of picking up ambiguity correction device 23 is provided to filter module 22.The output signal of filter module 22 provides as the final processing output signal of picking up fuzzy controller 13.

As shown in figure 20, filter module 22 and to pick up ambiguity correction device 23 opposite with the relevant position of Fig. 5 on position.In other words, the filter module 22 and the order of placement (that is processing sequence) of picking up ambiguity correction device 23 are not limited to specific one.Can at first carry out filter module 22 and pick up in the processing of ambiguity correction device 23 any.

With Fig. 5 and 20 to pick up fuzzy controller 13 the same, the fuzzy controller 13 that picks up of Figure 21 comprises high fdrequency component arrester 21, filter module 22 and picks up ambiguity correction device 23.The fuzzy controller 13 that picks up of Figure 21 also comprises adder 24.

The same with picking up in the fuzzy controller 13 of Fig. 5 and 20, the output signal of frame rate converter 11 is fed to high fdrequency component arrester 21 as the input signal that picks up fuzzy controller 13 to Figure 21.Offer filter module 22 and pick up in the ambiguity correction device 23 each from the output signal of picking up fuzzy behaviour detector 12.

As shown in figure 21, the output signal of high fdrequency component arrester 21 offers filter module 22 and picks up in the ambiguity correction device 23 each.Filter module 22 offers adder 24 with the output signal of picking up ambiguity correction device 23.Adder 24 with the output signal of filter module 22 with pick up the output signal addition of ambiguity correction device 23, and will obtain and as the final processing output signal output of picking up fuzzy controller 13.

Filter module shown in Figure 21 22 and pick up ambiguity correction device 23 parallel layouts, and Fig. 5 and the filter module 22 shown in 20 with pick up ambiguity correction device 23 and be connected with cascade system.Filter module 22 and pick up ambiguity correction device 23 and can arrange with parallel mode or cascade system.If filter module 22 and pick up ambiguity correction device 23 and adopt linear memories (line memory), filter module 22 then shown in Figure 21 and the parallel layout of picking up ambiguity correction device 23 allow filter module 22 and pick up ambiguity correction device 23 common lines memories.Thereby reduced the number of parts in the interlock circuit.

In known image processing techniques, it is fuzzy to handle picking up of moving object uniformly, and no matter fog-level and rest image state.According to the embodiment of the invention, use and pick up fuzzy controller 13, thereby permission improves fuzzy and do not produce damped oscillation by the enhancing amount of calculation of motion vectors change corresponding to the moving image state.Because use hardware switch to come switching signal among the known LTI, therefore treated image self usually is damaged.Having ALTI 81 can be with mild mode switching signal as the fuzzy controller 13 that picks up of its parts, thereby prevents that treated image is damaged.

For purposes of simplicity of explanation, in above-mentioned discussion, the direction (direction of motion) of motion vector is aimed at horizontal direction.Pick up fuzzy controller 13 and on any direction of motion, carry out the processing identical with above-mentioned processing.Specifically, no matter what direction of motion, pick up fuzzy controller 13 all the pixel value of correction target pixel control pick up fuzzy.In the ALTI of Figure 12 module 81, with the object pixel center, the pixel value that is arranged in n pixel on the direction of motion (for example, vertical direction) continuously is input to DL unit 91-1 continuously with the order of pixel arrangement.To other function square frames also is like this.

Picking up fuzzy controller 13 uses movement velocity (absolute value of motion vector) as parameter when proofreading and correct each pixel value.Perhaps, also can use another parameter, as long as this parametric representation is picked up fuzzy behaviour.

For example, picking up fuzzy controller 13 can use the shutter speed of video camera when picking up moving image to be processed to pick up the parameter of fuzzy behaviour as expression.This is because if shutter speed is different as shown in figure 22, then picks up fuzzy degree and influenced by time T s.

Shown in the first half of Figure 22, shutter speed and frame rate all are 1/30 second equally.In the latter half of Figure 22, shutter speed is than frame rate fast (1/30-Ts).In these two parts of Figure 22, the abscissa express time, and ordinate is represented the ratio of shutter opening time.The ratio of shutter opening time refers to (Ts/Vs) * 100%, wherein the Va stopwatch shows shutter speed (Va is any value of 0 that is equal to or greater than), the very first time of shutter opening is 0%, from the very first time through V after second second time of shutter close be 100%, and time T a stopwatch show time span from the very first time to the current time (Ta be any be equal to or greater than 0 and be equal to or less than the value of V).In the ordinate of Figure 11, the value of joining with time shaft is 100%, and maximum (peak of every line) is 0%.In two parts up and down of Figure 22, low more along the ordinate position, the ratio of shutter opening is just big more.

For example, the single photo-sensitive cell of video camera is now corresponding to the single pixel in the frame.If shown in the first half of Figure 22, shutter speed is 1/30 second, then 1/30 second shutter opening in the time from the pixel value output of the integrated value of the light of the single photo-sensitive cell input of video camera as respective pixel.If shutter speed is (1/30-Ts) second, then the shutter opening of (1/30-Ts) second the time in the integrated value from the light of the single photo-sensitive cell input of video camera export as the pixel value of respective pixel.

Shutter speed is corresponding to the optical storage time (time for exposure) of photo-sensitive cell.For example, if exist motion to pass the object of predetermined photo-sensitive cell front in the space, then photo-sensitive cell is in 1/30 second shutter speed than the long Ts of shutter speed second of (1/30-Ts) second, and reception is different from the light (that is bias light) of this object.The ratio of the integrated value of the light (as bias light) different with the light of object will increase greatlyyer under than (1/30-Ts) second shutter speed under 1/30 second shutter speed in the pixel value of single photo-sensitive cell output.

Generally speaking, shutter speed is slow more, and it is big more to pick up fuzzy degree.Shutter speed therefore expression is picked up a fuzzy characteristic.The same with movement velocity, shutter speed also can be picked up the parameter of fuzzy behaviour as expression.

Shutter speed thereby pick up the parameter of fuzzy behaviour as expression.For example, header on the motion image data that provides from frame speed transducer 11 is provided fuzzy behaviour detector 12 analysis of picking up of Fig. 1, detecting shutter speed, and the parameter that the shutter speed data are picked up fuzzy behaviour as expression offered pick up fuzzy controller 13 at every frame.Picking up fuzzy controller 13 uses shutter speed rather than movement velocity to carry out above-mentioned series of steps suitably to proofread and correct each pixel value.Use shutter speed pick up fuzzy controller 13 on functional structure with use movement velocity to pick up fuzzy controller 13 basic identical.Each picked up fuzzy controller 13 and suitably proofreaied and correct each pixel value by using shutter speed to carry out above-mentioned series of steps as parameter with reference to Fig. 5 to 19 discusses in the front.

The image processing equipment 1 with Fig. 1 is described as one embodiment of the present of invention.The invention is not restricted to the image processing equipment 1 of Fig. 1.

Specifically, Figure 23 to 26 is the functional-block diagrams according to the image processing equipment of other embodiments of the invention.

For example, the same with the image processing equipment 1 of Fig. 1, the image processing equipment 201 of Figure 23 comprises frame rate converter 11, picks up fuzzy behaviour detector 12 and picks up fuzzy controller 13.

In the image processing equipment 201 of Figure 23, pick up fuzzy controller 13 and handle the image that is input to image processing equipment 201, that is, and the moving image before the high frame-rate conversion of frame rate converter 11 is handled.Pick up parameter values for detection the moving image of fuzzy behaviour detector 13 before the high frame-rate conversion of frame rate converter 11 is handled, and testing result offered pick up fuzzy controller 13.

The image processing equipment 201 of Figure 23 is carried out with the order of step S1, S2, S4, S2 and S5 and is handled.

For example, the same with the image processing equipment 201 of the image processing equipment 1 of Fig. 1 and Figure 23, the image processing equipment 202 of Figure 24 comprises frame rate converter 11, picks up fuzzy behaviour detector 12 and picks up fuzzy controller 13.

With the same in the image processing equipment 1 of Fig. 1, the fuzzy controller 13 that picks up in the image processing equipment 202 of Figure 24 is handled by frame rate converter 11 and is handled the moving image that has converted to from the moving image of input by high frame-rate conversion.In other words, pick up 13 pairs of moving images of handling through too high frame-rate conversion of fuzzy controller and carry out treatment for correcting.

Yet the fuzzy behaviour detector 12 that picks up in the image processing equipment 202 of Figure 24 detects the parameter that fuzzy behaviour is picked up in expression from the moving image (that is the moving image of also not handling through the high frame-rate conversion of frame rate converter 11) of input.Detecting parameter then offers and picks up fuzzy controller 13.Specifically, pick up fuzzy controller 13 pixel value in the image processing equipment 202 of Figure 24 according to each pixel of parameter correction that from moving image, detects without frame-rate conversion.

The image processing equipment 202 of Figure 24 is with the image processing of the order execution graph 3 of step S1, S2, S3, S4 and S5.Yet in step S3, the parameter value that fuzzy behaviour is picked up in expression is to detect from the moving image (that is, being formed in each frame of the moving image of input among the step S 1) without high frame-rate conversion.

Different with the image processing equipment 202 of the image processing equipment 201 of Figure 23 and Figure 24, in the image processing equipment 212 of Figure 25 and the image processing equipment 231 of Figure 26 each is by frame rate converter 11 and pick up fuzzy controller 13 and constitute, and does not comprise and pick up fuzzy behaviour detector 12.

Shown in Figure 25 and 26, the superimposer 121 that picks up in fuzzy behaviour detector 12 and another image processing equipment 211 (below be called picture signal generator 211) is arranged together.The moving image that is input to picture signal generator 211 offers each of picking up in fuzzy behaviour detector 12 and the superimposer 121.Pick up fuzzy behaviour detector 12 and from moving image, detect expression and pick up the parameter value of fuzzy behaviour, and parameter value is offered superimposer 121.The parameter value that superimposer 121 picks up fuzzy behaviour with the expression signal that moving image and output obtain that is added to.

In the image processing equipment 212 of Figure 25 and the image processing equipment 231 of Figure 26 each receives the moving image (signal) that is superimposed with parameter value on it.

In the image processing equipment 212 of Figure 25, pick up fuzzy controller 13 parameter value is separated with moving image, and each pixel value in the frame of the moving image after proofread and correct to constitute separating according to the parameter value that fuzzy behaviour is picked up in expression.

11 pairs of processes of frame rate converter are picked up the moving image of fuzzy controller 13 corrections and are carried out high frame-rate conversion processing, and export the moving image that obtains, that is, and and through the moving image of too high frame-rate conversion and correction.

The image processing equipment 212 of Figure 25 is with the image processing of the order execution graph 3 of step S1, S4, S2 and S5.

In the image processing equipment 231 of Figure 26, the parameter value that frame rate converter 11 picks up expression fuzzy behaviour separates with moving image, moving image after separating is carried out high frame-rate conversion to be handled, and the moving image that the obtains moving image of too high frame-rate conversion (that is, through) is offered and picks up fuzzy controller 13.The parameter values that separated by frame rate converter 11, fuzzy behaviour is picked up in expression also offer and pick up fuzzy controller 13.

Pick up fuzzy controller 13 and pick up the parameter value of fuzzy behaviour, proofread and correct formation each pixel in every frame of the moving image of high frame-rate conversion, and export the moving image that obtains according to expression, that is, and through the moving image of overcorrect and high frame-rate conversion.

Partly or entirely can carrying out of above-mentioned series of processes step by hardware or software.

The part of the image processing equipment 1 of Fig. 1 (as picking up fuzzy controller 13) or all, the image processing equipment 201 of Figure 23 partly or entirely, the image processing equipment 202 of Figure 24 partly or entirely, the image processing equipment 212 of Figure 25 partly or entirely or partly or entirely can the forming of the image processing equipment 231 of Figure 26 by the computer of Figure 27.

As shown in figure 27, CPU (CPU) 301 is carried out various processing according to being stored in the program in the read-only memory (ROM) 302 and being loaded into one of program of random-access memory (ram) 303 from memory cell 308.RAM 303 stores the required data of CPU 301 where necessary.

CPU 301, ROM 302 and RAM 303 are interconnected with one another by bus 304.Bus 304 is connected to input and input interface 305.

Be connected to having of input and output interface 305 in addition: comprise keyboard and mouse input unit 306, comprise display output unit 307, comprise the memory cell 308 of hard disk and comprise modulator-demodulator and the communication unit of terminal adapter 309.Communication unit 309 is handled by the network executive communication such as the internet.

Driver 310 is connected to input and input interface 305.Removable medium 311 such as disk, CD, magneto optical disk or semiconductor memory is loaded into driver 310, and will be installed on the memory cell 308 from the computer program that removable medium 311 is read.

When the series of processes step is carried out by software, corresponding software programs is installed on the specialized hardware or all-purpose computer of built-in computer, to carry out various processing by network or from recording medium.

The recording medium of storage computation machine program can offer the user respectively with the equipment of Figure 27.Recording medium comprises removable recording medium 211 (package media), comprises that disk (as floppy disk), CD (as compact disc read-only memory (CD-ROM) and digital versatile disc (DVD)), magneto optical disk are (as mini-disk (MD

)) and semiconductor memory.Recording medium also comprises the hard disk that comprises in the ROM 302 of storage computation machine program and the memory cell 308, and each is storing software program and offer the user in equipment all.

The processing of being discussed in this specification is carried out successively with described time series order.Perhaps, can walk abreast or execution in step respectively.

In this specification, system refers to the system that comprises at least one equipment.

The high frame-rate conversion of carrying out among each embodiment that is discussed is in front handled the combination in any of second frame rate (frame rate) of first frame rate (frame rate) that is not limited to above-mentioned incoming video signal and outputting video signal.For example, first frame rate of incoming video signal can be 60 (or 30Hz), and second frame rate of outputting video signal can be 120Hz.Perhaps, first frame rate of incoming video signal can be 60 (or 30Hz), and second frame rate of outputting video signal can be 240Hz.For example, first frame rate of line-by-line inversion (PAL) incoming video signal can be 50Hz, and second frame rate of outputting video signal can be 100 or 200Hz.For example, first frame rate of incoming video signal can be 48Hz, and second frame rate of outputting video signal can be the preset frequency that is higher than 48Hz.

By one of embodiment of discussing according to the front incoming video signal of known electric viewing system is carried out high true speed conversion process, can show contents known with high picture quality.

It will be appreciated by those skilled in the art that and to carry out various modifications, combination, sub-portfolio and alternative according to designing requirement and other factors, as long as they are in the scope of appended claims and equivalent thereof.

Claims

1. image processing equipment, be used for obtaining at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place based on each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, this image processing equipment comprises adjuster, be used for the pixel value according to each of a plurality of pixels of proofreading and correct formation each access unit to be processed corresponding at least one parameter value of access unit to be processed, this adjuster comprises:

Acquisition device, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and obtaining with the object pixel is the input pixel value of n the pixel center, that be adjacent to align on the direction of motion as this moving image of first direction, and n is equal to or greater than 3 integer;

The first mean value calculation device, be used in the middle of the input pixel value that obtains by acquisition device, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction, k is the integer less than n/2;

The second mean value calculation device, be used in the middle of the input pixel value that obtains by acquisition device, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction;

Corrected value is determined device, be used for the input pixel value according to the first direction average pixel value that calculates by the first mean value calculation device, object pixel, the relation between the second direction average pixel value that calculates by the second mean value calculation device, be identified for the corrected value of the input pixel value of correction target pixel; With

First adder spare is used for and will be determined the input pixel value addition of determined corrected value of device and object pixel by corrected value, and will obtain and as the output of the output pixel value of object pixel.

2. image processing equipment as claimed in claim 1, also comprise the 3rd mean value calculation device, the mean value that is used to calculate the input pixel value of object pixel and m the pixel adjacent with object pixel is used as the target average pixel value, and m is equal to or greater than 1 integer

Wherein, corrected value determines that device comprises:

The candidate determining unit is used for the first direction average pixel value of object pixel and the difference between the input pixel value are defined as first candidate, and the second direction average pixel value of object pixel and the difference between the input pixel value are defined as second candidate;

The adjusted value determining unit, be used on second defined plane by first of the remarked pixel position and remarked pixel value, second point of the object pixel average pixel value that first point, indication that uses indication first direction average pixel value calculated by the 3rd mean value calculation device and indication second direction average pixel value thirdly between the position relation be identified for adjusting the adjusted value of corrected value;

Adjustment unit is used to use the adjusted value of being determined by the adjusted value determining unit, adjusts first candidate and second candidate determined by the candidate determining unit; With

Selected cell be used under the preset selection criterion selecting first and second candidates adjusted by adjustment unit and predetermined fixed value one, and selected value is set to corrected value.

3. image processing equipment as claimed in claim 1, wherein, the adjusted value determining unit will be at the absolute value of second the flection value of locating that connects first point, and straight line thirdly at second, divided by between first and second along second distance, and determine adjusted value according to the merchant who obtains.

4. image processing equipment as claimed in claim 1, wherein, in the first mean value calculation device and the second mean value calculation device each determines whether change in first polarity with second defined plane cathetus slope of remarked pixel value by the remarked pixel position, the straight line tie point is indicated k the input pixel value that falls into definite computer capacity respectively;

Do not change if determine the polarity of straight slope, then use k input pixel value to calculate one of first direction average pixel value and second direction average pixel value; And

If determine the reversing of straight slope, then basis is by the indicated input pixel value of point before the reversing, correction by the indicated input pixel value of point after the reversing, and uses input pixel value calibrated in k input pixel value and all the other uncorrected input pixel values to calculate one of first direction average pixel value and second direction average pixel value in k input pixel value.

5. image processing equipment as claimed in claim 1, wherein, adjuster also comprises the first adjuster unit and the second adjuster unit,

Wherein, the first adjuster unit comprises that acquisition device, the first mean value calculation device, the second mean value calculation device, corrected value determine device and first adder spare; And

Wherein, the second adjuster unit comprises:

The average filter device is asked in motion, be used to respond one of parameter value corresponding to object pixel and change the characteristic that average filter is asked in the fuzzy motion of indicating image, it is that the average filter operation is asked in the motion of feature that each input pixel value of pixel in the predetermined block that comprises object pixel is carried out with the characteristic after the conversion, and input pixel value that will obtain, calibrated, object pixel is exported as first value;

The subtraction device is used to calculate the input pixel value of object pixel and asks poor between first value of average filter device output from motion, and should differ to be worth as second and export; With

Second adder spare, being used for will be from second value of subtraction device output and the input pixel value addition of object pixel, and will obtain and export as the output pixel value of object pixel.

6. image processing equipment as claimed in claim 1, wherein, the motion vector that constitutes in each in each a plurality of pixels of a plurality of access units obtains as the parameter value of respective pixel, and described a plurality of access units constitute moving images.

7. image processing equipment as claimed in claim 1 wherein, during when pick up a plurality of access units that constitute moving image by image pick-up device in each, obtains the shutter speed of image pick-up device as parameter value.

8. image processing equipment as claimed in claim 1, also comprise the two-forty switching device that is used to carry out the rate transition operation, the rate transition operation is transformed into second speed higher than first rate with the speed of the access unit in the moving image from current first rate

Wherein, adjuster was proofreaied and correct each pixel value of a plurality of pixels of constituting access unit to be processed before or after the rate transition device is carried out the rate transition operation to access unit to be processed.

9. image processing equipment as claimed in claim 8, wherein, first rate is 30Hz, and second speed is 120Hz.

10. image processing equipment as claimed in claim 8, wherein, first rate is 60Hz, and second speed is 120Hz.

11. image processing equipment as claimed in claim 8, wherein, first rate is 60Hz, and second speed is 240Hz.

12. image processing equipment as claimed in claim 8, wherein, first rate is 50Hz, and second speed is 100Hz.

13. image processing equipment as claimed in claim 8, wherein, first rate is 50Hz, and second speed is 200Hz.

14. image processing method, be used for detecting and obtain at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place based on each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, this image processing method comprises step: according to each the pixel value of proofreading and correct corresponding at least one parameter value of access unit to be processed in a plurality of pixels that constitute each access unit to be processed, this aligning step comprises:

Obtain substep, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and obtaining with the object pixel is the input pixel value of n the pixel center, that be adjacent to align on the direction of motion as this moving image of first direction, and n is equal to or greater than 3 integer;

The first mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction, k is the integer less than n/2;

The second mean value calculation substep, be used for from obtaining in the middle of the input pixel value that substep obtains, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction;

Corrected value is determined substep, be used for being identified for the corrected value of the input pixel value of correction target pixel according to the relation between the input pixel value of first direction average pixel value that the first mean value calculation substep calculates, object pixel, the second direction average pixel value that in the second mean value calculation substep, calculates; With

The addition substep is used for and will determines the input pixel value addition of determined corrected value of substep and object pixel at corrected value, and will obtain and as the output of the output pixel value of object pixel.

15. image processing equipment, be used for obtaining at least one parameter value that is used to refer to the image blurring characteristic that during the moving image of predetermined image pick device picks up, takes place based on each access unit, perhaps from the outside value of getting parms, wherein, described a plurality of access unit constitutes the moving image that is picked up by image pick-up device, this image processing equipment comprises adjuster, be used for the pixel value according to each of a plurality of pixels of proofreading and correct formation each access unit to be processed corresponding at least one parameter value of access unit to be processed, this adjuster comprises:

Acquiring unit, one of a plurality of pixels that are used for constituting access unit to be processed are set to object pixel, and obtaining with the object pixel is the input pixel value of n the pixel center, that be adjacent to align on the direction of motion as this moving image of first direction, and n is equal to or greater than 3 integer;

First average calculation unit, be used in the middle of the input pixel value that obtains by acquiring unit, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the first direction, k is the integer less than n/2;

Second average calculation unit, be used in the middle of the input pixel value that obtains by acquiring unit, according to determine corresponding to the parameter value of object pixel further from object pixel be arranged in the computer capacity of the input pixel value of k pixel on the second direction opposite with first direction, and calculate the mean value that falls into the input pixel value in this computer capacity, as the average pixel value on the second direction;

The corrected value determining unit, be used for the input pixel value according to the first direction average pixel value that calculates by first average calculation unit, object pixel, the relation between the second direction average pixel value that calculates by second average calculation unit, be identified for the corrected value of the input pixel value of correction target pixel; With

First adder unit is used for the input pixel value addition by determined corrected value of corrected value determining unit and object pixel, and will obtain and as the output of the output pixel value of object pixel.