US20060114354A1 - Image processing circuit - Google Patents
Image processing circuit Download PDFInfo
- Publication number
- US20060114354A1 US20060114354A1 US11/334,224 US33422406A US2006114354A1 US 20060114354 A1 US20060114354 A1 US 20060114354A1 US 33422406 A US33422406 A US 33422406A US 2006114354 A1 US2006114354 A1 US 2006114354A1
- Authority
- US
- United States
- Prior art keywords
- pixel
- pixels
- pixel value
- output
- pixel values
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000012545 processing Methods 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 claims description 30
- 230000002093 peripheral effect Effects 0.000 claims description 6
- 230000001131 transforming effect Effects 0.000 claims description 2
- 230000006870 function Effects 0.000 description 36
- 230000015654 memory Effects 0.000 description 35
- 238000005070 sampling Methods 0.000 description 25
- 230000014509 gene expression Effects 0.000 description 24
- 238000010586 diagram Methods 0.000 description 12
- 230000000694 effects Effects 0.000 description 11
- 230000003111 delayed effect Effects 0.000 description 9
- 238000009125 cardiac resynchronization therapy Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 102000001690 Factor VIII Human genes 0.000 description 1
- 108010054218 Factor VIII Proteins 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G2340/0414—Vertical resolution change
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G2340/0421—Horizontal resolution change
Definitions
- the present invention relates to an image processing circuit for improving the resolution by increasing the number of pixels making up a display screen through an interpolation process.
- one of the methods for improving the quality of a television image involves increasing the number of scanning lines as well as increasing the number of horizontal pixels.
- a video signal of the current NTSC system has a vertical resolution of about 300 lines owing to interlaced scanning at 2:1.
- the CRT used in the typical television receiver has 525 scanning lines, and a lower resolution due to interlaced scanning, for which there is known a method of improving the resolution in a vertical direction by increasing the number of pixels in the vertical direction through the field interpolation using a field buffer to make non-interlace.
- Some CRTs used in the high definition television receivers have a set number of horizontal pixels about twice as many as that of the CRTs of the ordinary television receivers, and thus, there is known a method for improving the resolution in a horizontal direction by doubling the number of pixels in a scanning line direction by interpolation.
- the present invention has been devised in view of the aforementioned problems, and it is an object of the invention to provide an image processing circuit capable of carrying out high-speed processing and improving the horizontal and vertical resolutions even with its simple circuit configuration.
- An image processing circuit of the invention to transform the number of pixels in the horizontal and vertical directions into substantially twice by performing an interpolation process based on the pixel values of the pixels arranged regularly in the horizontal and vertical directions comprises pixel value extracting unit for extracting the pixel values of a total of nine pixels, three pixels in the horizontal direction by three pixels in the vertical direction, and pixel value calculating unit for calculating the pixel values of four pixels generated additionally corresponding to positions on the straight lines connecting a central pixel arranged in the center of the nine pixels and four peripheral pixels arranged in the oblique directions of the central pixel and at one-quarter the distance from the central pixel to the four peripheral pixels, on the basis of the pixel values of the nine pixels output from the pixel value extracting unit.
- an image processing circuit of the invention to transform the number of scanning lines corresponding to an input signal and the number of pixels in the direction along the scanning line into substantially twice comprises pixel value extracting unit for extracting the pixel values of a total of nine pixels, three pixels in the horizontal direction along a scanning line by three pixels in the vertical direction in which the line and adjacent lines are abreast, from the pixel values of a plurality of pixels making up three adjacent scanning lines, in which the pixel values of pixels contained in the scanning line are input in a predetermined order corresponding to the scan direction of the scanning line, pixel value calculating unit for calculating the pixel values of four pixels generated additionally corresponding to positions on the straight lines connecting a central pixel arranged in the center of the nine pixels and four peripheral pixels arranged in the oblique directions of the central pixel and at one-quarter the distance from the central pixel to the four peripheral pixels, on the basis of the pixel values of the nine pixels extracted by the pixel value extracting unit, and pixel value output unit for outputting the pixel values of a
- An image processing circuit of the invention has four pixels generated additionally around a central pixel on the basis of the pixel values of nine pixels, in which this generation process is performed while shifting the central pixel in a scan direction in order to transform the number of pixels in each of the horizontal and vertical directions into substantially twice.
- this generation process is performed while shifting the central pixel in a scan direction in order to transform the number of pixels in each of the horizontal and vertical directions into substantially twice.
- the pixel values of a total of nine pixels including this central pixel are only employed.
- the pixel value extracting unit outputs in parallel the pixel value of a first pixel input at a predetermined timing, the pixel value of a second pixel delayed by one pixel from the output timing of the first pixel, the pixel value of a third pixel delayed by two pixels from the output timing of the first pixel, the pixel value of a fourth pixel delayed by one scanning line from the output timing of the first pixel, the pixel value of a fifth pixel delayed by one scanning line from the output timing of the second pixel, the pixel value of a sixth pixel delayed by one scanning line from the output timing of the third pixel, the pixel value of a seventh pixel delayed by two scanning lines from the output timing of the first pixel, the pixel value of an eighth pixel delayed by two scanning lines from the output timing of the second pixel, and the pixel value of a ninth pixel delayed by two scanning lines from the output timing of the third pixel.
- the pixel values of nine pixels used in the pixel value calculating unit can be prepared
- the pixel values of pixels generated additionally around the central pixel are most affected by the central pixel that is located closest thereto. If the pixel value of each pixel is obtained through a convolution operation with a sampling function, it is preferable that the pixel value of a pixel located within the interval of adjacent pixels may be added, and the pixel value of a pixel located outside the interval of adjacent pixels may be subtracted.
- the pixel values of the pixels as viewed from the upper left in the horizontal direction are a through i, for example, and considering the pixel value of a pixel generated additionally on the upper left hand of the central pixel, the pixel value e of the central pixel has the greatest effect, the pixel values a, b, d of three pixels located next closest are considered on the plus side, and the pixel values c, f, g, h, i of remaining five pixels are considered on the minus side, resulting in the value A 1 . Also, the pixel values A 2 , A 3 , A 4 of other three pixels generated additionally are the same, and have the respective values as mentioned above.
- the pixel values A 1 through A 4 of four pixels set in this way are obtained by simply adding or subtracting the respective pixel values, excluding the pixel value e of the central pixel, whereby the processed contents (calculation contents) are simplified, and it is possible to carry out high-speed processing and provide the simple circuit structure.
- the value of N is desirably set to 10. As a result of examination by the present inventors, it has been confirmed that a clear enlarged image can be obtained by setting N to a value near 10.
- the pixel values of the pixels as viewed from the upper left in the horizontal direction are a through i, for example, and considering the pixel value of a pixel generated additionally on the upper left hand of the central pixel, the pixel value e of the central pixel has the greatest effect, the pixel values a, b, d of three pixels located next closest are considered on the plus side, the pixel values f, h, i of other three pixels are considered on the minus side, and the pixel values c, g of remaining two pixels are not considered, resulting the value A 1 as mentioned above.
- each of the pixel values A 1 and A 4 of two pixels arranged across the central pixel contains commonly (a+b+d) and (f+h+i) as the same processing unit, and each of the pixel values A 2 and A 3 of remaining two pixels contains commonly (b+c+f) and (d+g+h) as the same processing unit.
- the circuit can be further simplified by sharing these processings.
- the value of M is desirably set to 8. As a result of examination by the present inventors, it has been confirmed that a clear enlarged image can be obtained by setting M to a value near 8.
- the pixel values of any pixel generated additionally are to be strictly calculated using a sampling function, it can be thought that the pixel values of pixels arranged the distance equal to integral times the interval of adjacent pixels among the nine pixels have almost no effect. Accordingly, for the nine pixels arranged in three columns and three rows, the pixel values of the pixels as viewed from the upper left in the horizontal direction are a through i, for example, and considering the pixel value of a pixel generated additionally on the upper left hand of the central pixel, it is possible to ignore the effect of the pixel values of two pixels arranged on the upper left hand and the lower right hand, among the nine pixels, and other pixels are weighted at a predetermined value corresponding to the distance from the pixel generated additionally to respective pixels, resulting in the value A1.
- the pixel value can be obtained by reflecting the result of strict calculation using the sampling function.
- the value of L is desirably set to 10. If the weighting factor for the pixel values a through i is obtained by calculation using the sampling function, the value of L is near 10. Hence, with the above settings, the pixel values can be obtained through the strict calculation using the sampling function.
- the pixel value output unit desirably comprises first scanning line generating unit for storing and outputting the pixel values of two pixels generated additionally corresponding to the pixel contained in one scanning line where the central pixel is not contained in the order of arrangement along this scanning line, and second scanning line generating unit for storing and outputting the pixel values of two pixels generated additionally corresponding to the pixel contained in the other scanning line where the central pixel is not contained in the order of arrangement along this scanning line, and comprises output pixel value selecting unit for selecting alternately the output operation of consecutive pixel values of one scanning line by the first and second scanning line generating unit to be made in the first scanning line generating unit or the second scanning line generating unit.
- the pixel values of generated pixels arranged in two columns corresponding to one scanning line of an input signal are output in succession.
- the pixel values corresponding to respective columns are stored in the first and second scanning line generating unit in succession, and the output operation of these pixel values is performed alternately by the first and second scanning line generating unit.
- two scanning lines can be generated additionally corresponding to one scanning line of the input signal, so that the number of scanning lines can be transformed into substantially twice.
- FIG. 1 is a view showing the relation between the pixels contained in three scanning lines to be processed and four pixels generated additionally on the basis of these pixels in the image processing circuit of the first embodiment;
- FIG. 2 is a block diagram showing the configuration of the image processing circuit of the first embodiment
- FIG. 3 is a block diagram showing the detailed configuration of the pixel value extracting section included in the image processing circuit as shown in FIG. 2 ;
- FIG. 4 is a block diagram showing the detailed configuration of the pixel value calculating section included in the image processing circuit as shown in FIG. 2 ;
- FIG. 5 is a block diagram showing the detailed configuration of the pixel value output section included in the image processing circuit as shown in FIG. 2 ;
- FIG. 6 is a block diagram showing the detailed configuration of a pixel value calculating section in the second embodiment
- FIG. 7 is an explanatory view of a sampling function for use with the third embodiment
- FIG. 8 is an explanatory view in performing a convolution operation of the pixel value of the pixel Q 1 generated additionally, employing the pixel values of nine pixels P 1 through P 9 ;
- FIG. 9 is a block diagram showing the detailed configuration of a pixel value calculating section in the third embodiment.
- This image processing circuit is contained in a television receiver, for example, and performs an operation of transforming the number of scanning lines and the number of pixels along each scanning line, corresponding to an input (received) signal of the NTSC system into substantially twice.
- FIG. 1 is a view showing the relation between the pixels contained in three scanning lines to be processed and four pixels generated additionally on the basis of these pixels in the image processing circuit of the first embodiment.
- a horizontal direction as indicated in FIG. 1 extends along a scanning line corresponding to an input signal, and each pixel along each scanning line of the interlaced scanning that is performed in the television receivers for ground wave broadcasting is indicated by “ ⁇ ”.
- “ ⁇ ” indicates a pixel generated additionally by the arrangement of the pixels on an original scanning line and through an interpolation process of these pixel values.
- the nine pixels along the scanning lines are P 1 , P 2 , P 3 , P 4 , P 5 , P 6 , P 7 , P 8 and P 9 in the scan order, and the pixel values are a, b, c, d, e, f, g, h, and i.
- a pixel Q 1 is generated additionally at a position on a straight line connecting the central pixel P 5 and the lower right pixel P 1 and one-quarter the distance from the central pixel P 5 to the pixel P 1
- a pixel Q 2 is generated additionally at a position on a straight line connecting the central pixel P 5 and the lower left pixel P 3 and one-quarter the distance from the central pixel P 5 to the pixel P 3
- a pixel Q 3 is generated additionally at a position on a straight line connecting the central pixel P 5 and the upper right pixel P 7 and one-quarter the distance from the central pixel P 5 to the pixel P 7
- a pixel Q 4 is generated additionally at a position on a straight line connecting the central pixel P 5 and the upper left pixel P 9 and one-quarter the distance from the central pixel P 5 to the pixel P 9 .
- the pixel values of four pixels Q 1 , Q 2 , Q 3 and Q 4 generated additionally around the central pixel P 5 are most affected by the central pixel P 5 located closest.
- the pixel value of pixel located-within the interval of adjacent pixels e.g., interval between the pixels P 5 and P 4 , or between the pixels P 3 and P 2
- the pixel value of pixel located outside the interval of adjacent pixels may be subtracted.
- the pixel value e of the central pixel P 5 has the greatest effect, the pixel values a, b, d of three pixels P 1 , P 2 , P 4 located next closest are considered on the plus side, and the pixel values c, f, g, h, i of remaining five pixels P 3 , P 6 , P 7 , P 8 , P 9 are considered on the minus side.
- a 2 ⁇ Ne +( b+c+f ) ⁇ ( a+d+g+h+i ) ⁇ /( N ⁇ 2)
- a 3 ⁇ Ne +( d+g+h ) ⁇ ( a+b+c+f+i ) ⁇ /( N ⁇ 2)
- a 4 ⁇ Ne +( f+h+i ) ⁇ ( a+b+c+d+g ) ⁇ /( N ⁇ 2)
- N 10 into the respective expressions
- a 2 ⁇ 10 e +( b+c+f ) ⁇ ( a+d+g+h+i ) ⁇ /8 (2)
- a 3 ⁇ 10 e +( d+g+h ) ⁇ ( a+b+c+f+i ) ⁇ /8 (3)
- a 4 ⁇ 10 e +( f+h+i ) ⁇ ( a+
- FIG. 2 is a block diagram showing the configuration of the image processing circuit of this embodiment.
- the image processing circuit of this embodiment as shown in FIG. 2 comprises a pixel value extracting section 100 , a pixel value calculating section 200 , and a pixel value output section 300 .
- the pixel value extracting section 100 extracts the pixel values a through i of nine pixels as shown in FIG. 1 from among the pixel values of the pixels contained in three adjacent scanning lines included in an input signal. For example, if an RGB signal is considered as the input signal, the image processing circuits as shown in FIG. 2 corresponding to the respective color components of R, G and B are provided, and the pixel value extracting section 100 extracts the pixel values of nine pixels for an input R signal (or G signal or B signal). Other input signals than the RGB signal may be used, or the pixel values of nine pixels may be extracted on the basis of an input luminance signal.
- the pixel value calculating section 200 calculates the pixel values A 1 through A 4 of four pixels Q 1 through Q 4 generated additionally around the central pixel P 5 as shown in FIG. 1 on the basis of the pixel values a through i of nine pixels that are output from the pixel value extracting section 100 , and outputs these four pixel values in parallel.
- the pixel value output section 300 accepts the pixel values A 1 through A 4 of four pixels Q 1 through Q 4 that are output from the pixel value calculating section 200 .
- the pixel value output section 300 stores and outputs the pixel values A 1 through A 4 for each scanning line after transformation. For example, if attention is paid to four pixels Q 1 through Q 4 generated additionally around the pixel P 5 , a pixel Q 1 and a pixel Q 2 are stored corresponding to a first scanning line generated additionally, and a pixel Q 3 and a pixel Q 4 are stored corresponding to a second scanning line generated additionally, as shown in FIG. 1 .
- two new scanning lines can be generated additionally corresponding to one scanning line contained in the input signal, whereby the number of pixels contained in two scanning lines generated additionally is substantially twice the number of pixels contained in the original scanning line.
- the pixel value extracting section 100 corresponds to pixel value extracting unit; the pixel value calculating section 200 corresponds to pixel value calculating unit; and the pixel value output section 300 corresponds to pixel value output unit.
- FIG. 3 is a block diagram showing the detailed configuration of the pixel value extracting section 100 included in the image processing circuit as shown in FIG. 2 .
- the pixel value extracting section 100 comprises six D-type flip-flops (hereinafter referred to as “D-FF”) 110 through 115 , and two line memories 120 , 121 .
- D-FF D-type flip-flops
- the pixel values of the pixels contained in the scanning line corresponding to the input signal as the data (pixel value data) of a predetermined number of bits are input in synchronism with a clock signal CK 1 corresponding to a predetermined sampling frequency.
- the input pixel value data are input into two D-FFs 110 , 111 connected in tandem and a line memory 120 and two D-FFs 112 , 113 connected in tandem, respectively.
- the pixel value data of the pixels output from the line memory 120 are input into a line memory 121 and the D-FFs 114 , 115 connected in tandem.
- Each of the line memories 120 , 121 is a first-in first-out memory for storing the pixel values of the pixels in number corresponding to one scanning line of the input signal in the input order, and outputs the pixel value data of the input pixels at a timing delayed by one scanning line.
- the pixel value data (pixel value i) corresponding to a pixel P 9 arranged at the upper left hand of the central pixel P 5 in FIG. 1 is input into the pixel value extracting section 100 , the pixel value data (pixel value h) of a pixel P 8 input ahead by one pixel is output from a D-FF 110 , and the pixel value data (pixel value g) of a pixel P 7 input ahead by two pixels is output from a D-FF 111 .
- the pixel value data (pixel value f) of a pixel P 6 input ahead by one scanning line is output from the line memory 120
- the pixel value data (pixel value e) of the central pixel P 5 input ahead by one scanning line and one pixel is output from a D-FF 112
- the pixel value data (pixel value d) of a pixel P 4 input ahead by one scanning line and two pixels is output from a D-FF 113 .
- the pixel value data (pixel value c) of a pixel P 3 input ahead by two scanning lines is output from the line memory 121
- the pixel value data (pixel value b) of a pixel P 2 input ahead by two scanning lines and one pixel is output from a D-FF 114
- the pixel value data (pixel value a) of a pixel P 1 input ahead by two scanning lines and two pixels is output from a D-FF 115 .
- the pixel value data corresponding to nine pixels P 1 through P 9 as shown in FIG. 1 are output in parallel from the pixel value extracting section 100 .
- FIG. 4 is a circuit diagram showing the detailed configuration of the pixel value calculating section 200 included in the image processing circuit as shown in FIG. 2 .
- the pixel value calculating section 200 comprises fourteen adders 130 through 143 , eight subtracters 150 through 157 , a multiplier 160 for making tenfold multiplication, and four dividers 170 through 173 for dividing the input value by a divisor 8.
- the operation of the pixel value calculating section 200 for calculating the pixel values A 1 through A 4 of four pixels Q 1 through Q 4 will be described for each pixel, employing the expressions (1) through (4).
- the calculation process of the pixel value A 1 is performed using the adders 130 , 132 , 134 , 137 , 138 , 142 and the subtracters 150 , 154 . More specifically, three pixel values a, b, d are added by two adders 130 , 134 , three pixel values f, h, i are added by other two adders 132 , 137 , and two pixel values c, g are added by the other single adder 142 .
- the calculation process of the pixel value A 2 is performed using the adders 131 , 133 , 135 , 136 , 139 , 143 and the subtracters 151 , 155 . More specifically, three pixel values b, c, f are added by two adders 131 , 135 , three pixel values d, g, h are added by other two adders 133 , 136 , and two pixel values a, i are added by the other single adder 143 .
- the calculation process of the pixel value A 3 is performed using the adders 131 , 133 , 135 , 136 , 140 , 143 and the subtracters 152 , 156 . More specifically, three pixel values d, g, h are added by two adders 133 , 136 , three pixel values b, c, f are added by other two adders 131 , 135 , and two pixel values a, i are added by the other single adder 143 .
- the calculation process of the pixel value A 4 is performed using the adders 130 , 132 , 134 , 137 , 141 , 142 and the subtracters 153 , 157 . More specifically, three pixel values f, h, i are added by two adders 132 , 137 , three pixel values a, b, d are added by other two adders 130 , 134 , and two pixel values c, g are added by the other single adder 142 .
- the pixel values of the pixels are simply added or subtracted, except for multiplying the pixel value e of the central pixel P 5 tenfold.
- the processing contents can be simplified, and it is possible to carry out high-speed processing and provide the simple circuit configuration.
- the pixel value calculating section 200 as shown in FIG. 4 is provided with four dividers 170 through 173 , in which an addition result output from the corresponding adder is divided by a divisor 8.
- these dividers 170 through 173 can be realized by the three-bit shift circuits, that is, only by wiring the output lines of the adders 138 through 141 shifted by three bits.
- an equivalent operation to the division process by the dividers 170 through 173 can be effected by adjusting the gain in this conversion process.
- the four dividers 170 through 173 may be removed from the pixel value calculating section 200 shown in FIG. 4 .
- FIG. 5 is a block diagram showing the detailed configuration of the pixel value output section 300 included in the image processing circuit as shown in FIG. 2 .
- the pixel value output section 300 comprises three selectors 210 through 212 , two frequency demultipliers 220 , 221 , two D-FFs 230 , 231 , and three line memories 240 through 242 .
- a selector 210 , a frequency demultiplier 220 , a D-FF 230 , and a line memory 240 correspond to first scanning line generating unit; a selector 211 , a frequency demultiplier 221 , a D-FF 231 , and the line memories 241 , 242 correspond to second scanning line generating unit; and a selector 212 corresponds to output pixel value selecting unit.
- the selector 210 selects alternately the pixel value data corresponding to the pixel values A 1 , A 2 input concurrently from the pixel value calculating section 200 , and outputs it.
- the selection timing is set by a signal output from the frequency demultiplier 220 .
- This frequency demultiplier 220 receives a clock signal CK 2 having twice the frequency of a clock signal CK 1 corresponding to the sampling frequency of each pixel data input into the pixel value extracting section 100 as shown in FIG. 3 and outputs a signal with the frequency divided by two.
- the selector 210 having a selected state determined by the signal with the frequency of clock signal CK 2 divided by 2 outputs alternately the pixel value data of the pixel values A 1 , A 2 at an interval that is one-half the input interval of the pixel value data into the pixel value extracting section 100 .
- the pixel data value corresponding to the pixel value A 1 and the pixel value data corresponding to the pixel value A 2 that are output alternately are once held in the D-FF 230 , and then input into the line memory 240 .
- the line memory 240 is a first-in first-out memory for storing in the input order the pixel values of one scanning line corresponding to the first scanning line containing the pixels Q 1 and Q 2 as shown in FIG.
- This line memory 240 makes the write operation of the pixel value data synchronously when a write clock signal WCK is input, and the read operation of the pixel value data synchronously when a read clock signal RCK is input.
- the write clock signal WCK has the same frequency as the clock signal CK 2 as mentioned above, and is input into the line memory 240 over the entire period where the pixel value data is output from the D-FF 230 .
- the read clock signal RCK has the same frequency as a clock signal CK 3 having twice the frequency of the clock signal CK 2 , and the line memory 240 outputs the pixel value data at a reading rate twice as fast as a writing rate of the pixel value data when this read clock signal RCK is input. Also, this read clock signal RCK is input over about one-half of the period where the write clock signal WCK is input, so that the pixel value data stored in the line memory 240 may not underflow.
- the selector 211 selects alternately the pixel value data corresponding to the pixel values A 3 , A 4 input concurrently from the pixel value calculating section 200 , and outputs it.
- the selector 211 having a selected state determined by the signal with the frequency of clock signal CK 2 divided by 2 outputs alternately the pixel value data of the pixel values A 3 , A 4 at an interval that is one-half the input interval of the pixel value data into the pixel value extracting section 100 .
- the pixel data value corresponding to the pixel value A 3 and the pixel value data corresponding to the pixel value A 4 that are output alternately are once held in the D-FF 231 , and then input into the line memory 241 .
- the line memory 241 is a first-in first-out memory for storing in the input order the pixel values of one scanning line corresponding to the second scanning line containing the pixels Q 3 and Q 4 as shown in FIG. 1 , and stores the pixel value data of the pixels input from the D-FF 231 by one scanning line. In the latter stage of the line memory 241 , a line memory 242 having the same capacity is connected. These line memories 241 and 242 make the write operation of the pixel value data synchronously when a write clock signal WCK is input, and the read operation of the pixel value data synchronously when a read clock signal RCK is input, the same as the aforementioned line memory 240 .
- the line memory 241 in the former stage is employed to delay the input pixel data by one scanning line, and both the write clock signal WCK and the read clock signal RCK are set to the same frequency as the clock signal CK 2 .
- the line memory 242 in the latter stage is used for the same purposes as the line memory 240 , and performs the write operation of the pixel value data in synchronism with the write clock signal WCK having the same frequency as the clock signal CK 2 , and the read operation of the pixel value data in synchronism with the read clock signal RCK having the same frequency as the clock signal CK 3 having twice the frequency as the clock signal CK 2 and over an input period that is about one-half of that of the write clock signal WCK.
- the input period of the read clock signal RCK into the line memory 240 corresponding to the first scanning line and the line memory 242 corresponding to the second scanning line are alternately switched for each scanning line, whereby after the pixel value data of the pixels Q 1 , Q 2 corresponding to the first scanning line are output by one scanning line from the line memory 240 , the pixel value data of the pixels Q 3 , Q 4 corresponding to the second scanning line are output by one scanning line from the line memory 242 .
- the selector 212 provided in the latter stage of these two line memories 240 , 242 switches the selected state, every time a horizontal synchronizing signal H is input, to output alternately the pixel value data by one scanning line output from the line memory 240 and the pixel value data by one scanning line output from the line memory 242 .
- the pixel value data of two scanning lines corresponding to the first and second new scanning lines having about twice the number of constituent pixels can be output in the new scan order from the pixel value output section 300 , while the pixel value data of one scanning line is input into the pixel value extracting section 100 .
- the positions of the pixels Q 1 through Q 4 generated additionally employing the pixel value data input corresponding to the odd field, and the positions of the pixels Q 1 through Q 4 generated additionally employing the pixel value data input corresponding to the even field are exactly the same, whereby a progressive image having about twice the number of pixels in the horizontal and vertical directions can be easily produced from an image obtained by interlaced scanning using the image processing circuit as described above.
- all the pixel values a through i of nine pixels P 1 through P 9 are employed to calculate the pixel values A 1 through A 4 of the four pixels Q 1 through Q 4 located around the central pixel P 5 as shown in FIG. 1 , but the circuit configuration may be simplified by excluding the pixel values of the pixels which are thought to be less influential in calculating the pixel values A 1 through A 4 from the calculation object.
- the pixel values A 1 through A 4 of the four pixels Q 1 through Q 4 generated additionally are greatly affected by a variation of pixel value along a direction of the line connecting the pixel values Q 1 through Q 4 and the central pixel P 5 , there may be less significant effect by ignoring the influence of the pixel values of two pixels located in a direction substantially perpendicular to this direction.
- the pixel value c of the pixel P 3 located on the lower left hand of the central pixel P 5 and the pixel value g of the pixel P 7 located on the upper right hand of the central pixel P 5 are excluded from the calculation object.
- a 1 ⁇ Me +( a+b+d ) ⁇ ( f+h+i ) ⁇ / M
- FIG. 6 is a block diagram showing the detailed configuration of a pixel value calculating section 200 a in this embodiment.
- the pixel value extracting section 100 connected in the former stage of the pixel value calculating section 200 a and the pixel value output section 300 connected in the latter stage are the same as those of the image processing circuit of the first embodiment, and the pixel value calculating section 200 a will be only described below.
- the pixel value calculating section 200 a comprises twelve adders 130 through 141 , four subtracters 150 through 153 , a multiplier 160 a for making eightfold multiplication, and four dividers 170 through 173 for dividing the input value by a divisor 8.
- This pixel value calculating section 200 a excludes two adders 142 , 143 and four subtracters 154 through 157 from the pixel value calculating section 200 as shown in FIG. 4 , and replaces the tenfold multiplier 160 with an eightfold multiplier 160 a .
- a divisor 8 of four dividers 170 through 173 and a multiplier factor 8 of the multiplier 160 a are a power of 2, and can be implemented only by shifting the wiring by three bits.
- the operation of the pixel value calculating section 200 a will be described for each pixel below in the case where the pixel values A 1 through A 4 of the four pixels Q 1 through Q 4 are calculated, employing the aforementioned expressions (5) through (8).
- a calculation process of the pixel value A 1 is performed employing the adders 130 , 132 , 134 , 137 , 138 and the subtracter 150 . More specifically, three pixel values a, b, d are added by two adders 130 , 134 , and three pixel values f, h, i are added by other two adders 132 , 137 . And by inputting these two addition results into the subtracter 150 , an output value (a+b+d) that is an addition result output from the adder 134 subtracted by an output value (f+h+i) that is an addition result output from the adder 137 is output.
- the adder 138 adds a multiplication result (8e) of the multiplier 160 a to this output value, an addition result ⁇ 8e +(a+b+d) ⁇ (f+h+i) ⁇ is output. Further the divider 170 connected in the latter stage makes division by a divisor 8 to calculate the pixel value A 1 as indicated in the expression (5), its calculation result being output from the divider 170 .
- a calculation process of the pixel value A 2 is performed employing the adders 131 , 133 , 135 , 136 , 139 and the subtracter 151 . More specifically, three pixel values b, c, f are added by two adders 131 , 135 , and three pixel values d, g, h are added by other two adders 133 , 136 . And by inputting these two addition results into the subtracter 151 , an output value (b+c+f) that is an addition result output from the adder 135 subtracted by an output value (d+g+h) that is an addition result output from the adder 136 is output.
- the adder 139 adds a multiplication result (8e) of the multiplier 160 a to this output value, an addition result ⁇ 8e+(b+c+f) ⁇ (d+g+h) ⁇ is output. Further the divider 171 connected in the latter stage makes division by a divisor 8 to calculate the pixel value A 2 as indicated in the expression (6), its calculation result being output from the divider 171 .
- a calculation process of the pixel value A 3 is performed employing the adders 131 , 133 , 135 , 136 , 140 and the subtracter 152 . More specifically, three pixel values d, g, h are added by two adders 133 , 136 , and three pixel values b, c, f are added by other two adders 131 , 135 . And by inputting these two addition results into the subtracter 152 , an output value (d+g+h) that is an addition result output from the adder 136 subtracted by an output value (b+c+f) output from the adder 135 is output.
- a calculation process of the pixel value A 4 is performed employing the adders 130 , 132 , 134 , 137 , 141 and the subtracter 153 . More specifically, three pixel values f, h, i are added by two adders 132 , 137 , and three pixel values a, b, d are added by other two adders 130 , 134 . And by inputting these two addition results into the subtracter 153 , an output value (f+h+i) that is an addition result output from the adder 137 subtracted by an output value (a+b+d) that is an addition result output from the adder 134 is output.
- the adder 141 adds a multiplication result (8e) of the multiplier 160 a to this output value, an addition result (8e +(f+h+i) ⁇ (a+b+d)) is output. Further the divider 173 connected in the latter stage makes division by a divisor 8 to calculate the pixel value A 4 as indicated in the expression (8), its calculation result being output from the divider 173 .
- the pixel values of the pixels are simply added or subtracted, except that the pixel value e of the central pixel P 5 is multiplied eightfold.
- the number of adders or subtracters can be reduced as compared with the configuration as shown in FIG. 4 , making it possible to lessen the processing contents, and further to carry out high-speed processing and simplify the circuit configuration.
- the pixel value e of the central pixel P 5 is weighted by a weighting factor of 2 or greater (10 in the expression (1), 8 in the expression (5)) and the pixel values of other pixels are appropriately added or subtracted to calculate the pixel values A1 through A4 of the four pixels Q 1 through Q 4 located around the central pixel P 5 as shown in FIG. 1 .
- the degree to which the pixel values a through i of the nine pixels P 1 through P 9 has the effect may be computed employing a sampling function to obtain the correct coefficient values.
- FIG. 7 is an explanatory view of a sampling function for use with this embodiment.
- a sampling function H(t) shown in FIG. 7 is a function of a local support to which attention is paid on differentiability.
- the function H(t) can be differentiated only once in the whole region and a function of a local support having finite values, which are not zeroes, when a sample position t along a horizontal axis is between ⁇ 2 and +2.
- the third order B spline function F(t) is expressed as: (4 t 2 +12 t+ 9)/4; ⁇ 3/2 ⁇ t ⁇ 1 ⁇ 2 ⁇ 2 t 2 + 3/2; ⁇ 1 ⁇ 2 ⁇ t ⁇ 1 ⁇ 2 (4 t 2 ⁇ 12 t+ 9)/4; 1 ⁇ 2 ⁇ t ⁇ 3/2
- FIG. 8 is an explanatory view in performing a convolution operation of the pixel value of the pixel Q 1 generated additionally, employing the pixel values of nine pixels P 1 through P 9 .
- the specific values of the sampling function H(t 1 ) are computed using this distance t 1 , the degree to which the pixel value e of the central pixel P 5 has the effect on the pixel value A1 of the pixel Q 1 can be obtained.
- the degree to which the pixel values a through i of the nine pixels P 1 through P 9 has the effect on the pixel value A 1 of the pixel Q 1 is ⁇ 0.027, 0.16, ⁇ 0.071, 0.16, 0.79, ⁇ 0.080, ⁇ 0.071, ⁇ 0.080, or ⁇ 0.014.
- a reason why the result of addition and subtraction is divided by 10 in the right side of the expression (9) is that the pixel value A 1 of the pixel Q 1 is adjusted to have the same value, when the pixel values a through i of the nine pixels P 1 through P 9 are all the same value.
- the same adjustment has been made in the expressions (1) through (8) as cited above.
- FIG. 9 is a block diagram showing the detailed configuration of a pixel value calculating section 200 b in this embodiment.
- the pixel value extracting section 100 connected in the former stage of the pixel value calculating section 200 b and the pixel value output section 300 connected in the latter stage are the same as those included in the first embodiment, and the pixel value calculating section 200 b will be only described.
- the pixel value calculating section 200 b of this embodiment comprises fourteen adders 330 through 343 , four subtracters 350 through 353 , four multipliers 360 through 363 for making twofold multiplication, a multiplier 364 for making tenfold multiplication, and four dividers 370 through 373 for dividing the input value by a divisor 10.
- Four multipliers 360 through 363 can be implemented by shifting the wiring by one bit.
- a calculation process of the pixel value A 1 is performed employing the adders 331 , 334 , 335 , 336 , a subtracter 350 and a multiplier 360 . More specifically, two pixel values b, d are added by an adder 331 , and this addition result is doubled by the multiplier 360 . And four pixel values c, f, g, h are added employing three adders 334 , 335 , 336 .
- an output value (2b+2d) that is the multiplication result output from the multiplier 360 subtracted by an output value (c+f+g+h) that is an addition result output from the adder 336 is output.
- an adder 340 adding a multiplication result (10e) of the multiplier 364 to the output value, an addition result ⁇ 10e+2b+2d ⁇ (c+f+g+h) ⁇ is output, and further divided by a divisor 10 by a divider 370 connected in the latter stage to calculate the pixel value A1 as indicated in the expression (9), its calculation result being output from the divider 370 .
- a calculation process of the pixel value A 2 is performed employing the adders 330 , 332 , 333 , 337 , a subtracter 351 and a multiplier 361 . More specifically, two pixel values b, f are added by an adder 333 , and this addition result is doubled by the multiplier 361 . And four pixel values a, d, h, i are added employing three adders 330 , 332 , 337 .
- an output value (2b+2f) that is the multiplication result output from the multiplier 361 subtracted by an output value (a+d+h+i) that is an addition result output from the adder 337 is output. Accordingly, with an adder 341 adding a multiplication result (10e) of the multiplier 364 to the output value, an addition result ⁇ 10e+2b+2f ⁇ (a+d+h+i) ⁇ is output, and further divided by a divisor 10 by a divider 371 connected in the latter stage to calculate the pixel value A 2 as indicated in the expression (10), its calculation result being output from the divider 371 .
- a calculation process of the pixel value A 3 is performed using the adders 330 , 332 , 333 , 338 , a subtracter 352 and a multiplier 362 . More specifically, two pixel values d, h are added by an adder 332 , and this addition result is doubled by the multiplier 362 . Also, four pixel values a, b, f, i are added employing three adders 330 , 333 , 338 .
- an output value (2d+2h) that is the multiplication result output from the multiplier 362 subtracted by an output value (a+b+f+i) that is an addition result output from the adder 338 is output.
- an adder 342 adding a multiplication result (10e) of the multiplier 364 to the output value, an addition result ( ⁇ 10e+2d+2h ⁇ (a+b+f +i) ⁇ is output, and further divided by a divisor 10 by a divider 372 connected in the latter stage to calculate the pixel value A 3 as indicated in the expression (11), its calculation result being output from the divider 372 .
- a calculation process of the pixel value A 4 is performed using the adders 331 , 334 , 335 , 339 , a subtracter 353 and a multiplier 363 . More specifically, two pixel values f, h are added by an adder 335 , and this addition result is doubled by the multiplier 363 . Also, four pixel values b, c, d, g are added employing three adders 331 , 334 , 339 .
- an output value (2f+2h) that is the multiplication result output from the multiplier 363 subtracted by an output value (b+c+d+g) that is an addition result output from the adder 339 is output. Accordingly, with an adder 343 adding a multiplication result (10e) of the multiplier 364 to the output value, an addition result ⁇ 10e+2f+2h ⁇ (b+c+d+g) ⁇ is output, and further divided by a divisor 10 by a divider 373 connected in the latter stage to calculate the pixel value A 4 as indicated in the expression (12), its calculation result being output from the divider 373 .
- the pixel values of the pixels are simply added or subtracted, except that the multipliers with the multiplying factors of 10 and 2 are employed.
- the processing contents can be simplified, and it is possible to carry out high-speed processing and provide the simple circuit configuration. Since the weighting factor of each pixel value is determined using the sampling function, the pixel value with the strict calculation result reflected can be obtained.
- four pixels are generated additionally around the central pixel on the basis of the pixel values of nine pixels, in which this generation process is performed while shifting the central pixel in a scan direction in order to transform the number of pixels in the horizontal and vertical directions into substantially twice.
- this generation process is performed while shifting the central pixel in a scan direction in order to transform the number of pixels in the horizontal and vertical directions into substantially twice.
- the pixel values of nine pixels including this central pixel are only employed.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Image Processing (AREA)
- Television Systems (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
An image processing circuit capable of carrying out high-speed processing and improving the horizontal and vertical resolutions even with its simple structure. The pixel values a to i of a total of nine pixels, three pixels in the horizontal direction along a scanning line by three pixels in the vertical direction in which the line and adjacent lines are abreast, are extracted by a pixel value extracting section. The pixel values A1 to A4 of four pixels Q1 to Q4 generated additionally around the center pixel P5 are determined by calculation by a pixel value calculation section. These pixel values are outputted in units of one scanning line by correlating them with two scanning lines by a pixel value output section.
Description
- The present invention relates to an image processing circuit for improving the resolution by increasing the number of pixels making up a display screen through an interpolation process.
- Generally, one of the methods for improving the quality of a television image involves increasing the number of scanning lines as well as increasing the number of horizontal pixels. For example, a video signal of the current NTSC system has a vertical resolution of about 300 lines owing to interlaced scanning at 2:1. The CRT used in the typical television receiver has 525 scanning lines, and a lower resolution due to interlaced scanning, for which there is known a method of improving the resolution in a vertical direction by increasing the number of pixels in the vertical direction through the field interpolation using a field buffer to make non-interlace.
- Some CRTs used in the high definition television receivers have a set number of horizontal pixels about twice as many as that of the CRTs of the ordinary television receivers, and thus, there is known a method for improving the resolution in a horizontal direction by doubling the number of pixels in a scanning line direction by interpolation.
- By the way, when the number of vertical pixels is to be increased in order to improving the quality of a television image as described above, a field buffer having a large capacity is required for interpolation, which leads to a problem with the larger circuit. In particular, the interpolation process in the horizontal direction and the interpolation process in the vertical direction are required to be effected in a short time, for example, within 1/60 seconds for one screen. Therefore, there is a need for an image processing circuit capable of performing the interpolation processes in the horizontal and vertical directions at high speed with hardware of simple structure without making arithmetic operation by the processor.
- The present invention has been devised in view of the aforementioned problems, and it is an object of the invention to provide an image processing circuit capable of carrying out high-speed processing and improving the horizontal and vertical resolutions even with its simple circuit configuration.
- An image processing circuit of the invention to transform the number of pixels in the horizontal and vertical directions into substantially twice by performing an interpolation process based on the pixel values of the pixels arranged regularly in the horizontal and vertical directions comprises pixel value extracting unit for extracting the pixel values of a total of nine pixels, three pixels in the horizontal direction by three pixels in the vertical direction, and pixel value calculating unit for calculating the pixel values of four pixels generated additionally corresponding to positions on the straight lines connecting a central pixel arranged in the center of the nine pixels and four peripheral pixels arranged in the oblique directions of the central pixel and at one-quarter the distance from the central pixel to the four peripheral pixels, on the basis of the pixel values of the nine pixels output from the pixel value extracting unit. Also, an image processing circuit of the invention to transform the number of scanning lines corresponding to an input signal and the number of pixels in the direction along the scanning line into substantially twice comprises pixel value extracting unit for extracting the pixel values of a total of nine pixels, three pixels in the horizontal direction along a scanning line by three pixels in the vertical direction in which the line and adjacent lines are abreast, from the pixel values of a plurality of pixels making up three adjacent scanning lines, in which the pixel values of pixels contained in the scanning line are input in a predetermined order corresponding to the scan direction of the scanning line, pixel value calculating unit for calculating the pixel values of four pixels generated additionally corresponding to positions on the straight lines connecting a central pixel arranged in the center of the nine pixels and four peripheral pixels arranged in the oblique directions of the central pixel and at one-quarter the distance from the central pixel to the four peripheral pixels, on the basis of the pixel values of the nine pixels extracted by the pixel value extracting unit, and pixel value output unit for outputting the pixel values of a plurality of generated pixels in units of column in order by arranging the generated pixels having the pixel values calculated by the pixel value calculating unit in two columns along a horizontal direction by correlating them with one scanning line corresponding to the input signal.
- An image processing circuit of the invention has four pixels generated additionally around a central pixel on the basis of the pixel values of nine pixels, in which this generation process is performed while shifting the central pixel in a scan direction in order to transform the number of pixels in each of the horizontal and vertical directions into substantially twice. In particular, when the four pixels are generated additionally around the central pixel, the pixel values of a total of nine pixels including this central pixel are only employed. Hence, there is a small number of pixels to be processed, and it is possible to simplify a pixel generation (pixel value calculation) process and a circuit configuration for performing the process as well as carrying out high-speed processing.
- It is desirable that the pixel value extracting unit outputs in parallel the pixel value of a first pixel input at a predetermined timing, the pixel value of a second pixel delayed by one pixel from the output timing of the first pixel, the pixel value of a third pixel delayed by two pixels from the output timing of the first pixel, the pixel value of a fourth pixel delayed by one scanning line from the output timing of the first pixel, the pixel value of a fifth pixel delayed by one scanning line from the output timing of the second pixel, the pixel value of a sixth pixel delayed by one scanning line from the output timing of the third pixel, the pixel value of a seventh pixel delayed by two scanning lines from the output timing of the first pixel, the pixel value of an eighth pixel delayed by two scanning lines from the output timing of the second pixel, and the pixel value of a ninth pixel delayed by two scanning lines from the output timing of the third pixel. In this way, the pixel values of nine pixels used in the pixel value calculating unit can be prepared only by delaying the timing of outputting the pixel value of each pixel to be input in scan order by a predetermined time.
- Also, it is desirable that the pixel value calculating unit sets the pixel values A1, A2, A3, A4 of four pixels generated additionally around the central pixel such that:
A1={Ne+(a+b+d)−(c+f+g+h+i)}/(N−2)
A2={Ne+(b+c+f)−(a+d+g+h+i)}/(N−2)
A3={Ne+(d+g+h)−(a+b+c+f+i)}/(N−2)
A4={Ne+(f+h+i)−(a+b+c+d+g)}/(N−2)
where the pixel values of nine pixels including the central pixel are a, b, c, d, e, f, g, h, and i in the input order, and N is an integer of 3 or greater. The pixel values of pixels generated additionally around the central pixel are most affected by the central pixel that is located closest thereto. If the pixel value of each pixel is obtained through a convolution operation with a sampling function, it is preferable that the pixel value of a pixel located within the interval of adjacent pixels may be added, and the pixel value of a pixel located outside the interval of adjacent pixels may be subtracted. Accordingly, for the nine pixels arranged in three columns and three rows, the pixel values of the pixels as viewed from the upper left in the horizontal direction are a through i, for example, and considering the pixel value of a pixel generated additionally on the upper left hand of the central pixel, the pixel value e of the central pixel has the greatest effect, the pixel values a, b, d of three pixels located next closest are considered on the plus side, and the pixel values c, f, g, h, i of remaining five pixels are considered on the minus side, resulting in the value A1. Also, the pixel values A2, A3, A4 of other three pixels generated additionally are the same, and have the respective values as mentioned above. The pixel values A1 through A4 of four pixels set in this way are obtained by simply adding or subtracting the respective pixel values, excluding the pixel value e of the central pixel, whereby the processed contents (calculation contents) are simplified, and it is possible to carry out high-speed processing and provide the simple circuit structure. Also, the value of N is desirably set to 10. As a result of examination by the present inventors, it has been confirmed that a clear enlarged image can be obtained by setting N to a value near 10. - Also, the pixel value extracting unit may set the pixel values A1, A2, A3, A4 of four pixels generated additionally around the central pixel such that:
A1={Me+(a+b+d)−(f+h+i)}/M
A2={Me+(b+c+f)−(d+g+h)}/M
A3={Me+(d+g+h)−(b+c+f)}/M
A4={Me+(f+h+i)−(a+b+d)}/M
where M is an integer of 2 or greater. Since the pixel value of any pixel generated additionally is mostly reflected by a variation of the pixel value along a direction of the line connecting this pixel and the central pixel, it is thought that the pixel values of two pixels present in the direction almost perpendicular to this direction may be negligible in effect without too great influence. Accordingly, for the nine pixels arranged in three columns and three rows, the pixel values of the pixels as viewed from the upper left in the horizontal direction are a through i, for example, and considering the pixel value of a pixel generated additionally on the upper left hand of the central pixel, the pixel value e of the central pixel has the greatest effect, the pixel values a, b, d of three pixels located next closest are considered on the plus side, the pixel values f, h, i of other three pixels are considered on the minus side, and the pixel values c, g of remaining two pixels are not considered, resulting the value A1 as mentioned above. In this way, each of the pixel values A1 and A4 of two pixels arranged across the central pixel contains commonly (a+b+d) and (f+h+i) as the same processing unit, and each of the pixel values A2 and A3 of remaining two pixels contains commonly (b+c+f) and (d+g+h) as the same processing unit. Hence, the circuit can be further simplified by sharing these processings. Also, the value of M is desirably set to 8. As a result of examination by the present inventors, it has been confirmed that a clear enlarged image can be obtained by setting M to a value near 8. - Also, the pixel value extracting unit may set the pixel values A1, A2, A3, A4 of four pixels generated additionally such that:
A1={Le+2b+2d −(c+f+g+h)}/L
A2={Le+2b+2f −(a+d+h+i)}/L
A3={Le+2d+2h −(a+b+f+i)}/L
A4={Le+2f+2h −(b+c+d+g)}/L
where L is an integer of 2 or greater. If the pixel value of any pixel generated additionally is to be strictly calculated using a sampling function, it can be thought that the pixel values of pixels arranged the distance equal to integral times the interval of adjacent pixels among the nine pixels have almost no effect. Accordingly, for the nine pixels arranged in three columns and three rows, the pixel values of the pixels as viewed from the upper left in the horizontal direction are a through i, for example, and considering the pixel value of a pixel generated additionally on the upper left hand of the central pixel, it is possible to ignore the effect of the pixel values of two pixels arranged on the upper left hand and the lower right hand, among the nine pixels, and other pixels are weighted at a predetermined value corresponding to the distance from the pixel generated additionally to respective pixels, resulting in the value A1. In this way, the pixel value can be obtained by reflecting the result of strict calculation using the sampling function. Also; the value of L is desirably set to 10. If the weighting factor for the pixel values a through i is obtained by calculation using the sampling function, the value of L is near 10. Hence, with the above settings, the pixel values can be obtained through the strict calculation using the sampling function. - Also, the pixel value output unit desirably comprises first scanning line generating unit for storing and outputting the pixel values of two pixels generated additionally corresponding to the pixel contained in one scanning line where the central pixel is not contained in the order of arrangement along this scanning line, and second scanning line generating unit for storing and outputting the pixel values of two pixels generated additionally corresponding to the pixel contained in the other scanning line where the central pixel is not contained in the order of arrangement along this scanning line, and comprises output pixel value selecting unit for selecting alternately the output operation of consecutive pixel values of one scanning line by the first and second scanning line generating unit to be made in the first scanning line generating unit or the second scanning line generating unit. From the above pixel value calculating unit the pixel values of generated pixels arranged in two columns corresponding to one scanning line of an input signal are output in succession. Hence, the pixel values corresponding to respective columns are stored in the first and second scanning line generating unit in succession, and the output operation of these pixel values is performed alternately by the first and second scanning line generating unit. Thereby, two scanning lines can be generated additionally corresponding to one scanning line of the input signal, so that the number of scanning lines can be transformed into substantially twice.
-
FIG. 1 is a view showing the relation between the pixels contained in three scanning lines to be processed and four pixels generated additionally on the basis of these pixels in the image processing circuit of the first embodiment; -
FIG. 2 is a block diagram showing the configuration of the image processing circuit of the first embodiment; -
FIG. 3 is a block diagram showing the detailed configuration of the pixel value extracting section included in the image processing circuit as shown inFIG. 2 ; -
FIG. 4 is a block diagram showing the detailed configuration of the pixel value calculating section included in the image processing circuit as shown inFIG. 2 ; -
FIG. 5 is a block diagram showing the detailed configuration of the pixel value output section included in the image processing circuit as shown inFIG. 2 ; -
FIG. 6 is a block diagram showing the detailed configuration of a pixel value calculating section in the second embodiment; -
FIG. 7 is an explanatory view of a sampling function for use with the third embodiment; -
FIG. 8 is an explanatory view in performing a convolution operation of the pixel value of the pixel Q1 generated additionally, employing the pixel values of nine pixels P1 through P9; and -
FIG. 9 is a block diagram showing the detailed configuration of a pixel value calculating section in the third embodiment. - An image processing circuit according to one embodiment of the present invention will be described below with reference to the accompanying drawings. This image processing circuit is contained in a television receiver, for example, and performs an operation of transforming the number of scanning lines and the number of pixels along each scanning line, corresponding to an input (received) signal of the NTSC system into substantially twice.
-
FIG. 1 is a view showing the relation between the pixels contained in three scanning lines to be processed and four pixels generated additionally on the basis of these pixels in the image processing circuit of the first embodiment. A horizontal direction as indicated inFIG. 1 extends along a scanning line corresponding to an input signal, and each pixel along each scanning line of the interlaced scanning that is performed in the television receivers for ground wave broadcasting is indicated by “●”. Also, “◯” indicates a pixel generated additionally by the arrangement of the pixels on an original scanning line and through an interpolation process of these pixel values. - In this embodiment, on the basis of the pixel values of three pixels along each of three adjacent scanning lines, that is, a total of nine pixels, three pixels in the horizontal direction by three pixels in the vertical direction in which the line and adjacent lines are abreast, four pixels are generated additionally around the center pixel of these nine pixels, as shown in
FIG. 1 . - Suppose that the nine pixels along the scanning lines are P1, P2, P3, P4, P5, P6, P7, P8 and P9 in the scan order, and the pixel values are a, b, c, d, e, f, g, h, and i. Also, suppose that a pixel Q1 is generated additionally at a position on a straight line connecting the central pixel P5 and the lower right pixel P1 and one-quarter the distance from the central pixel P5 to the pixel P1, a pixel Q2 is generated additionally at a position on a straight line connecting the central pixel P5 and the lower left pixel P3 and one-quarter the distance from the central pixel P5 to the pixel P3, a pixel Q3 is generated additionally at a position on a straight line connecting the central pixel P5 and the upper right pixel P7 and one-quarter the distance from the central pixel P5 to the pixel P7, and a pixel Q4 is generated additionally at a position on a straight line connecting the central pixel P5 and the upper left pixel P9 and one-quarter the distance from the central pixel P5 to the pixel P9.
- In general, the pixel values of four pixels Q1, Q2, Q3 and Q4 generated additionally around the central pixel P5 are most affected by the central pixel P5 located closest. Also, considering a case of calculating the pixel value of each pixel by a convolution operation using a sampling function, it is preferable that the pixel value of pixel located-within the interval of adjacent pixels (e.g., interval between the pixels P5 and P4, or between the pixels P3 and P2) may be added, and the pixel value of pixel located outside the interval of adjacent pixels may be subtracted.
- Considering the pixel value A1 of a new pixel Q1 located on the lower right hand of the central pixel P5, the pixel value e of the central pixel P5 has the greatest effect, the pixel values a, b, d of three pixels P1, P2, P4 located next closest are considered on the plus side, and the pixel values c, f, g, h, i of remaining five pixels P3, P6, P7, P8, P9 are considered on the minus side. Accordingly, the pixel value A1 of the pixel Q1 is such as:
A1={10e+(a+b+d)−(c+f+g+h+i})/8 (1)
Supposing N to be an integer of 3 or greater, the pixel value A1 of the pixel Q1 can be represented such as:
A1={Ne+(a+b+d)−(c+f+g+h+i)}/(N−2)
As a result of examination by the present inventors, it has been confirmed that a clear enlarged image can be obtained by setting N to a value near 10, and the above expression (1) can be obtained by setting N tob 10. - Similarly, the pixel values A2, A3 and A4 of three pixels Q2, Q3 and Q4 generated additionally around the central pixel P5 can be represented such as:
A2={Ne+(b+c+f)−(a+d+g+h+i)}/(N−2)
A3={Ne+(d+g+h)−(a+b+c+f+i)}/(N−2)
A4={Ne+(f+h+i)−(a+b+c+d+g)}/(N−2)
Substituting N=10 into the respective expressions,
A2={10e+(b+c+f)−(a+d+g+h+i)}/8 (2)
A3={10e+(d+g+h)−(a+b+c+f+i)}/8 (3)
A4={10e+(f+h+i)−(a+b+c+d+g)}/8 (4) -
FIG. 2 is a block diagram showing the configuration of the image processing circuit of this embodiment. The image processing circuit of this embodiment as shown inFIG. 2 comprises a pixelvalue extracting section 100, a pixelvalue calculating section 200, and a pixelvalue output section 300. - The pixel
value extracting section 100 extracts the pixel values a through i of nine pixels as shown inFIG. 1 from among the pixel values of the pixels contained in three adjacent scanning lines included in an input signal. For example, if an RGB signal is considered as the input signal, the image processing circuits as shown inFIG. 2 corresponding to the respective color components of R, G and B are provided, and the pixelvalue extracting section 100 extracts the pixel values of nine pixels for an input R signal (or G signal or B signal). Other input signals than the RGB signal may be used, or the pixel values of nine pixels may be extracted on the basis of an input luminance signal. - The pixel
value calculating section 200 calculates the pixel values A1 through A4 of four pixels Q1 through Q4 generated additionally around the central pixel P5 as shown inFIG. 1 on the basis of the pixel values a through i of nine pixels that are output from the pixelvalue extracting section 100, and outputs these four pixel values in parallel. - The pixel
value output section 300 accepts the pixel values A1 through A4 of four pixels Q1 through Q4 that are output from the pixelvalue calculating section 200. The pixelvalue output section 300 stores and outputs the pixel values A1 through A4 for each scanning line after transformation. For example, if attention is paid to four pixels Q1 through Q4 generated additionally around the pixel P5, a pixel Q1 and a pixel Q2 are stored corresponding to a first scanning line generated additionally, and a pixel Q3 and a pixel Q4 are stored corresponding to a second scanning line generated additionally, as shown inFIG. 1 . By performing such a processing for one scanning line where the pixel P5 is contained, two new scanning lines can be generated additionally corresponding to one scanning line contained in the input signal, whereby the number of pixels contained in two scanning lines generated additionally is substantially twice the number of pixels contained in the original scanning line. - The pixel
value extracting section 100 corresponds to pixel value extracting unit; the pixelvalue calculating section 200 corresponds to pixel value calculating unit; and the pixelvalue output section 300 corresponds to pixel value output unit. -
FIG. 3 is a block diagram showing the detailed configuration of the pixelvalue extracting section 100 included in the image processing circuit as shown inFIG. 2 . As shown inFIG. 3 , the pixelvalue extracting section 100 comprises six D-type flip-flops (hereinafter referred to as “D-FF”) 110 through 115, and twoline memories - In this extracting
value extracting section 100, the pixel values of the pixels contained in the scanning line corresponding to the input signal as the data (pixel value data) of a predetermined number of bits are input in synchronism with a clock signal CK1 corresponding to a predetermined sampling frequency. The input pixel value data are input into two D-FFs line memory 120 and two D-FFs line memory 120 are input into aline memory 121 and the D-FFs line memories - Accordingly, considering the time at which the pixel value data (pixel value i) corresponding to a pixel P9 arranged at the upper left hand of the central pixel P5 in
FIG. 1 is input into the pixelvalue extracting section 100, the pixel value data (pixel value h) of a pixel P8 input ahead by one pixel is output from a D-FF 110, and the pixel value data (pixel value g) of a pixel P7 input ahead by two pixels is output from a D-FF 111. Also, the pixel value data (pixel value f) of a pixel P6 input ahead by one scanning line is output from theline memory 120, the pixel value data (pixel value e) of the central pixel P5 input ahead by one scanning line and one pixel is output from a D-FF 112, and the pixel value data (pixel value d) of a pixel P4 input ahead by one scanning line and two pixels is output from a D-FF 113. Further, the pixel value data (pixel value c) of a pixel P3 input ahead by two scanning lines is output from theline memory 121, the pixel value data (pixel value b) of a pixel P2 input ahead by two scanning lines and one pixel is output from a D-FF 114, and the pixel value data (pixel value a) of a pixel P1 input ahead by two scanning lines and two pixels is output from a D-FF 115. In this way, the pixel value data corresponding to nine pixels P1 through P9 as shown inFIG. 1 are output in parallel from the pixelvalue extracting section 100. -
FIG. 4 is a circuit diagram showing the detailed configuration of the pixelvalue calculating section 200 included in the image processing circuit as shown inFIG. 2 . As shown inFIG. 4 , the pixelvalue calculating section 200 comprises fourteenadders 130 through 143, eightsubtracters 150 through 157, amultiplier 160 for making tenfold multiplication, and fourdividers 170 through 173 for dividing the input value by adivisor 8. In the following, the operation of the pixelvalue calculating section 200 for calculating the pixel values A1 through A4 of four pixels Q1 through Q4 will be described for each pixel, employing the expressions (1) through (4). - The calculation process of the pixel value A1 is performed using the
adders subtracters adders adders single adder 142. And three addition results are input into twosubtracters adder 134 subtracted by a value (c+f+g+h+i) that is a sum of the addition results output from theadders subtracter 154 in the latter stage. Accordingly, a multiplication result (10 e) of themultiplier 160 is added to this output value by anadder 138, so that an addition result (10 e+(a+b+d)−(c+f+g+h+i)) is output. Further adivider 170 connected in the latter stage makes division by adivisor 8, resulting in the pixel value A1 as indicated in the expression (1), and this calculation result is output from thedivider 170. - The calculation process of the pixel value A2 is performed using the
adders subtracters 151, 155. More specifically, three pixel values b, c, f are added by twoadders adders single adder 143. And three addition results are input into twosubtracters 151, 155, respectively, so that an output value (b+c+f) that is an addition result output from anadder 135 subtracted by a value (a+d+g+h+i) that is a sum of the addition results output from theadders multiplier 160 is added to this output value by anadder 139, so that an addition result (10 e+(b+c+f)−(a+d+g+h+i)} is output. Further adivider 171 connected in the latter stage makes division by adivisor 8, resulting in the pixel value A2 as indicated in the expression (2), and this calculation result is output from thedivider 171. - The calculation process of the pixel value A3 is performed using the
adders subtracters adders adders single adder 143. And three addition results are input into twosubtracters adder 136 subtracted by a value (a+b+c+f+i) that is a sum of the addition results output from theadders subtracter 156 in the latter stage. Accordingly, a multiplication result (10 e) of themultiplier 160 is added to this output value by anadder 140, so that an addition result {10e+(d+g+h)−(a+b+c+f+i)} is output. Further adivider 172 connected in the latter stage makes division by adivisor 8, resulting in the pixel value A3 as indicated in the expression (3), and this calculation result is output from thedivider 172. - The calculation process of the pixel value A4 is performed using the
adders subtracters adders adders single adder 142. And three addition results are input into twosubtracters adder 137 subtracted by a value (a+b+c+d+g) that is a sum of the addition results output from theadders subtracter 157 in the latter stage. Accordingly, a multiplication result (10 e) of themultiplier 160 is added to this output value by anadder 141, so that an addition result {10 e+(f+h+i)−(a+b+c+d+g)} is output. Further adivider 173 connected in the latter stage makes division by adivisor 8, resulting in the pixel value A4 as indicated in the expression (4), and this calculation result is output from thedivider 173. - In this way, the pixel values of the pixels are simply added or subtracted, except for multiplying the pixel value e of the central pixel P5 tenfold. Hence, the processing contents can be simplified, and it is possible to carry out high-speed processing and provide the simple circuit configuration.
- The pixel
value calculating section 200 as shown inFIG. 4 is provided with fourdividers 170 through 173, in which an addition result output from the corresponding adder is divided by adivisor 8. However, thesedividers 170 through 173 can be realized by the three-bit shift circuits, that is, only by wiring the output lines of theadders 138 through 141 shifted by three bits. Also, in displaying an image on the CRT (Cathode Ray Tube), it is required that each pixel value that is digital data is finally converted into an analog signal, but an equivalent operation to the division process by thedividers 170 through 173 can be effected by adjusting the gain in this conversion process. Hence, the fourdividers 170 through 173 may be removed from the pixelvalue calculating section 200 shown inFIG. 4 . -
FIG. 5 is a block diagram showing the detailed configuration of the pixelvalue output section 300 included in the image processing circuit as shown inFIG. 2 . As shown inFIG. 5 , the pixelvalue output section 300 comprises threeselectors 210 through 212, twofrequency demultipliers FFs line memories 240 through 242. Aselector 210, afrequency demultiplier 220, a D-FF 230, and aline memory 240 correspond to first scanning line generating unit; aselector 211, afrequency demultiplier 221, a D-FF 231, and theline memories selector 212 corresponds to output pixel value selecting unit. - The
selector 210 selects alternately the pixel value data corresponding to the pixel values A1, A2 input concurrently from the pixelvalue calculating section 200, and outputs it. The selection timing is set by a signal output from thefrequency demultiplier 220. Thisfrequency demultiplier 220 receives a clock signal CK2 having twice the frequency of a clock signal CK1 corresponding to the sampling frequency of each pixel data input into the pixelvalue extracting section 100 as shown inFIG. 3 and outputs a signal with the frequency divided by two. Accordingly, theselector 210 having a selected state determined by the signal with the frequency of clock signal CK2 divided by 2 outputs alternately the pixel value data of the pixel values A1, A2 at an interval that is one-half the input interval of the pixel value data into the pixelvalue extracting section 100. The pixel data value corresponding to the pixel value A1 and the pixel value data corresponding to the pixel value A2 that are output alternately are once held in the D-FF 230, and then input into theline memory 240. Theline memory 240 is a first-in first-out memory for storing in the input order the pixel values of one scanning line corresponding to the first scanning line containing the pixels Q1 and Q2 as shown inFIG. 1 , and stores the pixel value data of the pixels input from the D-FF 230 by one scanning line. Thisline memory 240 makes the write operation of the pixel value data synchronously when a write clock signal WCK is input, and the read operation of the pixel value data synchronously when a read clock signal RCK is input. The write clock signal WCK has the same frequency as the clock signal CK2 as mentioned above, and is input into theline memory 240 over the entire period where the pixel value data is output from the D-FF 230. On one hand, the read clock signal RCK has the same frequency as a clock signal CK3 having twice the frequency of the clock signal CK2, and theline memory 240 outputs the pixel value data at a reading rate twice as fast as a writing rate of the pixel value data when this read clock signal RCK is input. Also, this read clock signal RCK is input over about one-half of the period where the write clock signal WCK is input, so that the pixel value data stored in theline memory 240 may not underflow. - Similarly, the
selector 211 selects alternately the pixel value data corresponding to the pixel values A3, A4 input concurrently from the pixelvalue calculating section 200, and outputs it. Theselector 211 having a selected state determined by the signal with the frequency of clock signal CK2 divided by 2 outputs alternately the pixel value data of the pixel values A3, A4 at an interval that is one-half the input interval of the pixel value data into the pixelvalue extracting section 100. The pixel data value corresponding to the pixel value A3 and the pixel value data corresponding to the pixel value A4 that are output alternately are once held in the D-FF 231, and then input into theline memory 241. Theline memory 241 is a first-in first-out memory for storing in the input order the pixel values of one scanning line corresponding to the second scanning line containing the pixels Q3 and Q4 as shown inFIG. 1 , and stores the pixel value data of the pixels input from the D-FF 231 by one scanning line. In the latter stage of theline memory 241, aline memory 242 having the same capacity is connected. Theseline memories aforementioned line memory 240. Theline memory 241 in the former stage is employed to delay the input pixel data by one scanning line, and both the write clock signal WCK and the read clock signal RCK are set to the same frequency as the clock signal CK2. Also, theline memory 242 in the latter stage is used for the same purposes as theline memory 240, and performs the write operation of the pixel value data in synchronism with the write clock signal WCK having the same frequency as the clock signal CK2, and the read operation of the pixel value data in synchronism with the read clock signal RCK having the same frequency as the clock signal CK3 having twice the frequency as the clock signal CK2 and over an input period that is about one-half of that of the write clock signal WCK. - The input period of the read clock signal RCK into the
line memory 240 corresponding to the first scanning line and theline memory 242 corresponding to the second scanning line are alternately switched for each scanning line, whereby after the pixel value data of the pixels Q1, Q2 corresponding to the first scanning line are output by one scanning line from theline memory 240, the pixel value data of the pixels Q3, Q4 corresponding to the second scanning line are output by one scanning line from theline memory 242. Theselector 212 provided in the latter stage of these twoline memories line memory 240 and the pixel value data by one scanning line output from theline memory 242. - In this way, the pixel value data of two scanning lines corresponding to the first and second new scanning lines having about twice the number of constituent pixels can be output in the new scan order from the pixel
value output section 300, while the pixel value data of one scanning line is input into the pixelvalue extracting section 100. For example, when the interlaced scanning is performed, the positions of the pixels Q1 through Q4 generated additionally employing the pixel value data input corresponding to the odd field, and the positions of the pixels Q1 through Q4 generated additionally employing the pixel value data input corresponding to the even field are exactly the same, whereby a progressive image having about twice the number of pixels in the horizontal and vertical directions can be easily produced from an image obtained by interlaced scanning using the image processing circuit as described above. - In the above first embodiment, all the pixel values a through i of nine pixels P1 through P9 are employed to calculate the pixel values A1 through A4 of the four pixels Q1 through Q4 located around the central pixel P5 as shown in
FIG. 1 , but the circuit configuration may be simplified by excluding the pixel values of the pixels which are thought to be less influential in calculating the pixel values A1 through A4 from the calculation object. - Since the pixel values A1 through A4 of the four pixels Q1 through Q4 generated additionally are greatly affected by a variation of pixel value along a direction of the line connecting the pixel values Q1 through Q4 and the central pixel P5, there may be less significant effect by ignoring the influence of the pixel values of two pixels located in a direction substantially perpendicular to this direction.
- In this embodiment, considering the pixel value A1 of the pixel Q1 located on the lower right hand of the central pixel P5, the pixel value c of the pixel P3 located on the lower left hand of the central pixel P5 and the pixel value g of the pixel P7 located on the upper right hand of the central pixel P5 are excluded from the calculation object. Accordingly, the pixel value A1 of the pixel Q1 is such as:
A1={8e+(a+b+d)−(f+h+i)}/8 (5)
Supposing M to be an integer of 2 or greater, the pixel value A1 of the pixel Q1 can be represented such as:
A1={Me+(a+b+d)−(f+h+i)}/M
As a result of examination by the present inventors, it has been confirmed that a clear enlarged image can be obtained by setting M to a value near 8, and the above expression (5) can be obtained by setting M to 8. - Similarly, the pixel values A2, A3 and A4 of three pixels Q2, Q3 and Q4 generated additionally around the central pixel P5 can be represented such as:
A2={Me+(b+c+f)−(d+g+h)}/M
A3={Me+(d+g+h)−(b+c+f)}/M
A4={Me+(f+h+i)−(a+b+d)}/M
Substituting M=8 into the respective expressions,
A2={8e+(b+c+f)−(d+g+h)}/8 (6)
A3={8e+(d+f+h)−(b+c+f)}/8 (7)
A4={8e+(f+h+i)−(a+b+d)}/8 (8) -
FIG. 6 is a block diagram showing the detailed configuration of a pixel value calculating section 200 a in this embodiment. The pixelvalue extracting section 100 connected in the former stage of the pixel value calculating section 200 a and the pixelvalue output section 300 connected in the latter stage are the same as those of the image processing circuit of the first embodiment, and the pixel value calculating section 200 a will be only described below. - As shown in
FIG. 6 , the pixel value calculating section 200 a comprises twelveadders 130 through 141, foursubtracters 150 through 153, amultiplier 160 a for making eightfold multiplication, and fourdividers 170 through 173 for dividing the input value by adivisor 8. This pixel value calculating section 200 a excludes twoadders subtracters 154 through 157 from the pixelvalue calculating section 200 as shown inFIG. 4 , and replaces thetenfold multiplier 160 with aneightfold multiplier 160 a. Adivisor 8 of fourdividers 170 through 173 and amultiplier factor 8 of themultiplier 160 a are a power of 2, and can be implemented only by shifting the wiring by three bits. - The operation of the pixel value calculating section 200 a will be described for each pixel below in the case where the pixel values A1 through A4 of the four pixels Q1 through Q4 are calculated, employing the aforementioned expressions (5) through (8).
- A calculation process of the pixel value A1 is performed employing the
adders subtracter 150. More specifically, three pixel values a, b, d are added by twoadders adders subtracter 150, an output value (a+b+d) that is an addition result output from theadder 134 subtracted by an output value (f+h+i) that is an addition result output from theadder 137 is output. Accordingly, if theadder 138 adds a multiplication result (8e) of themultiplier 160 a to this output value, an addition result {8e +(a+b+d)−(f+h+i)} is output. Further thedivider 170 connected in the latter stage makes division by adivisor 8 to calculate the pixel value A1 as indicated in the expression (5), its calculation result being output from thedivider 170. - A calculation process of the pixel value A2 is performed employing the
adders subtracter 151. More specifically, three pixel values b, c, f are added by twoadders adders subtracter 151, an output value (b+c+f) that is an addition result output from theadder 135 subtracted by an output value (d+g+h) that is an addition result output from theadder 136 is output. Accordingly, if theadder 139 adds a multiplication result (8e) of themultiplier 160 a to this output value, an addition result {8e+(b+c+f)−(d+g+h)} is output. Further thedivider 171 connected in the latter stage makes division by adivisor 8 to calculate the pixel value A2 as indicated in the expression (6), its calculation result being output from thedivider 171. - A calculation process of the pixel value A3 is performed employing the
adders subtracter 152. More specifically, three pixel values d, g, h are added by twoadders adders subtracter 152, an output value (d+g+h) that is an addition result output from theadder 136 subtracted by an output value (b+c+f) output from theadder 135 is output. Accordingly, if theadder 140 adds a multiplication result (8e) of themultiplier 160 a to this output value, an addition result {8e+(d+g+h)−(b+c+f)} is output. Further thedivider 172 connected in the latter stage makes division by adivisor 8 to calculate the pixel value A3 as indicated in the expression (7), its calculation result being output from thedivider 172. - A calculation process of the pixel value A4 is performed employing the
adders subtracter 153. More specifically, three pixel values f, h, i are added by twoadders adders subtracter 153, an output value (f+h+i) that is an addition result output from theadder 137 subtracted by an output value (a+b+d) that is an addition result output from theadder 134 is output. Accordingly, if theadder 141 adds a multiplication result (8e) of themultiplier 160 a to this output value, an addition result (8e +(f+h+i)−(a+b+d)) is output. Further thedivider 173 connected in the latter stage makes division by adivisor 8 to calculate the pixel value A4 as indicated in the expression (8), its calculation result being output from thedivider 173. - In this way, the pixel values of the pixels are simply added or subtracted, except that the pixel value e of the central pixel P5 is multiplied eightfold. And the number of adders or subtracters can be reduced as compared with the configuration as shown in
FIG. 4 , making it possible to lessen the processing contents, and further to carry out high-speed processing and simplify the circuit configuration. - In the first and second embodiments as described above, the pixel value e of the central pixel P5 is weighted by a weighting factor of 2 or greater (10 in the expression (1), 8 in the expression (5)) and the pixel values of other pixels are appropriately added or subtracted to calculate the pixel values A1 through A4 of the four pixels Q1 through Q4 located around the central pixel P5 as shown in
FIG. 1 . However, the degree to which the pixel values a through i of the nine pixels P1 through P9 has the effect may be computed employing a sampling function to obtain the correct coefficient values. -
FIG. 7 is an explanatory view of a sampling function for use with this embodiment. A sampling function H(t) shown inFIG. 7 is a function of a local support to which attention is paid on differentiability. For example, the function H(t) can be differentiated only once in the whole region and a function of a local support having finite values, which are not zeroes, when a sample position t along a horizontal axis is between −2 and +2. In addition, since being a sampling function, the sampling function H(t) is characterized in that the sampling function H(t) becomes one only at a sample point with t=0 and becomes zero at sample points with t=≈1 and ±2. - Concretely, a function H(t) fulfilling various conditions described above (a sampling function, one-time differentiability, and a local support), with letting a third order B spline function be F(t), such a sampling function H(t) can be defined as:
H(t)=−F(t+½)/4+F(t)−F(t−½)/4. - Here, the third order B spline function F(t) is expressed as:
(4t 2+12t+9)/4; − 3/2≦t<−½
−2t 2+ 3/2; −½≦t<½
(4t 2−12t+9)/4; ½≦t< 3/2
In addition, it is possible to express the above-mentioned sampling function H(t) by using a quadric piecewise polynomial as follows:
(−t 2−4t−4)/4; −2≦t<− 3/2
(3t 2+8t+5)/4; − 3/2≦t<−1
(5t 2+12t+7)/4; −1≦t<−½
(−7t 2+4)/4; −½≦t<½
(5t 2−12t+7)/4; ½≦t<1
(3t 2−8t+5)/4; 1≦t< 3/2
(−t 2+4t−4)/4; 3/2≦t≦2 - The above-described sampling function H(t) is a quadric piecewise polynomial, and uses the third order B spline function F(t). Therefore, the function H(t) is a function of a local support that is guaranteed to be differentiable only once over the whole region. In addition, the function H(t) becomes zero at t=±1 and ±2.
- In this manner, the above-described function H(t) is a sampling function and a function of a local support that can be differentiated only once over the whole region and converges to zero at t=±2. Therefore, it is possible to perform interpolation of a value between discrete pixel data using a function, which is differentiable only once, by performing convolution on the basis of respective discrete pixel data using this sampling function H(t).
-
FIG. 8 is an explanatory view in performing a convolution operation of the pixel value of the pixel Q1 generated additionally, employing the pixel values of nine pixels P1 through P9. For example, if two adjacent pixels on a scanning line are normalized to one, the distance t1 from the pixel Q1 to the central pixel P5 is obtained as t1=√{(0.25)2+(0.25)2}=0.35. Accordingly, if the specific values of the sampling function H(t1) are computed using this distance t1, the degree to which the pixel value e of the central pixel P5 has the effect on the pixel value A1 of the pixel Q1 can be obtained. - In this way, specifically, the degree to which the pixel values a through i of the nine pixels P1 through P9 has the effect on the pixel value A1 of the pixel Q1 is −0.027, 0.16, −0.071, 0.16, 0.79, −0.080, −0.071, −0.080, or −0.014. In practice, it is required to adjust each value to be closer to the integer by multiplying each of the nine values by an appropriate constant because the circuit becomes complex if any other numbers than the integer are multiplied. For example, multiplying each value by 10/0.79 so that the degree (0.79) to which the pixel value e has the effect on the central pixel P5 may be equal to 10, results in −0.34, 2.03, −0.90, 2.03, 10, −1.01, −0.90, −1.01, or −0.18. Among them, −0.34 and −0.18 are extremely smaller than 1, and can be ignored. From the above, the pixel value A1 of the pixel Q1 is obtained as follows.
A1={10e+2b+2d−(c+f+g+h)}/10 (9)
A reason why the result of addition and subtraction is divided by 10 in the right side of the expression (9) is that the pixel value A1 of the pixel Q1 is adjusted to have the same value, when the pixel values a through i of the nine pixels P1 through P9 are all the same value. The same adjustment has been made in the expressions (1) through (8) as cited above. Deviating from each coefficient computed employing the sampling function, the pixel value A1 of the pixel Q1 may be computed using
A1={Le+2b+2d−(c+f+g+h)}/L
where L is an integer of 2 or greater. - Similarly, the pixel values A2, A3 and A4 of three pixels Q2, Q3 and Q4 generated additionally around the central pixel P5 can be represented such as:
A2={Le+2b+2f−(a+d+h+i)}/L
A3={Le+2d+2h−(a+b+f+i)}/L
A4={Le+2f+2h−(b+c+d+g)}/L
Substituting L=10 which is the suitable value obtained by the calculation employing the sampling function into the respective expressions,
A2={10e+2b+2f−(a+d+h+i)}/10 (10)
A3={10e+2d+2h−(a+b+f+i)}/10 (11)
A4={10e+2f+2h−(b+c+d+g)}/10 (12) -
FIG. 9 is a block diagram showing the detailed configuration of a pixelvalue calculating section 200 b in this embodiment. The pixelvalue extracting section 100 connected in the former stage of the pixelvalue calculating section 200 b and the pixelvalue output section 300 connected in the latter stage are the same as those included in the first embodiment, and the pixelvalue calculating section 200 b will be only described. - As shown in
FIG. 9 , the pixelvalue calculating section 200 b of this embodiment comprises fourteenadders 330 through 343, foursubtracters 350 through 353, fourmultipliers 360 through 363 for making twofold multiplication, amultiplier 364 for making tenfold multiplication, and fourdividers 370 through 373 for dividing the input value by adivisor 10. Fourmultipliers 360 through 363 can be implemented by shifting the wiring by one bit. - In the following, the operation of the pixel
value calculating section 200 b will be described for each pixel in the case where the pixel values A1 through A4 of four pixels Q1 through Q4 are calculated, employing the aforementioned expressions (9) through (12). - A calculation process of the pixel value A1 is performed employing the
adders subtracter 350 and amultiplier 360. More specifically, two pixel values b, d are added by anadder 331, and this addition result is doubled by themultiplier 360. And four pixel values c, f, g, h are added employing threeadders multiplier 360 and the addition result of anadder 336 into thesubtracter 350, an output value (2b+2d) that is the multiplication result output from themultiplier 360 subtracted by an output value (c+f+g+h) that is an addition result output from theadder 336 is output. Accordingly, with anadder 340 adding a multiplication result (10e) of themultiplier 364 to the output value, an addition result {10e+2b+2d−(c+f+g+h)} is output, and further divided by adivisor 10 by adivider 370 connected in the latter stage to calculate the pixel value A1 as indicated in the expression (9), its calculation result being output from thedivider 370. - Also, a calculation process of the pixel value A2 is performed employing the
adders subtracter 351 and amultiplier 361. More specifically, two pixel values b, f are added by an adder 333, and this addition result is doubled by themultiplier 361. And four pixel values a, d, h, i are added employing threeadders multiplier 361 and the addition result of anadder 337 into thesubtracter 351, an output value (2b+2f) that is the multiplication result output from themultiplier 361 subtracted by an output value (a+d+h+i) that is an addition result output from theadder 337 is output. Accordingly, with anadder 341 adding a multiplication result (10e) of themultiplier 364 to the output value, an addition result {10e+2b+2f−(a+d+h+i)} is output, and further divided by adivisor 10 by adivider 371 connected in the latter stage to calculate the pixel value A2 as indicated in the expression (10), its calculation result being output from thedivider 371. - Also, a calculation process of the pixel value A3 is performed using the
adders multiplier 362. More specifically, two pixel values d, h are added by anadder 332, and this addition result is doubled by themultiplier 362. Also, four pixel values a, b, f, i are added employing threeadders multiplier 362 and the addition result of anadder 338 into the subtracter 352, an output value (2d+2h) that is the multiplication result output from themultiplier 362 subtracted by an output value (a+b+f+i) that is an addition result output from theadder 338 is output. Accordingly, with an adder 342 adding a multiplication result (10e) of themultiplier 364 to the output value, an addition result ({10e+2d+2h−(a+b+f +i)} is output, and further divided by adivisor 10 by adivider 372 connected in the latter stage to calculate the pixel value A3 as indicated in the expression (11), its calculation result being output from thedivider 372. - Also, a calculation process of the pixel value A4 is performed using the
adders subtracter 353 and amultiplier 363. More specifically, two pixel values f, h are added by anadder 335, and this addition result is doubled by themultiplier 363. Also, four pixel values b, c, d, g are added employing threeadders multiplier 363 and the addition result of anadder 339 into thesubtracter 353, an output value (2f+2h) that is the multiplication result output from themultiplier 363 subtracted by an output value (b+c+d+g) that is an addition result output from theadder 339 is output. Accordingly, with anadder 343 adding a multiplication result (10e) of themultiplier 364 to the output value, an addition result {10e+2f+2h−(b+c+d+g)} is output, and further divided by adivisor 10 by adivider 373 connected in the latter stage to calculate the pixel value A4 as indicated in the expression (12), its calculation result being output from thedivider 373. - In this way, the pixel values of the pixels are simply added or subtracted, except that the multipliers with the multiplying factors of 10 and 2 are employed. Hence, the processing contents can be simplified, and it is possible to carry out high-speed processing and provide the simple circuit configuration. Since the weighting factor of each pixel value is determined using the sampling function, the pixel value with the strict calculation result reflected can be obtained.
- As described above, with this invention, four pixels are generated additionally around the central pixel on the basis of the pixel values of nine pixels, in which this generation process is performed while shifting the central pixel in a scan direction in order to transform the number of pixels in the horizontal and vertical directions into substantially twice. In particular, when four pixels are generated additionally around the central pixel, the pixel values of nine pixels including this central pixel are only employed. Hence, there are a small number of pixels to be processed, and it is possible to simplify a pixel generation (pixel value calculation) process and a circuit for performing the process as well as carrying out high-speed processing.
Claims (8)
1-10. (canceled)
11. An image processing circuit for transforming the number of pixels in each of horizontal and vertical directions into substantially twice by performing an interpolation process based on pixel values of the pixels arranged regularly in the horizontal and vertical directions, characterized by comprising:
pixel value extracting unit for extracting the pixel values of a total of nine pixels, three pixels in the horizontal direction by three pixels in the vertical direction; and
pixel value calculating unit for calculating the pixel values of four pixels generated additionally corresponding to positions on straight lines connecting a central pixel arranged in the center of said nine pixels and four peripheral pixels arranged in the oblique directions of the central pixel and at one-quarter the distance from said central pixel to said four peripheral pixels, on the basis of the pixel values of said nine pixels output from said pixel value extracting unit.
12. The image processing circuit according to claim 11 , characterized in that said pixel value calculating unit sets the pixel values A1, A2, A3, A4 of four pixels generated additionally around said central pixel such that:
A1={Ne+(a+b+d)−(c+f+g+h+i)}/(N−2)
A 2 ={Ne+(b+c+f)−(a+d+g+h+i)}/(N−2)
A3={Ne+(d+g+h)−(a+b+c+f+i)}/(N−2)
A4={Ne+(f+h+i)−(a+b+c+d+g)}/(N−2)
where the pixel values of said nine pixels including said central pixel are a, b, c, d, e, f, g, h, and i in the scan order, and N is an integer of 3 or greater.
13. The image processing circuit according to claim 12 , characterized in that by having the value of N to 10, said pixel values A1, A2, A3, A4 are set such that:
A1={10e+(a+b+d)−(c+f+g+h+i)}/8
A2 ={10e+(b+c+f)−(a+d+g+h+i)}/8
A3={10e+(d+g+h)−(a+b+c+f+i)}/8
A4={10e+(f+h+i)−(a+b+c+d+g)}/8
14. The image processing circuit according to claim 11 , characterized in that said pixel value calculating unit sets the pixel values A1, A2, A3, A4 of four pixels generated additionally around said central pixel such that:
A1={Me+(a+b+d)−(f+h+i)}/M
A2={Me+(b+c+f)−(d+g+h)}/M
A3={Me+(d+g+h)−(b+c+f)}/M
A4={Me+(f+h+i)−(a+b+d)}/M
where the pixel values of said nine pixels including said central pixel are a, b, c, d, e, f, g, h, and i in the scan order, and M is an integer of 2 or greater.
15. The image processing circuit according to claim 14 , characterized in that by having the value of M to 8, said pixel values A1, A2, A3, A4 are set such that:
A1={8e+(a+b+d)−(f+h+i)}/8
A2={8e+(b+c+f)−(d+g+h)}/8
A3={8e+(d+g+h)−(b+c+f)}/8
A4={8e+(f+h+i)−(a+b+d)}/8
16. The image processing circuit according to claim 11 , characterized in that said pixel value calculating unit sets the pixel values A1, A2, A3, A4 of four pixels generated additionally around said central pixel such that:
A1={Le+2b+2d−(c+f+g+h)}/L
A2={Le+2b+2f−(a+d+h+i)}/L
A3={Le+2d+2h−(a+b+f+i)}/L
A4={Le+2f+2h−(b+c+d+g)}/L
where the pixel values of said nine pixels including said central pixel are a, b, c, d, e, f, g, h, and i in the scan order, and L is an integer of 2 or greater.
17. The image processing circuit according to claim 16 , characterized in that by having the value of L to 10, said pixel values A1, A2, A3, A4 are set such that:
A1={10e+2b+2d−(c+f+g+h)}/10
A2={10e+2b+2f−(a+d+h+i)}/10
A3={10e+2d+2h−(a+b+f+i)}/10
A4={10e+2f+2h−(b+c+d+g)}/10
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/334,224 US20060114354A1 (en) | 1999-04-20 | 2006-01-16 | Image processing circuit |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP11-112903 | 1999-04-20 | ||
JP11112903A JP2000308021A (en) | 1999-04-20 | 1999-04-20 | Image processing circuit |
PCT/JP2000/002565 WO2000064158A1 (en) | 1999-04-20 | 2000-04-20 | Image processing circuit |
US09/913,173 US7034885B1 (en) | 1999-04-20 | 2000-04-20 | Image processing circuit |
US11/334,224 US20060114354A1 (en) | 1999-04-20 | 2006-01-16 | Image processing circuit |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/913,173 Division US7034885B1 (en) | 1999-04-20 | 2000-04-20 | Image processing circuit |
PCT/JP2000/002565 Division WO2000064158A1 (en) | 1999-04-20 | 2000-04-20 | Image processing circuit |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060114354A1 true US20060114354A1 (en) | 2006-06-01 |
Family
ID=14598394
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/913,173 Expired - Fee Related US7034885B1 (en) | 1999-04-20 | 2000-04-20 | Image processing circuit |
US11/334,224 Abandoned US20060114354A1 (en) | 1999-04-20 | 2006-01-16 | Image processing circuit |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/913,173 Expired - Fee Related US7034885B1 (en) | 1999-04-20 | 2000-04-20 | Image processing circuit |
Country Status (7)
Country | Link |
---|---|
US (2) | US7034885B1 (en) |
EP (2) | EP1890491A1 (en) |
JP (1) | JP2000308021A (en) |
KR (1) | KR100424951B1 (en) |
CN (1) | CN1227903C (en) |
HK (1) | HK1043271B (en) |
WO (1) | WO2000064158A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140226065A1 (en) * | 2013-02-14 | 2014-08-14 | Warner Bros. Entertainment Inc. | Video conversion technology |
US20140369604A1 (en) * | 2012-02-27 | 2014-12-18 | St-Ericsson Sa | Virtual Image Generation |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000308021A (en) * | 1999-04-20 | 2000-11-02 | Niigata Seimitsu Kk | Image processing circuit |
DE10200990A1 (en) * | 2002-01-14 | 2003-08-14 | Broadcasttelevision Systems Me | Method of storing video signals |
JP2004349737A (en) * | 2003-05-13 | 2004-12-09 | Neuro Solution Corp | Image processing apparatus |
US7319797B2 (en) * | 2004-06-28 | 2008-01-15 | Qualcomm Incorporated | Adaptive filters and apparatus, methods, and systems for image processing |
JP2006308971A (en) * | 2005-04-28 | 2006-11-09 | Toshiba Corp | Information processor and image processing circuit |
TWI343220B (en) * | 2005-05-19 | 2011-06-01 | Mstar Semiconductor Inc | Noise reduction method |
US7701509B2 (en) * | 2006-04-25 | 2010-04-20 | Nokia Corporation | Motion compensated video spatial up-conversion |
CN102187664B (en) | 2008-09-04 | 2014-08-20 | 独立行政法人科学技术振兴机构 | Video signal converting system |
JP4823290B2 (en) * | 2008-10-06 | 2011-11-24 | 独立行政法人科学技術振興機構 | Image editing device |
JP5353560B2 (en) * | 2009-08-25 | 2013-11-27 | 富士通株式会社 | Image processing circuit and image encoding apparatus |
JP6673333B2 (en) * | 2015-03-18 | 2020-03-25 | ソニー株式会社 | Image processing apparatus, image processing method, and imaging apparatus |
CN114902276A (en) * | 2019-10-30 | 2022-08-12 | 英托皮克斯公司 | Image processor |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5122873A (en) * | 1987-10-05 | 1992-06-16 | Intel Corporation | Method and apparatus for selectively encoding and decoding a digital motion video signal at multiple resolution levels |
US5274307A (en) * | 1991-08-15 | 1993-12-28 | Zenith Electronics Corporation | Single IC for CRT display control waveform generation |
US5754618A (en) * | 1995-12-22 | 1998-05-19 | Matsushita Electric Industrial | Image processing apparatus and image processing method for favorably enhancing continuous boundaries which are affected by noise |
US5875268A (en) * | 1993-09-27 | 1999-02-23 | Canon Kabushiki Kaisha | Image processing with low-resolution to high-resolution conversion |
US5946044A (en) * | 1995-06-30 | 1999-08-31 | Sony Corporation | Image signal converting method and image signal converting apparatus |
US5991463A (en) * | 1995-11-08 | 1999-11-23 | Genesis Microchip Inc. | Source data interpolation method and apparatus |
US6229570B1 (en) * | 1998-09-25 | 2001-05-08 | Lucent Technologies Inc. | Motion compensation image interpolation—frame rate conversion for HDTV |
US6262773B1 (en) * | 1997-09-15 | 2001-07-17 | Sharp Laboratories Of America, Inc. | System for conversion of interlaced video to progressive video using edge correlation |
US6266454B1 (en) * | 1996-07-17 | 2001-07-24 | Sony Corporation | Device and method for processing, image and device and method for encoding image |
US6266092B1 (en) * | 1998-05-12 | 2001-07-24 | Genesis Microchip Inc. | Method and apparatus for video line multiplication with enhanced sharpness |
US6292591B1 (en) * | 1996-07-17 | 2001-09-18 | Sony Coporation | Image coding and decoding using mapping coefficients corresponding to class information of pixel blocks |
US6295091B1 (en) * | 1997-11-07 | 2001-09-25 | Intel Corporation | Method and apparatus for de-interlacing video fields for superior edge preservation |
US6323905B1 (en) * | 1997-12-25 | 2001-11-27 | Sony Corporation | Picture conversion apparatus picture conversion method learning apparatus and learning method |
US6333762B1 (en) * | 1998-02-28 | 2001-12-25 | Samsung Electronics Co., Ltd. | Method for making look-up tables for video format converter using the look-up tables |
US6661838B2 (en) * | 1995-05-26 | 2003-12-09 | Canon Kabushiki Kaisha | Image processing apparatus for detecting changes of an image signal and image processing method therefor |
US6970508B1 (en) * | 1996-07-17 | 2005-11-29 | Sony Corporation | Image coding and decoding using mapping coefficients corresponding to class information of pixel blocks |
US7034885B1 (en) * | 1999-04-20 | 2006-04-25 | Niigata Seimitsu Co., Ltd. | Image processing circuit |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2577748B2 (en) * | 1986-12-01 | 1997-02-05 | サカタインクス株式会社 | Image signal interpolation method and image signal processing apparatus for implementing the method |
FI98590C (en) * | 1994-09-20 | 1997-07-10 | Nokia Technology Gmbh | Method for interpolating video image |
JPH08223407A (en) * | 1995-02-14 | 1996-08-30 | Canon Inc | Image processing unit |
JP3669530B2 (en) * | 1995-06-30 | 2005-07-06 | ソニー株式会社 | Image signal conversion apparatus and image signal conversion method |
-
1999
- 1999-04-20 JP JP11112903A patent/JP2000308021A/en not_active Ceased
-
2000
- 2000-04-20 US US09/913,173 patent/US7034885B1/en not_active Expired - Fee Related
- 2000-04-20 KR KR10-2001-7008418A patent/KR100424951B1/en not_active IP Right Cessation
- 2000-04-20 WO PCT/JP2000/002565 patent/WO2000064158A1/en active IP Right Grant
- 2000-04-20 EP EP07122679A patent/EP1890491A1/en not_active Withdrawn
- 2000-04-20 EP EP00919139A patent/EP1176823A4/en not_active Withdrawn
- 2000-04-20 CN CNB008028168A patent/CN1227903C/en not_active Expired - Fee Related
-
2002
- 2002-06-19 HK HK02104567.3A patent/HK1043271B/en not_active IP Right Cessation
-
2006
- 2006-01-16 US US11/334,224 patent/US20060114354A1/en not_active Abandoned
Patent Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5122873A (en) * | 1987-10-05 | 1992-06-16 | Intel Corporation | Method and apparatus for selectively encoding and decoding a digital motion video signal at multiple resolution levels |
US5274307A (en) * | 1991-08-15 | 1993-12-28 | Zenith Electronics Corporation | Single IC for CRT display control waveform generation |
US5875268A (en) * | 1993-09-27 | 1999-02-23 | Canon Kabushiki Kaisha | Image processing with low-resolution to high-resolution conversion |
US6661838B2 (en) * | 1995-05-26 | 2003-12-09 | Canon Kabushiki Kaisha | Image processing apparatus for detecting changes of an image signal and image processing method therefor |
US5946044A (en) * | 1995-06-30 | 1999-08-31 | Sony Corporation | Image signal converting method and image signal converting apparatus |
US5991463A (en) * | 1995-11-08 | 1999-11-23 | Genesis Microchip Inc. | Source data interpolation method and apparatus |
US5754618A (en) * | 1995-12-22 | 1998-05-19 | Matsushita Electric Industrial | Image processing apparatus and image processing method for favorably enhancing continuous boundaries which are affected by noise |
US6266454B1 (en) * | 1996-07-17 | 2001-07-24 | Sony Corporation | Device and method for processing, image and device and method for encoding image |
US6292591B1 (en) * | 1996-07-17 | 2001-09-18 | Sony Coporation | Image coding and decoding using mapping coefficients corresponding to class information of pixel blocks |
US6970508B1 (en) * | 1996-07-17 | 2005-11-29 | Sony Corporation | Image coding and decoding using mapping coefficients corresponding to class information of pixel blocks |
US6262773B1 (en) * | 1997-09-15 | 2001-07-17 | Sharp Laboratories Of America, Inc. | System for conversion of interlaced video to progressive video using edge correlation |
US6295091B1 (en) * | 1997-11-07 | 2001-09-25 | Intel Corporation | Method and apparatus for de-interlacing video fields for superior edge preservation |
US6323905B1 (en) * | 1997-12-25 | 2001-11-27 | Sony Corporation | Picture conversion apparatus picture conversion method learning apparatus and learning method |
US6333762B1 (en) * | 1998-02-28 | 2001-12-25 | Samsung Electronics Co., Ltd. | Method for making look-up tables for video format converter using the look-up tables |
US6266092B1 (en) * | 1998-05-12 | 2001-07-24 | Genesis Microchip Inc. | Method and apparatus for video line multiplication with enhanced sharpness |
US6229570B1 (en) * | 1998-09-25 | 2001-05-08 | Lucent Technologies Inc. | Motion compensation image interpolation—frame rate conversion for HDTV |
US7034885B1 (en) * | 1999-04-20 | 2006-04-25 | Niigata Seimitsu Co., Ltd. | Image processing circuit |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140369604A1 (en) * | 2012-02-27 | 2014-12-18 | St-Ericsson Sa | Virtual Image Generation |
US9202132B2 (en) * | 2012-02-27 | 2015-12-01 | St-Ericsson Sa | Virtual image generation |
US20140226065A1 (en) * | 2013-02-14 | 2014-08-14 | Warner Bros. Entertainment Inc. | Video conversion technology |
US9241128B2 (en) * | 2013-02-14 | 2016-01-19 | Warner Bros. Entertainment Inc. | Video conversion technology |
US20160100128A1 (en) * | 2013-02-14 | 2016-04-07 | Warner Bros. Entertainment Inc. | Video conversion technology |
US9723257B2 (en) * | 2013-02-14 | 2017-08-01 | Warner Bros. Entertainment Inc. | Video conversion technology |
US10277862B2 (en) | 2013-02-14 | 2019-04-30 | Warner Bros. Entertainment Inc. | Video conversion technology |
US10687017B2 (en) | 2013-02-14 | 2020-06-16 | Warner Bros. Entertainment Inc. | Video conversion technology |
US11997417B2 (en) | 2013-02-14 | 2024-05-28 | Warner Bros. Entertainment Inc. | Video conversion technology |
Also Published As
Publication number | Publication date |
---|---|
US7034885B1 (en) | 2006-04-25 |
HK1043271A1 (en) | 2002-09-06 |
HK1043271B (en) | 2006-08-04 |
CN1337122A (en) | 2002-02-20 |
WO2000064158A1 (en) | 2000-10-26 |
EP1890491A1 (en) | 2008-02-20 |
JP2000308021A (en) | 2000-11-02 |
EP1176823A4 (en) | 2007-04-04 |
KR100424951B1 (en) | 2004-03-31 |
EP1176823A1 (en) | 2002-01-30 |
CN1227903C (en) | 2005-11-16 |
KR20010093239A (en) | 2001-10-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060114354A1 (en) | Image processing circuit | |
US6452592B2 (en) | Clock generation for sampling analog video | |
US6784942B2 (en) | Motion adaptive de-interlacing method and apparatus | |
US5986635A (en) | Processor for converting pixel number of video signal and display apparatus using the same | |
TWI504246B (en) | Ringing suppression in video scalers | |
US6961479B1 (en) | Image processing device, image processing method, image-processing program recorded medium | |
US20030133038A1 (en) | Image processing apparatus, method and providing medium | |
US7421150B2 (en) | Coordinate conversion apparatus and method | |
KR930012093B1 (en) | Progressive scanning video display device | |
US4598314A (en) | Method and apparatus for converting a video signal to a corresponding signal of lower line count | |
US20030007091A1 (en) | Scan line conversion circuit | |
US7782343B2 (en) | Scaling device of image process | |
US5896178A (en) | Method and system for converting VGA signals to television signals including horizontally averaging and thinning scanning lines before vertically averaging the scanning lines | |
KR20000051198A (en) | Apparatus for universal image format converting | |
US7339626B2 (en) | Deinterlacing video images with slope detection | |
KR100922244B1 (en) | Signal processing device, and image output device | |
US9324131B1 (en) | Method and apparatus for motion adaptive deinterlacing with reduced artifacts | |
KR19990044779A (en) | Digital deflection processing apparatus for cathode ray tube and its deflection processing method | |
US20080002065A1 (en) | Image processing circuit, image processing system and method therefor | |
US6989870B2 (en) | Video signal processing apparatus and method capable of converting an interlace video signal into a non-interlace video signal | |
US6385250B1 (en) | Image processing apparatus and image processing method | |
JP2944284B2 (en) | Multi-screen display device | |
KR100743520B1 (en) | Video Scaler and method for scaling video signal | |
JP2002218415A (en) | Video signal processor and video display device | |
JP2000115720A (en) | Scanning line interpolation device and scanning line interpolation method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |