CA1164086A - Image processing integrated circuit - Google Patents

Image processing integrated circuit

Info

Publication number
CA1164086A
CA1164086A CA000348925A CA348925A CA1164086A CA 1164086 A CA1164086 A CA 1164086A CA 000348925 A CA000348925 A CA 000348925A CA 348925 A CA348925 A CA 348925A CA 1164086 A CA1164086 A CA 1164086A
Authority
CA
Canada
Prior art keywords
black
white
image
output
integrated circuit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired
Application number
CA000348925A
Other languages
French (fr)
Inventor
M. Duane Sanner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Recognition Equipment Inc
Original Assignee
Recognition Equipment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Recognition Equipment Inc filed Critical Recognition Equipment Inc
Application granted granted Critical
Publication of CA1164086A publication Critical patent/CA1164086A/en
Expired legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/28Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/30Noise filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/36Applying a local operator, i.e. means to operate on image points situated in the vicinity of a given point; Non-linear local filtering operations, e.g. median filtering

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Nonlinear Science (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Image Processing (AREA)
  • Picture Signal Circuits (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Image Input (AREA)
  • Character Input (AREA)

Abstract

Abstract:
An array of integrated photosensitive devices is used to lift an image of a printed character or symbol from a document or other surface, process the image to allow for background conditions of the document and referencing it against a desired threshold to produce a black/white video output, in serial form, representative of the image sensed by the array. Charge transfer devices are used extensively throughout on a single integrated circuit to provide a complete image processing video device on a single integrated circuit chip.

Description

~;4n`~6 IMAGE PROCESSING INTEGRATED CIRCUIT

FIELD OF THE INVENTION
This invention relates to image processing devices and more particularly to an integrated circuit device which processes images and produces quantized black and white output video signals representative of the image scanned by the array.
BACKGROUND OF THE INVENTION
Present techniques for obtaining quantized video signals require multiple processing functions, each implemented by a combination of discrete and integrated circuits. The ability to extract a quantized video signal from degraded printing varies greatly between data lift systems, but is generally a function of the sophistication of the system.
SUMMARY OF THE INVENTION
-The invention provides an effective and economical way to transform an optical image of a printed character or other symbols to an electrical signal which is quantized to represent black and white levels. This type of quantized signal is required by almost all optical character recog-nition systems utilized in optical character recognition equipment. The device described may be utilized, for example, in a hand-held OCR reader to supply signals representing the character to the recognition logic. The system consists of a pulsed infrared emitting diode illumin-ation source and an integrated circuit which includes both an image sensor and an analog signal processing section.
The optical image projected onto the sensor is transformed into a stream of digital video data representing black or white levels.
In accordance with an aspect of the invention there is q~6 provided an image processing system including an image sensor for producing image data in the form of black and white pixels, a video processor, and a decision circuit for pr.oducing black or white decisions for each pixel, character-ized in that the video processor has parallel processing channels, one channel performing edge enhancement of the iMage data and the other channel being a contrast ratio detector which determines if a pixel is dark enough to exceed a minimum acceptable level, and a circuit for combining the outputs of said parallel channels prior to making the black or white decision.
DESCRIPTION OF THE DRAWINGS
The features of the invention and the technical advance represented thereby will be more fully understood when considered in conjunction with the following specification, claims and drawings in which:
Figure 1 is a block diagram of a prior art circuit;
Figure 2 is a block diagram of the present invention;
Figure 3 illustrates the sensor array;
Figure 4 is a schematic diagram of the sensor array;
Figure 5 is a schematic diagram of the 96 stage CCD
array spatial filter illustrated in Figures 2 and 3;
Figure 6 is a schematic diagram of the 115 stage CCD
array used for the white reference detector illustrated in Figure 2;
Figure 7 illustrates the 7 x 7 background detector matrix;
Figure 8 illustrates the sample point configuration within the 7 x 7 matrix of Figure 7;
3~ Figure 9 is a schematic diagram of the black reference circuit;

Figure 10 illustrates the spot filter image matrix shown in Figure 2; and Figure 11 is a timing diagram of the black/white video si,gnal.
Figure 12 is a flow diagram of the major timing sequence.
Figure 13 is a block diagram of the relation ratio for internal and external clocks.
DESCRIPTION OF THE PREFERRED EMBODIMENT
A fairly complex system which has good thresholding characteristics with degraded printing is shown in block form in Figure 1. The serial video signal from the single output port of an array of photosensitive elements 50 is first amplified by a preamp 52 in order to transmit it through an integrator 54. The signal is sampled 56 at the end of the integration, and then converted to a 4 bit digital signal by the analog/digital converter 58. The AGC
function 60 serves to normalize the A/D output, always producing 16 gray levels for a range of video input levels.
The purpose of the converter 58 is to drive the correlator function 62. The correlator 62 is a digital filter that quantizes a 4 bit input signal to a black or white level based upon the sum of the cells surrounding a cell.
Approximately 20 MSI and SSI logic packages are required to implement the control function 64 and timing signals 66, 68, 70 that tie all;the functions together.
The present invention has equal or greater thresholding characteristics and can be implemented in a single integrated circuit. This integrated circuit with several external components, replaces all the functional blocks shown in Figure 1.

Image processing systems similar to Figure 1 are described in U.S. Patents 3,947,817, 3,964rO22 and 4,075,605.
The system is a data lift system that consists of a pulsed infrared emitting diode illumination source (not illustrated) and an integrated circuit comprising both an image sensor and an analog signal processing section. A
block diagram of the system is illustrated in Figure 2. An optical image projected onto the sensor array 80 is trans-formed into a stream of digital video data representing black or white levels. The sensor array 80 may be, for example, area sensor 18 cells wide and 70 cells tall ~Figure 3)~ The sensor 80 may be, for example, a CCD device consisting of 18 shift registers each 70 bits in length.
Fach stage serves both as a sensor and a storage/read out device. In operation, an image is strobed on the sensor 80 using a pulsed infrared emitting diode as an illumination source. As soon as the diode is off, the 18 registers are shifted one bit, loading the serial read out register 82.
The read out register 82 is clocked 18 pulses to produce a serial bit stream output. A second shift pulse to the 18 vertical shift registers is then produced and the cycle is repeated a total of 70 times until all the data has been read out. This type of read out can only be utilized because the sensor is not illuminated during the read out sequence. The illumination time will comprise about 10% of the total frame time. This design has the advantage of requiring a much simpler CCD structure whose total cell area is light sensitive and thus twice as sensitive as a sensor structure that utilizes alternate sensor and storage sites.
As shown in Figure 2, the sensor is interconnected with a signal processing station. The video from the sensor array is processed by two separate functions that produce outputs 11f~4~
thlat are synchronized together to always relate to the same cell of video data. These two functions are the 96 stage CC,D spatial filter 84 and the 115 stage CCD background reference circuit. The video signal is fed into the two parallel CCD registers 84 and 86 which perform the two processing functions simultaneously.
Looking at Figure 4, there is illustrated one possible embodiment of the CCD sensor array 80. The photosites 90 are stages of vertical registers 92 which are read out by vertically clocking all registers 92 to parallel load the output register 94. The output register 94 ~as illustrated) shifts to the left, shifting the video out at the cell rate through a preamplifier 96 and then to the parallel registers 84 and 86 IFigure 2).
The spatial filter 84 is a linear filter designed to amplify portions of the image that correspond to character strokes characteristics or black parts of the image. The filter 84 is designed to have an output that goes negative for dark areas of video image and positive for white areas.
One possible embodiment of the 95 stage CCD shift register and filter ~4 is illustrated in Figure S. The video is fed into one end 84a of the shift register 84 in serial form.
The output from the differential amplifier 100 constitutes the filter output. This output is sampled at the end of the overscan time and stored on a capacitor 102 to be utilized during the next frame as a black reference level. During this sample time the filter register 84 contains only non-exposed of black level cells.
Connected to the llS stage CCD register is a background referen~e circuit 120 (Fig. 2) or reference detector which is a nonlinear function which produces outputs that represent the background or white level within a 7 x 7 ~,~....

4~6 element area. This area is generally illustrated in Figure 7 an~ indicated as a 7 x 7 background detector matrix. A
description of this function is described later.
Each filter function output in conjunction with a black reEerence level drives a comparator circuit to produce white or black digital levels. The comparator number 1, 122 is driven by a fraction of the background reference output and the signal from the "center cell" (indicated in Figure 7 as cell 58) which is the video information that is to be quantized. The resistors Rl, 124 and R2, 126 determine the percentage of background to be supplied to the comparator 122 which would be typically about 0.85. Comparator number 1, 122 output will be true, indicating white, if the center cell value i8 greater than 0.85 of the reference. This corresponds to a print contrast ratio of approximately 15%;
therefore, this function serves as a minimum print contrast ratio detector to prevent paper noise and blind inks from causing a black output.
Comparator 2, 128 is for the purpose of determining whether the spatial filter 84 output is positive or negative and providing a logic level signal. When the spatial filter 84 output is positive, the comparator 128 output is true indicating a white level. The output of the comparator 128 will greatly emphasize image contrast differences making low contrast white and black areas o~ a character white or black logic level outputs.
~he two comparators 122 and 128 are combined by an OR
circuit 130 to produce a quantized black/white output. The signals are OR'ED on a white basis so that either comparator 122 or 128 can force a white output. Comparator 1, 122 will force a white output for an absolutely low contrast signal and comparator 2, 128 will open up the white areas in an 8, A" or other alphanumeric characters having an enclosed or partially enclosed area. The output of the OR circuit 130 iS further processed by a spot filter 132 to remove isolated white or black cells from the output. In addition to the black/white data output, timing signals for external logic synchronization are provided by the control logic 134 as shown in Figure 2. These are Data Clock Out, Row/Frame Sync, and Strobe Out. The Row/Frame Sync is used in sampling the serial video stream and for vertical locationO
Strobe Out triggers the infrared emitting diodes which illuminate the surface to be scanned or read. A Background Signal Level Output, and the black reference are also available to be used as an indication of the signal to noise ratlo 80 that the video can be ignored at low light levels.
Description of major timing se~uence is illustrated in the flow diagram of Figure 12. A vertical clock 150 is generated for each 18 data or fixed rate pulses and is free running. These clocks are counted by a vertical clock counter 152. If the count is equal to or less than 73 a test 154, 156 is made to determine if the count is 73. For a count less than 73 a vertical clock 158 is gated to the sensor array 160 causing the cell or fixed data to advance by a row toward the read-out register 162. If the count is 73 a black reference sample pulse 164 is generated in addition to vertically clocking the sensor. The output register is then parallel loaded with the video data and then read out, requiring 18 data clocks.
The above sequence is repeated until the vertical clock count reaches 74. At this count, clocking of the sensor stops and the IRED illuminator 168 is turned on. The ~ 4~

illuminator 168 stays on until the count reaches 82, 170, 172. The vertical clock counter is then reset 174 which allows the complete cycle to be repeated.
The relative rates for internal and external clocks are illustrated in Figure 13.
The spatial filter 84 function provides character stroke emphasis and serves as an aperture correction which corrects for optical spreading in the array and for any uniform component of lens roll-off.
~he spatial filter associated with the 96 cell CCD
register forms a two dimensional discrete circular convolution of a two dimensional spatial impulse response with the sensor's image data. In terms of a two dimensional array, it can be considered as a 5 x S matrix superimposed on the pattern of array cells. This is illustrated in F~gure 7 wherein the 5 x 5 spatial filter matrix is shown in conjunction with a 7 x 7 background detector matrix. It should be noted that the cell 58 is the center of the matrix. The reference detector 200 or background detector shown in Figure 6 wherein the output is the white background level output performs a limited area spatial peak detection of the sensor image data. It covers the 7 x 7 matrix area illustrated in Figure 7 but only uses a checkboard pattern of samples for a total of 24 points as illustrated in Figure 8. Its implementation is on the second CCD register 8~ of 115 stases with the center of the 7 x 7 matrix at cell delay 58. Each sample point 202 is a unit weight diode-like function which causes the detector output to represent the highest (whitest) of the 24 cells being sampled. The match between individual detector samples are usually within +5 for array signal levels above 20% of saturation.

~ ~4`~ 6 The black reference circuit 250 (Figure 9) produce an o~tput level which is equivalent to a zero light level condition on the sensor array. The error in the black reference level as compared to the actual array black should generally be equal to less than 1% of the illuminated array output for illumination levels greater than 20% of saturation.
The spot filter 132 further processes the data to eliminate lone white or black data bits from the output. It operates on the threshold matrix by the following function:
A(i,j) = T(i-l,j) + T(i+l,j) + T(i,j-l) + T(i,j+l) ~1 if A(i,j) = 4 S(i,j) = ~ T(i,j) if 0 ~ A(i,j) ~ 4 ~0 if A(i,j) = 0 where S(i,j) is the two dimensional spot filtered image matrix, the top left element of the matrix is S(o,o).
A(i,j) is the sum of the binary values (0-1) of the 4 onaxis, adjacent cells to the cell to be spot filtered in the threshold matrix (see Figure 10).
If the four surrounding cells for a particular cell are all the same, the spot filter forces the center cell to the same value of the surrounding cells. Otherwise, the filter does nothing to the center cell. Figure 9 represents the function of four adjacent cells and a center cell. The spot filter is a tapped CCD register feeding the appropriate logic elements. In addition to the delay resulting from this function, more delay is incorporated here to synchronize the video with the Row/Frame Sync signal generated for the system.
Having described a preferred embodiment of the image Processing Integrated Circuit, other embodiments and arrangements will become apparent to those skilled in the art which will fall within the scope of the appended claim.

Claims

The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:
1. An image processing system including an image sensor for producing image data in the form of black and white pixels, a video processor, and a decision circuit for producing black or white decisions for each pixel, character-ized in that the video processor has parallel processing channels, one channel performing edge enhancement of the image data and the other channel being a contrast ratio detector which determines if a pixel is dark enough to exceed a minimum acceptable level, and a circuit for combining the outputs of said parallel channels prior to making the black or white decision.
CA000348925A 1979-04-23 1980-04-01 Image processing integrated circuit Expired CA1164086A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US3203479A 1979-04-23 1979-04-23
US032,034 1979-04-23

Publications (1)

Publication Number Publication Date
CA1164086A true CA1164086A (en) 1984-03-20

Family

ID=21862751

Family Applications (1)

Application Number Title Priority Date Filing Date
CA000348925A Expired CA1164086A (en) 1979-04-23 1980-04-01 Image processing integrated circuit

Country Status (5)

Country Link
JP (1) JPS55149571A (en)
CA (1) CA1164086A (en)
DE (1) DE3015637C2 (en)
FR (1) FR2455322B1 (en)
GB (1) GB2047934B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4463381A (en) * 1980-04-16 1984-07-31 Eastman Kodak Company Image processing apparatus including a partitioned low pass channel
US4446484A (en) * 1981-04-16 1984-05-01 Eastman Kodak Company Image gradient detectors operating in a partitioned low-pass channel
US4517607A (en) * 1981-11-09 1985-05-14 Ricoh Company, Ltd. Method of and apparatus for compensating image in image reproduction system
EP0083213A3 (en) * 1981-12-28 1984-08-08 General Electric Company Digital background normalizer using two dimensional integration techniques
KR0181129B1 (en) * 1995-06-17 1999-05-01 김광호 Image processing apparatus

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3394346A (en) * 1964-04-28 1968-07-23 Rca Corp Filter circuit
JPS48102926A (en) * 1972-04-07 1973-12-24
US3976973A (en) * 1974-01-07 1976-08-24 Recognition Equipment Incorporated Horizontal scan vertical simulation character reading
US3903543A (en) * 1974-01-16 1975-09-02 Bell Telephone Labor Inc Charge transfer device decoder and compander
US4075605A (en) * 1974-09-13 1978-02-21 Recognition Equipment Incorporated Character recognition unit
US3990044A (en) * 1975-07-07 1976-11-02 The Singer Company Symbol recognition enhancing apparatus
NL7608862A (en) * 1976-08-10 1978-02-14 Philips Nv SCHEME FOR TRANSMISSION OF CODED MESSAGES WITH A REDUCED TRANSMISSION TIME.
JPS5533348A (en) * 1978-08-31 1980-03-08 Fuji Xerox Co Ltd Noise elimination system

Also Published As

Publication number Publication date
GB2047934B (en) 1983-03-16
FR2455322B1 (en) 1987-07-17
GB2047934A (en) 1980-12-03
FR2455322A1 (en) 1980-11-21
DE3015637A1 (en) 1980-10-30
JPS55149571A (en) 1980-11-20
DE3015637C2 (en) 1985-10-31

Similar Documents

Publication Publication Date Title
US4817175A (en) Video stream processing system
US8482660B2 (en) Method and apparatus for detecting camera sensor intensity saturation
US5133022A (en) Normalizing correlator for video processing
US7378639B2 (en) Photoelectric conversion device and image sensor having a reset potential of a common signal line being common to the potential of a reference voltage terminal
US7566857B2 (en) Image sensor, multi-chip module type image sensor and contact image sensor
US4491964A (en) Image processing integrated circuit
EP0578875A1 (en) Normalizing correlator for video processing
EP0762741A3 (en) Solid state image pick-up device having a high precision defective pixel detecting circuit with low power consumption
US6192166B1 (en) Binarization circuit
US4578711A (en) Video data signal digitization and correction system
EP0491941A1 (en) Automatic detection and selection of a drop-out color using zone calibration in conjunction with optical character recognition of preprinted forms
CA1164086A (en) Image processing integrated circuit
EP0810773A3 (en) A method and system for hybrid error diffusion image processing
CA2105019C (en) Method and apparatus for elimination of color from multi-color image documents
US4856076A (en) Binary coding circuit for OCR
US20020002410A1 (en) Information acquisition method and apparatus
US6304826B1 (en) Self-calibration method and circuit architecture of image sensor
JPS60157372A (en) Frame detecting device of picture processing system
US5034825A (en) High quality image scanner
EP0195925B1 (en) Method for converting image gray levels
US7087881B2 (en) Solid state image pickup device including an integrator with a variable reference potential
US4881188A (en) Binary coding circuit
US20020134915A1 (en) Multi-resolution charge-coupled device (CCD) sensing apparatus
US6608706B1 (en) Scanning method for performing a low resolution scan by using a high resolution scanning module
US7385734B2 (en) Method and apparatuses for changing driving sequence to output charge couple device signal

Legal Events

Date Code Title Description
MKEX Expiry