WO2013085936A1

WO2013085936A1 - Sound-based damage detection

Info

Publication number: WO2013085936A1
Application number: PCT/US2012/067819
Authority: WO
Inventors: Daniel P. Phinney; Randall Roy MAYSICK; Thomas Gregory MIDDLETON; Swapnil Sakharshete; David M. Schaertel; Anthony A. Syracuse
Original assignee: Eastman Kodak Company
Priority date: 2011-12-06
Filing date: 2012-12-05
Publication date: 2013-06-13
Also published as: TW201332874A; US20130140757A1

Abstract

A document handling apparatus having a document transport path for moving a document therethrough. A single detector proximate the transport detects a misfeed indication in the transport path. A processing system processes the indication and issues a termination signal if a misfeed is determined.

Description

SOUND-BASED DAMAGE DETECTION

FIELD OF THE INVENTION

The present invention is directed to devices and methods of detecting misfeeds in a document handling apparatus. In particular, to devices and methods utilizing only one detector and sonic processing to detect document jams.

BACKGROUND OF THE INVENTION

Document scanners feed and transport paper documents past one or more imaging subsystems in order to create digital image files representative of the originals. Systems have been described that detect excessive or unique sound energy using audio frequency microphones, the energy created by the document being transported when the document or documents are being damaged, wrinkled, torn or otherwise deformed by the feeding and transport process (referred to herein as a "misfeed"). These sounds are differentiated from the normal sounds of the mechanisms via processing of the audio frequency sounds. The sounds are quantified, compared to a threshold (which may be adjustable), and then used to immediately stop the feeding and/or transport mechanism in order to prevent or substantially limit damage to the documents.

Incorporating multiple devices for receiving audio information (typically in the range of 1 KHz. to 10 KHz.) represents both a cost penalty and a packaging challenge given the position of drive rollers and other sensors within the document transport design.

SUMMARY OF THE INVENTION

This invention implements sound-based damage detection based on only one receiving device (in a preferred embodiment, an electret microphone), saving cost and enabling physical placement in paper transport systems where space may be at a premium.

The electret microphone operates over a wide frequency range and is capable of detecting the sound patterns associated with document damage. After buffering the signal with an amplifier, the sound energy is filtered for damage detection. It is important to filter out irrelevant frequencies before it is passed to the damage detection subsystem due to frequency aliasing by the analog-to-digital sampling process. This aliasing results in beat frequencies that can fall into the range of frequencies considered by the damage detection algorithm. After conversion to digital samples, the sound is further filtered to distinguish between sounds associated with a misfeed and the normal sounds of document transport.

Additionally, it has been found that mounting the sound detection device (microphone) in a compliant mount or rubber isolator helps to reduce the conduction of unwanted sounds, noise, and vibrations into the microphone from the scanner mechanisms. The electrical output amplitude of the sound detecting device may require additional amplification of the microphone output.

A preferred embodiment of the present invention comprises a sheet handling apparatus having a transport path, a device adapted to separate a first sheet from a plurality of stacked sheets and to feed the first sheet into the transport path, only one detector positioned near the transport path to detect a misfeed condition indicating that the first sheet is being damaged in the transport path, and a processing system coupled to the detector adapted to receive and process signals from the detector and configured to determine the misfeed in the transport path, and to terminate feeding sheets in response to the determination. The detector comprises a microphone mounted into the apparatus using a compliant noise isolating material. An energy level of the digital audio data is calculated to determine the misfeed.

Another preferred embodiment of the present invention comprises an article processing apparatus having a transport path for the plurality of articles, a feeder device for feeding individual ones of the articles into the transport path, only one audio detector positioned in the transport path to detect a misfeed condition in the transport path, and a processing system coupled to the detector to process signals from the detector and configured to terminate processing in response to the signals from the detector. An energy level of the signals from the detector is calculated to determine if the signals exceed an energy threshold, thereby indicating the misfeed condition. A converter coupled to the detector converts the signals into digital data frames wherein the processing system counts a number of the data frames that indicate the misfeed condition. A termination signal is issued if the number of data frames that exceed the energy threshold exceeds a preselected number.

Another preferred embodiment of the present invention comprises a method for feeding sheets by urging a sheet through a sheet transport path, providing only one audio receiver proximate the transport path, processing audio data detected by the audio receiver and terminating feeding sheets in response to determining a misfeed in the audio data, which includes calculating an energy level of the audio data. The audio receiver is mounted proximate the transport path using a noise isolating compliant material.

Another preferred embodiment of the present invention comprises a method of determining a misfeed in an article processing apparatus by placing only one microphone in the article processing apparatus, feeding an article into the article processing apparatus, generating and collecting digital data frames of sound from the analog sound detected by the microphone, processing the collected data frames to determine the misfeed, including reducing a probability of a false misfeed determination by accumulating a number of data frames collected, and reducing a sensitivity setting if the number of data frames collected exceeds a threshold amount. The number of data frames collected represents a distance that the document has traveled. An energy level of the data frames is calculated and compared to a jam threshold for each data frame. The jam threshold is determined according to the sensitivity setting. A jam count window is opened upon determining that the energy level of a current data frame exceeds its threshold. The jam count window accumulates a jam count, which counts the number of data frames that exceed their threshold. If the jam count reaches a preselected jam count limit while the jam count window is open then a jam signal is issued. The jam count window is closed if the total number of frames that have been processed exceeds a jam count window size and the jam count is reset to zero. Another preferred embodiment of the present invention comprises a method of processing articles by holding a plurality of the articles to be processed in an input tray, feeding a first one of the articles into an article processing apparatus using a device configured to separate the first one of the articles from the plurality of the articles, collecting sound data using only one microphone, processing the sound data and determining if the sound data indicates a misfeed, and, if so, terminating processing the articles.

It should be noted that in the present patent application preferred embodiments are described in terms of a scanner only for representative preferred embodiments. The present invention is not so limited, and the use of the term "scanner" is hereby intended to refer to any document or paper conveyance machine. These, and other, aspects and objects of the present invention will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following description, while indicating preferred embodiments of the present invention and numerous specific details thereof, is given by way of illustration and not of limitation. For example, the summary descriptions above are not meant to describe individual separate embodiments whose elements are not interchangeable. In fact, many of the elements described as related to a particular embodiment can be used together with, and possibly interchanged with, elements of other described embodiments. Many changes and modifications may be made within the scope of the present invention without departing from the spirit thereof, and the invention includes all such modifications. The figures below are intended to be drawn neither to any precise scale with respect to relative size, angular relationship, or relative position nor to any combinational relationship with respect to interchangeability, substitution, or representation of an actual implementation.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates a document feed and transport path. FIGs. 2A-C illustrate frequency domain band pass filtering. FIG 3 illustrates a sonic processing circuit.

FIG 4 illustrates a pertinent frequency domain for detecting document damage.

FIG 5 illustrates a flowchart of an algorithm for implementing the present invention.

FIG 6 illustrates a timing diagram for processing document misfeeds.

FIG 7 represents the first frame where the energy level exceeds the

Energy Threshold.

DETAILED DESCRIPTION OF THE INVENTION

With reference to Fig. 1, document 103 is moved forward by urging roller 101 into the feed and separation nip created by contact of rollers 105. Not shown is a standard input tray holding a stack of documents wherein the urging roller is configured to separate the first one of the documents from the stack. One document at a time is sequentially pushed further into the transport rollers 107 by selective rotation of the feed mechanism rollers 105. Ultimately the document is transported to an imaging station or stations to be converted into a digital image. Sound energy created by the physical transport of the document through the transport is also converted to an electrical signal by receiver 111. This sound energy may be characteristic of normal, undamaged transport of the document including that of the scanner itself, or may contain sounds characteristic of a document undergoing damage as a result of the feed and/or transport process. The electrical signal from microphone 111 is representative of the sounds associated with document transport. This signal is conveyed to amplifiers and signal conditioning block 115 which is described later.

With reference to FIGs. 2A-C, the electrical signal from microphone 211 is representative of all sounds received, including the lower frequency sounds associated with document transport including, potentially, those associated with document damage. This composite signal is conveyed to amplifiers and signal conditioning block 215 and is illustrated in the frequency domain in Figure 2A. The signal conditioning electronics separates the relatively low frequency signals associated with document transport, including the sounds of potential damage, using the bandpass filter in Figure 2B that allows frequencies between the lower limit of Fl and the upper limit of F2 in the range of approximately 100 Hz to 10 KHz, respectively, to pass through while greatly attenuating the higher frequency sounds. The output of this filter is shown in Figure 2C. The output of the bandpass filter illustrated by Figures 2B and 2C is passed to an analog-to-digital converter, which receives analog audio data and converts these to digital data frames as described below.

With reference to FIG. 3, the output of microphone 311 is amplified and filtered in the frequency domain. The output of amplifier and filter block 305 contains signals primarily associated with document transport, including those associated with possible damage as it is transported. These signals are converted to a digital representation by analog-to-digital converter 309 and then to the document damage processor 313 which makes a determination if the sound signals represent those of a document being damaged or not. Processor 313 receives signal 315 from the scanner controller when the feed mechanism is engaged. This prepares the damage detection processor 313 and initiates the detection algorithm which will be described later. If sounds associated with document damage are detected with sufficient energy and within timing windows as described below, then an output 317 from processor 313 is sent to the scanner controller which in turn quickly stops the transport and feed mechanisms to limit the damage to the document in question.

Damage Detection Algorithm

The damage detection processor determines when document damage due to misfeeding, wrinkles, staples, adhesion or other factors is occurring and stops the document transport motors and feed mechanisms in a very brief time interval to prevent further damage to the documents. The document damage detection algorithm uses the idea of differentiating between the sound made by a normal document entering a document scanner and the sound of a document being wrinkled due to a jam. For a system to make this distinction, it is important to ignore or in some way isolate the background sounds of the scanner from the sounds coming from the document. The background sounds come from various moving parts of the scanner. The moving parts include, but are not limited to, the transport motors, transport rollers, feeder mechanism and possible cooling fans. These scanner background sounds are typically periodic and have low frequency components relative to that of documents being damaged.

On the other hand, the sounds from a wrinkling or damaging document are a short duration signal in the time domain and have frequency components spread over a wide range in the frequency domain. In addition, the sound of a clean document being scanned typically has frequencies that overlap the frequencies that of a wrinkling document. Therefore, the algorithm can detect a jamming document by computing the energy of the audio signal by looking at a frequency band between F5 and F6 as shown in Figure 4, where F5 is the upper frequency limit of the background noise/clean document in the range of approximately 1 KHz. and where F6 is the upper frequency of a jamming document in the range of approximately 4 KHz. The cut-off frequency F5 is selected such that all the background sounds from different moving parts of the scanner and the sound associated with a clean document are substantially or detectably below this cut-off as shown below. This cut-off frequency selection can be based on test data collected and recorded from the scanners during normal operation.

With reference to FIG. 5, when the feeder mechanism is enabled 501, a document starts to enter the transport of the scanner. The damage detection processor uses a communicated feed enable signal generated at this point to determine when to start sampling the microphone. The algorithm for jam detection uses a frame -based processing technique. The system collects the digitized microphone data and processes the data in fixed data sets or frames that consist of N samples per frame 502, for example, typically approximately 50 samples. The algorithm receives multiple frames of microphone data and then will determine if the data is indicative of a document jam as will be described below. These frames of data are non-overlapping and each frame consists of approximately a one millisecond duration of audio data.

As the trail-edge of the document enters the document transport and passes over the point of feeding at the contact nip between rollers 105, the trail edge of the document may make a snapping sound that creates a sharp impulse in the audio signal. To reduce the probability of false jam detection on the trail-edge, an additional check 503 needs to be performed to determine where the microphone frame was captured in relation to the lead-edge of the document. This is done by keeping track of how many frames have been processed since the feeder mechanism enable signal was asserted, and if the current frame number has passed the Sensitivity Switch Point (SSP). The Sensitivity Switch Point is dictated by the length of the shortest document that can be safely transported. The trail edge will pass by the point of feeding sooner for short documents and is therefore the limiting case for the need to switch to a lower sensitivity and avoid false jam detections. The number of frames counted to cross the SSP is equivalent to the time to transport the shortest document such that the trail edge passes over the point of feeding.

If the frame count is greater than the Sensitivity Switch Point 505, then the current frame for the microphone is susceptible to this trailing edge false detection and the low sensitivity settings are used 507 in a later stage for determining whether or not a document jam has occurred. If the frame count has not passed the SSP 509, then the high sensitivity settings will be used 511.

Each frame of microphone output data is next processed by sending the digitized data through a band pass filter 513 with lower and upper cutoff frequencies F5 and F6 as previously described in Figure 4.

A ID median filter 515 is next applied to the frame of data to help distinguish audio characteristics between a document that is merely wrinkled which exhibits intermittent high peak values, as opposed to a document in the process of being damaged which has relatively continuous high values of amplitude. The median filter, energy threshold calculations, and Jam Count window accumulation all combine to distinguish merely wrinkled documents from those being damaged during transport.

After the median filter, the energy of the microphone frame of data is calculated 517. The energy of the frame of data is calculated with the equation below, where N represents the number of data samples within a frame, and micdata is a number correlated to a sound intensity of each individual digitized audio sample.

If the microphone frames are captured immediately after the feeder mechanism is enabled 520 then the algorithm completely ignores these frames of data by forcing the energy level to zero 521. An example number of ignored frames is about thirty. This prevents the algorithm from falsely detecting the feeder mechanism noise as a potential jam. Otherwise 522 the energy calculation from 517 is compared against a sensitivity threshold 523 that is varied depending on whether we are in the low or high sensitivity mode as determined previously in 503. A potential wrinkling document is detected when the energy level of the frame goes above the Energy Threshold 524. When this occurs, the algorithm initiates a jam count window if one has not been previously initiated and increments the Jam Count variable 525. This window defines a block of frames where the energy level of some minimum number of frames must exceed the Energy Threshold before an actual jam detection signal is issued. If the Jam Count exceeds the JamCount Threshold 527, then the jam signal is asserted 529 and the algorithm terminates 541. Otherwise, if the Jam Count is below the JamCount Threshold 543, then the algorithm waits for next frame of data.

If the energy level of this particular data frame is below the

Energy Threshold 533 then the algorithm increments the current position within the jam count window, assuming a jam had occurred on an earlier frame (jam count >0) and a jam count window was open 535. If a jam count window was opened by a previous frame exceeding the energy threshold, and the current frame position count reaches the end of the fixed window size 537 before the Jam Count exceeds the JamCount Threshold, then the window is closed and the Jam Count is reset to zero 539 and the algorithm waits for the next frame of data 551. Otherwise 549 the algorithm waits for the next frame of data 551.

In FIG. 7, "Jam #1" represents the first frame where the energy level exceeds the Energy Threshold and the jam count window opens. As each future frame is processed, the current position within the window is updated. Jam Detect #N represents the frame where the Jam Count exceeds the

JamCount Threshold before the window closes.

With reference to FIG.6, this timing diagram represents a single document traveling through the scanner. The damage detection algorithm commences when the feed mechanism enable signal is passed 601 from the main scanner controller to the damage detection processor. The delay period 603 is utilized to avoid false jam detection due to the sounds associated with the feed mechanism and a document entering the paper transport. At the end of this delay 605 the algorithm starts to actively look for sound signal data associated with document damage. The initial portion of the document is processed at high sensitivity in region 607 until there is the risk of false damage detection due to the trail edge of the document. At this point 609 the sensitivity drops to the lower sensitivity for the remainder of this document 611 until the end of the document is reached 613 and the algorithm terminates until the next document is fed.

PARTS LIST

101 Roller

103 Document

105 Rollers

107 Rollers

111 Microphone

115 Signal Conditioner

211 Electric Circuit

215 Electric Circuit

301 Controller

303 Document

305 Electric Circuit

309 Converter

311 Microphone

313 Processor

315 Signal

317 Signal

501 Step

502 Step

503 Step

505 Branch

507 Step

509 Branch

511 Step

513 Step

515 Step

517 Step

519 Step

520 Branch

521 Step

522 Branch 523 Step

524 Branch

525 Step

527 Branch

529 Step

533 Branch

535 Step

537 Step

539 Step

541 End

543 Branch

545 Branch

549 Branch

551 Step

601 Pointer

603 Document

605 Pointer

607 Document

609 Pointer

611 Document

613 Document

Claims

CLAIMS:

1. A sheet handling apparatus comprising:

a transport path;

a device adapted to separate a first sheet from a plurality of stacked sheets and to feed the first sheet into the transport path;

only one detector positioned near the transport path to detect a misfeed condition indicating that the first sheet is being damaged in the transport path; and

a processing system coupled to the detector and adapted to receive and process signals from the detector, the processing system configured to determine the misfeed in the transport path and to terminate feeding sheets in response to the determination.

2. The apparatus according to claim 1, wherein the detector comprises a microphone.

3. The apparatus according to claim 2, wherein the detector further comprises a mount made from a compliant noise isolating material.

4. The apparatus of claim 1, wherein the processing system is further configured to calculate an energy level of the digital audio data to determine the misfeed.

5. An article processing apparatus for processing a plurality of articles, comprising:

a transport path for the plurality of articles;

a feeder device for feeding individual ones of the articles into the transport path;

only one audio detector positioned in the transport path to detect a misfeed condition in the transport path; and a processing system coupled to the detector to receive and process signals from the detector, the processing system configured to terminate processing the plurality of articles in response to the signals from the detector .

6. The apparatus of claim 5, further comprising means for calculating an energy level of the signals from the detector to determine if the signals exceed an energy threshold, thereby indicating the misfeed condition.

7. The apparatus according to claim 6, further comprising:

a converter coupled to the detector for converting the signals from the detector into digital data frames which are received by the processing system; and

means for counting a number of the data frames that indicate the misfeed condition.

8. The apparatus of claim 7, further comprising:

means for issuing a termination signal in response to the means for counting, wherein the means for issuing a termination signal is triggered upon the number of data frames that exceed the energy threshold exceeding a preselected number.

9. A method for feeding sheets comprising:

urging a sheet through a sheet transport path;

providing only one audio receiver proximate the transport path; processing audio data detected by the audio receiver, the audio data detected during the step of urging;

determining a misfeed in the audio data; and

terminating feeding sheets in response to the step of determining.

10. The method of claim 9, further comprising calculating an energy level of the audio data.

11. The method of claim 9, further comprising mounting the audio receiver proximate the transport path using a noise isolating compliant material.

12. A method of determining a misfeed in an article processing apparatus, comprising:

placing only one microphone in the article processing apparatus; feeding an article into the article processing apparatus;

generating and collecting data frames of sound detected by the microphone;

processing the collected data frames to determine the misfeed; and reducing a probability of a false misfeed determination including: accumulating a number of data frames collected; and reducing a sensitivity setting if the number of data frames collected exceeds a preselected amount.

13. The method of claim 12, further comprising calculating an energy level of the data frames and comparing the calculated energy level for each data frame to a jam threshold corresponding to each data frame, the jam threshold for each data frame determined according to the sensitivity setting.

14. The method of claim 13, further comprising opening a jam count window upon determining that the calculated energy level of a current data frame exceeds its jam threshold, the jam count window for accumulating a jam count, the jam count for counting a number of data frames that exceed their corresponding jam threshold.

15. The method of claim 14, further comprising issuing a jam signal if the jam count reaches a preselected jam count limit while the jam count window is open.

16. The method of claim 15, further comprising counting a total number of frames that have been processed and closing the jam count window if the total number of frames that have been processed exceeds a jam count window size.

17. The method of claim 14, further comprising: counting a total number of frames that have been processed and closing the jam count window if the total number of frames that have been processed exceeds a jam count window size, including resetting the jam count to zero upon closing the jam count window; and

issuing a jam signal if the jam count reaches a preselected jam count limit while the jam count window is open.

18. The method of claim 12, further comprising bypassing a plurality of initially collected data frames including overwriting the data in t plurality of initially collected data frames with zero values.

19. A method of processing articles comprising: holding a plurality of the articles to be processed; feeding a first one of the articles into an article processing apparatus using a device configured to separate the first one of the articles from the plurality of the articles;

collecting sound data generated by the step of feeding using only one microphone;

processing the collected sound data generated by the step of feeding; determining, in response to the step of processing, that the collected sound data generated by the step of feeding indicates a misfeed; and terminating processing the articles in response to the step of determining.