US10896482B2 - Slice scan imaging system and methods of use - Google Patents
Slice scan imaging system and methods of use Download PDFInfo
- Publication number
- US10896482B2 US10896482B2 US15/923,583 US201815923583A US10896482B2 US 10896482 B2 US10896482 B2 US 10896482B2 US 201815923583 A US201815923583 A US 201815923583A US 10896482 B2 US10896482 B2 US 10896482B2
- Authority
- US
- United States
- Prior art keywords
- image
- slice
- slices
- pixel intensity
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 102
- 238000003384 imaging method Methods 0.000 title abstract description 23
- 230000008569 process Effects 0.000 claims abstract description 32
- 238000002156 mixing Methods 0.000 claims abstract description 8
- 230000004313 glare Effects 0.000 claims description 17
- 238000005286 illumination Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 239000003086 colorant Substances 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 8
- 238000012163 sequencing technique Methods 0.000 description 12
- 230000009467 reduction Effects 0.000 description 5
- 238000013459 approach Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000008570 general process Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000010008 shearing Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/001—Image restoration
- G06T5/002—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/001—Image restoration
- G06T5/003—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration by the use of local operators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G06T5/70—
-
- G06T5/73—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
- H04N1/19—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
- H04N1/191—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a one-dimensional array, or a combination of one-dimensional arrays, or a substantially one-dimensional array, e.g. an array of staggered elements
- H04N1/1911—Simultaneously or substantially simultaneously scanning picture elements on more than one main scanning line, e.g. scanning in swaths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20216—Image averaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30176—Document
Definitions
- the invention is directed to systems and methods for image capturing technologies and, more particularly, to a slice scan imaging system and respective processes to achieve high quality images.
- Image capture systems for postal sorting and defect inspection on continuously moving conveyor belts require short exposure times and intense lighting. This is not always technically feasible with typical frame cameras, which capture a large image area simultaneously. Additionally, the object which is being captured may be jostling/rocking as it passes the camera, which requires a fast shutter speed to “stop the action”.
- Line scan cameras are typically used for these applications, but they have several shortcomings that limit advanced image processing options. Although the line scan cameras are commonly used for conveyor imaging systems for postal sorting and defect inspection, these cameras are able to utilize focused, intense lighting in order to capture objects at relatively high belt speeds. Also, the processing of such images is not able to account for the rocking motion of the object while it is being captured. This can result in a “shearing” distortion in the final image if the object is not firmly held in place.
- the TDI camera is a scanning technology in which a frame transfer device produces a continuous video image for a moving object by means of a stack of linear arrays aligned with and synchronized to the motion of the object to be imaged. As the image moves from one line to the next, the integrated charge moves along with the image, providing higher pixel intensity at lower light levels than possible with line scan technologies.
- the TDI camera is able to capture objects with shorter exposure times or less illumination, but they are subject to capturing “fuzzy” images if the object being captured is not firmly held from moving in any direction other than the direction of travel.
- a method implemented in a computing device comprises: capturing multiple lines of an image in a single slice; capturing multiple slices; (capitalizing on opportunities provided by overlapping areas); stitching together the multiple slices by aligning common features of the images of a previous slice with a successive slice; and blending together the stitched together multiple slices.
- a computer program product comprises program code embodied in a computer-readable storage medium, the program code is readable/executable by a computing device to perform the method steps of any combination of features.
- a system comprises: a CPU, a computer readable memory and a computer readable storage medium; and program instructions to perform the method steps of any combination of features.
- the program instructions are stored on the computer readable storage medium.
- FIG. 1 shows an illustrative environment for implementing the steps in accordance with aspects of the invention.
- FIG. 2 shows a representation of stitching together several slices of an image in accordance with aspects of the present invention.
- FIG. 3 shows a technique for increasing the depth of field of an image in accordance with aspects of the present invention.
- FIG. 4 shows a technique for reducing noise in the image in accordance with aspects of the invention.
- FIGS. 5A and 5B show a technique for combining individual slices in order to amplify the intensity of light captured by the image sensor in accordance with aspects of the invention.
- FIGS. 6A and 6B show a technique for correcting for motion blur in accordance with aspects of the invention.
- FIGS. 7A and 7B representatively show a technique for glare reduction in accordance with aspects of the invention.
- FIG. 8 shows an illustrative mail sorting and sequencing system, which can be used in implementing the processes of the present invention.
- the invention is directed to systems and methods for image capturing technologies and, more particularly, to a slice scan imaging system and respective processes to achieve high quality images.
- the slice scan imaging system can capture multiple slices of a mailpiece as it moves along a conveyer system and stitch such slices together to achieve high quality images.
- the slice scan imaging system and processes described herein can be implemented in mail sorting and sequencing systems.
- a solution to poor image quality is provided by implementing a “slice scan” approach to capture narrow frames (e.g., multiple lines) of an object, e.g., mailpiece and in a particular embodiment, an address block of a mailpiece, as it moves past an image detector, e.g., “slice scan” camera or other imaging detectors (hereinafter referred to as “slice scan” camera).
- image detector e.g., “slice scan” camera or other imaging detectors
- This approach allows highly focused illumination to be used, e.g., illumination on only a portion of the mailpiece, compared to intensely illuminating a large area of the mailpiece, which is needed in conventional systems.
- each slice of the image can be aligned with a successive slice of the image in order correct for any rocking motion of the object between frames (slices), amongst other features described herein.
- This can be accomplished by detecting and matching features in the image which are common between successive slices (e.g., frames). These slices are then blended or stitched together to form a seamless image of high quality, which is representative of, e.g., the mailpiece.
- the “feature matching” for aligning successive slices is one approach that can be implemented in the aspects described herein.
- feature matching is one approach to the more general process of image registration for aligning images.
- the alignment process can use image registration (feature matching) or intensity-based methods. Accordingly, the present invention does not strictly rely on using feature-based methods, and intensity-based methods may in fact be implemented herein.
- the present invention may be embodied as a system, method or computer program product.
- the present invention may take the form of a hardware embodiment, a software embodiment or a combination of software and hardware.
- the present invention may take the form of a computer program product embodied in any tangible storage having computer-readable program code embodied in computer-readable storage medium (non-transitory medium).
- the computer-readable storage medium can contain or store information for use by or in connection with the instruction execution system, apparatus, or device.
- the computer-readable storage medium may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device or other non-transitory medium, memory, device or system.
- the computer-readable storage medium would include the following non-transitory systems, devices and/or memory: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
- the computer readable storage medium, memory, system and/or device is not to be construed as being transitory signals per se.
- the computer readable storage medium, memory, system and/or device is generally referred to as computer readable storage medium.
- FIG. 1 shows an illustrative environment 110 for managing the processes in accordance with the invention.
- the environment 110 includes a server or other computing system 112 that can perform the processes described herein.
- the illustrative environment may be used in a mail sorting and sequencing system as shown illustratively in FIG. 8 ; although other sorting and sequencing systems are also contemplated by the present invention.
- the computing system 112 includes a computing device 114 which can be resident on or communicate with a network infrastructure or other computing devices.
- the computing device 114 includes a processor 120 , memory 122 A, an I/O interface 124 , and a bus 126 .
- the computing device 114 includes random access memory (RAM), a read-only memory (ROM), and an operating system (O/S).
- the computing device 114 is in communication with an external I/O device/resource 128 and the storage system 122 B.
- the I/O device 128 can comprise any device that enables interaction with the computing device 114 (e.g., user interface) or any device that enables the computing device 114 to communicate with one or more other computing devices using any type of communications link or any device that enables the computing device 114 to interact with its environment.
- the I/O device 128 can be a “slice scan” camera which simultaneously captures multiple lines of an image in a single slice and captures multiple slices of the image representative of an object, e.g., mailpiece, as the object is traveling through a mail sorting and/or sequencing system shown in FIG. 8 as an example.
- a “slice scan” camera which simultaneously captures multiple lines of an image in a single slice and captures multiple slices of the image representative of an object, e.g., mailpiece, as the object is traveling through a mail sorting and/or sequencing system shown in FIG. 8 as an example.
- the processor 120 executes computer program code (e.g., program control 144 ), which can be stored in the memory 122 A and/or storage system 122 B. While executing the computer program code, the processor 120 can read and/or write data to/from memory 122 A, storage system 122 B, and/or I/O interface 124 .
- the program code 144 executes the processes of the invention such as, for example, stitching together multiple slices (each of which is composed of multiple lines) of an image, e.g., as the object travels through a sorting and/or sequencing system at high speeds, amongst other features described herein.
- the computing device 114 includes a imaging module 100 , which can be implemented as one or more program code in the program control 144 stored in memory 122 A as a separate or combined module. Additionally, the imaging module 100 may be implemented as separate dedicated processors or a single or several processors to provide the functionality of this tool. Moreover, it should be understood by those of ordinary skill in the art that the imaging module 100 is used as a general descriptive term for providing the features and/or functions of the present invention, and that the imaging module 100 may comprise many different components such as, for example, the components and/or infrastructure described and shown with reference to FIG. 1 .
- the imaging module 100 is operative and/or configured to, e.g., (i) provide higher quality images of a mailpiece (compared to conventional line scan processes), (ii) amplify low light conditions, (iii) reduce noise, (iv) improve depth of field, (v) compensate or correct for blurry imaging, and (v) reduce glare, amongst other features.
- a mailpiece compared to conventional line scan processes
- amplify low light conditions e.g., amplify low light conditions, (iii) reduce noise, (iv) improve depth of field, (v) compensate or correct for blurry imaging, and (v) reduce glare, amongst other features.
- color “scan line” cameras e.g., by implementing such slice scan techniques through the imaging module 100 as described herein, it is now possible to use color “scan line” cameras to capture the images.
- any light source greater than ambient light of the surrounding area can be used when capturing the image. That is, by implementing the systems and
- the imaging module 100 can stitch together multiple slices of an image of a mailpiece or text of a mailpiece or other object in order to correct for any rocking motion of the object between frames (e.g., slices). This is generally accomplished by: (i) obtaining multiple image slices of an object (e.g., mailpiece) from a “slice scan” camera, where many lines are captured simultaneously in each single slice; and (ii) stitching together the multiple slices to form a single image of the object by matching features (image registration) or intensity-based methods in each image slice common between successive slices (e.g., frames). This results in a high speed imaging system, which can capture objects not firmly held in place without intensely illuminating a large area.
- slices e.g., slices
- the “slice scan” camera will capture narrow slices of an object, e.g., simultaneously capture two or more lines. In more preferred embodiments, the narrow slices will be less than an entire image, e.g., mailpiece. In even more specific embodiments, the “slice scan” camera can simultaneously capture about 32 lines of image and, in even more specific embodiments, “N” number of lines which is approximately equal to the thickness of a focused light source, e.g., fluorescent or LED light source, which illuminates a portion of the object.
- a focused light source e.g., fluorescent or LED light source
- wavefront coding can be implemented, which is a technique that will increase the depth of field in an image as shown in FIG. 3 .
- wavefront coding refers to the use of a cubic phase modulating element in conjunction with deconvolution to extend the depth of field of a digital imaging system such as the “slice scan” camera.
- a number of lines are captured simultaneously through a lens which blurs the image uniformly.
- a deconvolution is then performed which brings a large range back into focus (e.g., see FIG. 3 ).
- a typical kernel size for this operation is 11 ⁇ 11, meaning at least 11 lines of data should be captured at a time. (This technique is not possible with line scan cameras currently in use.)
- the systems and processes described herein enable noise reduction as shown in FIG. 4 .
- the slices can be combined in a way which reduces the effects of noise on the final image as shown in FIG. 4 .
- individual slices can also be combined in order to amplify the intensity of light captured by the image sensor (slice scan” camera) as shown in FIGS. 5A and 5B .
- This will behave similar to a TDI camera in that shorter exposure times (which enables faster object transport) or less illumination can be used; however, because alignment can be performed on the slices, a high quality image can be produced even if the object is rocking.
- the noise reduction effects previously discussed may reduce noise to an acceptable level while correcting for the motion blur, as demonstrated in FIGS. 6A and 6B .
- FIGS. 2-7 show representations of different techniques (processes) implemented by the systems and processes described herein. These figures can also represent exemplary flows for respective processing steps in accordance with aspects of the present invention.
- the exemplary representations can be implemented as a system, a method, and/or a computer program product and related functionality implemented on the computing system of FIG. 1 . Accordingly, the processes associated with each representative figure can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions. It is also contemplated that any combination of techniques described herein can be used together in parallel or serially.
- FIG. 2 shows a representation of stitching together several slices of an image in accordance with aspects of the present invention. More specifically, as representatively shown at reference numeral 210 , a slice of an object 200 , e.g. star, is captured by a “slice scan” camera. As should be understood by those of ordinary skill in the art, each successive frame (e.g., slice) (each of which are represented by reference numerals 210 ) may have common overlapping subject with a previous frame (slice).
- the “slice scan” camera is used to capture very narrow frames (slices comprising multiple lines) as the object moves past the camera.
- the “slice scan” camera will simultaneously capture multiple lines of the object in a single slice and capture multiple slices, which have overlapping subject matter such as, e.g., a point on the star 220 .
- the slice 210 can be about 32 lines, although “N” number of lines for each slice is contemplated by the present invention.
- the number of lines may be equal to or approximately equal to the area (e.g., thickness) of a highly focused illumination on a certain area of the object, rather than intensely illuminating a large area needed in conventional camera technologies.
- each of the slices are then stitched together (e.g., shingled together) to form a single mosaic image of the object.
- each slice is aligned with the successive image in order correct for any rocking motion of the object in between frames (slices). This is shown representatively by detecting and matching features (image registration) or intensity-based methods in the image which are common between adjacent (successive) slices, e.g., the point of the star 220 , and overlapping such slices to form a mosaic image of the object.
- the overlapping can be one (1) or more lines of the slices.
- the alignment of the slices is shown by the shift or offset nature of each slice (to the left and right).
- the processes described herein can also provide an edge to edge mosaic, instead of an overlapping or shingling of the slices.
- the overlapping (e.g., shingling) of the slices will typically provide a more robust alignment, though.
- the alignment will be provided by stitching together the slices at their edges.
- the imaging module may detect transitioning features (different shades or colors of the image at the edges of the slice) that can be aligned together between the different slices, as an example.
- FIG. 3 representatively shows a technique for increasing the depth of field of an image.
- two objects 300 and 305 e.g., stars
- star 305 is blurry; whereas, star 300 is in focus.
- multiple slices of the objects e.g. stars
- the “slice scan” camera will capture multiple slices of the objects, which have overlapping subject matter such as, e.g., a point on the star 320 .
- each successive frame (e.g., slice) 310 may have common overlapping subject with a previous frame (slice).
- a typical kernel size for this operation is 11 ⁇ 11, meaning at least 11 lines of data should be captured at a time, although “N” number of lines for each slice is contemplated by the present invention. Additionally, the 11 ⁇ 11 size is an example based on a particular wavefront coding/deconvolution being implemented, and is not necessarily fixed in size other than, perhaps, in embodiments, 3 ⁇ 3 or greater.
- the “slice scan” camera includes a filter which blurs the image uniformly, as shown by reference numeral 312 .
- each of the slices will be deconvoluted to bring a large range of the images back into focus. This can be accomplished using a wavefront coding technique.
- the separate slices are then stitched together to form a single mosaic image representing the objects as shown at reference numeral 330 .
- each slice is aligned with the successive image in order correct for any rocking motion of the object in between frames (slices) as already described herein, e.g., by detecting and matching features (image registration) or intensity-based methods in the image which are common between successive slices, e.g., the point of the star 320 .
- These frames (slices) are then blended together to form a seamless image as shown at reference numeral 340 .
- FIG. 4 shows a technique for reducing noise in the image in accordance with aspects of the invention.
- this noise reduction technique overlapping of the scan lines can be used to correct for motion.
- multiple slices 210 of the object 200 are captured as the object moves past the camera.
- the noise 217 is represented as speckles or dots within each of the slides 210 .
- the values of the matched features in the image which are common between successive slices, e.g., the point of the star 220 can be averaged together to reduce any noise from any single slice, as shown by reference numeral 225 .
- These frames (slices) are then blended together to form a seamless image as shown at reference numeral 240 .
- individual slices can be combined in order to amplify the intensity of light captured by the image sensor, e.g., “slice scan” camera.
- a slice 210 of an object 200 e.g. star
- captured by the “slice scan” camera may be of varying dimness (brightness) due to the light intensity provided on the object 200 .
- pixel intensity of the image or portions of the image on each slice captured by the “slice scan” camera may vary from 0-255 for an 8 bit value (although other values, e.g., 12 bit values, are also contemplated herein), where 0 is dark and 255 is the brightest. In this example, any value of over 255 will result in an oversaturated image.
- each of the slices are aligned and stitched together to form a single mosaic image of the object.
- each slice is aligned with the successive image in order correct for any rocking motion of the object in between frames (slices). This is shown representatively by detecting and matching features (image registration) or intensity-based methods in the image which are common between adjacent (successive) slices, e.g., the point of the star 220 , and overlapping such slices to form a mosaic image of the object.
- the alignment of the slices is shown by the shift or offset nature of each slice (to the left and right).
- the pixel intensity values associated with the overlapped images can be added together as shown representatively at reference numeral 250 .
- the light intensity can be increased, resulting in a brighter image as shown at reference numeral 240 ′.
- the processes described herein will not over saturate the image; that is, the addition process will not exceed a maximum value, e.g., 255 for an 8 bit value.
- the values could be add up to more than 255, but later normalized to create an image with values between 0 and 255.
- the less intense light source can now be any light source, e.g., fluorescent, that will illuminate the object above the ambient light source. This also facilitates the use of color cameras in such industrial applications.
- the systems and processes described herein allow for the use of less illumination or higher transport speeds by correcting for motion blur.
- illumination is decreased (and therefore exposure time increased) or higher transport speeds are used, for example, motion blur may occur.
- the imaging system e.g., “slice scan” camera
- a Wiener deconvolution technique can be used to correct this blur to an extent.
- Wiener deconvolution is an application of the Wiener filter to noise problems inherent in deconvolution. It works in the frequency domain, attempting to minimize the impact of deconvolved noise at frequencies which have a poor signal-to-noise ratio.
- the Wiener deconvolution method has widespread use in image deconvolution applications, as the frequency spectrum of most visual images is fairly well behaved and may be estimated easily. Although the Wiener deconvolution can be used in line scan imaging systems, this technique significantly amplifies noise, which may make the final image unusable.
- FIGS. 6A and 6B representatively show a technique for correcting for motion blur.
- multiple lines for each slice of the object 600 e.g. stars
- the “slice scan” camera will capture multiple slices of the object, which have overlapping subject matter such as, e.g., a point on the star 620 .
- the image is shown to be blurred at reference numeral 612 .
- This may be caused by, e.g., decreased illumination or higher transport speeds.
- each of the blurred portions of the slices will be corrected, e.g., to bring it back into focus, by using the Wiener deconvolution technique as an example.
- the separate slices are then stitched together to form a single mosaic image representing the object as shown at reference numeral 630 .
- each slice is now in focus and is aligned with the successive image as already described herein, e.g., by detecting and matching features (image registration) or intensity-based methods in the image which are common between successive slices, e.g., the point of the star 620 .
- These frames (slices) are then blended together to form a seamless image as shown at reference numeral 640 .
- any glare generally does not stay in the same place. That is, if one region of the object is obstructed by glare in a given frame, the same region may not be obstructed in the next frame.
- regions which contain glare can be detected and ignored. This will result in a blended final image which contains significantly less glare as shown in FIGS. 7A and 7B .
- the brightness of a particular portion of the image may signify a glare 720 , when compared to the same portion of the image on a different slice captured at a different time and hence different angle from the previous slice. It is possible to make such a determination by determining the pixel intensity of the image or portions of the image on each slice captured by the “slice scan” camera. For example, a glare can be assumed when there is a higher pixel intensity value for a portion of the image on the first slice compared to pixel intensity value for the same portion of the image on the second slice (or vice versa), captured at a different time and angle.
- the processes described herein can (i) ignore the overlapping image with the higher pixel intensity value, e.g., use the minimum value, (ii) average the two values together, or (iii) subtract the lower pixel intensity value from higher pixel intensity value as representatively shown at reference numeral 772 .
- these techniques should not result in a value below a certain minimum threshold value (e.g., a pixel intensity value that would result in a dark image).
- the blended image 774 (from the stitched images 730 ) can then have a reduced or no glare.
- FIG. 8 shows an illustrative mail sorting and sequencing system, which can be used with the processes of the present invention. It should be understood by those of skill in the art that the present invention can be implemented with any number of mail sorting and sequencing systems, and that the illustrative representation of the mail sorting and sequencing system of FIG. 8 should not be considered a limiting feature to the claimed invention.
- the mail sorting and sequencing system is a single pass carrier delivery sequence sorter generally indicated by the numeral 10 .
- the single pass carrier delivery sequence sorter 10 has a base 12 with four legs 14 (only three shown in FIG. 8 ) extending therefrom.
- An auto feed station 16 extends lengthwise along the base 12 and has a feeder 18 and an address reader 20 at one end and a manual feed station 22 with a second address reader 24 at the other end.
- the feeder 18 and address reader 20 create a feed, read and insert path to a racetrack sorting device 26 which has an array of bin dividers 28 , adjacent ones of which create holders for individual mail pieces deposited therebetween.
- a video encoder/numerical controller 30 which may be a microprocessor or the like is located adjacent the feeder 18 and operationally connected to various components of the single pass carrier delivery sequence sorter 10 for coordinating the operation of the same in a manner explained.
- the address readers 20 , 24 and/or video encoder/numerical controller 30 or other computing devices can read barcode information and implement the processes of the present invention.
- On either side of the racetrack sorting device 26 are two interim unloading station units generally indicated by the numeral 32 , each having twenty (20) interim unloading stations 36 . At the ends of the interim unloading station units 32 , bundling/wrapping stations 38 are mounted on the base 12 . See, e.g., U.S. Pat. No. 8,138,438, for a full detailed explanation of the single pass carrier delivery sequence sorter 10 and related systems, the contents of which are incorporated by reference in their entirety herein.
Abstract
Description
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/923,583 US10896482B2 (en) | 2017-05-11 | 2018-03-16 | Slice scan imaging system and methods of use |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762504683P | 2017-05-11 | 2017-05-11 | |
US15/923,583 US10896482B2 (en) | 2017-05-11 | 2018-03-16 | Slice scan imaging system and methods of use |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180330472A1 US20180330472A1 (en) | 2018-11-15 |
US10896482B2 true US10896482B2 (en) | 2021-01-19 |
Family
ID=64096661
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/923,583 Active 2038-08-28 US10896482B2 (en) | 2017-05-11 | 2018-03-16 | Slice scan imaging system and methods of use |
Country Status (1)
Country | Link |
---|---|
US (1) | US10896482B2 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10713520B2 (en) * | 2016-10-27 | 2020-07-14 | Engineering Innovation, Inc. | Method of taking a picture without glare |
US10587821B2 (en) * | 2018-05-17 | 2020-03-10 | Lockheed Martin Corporation | High speed image registration system and methods of use |
US10970814B2 (en) * | 2018-08-30 | 2021-04-06 | Halliburton Energy Services, Inc. | Subsurface formation imaging |
US11889049B2 (en) | 2020-08-14 | 2024-01-30 | Raytheon Company | Gain map generation with rotation compensation |
US11563899B2 (en) | 2020-08-14 | 2023-01-24 | Raytheon Company | Parallelization technique for gain map generation using overlapping sub-images |
US11394851B1 (en) * | 2021-03-05 | 2022-07-19 | Toshiba Tec Kabushiki Kaisha | Information processing apparatus and display method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090175539A1 (en) * | 2008-01-09 | 2009-07-09 | Authorizer Technologies, Inc. | Method and system for swipe sensor image alignment using fourier phase analysis |
US8600194B2 (en) | 2011-05-17 | 2013-12-03 | Apple Inc. | Positional sensor-assisted image registration for panoramic photography |
US20180005392A1 (en) * | 2016-06-30 | 2018-01-04 | Datalogic ADC, Inc. | Item image stitching from multiple line-scan images for barcode scanning systems |
US10429632B2 (en) * | 2015-04-15 | 2019-10-01 | Olympus Corporation | Microscopy system, microscopy method, and computer-readable recording medium |
-
2018
- 2018-03-16 US US15/923,583 patent/US10896482B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090175539A1 (en) * | 2008-01-09 | 2009-07-09 | Authorizer Technologies, Inc. | Method and system for swipe sensor image alignment using fourier phase analysis |
US8600194B2 (en) | 2011-05-17 | 2013-12-03 | Apple Inc. | Positional sensor-assisted image registration for panoramic photography |
US10429632B2 (en) * | 2015-04-15 | 2019-10-01 | Olympus Corporation | Microscopy system, microscopy method, and computer-readable recording medium |
US20180005392A1 (en) * | 2016-06-30 | 2018-01-04 | Datalogic ADC, Inc. | Item image stitching from multiple line-scan images for barcode scanning systems |
Also Published As
Publication number | Publication date |
---|---|
US20180330472A1 (en) | 2018-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10896482B2 (en) | Slice scan imaging system and methods of use | |
EP3035231B1 (en) | Rolling shutter bar code imaging | |
US8582862B2 (en) | Mobile image quality assurance in mobile document image processing applications | |
CN103685830B (en) | Image read-out and bill handling device | |
US10068150B2 (en) | Method and apparatus for OCR detection of valuable documents by means of a matrix camera | |
JP2015210822A (en) | Camera and method for capture of moving flow of object | |
US9237256B2 (en) | Document reading apparatus and image processing method | |
US9916644B1 (en) | Ghost artifact removal system and method | |
JP2014053739A (en) | Image reader and paper sheet processing device | |
US11022553B2 (en) | Surface inspection system and surface inspection method | |
JPWO2017104575A1 (en) | Inspection system and inspection method | |
JP2017085501A (en) | Image reader and processing unit for sheet of paper or the like | |
US11695892B2 (en) | Reading device and method of detecting feature amount from visible or invisible image | |
US11140295B2 (en) | Image reading apparatus and method configured to correct tilt image data | |
US9143653B2 (en) | Image processing apparatus, method, and computer program product identifying show-through position based on back side image and expanded front side image | |
CN111433811B (en) | Reducing image artifacts in images | |
JP7278714B2 (en) | film scanning | |
EP3076163A1 (en) | Inspection device for sheet-shaped object | |
JP6645294B2 (en) | Image reading device | |
US10587821B2 (en) | High speed image registration system and methods of use | |
JP2001183113A (en) | Step detecting device | |
JP2019057883A (en) | Image reading device and image reading method | |
JP6299645B2 (en) | Image reading apparatus and image reading method | |
US20230370724A1 (en) | Recording and brightness adjustment of an image | |
US20170237949A1 (en) | Method and system of identifying container number |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LOCKHEED MARTIN CORPORATION, MARYLAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ELHAGE, ALEXANDER M.;RIESS, MICHAEL;SIGNING DATES FROM 20180314 TO 20180315;REEL/FRAME:045256/0205 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |