AU2007203527A1 - Image scanning device having a system for determining the distance to a target - Google Patents

Description

S&F Ref: 723466D1

AUSTRALIA

PATENTS ACT 1990 COMPLETE SPECIFICATION FOR A STANDARD PATENT Name and Address of Applicant Actual Inventor(s): Address for Service: Invention Title: Symbol Technologies, Inc., of One Symbol Plaza, Holtsville, New York, 11742, United States of America Alex Breytman, Bradley S. Carlson, Mark Krichever, Tsi David Shi, Dmitriy Yavid Spruson Ferguson St Martins Tower Level 31 Market Street Sydney NSW 2000 (CCN 3710000177) Image scanning device having a system for determining the distance to a target The following statement is a full description of this invention, including the best method of performing it known to me/us:- 5845c(886900_1) -1- 1 IMAGE SCANNING DEVICE HAVING A SYSTEM FOR DETERMINING THE O DISTANCE TO A TARGET SBACKGROUND OF THE INVENTION 1. Field of the Invention T This invention relates to imaging in optical code reading devices. This invention is particularly useful in solid state, area image sensor based, handheld code readers which are Spositioned at variable orientations and distances with respect to a target code and where a I sharply focused image of the code is desirable for reliable code capture and decoding.

2. Description of the Related Art Various optical readers and optical scanning systems have been developed heretofore for reading indicia such as bar code symbols appearing on a label or on the surface of an article. The bar code symbol itself is a coded pattern of indicia comprised of a series of bars of various widths spaced apart from one another by bound spaces of various widths, the bars and spaces having different light-reflecting characteristics. The readers and scanning systems electro-optically transform the graphic indicia into electrical signals, which are decoded into alphanumerical characters that are intended to be descriptive of the article or some characteristic thereof. Such characters are typically represented in digital form and utilized as an input to a data processing system for applications in point-of-sale processing, inventory control, and the like.

One embodiment of such a scanning system resides, in a hand-held, portable laser scanning head supported by a user, which is configured to allow the user to aim the head, and more particularly, a light beam, at a target and a symbol to be read.

SThe light source in a laser scanner bar code reader is typically a gas laser or semiconductor laser. The use of semiconductor devices as the light source in scanning systems is especially desirable because of their small size, low cost and low voltage requirements. The laser beam is optically modified, typically by a focusing optical assembly, 5 to form a beam spot of a certain size at the target distance. It is preferred that the cross In section of the beam spot at the target distance be approximately the same as the minimum width between regions of different light reflectivity, the bars and spaces of the symbol.

SThe bar code symbols are formed from bars or elements typically rectangular in shape with a variety of possible widths. The specific arrangement of elements defines the character represented according to a set of rules and definitions specified by the code or "symbology" used. The relative size of the bars and spaces is determined by the type of coding used, as is the actual size of the bars and spaces. The number of characters per a given area represented by the bar code symbol is referred to as the density of the symbol. To encode a desired sequence of characters, a collection of element arrangements are concatenated together to form the complete bar code symbol, with each character of the message being represented by its own corresponding group of elements. In some symbologies, a unique "start" and "stop" character is used to indicate where the bar code begins and ends. A number of different bar code symbologies exist. These symbologies include UPC/EAN, Code 39, Code 128, Codabar, and Interleaved 2 of For the purpose of our discussion, characters recognized and defined by a symbology shall be referred to as legitimate characters, while characters not recognized and defined by that symbology are referred to as illegitimate characters. Thus, an arrangement of elements not decodable by a given symbology corresponds to an illegitimate character(s) for that symbology.

O In the laser beam scanning systems known in the art, the laser light beam is directed by a lens or similar optical components along a light path toward a target that includes a bar code or other symbol on the surface. The moving-beam scanner operates by repetitively r. scanning the light beam in a line or series of lines across the symbol by means of motion of a scanning component, such as the light source itself or a mirror, disposed in the path of the t light beam. The scanning component may either sweep the beam spot across the symbol and trace a scan line or pattern across the symbol, or scan the field of view of the scanner, or do both.

Bar code reading systems also include a sensor or photodetector which functions to detect light reflected or scattered from the symbol. The photodetector or sensor is positioned in the scanner in an optical path so that it has a field of view which ensures the capture of a portion of the light which is reflected or scattered off the symbol and is detected and converted into an electrical signal. Electronic circuitry or software decodes the electrical signal into a digital representation of the data represented by the symbol that has been scanned. For example, the analog electrical signal detected by the photodetector may be converted into a pulse width modulated digital signal, with the widths corresponding to the physical widths of the bars and spaces. Such a digitized signal is then decoded based upon the specific symbology used by the symbol into a binary representation of the data encoded in the symbol, and subsequently to the alphanumeric characters so represented.

Moving-beam laser scanners are not the only type of optical instrument capable of reading bar code symbols. Another type of bar code reader particularly relevant to the present invention is one which incorporates detectors based upon charge coupled device (CCD) technology. In such prior art readers the size of the detector is typically smaller than the symbol to be read because of the image reduction by the objective lens in front of the CCD.

The entire symbol is flooded with light from a light source such as light emitting diodes -4- (LED) in the reader, and each CCD cell is sequentially read out to determine the presence of a bar or a space.

Inclusion of an auto focus system incorporating a method for determining distance

(N

to a targeted indicia and moveable or variable-focus optics in a CCD or other image based scanning device is envisioned as a method for extending the versatility and working range In ¢C of the system.

A need exists to provide an improved optical code reader without the limitations of Sprior art readers.

Another need exists to provide a means for controlling an automatic focusing optics assembly in an optical code reader according to a determined distance to a targeted indicia.

Yet another need exists to provide a system for creating and analyzing light patterns for determining the distance to the targeted indicia and subsequently provide focusadjusting control signals to the optics assembly.

SUMMARY

The present invention relates to methods and apparatus for improving the code acquisition of optical code readers, especially imaging code readers. Techniques are disclosed which are applicable for determining distance to a targeted indicia for controlling an automatic focusing optical assembly of an imaging code reader.

Embodiments of the present invention make use of collimated aiming patterns and speckle patterns to determine distance.

In a first embodiment of an optical code reader, where a collimated aiming pattern is used for determining distance, laser beams are aimed at the targeted indicia. The beams incident to the indicia are subsequently reflected back to the optical code reader and detected by a segment of a detector, i.e. array of photodetectors, CCD, or other imaging 885577-1 Selement. The reflected beam illuminates different segments of the detector based on the distance to the targeted indicia. By using the known position of the components within the Scode reader, and basic equations, the distance to the targeted indicia can be determined.

The distance determination may be performed either in real-time through the use of a processor to calculate the distance based on the data from the detector, or through the use of a data structure, such as a lookup table, which cross-references detector data with their corresponding distance values.

SIn another embodiment of an optical code reader, where a speckle pattern is used to determine distance, a laser beam illuminates the targeted indicia producing a speckled pattern, known in the art as the speckle effect, on an image sensor. As the image sensor is moved closer to the targeted indicia, the speckle noise or speckles that make up the speckled pattern become smaller producing a higher spatial distribution frequency on the image sensor, while conversely, as the image sensor is moved further away from the targeted indicia, the speckles increase in size and merge resulting in a lower spatial distribution frequency. The relation between distance to the targeted indicia and speckle spatial distribution frequency can be correlated using a data structure, such as a lookup table, where a plurality of spatial distribution values are cross referenced with their corresponding distance values.

Alternatively, a processor calculates the distance of the targeted indicia from the speckle spatial distribution data through the use of an algorithm or application software.

An aspect of the present invention provides an assembly for an optical code reader for determining distance to a target. The assembly comprises: a laser beam assembly for emitting at least one collimated beam of light to illuminate the target; 885577-1 an assembly fbr detecting a collimated pattern created by the reflection of the collimated beam of light by the target; and a processor for analyzing the detected collimated pattern to determine the distance to the target.

Another aspect of the present invention provides an assembly for an optical code reader for determining distance to a target. The assembly comprises: a radiation assembly Cc for emitting a light to illuminate the target; an assembly for detecting a speckle pattern created from light being reflected from the target; and a processor for processing the detected speckle pattern to determine the distance to the target.

Another aspect of the present invention provides an optical system for an optical code reader including an image sensor. The optical system comprises: means for automatically focusing an image of an optical code onto the image sensor; means for determining distance to the optical code by analyzing a pattern produced by the reflection of a radiation signal by the optical code, wherein the pattern is selected from the group consisting of a collimated pattern and a speckle patter; and means for providing at least one control signal to the automatically focusing means to control the focusing means in accordance with the determined distance.

BRIEF DESCRIPTION OF THE DRAWINGS Various embodiments of the invention will be described herein below with reference to the figures wherein: FIG. 1 is a pictorial view ofa handheld optical code reader and a schematic view of a host terminal; FIG. 2 is a block schematic of the handheld optical code reader of FIG. 1 showing the inner components, including an automatic focusing optics assembly and distance deternmining (range finding) components in accordance with the present invention; 885577-1 0 FIG. 3 is a more detailed representation of the imaging engine; c FIG. 4a and 4b are block representations of an embodiment of the collimated aiming s pattern method for determining distance to the indicia in accordance with the present invention; and FIG. 5 is a block representation of an embodiment of determining the distance to the "In targeted indicia using a speckle pattern caused by the speckle effect.

0 3 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS SIn the present invention, an optical code reader having an imaging engine is provided.

The optical code reader includes an image sensor. Such an image sensor may be a twodimensional or area charge coupled device (CCD) and associated circuitry for producing electronic signals corresponding to a two-dimensional array of pixel information for a field of view. The optical code reader of the present invention also includes the capabilities of determining distance to a targeted indicia by utilizing properties of reflected coherent light and adjusting the focus quality of an image impinged on the image sensor according to the determined distance.

FIG. 1 is a pictorial view of a handheld optical code reader 12 and a schematic view of a host terminal 26 which may be used for various imaging functions of the present invention. The handheld code reader 12 includes a housing 14 having a generally elongated handle or hand grip 16 and an upper portion 18 for housing an imaging engine 10. The front face 15 of the imaging engine 10 appears at the forward end of the upper portion 18 of the handheld optical code reader 12. The cross-sectional dimensions and overall size of the handle portion 16 are such that the optical code reader 12 can conveniently be held in the user's hand.

The optical code reader 12 senses incident light reflected off of an object (the object may be a plurality of objects) within a field of view of the optical code reader 12 for obtaining -7- 0 image data. The object may be an optical code, such as a bar code, or a non-code object. An imaging actuation means, such as a manual trigger 20 is mounted in moving relationship on the handle portion 16 in a forward facing region of the optical code reader 12. The user's CO1 forefinger is normally used to actuate the optical code reader 12 by depressing the trigger for actuating sensing and imaging of the object.

In A flexible electrical cable 22 is provided to connect the optical code reader 12 to the host terminal 26. In alternative embodiments, the cable 22 may also provide electrical power to the reader 12. In a further alternative embodiment, the cable 22 may be partially or fully replaced by wireless communication means such as radio frequency, optical or cellular communication means. In preferred embodiments, the optical code reader 12 includes a means for processing the pixel signals, and the processed information may be transmitted via the cable 22 from the optical code reader 12 to the host terminal 26.

A decode module may be provided in the optical code reader 12 and/or in the host terminal 26 for decoding image data corresponding to an optical code. An image data compression module 27 may be provided for compressing the image data.

The host terminal 26 includes at least one data processor, where the at least one data processor may be connected to one or more peripherals or computing devices, such as a video monitor, and/or a network. Compressed image data may be transmitted to the host terminal 26 over electrical cable 22. The transmission of video data may be triggered by pressing the trigger 20 or by actuating another switch on the optical code reader 12. The image data may then be applied to the host terminal 26. The compressed image data may be applied to a serial communication port of the host terminal 26, such as the serial communication port of a personal computer when such a device is used as the host terminal 26. The image data may be processed by a data processor (not shown) within the personal computer and selectively displayed on monitor (not shown). A color video image may be obtained.

O FIG. 2 is a sectional view of the inner components of the optical code reader 12. The _inner components include an auto-focusing optics assembly, distance determining components, imaging unit, and various other support systems which are incorporated into the Shandheld optical code reader 12. The reader 12 can be connected to a data storage system, i.e.

computer-based inventory management database or cash register, via one of a plurality of In standard wireless technologies allowing greater, unrestricted mobility within the working range of the particular wireless protocol chosen.

In a wireless embodiment, the power source, preferably rechargeable, will need to be contained in the handheld code reader 12 and a recharging cradle may be provided for recharging the handheld unit. The cradle can be connected to the data storage system for downloading data from the optical code reader 12 and for uploading data to the optical code reader 12.

With reference to FIG. 2, the optical code reader 12 is a handheld, gun shaped, device having an ergonomic, pistol-grip type handle 50. A movable trigger 52 is employed to allow the operator to activate the image acquisition components 54 and distance determining means components 56. The housing 14 contains the light source, automatic focusing system, image sensor, and signal processing circuitry 58, which includes a CPU which implements decoding algorithms and lookup table data retrieval functionality. Memory components 59 are also included for storing the lookup table data correlating light pattern parameters with distance values.

A power source 60 in the form of a battery is provided. A light-transmissive window 62 in the front end of the code reader 12 allows the outgoing light beam to exit the housing 14 and the incoming reflected light to enter while also protecting the delicate optics from dust and scratches. The wireless receiver and transmitter 64 and antenna 66 allow for greater freedom of movement for the operator.

IThe rechargeable power source 60 provides ample power to allow the code reader 12 to operate for a convenient period of time before needing to recharge on its base through the connector 68 located at the bottom of the grip 50. Typically, this type of code reader 12 is designed to operate within a range of several inches of the optical code or indicia.

It will be understood that aspects of the present invention are also applicable to In imaging engines which are not located in conventional handheld scanners or guns. For example, the imaging engine may be incorporated into a computer terminal in a fixed location or in a rotating turret. Such arrangements are particularly well adapted for using the imaging engine and distance determining components as part of a video phone system which also uses the display, processing and I/O capabilities of the computer.

The optical code reader 12 of the present invention may further include frame grabbing circuitry for providing video signals for displaying images produced by the apparatus on a terminal monitor. In this case hardware modification of existing terminals may be avoided.

Alternatively, the imaging engine 10 may be attached to or integrated with a portable, handheld computer device, such as a PDA and handheld computeK devices available from Symbol Technologies, Inc., such as the PDT 6800 Series and the PDT 8100 Series Portable Data Terminals, or attached to or integrated with portable scanning systems or terminals, such as those available from Symbol Technologies, Inc. Such systems may be incorporated as part of a local area, cellular or wide area network to coordinate scanning and other image processing functions described below.

In portable applications where electrical power is supplied by batteries, it is particularly important to conserve energy. Power management techniques may include switching the images to lower resolution or frame rates to conserve power. Alternatively, the imaging engine or other optical code reader circuitry, or portions thereof, may be periodically 0 shut down or enter a sleep mode, or shut down when the system senses that the battery charge level has dropped below a pre-selected level.

t s With reference to FIG. 3, the imaging engine 310 includes a lens assembly 302 having

C

1 a least one lens for focusing light incident on a photo sensor, where the lens assembly 302 is mounted on a lens guidance assembly 303, and having a lens adjustment mechanism 304 for In moving at least one lens of the lens assembly 302 along the lens guidance assembly 303 for changing the focal length of the lens assembly 302. Lens adjustment mechanism 304 is operatively connected to the lens assembly 302 for moving one or more optical lenses of the

C

.I lens assembly 302 along the lens guidance assembly 303. The lens adjustment mechanism 304 may be located within the imaging engine 310 or external to the imaging engine 310.

The imaging engine 310 further includes circuitry for capturing an image 306, including circuitry for photo sensing, analog-to-digital conversion, timing generation, automatic gain control (AGC) and peripheral circuits to control the above components. The circuitry for capturing an image 306 includes an area based image sensor 308, preferably, a charge coupled-device (CCD). In other embodiments, the image sensor 308 may be a CMOS device, a CMD (charge modulated device) or a CID (charge injection device) sensor. As the at least one lens of the lens assembly 302 is moved along the lens guidance assembly 303, the image 306 is focused on the image sensor 308.

In a first embodiment of the optical code reader, distance to a targeted optical code or indicia is determined using a collimated aiming pattern produced by an illumination source.

The collimated aiming pattern is reflected from the targeted indicia to the image sensor.

Distance to the targeted indicia can then be determined using the angle of reflection of the collimated aiming pattern incident on the target.

FIGs. 4a and 4b illustrate a representation of the embodiment of this method. FIG. 4a uses two laser beam sources 401 while FIG. 4b depicts a version using a pattern generator -11- 409. In this embodiment, a beam 405a produced by laser diodes 401 of an illuminative assembly is emitted from a housing 406 of a code reader towards a targeted indicia 402a.

Subsequently, the incident beam 405a is reflected by the indicia to form a reflected beam 405b. The reflected beam 405b returns to the housing 406, passes through an objective lens 407 and strikes portions of a detector 403, i.e. a photodetector in an array or CCD cell. A processor 404 correlates the size of the activated region of the detector 403 with distance data stored within a lookup table as the exemplary lookup table shown below. The algorithm used to derive the data below is:

P

Z Z sS Where: Z is the distance from laser 401 to target 402 Z, is the distance from Lens 407 to sensor 403 P is the separation of the two beams (in FIG. 4a) or size of the pattern (in FIG. 4b) S is the height of the pattern on the sensor 403 The distance data can then be converted to a form useable for controlling by the processor 404 the associated automatic focusing optics assembly 408 for focusing the image on the detector 403, as described above with respect to the lens adjustment mechanism 304 shown by FIG. 3.

Lookup Table Size Distance 1 12 2 6 3 4 4 3 12- A second embodiment utilizes the speckle patterns produced by the speckle effect to

C

determine distance. The speckle effect is an observed phenomenon of laser light illuminating t s a rough surface causing interference within the scattered light. The speckle effect, as its name

C

implies, produces a speckle pattern having bright and dark regions as a result of the 5 interference. As the image sensor is moved away from the surface the speckles grow in size l and merge with one another.

C¢€

The resulting change in spatial distribution frequency of the speckles in relation to the distance is used to determine the distance to the targeted indicia as illustrated in FIG. 5. An

C

image sensor 603 detects the speckle pattern produced by a laser 601 illuminating the indicia 602. The speckle pattern data is relayed to an image processor 604 for analysis of the spatial distribution frequency. Once the spatial distribution frequency is determined, a corresponding distance value can be retrieved from a lookup table containing predetermined paired frequency-distance data, as the exemplary lookup table shown below, stored in a memory 605 of the code reader. The distance data is derived from the equation: Where: p z, is the distance from laser 601 to target 602 7 f is the spatial frequency on the sensor 603 fo l P is the beam diameter A is the wavelength The corresponding distance value is then used by the processor 604 to control an automatic focus optics assembly 608 to control movement of at least one lens of the lens assembly to focus an image impinged on the image sensor 603, as described above with respect to the lens adjustment mechanism 304 shown by FIG. 3.

-13 Lookup Table Spatial Freq. Distance (Z) 100 25.64 200 12.82 300 8.55 400 6.41 The above described optical code reader utilizes light patterns, such as collimated and speckle patterns, and lookup tables, or other data structures, to determine distance to a targeted indicia and control an automatic focusing assembly, such as the automatic focusing assembly described in co-pending application assigned U.S. Application Serial No.

,10/425,344, the contents of which are incorporated herein by reference. The distance determining components correlate the detected patterns reflected by the targeted indicia with distance values stored in the lookup tables.

The described embodiments of the present invention are intended to be illustrative rather than restrictive, and are not intended to represent every embodiment of the present invention. Various modifications and variations can be made without departing from the spirit or scope of the invention as set forth in the following claims both literally and in equivalents recognized in law.

Claims (9)

1. An assembly for an optical code reader for determining distance to a target, said assembly comprising: a laser beam assembly for emitting at least one collimated beam of light to In illuminate the target; an assembly for detecting a collimated pattern created by the reflection of the collimated beam of light by the target; and a processor for analyzing the detected collimated pattern to determine the distance to the target.

2. The assembly as in claim 1, further comprising an automatic focus optics assembly controlled by the processor for focusing an image of the target in accordance with the determined distance.

3. The assembly as in claim 1, wherein the processor comprises means for measuring a separation between regions on the image sensor of the optical code reader illuminated by the collimated pattern reflected by the target.

4. The assembly as in claim 3, wherein the processor comprises means for correlating the determined separation with the distance to the target.

The assembly as in claim 3, wherein the means for correlating includes a data structure correlating each of a plurality of separation between regions on the image sensor and the collimated pattern with a respective distance to the target. 8X5607-I 0

6. An assembly for an optical code reader for determining distance to a target, said assembly comprising: a radiation assembly for emitting a light to illuminate the target; (N an assembly for detecting a speckle pattern created from light being reflected from the target; and In ¢Cc a processor for processing the detected speckle pattern to determine the distance C I l to the target.

7. The assembly as in claim 6, further comprising an automatic focus optics assembly controlled by the processor for focusing an image of the target in accordance with the determined distance.

8. The assembly as in claim 6, wherein the processor comprises: means for analyzing the detected speckle pattern to determine the speckle spatial distribution frequency; and means for correlating the speckle spatial distribution frequency to a distance to the target, wherein the means for correlating includes a data structure correlating each of a plurality of speckle spatial distribution frequencies to a respective distance to the target.

9. A distance determining method during electro-optical imaging and reading of indicia, comprising the steps of: illuminating the indicia with an incident light beam; detecting a speckle pattern produced by the reflection of the incident light beam by the indicia; and analyzing the detected speckle pattern to determine the distance to the indicia.

885607-1 -16- The method as in claim 9, wherein the step of analyzing comprises the steps of: calculating speckle spatial distribution frequency based on the detected speckle pattern; and correlating the calculated speckle spatial distribution frequency to the distance to the target. 11. An optical system for an optical code reader including an image sensor, said Soptical system comprising: means for automatically focusing an image of an optical code onto the image io sensor; means for determining distance to the optical code by analyzing a pattern produced by the reflection of a radiation signal by the optical code, wherein said pattern is selected from the group consisting of a collimated pattern and a speckle patter; and means for providing at least one control signal to the automatically focusing means to control the focusing means in accordance with the determined distance. DATED this Twenty-sixth Day of July, 2007 Symbol Technologies, Inc. Patent Attorneys for the Applicant SPRUSON FERGUSON 85607- I