JP2011118892A - Optical reading device with color imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain an optical reading device having a color imaging assembly for generating color imaging data at a low price. <P>SOLUTION: An image analysis circuit determines whether an obtained image should be characterized as a color picture or as an image containing a graphical symbol. A processing circuit processes the imaging data based on the determination of whether the image is the graphical symbol or the color picture by the image analysis circuit. A user can obtain and process both a color image and a graphical symbol such as a bar code, text, OCR symbol or signature. The optical reading device is configured also so that the obtained image is associated with at least one other obtained image. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention generally relates to optical readers, and more particularly to an optical reader using a color imaging device.

  Optical mark readers provided for reading one-dimensional or two-dimensional barcode symbols are known in the art. A number of optical character recognition systems are also on the market. In addition, many financial institutions today use computer signature capture systems. Many of these systems use monochrome imaging devices because monochrome imaging devices are very suitable for reading graphical symbols such as bar codes, OCR symbols, or signatures.

  On the other hand, it is very attractive if one apparatus can be provided with an image capturing function as well as reading a mark. At present, an optical reader having an image capture function uses a monochrome imaging device that provides a grayscale image. While such a device is useful, grayscale images are less desirable than color images for visual purposes. The world has come to expect color imaging. In addition, monochrome images are often less clear and contain less information than color images.

  Unfortunately, there are problems associated with reading graphical symbols using a color imaging system. The first problem relates to the difficulty of identifying binary mark in the color image. Because color imaging devices provide more information than can be used with binary mark readers, color imaging data is often confusing for graphical symbol mark readers. One way to solve this problem is to convert color imaging data to grayscale data. However, commercially available methods for converting color images to grayscale are too slow for high volume scanning. Therefore, an optical reader using a color imaging device with a grayscale converter would be slower and more expensive than an optical reader using a monochrome imaging device because additional processing is required.

  Therefore, a need exists for a low cost optical reader that can perform color photography and determine graphical symbols. This optical reader can automatically determine whether the image contains a graphical symbol or is only a color photographic image and must process the color imaging data acquired based on that determination. There is also a need for an optical reader that can associate an acquired color image with any subsequently acquired color image.

  The present invention addresses the aforementioned needs. The present invention relates to a low cost optical reader configured to perform color photography or to determine graphical symbols. The optical reader of the present invention determines whether the captured image is a color photographic image or a color image including a graphical symbol, either automatically or by manual selection. Subsequently, the optical reading device of the present invention processes the acquired imaging data according to the determination. The optical reader of the present invention operates to capture a plurality of images and associate the captured images.

  One aspect of the present invention is an optical reader. The optical reader includes a color imaging assembly that acquires an image of an object and generates imaging data corresponding to the image. An image analysis circuit is coupled to the color imaging assembly. The image analysis circuit is configured to determine whether the color imaging data includes at least one graphical symbol. The image is classified as a graphical symbol, or the image is classified as a color photograph if the color imaging data does not include at least one graphical symbol. A processing circuit is connected to the image analysis circuit. The processing circuit operates to process the imaging data based on the determination.

  In another aspect, the invention comprises an optical reader that captures an image of an object. The optical reader comprises a color imaging assembly that converts the image of the object into color digital data corresponding to the image.

  An automatic mode selection circuit is coupled to the color imaging assembly. The mode selection circuit selects one of a plurality of operation modes of the optical reading device using at least a part of the color digital data. The operation mode includes at least one graphical symbol mode and a color photograph mode. The processing circuit is connected to the mode selection circuit. The processing circuit is configured to process the color digital data based on the selected operation mode.

  In another aspect, the invention comprises an optical reader that captures an image of an object. The optical reader comprises a color imaging assembly that captures the image as color imaging data. A classification circuit is coupled to the color imaging assembly, and the classification circuit is configured to process at least a portion of the color imaging data to select one of a plurality of classifications, so that the image is a color image. Categorized as a photographic image or as an image containing at least one graphical symbol. An automatic mode selector is coupled to the classification circuit, and the automatic mode selector is configured to select an optical reader mode according to the selected classification. A processor is coupled to the classification circuit and is programmed to process the color imaging data according to the optical reader mode selected by the automatic mode selector.

  In another aspect, the invention comprises an optical reader that captures an image of an object. The optical reader includes a color imaging assembly that captures the image as color imaging data. A user mode selector is coupled to the color imaging assembly and is switchable between at least one automatic user mode or a manual user mode for manually selecting one of a plurality of imaging modes of the optical reader. As such, the plurality of imaging modes includes at least one graphical symbol mode and a color photo mode. An automatic imaging mode selector is coupled to the user mode selector and the color imaging assembly and operates to automatically select one of the plurality of imaging modes when in the automatic user mode. A processing circuit is coupled to the user mode selector and the automatic mode selector and is programmed to process the color imaging data based on the selected one of the plurality of operating modes.

  In another aspect, the invention comprises a method for acquiring an image of an object with an optical reader. The method includes obtaining first color imaging data representing the image, and analyzing the color imaging data to provide an image classification so that the image is classified as a color photograph or at least one graphical image. A step classified as including a symbol, and a step of processing the color imaging data according to the image classification.

  In another aspect, the present invention provides a step of obtaining color imaging data and analyzing the color imaging data to provide an image classification, so that the image is classified as a color photograph or the image is at least one image A computer-readable medium having computer-executable instructions for performing a method comprising the steps of categorizing as including graphical symbols and processing the color imaging data according to the image categorization.

  In another aspect, the invention comprises a color imaging assembly that acquires color imaging data and an optical reader having a graphical user interface that includes a display and a selection device. In the optical reader, a method for selecting at least one optical reader operating mode includes displaying at least one icon corresponding to the at least one optical reader operating mode on the graphical user interface; Selecting the at least one optical reader operation mode corresponding to the selected at least one icon by clicking the at least one icon on the selection device; and based on the selected at least one icon And processing the color imaging data to process the color imaging data as a color photographic image or an image including at least one graphical symbol.

  In another aspect, the invention comprises a color imaging assembly that acquires color imaging data and an optical reader having a graphical user interface that includes a display and a selection device. In the optical reader, a method for providing and selecting a menu on the display retrieves a set of menu items for the menu, each of the menu items representing at least one mode of operation of the optical reader. Displaying the set of menu items on the display; selecting a menu item; issuing a menu selection signal indicating a selected operation mode; and selecting the menu item And processing the imaging data to process the imaging data as a color photographic image or an image including at least one graphical symbol.

  In another aspect, the invention includes a method for acquiring an image of an object with an optical reader. The method includes the steps of providing a color imaging assembly, converting the image to color imaging data, classifying the image as a color photograph or a color image including at least one graphical symbol, and according to the classification step. Processing the color imaging data.

  In another aspect, the invention includes a method for acquiring an image of an object with an optical reader. The optical reader has a plurality of imaging modes including at least one graphical symbol mode and a color photographic mode. The method includes capturing the image by acquiring color imaging data, and analyzing the at least a portion of the color imaging data to provide an image category, the image category being at least one graphical symbol category and a color category. Including a photo classification, automatically selecting one of a plurality of image processing modes based on the image classification provided in the analyzing step, and the selected of the plurality of image processing modes And processing the color imaging data based on one.

  In another aspect, the invention comprises a method for acquiring an image of an object with an optical reader. The optical reader has a plurality of imaging modes including at least one graphical symbol mode and a color photographic mode. The method includes capturing the image by obtaining color imaging data, automatically selecting one of the imaging modes based on the analysis of the color imaging data, and the plurality Processing the color imaging data in accordance with a selected one of the imaging modes.

  In another aspect, the invention comprises a system for processing at least one image. The system has at least one network element. The system includes an optical reader having a color imaging device and a processor. The color imaging device is configured to capture the at least one image by generating color imaging data corresponding to the at least one image. The processor is configured to provide a classification of the color imaging data based on whether the color imaging data includes at least one graphical symbol. The processor is programmed to process the color imaging data according to the category. A network is connected to the color optical reader and the at least one network element so that processed image data is transmitted between the network and the at least one network element.

  Additional features and advantages of the invention will be set forth in the detailed description that follows, and in part will be readily apparent to those skilled in the art from that description, or may be apparent from the following detailed description, claims, and appended claims It will be understood that the invention described herein, including the drawings, can be practiced.

  It is understood that both the foregoing general description and the following detailed description are merely examples of the present invention and are intended to provide an overview or framework for understanding the nature and characteristics of the claimed invention. Should be. The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate various embodiments of the invention, and together with the description serve to explain the principles and operations of the invention.

  Reference will now be made in detail to the present embodiments as examples of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. An exemplary embodiment of the optical reader of the present invention is shown in FIG. 1 and is generally designated by the reference numeral 10 throughout.

  In accordance with the present invention, the present invention for an optical reader comprises a color imaging assembly that acquires color imaging data. An image analysis circuit determines whether the acquired image includes at least one graphical symbol. The processing circuit processes the imaging data based on determining whether the image includes at least one graphical symbol. The present invention allows a user to read graphical symbols such as barcodes, text, OCR characters and signatures using a color imaging device. The color optical reader of the present invention is configured to automatically determine whether a color image contains a graphical symbol or is only a color photographic image. The optical reader of the present invention is also operative to associate one acquired image with at least one subsequent acquired image.

  As implemented herein and shown in FIGS. 1A-1D, a perspective view of an optical reader according to various embodiments of the present invention is disclosed. FIG. 1A shows the underside of the handheld wireless optical reader 10. FIG. 1B shows the top surface of the optical reader shown in FIG. 1A. The optical reader 10 includes a housing 100, an antenna 102, a window 104, and a trigger 12. Window 104 houses illumination assembly 20 and imaging assembly 30. As shown in FIG. 1B, the upper surface of the reader 10 includes a function key 14, an alphanumeric keypad 16, and a display 60. In one embodiment, the function key 14 has an enter key and up / down cursor keys. FIG. 1C is also a handheld wireless optical reader 10. The reading apparatus 10 includes a function key 14, an alphanumeric keypad 16, a writing stylus 18, a display 60, and a signature block 62. The stylus 18 is used by the user to write a signature in the signature block 62. FIG. 1D shows yet another embodiment of the optical reader 10 of the present invention. In this embodiment, the reader 10 has a gun-shaped housing 100. The display 60 and the keypad 16 are disposed on the upper surface portion of the gun-shaped housing 100, and the trigger 12 is disposed on the lower surface of the upper surface portion of the housing 100. The housing 100 also includes a window 104 that houses the illumination assembly 20 and the imaging assembly 30. The wire 106 is disposed at the handle tip of the housing 100. Wire 106 provides optical reader 10 with a hardwired communication link for external devices such as a host processor or other data collection device.

  As implemented herein and shown in FIG. 2, a block diagram of the electro-optic assembly of the optical reader 10 of the present invention is disclosed. The optical reader 10 includes an illumination assembly 20 and a color imaging assembly 30 connected to a processor 40. The illumination assembly 20 has illumination optics 22 connected to a light source 24. The light source 24 is connected to the ASIC / FPGA 44. The ASIC / FPGA 44 is programmed to drive the light source 24. The imaging assembly 30 includes an imaging optical component 32 and a color imaging device 34. The imaging optical component 32 converges the irradiation light reflected by the target T on the color imaging device 34. The color imaging device 34 provides color imaging data to the ASIC / FPGA 44. The color imaging device 34 performs several functions. The color imaging device 34 generates an analog color image signal using an imaging array color filter. The array color filter pattern is a Bayer pattern. Analog color imaging data is converted to digital form using an internal analog / digital converter that also functions as a quantizer. In an 8-bit system, 256 luminance levels are obtained, and in a 12-bit converter, 4,000 luminance levels or more are obtained. Digital color imaging data is transmitted from the imaging device 34 to the ASIC / FPGA 44 and the processor 42.

  The optical reader 10 also has a processor 40. In the embodiment shown in FIG. 2, the processor 40 comprises a microprocessor 42 and an ASIC 44. A system bus 52 connects the microprocessor 40, RAM 46, EROM 48, I / O circuit 50, and display 60.

  Illumination optics 22 may be of any suitable type, but as an example, a lens system that directs light from light source 24 toward object T is shown. It will be apparent to those skilled in the relevant art that modifications and variations can be made to the illumination optics 22 of the present invention depending on the target illumination complexity. For example, the illumination optics 22 can comprise one or more lenses, diffusers, wedges, reflectors, or combinations of these elements. In one embodiment, the illumination optics 22 creates an aiming pattern on the object T.

  The light source 24 may be of any suitable type, but a plurality of white light emitting diodes are shown as an example. It will be apparent to those skilled in the relevant art that modifications and changes can be made to the light source 24 of the present invention depending on the application. For example, the illumination assembly 20 may be removed if it is certain that the ambient light level is high enough to obtain a high quality color image. In other embodiments, red light emitting diodes are used instead of white light emitting diodes.

  The color imaging device 34 may be of any suitable type, but as an example, a CMOS color imaging device having a 640 × 480 pixel resolution is shown. It will be apparent to those skilled in the relevant art that modifications and changes can be made to the color imaging device 34 of the present invention, depending on the cost and resolution required by the optical reader 10. In another embodiment, the color imager 34 has 800 × 600 pixels. A typical VGA resolution of 640 × 480 pixels is suitable for displaying a color image on a liquid crystal display or computer monitor. In one megapixel embodiment, the color imager 34 has 1156 × 864 pixels (approximately 1 million pixels). In yet another embodiment, the color imager 34 has 1536 × 1024 pixels. Those skilled in the art will appreciate that as the resolution of the imaging device 34 increases, the cost will increase. In another embodiment, the color imager 34 is implemented by scanning a linear CCD array. In another embodiment, the color imaging device 34 is implemented using an area CCD solid state image sensor.

  The processor 40 may be of any suitable type, but a processor comprising a microprocessor 42 and an ASIC 44 connected to the system bus 52 is shown as an example. In one embodiment, the microprocessor 42 and ASIC are programmable controllers that receive, process and output data according to an embedded program stored in the EROM 48. As described above, the microprocessor 42 and ASIC 44 are connected to the system bus 52 and include address, data and control lines.

  In the embodiment shown in FIG. 2, the microprocessor 42 is a standard VLSI integrated circuit (IC) microprocessor. The microprocessor 42 is assigned to the overall control of the electro-optic component shown in FIG. The processor 42 controls menu operations, commands and data received from the I / O circuit 50, data written to the display 60, and operating system functions. The I / O circuit 50 controls information received from the keypad 14 and the keypad 16. The microprocessor 42 is also responsible for processing and decoding the imaging data stored in the RAM 46 in accordance with programming instructions stored in the EROM 48. Therefore, the microprocessor 42 performs barcode decoding, optical character recognition, signature verification, and color image processing.

  In the embodiment shown in FIG. 2, the ASIC 44 is implemented using a programmable logic array (PLA) device. In a similar embodiment, ASIC 44 is implemented using a field programmable gate array (FPGA) device. The ASIC 44 plays a role of controlling image acquisition processing and storage of image data. As part of the image acquisition process, the ASIC 44 performs various timing adjustments and performs control functions including control of the light source 24, control of the color imaging device 34, and control of the external interface 56. It will be apparent to those skilled in the relevant art that modifications and changes can be made to the processor 40 of the present invention depending on the cost, availability and performance of a standard microprocessor and the type of color imaging device used. In one embodiment, microprocessor 42 and ASIC 44 are replaced with a single microprocessor 40. In one embodiment, microprocessor 40 is implemented using a single RISC processor. In yet another embodiment, the microprocessor 40 is implemented using a RISC and DSP hybrid processor.

  It will be apparent to those skilled in the relevant art that modifications and changes can be made to the memory configuration of the present invention in view of cost and flexibility. For example, in one embodiment, EROM 48 is implemented using EPROM or E2PROM. In yet another embodiment, flash memory is used. The RAM 46 typically includes at least one volatile memory element, and some embodiments have one or more long-term non-volatile memory elements.

  It will be apparent to those skilled in the relevant art that modifications and changes can be made to the I / O device 50 of the present invention depending on the application and working environment. Examples of the I / O device 50 include an RS-232 interface, a LAN interface, a PAN interface, a serial bus such as a USB, an Internet interface, and a wireless interface.

  The external interface 56 is used for transmitting discrete signals and controlling peripheral devices. Typically, the peripheral device is an external illuminator. An external illuminator is used instead of the light source 24.

  It will be apparent to those skilled in the relevant art that modifications and changes can be made to the operating system used in the optical reader 10 depending on the application and the desired operating environment. In one embodiment, a Windows® CE operating system is used. In other embodiments, a LINUX® or Palm0S® operating system is used. As a non-limiting example, an application program can be written using C, C ++, Visual Basic (registered trademark) or Visual C ++ (registered trademark). Other languages can be used depending on the application program. In other embodiments, the optical reader 10 does not use an operating system. For example, the simple reader shown in FIG. 1D does not require a complex operating system.

  As implemented herein and shown in FIG. 3, an example of a graphical user interface according to the present invention is disclosed. The display 60 provides a plurality of application program icons that are displayed on a graphical user interface (GUI) 650. The user selects with the arrow 652. For example, the GUI 650 allows the user to select an automatic image capture mode by clicking on an automatic mode icon 654. The GUI 650 also has a semi-automatic image capture icon 656, a barcode scanning icon 658, an OCR / text capture icon 660, a signature capture mode icon 662, a color photo mode icon 664, an association mode icon 668, and an additional application program icon 666. Application program icon 666 will allow the user to collect other biometric information such as fingerprints and voiceprints. In a Windows® CE environment, a start button icon 670 and a toolbar will also be displayed on the GUI 650. The GUI 650 also displays application program data 672 that is currently being performed.

  In the automatic imaging mode, the processor 40 is programmed to analyze the color imaging data to determine whether the acquired image contains a graphical symbol or is only a color photographic image. If the processor determines that the color image contains a graphical symbol, the processor further analyzes the acquired image and categorizes it as a bar code, OCR symbol, text or signature. Based on that classification, the optical reader 10 jumps to the appropriate routine in the EROM 48. The same applies to the semi-automatic mode. Thus, in automatic or semi-automatic mode, the barcode scanning mode, OCR / text mode, signature capture mode, color photo mode and association mode are controlled by the application program, not by the user.

  However, the user can manually select any of the modes listed above. When the user clicks on the barcode scanning icon 658, the barcode scanning application program will run. In this application program, the user can select between the one-dimensional barcode mode, the two-dimensional barcode mode, or the automatic identification mode. Further, the user can manually select and deselect the type of barcode, and the optical reader 10 can read the barcode or not read the barcode.

  The user can also click on the OCR / text icon 660. Clicking on icon 660 provides the user with a check verification mode, text scan mode, or binary image capture mode. The check verification mode is performed with the network service.

  Clicking on icon 662 provides the user with a signature capture mode. In one embodiment, this mode includes a signature verification program that allows the user to choose between static verification or dynamic verification. In the static mode, the user captures a signature image. The captured image is compared with the verification image stored in the remote database. In the dynamic mode, the optical reader 10 uses a stylus and signature block to capture the signature. In this mode, signature block 62 measures specific dynamic parameters such as applied pressure, direction and timing of movement or a combination of these parameters. Those skilled in the art will appreciate that the above are not all-inclusive but rather representative examples. The captured dynamic parameters are compared with verification data stored in a remote database.

  The user clicks icon 664 to select the color photo mode. With this mode, the user can select an automatic imaging mode in which the optical reader 10 adjusts imaging (for example, exposure) or a manual mode in which the user can arbitrarily adjust settings of the imaging apparatus.

  In another embodiment, display 60 provides the user with a menu listing the main modes of optical reader 10. The user uses the keypad 16 to select a desired mode. Use the cursor keys to highlight one of the modes listed above. When the enter key is pressed, the processor 40 jumps to the appropriate routine stored in the EROM 48. As described above, the user can select between automatic imaging mode, semi-automatic imaging mode, barcode scanning mode, OCR / text mode, signature capture mode, color photo mode or association mode.

  As implemented herein and shown in FIG. 4, a flowchart illustrating the processing flow of an automatic imaging mode according to another embodiment of the present invention is disclosed. After the user pulls the trigger at step 400, the processor reads the selected mode. In this case, the user has selected the automatic mode. The processor initializes the hardware of the optical reading apparatus 10, determines the image data memory space, and initializes the software mode setting. In step 408, the optical reading device 10 acquires an image by acquiring color imaging data. In some embodiments, the processor 40 can display the acquired image on the display 60 during this step. At step 410, processor 40 determines whether the captured image contains a graphical symbol. In one embodiment, processor 40 makes this determination using only a portion of the color imaging data. Since there are more green pixels than red or blue pixels in the Bayer pattern, the processor 40 uses the green pixels to search for a high energy region in the acquired image. For example, high energy such as black and white transition is a good indicator for looking for the presence of graphical symbols such as barcode symbols. A black and white binary image will consist of green pixels in one of two possible value regions. One narrow value region represents the white portion of the image, and the other narrow value region represents the black portion of the image.

  In other embodiments, step 410 is performed considering all pixel values. However, the determination of the pixel value is adjusted based on whether it is a red pixel, a green pixel, or a blue pixel. In other embodiments, processor 40 creates a grayscale image and determines whether the image includes a graphical symbol.

  If at step 410 processor 40 determines that there are no graphical symbols in the image, at step 432 the user is asked if he wishes to store the image. If desired, the color photographic image is stored in memory at step 434. If the processor 40 determines that the image contains a graphical symbol, the process flow moves to step 418. In this step, processor 40 applies a scan line to retrieve the bar code symbol identifier. If processor 40 determines that the graphical symbol is a bar code symbol, it attempts to decode the symbol at step 436. If decoding is successful, the symbol will be a menu symbol or a data symbol. If it is a data symbol, the decoded value of the barcode symbol is output to the display. If it is a menu symbol, the menu routine is executed. This menu symbol is described in more detail below.

  If processor 40 does not find a bar code symbol, it moves to step 420 and looks for an OCR-A or OCR-B character. If the processor finds these characters, optical character recognition is performed at step 422. If not found, the processor determines whether there is text in the image. If the text is found, in steps 428 and 430, the image is cropped and the text is compressed and stored. If the image does not contain text, the processor 40 determines whether the image has a signature. If the signature is present, the image is cropped and the data is compressed and stored at steps 428 and 430. In other embodiments, optical reader 10 is connected to a network and processor 40 communicates with remote network resources to provide a signature verification service. If the processor 40 cannot detect a bar code symbol, OCR symbol, text or signature, at step 432 the user is asked if he wishes to store the image. If desired, the color photographic image is stored in memory at step 434.

  As implemented herein and shown in FIG. 5, a flowchart illustrating the process flow of the semi-automatic mode is disclosed. After the user pulls the trigger at step 500, the processor reads the selected mode, initializes the hardware of the optical reader 10, defines the image data memory space, and initializes the software mode settings. In step 508, the optical reader 10 captures and displays an image.

At step 510, processor 40 determines whether the captured image includes a graphical symbol. Step 510 in semi-automatic mode is the same as step 410 in automatic mode. If the processor 40 determines that the captured image does not contain a graphical symbol, the processor 40 asks the user if he wishes to store a color image. If desired, the color image is stored at step 514. At step 516, a prompt asks the user if he wishes to associate the color image with another image. This step is not performed in automatic mode. If the user gives an affirmative answer in step 518, the association is made and the process flow returns to step 508.

  In steps 520, 522, 526, and 532, the user is given the opportunity to select the type of graphical imaging to be performed. The method of performing OCR, text capture, signature capture and / or verification has been described above in the description of the automatic mode, with one difference. In semi-automatic mode, at step 538, the user is asked if he wishes to associate the processed image with a subsequent captured image. If desired, the process flow returns to step 508 to capture and display another image. This association function can be used several times to associate multiple images.

  If the user indicates that it is a barcode, an attempt is made to decode the symbol at step 540. Referring back to step 540, if the decoding attempt is successful, at step 544 the processor 40 determines whether this symbol is a menu symbol. If it is not a menu symbol, the processor 40 displays the decoded barcode information on the display 60. If it is a menu symbol, at step 546 processor 40 executes the appropriate menu routine. In steps 552 through 564, if the trigger is being pulled, processor 40 can continue to capture images. At step 562, the user is asked if he wants to associate the decoded barcode with another image. If desired, program flow returns to step 508 to capture and display another image. The processor 40 associates this image with the decoded barcode information.

  As implemented herein and shown in FIGS. 6A-6C, a graphical representation of menu symbols used in the barcode processing flow shown in FIGS. 4 and 5 is disclosed. The decoded menu symbol includes a menu word 600 having the format shown in FIG. 6A. The menu word 600 has a 1-byte manufacturing ID code 600-1 and identifies the type and model of the optical reader. A field 600-2 of the word 600 specifies an OP code. The OP code is shown in FIG. 6C. The OP code 0 indicates a vector processing operation listed as A1-A4 in FIG. 6C. Vector processing allows the user to download valid codes, parameter tables, or current software to an external device. OP codes 1-7 allow the user to modify certain parts of the parameter table. These OP codes are used together with the offset field 600-3 and the data fields 600-4 to 600-7. The offset field 600-3 is an index related to the base address of the parameter table in memory that identifies the exact location in the parameter table. Data fields 600-4 through 600-7 are used to specify a bit mask indicating which bits are to be modified. FIG. 6B shows a second important group of options. For example, the operation mode of the reading device is included in F1-F6. These options are the same as the icons displayed on the GUI 650 in FIG. Offset field 600-3 corresponds to other optical reader 10 options as shown.

  As implemented herein and as shown in FIG. 7, a flowchart illustrating a method of reading a bar code according to yet another embodiment of the present invention is disclosed. In step 700, the processor 40 refers to the parameter table stored in the EROM 48. Specifically, the processor 40 determines whether the parameter table is programmed to perform one-dimensional decoding. When the parameter table enables one-dimensional processing, one-dimensional automatic identification is performed. The parameter table defines parameter values that determine the operation mode of the reader. Examples of these parameters include the size and frame rate of a color imaging device, a code that is valid at the time of barcode decoding, an I / O communication protocol, and an OCR option. If the one-dimensional decoding is successful, the decoded data is stored or displayed according to the parameter table settings. If the one-dimensional code is invalid or the one-dimensional decoding is not successful, the processor moves to step 708. In this step, the processor 40 determines whether there is a valid two-dimensional code. If the parameter table invalidates all of the two-dimensional codes, the processor 40 ends the barcode decoding routine. If the two-dimensional code is enabled, two-dimensional automatic identification is performed at step 710. If the decoding is successful, the decoded data is stored or output according to the parameters stored in the parameter table. If the decoding is not successful, the processor ends this routine.

  As implemented herein and illustrated in FIG. 8, a flowchart is disclosed that illustrates a method for performing one-dimensional automatic identification in step 702 of FIG. At step 800, the processor 40 calculates the activity of the selected image data element. Activity is defined as a measure of the rate of change of image data in a small two-dimensional portion of the area surrounding the selected data element. In one embodiment, activity is calculated along two arbitrarily chosen directions that are orthogonal to each other. Two directions orthogonal to each other are used because the direction of the symbol is not known. At step 802, processor 40 looks for a “high activity” area. These high activity areas are called candidate symbol areas (CSR). A high activity area indicates a transition from a black area to a white area or vice versa. If there are more than two CSRs, it probably indicates that there are more than one barcode symbol. At step 804, processor 40 selects the maximum CSR. In step 806, the processor 40 calculates the center of mass of the maximum CSR. Next, the processor 40 determines the direction of the highest activity with the maximum CSR. In a one-dimensional barcode, this will be the direction perpendicular to the direction of the bar. At steps 810 and 812, the processor defines the first scan line (SC = 0) as the scan line that bisects the bar code center of mass. The processor calculates the luminance value of the sampling point along the first scan line. In step 816, these luminance values are converted to digital data. In the decoding step 818, the processor 40 applies the one-dimensional decoding program one after another. If the decoding is not successful, the processor 40 checks whether the entire CSR has been scanned. If the entire CSR has not been scanned, a new scan line is established and the decoding process is repeated. If the entire CSR has been scanned at step 822 and there are no remaining CSRs to be decoded, the processor 40 ends this routine. If one-dimensional decoding is successful at step 820, the processor 40 determines whether this symbol is a one-dimensional stack symbol. If this symbol is a one-dimensional stacked symbol, the processor 40 scans and decodes the remaining CSR as a stacked symbol. If not, the decoded one-dimensional data is stored or output to the display 60 at step 830. At step 838, processor 40 determines whether there is an unexamined area. If there are unexamined regions, the decoding process is repeated. If there is no unexamined area, the processor 40 ends this routine.

  As implemented herein and shown in FIG. 9, a flow chart illustrating a method for two-dimensional automatic identification is disclosed. At step 900, processor 40 converts the image data into a binary binary format. At step 902, processor 40 searches through all 2D finder patterns and identifies them by type. Examples of the pattern type include a bulls-eye type pattern, a waistband type pattern, and a peripheral pattern. If the number of finder patterns is 0, the processor 40 ends this routine. If there is a finder pattern, the processor 40 searches for the finder pattern closest to the center of the field of view in an embodiment of the invention. The option of selecting the one closest to the center is advantageous in that the image located in the center is probably a symbol. At step 908, processor 40 attempts to decode the symbol according to the finder type. For example, the Aztec two-dimensional matrix symbol uses a bullseye finder pattern. The DataMatrix symbol uses a peripheral finder pattern. If the decryption is successful, the decrypted data is stored or displayed. At step 914, processor 40 determines whether there are other unused finder patterns. If there are unused finder patterns, the symbols corresponding to these unused patterns are decoded and the above steps are repeated. If there is no unused pattern, the processor 40 ends this routine.

  As implemented herein and shown in FIG. 10, a flowchart is disclosed that illustrates a method for reading text in accordance with yet another embodiment of the present invention. This routine can be accessed in a number of ways as described above. In step 1000, a bitmap image of the page is created. In step 1002, the bitmap image is sampled. In one embodiment, this is done by analyzing every Nth scanline of the bitmap image. The value of this integer N is determined by the resolution of the scanned image. In one embodiment, the image is sampled every 1/40 inch. This provides sufficient resolution to search and categorize different areas of the page. By sampling every 1/40 inch instead of every scan line, the processing and memory requirements of the reader 10 are greatly reduced. At step 1004, the processor 40 identifies page features. The processor 40 analyzes the page and divides it into a blank part and a non-blank part. Non-blank portions are analyzed to distinguish between text and non-text areas. After confirming the page layout, the processor 40 determines the degree of distortion using the transition between white and black. In step 1008, a horizontal white space is identified to split the line of text. In step 1010, individual words and characters are separated by identifying a vertical white space within each line of text. In step 1014, a character recognition algorithm is used in an attempt to recognize each individual character. Finally, at step 1016, processor 40 formats the restored text before storing the text in memory.

  As implemented herein and as shown in FIG. 11, a flowchart illustrating a method for performing OCR in accordance with yet another embodiment of the present invention is disclosed. In step 1100, the reader 10 generates a pit map image of the page. Subsequently, the processor 40 locates lines of text in the image, searches for white spaces in each line, and separates characters. In step 1108, the processor 40 performs OCR-A or OCR-B character recognition as desired. The decrypted character is stored in the memory.

  As implemented herein and as shown in FIG. 12, a flowchart is disclosed illustrating a method for associating successive images taken with the color optical reader of the present invention. This method corresponds to the icon 668 displayed on the GUI 650 of FIG. If icon 668 is not clicked, processor 40 assumes that reader 10 is not operating in the association mode. Accordingly, the processor 40 will process a single image. When the reader 10 is in the association mode, the processor 40 initializes the counter CNTR. At step 1206, processor 40 processes the first captured image. At step 1208, if CNTR is less than or equal to 2, processor 40 processes image N and associates image N with the first image. At step 1216, CNTR is incremented by one. If CNTR is greater than 2 (step 1208), that is, if at least two images have already been associated, processor 40 asks the user if he wishes to associate another image. If so, the process flow returns to step 1212. If not, the processor 40 ends this routine.

  As implemented herein and shown in FIG. 13, an example of image association according to the present invention is disclosed. Those skilled in the art will appreciate that the associated image 1300 can be placed on paper, displayed electronically on the display 60, or displayed electronically using other electronic means such as a computer monitor. Will. In this example, the captured first image is a color photograph 1302 showing a damaged parcel. The captured second image is a bar code 1304 attached to the side of the damaged parcel. The processor 40 decodes the barcode 1304 and associates the decoded barcode data 1306 with the color photograph 1302. In this example, the user has chosen to associate a third image, signature 1308. Therefore, according to the record 1300 seen by the staff, the damaged parcel is delivered to the company XYZ and it is reasonable that the person signing the parcel delivery is a person named John W. Smith. Can be judged.

  As implemented herein and shown in FIG. 14, a perspective view of a wireless color optical reader network 1400 according to another embodiment of the present invention is disclosed. Network 1400 includes an N-cordless optical scanner 10 connected to base terminal 202 by wireless link 18. Base terminal 202 is connected to host computer 206 by communication link 204. The cordless optical reader 10 is of the type described above. It has an antenna 102, keypads 14 and 16 and a display 60. The wireless control device is included in both the optical scanner 10 and the base terminal 202. It will be apparent to those skilled in the relevant art that the wireless controller may be of any suitable type, but as an example, the wireless controller 30 may provide a frequency hopping spectrum between the scanner 10 and the base terminal 202. Provides spread (FHSS) communication. FHSS is a type of spread spectrum wireless transmission that generates a narrowband signal that hops between a plurality of frequencies in a predetermined pattern. FHSS is often used in commercial environments because it can minimize errors due to interference and interference. However, those skilled in the art will appreciate that the optical scanner 10 and base terminal 202 can communicate using other wireless schemes and other modulation formats based on user requirements and environmental factors. The base terminal 202 has an antenna 208 and is used to send and receive messages from the optical scanner 10. The antenna 208 is connected to a radio control device arranged in the terminal 202. The base terminal 202 also has an I / O card, a base terminal processor, and a base terminal memory. The I / O card of the base terminal 202 is connected to the radio control device and the communication link 204.

  As implemented herein and shown in FIG. 15, a flowchart is disclosed that illustrates a method for transmitting packetized data from a color optical reader to a base station. In steps 1500 and 1502, the optical reader 10 captures an image and processes the image as described above. At step 1504, the processed image is combined into a packet, whether it is a color image, a decoded barcode, a text file, or signature verification information. In steps 1506 and 1508, a loop is created and packets are sent to the base terminal one by one until all packets are sent.

  As implemented herein and illustrated in FIGS. 16A and 16B, a graphical representation of a packet format in accordance with the present invention is disclosed. In one embodiment of the present invention, each packet can contain approximately 200 bytes of decoded data in a 256 byte packet. Those skilled in the art will appreciate that this is merely exemplary and that the scope of the present invention should not be limited to data packets of a particular size or format. FIG. 16A shows a data packet 1600 used to transmit decoded data from the optical reader to the base terminal when only one data packet is required. The packet 1600 includes an optical reader address field, a sequence number field, a packet length field, an image type field, image data, and an error check field. The optical reader address identifies an individual optical reader. Each packet includes a sequence number located in the second field. The next field contains the length of the image data field. After this, the packet contains a field that identifies the type of image processed. After the image type, the image data payload of the packet is inserted. Finally, the packet 200 includes an error check field.

  FIG. 16B shows a header packet 1602 and a data bucket 1604 that are used to transmit decoded data from the optical scanner to the base terminal when more than one data packet is required. If more than one packet is required, the reader 10 first transmits a header packet 1602. After the base terminal 202 responds that it can process the remaining packets, the reader 10 transmits the remaining packets 1604. If the base terminal 202 cannot process the remaining packets 1604 or there are other problems, the base terminal 202 will transmit an application packet to the scanner 10 indicating an error. The definitions of the scanner address field, sequence number field, symbol type, length, symbol data, and error check field have been described above and will not be repeated. The header packet 1602 also has a header identification field, which identifies this packet as a header packet. In the next field, the packet 1602 has a total length field, which stores the total length of data included in the decoded symbol. The next field contains the total number of packets in the message. The second field from the end is the packet number. In this header packet, this number is indicated as a packet number “1”. The remaining packets 1604 also have a packet number field and are incremented from 2 to N depending on the total number of packets being transmitted in the message.

  Packet 1600, packet 1602, and packet 1604 as described above may be of any suitable type, and these are representative examples that represent one embodiment of the present invention. Those skilled in the art will appreciate that packets may be implemented in various ways.

  As implemented herein and shown in FIG. 17, a flowchart is disclosed that illustrates a method for performing signature verification. In step 1700, the optical reader 10 captures an image of a document to generate a bitmap of the image. One skilled in the art will appreciate that in automatic or semi-automatic mode, the processor 40 determines that the image object is a graphical symbol in subsequent steps. Step 1202 is the same as steps 1002 and 1004 in FIG. The image is sampled by analyzing every Nth scanline of the bitmap image. As mentioned above, the image must be scanned in such a way that a sufficient resolution is obtained to locate and categorize the various areas on the document. In the case of checks, the position of the various fields on the certificate is relatively standardized. Although the check dimensions will vary somewhat, the check number, bank code, account number, date, signature block, etc. are in the same relative position for each check. At step 1704, document data such as name, check number, bank code, account number, date, etc. is extracted from the document using any OCR program and stored in memory. At step 1706, a handwritten image of the signature block is captured.

  Steps 1708 and 1710 are performed using the wireless system 1400 described above. In other embodiments, these steps are performed by a wired system. For example, in one embodiment, the optical reader 10 is connected to a host computer via an RS-232 or USB link. In another embodiment, the optical reader 10 is connected to a host computer via a LAN. One skilled in the art will appreciate that the present invention should not be construed as limited by these examples.

  At steps 1712 and 1714, processor 40 initializes the counter and begins waiting for a response from the host computer. In steps 1714-1718, if the response is not received within the time limit TL, the counter CNTR is incremented and the message is retransmitted. After several attempts, if CNTR> N (N is an integer), the processor 40 outputs a fault message. If the response message is received within the time limit TL, at step 1722 the processor determines the response. If the extracted data and signature match the information stored in the database accessible by the host computer, a permission message is displayed. If the extracted data and signature do not match the information stored in the database accessible by the host computer, a disapproval message is displayed. The embodiment of the dynamic signature verification is the same as the static embodiment just described. In dynamic, the user provides a signature using the stylus 18 and signature block 62 as shown in FIG. 1C. Signature block 62 provides processor 40 with dynamic parameters that are recorded at the time of signing. The dynamic parameters are transmitted to the host computer as described above.

  As implemented herein and shown in FIG. 18, an example of a color optical reader network 1800 according to the present invention is disclosed. The network 1800 includes a wireless system 1400, a personal computer 1802, an optical reader 10, a LAN 1820, a network service center 1830, and a personal area network (PAN), all connected via the network 1810.

  One skilled in the art will appreciate that the network 1810 may be of any suitable type depending on the application, but the Internet is shown as an example. However, the present invention should not be construed as limited to this example. In other embodiments, network 1810 is a private network. One skilled in the art will also appreciate that network 1810 is a wired network in some embodiments and a wireless network in other embodiments. Network 1810 may include a circuit switched network, an IP network, or both.

  The LAN 1820 includes a server 1822, a computer 1824, a database 1826, and a plurality of optical reading devices 10. Database 1826 is used to store the associated image along with other data fields. For example, it would be quite useful to store additional information with the associated image shown in FIG. Some people may want to relate delivery means, routes, drivers and other relevant information for subsequent analysis. Network 1810 authorizes reader 10, PAN 1850, and wireless system 1400 to store such data in database 1826. A system analyst can access this information via a personal computer 1802 connected to the network 1810. In one embodiment, LAN 1820 includes an Internet website. In this example, the user obtains access to database 1826 after being authenticated.

  The network service center 1830 is connected to the network 1810 via the interface 1844. The center 1830 also includes a server 1832, a computer 1834, a database 1836, a signature verification module 1838, and an authentication module 1840, all of which are connected via a LAN. Center 1830 houses any number of useful application programs 1842.

  The PAN 1850 has at least one color optical reader 10 connected to a point of sales (POS) terminal 1854. The POS terminal 1854 is connected to the network 1810 via the interface 182. The POS terminal 1854 has a credit card reader and a signature capture block. In the scenario shown in FIG. 18, the merchant user at POS terminal 1854 transmits the associated customer credit card number, signature, and in one embodiment, the customer's color image to center 1830. An authentication module 1840 is used to authenticate the credit card, and a signature verification module is used to authenticate the signature. In another embodiment, database 1836 is used to store customer images, credit card numbers, and verification signatures.

  It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

It is a perspective view of the various Example of the optical reader of this invention. It is a perspective view of the various Example of the optical reader of this invention. It is a perspective view of the various Example of the optical reader of this invention. It is a perspective view of the various Example of the optical reader of this invention. 1 is a block diagram of an electro-optic assembly of an optical reader according to the present invention. 2 is an example of a graphical user interface display according to the present invention. It is a flowchart which shows the processing flow of the automatic mode by the other Example of this invention. It is a flowchart which shows the processing flow of the semiautomatic mode by other Examples of this invention. It is a flowchart which shows the processing flow of the semiautomatic mode by other Examples of this invention. 6 is an illustration of menu symbols used in the barcode processing flow shown in FIGS. 4 and 5. FIG. 6 is an illustration of menu symbols used in the barcode processing flow shown in FIGS. 4 and 5. FIG. 6 is an illustration of menu symbols used in the barcode processing flow shown in FIGS. 4 and 5. FIG. 6 is a flowchart illustrating a method of reading a barcode according to still another embodiment of the present invention. It is a flowchart which shows the method of the one-dimensional automatic identification by the method shown by FIG. It is a flowchart which shows the method of the two-dimensional automatic identification by the method shown by FIG. 6 is a flowchart illustrating a method for reading text according to still another embodiment of the present invention. 6 is a flowchart illustrating a method for performing OCR according to still another embodiment of the present invention. 6 is a flowchart illustrating a method for associating consecutive images taken with the color optical reader of the present invention. It is an example of the image correlation by this invention. FIG. 6 is a perspective view of a wireless color optical reader according to still another embodiment of the present invention. 6 is a flowchart illustrating a method of transmitting packetized data from a color optical reader to a base station. FIG. 6 is a diagram illustrating a packet format according to still another embodiment of the present invention. FIG. 6 is a diagram illustrating a packet format according to still another embodiment of the present invention. 6 is a flowchart illustrating a method for performing signature verification according to still another embodiment of the present invention. Figure 2 is an illustration of a color optical reader network application according to the present invention.

Claims (15)

A handheld device consisting of:
2D imager;
An imaging optical element that focuses the reflected light from the object onto the two-dimensional imager;
A processor communicatively coupled to the two-dimensional imager;
memory;
An actuator for manually initiating image acquisition, wherein the handheld device is responsive to the actuator being actuated by a user, the handheld device obtains an image for processing, wherein the handheld device And the image is adapted to contain imaging data; and wherein the handheld device further comprises the process comprising:
(1) processing the image according to a first process, wherein the result of the first process indicates whether a symbol is in the image; and
(2) performing a storage process for conditionally storing the image in the memory under a condition that the result of the first process indicates that a symbol is not in the image;
Is adapted to include.   The hand-held device according to claim 1, wherein the two-dimensional imager is a two-dimensional color imager, the image is a color image, and the imaging data includes color imaging data.   3. The handheld device according to claim 1 or 2, further comprising: (a) decoded information corresponding to the symbol in response to a processing step indicating that a symbol is in the image. A hand-held device that is adapted to operate.   3. The handheld device according to claim 1, 2, or 2, wherein the handheld device stores the image in the memory for performing the storage process.   5. The handheld device according to claim 1, 2, 3, or 4, wherein the handheld device requests a user to indicate whether or not the image should be stored in order to perform the storage process. A hand-held device that stores the image in the memory in response to an instruction by the user that the image should be stored.   6. The handheld device according to claim 2, 3, 4, or 5, wherein the handheld device operates to decode a barcode using the color imaging data.   7. The handheld device according to claim 1, 2, 3, 4, 5, or 6, wherein the first process includes determining whether the image is a two-tone image.   8. The handheld device according to claim 1, 2, 3, 4, 5, 6, or 7, wherein the first process includes detecting a bar code. A method consisting of:
Acquiring a first color image using a handheld device;
Obtaining a second color image using the handheld device, the second color image including an indication of an optical index;
Decoding the optical index using the second color image to generate decoded data;
Associating the decoded data with the first color image so that the decoded data and the first color image are electronically correlated with each other;   10. The method of claim 9, wherein the method includes electronically displaying the decoded data along with the first color image.   10. The method of claim 9, wherein the method includes electronically displaying the decoded data along with the first color image on a display of the handheld device.   12. The method according to claim 9, 10, or 11, wherein the acquisition of the second color image is performed following acquisition of the first color image.   12. A method according to claim 9, 10 or 11, wherein the first color image and the second color image correspond to different fields of view of a common matter.   14. The method of claim 9, 10, 11, 12, or 13, wherein the first color image is a delivery packet and the second color image is included on the delivery packet. A method that is an optical indicator display.   15. The method of claim 9, 10, 11, 12, 13, or 14, further comprising counting the number of color images acquired and presenting a prompt to the user in response to the count. Including.

Images