US20140353372A1 - Smart scanning system - Google Patents

Smart scanning system Download PDF

Info

Publication number
US20140353372A1
US20140353372A1 US14/449,355 US201414449355A US2014353372A1 US 20140353372 A1 US20140353372 A1 US 20140353372A1 US 201414449355 A US201414449355 A US 201414449355A US 2014353372 A1 US2014353372 A1 US 2014353372A1
Authority
US
United States
Prior art keywords
image
item
system
barcode
identity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/449,355
Inventor
II Jonathan H. Connell
Myron D. Flickner
Norman Haas
Thomas J. Hammershoy
Arun Hampapur
Sharathchandra U. Pankanti
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Global Commerce Solutions Holdings Corp
Original Assignee
Toshiba Global Commerce Solutions Holdings Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US11/756,391 priority Critical patent/US8794524B2/en
Application filed by Toshiba Global Commerce Solutions Holdings Corp filed Critical Toshiba Global Commerce Solutions Holdings Corp
Priority to US14/449,355 priority patent/US20140353372A1/en
Publication of US20140353372A1 publication Critical patent/US20140353372A1/en
Assigned to TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORATION reassignment TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HAMMERSHOY, THOMAS J., HAMPAPUR, ARUN, FLICKNER, MYRON D., HAAS, NORMAN, CONNELL, JONATHAN H., II, PANKATI, SHARATHCHANDRA U.
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00Cash registers
    • G07G1/0036Checkout procedures
    • G07G1/0045Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G07G1/0054Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles
    • G07G1/0063Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K5/00Methods or arrangements for verifying the correctness of markings on a record carrier; Column detection devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/0004Hybrid readers
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10544Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
    • G06K7/10554Moving beam scanning
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10544Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
    • G06K7/10821Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/20Image acquisition
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/62Methods or arrangements for recognition using electronic means
    • G06K9/6288Fusion techniques, i.e. combining data from various sources, e.g. sensor fusion
    • G06K9/6292Fusion techniques, i.e. combining data from various sources, e.g. sensor fusion of classification results, e.g. of classification results related to same input data
    • G06K9/6293Fusion techniques, i.e. combining data from various sources, e.g. sensor fusion of classification results, e.g. of classification results related to same input data of classification results relating to different input data, e.g. multimodal recognition

Abstract

The present invention provides a smart scanning system comprising an integrated scanning and image capture system in which one or more image capture device(s) (e.g., still camera, video camera, etc.) and a barcode scanner are positioned within a common enclosure that is a component of a checkout station. The barcode of item is scanned and an image of the item is recorded. The identity of the item as determined based on the barcode is compared to its appearance as determined based on its image. If the identity is inconsistent with its appearance, a discrepancy is registered. It is then determined whether the discrepancy is due to fraud (e.g., theft) or device error. In the case of the latter, the system can be updated to prevent a repeat of the error.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation application of, and claims priority to, U.S. application Ser. No. 11/756,391, filed on May 31, 2007, which is hereby incorporated by reference in its entirety.
  • FIELD OF THE INVENTION
  • The present invention generally relates to a smart scanning system. Specifically, the present invention relates to an integrated system in which a barcode scanner and an image capture device (e.g., image capture device) are commonly contained/housed/positioned.
  • BACKGROUND OF THE INVENTION
  • Marketplace security has become a rising concern over recent years. Security and anti-theft concerns have only increased with the pervasiveness of scanners at checkout stations. It has become increasingly frequent for perpetrators to switch and/or alter barcodes so that an item can be obtained for a cheaper price. In addition, many retailers also utilize image capture devices to catch shop lifters. Unfortunately, current placement of image capture devices is either awkward, or of little use during the checkout process. Any current placement of image capture devices near checkout stations inevitably places them in the way of customer's arms, heads or bodies, creating opportunities for collisions, with damage to the person and/or the image capture devices. It also creates problems for the store, with regard to cleaning, theft, camera occlusions, etc.
  • In view of the foregoing, there exits a need for a solution that solves at least one of the above-referenced deficiencies in the related art.
  • SUMMARY OF THE INVENTION
  • In general, the present invention provides a smart scanning system comprising an integrated scanning and image capture system in which one or more image capture device(s) (e.g., still camera, video camera, etc.) and a barcode scanner are positioned within a common enclosure that is a component of a checkout station. The barcode of item is scanned and an image of the item is recorded. It is then determined whether the identity of the item as determined based on the barcode is consistent with its appearance as determined from the image. If not, a discrepancy is registered. It is then determined whether the discrepancy is due to fraud (e.g., theft) or device error. In the case of the latter, the system can be updated to prevent a repeat of the error.
  • A first aspect of the present invention provides a smart scanning method, comprising: receiving a scan of a barcode of an item via an integrated scanning and image capture system; determining an identity of the item based on the barcode; capturing of an image of the item via the integrated scanning and image capture system; and determining whether the identity is consistent with an appearance of the item as determined from the image.
  • A second aspect of the present invention provides a smart scanning system, comprising: a module for receiving a scan of a barcode of an item, the barcode being scanned via an integrated scanning and image capture system; a module for determining an identity of the item based on the barcode; a module for receiving of an image of the item, the image being captured via the integrated scanning and image capture system; a module for determining an appearance of the item based on the image; and a module for determining whether the identity is consistent with the appearance.
  • A third aspect of the present invention provides an integrated scanning and image capture system, comprising: a barcode scanner for scanning a barcode of an item; an image capture device for capturing an image of the item, the barcode scanner and the image capture device both being positioned within a common enclosure.
  • A fourth aspect of the present invention provides a program item stored on a computer readable medium for smart scanning, the computer readable medium comprising program code for causing a computer system to: receive a scan of a barcode of an item via an integrated scanning and image capture system; determine an identity of the item based on the barcode; capture of an image of the item via the integrated scanning and image capture system; and determine whether the identity is consistent with an appearance of the item as determined from the image.
  • A fifth aspect of the present invention provides a method for deploying a smart scanning system, comprising: providing a computer infrastructure being operable to: receive a scan of a barcode of an item via an integrated scanning and image capture system; determine an identity of the item based on the barcode; capture of an image of the item via the integrated scanning and image capture system; and determine whether the identity is consistent with an appearance of the item as determined from the image.
  • A sixth aspect of the present invention provides computer software embodied in a propagated signal for smart scanning, the computer software comprising instructions for causing a computer system to: receive a scan of a barcode of an item via an integrated scanning and image capture system; determine an identity of the item based on the barcode; capture of an image of the item via the integrated scanning and image capture system; and determine whether the identity is consistent with an appearance of the item as determined from the image.
  • A seventh aspect of the present invention provides a data processing system for smart scanning, comprising: a memory medium having instructions; a bus coupled to the memory medium; and a processor coupled to the bus that when executing the instructions causes the data processing system to: receive a scan of a barcode of an item via an integrated scanning and image capture system; determine an identity of the item based on the barcode; capture of an image of the item via the integrated scanning and image capture system; and determine whether the identity is consistent with an appearance of the item as determined from the image.
  • An eighth aspect of the present invention provides computer-implemented business method for smart scanning, comprising: receiving a scan of a barcode of an item via an integrated scanning and image capture system; determining an identity of the item based on the barcode; capturing of an image of the item via the integrated scanning and image capture system; and determining whether the identity is consistent with an appearance of the item as determined from the image.
  • Any of these aspects can include one or more of the following additional aspects: register a discrepancy if the identity is inconsistent with the appearance; determine whether the discrepancy is either an error or fraud; update the integrated scanning and image capture system to prevent the error from being repeated; provide a notification of the discrepancy, the notification being at least one of a visual notification and an audible notification.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and other features of this invention will be more readily understood from the following detailed description of the various aspects of the invention taken in conjunction with the accompanying drawings in which:
  • FIG. 1 depicts smart scanning system according to the present invention.
  • FIG. 2 depicts an item before being processed by the smart scanning system of FIG. 1 according to the present invention.
  • FIG. 3 depicts an item after being processed by the smart scanning system of FIG. 1 according to the present invention.
  • FIG. 4 depicts a more specific computerized implementation according to the present invention.
  • The drawings are not necessarily to scale. The drawings are merely schematic representations, not intended to portray specific parameters of the invention. The drawings are intended to depict only typical embodiments of the invention, and therefore should not be considered as limiting the scope of the invention. In the drawings, like numbering represents like elements.
  • DETAILED DESCRIPTION OF THE INVENTION
  • For convenience, the Detailed Description of the Invention has the following Sections:
  • I. General Description
  • II. Computerized Implementation
  • I. General Description
  • As indicated above, the present invention provides a smart scanning system comprising an integrated scanning and image capture system in which one or more image capture device(s) (e.g., camera) and a barcode scanner are positioned within a common enclosure that is a component of a checkout station. The barcode of item is scanned and an image of the item is recorded. The identity of the item as determined based on the barcode is compared to an appearance of the item as determined based on its image. If the two are inconsistent, a discrepancy is registered. It is then determined whether the discrepancy is due to fraud (e.g., theft) or device error. In the case of the latter, the system can be updated to prevent a repeat of the error.
  • The integrated device of the present invention should not result in an increase of volume of the enclosure of previous systems that houses only barcode scanners. The enclosure of the present invention protects the image capture device(s) from collision, theft, dust and dir, water and similar fluids, etc. The image capture device(s) are generally located and oriented so that (1) they fit inside the small, already-somewhat-full space, (2) they are pointed in such a way that they can usefully see the desired field of view, and (3) they do not interfere with the optical paths required by the pre-existing barcode scanner light source, mirrors, and reflected light intensity sensor. In addition, they do not require increasing the dimensions of glass used, so that no additional risk of glass breakage is incurred.
  • Referring now to FIG. 1, a smart scanning system 10 according to the present invention is shown. In general, smart scanning system 10 comprises an integrated scanning and image capture system. Specifically, smart scanning system 10 includes at least one barcode scanner 12A and/or 12B, at least one image capture device(s) 14 (e.g., a still image camera, a video camera, etc.), and barcode scanning and image processing software. At least one barcode scanner 12A and one image capture mechanism 14 of smart scanning system 10 are positioned within a common enclosure 19.
  • Image capture device(s) 14 is placed behind shield 17 (glass, plastic, etc.) as shown. Where multiple image capture devices 14 are used, one is placed is placed so that one looks out along a path more or less normal to the vertical glass surface of the barcode scanner, and the other looks more or less straight up from below the horizontal surface of the scanner. The latter image capture device is also placed off to one side, so that it is actually under the (e.g., steel) rim surrounding the existing shield 17 in that surface. As such, hole (e.g., 1″ in diameter in an illustrative embodiment) is cut in the steel rim, and covered with a separate, transparent plate. Regardless (as stated above), smart scanning system 10 also includes barcode scanning and image processing software to perform the functions described herein. This software is stored on a memory medium that may or may not be positioned within enclosure.
  • Referring now to FIGS. 2-3, the functions of smart scanning system 10 will be explained. Specifically, a scan of a barcode 18 of an item 16 (e.g., a consumer product) will be received the barcode scanner 12A and/or 12B (shown in FIG. 1). Based on the barcode 18, the barcode scanning software will determine an identity of item 16 (e.g., a bottle of X brand cola). This occurs via known means such as cross-referencing a table of barcode values to product identities.
  • Before, after or simultaneous to the scan of the barcode), an image 20 of item 16 will be captured by image capture device 14 (shown in FIG. 1), and processed to determine an appearance of the item (which should be consistent with the identity as determined based on the scan of barcode 18). The sequence of capturing and processing the image is typically as follows: wait for low motion of item 16; take dark and bright pictures; segment item 16 from background 20, the results of which are shown in FIG. 4; extract at least one visual feature of item 16 and determine the identity based on those visual features. This determination can be based on comparison of the image to an electronic database or library of images associated with corresponding item identities. In addition, the appearance can be as general or as specific as desired. For example, the appearance can be specific so as to identify the item (e.g., a bottle of X brand cola), or it can be more general (e.g., a bottle of cola, or just cola based on the color).
  • Thereafter, smart scanning system 10 will compare the identity of item 16 as determined based on the scan of barcode 18 to the appearance as determined based on the image to determine if the two are consistent with one another. If not, smart scanning system 10 will register a discrepancy and providing a notification of the discrepancy (at least one of a visual notification and an audible notification). Where there is a discrepancy, smart scanning system 10 will then determine to determine whether the discrepancy is either error or fraud. For example, was the barcode tampered with or changed, or as the discrepancy due to device error. Where device error caused the discrepancy, smart scanning system 10 can be updated (e.g., in response to an operator's input) to reflect the true identity of the item and its association with the image just captured.
  • II. Computerized Implementation
  • II. Computerized Implementation
  • Referring now to FIG. 4, a computerized implementation 100 of the present invention is shown. As depicted, implementation 100 includes smart scanning system 10 deployed within a computer infrastructure 102. This is intended to demonstrate, among other things, that the present invention could be implemented within a network environment (e.g., the Internet, a wide area network (WAN), a local area network (LAN), a virtual private network (VPN), etc.), or on a stand-alone computer system. In the case of the former, communication throughout the network can occur via any combination of various types of communications links. For example, the communication links can comprise addressable connections that may utilize any combination of wired and/or wireless transmission methods. Where communications occur via the Internet, connectivity could be provided by conventional TCP/IP sockets-based protocol, and an Internet service provider could be used to establish connectivity to the Internet. Still yet, computer infrastructure 102 is intended to demonstrate that some or all of the components of implementation 100 could be deployed, managed, serviced, etc. by a service provider who offers to implement, deploy, and/or perform the functions of the present invention for others.
  • As shown, smart scanning system 10 includes a processing unit 106, a memory 108, a bus 110, and device interfaces 112. Further, smart scanning system 10 is shown having barcode scanner 12 and image capture device 14 and storage system 116 that communicate with bus via device interfaces (although barcode scanner 12 and/or image capture device 14 alternatively could directly communicate with bus 110). In general, processing unit 106 executes computer program code, such as image processing program 118 and barcode scanning program 122, which are stored in memory 108 and/or storage system 116. While executing computer program code, processing unit 106 can read and/or write data to/from memory 108, storage system 116, and/or device interfaces 112. Bus 110 provides a communication link between each of the components in smart scanning system 10. Although not shown, smart scanning system 10 could also include I/O interfaces that communicate with: one or more external devices such as a cash register, a keyboard, a pointing device, a display, etc.); one or more devices that enable a user to interact with smart scanning system 10; and/or any devices (e.g., network card, modem, etc.) that enable smart scanning system 10 to communicate with one or more other computing devices.
  • Computer infrastructure 102 is only illustrative of various types of computer infrastructures for implementing the invention. For example, in one embodiment, computer infrastructure 102 comprises two or more computing devices (e.g., a server cluster) that communicate over a network to perform the various process of the invention. Moreover, smart scanning system 10 is only representative of various possible computer systems that can include numerous combinations of hardware. To this extent, in other embodiments, smart scanning system 10 can comprise any specific purpose computing article of manufacture comprising hardware and/or computer program code for performing specific functions, any computing article of manufacture that comprises a combination of specific purpose and general purpose hardware/software, or the like. In each case, the program code and hardware can be created using standard programming and engineering techniques, respectively. Moreover, processing unit 106 may comprise a single processing unit, or be distributed across one or more processing units in one or more locations, e.g., on a client and server. Similarly, memory 108 and/or storage system 116 can comprise any combination of various types of data storage and/or transmission media that reside at one or more physical locations. Further, device interfaces 112 can comprise any module for exchanging information with one or more external device 114. Still further, it is understood that one or more additional components (e.g., system software, math co-processing unit, etc.) not shown in FIG. 4 can be included in smart scanning system 10.
  • Storage system 116 can be any type of system capable of providing storage for information under the present invention. To this extent, storage system 116 could include one or more storage devices, such as a magnetic disk drive or an optical disk drive. In another embodiment, storage system 116 includes data distributed across, for example, a local area network (LAN), wide area network (WAN) or a storage area network (SAN) (not shown). In addition, although not shown, additional components, such as cache memory, communication systems, system software, etc., may be incorporated into smart scanning system 10.
  • Shown in memory 108 of smart scanning system 10 is image processing program 118, which a set (at least one) of modules 120. The modules generally provide the functions of the present invention as described herein. Specifically (among other things), set of modules 120 is configured to: receive a scan of a barcode of item 16 via barcode scanner 12; determine an identity of the item based on the barcode; capture of an image of item 16 via image capture device 14; process the image (e.g., segment item 16 from the background, extract visual feature(s) of item 16); determine an appearance the item 16 based on the image; and determining whether the identity is consistent with the appearance; register a discrepancy if the identity is inconsistent with the appearance; determine whether the discrepancy is either an error or fraud; update the integrated scanning and image capture system to prevent the error from being repeated; provide a notification of the discrepancy, the notification being at least one of a visual notification and an audible notification.
  • While shown and described herein as a smart scanning system, method, and program item, it is understood that the invention further provides various alternative embodiments. For example, in one embodiment, the invention provides a computer-readable/useable medium that includes computer program code to enable a computer infrastructure to provide smart scanning. To this extent, the computer-readable/useable medium includes program code that implements each of the various process of the invention. It is understood that the terms computer-readable medium or computer useable medium comprises one or more of any type of physical embodiment of the program code. In particular, the computer-readable/useable medium can comprise program code embodied on one or more portable storage articles of manufacture (e.g., a compact disc, a magnetic disk, a tape, etc.), on one or more data storage portions of a computing device, such as memory 108 (FIG. 4) and/or storage system 116 (FIG. 4) (e.g., a fixed disk, a read-only memory, a random access memory, a cache memory, etc.), and/or as a data signal (e.g., a propagated signal) traveling over a network (e.g., during a wired/wireless electronic distribution of the program code).
  • In another embodiment, the invention provides a business method that performs the process of the invention on a subscription, advertising, and/or fee basis. That is, a service provider, such as a Solution Integrator, could offer to provide smart scanning. In this case, the service provider can create, maintain, and support, etc., a computer infrastructure, such as computer infrastructure 102 (FIG. 4) that performs the process of the invention for one or more customers. In return, the service provider can receive payment from the customer(s) under a subscription and/or fee agreement and/or the service provider can receive payment from the sale of advertising content to one or more third parties.
  • In still another embodiment, the invention provides a computer-implemented method for smart scanning. In this case, a computer infrastructure, such as computer infrastructure 102 (FIG. 4), can be provided and one or more systems for performing the process of the invention can be obtained (e.g., created, purchased, used, modified, etc.) and deployed to the computer infrastructure. To this extent, the deployment of a system can comprise one or more of: (1) installing program code on a computing device, such as smart scanning system 10 (FIG. 4), from a computer-readable medium; (2) adding one or more computing devices to the computer infrastructure; and (3) incorporating and/or modifying one or more existing systems of the computer infrastructure to enable the computer infrastructure to perform the process of the invention.
  • As used herein, it is understood that the terms “program code” and “computer program code” are synonymous and mean any expression, in any language, code or notation, of a set of instructions intended to cause a computing device having an information processing capability to perform a particular function either directly or after either or both of the following: (a) conversion to another language, code or notation; and/or (b) reproduction in a different material form. To this extent, program code can be embodied as one or more of: an application/software program, component software/a library of functions, an operating system, a basic device system/driver for a particular computing and/or device device, and the like.
  • A data processing system suitable for storing and/or executing program code can be provided hereunder and can include at least one processor communicatively coupled, directly or indirectly, to memory element(s) through a system bus. The memory elements can include, but are not limited to, local memory employed during actual execution of the program code, bulk storage, and cache memories that provide temporary storage of at least some program code in order to reduce the number of times code must be retrieved from bulk storage during execution. Input/output or device devices (including, but not limited to, keyboards, displays, pointing devices, etc.) can be coupled to the system either directly or through intervening device controllers.
  • Network adapters also may be coupled to the system to enable the data processing system to become coupled to other data processing systems, remote printers, storage devices, and/or the like, through any combination of intervening private or public networks. Illustrative network adapters include, but are not limited to, modems, cable modems and Ethernet cards.
  • The foregoing description of various aspects of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and obviously, many modifications and variations are possible. Such modifications and variations that may be apparent to a person skilled in the art are intended to be included within the scope of the invention as defined by the accompanying claims.

Claims (14)

We claim:
1. A smart scanning system, comprising:
a scan module which receives a scan of a barcode of an item via a scanning and image capture system;
a barcode module which determines an identity of the item based on the barcode;
a first capture module which captures a first image of an appearance of the item via the scanning and image capture system, wherein the first image includes an image of the barcode; and
a determining module which determines whether the identity is consistent with an appearance of the item as determined from the first image and the second image.
2. The smart scanning system of claim 1, further comprising:
an extract module which extracts a feature of the item from the first image; and
a compare module which compares the extracted feature to an electronic database or library of images associated with corresponding item identity.
3. The smart scanning system of claim 1, further comprising:
a second capture module which captures a second image of an appearance of the item via the scanning and image capture system.
4. The smart scanning system of claim 3, further comprising:
an extract module which extracts a feature of the item from at least one of the first image and the second image; and
a compare module which compares the extracted feature to an electronic database or library of images associated with corresponding item identity.
5. The smart scanning system of claim 3, wherein the second capture module captures the second image from a different direction of the first capture module and the first image.
6. The smart scanning system of claim 5, further comprising:
an extract module which extracts a feature of the item from at least one of the first image and the second image; and
a compare module which compares the extracted feature to an electronic database or library of images associated with corresponding item identity.
7. A smart scanning method, comprising:
receiving a scan of a barcode of an item via a scanning and image capture system;
determining an identity of the item based on the barcode;
capturing a first image of an appearance of the item via the scanning and image capture system, wherein the first image includes an image of the barcode; and
determining whether the identity is consistent with an appearance of the item as determined from the first image and the second image.
8. The smart scanning method of claim 7, further comprising:
extracting a feature of the item from the first image; and
comparing the extracted feature to an electronic database or library of images associated with corresponding item identity.
9. The smart scanning method of claim 7, further comprising:
capturing a second image of an appearance of the item via the scanning and image capture system.
10. The smart scanning method of claim 9, further comprising:
extracting a feature of the item from at least one of the first image and the second image; and
comparing the extracted feature to an electronic database or library of images associated with corresponding item identity.
11. The smart scanning method of claim 9, wherein the second capture module captures the second image from a different direction of the first capture module and the first image.
12. The smart scanning method of claim 11, further comprising:
extracting a feature of the item from at least one of the first image and the second image; and
comparing the extracted feature to an electronic database or library of images associated with corresponding item identity.
13. A smart scanning system, comprising:
a scan module which receives a scan of a barcode of an item via a scanning and image capture system;
a barcode module which determines an identity of the item based on the barcode;
a first capture module which captures a first image of an appearance of the item via the scanning and image capture system;
a second capture module which captures a second image of an appearance of the item via the scanning and image capture system, wherein the second capture module captures the second image from a different direction of the first capture module and the first image; and
a determining module which determines whether the identity is consistent with an appearance of the item as determined from the first image and the second image.
14. The smart scanning system of claim 13, further comprising:
an extract module which extracts a feature of the item from at least one of the first image and the second image; and
a compare module which compares the extracted feature to an electronic database or library of images associated with corresponding item identity.
US14/449,355 2007-05-31 2014-08-01 Smart scanning system Abandoned US20140353372A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US11/756,391 US8794524B2 (en) 2007-05-31 2007-05-31 Smart scanning system
US14/449,355 US20140353372A1 (en) 2007-05-31 2014-08-01 Smart scanning system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/449,355 US20140353372A1 (en) 2007-05-31 2014-08-01 Smart scanning system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/756,391 Continuation US8794524B2 (en) 2007-05-31 2007-05-31 Smart scanning system

Publications (1)

Publication Number Publication Date
US20140353372A1 true US20140353372A1 (en) 2014-12-04

Family

ID=40087004

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/756,391 Expired - Fee Related US8794524B2 (en) 2007-05-31 2007-05-31 Smart scanning system
US14/449,355 Abandoned US20140353372A1 (en) 2007-05-31 2014-08-01 Smart scanning system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/756,391 Expired - Fee Related US8794524B2 (en) 2007-05-31 2007-05-31 Smart scanning system

Country Status (1)

Country Link
US (2) US8794524B2 (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8359278B2 (en) 2006-10-25 2013-01-22 IndentityTruth, Inc. Identity protection
US20090039165A1 (en) * 2007-08-08 2009-02-12 Ncr Corporation Methods and Apparatus for a Bar Code Scanner Providing Video Surveillance
US8662397B2 (en) * 2007-09-27 2014-03-04 Symbol Technologies, Inc. Multiple camera imaging-based bar code reader
US20100102129A1 (en) * 2008-10-29 2010-04-29 Symbol Technologies, Inc. Bar code reader with split field of view
US8479996B2 (en) * 2008-11-07 2013-07-09 Symbol Technologies, Inc. Identification of non-barcoded products
US8079523B2 (en) * 2008-12-15 2011-12-20 Symbol Technologies, Inc. Imaging of non-barcoded documents
DE102009044537A1 (en) * 2009-11-16 2011-05-19 Wincor Nixdorf International Gmbh Mobile goods tracking system and method
JP5341844B2 (en) * 2010-09-01 2013-11-13 東芝テック株式会社 Store system, sales registration device and program
US9171442B2 (en) * 2010-11-19 2015-10-27 Tyco Fire & Security Gmbh Item identification using video recognition to supplement bar code or RFID information
US8678286B2 (en) 2011-01-31 2014-03-25 Honeywell Scanning & Mobility Method and apparatus for reading optical indicia using a plurality of data sources
EP2676197B1 (en) 2011-02-18 2018-11-28 CSidentity Corporation System and methods for identifying compromised personally identifiable information on the internet
US8819793B2 (en) 2011-09-20 2014-08-26 Csidentity Corporation Systems and methods for secure and efficient enrollment into a federation which utilizes a biometric repository
JP5928592B2 (en) * 2012-08-03 2016-06-01 日本電気株式会社 Information processing apparatus and screen setting method
USD723560S1 (en) * 2013-07-03 2015-03-03 Hand Held Products, Inc. Scanner
SG2013069893A (en) * 2013-09-13 2015-04-29 Jcs Echigo Pte Ltd Material handling system and method
USD730901S1 (en) * 2014-06-24 2015-06-02 Hand Held Products, Inc. In-counter barcode scanner
US20160110791A1 (en) * 2014-10-15 2016-04-21 Toshiba Global Commerce Solutions Holdings Corporation Method, computer program product, and system for providing a sensor-based environment
US10339527B1 (en) 2014-10-31 2019-07-02 Experian Information Solutions, Inc. System and architecture for electronic fraud detection
US9892478B2 (en) 2015-03-06 2018-02-13 Digimarc Corporation Digital watermarking applications
CA2940356A1 (en) * 2015-09-28 2017-03-28 Wal-Mart Stores, Inc. Systems and methods of object identification and database creation
CN108520520B (en) * 2018-04-12 2019-01-01 绍兴柯桥东茂织造有限公司 Key position bulge degree-measuring system

Family Cites Families (86)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4323772A (en) 1980-03-06 1982-04-06 R. J. Reynolds Tobacco Company Bar code reader system
US5635697A (en) 1989-03-01 1997-06-03 Symbol Technologies, Inc. Method and apparatus for decoding two-dimensional bar code
US5331455A (en) 1991-10-31 1994-07-19 The Research Foundation Of State University Of New York Electrical pulse operated laser sampling light amplifier
US5467403A (en) 1991-11-19 1995-11-14 Digital Biometrics, Inc. Portable fingerprint scanning apparatus for identification verification
US5426282A (en) 1993-08-05 1995-06-20 Humble; David R. System for self-checkout of bulk produce items
US5497314A (en) 1994-03-07 1996-03-05 Novak; Jeffrey M. Automated apparatus and method for object recognition at checkout counters
US5513264A (en) 1994-04-05 1996-04-30 Metanetics Corporation Visually interactive encoding and decoding of dataforms
US5631976A (en) 1994-04-29 1997-05-20 International Business Machines Corporation Object imaging system
US5546475A (en) 1994-04-29 1996-08-13 International Business Machines Corporation Produce recognition system
JP3213669B2 (en) 1994-05-30 2001-10-02 東芝テック株式会社 Check-out system
US5883968A (en) 1994-07-05 1999-03-16 Aw Computer Systems, Inc. System and methods for preventing fraud in retail environments, including the detection of empty and non-empty shopping carts
US5815200A (en) 1994-07-26 1998-09-29 Metanetics Corporation Extended working range dataform reader with reduced power consumption
US5763864A (en) * 1994-07-26 1998-06-09 Meta Holding Corporation Dataform reader including dual laser and imaging reading assemblies
EP0727760A3 (en) 1995-02-17 1997-01-29 Ibm Produce size recognition system
US5583686A (en) 1995-06-06 1996-12-10 Spot Technology Inc. Lens assembly installation of scanner
US5649970A (en) 1995-08-18 1997-07-22 Loeb; Gerald E. Edge-effect electrodes for inducing spatially controlled distributions of electrical potentials in volume conductive media
US5918211A (en) 1996-05-30 1999-06-29 Retail Multimedia Corporation Method and apparatus for promoting products and influencing consumer purchasing decisions at the point-of-purchase
US6434530B1 (en) 1996-05-30 2002-08-13 Retail Multimedia Corporation Interactive shopping system with mobile apparatus
US5958012A (en) 1996-07-18 1999-09-28 Computer Associates International, Inc. Network management system using virtual reality techniques to display and simulate navigation to network components
US6064469A (en) 1996-08-30 2000-05-16 Applied Graphics Technologies, Inc. Apparatus and method for processing images using a reciprocating easel
US6366696B1 (en) * 1996-12-20 2002-04-02 Ncr Corporation Visual bar code recognition method
US6122409A (en) 1997-08-29 2000-09-19 Mci Communications Corporation System and method for digitally capturing a product image
US6606171B1 (en) 1997-10-09 2003-08-12 Howtek, Inc. Digitizing scanner
US5928221A (en) 1997-11-17 1999-07-27 Coherent, Inc. Fluence monitoring method for laser treatment of biological tissue
US6032128A (en) 1997-12-15 2000-02-29 Ncr Corporation Method and apparatus for detecting item placement and item removal during operation of a self-service checkout terminal
US6853400B1 (en) 1998-06-16 2005-02-08 Fuji Photo Film Co., Ltd. System and method for correcting aberration of lenses through which images are projected
US6155489A (en) 1998-11-10 2000-12-05 Ncr Corporation Item checkout device including a bar code data collector and a produce data collector
US7143065B1 (en) 1998-11-13 2006-11-28 Diebold, Incorporated Cash dispensing method for self-service facility such as motor fuel dispensing facility
US6382357B1 (en) 1998-12-14 2002-05-07 Ncr Corporation Retail system for allowing a customer to perform a retail transaction and associated method
US6845913B2 (en) 1999-02-11 2005-01-25 Flir Systems, Inc. Method and apparatus for barcode selection of themographic survey images
AUPQ212499A0 (en) 1999-08-10 1999-09-02 Ajax Cooke Pty Ltd Item recognition method and apparatus
ES2350475T3 (en) 1999-12-10 2011-01-24 Beverage Metrics Holding Ltd. System, method and device for supervision of drinks supply.
US6726094B1 (en) 2000-01-19 2004-04-27 Ncr Corporation Method and apparatus for multiple format image capture for use in retail transactions
BR0106078B1 (en) 2000-04-20 2009-08-11 method for recording and rewarding the return of shopping carts to pickup points and system for performing the same.
GB0016756D0 (en) 2000-07-07 2000-08-30 Hewlett Packard Co Use of local equipment by mobile entity
US7845554B2 (en) 2000-10-30 2010-12-07 Fujitsu Frontech North America, Inc. Self-checkout method and apparatus
US20090119168A1 (en) 2001-11-14 2009-05-07 Retaildna, Llc System and method for providing an incentive based on the hardware used to place an order
US6556276B2 (en) 2001-02-09 2003-04-29 Gretag Imaging, Inc. Photographic reorder system and method
US7599855B2 (en) 2001-02-13 2009-10-06 Lester Sussman System and method for a complete and convenient shopping experience
US7044370B2 (en) 2001-07-02 2006-05-16 Ecr Software Corporation Checkout system with a flexible security verification system
US20030015585A1 (en) 2001-07-19 2003-01-23 Ncr Corporation Self checkout system utilizing networked shopping carts
US20030167242A1 (en) 2002-02-05 2003-09-04 Daryl Hamilton Retail security system and process
US20030222147A1 (en) 2002-06-04 2003-12-04 Hand Held Products, Inc. Optical reader having a plurality of imaging modules
US20040117250A1 (en) 2002-12-17 2004-06-17 Allen Lubow Method and system for providing coupon savings using existing credit card processing infrastructure, and barcoded coupon having 2-D component
US20040125396A1 (en) 2002-12-19 2004-07-01 James Burke System and method for routing voice/video/fax mail
US7188769B2 (en) 2003-04-07 2007-03-13 Silverbrook Research Pty Ltd Laser scanner using rotating holographic optical element
US7118026B2 (en) 2003-06-26 2006-10-10 International Business Machines Corporation Apparatus, method, and system for positively identifying an item
JP2005191311A (en) 2003-12-25 2005-07-14 Sharp Corp Solid state imaging device and method for manufacturing the same
US20050173527A1 (en) 2004-02-11 2005-08-11 International Business Machines Corporation Product checkout system with anti-theft device
US7337960B2 (en) 2004-02-27 2008-03-04 Evolution Robotics, Inc. Systems and methods for merchandise automatic checkout
US7246745B2 (en) 2004-02-27 2007-07-24 Evolution Robotics Retail, Inc. Method of merchandising for checkout lanes
US7100824B2 (en) 2004-02-27 2006-09-05 Evolution Robotics, Inc. System and methods for merchandise checkout
CA2559999A1 (en) 2004-03-16 2005-09-29 Maximilian Munte Mobile paper record processing system
JP4305847B2 (en) 2004-03-26 2009-07-29 富士通株式会社 Store settlement method, system and program
US20060047835A1 (en) 2004-07-02 2006-03-02 Greaux Jeffrey E Method and System for LAN and WLAN access to e-commerce sites via Client Server Proxy
US7748631B2 (en) * 2004-07-29 2010-07-06 Symbol Technologies, Inc. Point-of-transaction workstation for electro-optically reading one-dimensional and two-dimensional indicia by image capture
US7219838B2 (en) 2004-08-10 2007-05-22 Howell Data Systems System and method for notifying a cashier of the presence of an item in an obscured area of a shopping cart
US7168618B2 (en) 2004-08-12 2007-01-30 International Business Machines Corporation Retail store method and system
US8539119B2 (en) 2004-11-24 2013-09-17 Qualcomm Incorporated Methods and apparatus for exchanging messages having a digital data interface device message format
US8873584B2 (en) 2004-11-24 2014-10-28 Qualcomm Incorporated Digital data interface device
US7124058B2 (en) 2004-12-30 2006-10-17 Spx Corporation Off-board tool with optical scanner
US7337962B2 (en) 2004-12-30 2008-03-04 International Business Machines Corporation Method to detect false purchases with a consumer service device
US20060180664A1 (en) 2005-02-15 2006-08-17 Barrett Patrick V Wirelessly deliverable and redeemable secure couponing system and method
JP2007004352A (en) 2005-06-22 2007-01-11 Fujifilm Holdings Corp Character input system
JP2007009946A (en) 2005-06-28 2007-01-18 Denso Corp Vehicle control system
US20060289637A1 (en) 2005-06-28 2006-12-28 Media Cart Holdings, Inc. Media enabled shopping cart system with basket inventory
US20070094080A1 (en) 2005-10-21 2007-04-26 Coalitionworks, Llc Smart shopping method and system
US20070107021A1 (en) 2005-11-04 2007-05-10 Angel Albert J Shopping on Demand Transactional System with Data Warehousing Feature, Data Tracking, Shopping Cart Reservation Feature, Purchase Commentary and External Marketing Incentives Deployed in Video On Demand Cable Systems
US20070107016A1 (en) 2005-11-04 2007-05-10 Angel Albert J Interactive Multiple Channel User Enrollment, Purchase Confirmation Transactional System with Fulfillment Response Feature for Video On Demand Cable Systems
US20070107017A1 (en) 2005-11-04 2007-05-10 Angel Albert J Transaction Process Controller with User History, Selectable Profile Controls, Confirmation and User Control Options for Shopping with Video On Demand Cable Systems
US7334729B2 (en) 2006-01-06 2008-02-26 International Business Machines Corporation Apparatus, system, and method for optical verification of product information
US20070288310A1 (en) 2006-01-24 2007-12-13 Boos Frederick B Methods and systems for providing advertising to consumers
US7653212B2 (en) 2006-05-19 2010-01-26 Universal Electronics Inc. System and method for using image data in connection with configuring a universal controlling device
US20080027796A1 (en) 2006-07-31 2008-01-31 Leonardo Weiss F Chaves Distributed reputation-based recommendation system
US20080059281A1 (en) 2006-08-30 2008-03-06 Kimberly-Clark Worldwide, Inc. Systems and methods for product attribute analysis and product recommendation
US20080142598A1 (en) 2006-12-14 2008-06-19 Sik Piu Kwan Method, system, and apparatus for an electronic freeze frame shutter for a high pass-by image scanner
US7533799B2 (en) 2006-12-14 2009-05-19 Ncr Corporation Weight scale fault detection
US7422147B2 (en) 2006-12-22 2008-09-09 Walter Steven Rosenbaum System and method for detecting fraudulent transactions of items having item-identifying indicia
US8615426B2 (en) 2006-12-26 2013-12-24 Visa U.S.A. Inc. Coupon offers from multiple entities
US8146811B2 (en) 2007-03-12 2012-04-03 Stoplift, Inc. Cart inspection for suspicious items
US7909248B1 (en) 2007-08-17 2011-03-22 Evolution Robotics Retail, Inc. Self checkout with visual recognition
US20090268941A1 (en) 2008-04-23 2009-10-29 French John R Video monitor for shopping cart checkout
US20100042236A1 (en) 2008-08-15 2010-02-18 Ncr Corporation Self-service terminal
US20120101881A1 (en) 2008-11-25 2012-04-26 Mary Theresa Taylor Loyalty promotion apparatuses, methods and systems
US20110060634A1 (en) 2009-09-04 2011-03-10 Bank Of America Activation of electronic customer benefit offers
US10504100B2 (en) 2010-07-30 2019-12-10 Ncr Corporation Point of sale virtual customer session

Also Published As

Publication number Publication date
US20080296382A1 (en) 2008-12-04
US8794524B2 (en) 2014-08-05

Similar Documents

Publication Publication Date Title
US7711598B2 (en) Web-based consumer product marketing communication network for managing and delivering consumer product marketing communications to consumers along e-commerce (EC) enabled web sites on the world wide web (WWW), using multi-mode virtual kiosks (MMVKS) driven by server=side components embodying consumer product identifiers and driven by consumer product information (CPI) links managed by product manufacturer team members and/or their agents
CN101099161B (en) Visual code system for camera-equipped mobile devices and applications thereof
US10121133B2 (en) Method for self-checkout with a mobile device
CN102667913B (en) Augmented reality system method and apparatus for displaying an item image in acontextual environment
US8807432B2 (en) Apparatus for displaying bar codes from light emitting display surfaces
EP3118573B1 (en) Method and system for dimensioning and imaging items
US8473363B1 (en) Systems and methods for price searching and customer self-checkout using a mobile device
US7581682B2 (en) Image-recording device, method for recording an image that is visualized on a display unit, arrangement of an image-recording device and a display unit, use of said image-recording device, and use of said arrangement
US20090222353A1 (en) Payment system
DE202011110623U1 (en) Device for recycling mobile phones
US20030018897A1 (en) Video identification verification system and method for a self-checkout system
US20120136698A1 (en) Barcode enabled coupon search, retrieval, presentation and redemption via telecommunications devices
JP2006514767A (en) Plug-in credit card reading module for mobile phone authentication
EP1244043A2 (en) Method, carrier and system for accessing advertising information using a product identifier
JP5427859B2 (en) System for image capture and identification
JP5984096B2 (en) Method and mechanism for identifying an object
US20050242189A1 (en) Visual code system for camera-equipped mobile devices and applications thereof
CN101160576B (en) Method and system for measuring retail store display conditions
JP2004537078A (en) Method and system for determining best deals and availability
TWI289800B (en) Apparatus, method, and system for positively identifying an item
US7477149B2 (en) Security system for inventory
JP4620807B2 (en) Self-shopping support to acquire content from electronic shelf labels (ESL)
US8091782B2 (en) Using cameras to monitor actual inventory
US20050102183A1 (en) Monitoring system and method based on information prior to the point of sale
US10311424B2 (en) Indicia encoding system with integrated purchase and payment information

Legal Events

Date Code Title Description
AS Assignment

Owner name: TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CONNELL, JONATHAN H., II;FLICKNER, MYRON D.;HAAS, NORMAN;AND OTHERS;SIGNING DATES FROM 20141002 TO 20150106;REEL/FRAME:034679/0453

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION