WO2020042966A1 - 漏扫识别方法、装置、自助收银终端及系统 - Google Patents

漏扫识别方法、装置、自助收银终端及系统 Download PDF

Info

Publication number
WO2020042966A1
WO2020042966A1 PCT/CN2019/101520 CN2019101520W WO2020042966A1 WO 2020042966 A1 WO2020042966 A1 WO 2020042966A1 CN 2019101520 W CN2019101520 W CN 2019101520W WO 2020042966 A1 WO2020042966 A1 WO 2020042966A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
video information
scanning
self
missed
Prior art date
Application number
PCT/CN2019/101520
Other languages
English (en)
French (fr)
Inventor
文杰
傅业焘
江文晟
朱瑜
刘扬
沈飞
赵小伟
刘辉
杨浩
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Priority to JP2021510931A priority Critical patent/JP7245321B2/ja
Publication of WO2020042966A1 publication Critical patent/WO2020042966A1/zh
Priority to US17/186,682 priority patent/US11501614B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/20—Point-of-sale [POS] network systems
    • G06Q20/208—Input by product or record sensing, e.g. weighing or scanner processing
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G3/00—Alarm indicators, e.g. bells
    • G07G3/006—False operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/20—Point-of-sale [POS] network systems
    • G06Q20/206—Point-of-sale [POS] network systems comprising security or operator identification provisions, e.g. password entry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/0036—Checkout procedures
    • G07G1/0045—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/0036—Checkout procedures
    • G07G1/0045—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G07G1/0054—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles
    • G07G1/0063—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00—Cash registers
    • G07G1/12—Cash registers electronically operated
    • G07G1/14—Systems including one or more distant stations co-operating with a central processing unit
    • G07G1/145—PLU-management
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19613—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19678—User interface
    • G08B13/19691—Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
    • G06K7/10821—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
    • G06K7/10861—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices sensing of data fields affixed to objects or articles, e.g. coded labels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404—Methods for optical code recognition
    • G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/1413—1D bar codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404—Methods for optical code recognition
    • G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/1417—2D bar codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/18—Payment architectures involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/44—Event detection

Definitions

  • the present invention relates to the field of computer technology, and in particular, to a method, a device, a self-service cash register terminal, and a system for identifying missing scans.
  • embodiments of the present invention provide a method, a device, a self-service cash register terminal and a system for identifying missing scans to reduce the use cost of the self-service cash register terminal.
  • an embodiment of the present invention provides a method for identifying missing scans, including:
  • a detection result of a user's missed scanning behavior is obtained.
  • an embodiment of the present invention provides a missing scan identification method, including:
  • an embodiment of the present invention provides a missing scan identification method, including:
  • an embodiment of the present invention provides a method for identifying missing scans, including:
  • the missed scan instruction information is sent to the self-service cash register terminal.
  • an embodiment of the present invention provides a missing scanning identification device, including:
  • a first acquisition module configured to collect video information of an item scanned by a user
  • a first detection module is configured to obtain a detection result of a user's missed scanning behavior according to the video information.
  • an embodiment of the present invention provides a missing scanning identification device, including:
  • a second acquisition module configured to collect video information of the items scanned by the user
  • a first sending module configured to send the video information to an image server
  • a first receiving module is configured to receive a user behavior detection result obtained by the image server by processing the video information.
  • an embodiment of the present invention provides a missing scanning identification device, including:
  • a first acquisition module configured to acquire video information of a user's scanned item sent by a self-service cash register terminal
  • a second detection module configured to obtain a user behavior detection result according to the video information
  • a second sending module is configured to send the user behavior detection result to the self-service cash register terminal.
  • an embodiment of the present invention provides a missing scanning identification device, including:
  • a second acquisition module configured to acquire video information of the user's scanned items sent by the self-service cash register terminal
  • a display module configured to display the video information to a background monitoring person, so that the background monitoring person determines whether the user has missed scanning behavior according to the video information;
  • the third sending module is configured to send the missing scanning instruction information to the self-service cash register terminal in response to the operation event that the background monitoring personnel confirms that the user has a missing scanning behavior.
  • an embodiment of the present invention provides a self-service cash register terminal, including: a first memory and a first processor; the first memory is configured to store one or more computer instructions, wherein the one or more computers When the instructions are executed by the first processor, the missing scan recognition method according to the first aspect is implemented.
  • an embodiment of the present invention provides a self-service cash register terminal, including: a second memory and a second processor; the second memory is configured to store one or more computer instructions, wherein the one or more computers When the instructions are executed by the second processor, the missing scan recognition method according to the second aspect is implemented.
  • an embodiment of the present invention provides an image server, including: a third memory and a third processor; the third memory is configured to store one or more computer instructions, wherein the one or more computers When the instructions are executed by the third processor, the missing scan recognition method according to the third aspect is implemented.
  • an embodiment of the present invention provides a background monitoring terminal, including: a fourth memory and a fourth processor; the fourth memory is used to store one or more computer instructions, wherein the one or more When the computer instructions are executed by the fourth processor, the missing scan recognition method according to the fourth aspect is implemented.
  • an embodiment of the present invention provides a self-service cashier system, including the self-service cashier terminal described in the ninth aspect and the background monitoring terminal described in the twelfth aspect; or the system includes the tenth aspect The self-service cash register terminal, the image server according to the eleventh aspect, and the background monitoring terminal according to the twelfth aspect.
  • An embodiment of the present invention provides a computer storage medium for storing a computer program that causes a computer to implement the missing scan recognition method according to any one of the first to fourth aspects when executed.
  • the missing scanning recognition method, device, self-service cash register terminal and system collect video information of a user when the user scans an item, and use the video information to detect the missing scanning behavior of the user.
  • the obtained detection result can be used for Implement functions such as auxiliary settlement or alarm, avoid or reduce the user's missed scanning behavior when using self-service cashier terminals, reduce economic losses in retail stores, save manpower and resources, effectively reduce the cost of self-service cashier terminals, and help self-service cashiers
  • the promotion and application of the terminal, and the loss prevention function is realized through video processing, and the user's cash register process is not disturbed, which effectively improves the user experience.
  • FIG. 1 is a schematic diagram of an application scenario according to an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a first embodiment of a missing scan recognition method according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an appearance of a self-service cash register terminal according to an embodiment of the present invention.
  • FIG. 4 is a schematic flowchart of a second embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a third embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of a fourth embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • FIG. 7 is a schematic flowchart of a fifth embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • FIG. 8 is a schematic flowchart of a sixth embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • FIG. 9 is a schematic flowchart of a seventh embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of a first embodiment of a missing scan recognition device according to an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of a second embodiment of a missing scan recognition device according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of a third embodiment of a missing scan recognition device according to an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of a fourth embodiment of a missing scan identification device according to an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram of a self-service cash register terminal according to an embodiment of the present invention.
  • FIG. 15 is a schematic structural diagram of another self-service cash register terminal according to an embodiment of the present invention.
  • 16 is a schematic structural diagram of still another self-service cash register terminal according to an embodiment of the present invention.
  • FIG. 17 is a schematic structural diagram of an image server according to an embodiment of the present invention.
  • FIG. 18 is a schematic structural diagram of a background monitoring terminal according to an embodiment of the present invention.
  • the words “if”, “if” as used herein can be interpreted as “at” or “when” or “responding to determination” or “responding to detection”.
  • the phrases “if determined” or “if detected (the stated condition or event)” can be interpreted as “when determined” or “responded to the determination” or “when detected (the stated condition or event) ) “Or” in response to a detection (statement or event stated) ".
  • FIG. 1 is a schematic diagram of an application scenario provided by an embodiment of the present invention.
  • the self-service cash register terminal can communicate with a settlement server, an image server, a background monitoring terminal, and a field monitoring terminal.
  • the self-service cash register terminal may be provided at an outlet of the store or at another location.
  • the user can select the item to be purchased in the store, and then scan the barcode of the item at the self-service cash register terminal.
  • the self-service cash register terminal collects video information of the user when the user scans the item, and judges whether the user has missed scanning behavior based on the video information.
  • the settlement server is used to implement functions such as item inquiry and settlement.
  • the self-service cash register terminal may send the scanned item identification to the settlement server, and the settlement server queries the item information such as name, price, etc. to the self-service cash register terminal.
  • the self-service cash register terminal is displayed to the user.
  • the settlement server can generate payment information according to the price of all items, and complete the settlement according to the user's payment behavior.
  • the background monitoring terminal is used for background monitoring personnel to monitor the scanning behavior of the user.
  • the self-service cash register terminal can send the video information of the user's scanned items collected in real time to the background monitoring terminal, and the background monitoring terminal displays it to the background monitoring personnel, thereby implementing manual monitoring of user behavior and further protecting the economic benefits of the store.
  • the on-site monitoring terminal is used for on-site monitoring personnel to monitor the scanning behavior of the user.
  • the self-service cash register terminal can send a warning message to the on-site monitoring terminal when the user's missing scanning behavior meets certain conditions, such as when the missing scanning behavior occurs or the number of missed scanning times is greater than a certain value.
  • the on-site monitoring terminal can be carried by the on-site monitoring personnel. After receiving the warning information, the on-site monitoring staff can go to the self-service cash register terminal to assist the user to complete the scanning and settlement.
  • An embodiment of the present invention provides a method for processing video information of an item scanned by a user in a process of self-service settlement by a user to obtain a detection result of a user's missed scanning behavior, and the detection result may be used for subsequent settlement and other steps.
  • FIG. 1 shows an optional application scenario according to an embodiment of the present invention. Those skilled in the art can understand that the specific hardware architecture can be adjusted according to actual needs, as long as the user's missed scanning behavior can be detected through video information.
  • the function of the image server can be placed on the self-service cash register terminal, and the self-service cash register terminal can directly process the video information to detect the user's missed scanning behavior;
  • the function of the settlement server can also be placed on the self-service cash register terminal, and the self-service cash register terminal can store There is a corresponding relationship between the item identification and the item price, and the corresponding price can be determined according to the scanned item identification; or, the functions of the image server and the settlement server can be integrated in one server; or the functions of the image server or the settlement server can be Implemented in the background monitoring terminal, etc.
  • FIG. 2 is a schematic flowchart of a first embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • the method execution subject in this embodiment may be a self-service cash register terminal.
  • the missing scan recognition method in this embodiment may include:
  • Step 201 Collect video information of an item scanned by a user.
  • Step 202 Obtain a detection result of a user's missed scanning behavior according to the video information.
  • the user in the embodiment of the present invention may refer to a consumer in a retail store, and the item may refer to a product purchased by the user.
  • Marks such as barcodes and two-dimensional codes are generally set on the articles, and the settlement of the articles can be achieved by scanning the signs.
  • FIG. 3 is a schematic diagram of an appearance of a self-service cash register terminal according to an embodiment of the present invention.
  • the self-service cash register terminal may include functional devices such as a camera, a display screen, a code scanning port, a placing table, etc., which are required to implement self-service cash register.
  • the self-service cash register terminal may not include these functional devices.
  • the self-service cash register terminal may be embedded in the self-service cash register.
  • the self-service cash register may include functional devices such as a camera, a display screen, a code scanning port, and a placing table. The device interacts to implement the missing scan recognition method.
  • the display screen can display information such as the name, price, etc. of the item scanned by the user.
  • the placing table is used for placing articles, and may specifically include an area to be scanned A for placing articles to be scanned, a scanning area B for scanning articles, and a scanned area C for placing scanned articles.
  • the placing table is a code scanning area for the user to scan the article.
  • the user can align the identification of the article with the code scanning port in the code scanning area, thereby realizing the scanning of the article.
  • a photographing device such as a camera shown in FIG. 2, may be set within a preset range of the scanning area.
  • the preset range can be set according to actual needs, for example, it can be 1 meter.
  • collecting video information of the user's scanned item in step 201 may include: acquiring video information of the code scanning area collected by the photographing device.
  • the self-service cash register terminal can collect video information of the user in real time through a camera.
  • the camera can be set at a position where the user can scan the scanning behavior of the item, for example, on the top of a self-service cash register terminal, and so on.
  • the user's behavior can be detected, and the detection result can include whether the user has missed scanning behavior, or the number of times that the user has missed scanning, or each time when the user's missed scanning behavior is detected, etc. Wait.
  • the detection result can include whether the user has missed scanning behavior, or the number of times that the user has missed scanning, or each time when the user's missed scanning behavior is detected, etc. Wait.
  • the user's behavior may be analyzed through machine learning, for example, a model of a user's hand, a model of an item, etc. may be learned through machine learning, and the model may be used for real-time leak detection.
  • multiple samples may be obtained first, and each sample contains user behavior data such as the motion trajectory of the hand, the posture of the hand, and the like, and also includes corresponding behavior labels such as whether it is a missed scan behavior, the number of missed scans, etc.
  • a user behavior model is obtained through a machine learning method such as a neural network.
  • the behavior data corresponding to the user can be directly determined based on the video information collected in real time, and the behavior data is input into the user behavior model. According to the model, it can be determined whether it is a missed scan behavior or the number of missed scans.
  • Motion segmentation refers to labeling the pixels associated with each independent motion in multiple motions of sequence features, and clustering these pixels according to their respective media objects.
  • the main purpose is to extract from the static background as Foreground moving objects.
  • multiple key points of the user's hand can be obtained through algorithms such as OpenPose, and the gesture of the user's hand can be determined based on the key points.
  • the user may take an item once as a complete action, and determine whether a code scanning behavior occurs during each complete action. If no code scanning occurs during a complete action, Behavior is considered a missed scan.
  • Whether the code scanning behavior occurs can be judged by the signal obtained by the code scanning device of the self-service cash register terminal, or it can also be judged by a POS (point of sale) or other similar device.
  • the POS machine can identify the Bar code or QR code, and determine the corresponding name, price, etc.
  • the POS machine or other scanning device does not scan the identification of the item within the time period of an action, it is determined that the user has a missed scanning behavior within the time period. In addition, if the identification of the item is scanned, but the scan The information of the items is inconsistent with the information of the items determined through the video information. It can also be considered that there is a leaking behavior to prevent users from cheating. Replace the true identification with a false identification, which will bring losses to the store.
  • determining whether the user has missed scanning behavior during the time period according to the identifier of the item scanned during the time period may include:
  • the attribute information of the item may include at least one of the following: a name, a price, a type, a size, a color, and the like of the item.
  • the type of the item can be determined according to the video information, and the price range of the item can be determined according to the type. If the price of the scanned item is not within the range, it is considered that a missed scan behavior has occurred. For example, determining whether the user has missed scanning behavior during the time period according to the identifier of the item scanned during the time period may include:
  • the start time for the user to scan the first item is 19:00:00 and the end time is 19:00:05, then the period from 19:00:00 to 19:00:05 It is a period of time in which a scanning action is performed. If no identification of an item is scanned during this period of time, it is considered that a missing scanning behavior has occurred. If the item's identification is scanned, but the item is determined to be gum, and the video information can be used to determine whether the item is a vat, or the price of the item is determined to be 1 yuan, but the minimum price of the item is determined to be 10 by video information. Yuan, it means that the item information determined by the identification is inconsistent with the item information detected by the video information, and it can be considered that there is a missed scanning behavior.
  • Identifying the attribute information of an item based on video information can be achieved through methods such as big data analysis and machine learning.
  • the preset conditions can be set according to actual needs.
  • the user can allow settlement of the items scanned by the user, which can provide a fault tolerance space for the video detection algorithm, and prevent misjudgments from affecting the user's shopping experience. Save shopping process.
  • the settlement of the items scanned by the user according to the detection result may include: in response to the operation event that the user confirms that the item has been scanned, determining the number of missed scans of the user according to the detection result; if the number of missed scans of the user If the value is less than the first preset threshold, the item scanned by the user is settled.
  • the operation event that the user confirms that the item has been scanned may refer to an operation in which the user determines that all items have been scanned by clicking the screen, pressing a button, or voice input, for example, a button such as "Done" may be displayed on a self-service cash register terminal When the user finishes scanning all the items, he can click the "Finish” button. In response to the user's click operation, the self-service cash register terminal can settle the items scanned by the user according to the detection results.
  • the first preset threshold may be set according to actual needs, for example, it may be 4 times.
  • the forbidden settlement interface is used to prompt the user that the user cannot perform settlement.
  • the forbidden settlement interface may display "Detection that you have missed scanning and cannot be settled.” Behavior, need the clerk to come to handle "and so on.
  • the self-service cash register terminal collects video information of the user when the user scans the item, and detects the user's behavior based on the video information to determine whether the user has missed scanning behavior, only if the user's behavior meets certain conditions, such as no occurrence Missed scanning behavior or the number of times users missed scanning is allowed to make payments normally. Otherwise, users' payment behavior can be blocked to prevent users from missing scanning and causing losses to merchants.
  • the embodiment of the present invention uses video information to detect whether a user has a missed scanning behavior, which is a significant improvement over the method of settlement using a weighing device in the prior art.
  • a self-service cash register terminal is provided with a weighing machine, which uses gravity sensing to weigh and prevent damage, and compares the weight of the code scanning item with the weight of the item on the weighing machine. If the weight is different, an alarm is issued.
  • the machine itself occupies a large area, and each product must be weighed, and the user experience is poor.
  • the missing scan recognition method provided by the embodiment of the present invention implements a loss prevention function through video processing. The user has no perception and reduces interference with the user, so that the user's checkout process is not disturbed, which can effectively improve user experience and save store space. Wider range of application and stronger plasticity.
  • the missing scan recognition method collects video information of a user when the user scans an item, and detects the missed scan behavior of the user by using the video information.
  • the obtained detection result can be used to implement auxiliary settlement or alarm, etc. Functions, to avoid or reduce the user's missed scanning behavior when using self-service cashier terminals, reduce the economic loss of retail stores, save manpower and material resources, effectively reduce the cost of self-service cashier terminals, and facilitate the promotion and application of self-service cashier terminals. And through the video processing to achieve the loss prevention function, the user's cash register process is not disturbed, effectively improving the user experience.
  • FIG. 4 is a schematic flowchart of a second embodiment of a missing scan recognition method according to an embodiment of the present invention. This embodiment is based on the technical solution provided in the foregoing embodiment, and when a user has a scan-missing behavior, an on-site monitoring person in the store may be prompted to go for processing. As shown in FIG. 4, the missing scan recognition method in this embodiment may include:
  • Step 401 Collect video information of an item scanned by a user.
  • Step 402 Obtain a detection result of a user's missed scanning behavior according to the video information.
  • Step 403 In response to the operation event that the user confirms that the scanning of the item is completed, determine the number of missed scans of the user according to the detection result.
  • the items scanned by the user are settled.
  • Step 404 If the number of missed scans of the user is not less than a first preset threshold, display a settlement prohibition interface, and send a warning message to the on-site monitoring terminal.
  • the user's settlement can be blocked, a settlement prohibition interface can be displayed, and a warning message can be sent to the on-site monitoring terminal to remind the on-site monitoring personnel.
  • the on-site monitoring terminal may be any terminal carried by the on-site monitoring personnel, such as a mobile phone or a wearable device such as a watch, a smart bracelet, etc., and the on-site monitoring personnel may be a person in the store, such as a second person, who assists the user to complete a self-service cashier at the scene .
  • the on-site monitoring terminal may push the reminder information to the on-site monitoring personnel according to the warning information, and prompt the on-site monitoring personnel to process. For example, you can display or play "Cash register xx detected missing scanning behavior, please go to handle it".
  • only the forbidden settlement interface may be displayed, and no warning information is sent, and the user himself seeks the help of the on-site monitoring personnel.
  • Step 405 In response to the operation event of the on-site monitoring personnel, settle the items scanned by the user.
  • the on-site monitoring personnel can go to the self-service cash register terminal where the user is located to assist the user in settlement.
  • the on-site monitoring staff finds that the items purchased by the user are exactly the same as the items scanned by the user displayed on the self-service cash register terminal, the blocking can be released to allow the user to pay normally.
  • the inconsistent items displayed by the user on the terminal indicate that the user may have missed the scanning behavior.
  • the on-site monitoring staff can assist the user to complete the scan, and after scanning all the items correctly, remove the block and allow the user to pay normally.
  • unblock There are many ways to unblock. For example, on-site monitoring personnel can enter a password at the self-service cash register terminal to unblock.
  • the settlement of the items scanned by the user may include: obtaining a password input by the on-site monitoring personnel. If the password is a password for lifting the prohibition of settlement, then Settle the items scanned by the user.
  • the on-site monitoring terminal carried by the on-site monitoring personnel may be provided with a two-dimensional code.
  • the two-dimensional code may be scanned by the self-service cash register terminal, thereby releasing the blocking.
  • the settlement of the items scanned by the user may include: scanning the two-dimensional code provided by the on-site monitoring personnel, if the two-dimensional code is used to release the prohibition of settlement The QR code will settle the items scanned by the user.
  • the blocking may also be lifted by such methods as shooting specific expressions of the on-site monitoring personnel through the self-service cash register terminal, inputting specific keywords by the on-site monitoring personnel, and other interactions between the on-site monitoring terminal and the self-service cash register terminal. This embodiment does not limit this.
  • the missing scan recognition method determines the number of missed scans of a user according to the detection result after the user scans an item. If the missed scans of the user meets a certain condition, a settlement prohibition interface may be displayed. And send a warning message to the on-site monitoring terminal, prompting the on-site monitoring staff to come to deal with it. After the on-site monitoring staff assists the user to complete the scan, the self-service cash register terminal responds to the on-site monitoring staff's operation event, and clears the items scanned by the user. When problems occur during scanning, the on-site monitoring personnel are notified to assist in processing, which improves the efficiency of self-service cashiering, and effectively avoids the economic loss of the store.
  • FIG. 5 is a schematic flowchart of a third embodiment of a missing scan recognition method according to an embodiment of the present invention. This embodiment is based on the technical solutions provided by the foregoing embodiments, while monitoring user behavior through a self-service cash register terminal, it also monitors through a background monitoring terminal. As shown in FIG. 5, the missing scan recognition method in this embodiment may include:
  • Step 501 Collect video information of an item scanned by a user, and send the video information to a background monitoring terminal.
  • the video information of the user's scanned items can be collected in real time and sent to the background monitoring terminal in real time, and the video information is used for the background monitoring terminal to play, so that the background monitoring personnel can perform Monitoring.
  • the background monitoring personnel may be workers in the store for monitoring video
  • the background monitoring terminal may be any terminal having a video playback function such as a mobile phone, a tablet device, a computer, a smart TV, a display, and the like.
  • Step 502 Obtain a detection result of a user's missed scanning behavior according to the video information.
  • Step 503 Obtain missing scan instruction information sent by the background monitoring terminal in response to an operation event of the background monitoring personnel and used to indicate that the user has a missing scan behavior.
  • the video information may be processed by an algorithm to detect a user's missed scanning behavior, which is a kind of machine detection behavior.
  • the background monitoring personnel can perform corresponding operations when it is found that the user has missed scanning behavior, which is a manual monitoring method.
  • the background monitoring terminal after the background monitoring terminal obtains the video information of the user's scanned items sent by the self-service cash register terminal, it can display the video information to the background monitoring personnel, so that the background monitoring personnel can determine whether the user has missed scanning based on the video information. Behavior; in response to the background monitoring personnel confirming the operation event of the user's missing scanning behavior, the background monitoring terminal can send the missing scanning instruction information to the self-service cash register terminal, so that the self-service cash register terminal can scan the user's items according to the missing scanning instruction information proceed to checkout.
  • the background monitoring personnel can confirm the operation event of the user's missed scanning behavior.
  • the "problem" button can be displayed in the video playback interface of the background monitoring terminal. The user's video information) finds that the user has missed scanning behavior, then can press the "problem" button, so that the background monitoring terminal can send missed scanning instruction information to the self-service cash register terminal.
  • the background monitoring personnel can confirm the user's missed scanning behavior by voice, clicking on keyboard keys, and other methods.
  • Step 504 In response to the operation event that the user confirms that the item scanning is completed, if the number of missed scans of the user is detected to be less than a first preset threshold based on the video information, and / or determined according to the missed scan instruction information If the number of missed scans of the user is less than the second preset threshold, the item scanned by the user is settled.
  • the self-service cash register terminal can detect the user's missed scan behavior in two ways: one is to process the video information through an algorithm to determine the number of missed scans of the user; the second is to monitor the user through the video by the background monitoring staff Monitoring to determine the number of missed scans for a user.
  • whether to allow settlement of the item scanned by the user may be determined according to the number of missed scans obtained through an algorithm and / or the number of missed scans obtained through manual monitoring.
  • step 504 may include: in response to the operation event that the user confirms that the scanning of the item is completed, if it is detected that the number of missed scans of the user is less than a first preset threshold according to the video information, Settle the items scanned by the user; if it is not less than the first preset threshold, block.
  • step 504 may include: in response to the operation event that the user confirms that the scanning of the item is completed, if it is determined according to the missed scan instruction information that the number of missed scans of the user is less than a second preset The threshold is used for settlement of the items scanned by the user; if it is not less than the second preset threshold, blocking is performed.
  • the background monitoring staff may click "has a problem" every time a user is found to have missed scanning behavior, and the background monitoring staff may send a missed scanning instruction message to the self-service cash register terminal.
  • the self-service cash register terminal can determine the number of missed scans of the user according to the number of missed scan instruction information received by the user during the scanning process.
  • the second preset threshold can be set according to actual needs, for example, it can be twice.
  • step 504 may include: in response to the operation event that the user confirms that the item has been scanned, if the number of missed scans of the user is detected based on the video information to be less than a first preset threshold And according to the missed scan instruction information, it is determined that the number of missed scans of the user is less than a second preset threshold, then the items scanned by the user are settled; if the number of missed scans of the user is detected based on the video information, A preset threshold, or if it is determined that the number of missed scans of the user is not less than a second preset threshold according to the missed scan indication information, blocking is performed.
  • the user is allowed to make a normal settlement; if the leakages are obtained by processing video information, The number of scans is not less than 4 times, or the background monitoring staff confirms that the number of missed scans of the user is not less than 2 times, the settlement is prohibited.
  • step 504 may include: in response to the operation event that the user confirms that the item has been scanned, if the number of missed scans of the user is detected based on the video information to be less than a first preset threshold Or if the number of missed scans of the user is determined to be less than a second preset threshold according to the missed scan instruction information, the items scanned by the user are settled; if the number of missed scans of the user is detected based on the video information, If a preset threshold value is determined and the number of missed scan times of the user is not less than a second preset threshold value according to the missed scan indication information, blocking is performed.
  • the method for implementing the blocking may refer to the foregoing embodiments, and may include, for example, displaying a forbidden settlement interface, sending warning information to an on-site monitoring terminal, and the like.
  • the self-service cash register terminal can process the collected video information, detect the user's missed scanning behavior, and at the same time, send the collected video information to the background monitoring terminal.
  • the video information is used for the background monitoring terminal to play, so that the background monitoring personnel can monitor the user's behavior based on the video information collected in real time, and feedback to the self-service cash register terminal when the user's missing scanning behavior is found.
  • the user can decide whether to enter the normal settlement process according to the number of missed scans detected through the video information, or the number of missed scans determined based on the feedback from the background monitoring staff. Algorithms and manual can be implemented. Double monitoring to further improve the loss prevention effect.
  • the background monitoring terminal may communicate with the multiple self-service cashier terminals to obtain video information shot by the multiple self-service cashier terminals and display them to the background monitoring staff.
  • the self-service cash register terminal may also send a warning instruction to the background monitoring terminal to control the background monitoring terminal to highlight the user's video information.
  • the self-service cash register terminal can process the video information to detect the user's missed scanning behavior in real time. If the user's missed scanning behavior is detected, a warning instruction is sent to the background monitoring terminal, and the background monitoring terminal obtains the warning instruction. Then, the video information of the user may be highlighted according to the warning instruction.
  • the display interface of the background monitoring terminal displays multiple video information.
  • a self-service cash register terminal detects that the user has missed scanning, it can send a warning message to the background monitoring terminal.
  • the background monitoring terminal can highlight the self-service cash register terminal. Captured video information.
  • the name, number, area, etc. of the video information may be highlighted, or a warning identifier such as a red dot, an exclamation mark, etc. may be added to the video information.
  • a suspicious user operation can be highlighted in the background monitoring terminal to allow the background monitoring staff to perform targeted secondary confirmation of monitoring, which improves monitoring efficiency and reduces retail sales. Attrition.
  • the background monitoring terminal may further: in response to a user's operation event of viewing the highlighted video information, cancel the highlight display of the video information. For example, the user can view the video information by clicking the mouse.
  • the background monitoring terminal detects that the user has viewed the video information, it can cancel the highlighting of the video information to prevent the video information from being highlighted for a long time to affect the monitoring of the background monitoring personnel. effectiveness.
  • step 502 may include: obtaining a detection result of a user's missed scanning behavior obtained by the background monitoring terminal by processing the video information.
  • the task of detecting video information can be implemented in a background monitoring terminal to reduce the pressure on the self-service cash register terminal.
  • the background monitoring terminal can process the video information, detect the user's missed scanning behavior, and send a detection result of the user's missed scanning behavior to the self-service cash register terminal, so that the self-service cash register terminal can use the detection result to settle the item.
  • the background monitoring terminal can also directly highlight the corresponding video information when it detects that the user has missed scanning behavior through the video information. There is no need to go through a self-service cash register terminal in the middle, which improves the processing efficiency of the system.
  • FIG. 6 is a schematic flowchart of a fourth embodiment of a missing scan recognition method according to an embodiment of the present invention. This embodiment is based on the technical solution provided by the foregoing embodiment, and adds functions such as a settlement guide screen and a blacklist mechanism. If the user is on the blacklist, the self-service cashier terminal cannot be used for settlement. As shown in FIG. 6, the missing scan recognition method in this embodiment may include:
  • Step 601 Play a settlement guidance screen.
  • the self-service cash register terminal may play a settlement guidance screen, prompting the user to perform self-scanning code settlement.
  • the settlement guidance screen may be a static image, or may be a video, an animation, or the like.
  • the settlement guidance screen may include content for guiding a user to perform a settlement operation correctly, for example, it may include how to correctly take an item, how to perform a code scanning operation, and the like.
  • Step 602 In response to an operation event that the user starts scanning an item, collect video information of the user scanning the item.
  • the video capture function when the user does not start scanning the item, the video capture function may be temporarily disabled.
  • the video capture function When the user starts scanning the item, the video capture function is turned on to collect the video information of the user scanning the item. After you start collecting video information, you can identify missing scans in real time based on the algorithm.
  • users can confirm the start of scanning items in various ways.
  • options, keys, etc. for starting operations can be provided for the user to select.
  • a "start" button is displayed on the settlement guidance screen, and in response to an operation event when the user clicks the "start” button, video information of an item scanned by the user may be started to be collected.
  • the user can start collecting video information of the user's scanned item.
  • Step 603 Obtain a detection result of a user's missed scanning behavior according to the video information.
  • Step 604 Obtain the user's identity information in response to the user's card swipe operation information.
  • the user can swipe a card for settlement, and the card here may refer to any card that can identify the identity of the user, such as a membership card of a store.
  • the identity information of the user may refer to the user's name, member number, mobile phone number, ID number, and so on.
  • the user's identity information can also be obtained through face recognition, scanning the two-dimensional code of the user terminal, and so on.
  • Step 605 If the identity information of the user is not in the blacklist, settle the items scanned by the user according to the detection result.
  • the blacklist may be stored in a self-service cash register terminal, or may be stored in other devices such as a server, a background monitoring terminal, and the like, and the blacklist may be obtained through communication with other devices.
  • a forbidden settlement interface may be displayed, prompting the user "an exception occurred, please go to a manual window for settlement".
  • the scanning behavior of the user can be blocked in time.
  • the user's identity information can be obtained through face recognition technology. If the user's identity information is on the blacklist, before the user starts scanning the item, or during the process of scanning the item, the user can be reminded that "an abnormality has occurred. Manual window for settlement. "
  • the background monitoring terminal can be used to implement the function of adding a blacklist.
  • the background monitoring terminal may add the identity information of the user to the suspected blacklist in response to the operation event of the background monitoring personnel; display the identity information and corresponding video information in the suspected blacklist to the management personnel; An operation event of a manager adds the identity information of the user to a blacklist.
  • the background monitoring personnel can add the user's identity information to the suspected blacklist according to the user's behavior.
  • the background monitoring terminal can display "join the blacklist" on the interface that plays the user's video information.
  • the identity information of the user may be added to the suspected blacklist.
  • the background monitoring terminal can play the video information of the user who is suspected to be in the blacklist to the manager, and the manager can confirm whether to add it to the blacklist. If the manager confirms that the user has abnormal behavior, he can click the video playback interface. The corresponding button on the background monitoring terminal can add the user's identity information to the blacklist.
  • the identity information added to the blacklist can be applied across the entire network, or it can be applied at all chain stores, and users cannot make self-service settlement payments at any chain stores.
  • corresponding prompt information may be pushed to the user.
  • prompt information corresponding to the current number of missed scanning may be pushed. For example, if the number of missed scans is greater than 0 and less than 3, corresponding to the first-level prompt information, and the number of missed scans is greater than or equal to 3, corresponding to the second-level prompt information.
  • the first-level prompt information can be a weak prompt
  • the second-level prompt information can be a strong prompt, which improves the prompt effect for the user.
  • the first-level prompt can be "Dear, please confirm that the scanned product matches the actual number of products”
  • the second-level prompt can be "Is it difficult to scan, let the second person help you.”
  • a prompt message may be sent to the on-site monitoring terminal to prompt the on-site monitoring personnel to assist in processing.
  • video information and data logs can also be uploaded to the server, so that the server can perform algorithm optimization and report statistics based on the video information and data logs.
  • FIG. 7 is a schematic flowchart of a fifth embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • the method execution subject in this embodiment may be a self-service cash register terminal.
  • This embodiment is different from the foregoing embodiments in that processing of video information is performed in an image server.
  • the missing scan recognition method in this embodiment may include:
  • Step 701 Collect video information of an item scanned by a user.
  • Step 702 Send the video information to an image server.
  • Step 703 Receive a user behavior detection result obtained by the image server by processing the video information.
  • the user behavior detection result includes time information corresponding to a scanning action of the user, and the time information includes at least one of the following: a start time, an end time, and a time period in which the action is performed, which is scanned by the self-service cash register terminal according to the user
  • the detection result of the action determines whether there is a missing scan behavior.
  • the method may further include: determining whether the user has a leak according to the identifier of the item scanned within the time period where the scanning action is located Sweep behavior.
  • the detection result of the user behavior may include a detection result of the user ’s missed scanning behavior obtained according to the video information and the scanning result of the article, for example, may include whether the user has a missed scanning behavior, there are several missed scanning behaviors, and the like.
  • the method may further include: sending a scanning result of the item to the image server, so that the image server obtains a detection result of a user's missed scanning behavior according to the video information and the scanning result.
  • the user behavior detection result includes a detection result of a user's missed scanning behavior.
  • the scan result includes at least one of the following: an identification of the item, attribute information of the item, a time when the item was scanned, and the like.
  • FIG. 8 is a schematic flowchart of a sixth embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • the execution subject of the method in this embodiment may be an image server.
  • the missing scan recognition method in this embodiment may include:
  • Step 801 Obtain video information of a user's scanned item sent by a self-service cash register terminal.
  • Step 802 Obtain a user behavior detection result according to the video information.
  • Step 803 Send the user behavior detection result to the self-service cash register terminal.
  • obtaining a user behavior detection result according to the video information may include: determining a user's pose data based on the video information; and determining, based on the user's pose data, time information corresponding to a scanning action.
  • the time information includes the following: At least one item is described: a start time, an end time, and a time period in which the action is located; the user behavior detection result includes the time information.
  • the method may further include: receiving a scanning result of an item sent by a self-service cash register terminal; obtaining a detection result of a user's missed scanning behavior according to the video information and the scanning result; wherein the user behavior detection
  • the results include detection results of the user's missed scanning behavior.
  • obtaining the detection result of the user's missed scanning behavior according to the video information and the scanning result may include: identifying the attribute information of the item according to the video information; determining the attribute information of the item according to the scanning result of the item; If the attribute information of the item identified based on the video information is inconsistent with the attribute information of the item determined according to the scan result, it is determined that the user has a missed scanning behavior.
  • obtaining a detection result of a user's missed scanning behavior according to the video information and the scan result may include: identifying a type of an item according to the video information; determining a corresponding minimum price according to the type; and according to the item The result of the scan determines the price of the item; if the price of the item is lower than the minimum price, it is determined that the user has a missed scan behavior.
  • Embodiments 5 to 6 are different from the foregoing embodiments only in that the video information processing process is performed on the image server.
  • the specific implementation principles, processes, and effects can refer to the foregoing embodiments, and are not described here. To repeat.
  • FIG. 9 is a schematic flowchart of a seventh embodiment of a missing scan recognition method according to an embodiment of the present invention.
  • the execution subject of the method in this embodiment may be a background monitoring terminal.
  • the missing scan recognition method in this embodiment may include:
  • Step 901 Obtain video information of a user's scanned item sent by a self-service cash register terminal.
  • Step 902 Display the video information to a background monitoring person, so that the background monitoring person can determine whether the user has missed scanning behavior according to the video information.
  • Step 903 In response to an operation event in which the background monitoring personnel confirms that the user has a missed scanning behavior, sending a missed scanning instruction message to the self-service cash register terminal.
  • the method may further include: obtaining a warning instruction sent by the self-service cash register terminal when it detects a user's missing scanning behavior; and highlighting the video information of the user according to the warning instruction.
  • the method may further include: processing the video information to detect a user's missed scanning behavior; and sending a detection result of the user's missed scanning behavior to the self-service cash register terminal.
  • the method may further include: in response to an operation event of the background monitoring personnel, adding the user's identity information to the suspected blacklist; adding the identity information in the suspected blacklist and the corresponding video The information is displayed to the management personnel; in response to an operation event of the management personnel, the identity information of the user is added to the blacklist.
  • FIG. 10 is a schematic structural diagram of a first embodiment of a missing scan recognition device according to an embodiment of the present invention. As shown in FIG. 10, the apparatus may include:
  • a first acquisition module 11 configured to collect video information of a user's scanned item
  • the first detection module 12 is configured to obtain a detection result of a user's missed scanning behavior according to the video information.
  • the device may further include a settlement module, configured to settle the items scanned by the user according to the detection result.
  • a settlement module configured to settle the items scanned by the user according to the detection result.
  • a photographing device is provided within a preset range of a scan code area for a user to scan an item; correspondingly, the first acquisition module 11 may be specifically configured to: acquire the scan collected by the photographing device Video information in the code area.
  • the first detection module 12 may be specifically configured to: determine a user's pose data according to the video information; determine a time period in which a scanning action is located according to the user's pose data; and scan according to the time period The identification of the received item determines whether the user has missed scanning behavior during the time period.
  • the first detection module 12 may be specifically configured to: determine the pose data of the user according to the video information; determine the time period in which a scanning action is located according to the pose data of the user; One or more frames of images in the time period identify the attribute information of the item; determine the attribute information of the item according to the identification of the item scanned during the time period; if the attribute information identified by the video information is related to If the attribute information determined according to the identifier is inconsistent, it is judged that the user has a missed scanning behavior.
  • the first detection module 12 may be specifically configured to: determine the pose data of the user according to the video information; determine the time period in which a scanning action is located according to the pose data of the user; One or more frames of images in the time period identify the type of the item; determine the corresponding lowest price according to the type; determine the price of the item according to the identifier of the item scanned during the time period; if the item If the price is lower than the minimum price, it is judged that the user has a scan-missing behavior.
  • the settlement module may be specifically configured to: determine the number of missed scans of the user according to the detection result in response to the operation event that the user confirms that the item has been scanned; if the number of missed scans of the user is less than a first preset threshold , Then the items scanned by the user are settled.
  • the settlement module may be further configured to: if the number of missed scans of the user is not less than a first preset threshold, display a settlement prohibition interface, and / or send warning information to the on-site monitoring terminal.
  • the settlement module may be further configured to: after displaying the forbidden settlement interface, respond to the operation event of the on-site monitoring personnel, perform settlement for the items scanned by the user.
  • the settlement module may be further configured to obtain a password input by the on-site monitoring personnel after displaying the forbidden settlement interface, and if the password is a password used to release the prohibited settlement, perform settlement on the items scanned by the user;
  • the QR code provided by the on-site monitoring personnel is scanned, and if the QR code is a QR code used to cancel the prohibition of settlement, the item scanned by the user is settled.
  • the first collection module 11 may be further configured to send the collected video information to a background monitoring terminal, and the video information is used for the background monitoring terminal to play.
  • the first detection module 12 may be further configured to: if it is detected that the user has missed scanning behavior through the video information, send the background monitoring terminal to control the background monitoring terminal to highlight the user video. Informational warning instructions.
  • the settlement module 13 may be specifically configured to: obtain missing scan instruction information sent by the background monitoring terminal in response to an operation event of the background monitoring personnel to indicate that the user has a missing scan behavior; and respond to the user confirming the item scan For the completed operation event, if it is detected that the number of missed scans of the user is less than a first preset threshold according to the video information, and / or, it is determined that the number of missed scans of the user is less than a second preset scan according to the missed scan instruction information. Set a threshold to settle the items scanned by the user.
  • the first detection module 12 may be specifically configured to: process the video information to detect a user ’s missed scanning behavior; or obtain a pair obtained by the background monitoring terminal by processing the video information. Detection results of user missed scanning behavior.
  • the settlement module 13 may be specifically configured to: obtain the identity information of the user; determine whether the identity information of the user is in the blacklist; if not, perform settlement for the items scanned by the user according to the detection result.
  • the first detection module 12 may be further configured to: push the corresponding prompt information to the user according to the number of missed scans of the user.
  • the device shown in FIG. 10 can execute the missing scan recognition methods provided in the foregoing first to fourth embodiments.
  • the parts that are not described in detail in this embodiment reference may be made to the related description of the foregoing embodiment.
  • the implementation process and technical effect of the technical solution refer to the description in the foregoing embodiments, and details are not described herein again.
  • FIG. 11 is a schematic structural diagram of a second embodiment of a missing scan recognition device according to an embodiment of the present invention. As shown in FIG. 11, the device may include:
  • the second acquisition module 14 is configured to collect video information of an item scanned by a user
  • a first sending module 15 configured to send the video information to an image server
  • the first receiving module 16 is configured to receive a user behavior detection result obtained by the image server by processing the video information.
  • the user behavior detection result includes time information corresponding to one scanning action of the user, and the time information includes at least one of the following: a start time, an end time, and a time period in which the action is located.
  • the first receiving module 16 may be further configured to: after receiving the user behavior detection result obtained by processing the video information by the image server, according to the scanning result within the time period in which the scanning action is located The identification of the item determines whether the user has missed the scan.
  • the device shown in FIG. 11 can execute the missing scan identification method provided in the foregoing fifth embodiment.
  • the parts that are not described in detail in this embodiment reference may be made to the related description of the foregoing embodiment.
  • the implementation process and technical effect of the technical solution refer to the description in the foregoing embodiments, and details are not described herein again.
  • FIG. 12 is a schematic structural diagram of a third embodiment of a missing scan recognition device according to an embodiment of the present invention. As shown in FIG. 12, the device may include:
  • a first acquisition module 17 configured to acquire video information of a user-scanned item sent by a self-service cash register terminal
  • a second detection module 18 configured to obtain a user behavior detection result according to the video information
  • the second sending module 19 is configured to send the user behavior detection result to the self-service cash register terminal.
  • the second detection module 18 may be specifically configured to determine the pose data of the user according to the video information; determine the time information corresponding to a scanning action according to the pose data of the user, and the time information includes at least the following One item: a start time, an end time, and a time period in which the action is located; wherein the user behavior detection result includes the time information.
  • the second detection module 18 may be specifically configured to: receive a scan result of an item sent by a self-service cash register terminal; obtain a detection result of a user's missed scanning behavior according to the video information and the scan result; wherein, The user behavior detection result includes a detection result of a user's missed scanning behavior.
  • the second detection module 18 may be specifically configured to: receive the scan result of the item sent by the self-service cash register terminal; identify the attribute information of the item according to the video information; determine the attribute information of the item according to the scan result of the item; It is determined that the attribute information of the item is inconsistent with the attribute information of the item determined according to the scanning result according to the video information, and it is determined that the user has a missed scanning behavior.
  • the second detection module 18 may be specifically configured to: receive the scan result of the item sent by the self-service cash register terminal; identify the type of the item according to the video information; determine the corresponding lowest price according to the type; The scanning result determines the price of the item; if the price of the item is lower than the minimum price, it is judged that the user has a scan-missing behavior.
  • the device shown in FIG. 12 can execute the missing scan identification method provided in the foregoing sixth embodiment.
  • the parts that are not described in detail in this embodiment reference may be made to the related description of the foregoing embodiment.
  • the implementation process and technical effect of the technical solution refer to the description in the foregoing embodiments, and details are not described herein again.
  • FIG. 13 is a schematic structural diagram of a fourth embodiment of a missing scan recognition device according to an embodiment of the present invention. As shown in FIG. 13, the device may include:
  • a second obtaining module 110 configured to obtain video information of a user's scanned item sent by a self-service cash register terminal;
  • a display module 111 configured to display the video information to a background monitoring person, so that the background monitoring person determines whether the user has missed scanning behavior according to the video information;
  • the third sending module 112 is configured to send a missed scan instruction message to the self-service cash register terminal in response to an operation event in which the background monitoring personnel confirms that the user has a missed scan behavior.
  • the third sending module 112 may be further configured to: process the video information to detect a user's missed scanning behavior; and send a detection result of the user's missed scanning behavior to the self-service cash register terminal.
  • the third sending module 112 may be further configured to: add the identity information of the user to the suspected blacklist in response to an operation event of the background monitoring personnel; and add the identity in the suspected blacklist The information and corresponding video information are displayed to the management personnel; in response to an operation event of the management personnel, the identity information of the user is added to the blacklist.
  • the apparatus shown in FIG. 13 can execute the missing scan recognition method provided in the foregoing Embodiment 7.
  • the parts that are not described in detail in this embodiment reference may be made to the related description of the foregoing embodiment.
  • the implementation process and technical effect of the technical solution refer to the description in the foregoing embodiments, and details are not described herein again.
  • FIG. 14 is a schematic structural diagram of a self-service cash register terminal according to an embodiment of the present invention.
  • the self-service cash register terminal may include a first processor 21 and a first memory 22.
  • the first memory 22 is configured to store a program that supports a self-service cash register terminal to execute the missing scan recognition method provided by any of the foregoing embodiments, and the first processor 21 is configured to execute the first memory 22 Stored programs.
  • the program includes one or more computer instructions, wherein when the one or more computer instructions are executed by the first processor 21, the following steps can be implemented:
  • a detection result of a user's missed scanning behavior is obtained.
  • the first processor 21 is further configured to execute all or part of the steps in the foregoing embodiments shown in FIG. 1 to FIG. 4.
  • the structure of the self-service cash register terminal may further include a first communication interface 23, which is used for communication between the self-service cash register terminal and other devices or a communication network.
  • the self-service cash register terminal in this embodiment may be used as a part of the self-service cash register of the store, for example, it may be integrated inside the self-service cash register of the store, and connected to the display device, POS machine and other devices of the self-service cash register and realize corresponding functions.
  • the self-service cash register terminal may further include a display device, a POS machine, and the like.
  • the self-service cash register terminal provided with these devices does not need to be connected with other devices, and can independently implement a self-service cash register function.
  • FIG. 15 is a schematic structural diagram of another self-service cash register terminal according to an embodiment of the present invention.
  • the self-service cash register terminal shown in FIG. 15 is a device for assisting the first processor 21 in addition to the self-service cash register terminal shown in FIG. 14.
  • the self-service cash register terminal may further include: a photographing device 24 connected to the first processor, and the photographing device 24 may be a camera or the like;
  • the shooting device 24 is configured to collect video information of a user-scanned item and send it to the first processor 21, that is, the first processor 21 may collect video information of a user-scanned item through the shooting device 24.
  • the self-service cash register terminal may further include: a POS machine 25 and a display device 26; both the POS machine 25 and the display device 26 are connected to the first processor 21; the POS machine 25 is used for Scan and settle items.
  • the display device 26 is configured to: before the user starts scanning the item, display a settlement guide screen; when the user scans the item, display the scanned item information; when the user finishes scanning, display the settlement interface or the prohibition settlement interface.
  • the display device 26 may display a corresponding screen or information under the control of the first processor 21.
  • the first processor 21 when the first processor 21 needs to perform operations such as scanning, settlement, and display, it can be implemented by a device such as a POS machine 25 and a display device 26.
  • the first processor 21 can specifically settle items. Including: the first processor 21 performs settlement through the POS machine 25; the display of the forbidden settlement interface by the first processor 21 may specifically include: the first processor 21 displays the account through the display device 26 The forbidden settlement interface is described.
  • the first processor 21 may also perform scanning and settlement in other manners.
  • an item can be scanned by a bar code or two-dimensional code scanning device, and the price of the scanned item can be determined through communication with a database to settle the item.
  • a payment function such as Alipay can be implemented through a payment interface.
  • the self-service cash register terminal may further include: an alarm device 27; the alarm device 27 is connected to the first processor 21, and is configured to acquire the first processor 21 when it detects a user's missed scanning behavior
  • the preset condition may be set according to actual needs, for example, the number of missed scans may be less than a certain number.
  • the alarm device 27 may include at least one of the following: an indicator light, a vibrator, a speaker, and the like.
  • the alarm signal issued by the alarm device may include at least one of the following: a flashing indicator light, a vibrator vibrating, and a speaker playing an alarm signal.
  • FIG. 15 shows the self-service cash register terminal, which integrates a shooting device 24, a placing table, a POS machine 25, a display device 26, and an alarm device 27, etc., and can assist the first processor 21 to complete the self-service settlement operation. Suitable for promotion and application.
  • FIG. 16 is a schematic structural diagram of still another self-service cash register terminal according to an embodiment of the present invention.
  • the self-service cash register terminal may include a second processor 28 and a second memory 29.
  • the second memory 29 is configured to store a program that supports a self-service cash register terminal to execute the missing scan recognition method provided by any of the foregoing embodiments, and the second processor 28 is configured to execute the second memory 29 Stored programs.
  • the program includes one or more computer instructions, wherein when the one or more computer instructions are executed by the second processor 28, the following steps can be implemented:
  • the structure of the self-service cash register terminal may further include a second communication interface 210, which is used for the background monitoring terminal to communicate with other devices or a communication network.
  • FIG. 17 is a schematic structural diagram of an image server according to an embodiment of the present invention.
  • the image server may include a third processor 211 and a third memory 212.
  • the third memory 212 is configured to store a program that supports the image server to execute the missed scan recognition method provided by any of the foregoing embodiments, and the third processor 211 is configured to execute the program stored in the third memory 212 .
  • the program includes one or more computer instructions, and when the one or more computer instructions are executed by the third processor 211, the following steps can be implemented:
  • the image server may further include a third communication interface 213 in its structure, which is used for the background monitoring terminal to communicate with other devices or communication networks.
  • FIG. 18 is a schematic structural diagram of a background monitoring terminal according to an embodiment of the present invention.
  • the background monitoring terminal may include a fourth processor 214 and a fourth memory 215.
  • the fourth memory 214 is configured to store a program that supports a background monitoring terminal to execute the missing scan recognition method provided in any of the foregoing embodiments, and the fourth processor 214 is configured to execute the fourth memory 215. Stored programs.
  • the program includes one or more computer instructions, and when the one or more computer instructions are executed by the fourth processor 214, the following steps can be implemented:
  • the missed scan instruction information is sent to the self-service cash register terminal.
  • the structure of the background monitoring terminal may further include a fourth communication interface 216, which is used for the background monitoring terminal to communicate with other devices or a communication network.
  • the embodiment of the present invention also provides a schematic diagram of a self-service cash register system.
  • the self-service cash register system may include the self-service cash register terminal according to any one of the above embodiments and the background monitoring terminal according to any one of the above embodiments, and may further include an image server according to any of the above embodiments.
  • the self-service cash register system may further include: an on-site monitoring terminal.
  • the on-site monitoring terminal is configured to obtain warning information sent by the self-service cash register terminal when the number of missed scans of the user is not less than a first preset threshold, and push reminder information to the on-site monitoring personnel according to the warning information.
  • the on-site monitoring terminal is a wearable device, and the on-site monitoring terminal may be provided with a two-dimensional code for canceling settlement prohibition for scanning by the self-service cash register terminal.
  • the self-service cash register system may further include a background server.
  • the self-service cash register terminal can upload video information, data logs, etc. to a background server for the background server to perform algorithm optimization and the like.
  • an embodiment of the present invention provides a computer-readable storage medium storing computer instructions, and when the computer instructions are executed by a processor, causing the processor to perform the following actions:
  • a detection result of a user's missed scanning behavior is obtained.
  • the processor may also be caused to execute all or part of the steps involved in the missing scan identification method in the first to fourth embodiments.
  • an embodiment of the present invention provides another computer-readable storage medium that stores computer instructions.
  • the processor is caused to perform the following actions:
  • the processor may also be caused to execute all or part of the steps involved in the missing scan recognition method in the fifth embodiment.
  • an embodiment of the present invention provides another computer-readable storage medium that stores computer instructions.
  • the processor is caused to perform the following actions:
  • the processor may also be caused to execute all or part of the steps involved in the missing scan identification method in the sixth embodiment.
  • an embodiment of the present invention provides another computer-readable storage medium storing computer instructions.
  • the processor is caused to perform the following actions:
  • the missed scan instruction information is sent to the self-service cash register terminal.
  • the processor may also be caused to execute all or part of the steps involved in the missing scan identification method in the seventh embodiment.
  • the device embodiments described above are only schematic, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, may be located One place, or it can be distributed across multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without creative labor.
  • each embodiment can be implemented by adding a necessary universal hardware platform, and of course, it can also be implemented by a combination of hardware and software.
  • the above-mentioned technical solution essentially or part that contributes to the existing technology may be embodied in the form of a computer product.
  • the present invention may use one or more computer-usable storages containing computer-usable program code.
  • the form of a computer program product implemented on a medium including but not limited to disk storage, CD-ROM, optical storage, etc.).
  • These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable network-connected device to the floor in a particular manner, such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, the instructions
  • the device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
  • These computer program instructions can also be loaded onto a computer or other programmable network-connected device, so that a series of steps can be performed on the computer or other programmable device to produce a computer-implemented process, which can be executed on the computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.
  • a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.
  • processors CPUs
  • input / output interfaces output interfaces
  • network interfaces network interfaces
  • memory volatile and non-volatile memory
  • Memory may include non-persistent memory, random access memory (RAM), and / or non-volatile memory in computer-readable media, such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash memory
  • Computer-readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information can be stored by any method or technology.
  • Information may be computer-readable instructions, data structures, modules of a program, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), and read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, read-only disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media may be used to store information that can be accessed by computing devices.
  • computer-readable media does not include temporary computer-readable media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Multimedia (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Emergency Management (AREA)
  • Geometry (AREA)
  • Cash Registers Or Receiving Machines (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Image Analysis (AREA)

Abstract

本发明实施例提供一种漏扫识别方法、装置、自助收银终端及系统，其中方法包括：采集用户扫描物品的视频信息；根据所述视频信息，获取对用户的漏扫行为的检测结果。本发明实施例提供的漏扫识别方法、装置、自助收银终端及系统，能够避免或减少用户在使用自助收银终端时出现的漏扫行为，降低零售门店的经济损失，节省了人力物力，有效减少了自助收银终端的使用成本，有利于自助收银终端的推广和应用，并且通过视频处理实现防损功能，用户收银过程不受打扰，有效提高了用户体验度。

Description

漏扫识别方法、装置、自助收银终端及系统
本申请要求2018年08月28日递交的申请号为201810987941.7、发明名称为“漏扫识别方法、装置、自助收银终端及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及计算机技术领域，尤其涉及一种漏扫识别方法、装置、自助收银终端及系统。
背景技术
随着零售业的不断发展和电子科技的不断进步，卖场的结算方式也在不断发生变化。为了解决排队付款人数过多的问题，减轻卖场收银人员的负担，自助收银机应运而生。自助收银机大多设置在卖场出口处，能够让消费者以自助的方式扫描商品、结账付款，免去排队的过程，为消费者提供了极大的便利。
现有技术中，消费者在使用自助收银机时常常会出现漏扫等有意或无意的违规操作，为零售门店带来经济损失，如果安排店员对用户的自助扫码过程进行逐个盯防，又浪费人力物力，导致自助收银机的使用成本过高。
发明内容
有鉴于此，本发明实施例提供一种漏扫识别方法、装置、自助收银终端及系统，以降低自助收银终端的使用成本。
第一方面，本发明实施例提供一种漏扫识别方法，包括：
采集用户扫描物品的视频信息；
根据所述视频信息，获取对用户的漏扫行为的检测结果。
第二方面，本发明实施例提供一种漏扫识别方法，包括：
采集用户扫描物品的视频信息；
将所述视频信息发送给图像服务器；
接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
第三方面，本发明实施例提供一种漏扫识别方法，包括：
获取自助收银终端发送的用户扫描物品的视频信息；
根据所述视频信息得到用户行为检测结果；
将所述用户行为检测结果发送给所述自助收银终端。
第四方面，本发明实施例提供一种漏扫识别方法，包括：
获取自助收银终端发送的用户扫描物品的视频信息；
将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
第五方面，本发明实施例提供一种漏扫识别装置，包括：
第一采集模块，用于采集用户扫描物品的视频信息；
第一检测模块，用于根据所述视频信息，获取对用户的漏扫行为的检测结果。
第六方面，本发明实施例提供一种漏扫识别装置，包括：
第二采集模块，用于采集用户扫描物品的视频信息；
第一发送模块，用于将所述视频信息发送给图像服务器；
第一接收模块，用于接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
第七方面，本发明实施例提供一种漏扫识别装置，包括：
第一获取模块，用于获取自助收银终端发送的用户扫描物品的视频信息；
第二检测模块，用于根据所述视频信息得到用户行为检测结果；
第二发送模块，用于将所述用户行为检测结果发送给所述自助收银终端。
第八方面，本发明实施例提供一种漏扫识别装置，包括：
第二获取模块，用于获取自助收银终端发送的用户扫描物品的视频信息；
显示模块，用于将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
第三发送模块，用于响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
第九方面，本发明实施例提供一种自助收银终端，包括：第一存储器和第一处理器；所述第一存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第一处理器执行时实现上述第一方面所述的漏扫识别方法。
第十方面，本发明实施例提供一种自助收银终端，包括：第二存储器和第二处理器； 所述第二存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第二处理器执行时实现上述第二方面所述的漏扫识别方法。
第十一方面，本发明实施例提供一种图像服务器，包括：第三存储器和第三处理器；所述第三存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第三处理器执行时实现上述第三方面所述的漏扫识别方法。
第十二方面，本发明实施例提供一种后台监控终端，包括：第四存储器和第四处理器；所述第四存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第四处理器执行时实现上述第四方面所述的漏扫识别方法。
第十三方面，本发明实施例提供一种自助收银系统，包括上述第九方面所述的自助收银终端以及上述第十二方面所述的后台监控终端；或者，所述系统包括上述第十方面所述的自助收银终端、上述第十一方面所述的图像服务器以及上述第十二方面所述的后台监控终端。
本发明实施例提供了一种计算机存储介质，用于储存计算机程序，所述计算机程序使计算机执行时实现上述第一方面至第四方面中任一项所述的漏扫识别方法。
本发明实施例提供的漏扫识别方法、装置、自助收银终端及系统，在用户扫描物品时采集用户的视频信息，通过所述视频信息来检测用户的漏扫行为，得到的检测结果可以用于实现辅助结算或者报警等功能，避免或减少用户在使用自助收银终端时出现的漏扫行为，降低零售门店的经济损失，节省了人力物力，有效减少了自助收银终端的使用成本，有利于自助收银终端的推广和应用，并且通过视频处理实现防损功能，用户收银过程不受打扰，有效提高了用户体验度。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例提供的一种应用场景示意图；
图2为本发明实施例提供的漏扫识别方法实施例一的流程示意图；
图3为本发明实施例提供的一种自助收银终端的外观示意图；
图4为本发明实施例提供的漏扫识别方法实施例二的流程示意图；
图5为本发明实施例提供的漏扫识别方法实施例三的流程示意图；
图6为本发明实施例提供的漏扫识别方法实施例四的流程示意图；
图7为本发明实施例提供的漏扫识别方法实施例五的流程示意图；
图8为本发明实施例提供的漏扫识别方法实施例六的流程示意图；
图9为本发明实施例提供的漏扫识别方法实施例七的流程示意图；
图10为本发明实施例提供的漏扫识别装置实施例一的结构示意图；
图11为本发明实施例提供的漏扫识别装置实施例二的结构示意图；
图12为本发明实施例提供的漏扫识别装置实施例三的结构示意图；
图13为本发明实施例提供的漏扫识别装置实施例四的结构示意图；
图14为本发明实施例提供的一种自助收银终端的结构示意图；
图15为本发明实施例提供的另一种自助收银终端的结构示意图；
图16为本发明实施例提供的又一种自助收银终端的结构示意图；
图17为本发明实施例提供的一种图像服务器的结构示意图；
图18为本发明实施例提供的一种后台监控终端的结构示意图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
在本发明实施例中使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本发明。在本发明实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义，“多种”一般包含至少两种，但是不排除包含至少一种的情况。
应当理解，本文中使用的术语“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。
取决于语境，如在此所使用的词语“如果”、“若”可以被解释成为“在……时” 或“当……时”或“响应于确定”或“响应于检测”。类似地，取决于语境，短语“如果确定”或“如果检测(陈述的条件或事件)”可以被解释成为“当确定时”或“响应于确定”或“当检测(陈述的条件或事件)时”或“响应于检测(陈述的条件或事件)”。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的商品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种商品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的商品或者系统中还存在另外的相同要素。
本发明实施例提供的方法适用于任意需要收银的场合，例如超市、商场、卖场、商店等。图1为本发明实施例提供的一种应用场景示意图。如图1所示，自助收银终端可以与结算服务器、图像服务器、后台监控终端、现场监控终端通信。
具体地，自助收银终端可以设置在卖场的出口处或其它位置。用户可以在卖场内选取要购买的物品，然后，在自助收银终端扫描物品的条码，自助收银终端在用户扫描物品时采集用户的视频信息，并根据视频信息判断用户有没有漏扫行为。
结算服务器用于实现物品的查询和结算等功能。可选的，当用户在自助收银终端扫描一件物品后，自助收银终端可以将扫描到的物品的标识发送给结算服务器，结算服务器查询物品的信息如名称、价格等发送给自助收银终端，由自助收银终端显示给用户。当用户将全部物品扫描完毕后，结算服务器可以根据全部物品的价格生成支付信息，并根据用户的支付行为完成结算。
图像服务器用于实现视频信息的处理，具体地，自助收银终端在用户扫描物品的过程中，可以实时采集用户扫描物品的视频信息并发送给图像服务器，图像服务器能够对视频信息进行处理，得到对用户漏扫行为的检测结果，并反馈给自助收银终端，自助收银终端能够根据所述检测结果对用户扫描的商品进行结算。
后台监控终端用于供后台监控人员对用户的扫描行为进行监控。具体地，自助收银终端可以将实时采集到的用户扫描物品的视频信息发送给后台监控终端，由后台监控终端显示给后台监控人员，从而实现用户行为的人工监控，进一步保障门店经济利益。
现场监控终端用于供现场监控人员对用户的扫描行为进行监控。具体地，自助收银终端在用户的漏扫行为满足一定的条件，例如出现漏扫行为或者漏扫次数大于一定值时，可以向现场监控终端发送警示信息，现场监控终端可以由现场监控人员随身携带，现场监控人员收到警示信息后，可以前往自助收银终端协助用户完成扫描和结算。
本发明实施例提供了一种在用户自助结算的过程中对用户扫描物品的视频信息进行处理、得到对用户漏扫行为的检测结果的方法，所述检测结果可以用于后续的结算等步骤。图1示出的是本发明实施例一种可选的应用场景。本领域技术人员可以理解的是，具体的硬件架构可以根据实际需要来调整，只要能够实现通过视频信息对用户的漏扫行为进行检测即可。
例如，图像服务器的功能可以放在自助收银终端，由自助收银终端直接对视频信息进行处理，得到对用户漏扫行为的检测；结算服务器的功能也可以放在自助收银终端，自助收银终端可以存储有物品的标识与物品价格的对应关系，根据扫描到的物品的标识可以确定对应的价格；或者，图像服务器和结算服务器的功能可以集成在一个服务器中；或者，图像服务器或结算服务器的功能可以放在后台监控终端实现，等等。
下面结合如下的方法实施例以及附图对本发明实施例提供的漏扫识别方法的实现过程进行介绍。另外，下述各方法实施例中的步骤时序仅为一种举例，而非严格限定。
图2为本发明实施例提供的漏扫识别方法实施例一的流程示意图。本实施例中方法的执行主体可以为自助收银终端。如图2所示，本实施例中的漏扫识别方法，可以包括：
步骤201、采集用户扫描物品的视频信息。
步骤202、根据所述视频信息，获取对用户的漏扫行为的检测结果。
本发明实施例中的用户可以是指零售门店的消费者，物品可以是指用户购买的商品。物品上一般设置有条形码、二维码等标识，通过对标识的扫描可以实现对物品的结算。
图3为本发明实施例提供的一种自助收银终端的外观示意图。如图3所示，所述自助收银终端可以包括实现自助收银所需的功能装置如摄像头、显示屏、扫码口、放置台等。或者，自助收银终端可以不包括这些功能装置，自助收银终端可以嵌入在自助收银机中，自助收银机可以包括功能装置如摄像头、显示屏、扫码口、放置台等，自助收银终端通过与功能装置的交互来实现对漏扫识别方法。
所述显示屏能够显示用户扫描物品的信息，例如物品的名称、价格等。所述放置台用于放置物品，具体可以包括用于放置待扫描物品的待扫描区A、用于扫描物品的扫描区B、用于放置已扫描物品的已扫描区C。
所述放置台上方是供用户扫描物品的扫码区域，用户可以在扫码区域将物品的标识对准扫码口，从而实现对物品的扫描。
所述扫码区域的预设范围内可以设置有拍摄装置，例如图2所示的摄像头。所述预设范围可以根据实际需要来设置，例如可以为1米。
相应的，步骤201中的采集用户扫描物品的视频信息，可以包括：获取所述拍摄装置采集到的所述扫码区域的视频信息。
具体地，在用户扫描物品的过程中，自助收银终端可以通过摄像头实时采集用户的视频信息。所述摄像头可以设置在能够拍摄到用户扫描物品行为的位置，例如，设置在自助收银终端的顶部，等等。
根据实时获取到的视频信息，可以对用户的行为进行检测，检测结果可以包括用户是否存在漏扫行为，或者，用户的漏扫次数，或者，每一次检测到用户出现漏扫行为的时刻，等等。根据视频信息获取对用户的漏扫行为的检测结果的实现方式可以有多种，本发明实施例对此不作限制。
在一种可选的实施方式中，可以通过机器学习来分析用户的行为，例如通过机器学习来学习用户的手的模型、物品的模型等，并将模型用于实时漏扫检测。具体地，可以首先获取多个样本，每个样本中都包含有用户的行为数据例如手的运动轨迹、手的姿态等，还包含对应的行为标签例如是否属于漏扫行为、漏扫次数等，然后，通过神经网络等机器学习方式来得到用户行为模型。在门店正式营业过程中，可以直接根据实时采集到的视频信息确定用户对应的行为数据，并将行为数据输入至用户行为模型中，根据模型可以确定是否属于漏扫行为或者漏扫次数。
根据视频信息确定用户对应的行为数据可以有多种实现方式，例如，可以通过3D卷积、光流算法、运动分割算法等获取用户的行为数据。3D卷积通过堆叠多个连续的帧组成一个立方体，然后在立方体中运用3D卷积核，在这个结构中，卷积层中每一个特征map都会与上一层中多个邻近的连续帧相连，因此能够捕捉运动信息。光流(optical flow)算法是目前运动图像分析的重要方法，当物体在运动时，它在图像上对应点的亮度模式也在运动，这种图像亮度模式的表观运动(apparent motion)就是光流。运动分割是指在序列特征多种运动中，标记出与每一独立运动相关联的像素，并对这些像素按照各自所属的媒体对象进行聚类，其主要目的是从静止背景之中提取出作为前景的运动物体。此外，还可以通过OpenPose等算法来获取用户的手的多个关键点，并根据关键点确定用户手的姿态。
在另一种可选的实施方式中，可以将用户拿取一次物品记为一个完整的动作，判断每一个完整的动作过程中是否出现了扫码行为，若一个完整的动作中没有出现扫码行为，则认为是漏扫。
具体地，步骤202中的根据所述视频信息，获取对用户的漏扫行为的检测结果，可 以包括：根据所述视频信息确定用户的姿态数据；根据所述用户的姿态数据，确定一个扫描动作所在的时间段；根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为。
如何截取一个完整的扫描动作可以有很多种实现方式。例如，自助收银终端的左侧用于放置待扫描的物品，右侧用于放置已扫描的物品，那么用户的手向右移动被认为是拿来扫描的操作，向左移动被认为是返回的操作，一来一回作为一个完整的动作。或者，用户的手从扫描区域的左边界移动到右边界，就认为是一个完整的动作，这个动作中应该伴随着物品被扫码，否则就是漏扫行为。或者，根据用户的动作轨迹可以判断用户的拿起物品的时刻和放下物品的时刻，根据拿起物品的时刻和放下物品的时刻，可以确定一个完整的动作。
是否出现扫码行为可以通过自助收银终端的扫码装置获取到的信号来判断，或者，也可以通过POS(point of sale，销售终端)机或其它类似的设备来判断，POS机能够识别物品的条形码或二维码，并确定对应的名称、价格等。
如果一个动作所在的时间段内POS机或其它扫描装置没有扫描到的物品的标识，则确定用户在所述时间段内存在漏扫行为，除此之外，如果扫描到物品的标识，但是扫描的物品的信息与通过视频信息确定的物品的信息不一致，也可以认为出现了漏扫行为，防止用户作弊，用假的标识代替真的标识，给门店带来损失。
可选的，根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为，可以包括：
根据所述视频信息在所述时间段内的一帧或多帧图像识别所述物品的属性信息；根据所述时间段内扫描到的物品的标识确定所述物品的属性信息；若根据所述视频信息识别到的属性信息与根据标识确定的属性信息不一致，则判断用户存在漏扫行为。
其中，所述物品的属性信息可以包括下述至少一项：物品的名称、价格、类型、尺寸、颜色等。
可选的，可以根据视频信息判断物品的类型，根据类型可以确定物品的价格区间，如果扫描的物品的价格不在该区间内，就认为出现了漏扫行为。例如，根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为，可以包括：
根据所述视频信息在所述时间段内的一帧或多帧图像识别所述物品的类型；根据所述类型确定对应的最低价格；根据所述时间段内扫描到的物品的标识确定所述物品的价格；若所述物品的价格低于所述最低价格，则判断用户存在漏扫行为。
例如，通过对视频信息进行处理发现，用户扫描第一个物品的开始时间为19:00:00，结束时间为19:00:05，则19:00:00至19:00:05这一段时间就是一个扫描动作所在的时间段，如果这一时间段没有扫描到物品的标识，则认为出现了漏扫行为。若扫描到了物品的标识，但是通过标识确定物品是口香糖，而通过视频信息可以确定该物品是大桶饮品，或者，通过标识确定物品的价格为1元，但是通过视频信息确定物品的最低价格为10元，则说明通过标识确定的物品信息与通过视频信息检测到的物品信息不一致，同样可以认为出现了漏扫行为。
根据视频信息识别物品的属性信息可以通过大数据分析和机器学习等方法来实现。
这样，通过对视频信息进行分析可以确定一个完整的动作所经历的时段，还可以确定视频中的物品信息，通过POS机等可以确定这一时段内是否有物品被扫描以及被扫描的物品的信息，从而确定用户是否出现漏扫行为。
在对视频信息进行检测后，还可以根据检测结果对用户扫描的物品进行结算。具体地，若所述检测结果满足预设的条件，则可以对用户扫描的物品进行结算，用户正常完成支付后可以带着物品离开。若不满足预设的条件，则不允许对物品进行结算。所述预设的条件可以根据实际需要来设置。
在一种可选的实施方式中，只要检测到用户存在漏扫行为，则不允许对物品进行结算，只有用户在整个扫描过程中不存在漏扫行为，才能够正常进行结算。
在另一种可选的实施方式中，只要所述用户的漏扫次数小于一定值，就允许对用户扫描的物品进行结算，能够为视频检测算法提供容错空间，防止误判影响用户购物体验，节省购物流程。
可选的是，根据检测结果对用户扫描的物品进行结算，可以包括：响应于所述用户确认物品扫描完毕的操作事件，根据检测结果确定用户的漏扫次数；若所述用户的漏扫次数小于第一预设阈值，则对用户扫描的物品进行结算。
所述用户确认物品扫描完毕的操作事件，可以是指用户通过点击屏幕、按下按键、语音输入等方式确定全部物品已经扫描完毕的操作，例如，在自助收银终端上可以显示“完成”等按钮，用户在将全部物品扫描完毕时，可以点击“完成”按钮，自助收银终端响应于用户的点击操作，可以根据检测结果对用户扫描的物品进行结算。
若所述用户的漏扫次数不小于第一预设阈值，则不允许对物品进行结算。所述第一预设阈值可以根据实际需要来设置，例如可以为4次。
在不允许对物品进行结算时，可以采取相应的措施对用户进行提示，如显示禁止结算界面等。具体地，所述禁止结算界面用于提示用户无法进行结算，可选的，所述禁止结算界面上可以显示“检测到您存在漏扫行为，无法进行结算”，或者，可以显示“存在漏扫行为，需要店员前来处理”等等。
在实际应用中，自助收银终端在用户扫描物品时采集用户的视频信息，并根据视频信息对用户的行为进行检测，判断用户有没有漏扫行为，只有在用户的行为满足一定条件，例如没有出现漏扫行为或者用户漏扫的次数小于预设次数时才允许用户正常进行支付，否则可以阻断用户的支付行为，防止用户漏扫为商家带来损失。
此外，本发明实施例采用视频信息检测用户是否存在漏扫行为，相对于现有技术中的利用称重装置进行结算的方法有着显著的进步。
现有技术中，在自助收银终端设置有称重机，利用重力感应来称重防损，把扫码物品对应的重量与称重机上的物品的重量进行对比，如果重量不同则提示报警，从而实现称重防损，机器本身占地较大，而且每件商品必须称重，用户体验欠佳。而本发明实施例提供的漏扫识别方法，通过视频处理来实现防损功能，用户无感知，减少对用户的干扰，使得用户收银过程不受打扰，能够有效提升用户体验度，节约门店空间，适用范围更广，可塑性更强。
综上，本实施例提供的漏扫识别方法，在用户扫描物品时采集用户的视频信息，通过所述视频信息来检测用户的漏扫行为，得到的检测结果可以用于实现辅助结算或者报警等功能，避免或减少用户在使用自助收银终端时出现的漏扫行为，降低零售门店的经济损失，节省了人力物力，有效减少了自助收银终端的使用成本，有利于自助收银终端的推广和应用，并且通过视频处理实现防损功能，用户收银过程不受打扰，有效提高了用户体验度。
图4为本发明实施例提供的漏扫识别方法实施例二的流程示意图。本实施例是在上述实施例提供的技术方案的基础上，在用户存在漏扫行为时，可以提示店内的现场监控人员前去处理。如图4所示，本实施例中的漏扫识别方法，可以包括：
步骤401、采集用户扫描物品的视频信息。
步骤402、根据所述视频信息，获取对用户的漏扫行为的检测结果。
步骤403、响应于所述用户确认物品扫描完毕的操作事件，根据检测结果确定用户的漏扫次数。
可选的，若所述用户的漏扫次数小于第一预设阈值，则对用户扫描的物品进行结算。
步骤404、若所述用户的漏扫次数不小于第一预设阈值，则显示禁止结算界面，并向现场监控终端发送警示信息。
具体地，如果所述用户的漏扫次数大于等于第一预设阈值，则可以对用户的结算进行阻断，显示禁止结算界面，同时还可以向现场监控终端发送警示信息，以提醒现场监控人员。
所述现场监控终端可以是现场监控人员携带的任意终端，例如手机或可穿戴设备如手表、智能手环等，所述现场监控人员可以是门店小二等用于在现场协助用户完成自助收银的人员。
所述现场监控终端接收到所述警示信息后，可以根据所述警示信息向现场监控人员推送所述提醒信息，提示现场监控人员进行处理。例如，可以显示或播放“xx号收银机检测到漏扫行为，请前去处理”。
在其它可选的实施方式中，也可以仅显示禁止结算界面，不发送警示信息，由用户自行寻求现场监控人员的帮助。
步骤405、响应于现场监控人员的操作事件，对用户扫描的物品进行结算。
现场监控人员在接收到警示信息后，可以前往用户所在的自助收银终端协助用户进行结算。
具体地，若现场监控人员发现用户购买的物品与自助收银终端上显示的用户已扫描的物品完全一致，则可以解除阻断，允许用户正常支付；若现场监控人员发现用户购买的物品与自助收银终端上显示的用户已扫描的物品不一致，则说明用户可能存在漏扫行为，此时现场监控人员可以协助用户完成扫描，并在正确扫描全部物品后，解除阻断，允许用户正常支付。
解除阻断的方式可以有很多种，例如，现场监控人员可以在自助收银终端输入密码，从而解除阻断。
可选的，步骤405中的响应于现场监控人员的操作事件，对用户扫描的物品进行结算，可以包括：获取现场监控人员输入的密码，若所述密码为用于解除禁止结算的密码，则对用户扫描的物品进行结算。
或者，现场监控人员携带的现场监控终端可以设置有二维码，当现场监控人员确认用户已经正确扫描全部物品时，可以用所述自助收银终端的扫描该二维码，从而解除阻断。
相应的，步骤405中的响应于现场监控人员的操作事件，对用户扫描的物品进行结算，可以包括：扫描现场监控人员提供的二维码，若所述二维码为用于解除禁止结算的二维码，则对用户扫描的物品进行结算。
在其它可选的实施方式中，也可以诸如通过自助收银终端拍摄现场监控人员的特定表情、现场监控人员语音输入特定关键词、通过现场监控终端与自助收银终端的其它交互等方式来解除阻断，本实施例对此不作限制。
综上，本实施例提供的漏扫识别方法，在用户扫描物品完毕后，根据检测结果确定用户的漏扫次数，若所述用户的漏扫次数满足一定的条件，则可以显示禁止结算界面，并向现场监控终端发送警示信息，提示现场监控人员前来处理，在现场监控人员协助用户完成扫描后，自助收银终端响应于现场监控人员的操作事件，对用户扫描的物品进行结算，能够在用户扫描出现问题时及时通知现场监控人员协助处理，提高用户自助收银的效率，且有效避免了门店的经济损失。
图5为本发明实施例提供的漏扫识别方法实施例三的流程示意图。本实施例是在上述各实施例提供的技术方案的基础上，在通过自助收银终端对用户行为进行监测的同时，还通过后台监控终端进行监控。如图5所示，本实施例中的漏扫识别方法，可以包括：
步骤501、采集用户扫描物品的视频信息，并将所述视频信息发送给后台监控终端。
具体地，可以实时采集用户扫描物品的视频信息，并实时发送给后台监控终端，所述视频信息用于供所述后台监控终端播放，以使后台监控人员可以根据所述视频信息对所述用户的行为进行监控。
所述后台监控人员可以是门店内用于监控视频的工作人员，所述后台监控终端可以是任意具有视频播放功能的终端如手机、平板设备、计算机、智能电视、显示器等。
步骤502、根据所述视频信息，获取对用户的漏扫行为的检测结果。
步骤503、获取后台监控终端响应于后台监控人员的操作事件发送的用于指示用户出现漏扫行为的漏扫指示信息。
具体地，步骤502中，可以通过算法对所述视频信息进行处理，检测用户的漏扫行为，是一种机器检测行为。步骤503中，后台监控人员可以在发现用户出现漏扫行为时进行相应的操作，是一种人工监控方式。
可选的，后台监控终端获取到自助收银终端发送的用户扫描物品的视频信息后，可以将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户 是否出现漏扫行为；响应于后台监控人员确认用户出现漏扫行为的操作事件，后台监控终端可以向自助收银终端发送漏扫指示信息，以使所述自助收银终端根据所述漏扫指示信息对用户扫描的物品进行结算。
后台监控人员确认用户出现漏扫行为的操作事件可以有多种实现方式，例如，在后台监控终端的视频播放界面中可以显示“有问题”的按钮，当后台监控人员根据监控画面(即所述用户的视频信息)发现用户出现漏扫行为，则可以按下“有问题”按钮，从而后台监控终端可以向自助收银终端发送漏扫指示信息。或者，后台监控人员可以通过语音、点击键盘按键等方式确认用户出现漏扫行为。
步骤504、响应于所述用户确认物品扫描完毕的操作事件，若根据所述视频信息检测到所述用户的漏扫次数小于第一预设阈值，和/或，根据所述漏扫指示信息确定所述用户的漏扫次数小于第二预设阈值，则对用户扫描的物品进行结算。
本实施例中，自助收银终端可以通过两种途径来对用户的漏扫行为进行检测：一是通过算法对视频信息进行处理，确定用户的漏扫次数；二是由后台监控人员通过视频对用户的行为进行监控，确定用户的漏扫次数。
在用户确认物品扫描完毕时，可以根据通过算法得到的漏扫次数和/或通过人工监控得到的漏扫次数确定是否允许对用户扫描的物品进行结算。
在一种可选的实施方式中，步骤504可以包括：响应于所述用户确认物品扫描完毕的操作事件，若根据所述视频信息检测到所述用户的漏扫次数小于第一预设阈值，则对用户扫描的物品进行结算；若不小于第一预设阈值，则进行阻断。
在另一种可选的实施方式中，步骤504可以包括：响应于所述用户确认物品扫描完毕的操作事件，若根据所述漏扫指示信息确定所述用户的漏扫次数小于第二预设阈值，则对用户扫描的物品进行结算；若不小于第二预设阈值，则进行阻断。
可选的，后台监控人员可以在每发现一次用户出现漏扫行为时点击一次“有问题”，后台监控人员可以向自助收银终端发送一次漏扫指示信息。自助收银终端可以根据用户扫描过程收到的漏扫指示信息的次数确定用户的漏扫次数。
若后台监控人员确认的用户漏扫次数小于第二预设阈值，则允许用户正常进行结算。所述第二预设阈值可以根据实际需要来设置，例如可以为2次。
在另一种可选的实施方式中，步骤504可以包括：响应于所述用户确认物品扫描完毕的操作事件，若根据所述视频信息检测到所述用户的漏扫次数小于第一预设阈值并且根据所述漏扫指示信息确定所述用户的漏扫次数小于第二预设阈值，则对用户扫描的物 品进行结算；若根据所述视频信息检测到所述用户的漏扫次数不小于第一预设阈值，或者，根据所述漏扫指示信息确定所述用户的漏扫次数不小于第二预设阈值，则进行阻断。
例如，只有在通过对视频信息进行处理得到的漏扫次数小于4次、并且后台监控人员确认用户的漏扫次数小于2次时，才允许用户正常结算；若是通过对视频信息进行处理得到的漏扫次数不小于4次，或者后台监控人员确认用户的漏扫次数不小于2次，则禁止结算。
在另一种可选的实施方式中，步骤504可以包括：响应于所述用户确认物品扫描完毕的操作事件，若根据所述视频信息检测到所述用户的漏扫次数小于第一预设阈值或者根据所述漏扫指示信息确定所述用户的漏扫次数小于第二预设阈值，则对用户扫描的物品进行结算；若根据所述视频信息检测到所述用户的漏扫次数不小于第一预设阈值并且根据所述漏扫指示信息确定所述用户的漏扫次数不小于第二预设阈值，则进行阻断。
在上述各实施方式中，进行阻断的实现方法可以参照上述实施例，例如可以包括显示禁止结算界面、向现场监控终端发送警示信息等等。
综上，本发明实施例提供的漏扫识别方法，自助收银终端可以对采集到的视频信息进行处理，检测用户的漏扫行为，同时可以将采集到的视频信息发送给后台监控终端，所述视频信息用于供所述后台监控终端播放，使得后台监控人员可以根据实时采集的视频信息对用户行为进行监控，并在发现用户的漏扫行为时向自助收银终端反馈，自助收银终端可以在所述用户确认物品扫描完毕后，可以根据通过所述视频信息检测到的漏扫次数，或者根据后台监控人员反馈的信息确定的漏扫次数，来决定是否进入正常的结算流程，能够实现算法和人工的双重监控，进一步提高防损效果。
可选的，当一家门店有多个自助收银终端时，后台监控终端可以与所述多个自助收银终端进行通信，获取多个自助收银终端拍摄的视频信息并显示给后台监控人员。
进一步地，若通过所述视频信息检测到用户出现漏扫行为，自助收银终端还可以向后台监控终端发送用于控制所述后台监控终端突出显示所述用户视频信息的警示指令。
具体地，自助收银终端可以对所述视频信息进行处理，实时检测用户的漏扫行为，若检测到用户出现漏扫行为，则向后台监控终端发送警示指令，所述后台监控终端获取到警示指令后，可以根据所述警示指令，突出显示所述用户的视频信息。
例如，后台监控终端的显示界面上显示了多个视频信息，当某个自助收银终端检测到用户出现漏扫行为时，可以向后台监控终端发送警示信息，后台监控终端可以突出显示该自助收银终端采集的视频信息。
突出显示的方式有很多种，只要能够实现将出现漏扫行为的视频信息与其它视频信息作出区分即可，方便提示后台监控人员对可能有问题的用户进行重点监控。可选的，可以高亮所述视频信息的名称、编号、所在区域等，或者在视频信息中增加警示标识如红点、感叹号等。
这样，在通过视频信息检测到用户存在漏扫行为时，可以在后台监控终端对可疑用户操作进行高亮提示，让后台监控人员有目标地进行监控二次确认，提升了监控效率，降低了零售耗损。
进一步地，后台监控终端还可以：响应于用户查看被突出显示的视频信息的操作事件，取消对所述视频信息的突出显示。例如，用户可以通过点击鼠标来查看视频信息，当后台监控终端检测到用户查看了视频信息，则可以取消对所述视频信息的高亮，避免视频信息长期处于高亮状态影响后台监控人员的监控效率。
在上述实施例提供的技术方案的基础上，可选的是，步骤502可以包括：获取所述后台监控终端通过对所述视频信息进行处理得到的对用户漏扫行为的检测结果。
具体地，可以将对视频信息进行检测的工作放到后台监控终端来实现，减轻自助收银终端的压力。后台监控终端可以对所述视频信息进行处理，检测用户的漏扫行为，并向所述自助收银终端发送对用户的漏扫行为的检测结果，方便自助收银终端利用检测结果对物品进行结算。
可以理解的是，在将对视频信息进行检测的工作放到后台监控终端执行的情况下，后台监控终端还可以在通过视频信息检测到用户出现漏扫行为时，直接突出显示对应的视频信息，中间无需经过自助收银终端，提高了系统的处理效率。
图6为本发明实施例提供的漏扫识别方法实施例四的流程示意图。本实施例是在上述实施例提供的技术方案的基础上，增加了结算引导画面和黑名单机制等功能，若用户在黑名单中，则无法使用自助收银终端进行结算。如图6所示，本实施例中的漏扫识别方法，可以包括：
步骤601、播放结算引导画面。
具体地，在用户开始扫描物品之前，自助收银终端可以播放结算引导画面，提示用户进行自助扫码结算。所述结算引导画面可以是静态的图像，也可以是视频、动画等。所述结算引导画面可以包括用于引导用户正确进行结算操作的内容，例如可以包括如何正确地拿取物品、如何进行扫码操作等。
步骤602、响应于用户开始扫描物品的操作事件，采集用户扫描物品的视频信息。
本实施例中，在用户未开始扫描物品时，可以暂不开启视频采集功能。在用户开始扫描物品时，才开启视频采集的功能，采集用户扫描物品的视频信息。开始采集视频信息后，可以根据算法实时地进行漏扫识别。
在实际应用中，用户可以通过多种方式来确认开始扫描物品。可选的，可以提供开始操作的选项、按键等，供用户选择。例如，在结算引导画面上显示“开始”按钮，响应于用户点击所述“开始”按钮的操作事件，可以开始采集用户扫描物品的视频信息。或者，可以在用户拿取物品扫描成功后，开始采集用户扫描物品的视频信息。
步骤603、根据所述视频信息，获取对用户的漏扫行为的检测结果。
步骤604、响应于用户刷卡的操作信息，获取用户的身份信息。
具体地，用户在全部物品扫描完毕后，可以刷卡进行结算，这里的卡可以是指门店的会员卡等任意能够识别用户身份的卡片。所述用户的身份信息可以是指用户的姓名、会员号码、手机号码、身份证号等等。
在其它的实现方式中，也可以通过人脸识别、扫描用户终端二维码等方式来获取用户的身份信息。
步骤605、若所述用户的身份信息不在黑名单中，则根据检测结果对用户扫描的物品进行结算。
其中，黑名单可以存储在自助收银终端中，也可以存储在其它设备如服务器、后台监控终端等，通过与其它设备的通信来获取黑名单。
若用户的身份信息在所述黑名单中，则禁止用户在自助收银终端进行结算。具体地，可以显示禁止结算界面，提示用户“出现异常，请前往人工窗口进行结算”。
在其它可选的实施方式中，如果可以提前获知用户的身份信息，则可以及时对用户的扫描行为进行阻断。例如，可以通过人脸识别技术获取用户的身份信息，若用户的身份信息在黑名单中，则在用户开始扫描物品之前，或者在用户扫描物品的过程中，可以提醒用户“出现异常，请前往人工窗口进行结算”。
进一步地，后台监控终端可以用于实现添加黑名单的功能。可选的，后台监控终端可以响应于后台监控人员的操作事件，将用户的身份信息添加到疑似黑名单；将所述疑似黑名单中的身份信息及对应的视频信息显示给管理人员；响应于管理人员的操作事件，将所述用户的身份信息添加到黑名单。
具体地，后台监控人员在对视频进行监控的过程中，可以根据用户的行为将用户的 身份信息添加到疑似黑名单，例如，后台监控终端可以在播放用户视频信息的界面显示“加入黑名单”的按钮，响应于后台监控人员点击所述按钮的操作，可以将所述用户的身份信息添加到疑似黑名单中。
然后，门店的管理人员可以对疑似黑名单中的用户进行核实。具体地，后台监控终端可以将疑似黑名单中的用户的视频信息播放给管理人员，由管理人员确认是否将其添加到黑名单中，若管理人员确认用户存在异常行为，则可以点击视频播放界面上的相应按钮，后台监控终端可以将用户的身份信息添加到黑名单中。
添加到黑名单中的身份信息可以在全网应用，或者，可以在所有的连锁门店应用，用户不能在任何连锁门店进行自助结算支付。
综上，本实施例提供的漏扫识别方法，增加了黑名单功能，在用户扫描物品完毕后，如果用户不在黑名单内，且用户的漏扫行为满足预设的条件，则可以正常支付，若用户在黑名单内，则不允许用户进行自助结算支付，从而有效保障门店的经济利益。
在上述各实施例提供的技术方案的基础上，可选的是，还可以根据检测到的所述用户的漏扫次数，向所述用户推送对应的提示信息。
具体地，在用户扫描物品的过程中，当检测到用户出现漏扫行为时，可以推送与当前漏扫次数对应的提示信息。例如，漏扫次数大于0小于3，对应一级提示信息，漏扫次数大于等于3，对应二级提示信息。一级提示信息可以为弱提示，二级提示信息可以为强提示，提高对用户的提示效果。
例如，一级提示信息可以为“亲，请确认已扫商品与实际商品数量相匹配哦”，二级提示信息可以为“扫描有困难吗，让小二来帮助你吧”。
此外，还可以显示“帮助”按钮。响应于用户按下帮助按钮的操作，可以向现场监控终端发送提示消息，提示现场监控人员协助处理。
在上述各实施例提供的技术方案的基础上，可选的是，还可以将视频信息以及数据日志上传至服务器，以使服务器根据视频信息和数据日志进行算法优化、报表统计等。
图7为本发明实施例提供的漏扫识别方法实施例五的流程示意图。本实施例中方法的执行主体可以为自助收银终端。本实施例与前述各实施例不同的是，将对视频信息的处理放到图像服务器中来执行。如图7所示，本实施例中的漏扫识别方法，可以包括：
步骤701、采集用户扫描物品的视频信息。
步骤702、将所述视频信息发送给图像服务器。
步骤703、接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
可选的，所述用户行为检测结果包括用户一个扫描动作对应的时间信息，所述时间信息包括下述至少一项：开始时间、结束时间、动作所在的时间段，由自助收银终端根据用户扫描动作的检测结果确定是否存在漏扫行为。
相应的，在接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果之后，还可以包括：根据所述扫描动作所在的时间段内扫描到的物品的标识确定用户是否存在漏扫行为。
或者，所述用户行为检测结果可以包括根据视频信息和物品的扫描结果得到的对用户漏扫行为的检测结果，例如可以包括用户是否存在漏扫行为，存在几次漏扫行为等等。
具体地，所述方法还可以包括：将物品的扫描结果发送给所述图像服务器，以使所述图像服务器根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果。相应的，所述用户行为检测结果包括对用户的漏扫行为的检测结果。
其中，所述扫描结果包括下述至少一项：物品的标识、物品的属性信息、物品被扫描的时间，等等。
图8为本发明实施例提供的漏扫识别方法实施例六的流程示意图。本实施例中方法的执行主体可以为图像服务器。如图8所示，本实施例中的漏扫识别方法，可以包括：
步骤801、获取自助收银终端发送的用户扫描物品的视频信息。
步骤802、根据所述视频信息得到用户行为检测结果。
步骤803、将所述用户行为检测结果发送给所述自助收银终端。
可选的，根据所述视频信息得到用户行为检测结果，可以包括：根据所述视频信息确定用户的姿态数据；根据用户的姿态数据，确定一个扫描动作对应的时间信息，所述时间信息包括下述至少一项：开始时间、结束时间、动作所在的时间段；所述用户行为检测结果包括所述时间信息。
可选的，所述方法还可以包括：接收自助收银终端发送的物品的扫描结果；根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果；其中，所述用户行为检测结果包括对用户的漏扫行为的检测结果。
可选的，根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果，可以包括：根据所述视频信息识别物品的属性信息；根据物品的扫描结果确定物品的属性信息；若根据所述视频信息识别到物品的属性信息与根据扫描结果确定的所述物品的属 性信息不一致，则判断用户存在漏扫行为。
可选的，根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果，可以包括：根据所述视频信息识别物品的类型；根据所述类型确定对应的最低价格；根据物品的扫描结果确定所述物品的价格；若所述物品的价格低于所述最低价格，则判断用户存在漏扫行为。
实施例五至实施例六与上述各实施例的不同之处仅在于将视频信息处理的过程放在图像服务器执行，具体的实现原理、过程和效果均可以参照前述各实施例，此处不再赘述。
图9为本发明实施例提供的漏扫识别方法实施例七的流程示意图。本实施例中方法的执行主体可以为后台监控终端。如图9所示，本实施例中的漏扫识别方法，可以包括：
步骤901、获取自助收银终端发送的用户扫描物品的视频信息。
步骤902、将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为。
步骤903、响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
可选的，所述方法还可以包括：获取所述自助收银终端在检测到用户出现漏扫行为时发送的警示指令；根据所述警示指令，突出显示所述用户的视频信息。
可选的，所述方法还可以包括：对所述视频信息进行处理，检测用户的漏扫行为；向所述自助收银终端发送对用户的漏扫行为的检测结果。
可选的，所述方法还可以包括：响应于所述后台监控人员的操作事件，将所述用户的身份信息添加到疑似黑名单中；将所述疑似黑名单中的身份信息及对应的视频信息显示给管理人员；响应于管理人员的操作事件，将所述用户的身份信息添加到黑名单中。
本实施例提供的漏扫识别方法的具体实现原理和过程与上述各实施例类似，本实施例未详细描述的部分，可参考对前述实施例的相关说明。该技术方案的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。
以下将详细描述本发明的一个或多个实施例的漏扫识别装置。本领域技术人员可以理解，这些漏扫识别装置均可使用市售的硬件组件通过本方案所教导的步骤进行配置来构成。
图10为本发明实施例提供的漏扫识别装置实施例一的结构示意图。如图10所示，该装置可以包括：
第一采集模块11，用于采集用户扫描物品的视频信息；
第一检测模块12，用于根据所述视频信息，获取对用户的漏扫行为的检测结果。
可选的，所述装置还可以包括结算模块，用于根据检测结果对用户扫描的物品进行结算。
可选的，用于供用户扫描物品的扫码区域的预设范围内设置有拍摄装置；相应的，所述第一采集模块11具体可以用于：获取所述拍摄装置采集到的所述扫码区域的视频信息。
可选的，第一检测模块12具体可以用于：根据所述视频信息确定用户的姿态数据；根据所述用户的姿态数据，确定一个扫描动作所在的时间段；根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为。
可选的，第一检测模块12具体可以用于：根据所述视频信息确定用户的姿态数据；根据所述用户的姿态数据，确定一个扫描动作所在的时间段；根据所述视频信息在所述时间段内的一帧或多帧图像识别所述物品的属性信息；根据所述时间段内扫描到的物品的标识确定所述物品的属性信息；若根据所述视频信息识别到的属性信息与根据标识确定的属性信息不一致，则判断用户存在漏扫行为。
可选的，第一检测模块12具体可以用于：根据所述视频信息确定用户的姿态数据；根据所述用户的姿态数据，确定一个扫描动作所在的时间段；根据所述视频信息在所述时间段内的一帧或多帧图像识别所述物品的类型；根据所述类型确定对应的最低价格；根据所述时间段内扫描到的物品的标识确定所述物品的价格；若所述物品的价格低于所述最低价格，则判断用户存在漏扫行为。
可选的，所述结算模块具体可以用于：响应于所述用户确认物品扫描完毕的操作事件，根据检测结果确定用户的漏扫次数；若所述用户的漏扫次数小于第一预设阈值，则对用户扫描的物品进行结算。
可选的，所述结算模块还可以用于：若所述用户的漏扫次数不小于第一预设阈值，则显示禁止结算界面，和/或，向现场监控终端发送警示信息。
可选的，所述结算模块还可以用于：在显示禁止结算界面之后，响应于现场监控人员的操作事件，对用户扫描的物品进行结算。
可选的，所述结算模块还可以用于：在显示禁止结算界面之后，获取现场监控人员 输入的密码，若所述密码为用于解除禁止结算的密码，则对用户扫描的物品进行结算；或者，扫描现场监控人员提供的二维码，若所述二维码为用于解除禁止结算的二维码，则对用户扫描的物品进行结算。
可选的，所述第一采集模块11还可以用于：将采集到的视频信息发送给后台监控终端，所述视频信息用于供所述后台监控终端播放。
可选的，所述第一检测模块12还可以用于：若通过所述视频信息检测到用户出现漏扫行为，则向后台监控终端发送用于控制所述后台监控终端突出显示所述用户视频信息的警示指令。
可选的，所述结算模块13具体可以用于：获取后台监控终端响应于后台监控人员的操作事件发送的用于指示用户出现漏扫行为的漏扫指示信息；响应于所述用户确认物品扫描完毕的操作事件，若根据所述视频信息检测到所述用户的漏扫次数小于第一预设阈值，和/或，根据所述漏扫指示信息确定所述用户的漏扫次数小于第二预设阈值，则对用户扫描的物品进行结算。
可选的，所述第一检测模块12具体可以用于：对所述视频信息进行处理，检测用户的漏扫行为；或者，获取所述后台监控终端通过对所述视频信息进行处理得到的对用户漏扫行为的检测结果。
可选的，所述结算模块13具体可以用于：获取用户的身份信息；判断所述用户的身份信息是否在黑名单中；若否，则根据检测结果对用户扫描的物品进行结算。
可选的，所述第一检测模块12还可以用于：根据检测到的所述用户的漏扫次数，向所述用户推送对应的提示信息。
图10所示装置可以执行前述实施例一至四提供的漏扫识别方法，本实施例未详细描述的部分，可参考对前述实施例的相关说明。该技术方案的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。
图11为本发明实施例提供的漏扫识别装置实施例二的结构示意图。如图11所示，该装置可以包括：
第二采集模块14，用于采集用户扫描物品的视频信息；
第一发送模块15，用于将所述视频信息发送给图像服务器；
第一接收模块16，用于接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
可选的，所述用户行为检测结果包括用户一个扫描动作对应的时间信息，所述时间 信息包括下述至少一项：开始时间、结束时间、动作所在的时间段。
相应的，所述第一接收模块16还可以用于：在接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果之后，根据所述扫描动作所在的时间段内扫描到的物品的标识确定用户是否存在漏扫行为。
可选的，所述第一接收模块16还可以用于：将物品的扫描结果发送给所述图像服务器，以使所述图像服务器根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果；相应的，所述用户行为检测结果包括对用户的漏扫行为的检测结果。
图11所示装置可以执行前述实施例五提供的漏扫识别方法，本实施例未详细描述的部分，可参考对前述实施例的相关说明。该技术方案的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。
图12为本发明实施例提供的漏扫识别装置实施例三的结构示意图。如图12所示，该装置可以包括：
第一获取模块17，用于获取自助收银终端发送的用户扫描物品的视频信息；
第二检测模块18，用于根据所述视频信息得到用户行为检测结果；
第二发送模块19，用于将所述用户行为检测结果发送给所述自助收银终端。
可选的，所述第二检测模块18具体可以用于：根据所述视频信息确定用户的姿态数据；根据用户的姿态数据，确定一个扫描动作对应的时间信息，所述时间信息包括下述至少一项：开始时间、结束时间、动作所在的时间段；其中，所述用户行为检测结果包括所述时间信息。
可选的，所述第二检测模块18具体可以用于：接收自助收银终端发送的物品的扫描结果；根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果；其中，所述用户行为检测结果包括对用户的漏扫行为的检测结果。
可选的，所述第二检测模块18具体可以用于：接收自助收银终端发送的物品的扫描结果；根据所述视频信息识别物品的属性信息；根据物品的扫描结果确定物品的属性信息；若根据所述视频信息识别到物品的属性信息与根据扫描结果确定的所述物品的属性信息不一致，则判断用户存在漏扫行为。
可选的，所述第二检测模块18具体可以用于：接收自助收银终端发送的物品的扫描结果；根据所述视频信息识别物品的类型；根据所述类型确定对应的最低价格；根据物品的扫描结果确定所述物品的价格；若所述物品的价格低于所述最低价格，则判断用户存在漏扫行为。
图12所示装置可以执行前述实施例六提供的漏扫识别方法，本实施例未详细描述的部分，可参考对前述实施例的相关说明。该技术方案的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。
图13为本发明实施例提供的漏扫识别装置实施例四的结构示意图。如图13所示，该装置可以包括：
第二获取模块110，用于获取自助收银终端发送的用户扫描物品的视频信息；
显示模块111，用于将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
第三发送模块112，用于响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
可选的，所述第三发送模块112还可以用于：获取所述自助收银终端在检测到用户出现漏扫行为时发送的警示指令；根据所述警示指令，突出显示所述用户的视频信息。
可选的，所述第三发送模块112还可以用于：对所述视频信息进行处理，检测用户的漏扫行为；向所述自助收银终端发送对用户的漏扫行为的检测结果。
可选的，所述第三发送模块112还可以用于：响应于所述后台监控人员的操作事件，将所述用户的身份信息添加到疑似黑名单中；将所述疑似黑名单中的身份信息及对应的视频信息显示给管理人员；响应于管理人员的操作事件，将所述用户的身份信息添加到黑名单中。
图13所示装置可以执行前述实施例七提供的漏扫识别方法，本实施例未详细描述的部分，可参考对前述实施例的相关说明。该技术方案的执行过程和技术效果参见前述实施例中的描述，在此不再赘述。
图14为本发明实施例提供的一种自助收银终端的结构示意图。如图14所示，该自助收银终端可以包括：第一处理器21和第一存储器22。其中，所述第一存储器22用于存储支持自助收银终端执行前述任一实施例提供的漏扫识别方法的程序，所述第一处理器21被配置为用于执行所述第一存储器22中存储的程序。
所述程序包括一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第一处理器21执行时能够实现如下步骤：
采集用户扫描物品的视频信息；
根据所述视频信息，获取对用户的漏扫行为的检测结果。
可选地，所述第一处理器21还用于执行前述图1-图4所示实施例中的全部或部分步骤。
其中，所述自助收银终端的结构中还可以包括第一通信接口23，用于自助收银终端与其他设备或通信网络通信。
本实施例中的自助收银终端，可以作为门店的自助收银机的一部分，例如可以集成在门店的自助收银机的内部，与自助收银机的显示装置、POS机等装置连接并实现相应的功能。
或者，所述自助收银终端还可以包括显示装置、POS机等，设置有这些装置的自助收银终端无需再与其它设备连接，可以单独实现自助收银功能。
图15为本发明实施例提供的另一种自助收银终端的结构示意图。图15所示的自助收银终端，是在图14所示自助收银终端的基础上，增加了用于辅助第一处理器21进行工作的装置。
可选的，所述自助收银终端除了第一处理器21和第一存储器22以外，还可以包括：与所述第一处理器连接的拍摄装置24，所述拍摄装置24可以为摄像头等；所述拍摄装置24用于采集用户扫描物品的视频信息并发送给所述第一处理器21，即所述第一处理器21可以通过所述拍摄装置24采集用户扫描物品的视频信息。
可选的，所述自助收银终端还可以包括：放置台(图中未示出)；所述放置台包括用于放置待扫描物品的待扫描区、用于扫描物品的扫描区、用于放置已扫描物品的已扫描区；所述待扫描区、所述扫描区和所述已扫描区均位于所述拍摄装置24的拍摄范围内。
可选的，所述自助收银终端还可以包括：POS机25和显示装置26；所述POS机25和所述显示装置26均与所述第一处理器21连接；所述POS机25用于对物品进行扫描和结算。
所述显示装置26用于：在用户开始扫描物品前，显示结算引导画面；在用户扫描物品时，显示被扫描的物品信息；在用户完成扫描时，显示结算界面或禁止结算界面。所述显示装置26可以在第一处理器21的控制下显示相应的画面或信息。
相应的，所述第一处理器21需要执行扫描、结算、显示等操作时，可以通过POS机25、显示装置26等装置来实现，例如，所述第一处理器21对物品进行结算可以具体包括：所述第一处理器21通过所述POS机25对物品进行结算；所述第一处理器21显示禁止结算界面可以具体包括：所述第一处理器21通过所述显示装置26显示所述禁止结算界面。
在其它可选的实施方式中，第一处理器21也可以通过其它方式实现扫描和结算。例如，可以通过条形码或二维码扫描装置来对物品进行扫描，可以通过与数据库的通信来确定被扫描物品的价格等，从而对物品进行结算，可以通过支付接口如支付宝等实现支付功能。
可选的，所述自助收银终端还可以包括：报警装置27；所述报警装置27与所述第一处理器21连接，用于获取所述第一处理器21在检测到用户的漏扫行为不满足预设条件时发送的报警指示信息，并根据所述报警指示信息发出报警信号。所述预设条件可以根据实际需要来设置，例如可以为漏扫次数小于一定的次数。
所述报警装置27可以包括下述至少一项：指示灯、振动器、扬声器等。所述报警装置发出报警信号可以包括下述至少一种：指示灯闪烁、振动器振动、扬声器播放报警信号。
图15为所示的自助收银终端，集成了拍摄装置24、放置台、POS机25、显示装置26和报警装置27等，能够协助第一处理器21完成自助结算操作，结构简单、易于实现，适于推广和应用。
图16为本发明实施例提供的又一种自助收银终端的结构示意图。如图16所示，该自助收银终端可以包括：第二处理器28和第二存储器29。其中，所述第二存储器29用于存储支持自助收银终端执行前述任一实施例提供的漏扫识别方法的程序，所述第二处理器28被配置为用于执行所述第二存储器29中存储的程序。
所述程序包括一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第二处理器28执行时能够实现如下步骤：
采集用户扫描物品的视频信息；
将所述视频信息发送给图像服务器；
接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
其中，所述自助收银终端的结构中还可以包括第二通信接口210，用于后台监控终端与其他设备或通信网络通信。
图17为本发明实施例提供的一种图像服务器的结构示意图。如图17所示，该图像服务器可以包括：第三处理器211和第三存储器212。其中，所述第三存储器212用于存储支持图像服务器执行前述任一实施例提供的漏扫识别方法的程序，第三处理器211被配置为用于执行所述第三存储器212中存储的程序。
所述程序包括一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第 三处理器211执行时能够实现如下步骤：
获取自助收银终端发送的用户扫描物品的视频信息；
根据所述视频信息得到用户行为检测结果；
将所述用户行为检测结果发送给所述自助收银终端。
其中，所述图像服务器的结构中还可以包括第三通信接口213，用于后台监控终端与其他设备或通信网络通信。
图18为本发明实施例提供的一种后台监控终端的结构示意图。如图18所示，该后台监控终端可以包括：第四处理器214和第四存储器215。其中，所述第四存储器214用于存储支持后台监控终端执行前述任一实施例提供的漏扫识别方法的程序，所述第四处理器214被配置为用于执行所述第四存储器215中存储的程序。
所述程序包括一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第四处理器214执行时能够实现如下步骤：
获取自助收银终端发送的用户扫描物品的视频信息；
将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
其中，所述后台监控终端的结构中还可以包括第四通信接口216，用于后台监控终端与其他设备或通信网络通信。
本发明实施例还提供的一种自助收银系统的示意图。所述自助收银系统可以包括：上述任一实施例所述的自助收银终端以及上述任一实施例所述的后台监控终端，还可以包括上述任一实施例所述的图像服务器。
可选的，所述自助收银系统还可以包括：现场监控终端。所述现场监控终端用于获取自助收银终端在检测到用户的漏扫次数不小于第一预设阈值时发送的警示信息，并根据所述警示信息向现场监控人员推送提醒信息。
可选的，所述现场监控终端为可穿戴设备，所述现场监控终端可以设置有用于解除禁止结算的二维码，用于供所述自助收银终端扫描。
可选的，所述自助收银系统还可以包括后台服务器。所述自助收银终端可以将视频信息、数据日志等上传后台服务器，供后台服务器进行算法优化等。
本发明实施例提供的系统的工作原理、执行过程和技术效果可以参见前述任一实施 例，在此不再赘述。
另外，本发明实施例提供了一种存储计算机指令的计算机可读存储介质，当所述计算机指令被处理器执行时，致使所述处理器执行包括以下的动作：
采集用户扫描物品的视频信息；
根据所述视频信息，获取对用户的漏扫行为的检测结果。
当所述计算机指令被处理器执行时，还可以致使所述处理器执行上述实施例一至四中的漏扫识别方法所涉及的全部或部分步骤。
另外，本发明实施例提供了另一种存储计算机指令的计算机可读存储介质，当所述计算机指令被处理器执行时，致使所述处理器执行包括以下的动作：
采集用户扫描物品的视频信息；
将所述视频信息发送给图像服务器；
接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
当所述计算机指令被处理器执行时，还可以致使所述处理器执行上述实施例五中的漏扫识别方法所涉及的全部或部分步骤。
另外，本发明实施例提供了另一种存储计算机指令的计算机可读存储介质，当所述计算机指令被处理器执行时，致使所述处理器执行包括以下的动作：
获取自助收银终端发送的用户扫描物品的视频信息；
根据所述视频信息得到用户行为检测结果；
将所述用户行为检测结果发送给所述自助收银终端。
当所述计算机指令被处理器执行时，还可以致使所述处理器执行上述实施例六中的漏扫识别方法所涉及的全部或部分步骤。
另外，本发明实施例还提供了另一种存储计算机指令的计算机可读存储介质，当所述计算机指令被处理器执行时，致使所述处理器执行包括以下的动作：
获取自助收银终端发送的用户扫描物品的视频信息；
将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
另外，当所述计算机指令被处理器执行时，还可以致使所述处理器执行上述实施例七中的漏扫识别方法所涉及的全部或部分步骤。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助加必需的通用硬件平台的方式来实现，当然也可以通过硬件和软件结合的方式来实现。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以计算机产品的形式体现出来，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程网络连接设备的处理器以产生一个机器，使得通过计算机或其他可编程网络连接设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程网络连接设备以特定方式楼层的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程网络连接设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介 质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括暂存电脑可读媒体(transitory media)，如调制的数据信号和载波。
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (43)

  1. 一种漏扫识别方法，其特征在于，包括：
    采集用户扫描物品的视频信息；
    根据所述视频信息，获取对用户的漏扫行为的检测结果。
  2. 根据权利要求1所述的方法，其特征在于，还包括：
    根据检测结果对用户扫描的物品进行结算。
  3. 根据权利要求1所述的方法，其特征在于，用于供用户扫描物品的扫码区域的预设范围内设置有拍摄装置；
    相应的，采集用户扫描物品的视频信息，包括：
    获取所述拍摄装置采集到的所述扫码区域的视频信息。
  4. 根据权利要求1所述的方法，其特征在于，根据所述视频信息，获取对用户的漏扫行为的检测结果，包括：
    根据所述视频信息确定用户的姿态数据；
    根据所述用户的姿态数据，确定一个扫描动作所在的时间段；
    根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为。
  5. 根据权利要求4所述的方法，其特征在于，根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为，包括：
    根据所述视频信息在所述时间段内的一帧或多帧图像识别所述物品的属性信息；
    根据所述时间段内扫描到的物品的标识确定所述物品的属性信息；
    若根据所述视频信息识别到的属性信息与根据标识确定的属性信息不一致，则判断用户存在漏扫行为。
  6. 根据权利要求4所述的方法，其特征在于，根据在所述时间段内扫描到的物品的标识确定用户在所述时间段内是否存在漏扫行为，包括：
    根据所述视频信息在所述时间段内的一帧或多帧图像识别所述物品的类型；
    根据所述类型确定对应的最低价格；
    根据所述时间段内扫描到的物品的标识确定所述物品的价格；
    若所述物品的价格低于所述最低价格，则判断用户存在漏扫行为。
  7. 根据权利要求1所述的方法，其特征在于，根据检测结果对用户扫描的物品进行结算，包括：
    响应于所述用户确认物品扫描完毕的操作事件，根据检测结果确定用户的漏扫次数；
    若所述用户的漏扫次数小于第一预设阈值，则对用户扫描的物品进行结算。
  8. 根据权利要求7所述的方法，其特征在于，还包括：
    若所述用户的漏扫次数不小于第一预设阈值，则显示禁止结算界面，和/或，向现场监控终端发送警示信息。
  9. 根据权利要求8所述的方法，其特征在于，在显示禁止结算界面之后，还包括：
    响应于现场监控人员的操作事件，对用户扫描的物品进行结算。
  10. 根据权利要求9所述的方法，其特征在于，响应于现场监控人员的操作事件，对用户扫描的物品进行结算，包括：
    获取现场监控人员输入的密码，若所述密码为用于解除禁止结算的密码，则对用户扫描的物品进行结算；
    或者，扫描现场监控人员提供的二维码，若所述二维码为用于解除禁止结算的二维码，则对用户扫描的物品进行结算。
  11. 根据权利要求1所述的方法，其特征在于，还包括：
    将采集到的视频信息发送给后台监控终端，所述视频信息用于供所述后台监控终端播放。
  12. 根据权利要求11所述的方法，其特征在于，还包括：
    若通过所述视频信息检测到用户出现漏扫行为，则向后台监控终端发送用于控制所述后台监控终端突出显示所述用户视频信息的警示指令。
  13. 根据权利要求12所述的方法，其特征在于，根据检测结果对用户扫描的物品进行结算，包括：
    获取后台监控终端响应于后台监控人员的操作事件发送的用于指示用户出现漏扫行为的漏扫指示信息；
    响应于所述用户确认物品扫描完毕的操作事件，若根据所述视频信息检测到所述用户的漏扫次数小于第一预设阈值，和/或，根据所述漏扫指示信息确定所述用户的漏扫次数小于第二预设阈值，则对用户扫描的物品进行结算。
  14. 根据权利要求11所述的方法，其特征在于，根据所述视频信息，获取对用户的漏扫行为的检测结果，包括：
    对所述视频信息进行处理，检测用户的漏扫行为；
    或者，获取所述后台监控终端通过对所述视频信息进行处理得到的对用户漏扫行为的检测结果。
  15. 根据权利要求1所述的方法，其特征在于，根据检测结果对用户扫描的物品进行结算，包括：
    获取用户的身份信息；
    判断所述用户的身份信息是否在黑名单中；
    若否，则根据检测结果对用户扫描的物品进行结算。
  16. 根据权利要求1所述的方法，其特征在于，还包括：
    根据检测到的所述用户的漏扫次数，向所述用户推送对应的提示信息。
  17. 一种漏扫识别方法，其特征在于，包括：
    采集用户扫描物品的视频信息；
    将所述视频信息发送给图像服务器；
    接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
  18. 根据权利要求17所述的方法，其特征在于，所述用户行为检测结果包括用户一个扫描动作对应的时间信息，所述时间信息包括下述至少一项：开始时间、结束时间、动作所在的时间段；
    相应的，在接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果之后，还包括：
    根据所述扫描动作所在的时间段内扫描到的物品的标识确定用户是否存在漏扫行为。
  19. 根据权利要求17所述的方法，其特征在于，还包括：
    将物品的扫描结果发送给所述图像服务器，以使所述图像服务器根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果；
    相应的，所述用户行为检测结果包括对用户的漏扫行为的检测结果。
  20. 一种漏扫识别方法，其特征在于，包括：
    获取自助收银终端发送的用户扫描物品的视频信息；
    根据所述视频信息得到用户行为检测结果；
    将所述用户行为检测结果发送给所述自助收银终端。
  21. 根据权利要求20所述的方法，其特征在于，根据所述视频信息得到用户行为检测结果，包括：
    根据所述视频信息确定用户的姿态数据；
    根据用户的姿态数据，确定一个扫描动作对应的时间信息，所述时间信息包括下述至少一项：开始时间、结束时间、动作所在的时间段；
    其中，所述用户行为检测结果包括所述时间信息。
  22. 根据权利要求20所述的方法，其特征在于，根据所述视频信息得到用户行为检测结果，包括：
    接收自助收银终端发送的物品的扫描结果；
    根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果；
    其中，所述用户行为检测结果包括对用户的漏扫行为的检测结果。
  23. 根据权利要求22所述的方法，其特征在于，根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果，包括：
    根据所述视频信息识别物品的属性信息；
    根据物品的扫描结果确定物品的属性信息；
    若根据所述视频信息识别到物品的属性信息与根据扫描结果确定的所述物品的属性信息不一致，则判断用户存在漏扫行为。
  24. 根据权利要求22所述的方法，其特征在于，根据所述视频信息和所述扫描结果得到对用户的漏扫行为的检测结果，包括：
    根据所述视频信息识别物品的类型；
    根据所述类型确定对应的最低价格；
    根据物品的扫描结果确定所述物品的价格；
    若所述物品的价格低于所述最低价格，则判断用户存在漏扫行为。
  25. 一种漏扫识别方法，其特征在于，包括：
    获取自助收银终端发送的用户扫描物品的视频信息；
    将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
    响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
  26. 根据权利要求25所述的方法，其特征在于，还包括：
    获取所述自助收银终端在检测到用户出现漏扫行为时发送的警示指令；
    根据所述警示指令，突出显示所述用户的视频信息。
  27. 根据权利要求25所述的方法，其特征在于，还包括：
    响应于所述后台监控人员的操作事件，将所述用户的身份信息添加到疑似黑名单中；
    将所述疑似黑名单中的身份信息及对应的视频信息显示给管理人员；
    响应于管理人员的操作事件，将所述用户的身份信息添加到黑名单中。
  28. 根据权利要求25所述的方法，其特征在于，还包括：
    对所述视频信息进行处理，检测用户的漏扫行为；
    向所述自助收银终端发送对用户的漏扫行为的检测结果。
  29. 一种漏扫识别装置，其特征在于，包括：
    第一采集模块，用于采集用户扫描物品的视频信息；
    第一检测模块，用于根据所述视频信息，获取对用户的漏扫行为的检测结果。
  30. 一种漏扫识别装置，其特征在于，包括：
    第二采集模块，用于采集用户扫描物品的视频信息；
    第一发送模块，用于将所述视频信息发送给图像服务器；
    第一接收模块，用于接收所述图像服务器通过对所述视频信息进行处理得到的用户行为检测结果。
  31. 一种漏扫识别装置，其特征在于，包括：
    第一获取模块，用于获取自助收银终端发送的用户扫描物品的视频信息；
    第二检测模块，用于根据所述视频信息得到用户行为检测结果；
    第二发送模块，用于将所述用户行为检测结果发送给所述自助收银终端。
  32. 一种漏扫识别装置，其特征在于，包括：
    第二获取模块，用于获取自助收银终端发送的用户扫描物品的视频信息；
    显示模块，用于将所述视频信息显示给后台监控人员，以使后台监控人员根据所述视频信息确定用户是否出现漏扫行为；
    第三发送模块，用于响应于后台监控人员确认用户出现漏扫行为的操作事件，向自助收银终端发送漏扫指示信息。
  33. 一种自助收银终端，其特征在于，包括：第一存储器和第一处理器；所述第一存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第一处理器执行时实现如权利要求1至16中任一项所述的漏扫识别方法。
  34. 根据权利要求33所述的自助收银终端，其特征在于，还包括：拍摄装置；
    所述拍摄装置与所述第一处理器连接，用于采集用户扫描物品的视频信息并发送给所述第一处理器。
  35. 根据权利要求34所述的自助收银终端，其特征在于，还包括：放置台；
    所述放置台包括用于放置待扫描物品的待扫描区、用于扫描物品的扫描区、用于放置已扫描物品的已扫描区；
    所述待扫描区、所述扫描区和所述已扫描区均位于所述拍摄装置的拍摄范围内。
  36. 根据权利要求33所述的自助收银终端，其特征在于，还包括：POS机和显示装置；
    所述POS机和所述显示装置均与所述第一处理器连接；
    所述POS机用于对物品进行扫描和结算；
    所述显示装置用于：在用户开始扫描物品前，显示结算引导画面；在用户扫描物品时，显示被扫描的物品信息；在用户完成扫描时，显示结算界面或禁止结算界面。
  37. 根据权利要求33所述的自助收银终端，其特征在于，还包括：报警装置；
    所述报警装置与所述第一处理器连接，用于获取所述第一处理器在检测到用户的漏扫行为不满足预设条件时发送的报警指示信息，并根据所述报警指示信息发出报警信号。
  38. 一种自助收银终端，其特征在于，包括：第二存储器和第二处理器；所述第二存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第二处理器执行时实现如权利要求17至19中任一项所述的漏扫识别方法。
  39. 一种图像服务器，其特征在于，包括：第三存储器和第三处理器；所述第三存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第三处理器执行时实现如权利要求20至24中任一项所述的漏扫识别方法。
  40. 一种后台监控终端，其特征在于，包括：第四存储器和第四处理器；所述第四存储器用于存储一条或多条计算机指令，其中，所述一条或多条计算机指令被所述第四处理器执行时实现如权利要求25至28中任一项所述的漏扫识别方法。
  41. 一种自助收银系统，其特征在于，包括：权利要求33至37中任一项所述的自助收银终端以及权利要求40所述的后台监控终端；
    或者，所述系统包括：权利要求38所述的自助收银终端、权利要求39所述的图像服务器以及权利要求40所述的后台监控终端。
  42. 根据权利要求41所述的自助收银系统，其特征在于，还包括：现场监控终端；
    所述现场监控终端用于获取自助收银终端在检测到用户的漏扫次数不小于第一预设阈值时发送的警示信息，并根据所述警示信息向现场监控人员推送提醒信息。
  43. 根据权利要求42所述的自助收银系统，其特征在于，所述现场监控终端为可穿戴设备；
    所述现场监控终端设置有用于解除禁止结算的二维码，用于供所述自助收银终端扫描。
PCT/CN2019/101520 2018-08-28 2019-08-20 漏扫识别方法、装置、自助收银终端及系统 WO2020042966A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021510931A JP7245321B2 (ja) 2018-08-28 2019-08-20 スキャン漏れ識別方法および装置、セルフサービス・キャッシュ・レジスタ端末およびシステム
US17/186,682 US11501614B2 (en) 2018-08-28 2021-02-26 Skip-scanning identification method, apparatus, and self-service checkout terminal and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810987941.7A CN110866429B (zh) 2018-08-28 2018-08-28 漏扫识别方法、装置、自助收银终端及系统
CN201810987941.7 2018-08-28

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/186,682 Continuation US11501614B2 (en) 2018-08-28 2021-02-26 Skip-scanning identification method, apparatus, and self-service checkout terminal and system

Publications (1)

Publication Number Publication Date
WO2020042966A1 true WO2020042966A1 (zh) 2020-03-05

Family

ID=69643823

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/101520 WO2020042966A1 (zh) 2018-08-28 2019-08-20 漏扫识别方法、装置、自助收银终端及系统

Country Status (4)

Country Link
US (1) US11501614B2 (zh)
JP (1) JP7245321B2 (zh)
CN (1) CN110866429B (zh)
WO (1) WO2020042966A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113591589A (zh) * 2021-07-02 2021-11-02 北京百度网讯科技有限公司 产品漏检的识别方法、装置、电子设备及存储介质
EP4047538A1 (en) * 2021-02-19 2022-08-24 Toshiba TEC Kabushiki Kaisha Self-checkout system and method
WO2022209055A1 (ja) * 2021-03-30 2022-10-06 日本電気株式会社 検知システム、検知方法、及び、記憶媒体

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10769896B1 (en) * 2019-05-01 2020-09-08 Capital One Services, Llc Counter-fraud measures for an ATM device
US11462083B2 (en) * 2019-06-25 2022-10-04 Ncr Corporation Display with integrated cameras
JP7264401B2 (ja) * 2020-03-09 2023-04-25 ▲図▼▲霊▼通▲諾▼（北京）科技有限公司 会計方法、装置及びシステム
CN111723702B (zh) * 2020-06-08 2024-02-27 苏州工业职业技术学院 数据监控方法、装置以及支付系统
JP2022011666A (ja) * 2020-06-30 2022-01-17 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
CN111967321B (zh) * 2020-07-15 2024-04-05 菜鸟智能物流控股有限公司 视频数据处理方法、装置、电子设备和存储介质
JP2022132770A (ja) * 2021-03-01 2022-09-13 東芝テック株式会社 セルフ式商品販売データ処理装置およびプログラム
JP7318753B2 (ja) * 2021-06-30 2023-08-01 富士通株式会社 情報処理プログラム、情報処理方法、および情報処理装置
US11308775B1 (en) 2021-08-13 2022-04-19 Sai Group Limited Monitoring and tracking interactions with inventory in a retail environment
US11302161B1 (en) * 2021-08-13 2022-04-12 Sai Group Limited Monitoring and tracking checkout activity in a retail environment
JP2023065267A (ja) * 2021-10-27 2023-05-12 富士通株式会社 行動判定プログラム、行動判定方法及び行動判定装置
CN114092081A (zh) * 2021-11-30 2022-02-25 厦门点亮流星科技有限责任公司 一种饰品贩卖系统及其对应的操作方法
JP7199586B1 (ja) 2022-05-27 2023-01-05 株式会社Retail SHIFT チェック装置及びチェックシステム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101615014A (zh) * 2009-07-14 2009-12-30 杭州海康威视数字技术股份有限公司 一种监控电子收银机操作的方法及系统
US20160253700A1 (en) * 2012-07-18 2016-09-01 Maynard L. Dokken System and method for automated advocate marketing with digital rights registration
CN106251520A (zh) * 2016-07-20 2016-12-21 深圳巧思科技有限公司 一种超市收银系统
CN207517142U (zh) * 2017-12-04 2018-06-19 浙江捷洋科技有限公司 一种自助超市收银机

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6856964B1 (en) 1999-03-22 2005-02-15 Ncr Corporation System and methods for integrating a self-checkout system into an existing store system
US7845554B2 (en) 2000-10-30 2010-12-07 Fujitsu Frontech North America, Inc. Self-checkout method and apparatus
US8448858B1 (en) * 2004-06-21 2013-05-28 Stoplift, Inc. Method and apparatus for detecting suspicious activity using video analysis from alternative camera viewpoint
US7631808B2 (en) * 2004-06-21 2009-12-15 Stoplift, Inc. Method and apparatus for detecting suspicious activity using video analysis
WO2006105376A2 (en) 2005-03-29 2006-10-05 Stoplift, Inc. Method and apparatus for detecting suspicious activity using video analysis
NZ562245A (en) 2005-04-07 2011-01-28 Freedom Shopping Inc Self checkout kiosk and retail security system
JP2007206996A (ja) 2006-02-02 2007-08-16 Nippon Signal Co Ltd:The バーコード読取装置及びそれを用いたセルフチェックアウトレジシステム
US8239268B2 (en) 2006-06-20 2012-08-07 Toshiba Tec Kabushiki Kaisha Self-checkout terminal
JP4874166B2 (ja) 2006-06-20 2012-02-15 東芝テック株式会社 チェックアウト端末
JP4038232B1 (ja) 2006-09-13 2008-01-23 ホームネットカーズ株式会社 顧客情報処理システム及び方法
US8570375B1 (en) * 2007-12-04 2013-10-29 Stoplift, Inc. Method and apparatus for random-access review of point of sale transactional video
US8086497B1 (en) 2008-03-05 2011-12-27 United Services Automobile Association Systems and methods for price searching and customer self-checkout using a mobile device
US7448542B1 (en) * 2008-05-05 2008-11-11 International Business Machines Corporation Method for detecting a non-scan at a retail checkout station
US8751011B2 (en) 2008-07-11 2014-06-10 Medtronic, Inc. Defining therapy parameter values for posture states
US8448859B2 (en) 2008-09-05 2013-05-28 Datalogic ADC, Inc. System and method for preventing cashier and customer fraud at retail checkout
US8403215B2 (en) 2009-05-11 2013-03-26 Toshiba Global Commerce Solutions Holdings Corporation Self shopping support by getting contents from electronic shelf labels
JP5053343B2 (ja) 2009-09-04 2012-10-17 東芝テック株式会社 セルフチェックアウト端末
US9357949B2 (en) 2010-01-08 2016-06-07 Medtronic, Inc. User interface that displays medical therapy and posture data
US9053473B2 (en) 2010-05-28 2015-06-09 Ncr Corporation Techniques for assisted self checkout
US9218580B2 (en) * 2010-12-30 2015-12-22 Honeywell International Inc. Detecting retail shrinkage using behavioral analytics
WO2012161364A1 (ko) * 2011-05-26 2012-11-29 (주) 웨이브링크 스캔 누락 방지 장치 및 시스템, 및 스캔 누락 방지 방법
US20130054395A1 (en) 2011-08-25 2013-02-28 Michael Cyr Methods and systems for self-service checkout
WO2013134865A1 (en) * 2012-03-16 2013-09-19 In Situ Media Corporation System and method for scanning, tracking and collating customer shopping selections
US9396621B2 (en) * 2012-03-23 2016-07-19 International Business Machines Corporation Systems and methods for false alarm reduction during event detection
US9536236B2 (en) 2012-06-08 2017-01-03 Ronny Hay Computer-controlled, unattended, automated checkout store outlet and related method
US20140222603A1 (en) 2012-06-08 2014-08-07 Ronny Hay Computer-controlled, unattended, automated checkout store outlet
JP5379334B1 (ja) 2012-06-12 2013-12-25 オリンパスイメージング株式会社 撮像装置
WO2014100827A1 (en) * 2012-12-21 2014-06-26 Joshua Migdal Verification of fraudulent activities at a selfcheckout terminal
EP3005281A4 (en) 2013-06-04 2017-06-28 Proteus Digital Health, Inc. System, apparatus and methods for data collection and assessing outcomes
JP6298772B2 (ja) 2015-01-14 2018-03-20 日立オートモティブシステムズ株式会社 車載用制御装置、自車位置姿勢特定装置、車載用表示装置
CN106169135A (zh) * 2016-02-01 2016-11-30 唐超(北京)科技有限公司 自助结账防损校验方法及系统
CN105915857A (zh) * 2016-06-13 2016-08-31 南京亿猫信息技术有限公司 超市购物车监控系统及其监控方法
CN106340143B (zh) * 2016-08-26 2018-07-27 北京中盛益华科技有限公司 商超收银过程防盗监控方法
US11482082B2 (en) * 2016-09-18 2022-10-25 Ncr Corporation Non-scan loss verification at self-checkout terminal
CN206179134U (zh) * 2016-09-21 2017-05-17 深圳市泛海三江科技发展有限公司 一种商超智能防盗系统
CN106683294A (zh) * 2016-12-14 2017-05-17 深圳市易捷通科技股份有限公司 一种零售收银防盗防损的收银设备及方案
CN107038822A (zh) * 2017-03-27 2017-08-11 杭州赛狐科技有限公司 一种自助收银系统及方法
US11080976B2 (en) * 2017-06-15 2021-08-03 Ncr Corporation Real time bypass detection in scanner
US11726210B2 (en) * 2018-08-05 2023-08-15 COM-IoT Technologies Individual identification and tracking via combined video and lidar systems
US11756389B2 (en) * 2020-01-10 2023-09-12 Everseen Limited System and method for detecting scan and non-scan events in a self check out process

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101615014A (zh) * 2009-07-14 2009-12-30 杭州海康威视数字技术股份有限公司 一种监控电子收银机操作的方法及系统
US20160253700A1 (en) * 2012-07-18 2016-09-01 Maynard L. Dokken System and method for automated advocate marketing with digital rights registration
CN106251520A (zh) * 2016-07-20 2016-12-21 深圳巧思科技有限公司 一种超市收银系统
CN207517142U (zh) * 2017-12-04 2018-06-19 浙江捷洋科技有限公司 一种自助超市收银机

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4047538A1 (en) * 2021-02-19 2022-08-24 Toshiba TEC Kabushiki Kaisha Self-checkout system and method
CN114973546A (zh) * 2021-02-19 2022-08-30 东芝泰格有限公司 自助结账系统及存储介质
WO2022209055A1 (ja) * 2021-03-30 2022-10-06 日本電気株式会社 検知システム、検知方法、及び、記憶媒体
CN113591589A (zh) * 2021-07-02 2021-11-02 北京百度网讯科技有限公司 产品漏检的识别方法、装置、电子设备及存储介质
CN113591589B (zh) * 2021-07-02 2022-09-27 北京百度网讯科技有限公司 产品漏检的识别方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
JP7245321B2 (ja) 2023-03-23
CN110866429B (zh) 2024-03-08
US11501614B2 (en) 2022-11-15
JP2021536619A (ja) 2021-12-27
US20210183212A1 (en) 2021-06-17
CN110866429A (zh) 2020-03-06

Similar Documents

Publication Publication Date Title
WO2020042966A1 (zh) 漏扫识别方法、装置、自助收银终端及系统
US20230013957A1 (en) Non-Scan Loss Verification at Self-Checkout Terminal
JP6204491B2 (ja) セルフチェックアウト端末における不正行為の検証
JP6686290B2 (ja) システム及び方法
US20150269549A1 (en) Synchronizing scan activity with loss prevention cameras
CN108269371A (zh) 商品自动结算方法、装置、自助收银台
CN111263224B (zh) 视频处理方法、装置及电子设备
US10372998B2 (en) Object recognition for bottom of basket detection
US11961083B2 (en) Alert controller for loss prevention
CN108960132B (zh) 一种开放式自动售货机中商品的购买方法及其装置
US11379903B2 (en) Data processing method, device and storage medium
WO2017215362A1 (zh) 一种基于超市购物车的智能购物系统及其控制方法
CN111161486A (zh) 基于结算箱的商品防盗方法及系统
WO2021179137A1 (zh) 结算方法、装置和系统
WO2019096228A1 (zh) 一种基于神经网络的无人售货方法和设备
CN114529850A (zh) 自助收银的风险识别方法、装置及系统
CN111260685B (zh) 视频处理方法、装置及电子设备
JPWO2019171572A1 (ja) セルフレジシステム、購入商品管理方法および購入商品管理プログラム
US20230005348A1 (en) Fraud detection system and method
CN111783707A (zh) 称重预处理方法、称重设备和计算机可读存储介质
US20220414632A1 (en) Operation of a self-check out surface area of a retail store
JP6398331B2 (ja) 情報処理装置、制御方法、及びプログラム
JP7010030B2 (ja) 店内監視装置、店内監視方法、および店内監視プログラム
US20190378389A1 (en) System and Method of Detecting a Potential Cashier Fraud
EP4372653A1 (en) Risk identification method, apparatus, device and storage medium for self-service checkout

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19856113

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021510931

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19856113

Country of ref document: EP

Kind code of ref document: A1