CA3130322A1 - Monitoring method, device and system for user behaviors in store and computer system - Google Patents

Monitoring method, device and system for user behaviors in store and computer system Download PDF

Info

Publication number
CA3130322A1
CA3130322A1 CA3130322A CA3130322A CA3130322A1 CA 3130322 A1 CA3130322 A1 CA 3130322A1 CA 3130322 A CA3130322 A CA 3130322A CA 3130322 A CA3130322 A CA 3130322A CA 3130322 A1 CA3130322 A1 CA 3130322A1
Authority
CA
Canada
Prior art keywords
shopper
target
merchandise
code
store
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3130322A
Other languages
French (fr)
Inventor
Ting DAI
Shu Liu
Jiajia Cheng
Xiaogang Wang
Zhenzhen Ma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
10353744 Canada Ltd
Original Assignee
10353744 Canada Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 10353744 Canada Ltd filed Critical 10353744 Canada Ltd
Publication of CA3130322A1 publication Critical patent/CA3130322A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201—Market modelling; Market analysis; Collecting market data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Accounting & Taxation (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Computer Interaction (AREA)
  • General Business, Economics & Management (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Game Theory and Decision Science (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Alarm Systems (AREA)

Abstract

A method, an apparatus, a system, and a computer system for in-store shopper behavior monitoring are disclosed. The method includes identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper; monitoring and recognizing behavior of the target shopper in the store using a predetermined method; when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code;
and uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.

Description

MONITORING METHOD, DEVICE AND SYSTEM FOR USER BEHAVIORS IN STORE
AND COMPUTER SYSTEM
BACKGROUND OF THE INVENTION
Technical Field [0001] The present invention relates to monitoring, and more particular to a method, an apparatus, a system, and a computer system for in-store shopper behavior monitoring.
Description of Related Art
[0002] With the development of technology, more and more technical products have been used in operation of brick-and-mortar stores. For improving shopper experience, stores want to collect information about consumption habits and preferences of their customers and accordingly provide and recommend merchandise that meet customer needs. However, conventional brick-and-mortar stores often lack for equipment and methodology required by such information collection. Hence, there is a need for a method for in-store shopper behavior monitoring that can help brick-and-mortar stores to collect information about consumption habits and preferences of their customers, so as to allow these stores to make more relevant recommendations and provide better services.
SUMMARY OF THE INVENTION
[0003] To address the foregoing need, the primary objective of the present invention is to provide a method, an apparatus, a system, and a computer system for in-store shopper behavior monitoring.
[0004] For accomplishing this objective, in a first aspect, the present invention provides a method for in-store shopper behavior monitoring, which comprises:
[0005] identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
[0006] monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
[0007] when the target shopper is recognized as picking a merchandise item, identifying a Date recue / Date received 202 1-1 1-09 merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and
[0008] uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0009] In some embodiments, the step of "monitoring and recognizing behavior of the target shopper in the store using a predetermined method" comprises:
[0010] calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner.
[0011] The step of "when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, the step of generating a first association relationship between the merchandise code and the shopper code"
comprises:
[0012] when the image showing that the target shopper is picking the merchandise is photographed, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code.
[0013] In some embodiments, the step of "monitoring and recognizing behavior of the target shopper in the store using a predetermined method" comprises:
[0014] calling a predetermined sensor to detect any change in a total weight of merchandise items in a predetermined shelf and to quantify the change if such a change is detected.
[0015] The step of "when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code"
comprises:
[0016] when a said change is detected, according to the quantified change and the image photographed by the predetermined camera, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code.
[0017] In some embodiments, the method comprises:
[0018] when the target shopper is recognized as putting the merchandise item back, generating a second association relationship between the merchandise code and the shopper code; and
[0019] uploading the second association relationship and a second target image to the predetermined server, the second target image includes an image showing that the target shopper is putting the merchandise item back.
[0020] In some embodiments, the method comprises:
[0021] collecting an entry time and an exit time corresponding when the target shopper entered and Date recue / Date received 202 1-1 1-09 left the store, respectively; and
[0022] uploading the entry time and the exit time to the predetermined server.
[0023] In some embodiments, the method comprises:
[0024] calling the predetermined camera to photograph an entry image showing that the target shopper is entering the store and an exit image showing that the target shopper is leaving the store; and
[0025] uploading the entry image and the exit image to the predetermined server.
[0026] In a second aspect, the present invention provides an apparatus for in-store shopper behavior monitoring, the apparatus comprising:
[0027] an identification module, for identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
[0028] a monitoring module, for monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
[0029] a processing module, for when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code;
and
[0030] an uploading module, for uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0031] In some embodiments, the monitoring module is further for calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner;
the processing module is further for when the image showing that the target shopper is picking the merchandise is photographed, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code.
[0032] In a third aspect, the present invention provides a system for in-store shopper behavior monitoring, which comprises a processing end, a predetermined camera, and a predetermined sensor.
[0033] The processing end is configured to perform: identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper; calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner; calling a predetermined sensor to detect any change in a total weight of merchandise items in a Date recue / Date received 202 1-1 1-09 predetermined shelf and to quantify the change if such a change is detected;
when a said change is detected, according to the quantified change and the image photographed by the predetermined camera, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code;
uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0034] The predetermined camera is configured to photograph and recognize the behavior of the target shopper in the store in a real-time manner.
[0035] The predetermined sensor is for detecting any change in a total weight of merchandise items in a predetermined shelf and for quantifying the change if such a change is detected.
[0036] In a fourth aspect, the present invention provides a computer system comprising:
[0037] one or more processors; and
[0038] a memory coupled with the one or more processors, the memory storing a program instruction that when executed by the one or more processors performing following operations:
[0039] identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
[0040] monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
[0041] when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and
[0042] uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0043] The present invention has the following beneficial effects:
[0044] The present invention discloses a method for in-store shopper behavior monitoring, comprising steps of identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
monitoring and recognizing behavior of the target shopper in the store using a predetermined method; when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and uploading the first association relationship and a first target image to a predetermined server, wherein the first Date recue / Date received 202 1-1 1-09 target image includes an image showing that the target shopper is picking the merchandise item.
The present invention realizes full-chain monitoring to shopping behavior of shoppers, and helps in-store operational staff to achieve better in-shopping and/or post-shopping engagement with shoppers according to images stored previously. The present invention may further support shopper profiling with the collected shopper behavior data such as the association relationships, so as to allow stores to make more relevant recommendations and provide better services for customers.
BRIEF DESCRIPTION OF THE DRAWINGS
[0045] The accompanying drawings are provided herein for better understanding of the present invention and form a part of this disclosure. The illustrative embodiments and their descriptions are for explaining the present invention and by no means form any improper limitation to the present invention, wherein:
[0046] FIG. 1 is a schematic drawing of a system for in-store shopper behavior monitoring according to one embodiment of the present invention;
[0047] FIG. 2 is a structural diagram of a computer system according to one embodiment of the present invention;
[0048] FIG. 3 is a flowchart of a method according to one embodiment of the present invention; and
[0049] FIG. 4 is a structural diagram of an apparatus according to one embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0050] To make the foregoing objectives, features, and advantages of the present invention clearer and more understandable, the following description will be directed to some embodiments as depicted in the accompanying drawings to detail the technical schemes disclosed in these embodiments. It is, however, to be understood that the embodiments referred herein are only a part of all possible embodiments and thus not exhaustive. Based on the embodiments of the present invention, all the other embodiments can be conceived without creative labor by people of ordinary skill in the art, and all these and other embodiments shall be embraced in the scope of the present invention.
[0051] As mentioned above, to address the need of the art, the present invention provides a method for in-store shopper behavior monitoring. To implement the method, as shown in FIG. 1, the Date recue / Date received 202 1-1 1-09 present invention also discloses a system for in-store shopper behavior monitoring. The system includes a store server, at least one smart shelf, an access control system, and at least one security camera, all installed in a store. The store server may interact with a cloud server so ta to transmit videos and shopper behavior data. The smart shelf is for displaying merchandise items to be sold, and the smart shelf is equipped with a weighting sensor, so that when the total weight of the merchandise on the smart shelf changes, the weighting sensor can find and quantify the change in weight. The access control system includes a code reader, an infrared sensor, and a depth camera. The code reader can scan a QR code associated with a shopper so as to get identity information of the shopper. The depth camera can capture an image of the face of the shopper, and the face image can be used to identify the shopper. The infrared sensor can recognize whether a shopper is entering or leaving the store. The security camera can take pictures of the in-store scenes in a real-time manner and upload the pictures to the store server.
[0052] Specifically, using the foregoing system to perform in-store shopper behavior monitoring includes the following steps.
[0053] Step 1 involves identifying a shopper entering a store.
[0054] Therein, the depth camera may capture data about the face of the shopper. The code reader may scan a QR code representing the shopper. Then the face data and QR code are uploaded to the store server. The store server identifies the shopper according to the face data or according to the QR code. The identity of the shopper is determined using a code exclusive to that very use.
[0055] The store server may further generate an entry record of the shopper.
The entry record includes the time when the shopper entered the store.
[0056] Step 2 involves using the security camera to monitor and recognize the behavior of the shopper in a real-time manner.
[0057] Step 3 involves when the security camera recognizes that the shopper is picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and establishing a first association relationship between the shopper code representing the identity of the shopper and the merchandise code.
[0058] Preferably, the security camera and the smart shelf can both recognize whether the shopper is picking a merchandise item.
[0059] The security camera recognizes that the shopper is picking a merchandise item through the following process:
[0060] recognizing the action by which the shopper is picking the merchandise item from the real-time monitoring image; and Date recue / Date received 202 1-1 1-09
[0061] recognizing a merchandise code exclusive to the picked merchandise item.
[0062] The smart shelf recognizes the action by which the shopper is picking the merchandise item by:
[0063] when the weighting sensor detects that total weight of the merchandise items om the smart shelf has changed, the smart sensor determines the variation of the total weight; and
[0064] according to the image of the shopper picking the item captured by the security camera ant the determined variation, recognizing the merchandise corresponding merchandise code.
[0065] The store server is capable of generating a first image record according to the monitoring video or the monitoring video screenshot temporally corresponding to the moment on which the shopper is picking the merchandise item as captured and recognized by the camera aimed at the merchandise item.
[0066] Step 4 involves when the shopper puts the merchandise item back to the smart shelf, creating a second association relationship between the identity code of the shopper and the merchandise code.
[0067] Preferably, recognizing that the shopper is putting the merchandise item back is achieved by:
[0068] recognizing the action by which the shopper is putting the merchandise item back from the real-time monitoring image; and
[0069] recognizing the merchandise code exclusive to the merchandise item put back.
[0070] The store server is capable of generating a second image record according to the monitoring video or the monitoring video screenshot temporally corresponding to the moment on which the shopper is putting the merchandise item back as captured and recognized by the camera aimed at the merchandise item.
[0071] Step 5 involves when the shopper is recognized as leaving the store, generating an exit record associated with the shopper. The exit record includes the exit time on which the shopper is leaving the store.
[0072] In Step 6, the store server uploads the complete record from the shopper entering to leaving the store to a cloud server.
[0073] The complete record includes a store code, the shopper code, the entry record, the exit record, the first association relationship and the second association relationship.
[0074] The complete record further includes the first image record and the second image record.
[0075] The operational staff of the store can review the in-store behavior of the shopper from the complete record stored in the cloud server, and extract relevant shopper behavior data according to the behavior of the shopper for facilitating shopper profiling of the store.
[0076] Embodiment 2 Date recue / Date received 202 1-1 1-09
[0077] Based on the foregoing embodiment, as shown in FIG. 3, the present invention discloses a method for in-store shopper behavior monitoring. The method includes:
[0078] 310. identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
[0079] 320. monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
[0080] 330. when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code;
[0081] in which, preferably, the step of "monitoring and recognizing behavior of the target shopper in the store using a predetermined method" includes:
[0082] 331. calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner;
[0083] the step of "when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code" includes:
[0084] 332, when the image showing that the target shopper is picking the merchandise is photographed, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code.
[0085] Preferably, the step of "monitoring and recognizing behavior of the target shopper in the store using a predetermined method" includes:
[0086] 333. calling a predetermined sensor to detect any change in a total weight of merchandise items in a predetermined shelf and to quantify the change if such a change is detected;
[0087] in which the step of "when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code"
includes:
[0088] 334. when a said change is detected, according to the quantified change and the image photographed by the predetermined camera, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code;
[0089] 340. uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0090] Preferably, the method comprises:

Date recue / Date received 202 1-1 1-09
[0091] 350. when the target shopper is recognized as putting the merchandise item back, generating a second association relationship between the merchandise code and the shopper code; and
[0092] 351. uploading the second association relationship and a second target image to the predetermined server, the second target image includes an image showing that the target shopper is putting the merchandise item back.
[0093] Preferably, the method comprises:
[0094] 360. collecting an entry time and an exit time corresponding when the target shopper entered and left the store, respectively; and
[0095] 361. uploading the entry time and the exit time to the predetermined server.
[0096] Preferably, the method comprises:
[0097] 370. calling the predetermined camera to photograph an entry image showing that the target shopper is entering the store and an exit image showing that the target shopper is leaving the store; and
[0098] 371. uploading the entry image and the exit image to the predetermined server.
[0099] Embodiment 3
[0100] Based on the foregoing method, as shown in FIG. 4, the present invention discloses an apparatus for in-store shopper behavior monitoring. The apparatus includes:
[0101] An identification module 410, for identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
[0102] A monitoring module 420, for monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
[0103] A processing module 430, for when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code;
and
[0104] An uploading module 440, for uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0105] Preferably, the monitoring module 420 is further for calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner;
the processing module 430 is further for when the image showing that the target shopper is picking the merchandise is photographed, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code Date recue / Date received 202 1-1 1-09 and the shopper code.
[0106] Preferably, the monitoring module 420 is further for calling a predetermined sensor to detect any change in a total weight of merchandise items in a predetermined shelf and to quantify the change if such a change is detected; the processing module 430 is further for when a said change is detected, according to the quantified change and the image photographed by the predetermined camera, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code.
[0107] Preferably, the processing module 430 is further for when the target shopper is recognized as putting the merchandise item back, generating a second association relationship between the merchandise code and the shopper code; the uploading module 440 is further for uploading the second association relationship and a second target image to the predetermined server, the second target image includes an image showing that the target shopper is putting the merchandise item back.
[0108] Preferably, the processing module 430 is further for collecting an entry time and an exit time corresponding when the target shopper entered and left the store, respectively; the uploading module 440 is further for uploading the entry time and the exit time to the predetermined server.
[0109] Preferably, the processing module 430 is further for calling the predetermined camera to photograph an entry image showing that the target shopper is entering the store and an exit image showing that the target shopper is leaving the store; and the uploading module 440 is further for uploading the entry image and the exit image to the predetermined server.
[0110] Embodiment 4
[0111] Based on the method, the apparatus and the system discussed above, the present embodiment provides a computer system, which includes:
one or more processors; and a memory coupled with the one or more processors, wherein the memory stores a program instruction that when executed by the one or more processors performs following operations:
[0112] identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
[0113] monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
[0114] when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and
[0115] uploading the first association relationship and a first target image to a predetermined server, Date recue / Date received 202 1-1 1-09 wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
[0116] FIG. 2 illustratively depicts a structure of the computer system. It may specifically include a processor 1510, a video display adapter 1511, a disk driver 1512, an I/O port 1513, a network port 1514, and a memory 1520. The processor 1510, the video display adapter 1511, the disk driver 1512, the I/O port 1513, the network port 1514, and the memory 1520 may be communicatively connected through a communication bus 1530.
[0117] Therein, the processor 1510 may be implemented using a common CPU
(Central Processing Unit), a microprocessor, an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits for executing relevant programs to realize the technical scheme provided by the present invention.
[0118] The memory 1520 may be realized using a ROM (Read Only Memory), a RAM
(Random Access Memory), a static storage device, a dynamic storage device or any analog.
The memory 1520 may store for an operating system 1521 that controls operation of the computer system 1500, and a basic input/output system (BIOS) for controlling low-level operations of the computer system 1500. In addition, it may further store a web browser 1523, a data storage management system 1524, and an icon and font processing system 1525. The icon and font processing system 1525 may be an application enabling operations of the foregoing various steps of the embodiments of the present invention. In any case, when the technical scheme provided by present invention is realized using software or firmware, the related program codes are stored in the memory 1520 for the processor 1510 to call and execute.
The I/O port 1513 is for connecting an I/O module for allowing data input and output. The input/output module may be built in the apparatus as a component (not shown), or may be set externally and connected to the apparatus so as to provides corresponding functions. Therein, the input device may include a keyboard, a mouse, a touch panel, a microphone, various sensors or more. The output device may include a display, an amplifier, a vibrator, an indicator or more.
[0119] The network port 1514 is for connecting a communication module (not shown) to allow communication between the disclosed apparatus and external devices. Therein, the communication module may enable communication either in a wired manner (such as through a USB, a network line, etc.) or in a wireless way (such as through a mobile network, WIFI, Bluetooth, etc.).
[0120] The bus 1530 includes a channel through which information can be transmitted among components of the disclosed apparatus (i.e., the processor 1510, the video display adapter 1511, the disk driver 1512, the I/O port 1513, the network port 1514, and the memory 1520).

Date recue / Date received 202 1-1 1-09
[0121] Additionally, the computer system 1500 may further retrieve information from a virtual database 1541 for information on resource receiving condition for facilitating its condition determination or more.
[0122] It is to be noted that while the apparatus in the depicted embodiment works merely by virtue of the processor 1510, the video display adapter 1511, the disk driver 1512, the I/O port 1513, the network port 1514, the memory 1520, and the bus 1530, in practical implementations, the apparatus may further include additional components required for its desired purposes.
Moreover, people skilled in the art would appreciate that the disclosed apparatus may only include the minimal number of components for realizing the scheme of the present invention instead of having all these depicted components.
[0123] From the description above, people skilled in the art would clearly recognize that the present invention may be realized using software in combination with necessary universal hardware-based platform. Based on this understanding, the technical scheme of the present invention may, in nature or for its part that is contributive to the improvement of the prior art, implemented in the form of a software product. Such a computer software product may be stored in a storage medium, such as a ROM/RAM, a disc, an optical disk, or the like and include several instructions that direct a computer-based apparatus (such as a personal computer, a cloud server, or a network device) to perform the methods as described in any embodiment or any part of an embodiment of the present invention.
[0124] The embodiments disclosed herein are described in a progressive sense, and therefore a part in one embodiment may having its details complemented by the description for its counter parts in other embodiments. Every embodiment is such described that it only emphasizes what differentiates it from the other embodiments. Particularly, for a system or an embodiment directed to a system, the subject matter may be described in a simplified way as more details may be learned from the embodiment about its relevant method. The system and system embodiment disclosed herein are merely illustrative, in which a unit described as a separated part may be or may be not physically separated, and a part shown as a unit may be or may be not a physical unit, meaning that it may be located at one site or alternatively be distributed across multiple units in a network. The purpose of an embodiment may be realized using all or some of the described/shown modules according to practical needs. People skilled in the art would understand and implement the present invention without paying creative efforts.
[0125] The present invention has been described with reference to the preferred embodiments and it is understood that the embodiments are not intended to limit the scope of the present invention.
Moreover, as the contents disclosed herein should be readily understood and can be Date recue / Date received 202 1-1 1-09 implemented by a person skilled in the art, all equivalent changes or modifications which do not depart from the concept of the present invention should be encompassed by the appended claims. Hence, the scope of the present invention shall only be defined by the appended claims.

Date recue / Date received 202 1-1 1-09

Claims (10)

What is claimed is:
1. A method for in-store shopper behavior monitoring, comprising steps of:
identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
2. The method of claim 1, wherein the step of "monitoring and recognizing behavior of the target shopper in the store using a predetermined method" comprises:
calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner;
whereby the step of "when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code" comprises:
when the image showing that the target shopper is picking the merchandise is photographed, identifying the merchandise code exclusive to the merchandise item, and generating the first association relationship between the merchandise code and the shopper code.
3. The method of claim 2, wherein the step of "monitoring and recognizing behavior of the target shopper in the store using a predetermined method" comprises:

Date recue / Date received 2021-11-09 calling a predetermined sensor to detect any change in a total weight of merchandise items in a predetermined shelf and to quantify the change if such a change is detected;
whereby the step of "when the target shopper is recognized as picking a merchandise item, identifying the merchandise code exclusive to the merchandise item, and generating the first association relationship between the merchandise code and the shopper code" comprises:
when a said change is detected, according to the quantified change and the image photographed by the predetermined camera, identifying the merchandise code exclusive to the merchandise item, and generating the first association relationship between the merchandise code and the shopper code.
4. The method of any of claims 1-3, further comprising:
when the target shopper is recognized as putting the merchandise item back, generating a second association relationship between the merchandise code and the shopper code;
and uploading the second association relationship and a second target image to the predetermined server, wherein the second target image includes an image showing that the target shopper is putting the merchandise item back.
5. The method of any of claims 1-3, further comprising:
collecting an entry time and an exit time corresponding when the target shopper entered and left the store, respectively; and uploading the entry time and the exit time to the predetermined server.
6. The method of any of claims 1-3, further comprising:
calling the predetermined camera to photograph an entry image showing that the target shopper is entering the store and an exit image showing that the target shopper is leaving the store; and uploading the entry image and the exit image to the predetermined server.
Date recue / Date received 2021-11-09
7. An apparatus for in-store shopper behavior monitoring, comprising:
an identification module, for identifying identity information associated with a target shopper present .. in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
a monitoring module, for monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
a processing module, for when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and an uploading module, for uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.
8. The apparatus of claim 7, wherein the monitoring module is further for calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner; and the processing module is further for when the image showing that the target shopper is picking the merchandise is photographed, identifying the merchandise code exclusive to the merchandise item, and generating the first association relationship between the merchandise code and the shopper code.
9. A system for in-store shopper behavior monitoring, comprising a processing end, a predetermined camera, and a predetermined sensor, the processing end for identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper; calling a predetermined camera to photograph and recognize the behavior of the target shopper in the store in a real-time manner; calling a predetermined sensor to detect any change in a total weight of merchandise items in a predetermined shelf and to quantify the change if such a change is detected;
when a said change is detected, according to the quantified change and the image photographed by the predetermined camera, identifying a merchandise code exclusive to the merchandise item, and Date recue / Date received 2021-11-09 generating a first association relationship between the merchandise code and the shopper code; and uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item;
the predetermined camera for photographing and recognizing the behavior of the target shopper in the store in a real-time manner; and the predetermined sensor for detecting any change in a total weight of merchandise items in a predetermined shelf and to quantify the change if such a change is detected.
10. A computer system, comprising:
one or more processors; and a memory coupled with the one or more processors, the memory storing a program instruction that when executed by the one or more processors performing following operations:
identifying identity information associated with a target shopper present in a store, wherein the identity information includes a shopper code exclusive to the target shopper;
monitoring and recognizing behavior of the target shopper in the store using a predetermined method;
when the target shopper is recognized as picking a merchandise item, identifying a merchandise code exclusive to the merchandise item, and generating a first association relationship between the merchandise code and the shopper code; and uploading the first association relationship and a first target image to a predetermined server, wherein the first target image includes an image showing that the target shopper is picking the merchandise item.

Date recue / Date received 2021-11-09
CA3130322A 2020-09-09 2021-09-09 Monitoring method, device and system for user behaviors in store and computer system Pending CA3130322A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010942975.1 2020-09-09
CN202010942975.1A CN112215068A (en) 2020-09-09 2020-09-09 Method, device and system for monitoring user behaviors in shop and computer system

Publications (1)

Publication Number Publication Date
CA3130322A1 true CA3130322A1 (en) 2022-03-09

Family

ID=74049217

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3130322A Pending CA3130322A1 (en) 2020-09-09 2021-09-09 Monitoring method, device and system for user behaviors in store and computer system

Country Status (2)

Country Link
CN (1) CN112215068A (en)
CA (1) CA3130322A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115687674A (en) * 2022-12-20 2023-02-03 昆明勤砖晟信息科技有限公司 Big data demand analysis method and system serving smart cloud service platform

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108198052A (en) * 2018-03-02 2018-06-22 北京京东尚科信息技术有限公司 User's free choice of goods recognition methods, device and intelligent commodity shelf system
CN108805495A (en) * 2018-05-31 2018-11-13 京东方科技集团股份有限公司 Article storage management method and system and computer-readable medium

Also Published As

Publication number Publication date
CN112215068A (en) 2021-01-12

Similar Documents

Publication Publication Date Title
US11847689B2 (en) Dynamic customer checkout experience within an automated shopping environment
US20210312772A1 (en) Storefront device, storefront management method, and program
CN109215254B (en) Physical store application system, user information processing method and device
CN109213310B (en) Information interaction equipment, data object information processing method and device
US20190327451A1 (en) Video image analysis apparatus and video image analysis method
US20200364752A1 (en) Storefront device, storefront system, storefront management method, and program
KR102254639B1 (en) System and method for managing stores
JP7035395B2 (en) Anomaly detection system, information processing device, and anomaly detection method
US9836734B2 (en) Providing electronic receipts for vending machine transactions
CN112200631B (en) Industry classification model training method and device
CA3130322A1 (en) Monitoring method, device and system for user behaviors in store and computer system
CN110677448A (en) Associated information pushing method, device and system
WO2018222811A1 (en) Automated point of sale system
US10938890B2 (en) Systems and methods for managing the processing of information acquired by sensors within an environment
JP2020095581A (en) Method for processing information, information processor, information processing system, and store
US20180075462A1 (en) Systems and methods for analyzing remotely located facilities
CN112950329A (en) Commodity dynamic information generation method, device, equipment and computer readable medium
JP6345366B1 (en) Information processing apparatus, information processing apparatus control method, and information processing apparatus control program
CN113129112A (en) Article recommendation method and device and electronic equipment
JPWO2021230123A5 (en)
US20240221008A1 (en) Processing apparatus, processing method, and non-transitory storage medium
JP2016024601A (en) Information processing apparatus, information processing system, information processing method, commodity recommendation method, and program
WO2023032000A1 (en) Processing device, processing method, and program
TWI821006B (en) System for evaluating waiting time based on purchases and payment delay and method thereof
US20220092573A1 (en) Portable terminal and information processing method for a portable terminal

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20220916

EEER Examination request

Effective date: 20220916

EEER Examination request

Effective date: 20220916

EEER Examination request

Effective date: 20220916

EEER Examination request

Effective date: 20220916

EEER Examination request

Effective date: 20220916