US20190107394A1 - Tracking movement of physical objects through a confined space - Google Patents
Tracking movement of physical objects through a confined space Download PDFInfo
- Publication number
- US20190107394A1 US20190107394A1 US16/216,436 US201816216436A US2019107394A1 US 20190107394 A1 US20190107394 A1 US 20190107394A1 US 201816216436 A US201816216436 A US 201816216436A US 2019107394 A1 US2019107394 A1 US 2019107394A1
- Authority
- US
- United States
- Prior art keywords
- time
- entrance
- exit
- average
- particular location
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 claims abstract description 34
- 230000004044 response Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 7
- 230000001815 facial effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 239000002537 cosmetic Substances 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 241000894007 species Species 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 239000008187 granular material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/04—Interpretation of pictures
-
- G06K9/00771—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/02—Reservations, e.g. for tickets, services or events
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0255—Targeted advertisements based on user history
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0277—Online advertisement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/01—Social networking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
Definitions
- the present disclosure relates to tracking the movement of physical objects through a confined space, and calculating average staying times for the physical objects.
- FIG. 1 is a flow diagram that depicts a first process for calculating an average shopping time, in an embodiment
- FIG. 2 is a flow diagram that depicts a second process for calculating an average shopping time, in an embodiment
- FIG. 3 is a block diagram that illustrates a computer system upon which an embodiment of the invention may be implemented.
- an entrance time is determined for each object (e.g., a person) that enters a location and the entrance time is associated with the object.
- An exit time is later determined for each object.
- a staying duration is determined that reflects a difference between the exit time for that object and the entrance time for that individual.
- the staying duration is referred to as “shopping time.”
- An average staying duration is determined based on all the objects that have an associated staying duration.
- objects are not tracked. Instead, multiple entrance times are determined, one for each object that enters a certain location. Also, multiple exit times are determined, one for each object that exits the location. An average entrance time is determined based on all the entrance times. An average exit time is determined based on all the exit times. An average staying duration is determined by comparing the average exit time with the average entrance time.
- Reference herein to “average staying duration,” “average shopping time,” or “average time” also includes median staying duration, median shopping time, or median time, unless otherwise indicated. Selecting a median shopping time, for example, reduces the effect that outliers (e.g., all day shoppers) would have in a calculated average shopping time.
- average staying duration may be calculated for people at a certain place in a museum or zoo.
- average staying duration of one or more animals within a certain geographical area may be calculated.
- a “store” is any physical location where customers can enter and purchase one or more items, such as food, clothing, electronics, toys, office/school supplies, plants, fuel, etc.
- a store may include an enclosed building with a roof and walls or may be an open air market that has no walls or no walls or roof.
- a store may be a retail store or a wholesale store.
- objects are tracked and their individual staying durations are determined.
- An object may be tracked in one of multiple ways.
- one or more video cameras may be directed to one or more entrances of a store and generate video data of people entering the store.
- Facial recognition software is used to detect and recognize faces of the people.
- the same or different set of one or more cameras is directed to an exit of the store and generates video data of people exiting the store.
- the facial recognition software is used to detect and recognize faces of the people exiting the store and match those faces with the faces detected of the people entering the store. If there is a match, then a shopping duration is determined for the person corresponding to the match.
- the facial recognition and matching may be performed “online”; that is, while the video data is being generated or while the store is open. Alternatively, the facial recognition and matching may be performed “offline” or after the store closes.
- a card e.g., a credit card or a card issued by the store
- entering/swiping the card into the same or different card reader upon exit e.g., a credit card or a card issued by the store
- Previously-issued cards could be used in the context of access controlled office spaces.
- each individual receives a RFID tag upon entering the store.
- An RFID tag may be activated upon being issued to an individual.
- the RFID tag sends a signal to one or more RFID receivers. When no RFID receivers receive the signal from the RFID tag, then it is presumed that the individual has exited the store.
- the RFID tag may send a signal to an RFID receiver when the RFID tag reaches an exit, indicating that the individual has left the store.
- FIG. 1 is a flow diagram that depicts a process 100 for calculating an average shopping time, in an embodiment.
- an entrance time is determined.
- an exit time is determined.
- block 130 for each individual that exits the store, the entrance time of that individual is identified. If video surveillance is used to track individuals, then block 130 may comprise determining a match for a face of an individual that exited the store with a face of an individual that entered the store. If no match is determined (e.g., within a certain degree of confidence), then the exit time of the individual that exited the store may be discarded. If a match is found (e.g., within a certain degree of confidence), then the entrance time associated with that individual is retrieved.
- a shopping time for the individual is determined.
- the shopping time may be determined by subtracting the exit time from the entrance time. For example, if an individual entered the store at 11:34 AM on a particular day and exited the store at 12:19 PM on the particular day, then the individual's shopping time is 45 minutes.
- an average shopping time is calculated based on the shopping times for multiple individuals that entered and exited the store.
- the average shopping time may be calculated by totaling the shopping times of the multiple individuals and dividing the total by the number of individuals for which a shopping time has been determined.
- the average shopping time excludes shopping times of individuals who did not purchase an item during the day and time that was tracked.
- the average shopping time may reflect only shopping times of customers that actually purchased an item from the store while in the store during the tracked duration.
- purchasing customers may be identified when such customers, for example, arrive at a checkout counter to purchase one or more items from the store or when such customers leave a self-checkout location designated for customers who do not require assistance from a store employee to purchase the item(s).
- a camera may be present at a checkout location (if one exists) that captures video or one or more images of the customer that is purchasing (or just purchased) one or more items.
- point of sale data may be used to determine shopping times for purchasing customers.
- an average shopping time is determined for purchasing customers and an average shopping time is determined for non-purchasing customers.
- a comparison of the two average shopping times may reveal, for example, that customers who make a purchase during the tracked duration tend to spend a significantly less time in the store than customers who did not make a purchase during the tracked duration.
- entrance times and exit times are tracked regardless of the individual who enters and exits. Because the average shopping time over all customers is sought, the exit times and entrance times do not need to be paired.
- the following set of equations illustrate that the above equation is equivalent to determining the difference between the average entrance time and the average exit time for a day measurement:
- the average shopping time may be found by finding the difference between the average exit time and the average entrance time.
- FIG. 2 is a flow diagram that depicts a process 200 for calculating an average duration time, in an embodiment.
- an entrance time may be determined when an individual removes a card from a card dispenser (similar to when a car driver takes a card from a card machine at a parking garage) or when an individual swipes a card (in the individual's possession before approaching the store) over a card reader.
- a number of exit times is determined.
- the exit times may be determined in the same (or similar) way the entrance times are determined. For example, if a card was issued to an individual upon entrance into the store, then the individual may swipe the card at a card reader upon exit or a transmitter in the card may send a signal to a receiver when the individual exits with the card.
- video data may be automatically analyzed to determine that an object (e.g., regardless of identity) exits the specified geographical location (e.g., store).
- exit times or entrance times are not excluded, even if there is a difference in their respective numbers.
- the average entrance time and/or average exit time is still valid if reasonable assumptions are made about the error distribution.
- an average entrance time is determined.
- the average entrance time may be determined by adding the entrance times (determined in block 210 ) to generate a total entrance time and then dividing the total entrance time by the number of entrance times. While FIG. 2 depicts block 230 as occurring subsequent to block 220 , block 230 may be determined prior to block 220 or while block 220 is being performed. For example, the average entrance time may be continually updated as objects (e.g. people) enter the geographical area (e.g., store).
- an average exit time is determined.
- the average exit time may be determined by adding the exit times (determined in block 220 ) to generate a total exit time and then dividing the total exit time by the number of exit times.
- Block 240 may be determined continually as individuals are exiting the store. Alternatively, block 240 (and/or block 230 ) may be performed after the store has closed on that particular day.
- payments such as credit card or debit card payments
- checkout are used to represent when people are finished shopping. In this way, physical exits from a store do not need to be tracked.
- Timestamp Format and Timestamp Granularity
- the party or entity that determines the timestamps is different than the party or entity that determines an average shopping time based on the timestamps.
- a computing device owned or managed by a store may report timestamp data (reflecting multiple timestamps) to a third party that is tasked with calculating the average shopping time and, optionally, using the average shopping time to perform one or more other calculations.
- the store's computing device may report the timestamp data in one of many different types of formats.
- the timestamp data may be a list of entrance times and a list exit times, where each entrance time is associated with a unique entrance and each exit time is associated with a unique exit.
- the timestamp data may be a list of entrance times and a list of exit times where each entrance time is associated with a count that indicates a number of individuals that entered at or around the entrance time and where each exit time is associated with a count that indicates a number of individuals that exited at or around the exit time.
- the list of entrance times may include 10:05, 10:10, and 10:20.
- Time 10:05 may be associated with a count of four
- time 10:10 may be associated with a count of one
- time 10:20 may be associated with a count of seven. These counts indicate that four people entered the store between 10:00 and 10:05, that one person entered the store between 10:05 and 10:10, that no one entered the store between 10:10 and 10:15, and that seven people entered the store between 10:15 and 10:20.
- timestamp data includes counts
- the different entrance times and exit times may be weighted based on their respective counts.
- an entrance time that is associated with a count of ten may be weighted twice as much as an entrance time that is associated with a count of five.
- the granularity of the times is every five minutes.
- the granularity of the timestamp data may vary from implementation to implementation.
- Each timestamp may be at the granularity of milliseconds, seconds, minutes, five minutes (as the above example), or some other time range.
- timestamps of one or more individuals may be excluded when calculating the average shopping time at a store.
- An example of such an individual is anyone shorter than a certain height, such as under 50 inches.
- Such individuals may be presumed to be children that are not at the store to shop for themselves or others. Small children may be detected in ways other than determining their height, such as detecting that an individual is sitting in a stroller or shopping cart.
- Teen sitting in a stroller or shopping cart is presumed to be a child.
- average shopping time may be calculated for time periods that are less than the period of time that a store is open. For example, an AST may be determined for each two hours (e.g., 8 AM-10 AM, 10 AM-12 PM, 12 PM-2 PM, 2 PM-4 PM, and 4 PM-6 PM). In this way, more granule ASTs are determined for a particular store and can be used to determine how long people are shopping during those time intervals. The resulting ASTs for a single day (or compared across multiple days) may reveal that people are shopping longer in the morning hours than in the afternoon hours
- an AST when determining an average shopping time (AST), those who enter a store are not the same as those who exit the store. For example, an AST may be determined for 10 AM-1 PM on a particular day when a store is open from 8 AM to 10 PM. Thus, some people may have entered the store before 10 AM and exited the store between 10 AM and 1 PM. Similarly, other people may have entered the store between 10 AM and 1 PM and exited the store after 1 PM. For example, if a large number of people enter at 12:55 PM and do not leave until after 1 PM, then the average exit time may be skewed toward the 1 PM time and the average staying duration for 10 AM and 1 PM may be longer than in actuality.
- Another approach involves determining a difference in the number of entrances and the number of exits. If the number of entrances is greater than the number of exits, then one or more entrance times may be excluded from determining the average entrance time. The number of entrance times to exclude may be equal to the difference between the number of entrances and the number of exits. The specific entrance times to exclude may be entrances that occurred closest to the end of the tracked duration (e.g., 1 PM in the above example).
- average shopping times are determined for multiple days. The different ASTs may then be compared to each other. For example, an AST for one Monday is compared with an AST for another Monday.
- One reason such a comparison may be performed is because the store may have changed the layout between the two Mondays and a manager/owner of the store desires to see if the average shopping duration has increased or decreased as a result of the layout.
- ASTs for multiple time durations may be aggregated. For example, an AST may be determined for each day of March in a particular year. Then an AST for March may be determined by adding the AST for each day of March and dividing the total by the number of shopping days in March. Additionally or alternatively, a median shopping time (MST) may be determined for March. As another example, an AST (or MST) may be determined for each Thursday of a summer month in a particular year. A single AST for summer Thursdays may then be determined, along with a standard deviation.
- MST median shopping time
- average shopping times are determined for different locations. For example, one AST for one store location (e.g., in one California city) is determined and another AST for another store location (e.g., in a neighboring California city) is determined. The two ASTs may be for the same day or for different days. The two ASTs may be compared to reveal that the AST for one store location is significantly different than the AST for the other store location.
- an AST may be determined for a month (e.g., based on individual day ASTs) for one store that sells high end clothing and another AST may be determined for another store that sells low end clothing and that has the same or similar layout as the first store.
- the two stores may be relatively close to each other (e.g., in the same or neighboring city) or may be relatively far from each other (e.g., in different counties, states, or countries).
- the two ASTs may be compared to determine which store has a higher AST.
- the techniques described herein may be used to track average shopping time spent in a specific area within a store. For example, a store owner may desire to know how long people are looking at or are near the shoe display, at least on average. The store owner may regard a relatively high average (or median) time spent near the shoe display as a success of the shoe display in attracting attention.
- a specific area within a store may be a cosmetics section, within a store, that has a history of customers complaining about the long wait times.
- a store owner may add employees and/or change the layout of the cosmetics section to assist in reducing shopping times of future customers.
- An average shopping time (AST) may be calculated for the cosmetics section to determine whether the AST for the cosmetics section has decreased as a result of the added employees and/or the changed layout.
- many techniques may be used to determine the entrances to and the exits from a specific area within a store. For example, one or more cameras may be pointed at the specific area such that whenever an individual comes into view of the camera(s), then an entrance timestamp for that individual is determined and stored. Similarly, if an individual leaves the view of the camera(s), then an exit timestamp is determined and stored.
- an average “looking” time may be calculated for a particular painting at a museum where, for example, administrators of the museum desire to know (a) the average time people spend in an art exhibit consisting of work of a particular artist or (b) the average time people spend within a small geographical area around a particular work of art. It is presumed that if a person is within the small geographical area, then the person is there to admire or at least look at the work of art.
- a zoo may want to determine how long a certain bird species spends in a particular area of a cage. Knowing the average staying duration of each bird in that area may provide a clue as to the daily habits of the bird species.
- the techniques described herein are implemented by one or more special-purpose computing devices.
- the special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination.
- ASICs application-specific integrated circuits
- FPGAs field programmable gate arrays
- Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques.
- the special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
- FIG. 3 is a block diagram that illustrates a computer system 300 upon which an embodiment of the invention may be implemented.
- Computer system 300 includes a bus 302 or other communication mechanism for communicating information, and a hardware processor 304 coupled with bus 302 for processing information.
- Hardware processor 304 may be, for example, a general purpose microprocessor.
- Computer system 300 also includes a main memory 306 , such as a random access memory (RAM) or other dynamic storage device, coupled to bus 302 for storing information and instructions to be executed by processor 304 .
- Main memory 306 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 304 .
- Such instructions when stored in non-transitory storage media accessible to processor 304 , render computer system 300 into a special-purpose machine that is customized to perform the operations specified in the instructions.
- Computer system 300 further includes a read only memory (ROM) 308 or other static storage device coupled to bus 302 for storing static information and instructions for processor 304 .
- ROM read only memory
- a storage device 310 such as a magnetic disk or optical disk, is provided and coupled to bus 302 for storing information and instructions.
- Computer system 300 may be coupled via bus 302 to a display 312 , such as a cathode ray tube (CRT), for displaying information to a computer user.
- a display 312 such as a cathode ray tube (CRT)
- An input device 314 is coupled to bus 302 for communicating information and command selections to processor 304 .
- cursor control 316 is Another type of user input device
- cursor control 316 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 304 and for controlling cursor movement on display 312 .
- This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
- Computer system 300 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes or programs computer system 300 to be a special-purpose machine. According to one embodiment, the techniques herein are performed by computer system 300 in response to processor 304 executing one or more sequences of one or more instructions contained in main memory 306 . Such instructions may be read into main memory 306 from another storage medium, such as storage device 310 . Execution of the sequences of instructions contained in main memory 306 causes processor 304 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
- Non-volatile media includes, for example, optical or magnetic disks, such as storage device 310 .
- Volatile media includes dynamic memory, such as main memory 306 .
- Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
- Storage media is distinct from but may be used in conjunction with transmission media.
- Transmission media participates in transferring information between storage media.
- transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 302 .
- transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
- Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor 304 for execution.
- the instructions may initially be carried on a magnetic disk or solid state drive of a remote computer.
- the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
- a modem local to computer system 300 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
- An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 302 .
- Bus 302 carries the data to main memory 306 , from which processor 304 retrieves and executes the instructions.
- the instructions received by main memory 306 may optionally be stored on storage device 310 either before or after execution by processor 304 .
- Computer system 300 also includes a communication interface 318 coupled to bus 302 .
- Communication interface 318 provides a two-way data communication coupling to a network link 320 that is connected to a local network 322 .
- communication interface 318 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line.
- ISDN integrated services digital network
- communication interface 318 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
- LAN local area network
- Wireless links may also be implemented.
- communication interface 318 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
- Network link 320 typically provides data communication through one or more networks to other data devices.
- network link 320 may provide a connection through local network 322 to a host computer 324 or to data equipment operated by an Internet Service Provider (ISP) 326 .
- ISP 326 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 328 .
- Internet 328 uses electrical, electromagnetic or optical signals that carry digital data streams.
- the signals through the various networks and the signals on network link 320 and through communication interface 318 which carry the digital data to and from computer system 300 , are example forms of transmission media.
- Computer system 300 can send messages and receive data, including program code, through the network(s), network link 320 and communication interface 318 .
- a server 330 might transmit a requested code for an application program through Internet 328 , ISP 326 , local network 322 and communication interface 318 .
- the received code may be executed by processor 304 as it is received, and/or stored in storage device 310 , or other non-volatile storage for later execution.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Theoretical Computer Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Tourism & Hospitality (AREA)
- Game Theory and Decision Science (AREA)
- Multimedia (AREA)
- Human Resources & Organizations (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Data Mining & Analysis (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Image Analysis (AREA)
Abstract
Techniques are provided for calculating an average time physical objects spend at a particular location, such as a store. A plurality of entrance times is identified, where each entrance time corresponds to when one or more objects entered the particular location. A plurality of exit times is also identified, where each exit time corresponds to when one or more objects exited the particular location. An average entrance time is determined based on the plurality of entrance times. An average exit time is determined based on the plurality of exit times. An average time people spend at the particular location is determined based on a difference between the average exit time and the average entrance time.
Description
- This application claims benefit under 35 U.S.C. § 120 as a Continuation of application Ser. No. 14/292,832 filed May 31, 2014, the entire contents of which is hereby incorporated by reference for all purposes as if fully set forth herein. The applicant(s) hereby rescind any disclaimer of claim scope in the parent application(s) or the prosecution history thereof and advise the USPTO that the claims in this application may be broader than any claim in the parent application(s).
- The present disclosure relates to tracking the movement of physical objects through a confined space, and calculating average staying times for the physical objects.
- In the drawings:
-
FIG. 1 is a flow diagram that depicts a first process for calculating an average shopping time, in an embodiment; -
FIG. 2 is a flow diagram that depicts a second process for calculating an average shopping time, in an embodiment; -
FIG. 3 is a block diagram that illustrates a computer system upon which an embodiment of the invention may be implemented. - In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
- Techniques are described herein for calculating an average time objects spend in a particular location. In one technique, an entrance time is determined for each object (e.g., a person) that enters a location and the entrance time is associated with the object. An exit time is later determined for each object. For each individual, a staying duration is determined that reflects a difference between the exit time for that object and the entrance time for that individual. In the shopping context, the staying duration is referred to as “shopping time.” An average staying duration is determined based on all the objects that have an associated staying duration.
- In another technique, objects are not tracked. Instead, multiple entrance times are determined, one for each object that enters a certain location. Also, multiple exit times are determined, one for each object that exits the location. An average entrance time is determined based on all the entrance times. An average exit time is determined based on all the exit times. An average staying duration is determined by comparing the average exit time with the average entrance time.
- Reference herein to “average staying duration,” “average shopping time,” or “average time” also includes median staying duration, median shopping time, or median time, unless otherwise indicated. Selecting a median shopping time, for example, reduces the effect that outliers (e.g., all day shoppers) would have in a calculated average shopping time.
- While the following description and examples are primarily in the context of shopping at a store, embodiments are not limited to the shopping context. For example, average staying duration may be calculated for people at a certain place in a museum or zoo. As another example, the average staying duration of one or more animals within a certain geographical area may be calculated.
- As used herein, a “store” is any physical location where customers can enter and purchase one or more items, such as food, clothing, electronics, toys, office/school supplies, plants, fuel, etc. A store may include an enclosed building with a roof and walls or may be an open air market that has no walls or no walls or roof. A store may be a retail store or a wholesale store.
- In an embodiment, objects are tracked and their individual staying durations are determined. An object may be tracked in one of multiple ways. For example, one or more video cameras may be directed to one or more entrances of a store and generate video data of people entering the store. Facial recognition software is used to detect and recognize faces of the people. The same or different set of one or more cameras is directed to an exit of the store and generates video data of people exiting the store. The facial recognition software is used to detect and recognize faces of the people exiting the store and match those faces with the faces detected of the people entering the store. If there is a match, then a shopping duration is determined for the person corresponding to the match.
- The facial recognition and matching may be performed “online”; that is, while the video data is being generated or while the store is open. Alternatively, the facial recognition and matching may be performed “offline” or after the store closes.
- As another example of how objects may be tracked is each individual entering/swiping a card (e.g., a credit card or a card issued by the store) into a card reader upon entry and entering/swiping the card into the same or different card reader upon exit. Previously-issued cards could be used in the context of access controlled office spaces.
- As another example, exit times of individuals are tracked through their respective credit card payments rather than calculating when the individuals exit the doors of a store.
- As another example, each individual receives a RFID tag upon entering the store. An RFID tag may be activated upon being issued to an individual. The RFID tag sends a signal to one or more RFID receivers. When no RFID receivers receive the signal from the RFID tag, then it is presumed that the individual has exited the store. Alternatively, the RFID tag may send a signal to an RFID receiver when the RFID tag reaches an exit, indicating that the individual has left the store.
- In an embodiment, when a facial recognition technique is used, employees of a store are pre-registered so that employees' entrances and exits from the store are not considered when determined the average staying duration. Some employees may enter and exit the store frequently throughout the day, which might cause the average shopping time to decrease if those employees were considered. Additionally or alternatively, some employees may stay within the store all day or for a relatively long period of time that is longer than the average shopping time, which might cause the average shopping time to decrease if those employees were considered. Some stores, however, use different doors for employees to enter and exit. In such circumstances, facial recognition may not be needed for those employees. Additionally, when employees are working during their respective working hours, they generally do not leave. Thus, the entrance and exit times will not be significantly affected.
-
FIG. 1 is a flow diagram that depicts aprocess 100 for calculating an average shopping time, in an embodiment. - At
block 110, for each individual that enters a store, an entrance time is determined. - At
block 120, for each individual that exits the store, an exit time is determined. - At
block 130, for each individual that exits the store, the entrance time of that individual is identified. If video surveillance is used to track individuals, then block 130 may comprise determining a match for a face of an individual that exited the store with a face of an individual that entered the store. If no match is determined (e.g., within a certain degree of confidence), then the exit time of the individual that exited the store may be discarded. If a match is found (e.g., within a certain degree of confidence), then the entrance time associated with that individual is retrieved. - In an embodiment, an exit time-entrance time pair is excluded if the match between the “entrance face” and the “exit face” is below a confidence threshold. In other words, if the two faces have a high probability of matching, then the respective times are kept; other times are excluded. The times that are kept may be considered a representative subsample of the actual shopping population. In a related embodiment, the confidence threshold is adjusted based on the number of matches. For example, if the number of matches is low (e.g., less than 100) or the match rate is low (e.g., a 54% match rate), then the confidence threshold may be lowered so that more matches may be identified. Conversely, if the number of matches is high or the match rate is high (e.g., a 99% match rate), then the confidence threshold may be increased in order to get more accurate matches without sacrificing too much on accuracy and margin of error.
- At
block 140, for each individual that exited the store, a shopping time for the individual is determined. The shopping time may be determined by subtracting the exit time from the entrance time. For example, if an individual entered the store at 11:34 AM on a particular day and exited the store at 12:19 PM on the particular day, then the individual's shopping time is 45 minutes. - At
block 150, an average shopping time is calculated based on the shopping times for multiple individuals that entered and exited the store. The average shopping time may be calculated by totaling the shopping times of the multiple individuals and dividing the total by the number of individuals for which a shopping time has been determined. - In an embodiment, the average shopping time excludes shopping times of individuals who did not purchase an item during the day and time that was tracked. Thus, the average shopping time may reflect only shopping times of customers that actually purchased an item from the store while in the store during the tracked duration. In this embodiment, purchasing customers may be identified when such customers, for example, arrive at a checkout counter to purchase one or more items from the store or when such customers leave a self-checkout location designated for customers who do not require assistance from a store employee to purchase the item(s). For example, a camera may be present at a checkout location (if one exists) that captures video or one or more images of the customer that is purchasing (or just purchased) one or more items. As another example, point of sale data may be used to determine shopping times for purchasing customers.
- In a related embodiment, an average shopping time is determined for purchasing customers and an average shopping time is determined for non-purchasing customers. A comparison of the two average shopping times may reveal, for example, that customers who make a purchase during the tracked duration tend to spend a significantly less time in the store than customers who did not make a purchase during the tracked duration.
- The following is an equation that may be used to calculate the average shopping time of people who spend time in a store:
-
- where ti* is an exit time of customer i, ti is an entrance time of customer i, and N is the number of customers who enter the store.
- In an embodiment, instead of tracking individual shopping times, entrance times and exit times are tracked regardless of the individual who enters and exits. Because the average shopping time over all customers is sought, the exit times and entrance times do not need to be paired. The following set of equations illustrate that the above equation is equivalent to determining the difference between the average entrance time and the average exit time for a day measurement:
-
- where the last two terms are the average exit time and the average entrance time. Thus, the average shopping time may be found by finding the difference between the average exit time and the average entrance time.
-
FIG. 2 is a flow diagram that depicts aprocess 200 for calculating an average duration time, in an embodiment. - At
block 210, a number of entrance times is determined. As noted previously, an entrance time may be determined automatically by one or more video cameras that are directed to one or more entrances and generating video, which is analyzed by a video analyzer to detect instances of when objects enter a certain geographical area, such as individuals entering a store. Alternatively, an entrance time may be determined when an object crosses a “virtual fence”. The virtual fence may include one or more lasers that, when interfered by an object crossing the “fence”, send a signal that indicates an entrance of an object. A timestamp is determined for each signal that the virtual fence system generates. Alternatively, an entrance time may be determined when an individual removes a card from a card dispenser (similar to when a car driver takes a card from a card machine at a parking garage) or when an individual swipes a card (in the individual's possession before approaching the store) over a card reader. - At
block 220, a number of exit times is determined. The exit times may be determined in the same (or similar) way the entrance times are determined. For example, if a card was issued to an individual upon entrance into the store, then the individual may swipe the card at a card reader upon exit or a transmitter in the card may send a signal to a receiver when the individual exits with the card. As another example, video data may be automatically analyzed to determine that an object (e.g., regardless of identity) exits the specified geographical location (e.g., store). - In an embodiment, a comparison is made between the number of exit times and the number of entrance times. If there is a difference, then one or more of the times may be excluded. For example, if there are three more entrance times than exit times, then three entrance times are excluded. The three entrance times may be selected randomly or may be selected based on when the entrance times are, such as the last three entrance times of the day.
- In an alternative embodiment, exit times or entrance times are not excluded, even if there is a difference in their respective numbers. The average entrance time and/or average exit time is still valid if reasonable assumptions are made about the error distribution.
- At
block 230, an average entrance time is determined. The average entrance time may be determined by adding the entrance times (determined in block 210) to generate a total entrance time and then dividing the total entrance time by the number of entrance times. WhileFIG. 2 depicts block 230 as occurring subsequent to block 220, block 230 may be determined prior to block 220 or whileblock 220 is being performed. For example, the average entrance time may be continually updated as objects (e.g. people) enter the geographical area (e.g., store). - At
block 240, an average exit time is determined. The average exit time may be determined by adding the exit times (determined in block 220) to generate a total exit time and then dividing the total exit time by the number of exit times.Block 240 may be determined continually as individuals are exiting the store. Alternatively, block 240 (and/or block 230) may be performed after the store has closed on that particular day. - At
block 250, an average shopping time is determined based on the average exit time and the average entrance time. For example, the average entrance time may be subtracted from the average exit time. If the average entrance time is 12:14 and the average exit time is 12:54, then the average shopping time (or duration) is 40 minutes. - In an embodiment, instead of tracking exits, payments (such as credit card or debit card payments) at checkout are used to represent when people are finished shopping. In this way, physical exits from a store do not need to be tracked.
- As noted previously, some stores use different doors for employees to enter and exit. In such circumstances, employee entrances and exits are not considered a problem that needs to be addressed. Additionally, when employees are working during their respective working hours, they generally do not leave. Thus, the average entrance and exit times will not be significantly affected.
- In an embodiment, the party or entity that determines the timestamps is different than the party or entity that determines an average shopping time based on the timestamps. For example, a computing device owned or managed by a store may report timestamp data (reflecting multiple timestamps) to a third party that is tasked with calculating the average shopping time and, optionally, using the average shopping time to perform one or more other calculations. The store's computing device may report the timestamp data in one of many different types of formats.
- In one example format, the timestamp data may be a list of entrance times and a list exit times, where each entrance time is associated with a unique entrance and each exit time is associated with a unique exit.
- In another example format, the timestamp data may be a list of entrance times and a list of exit times where each entrance time is associated with a count that indicates a number of individuals that entered at or around the entrance time and where each exit time is associated with a count that indicates a number of individuals that exited at or around the exit time. For example, the list of entrance times may include 10:05, 10:10, and 10:20. Time 10:05 may be associated with a count of four, time 10:10 may be associated with a count of one, and time 10:20 may be associated with a count of seven. These counts indicate that four people entered the store between 10:00 and 10:05, that one person entered the store between 10:05 and 10:10, that no one entered the store between 10:10 and 10:15, and that seven people entered the store between 10:15 and 10:20.
- In another example, the data may be in the form of time stamps associated with an estimate of the number of people entering or exiting the store. For example, if two people enter at 10:13:45, then the data shows the time stamp and the number of people entering the store as ‘2’.
- If timestamp data includes counts, then, when calculating an average shopping time using the timestamp data, the different entrance times and exit times may be weighted based on their respective counts. Thus, an entrance time that is associated with a count of ten may be weighted twice as much as an entrance time that is associated with a count of five.
- In the above example, the granularity of the times is every five minutes. The granularity of the timestamp data may vary from implementation to implementation. Each timestamp may be at the granularity of milliseconds, seconds, minutes, five minutes (as the above example), or some other time range.
- In an embodiment, timestamps of one or more individuals may be excluded when calculating the average shopping time at a store. An example of such an individual is anyone shorter than a certain height, such as under 50 inches. Such individuals may be presumed to be children that are not at the store to shop for themselves or others. Small children may be detected in ways other than determining their height, such as detecting that an individual is sitting in a stroller or shopping cart. Anyone sitting in a stroller or shopping cart is presumed to be a child.
- Detecting that an individual's timestamps should be excluded may be performed manually or automatically by, for example, analyzing video. For example, a software video application analyzes video data that is captured of a store's entrance may determine that an individual is sitting in a stroller or than an individual is shorter than 50 inches. Accordingly, a timestamp is not generated for that individual.
- In an embodiment, for stores with multiple entrances, where customers may only be passing through the store, such as an anchor store at a mall, entry/exit counts for customers who simply walk straight through the store without intending to shop are excluded.
- As noted previously, average shopping time (AST) may be calculated for time periods that are less than the period of time that a store is open. For example, an AST may be determined for each two hours (e.g., 8 AM-10 AM, 10 AM-12 PM, 12 PM-2 PM, 2 PM-4 PM, and 4 PM-6 PM). In this way, more granule ASTs are determined for a particular store and can be used to determine how long people are shopping during those time intervals. The resulting ASTs for a single day (or compared across multiple days) may reveal that people are shopping longer in the morning hours than in the afternoon hours
- In some cases, when determining an average shopping time (AST), those who enter a store are not the same as those who exit the store. For example, an AST may be determined for 10 AM-1 PM on a particular day when a store is open from 8 AM to 10 PM. Thus, some people may have entered the store before 10 AM and exited the store between 10 AM and 1 PM. Similarly, other people may have entered the store between 10 AM and 1 PM and exited the store after 1 PM. For example, if a large number of people enter at 12:55 PM and do not leave until after 1 PM, then the average exit time may be skewed toward the 1 PM time and the average staying duration for 10 AM and 1 PM may be longer than in actuality.
- To adjust for this skewing, one or more approaches may be implemented. One approach involves removing (or not considering) certain exit times and/or entrance times. For example, any entrances between 12:45 PM and 1 PM are not included when determining the average entrance time. As another example, any exits between 10 AM and 10:25 AM are not included when determining the average exit time.
- Another approach involves determining a difference in the number of entrances and the number of exits. If the number of entrances is greater than the number of exits, then one or more entrance times may be excluded from determining the average entrance time. The number of entrance times to exclude may be equal to the difference between the number of entrances and the number of exits. The specific entrance times to exclude may be entrances that occurred closest to the end of the tracked duration (e.g., 1 PM in the above example).
- In an embodiment, average shopping times (ASTs) are determined for multiple days. The different ASTs may then be compared to each other. For example, an AST for one Monday is compared with an AST for another Monday. One reason such a comparison may be performed is because the store may have changed the layout between the two Mondays and a manager/owner of the store desires to see if the average shopping duration has increased or decreased as a result of the layout.
- In an embodiment, ASTs for multiple time durations (e.g., hours or days) may be aggregated. For example, an AST may be determined for each day of March in a particular year. Then an AST for March may be determined by adding the AST for each day of March and dividing the total by the number of shopping days in March. Additionally or alternatively, a median shopping time (MST) may be determined for March. As another example, an AST (or MST) may be determined for each Thursday of a summer month in a particular year. A single AST for summer Thursdays may then be determined, along with a standard deviation.
- In an embodiment, average shopping times (ASTs) are determined for different locations. For example, one AST for one store location (e.g., in one California city) is determined and another AST for another store location (e.g., in a neighboring California city) is determined. The two ASTs may be for the same day or for different days. The two ASTs may be compared to reveal that the AST for one store location is significantly different than the AST for the other store location.
- As another example, an AST (or MST) may be determined for a month (e.g., based on individual day ASTs) for one store that sells high end clothing and another AST may be determined for another store that sells low end clothing and that has the same or similar layout as the first store. The two stores may be relatively close to each other (e.g., in the same or neighboring city) or may be relatively far from each other (e.g., in different counties, states, or countries). The two ASTs may be compared to determine which store has a higher AST.
- The techniques described herein may be used to track average shopping time spent in a specific area within a store. For example, a store owner may desire to know how long people are looking at or are near the shoe display, at least on average. The store owner may regard a relatively high average (or median) time spent near the shoe display as a success of the shoe display in attracting attention.
- As another example, a specific area within a store may be a cosmetics section, within a store, that has a history of customers complaining about the long wait times. A store owner may add employees and/or change the layout of the cosmetics section to assist in reducing shopping times of future customers. An average shopping time (AST) may be calculated for the cosmetics section to determine whether the AST for the cosmetics section has decreased as a result of the added employees and/or the changed layout.
- As noted previously, many techniques may be used to determine the entrances to and the exits from a specific area within a store. For example, one or more cameras may be pointed at the specific area such that whenever an individual comes into view of the camera(s), then an entrance timestamp for that individual is determined and stored. Similarly, if an individual leaves the view of the camera(s), then an exit timestamp is determined and stored.
- As noted previously, while the examples above are in the context of shopping, embodiments are not limited to the shopping context. Techniques described herein may be applied to any person, animal, or inanimate object that is located within a geographical area for a particular amount of time. For example, an average “looking” time may be calculated for a particular painting at a museum where, for example, administrators of the museum desire to know (a) the average time people spend in an art exhibit consisting of work of a particular artist or (b) the average time people spend within a small geographical area around a particular work of art. It is presumed that if a person is within the small geographical area, then the person is there to admire or at least look at the work of art.
- As another example, a zoo may want to determine how long a certain bird species spends in a particular area of a cage. Knowing the average staying duration of each bird in that area may provide a clue as to the daily habits of the bird species.
- According to one embodiment, the techniques described herein are implemented by one or more special-purpose computing devices. The special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination. Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques. The special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
- For example,
FIG. 3 is a block diagram that illustrates acomputer system 300 upon which an embodiment of the invention may be implemented.Computer system 300 includes abus 302 or other communication mechanism for communicating information, and ahardware processor 304 coupled withbus 302 for processing information.Hardware processor 304 may be, for example, a general purpose microprocessor. -
Computer system 300 also includes amain memory 306, such as a random access memory (RAM) or other dynamic storage device, coupled tobus 302 for storing information and instructions to be executed byprocessor 304.Main memory 306 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed byprocessor 304. Such instructions, when stored in non-transitory storage media accessible toprocessor 304, rendercomputer system 300 into a special-purpose machine that is customized to perform the operations specified in the instructions. -
Computer system 300 further includes a read only memory (ROM) 308 or other static storage device coupled tobus 302 for storing static information and instructions forprocessor 304. Astorage device 310, such as a magnetic disk or optical disk, is provided and coupled tobus 302 for storing information and instructions. -
Computer system 300 may be coupled viabus 302 to adisplay 312, such as a cathode ray tube (CRT), for displaying information to a computer user. Aninput device 314, including alphanumeric and other keys, is coupled tobus 302 for communicating information and command selections toprocessor 304. Another type of user input device iscursor control 316, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections toprocessor 304 and for controlling cursor movement ondisplay 312. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane. -
Computer system 300 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes orprograms computer system 300 to be a special-purpose machine. According to one embodiment, the techniques herein are performed bycomputer system 300 in response toprocessor 304 executing one or more sequences of one or more instructions contained inmain memory 306. Such instructions may be read intomain memory 306 from another storage medium, such asstorage device 310. Execution of the sequences of instructions contained inmain memory 306 causesprocessor 304 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions. - The term “storage media” as used herein refers to any non-transitory media that store data and/or instructions that cause a machine to operation in a specific fashion. Such storage media may comprise non-volatile media and/or volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as
storage device 310. Volatile media includes dynamic memory, such asmain memory 306. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge. - Storage media is distinct from but may be used in conjunction with transmission media. Transmission media participates in transferring information between storage media. For example, transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise
bus 302. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. - Various forms of media may be involved in carrying one or more sequences of one or more instructions to
processor 304 for execution. For example, the instructions may initially be carried on a magnetic disk or solid state drive of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local tocomputer system 300 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data onbus 302.Bus 302 carries the data tomain memory 306, from whichprocessor 304 retrieves and executes the instructions. The instructions received bymain memory 306 may optionally be stored onstorage device 310 either before or after execution byprocessor 304. -
Computer system 300 also includes acommunication interface 318 coupled tobus 302.Communication interface 318 provides a two-way data communication coupling to anetwork link 320 that is connected to alocal network 322. For example,communication interface 318 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line. As another example,communication interface 318 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation,communication interface 318 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information. - Network link 320 typically provides data communication through one or more networks to other data devices. For example,
network link 320 may provide a connection throughlocal network 322 to ahost computer 324 or to data equipment operated by an Internet Service Provider (ISP) 326.ISP 326 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 328.Local network 322 andInternet 328 both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals onnetwork link 320 and throughcommunication interface 318, which carry the digital data to and fromcomputer system 300, are example forms of transmission media. -
Computer system 300 can send messages and receive data, including program code, through the network(s),network link 320 andcommunication interface 318. In the Internet example, aserver 330 might transmit a requested code for an application program throughInternet 328,ISP 326,local network 322 andcommunication interface 318. - The received code may be executed by
processor 304 as it is received, and/or stored instorage device 310, or other non-volatile storage for later execution. - In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. The sole and exclusive indicator of the scope of the invention, and what is intended by the applicants to be the scope of the invention, is the literal and equivalent scope of the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction.
Claims (20)
1. A method for tracking average time physical objects spend at a particular location without tracking staying duration for individual objects, the method comprising:
obtaining tracking data from one or more devices associated with a particular location;
identifying a plurality of entrance times and a plurality of exit times based on the tracking data, wherein:
each entrance time of the plurality of entrance times corresponds to when a first plurality of objects entered the particular location, and
each exit time of the plurality of exit times corresponds to when a second plurality of objects exited the particular location;
determining an average entrance time based on the plurality of entrance times;
determining an average exit time based on the plurality of exit times;
determining the average time objects spend at the particular location based on a difference between the average exit time and the average entrance time;
wherein the method is performed by one or more computing devices.
2. The method of claim 1 , wherein the plurality of entrance times includes an entrance time for a particular object, and wherein the plurality of exit times does not include an exit time for the particular object.
3. The method of claim 1 , wherein the plurality of entrance times does not include an entrance time for a particular object, and wherein the plurality of exit times includes an exit time for the particular object.
4. The method of claim 1 , wherein the one or more devices are card readers at the particular location.
5. The method of claim 1 , wherein the one or more devices are RFID receivers at the particular location.
6. The method of claim 1 , wherein the one or more devices are electronic dispensers at the particular location.
7. The method of claim 1 wherein the one or more devices form a virtual fence around the particular location.
8. The method of claim 1 wherein the obtaining and identifying are performed by one or more first computing devices associated with a first entity, and the determining is performed by one or more second computing devices associated with a second entity different from the first entity.
9. The method of claim 1 wherein the tracking data is for a particular time range of a particular day.
10. The method of claim 9 further comprising:
comparing a number of entrance times for the particular location during the particular time range and a number of exit times for the particular location during the particular time range;
in response to determining that the number of entrance times is greater than the number of exit times:
removing one or more entrance times from the plurality of entrance times;
wherein determining the average entrance time is not based on the one or more entrance times;
in response to determining that the number of exit times is greater than the number of entrance times:
removing one or more exit times from the plurality of exit times;
wherein determining the average exit time is not based on the one or more exit times.
11. One or more non-transitory computer-readable media storing instructions for determining an average time objects spend at a particular location without tracking staying duration for individual objects, wherein the instructions, when executed by one or more processors, cause:
obtaining tracking data from one or more devices associated with a particular location;
identifying a plurality of entrance times and a plurality of exit times based on the tracking data, wherein:
each entrance time of the plurality of entrance times corresponds to when a first plurality of objects entered the particular location, and
each exit time of the plurality of exit times corresponds to when a second plurality of objects exited the particular location;
determining an average entrance time based on the plurality of entrance times;
determining an average exit time based on the plurality of exit times;
determining the average time objects spend at the particular location based on a difference between the average exit time and the average entrance time.
12. The one or more non-transitory computer-readable media of claim 11 , wherein the plurality of entrance times includes an entrance time for a particular object, and wherein the plurality of exit times does not include an exit time for the particular object.
13. The one or more non-transitory computer-readable media of claim 11 , wherein the plurality of entrance times does not include an entrance time for a particular object, and wherein the plurality of exit times includes an exit time for the particular object.
14. The one or more non-transitory computer-readable media of claim 11 , wherein the one or more devices are card readers at the particular location.
15. The one or more non-transitory computer-readable media of claim 11 , wherein the one or more devices are RFID receivers at the particular location.
16. The one or more non-transitory computer-readable media of claim 11 , wherein the one or more devices are electronic dispensers at the particular location.
17. The one or more non-transitory computer-readable media of claim 11 wherein the one or more devices form a virtual fence around the particular location.
18. The one or more non-transitory computer-readable media of claim 11 wherein the obtaining and identifying are performed by one or more first computing devices associated with a first entity, and the determining is performed by one or more second computing devices associated with a second entity different from the first entity.
19. The one or more non-transitory computer-readable media of claim 11 wherein the tracking data is for a particular time range of a particular day.
20. The one or more non-transitory computer-readable media of claim 19 , wherein the instructions, when executed by the one or more processors, further cause:
comparing a number of entrance times for the particular location during the particular time range and a number of exit times for the particular location during the particular time range;
in response to determining that the number of entrance times is greater than the number of exit times:
removing one or more entrance times from the plurality of entrance times;
wherein determining the average entrance time is not based on the one or more entrance times;
in response to determining that the number of exit times is greater than the number of entrance times:
removing one or more exit times from the plurality of exit times;
wherein determining the average exit time is not based on the one or more exit times.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/216,436 US20190107394A1 (en) | 2014-05-31 | 2018-12-11 | Tracking movement of physical objects through a confined space |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/292,832 US10180321B2 (en) | 2014-05-31 | 2014-05-31 | Calculating duration time in a confined space |
US16/216,436 US20190107394A1 (en) | 2014-05-31 | 2018-12-11 | Tracking movement of physical objects through a confined space |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/292,832 Continuation US10180321B2 (en) | 2014-05-31 | 2014-05-31 | Calculating duration time in a confined space |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190107394A1 true US20190107394A1 (en) | 2019-04-11 |
Family
ID=54701356
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/292,832 Expired - Fee Related US10180321B2 (en) | 2014-05-31 | 2014-05-31 | Calculating duration time in a confined space |
US16/216,436 Abandoned US20190107394A1 (en) | 2014-05-31 | 2018-12-11 | Tracking movement of physical objects through a confined space |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/292,832 Expired - Fee Related US10180321B2 (en) | 2014-05-31 | 2014-05-31 | Calculating duration time in a confined space |
Country Status (1)
Country | Link |
---|---|
US (2) | US10180321B2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220292287A1 (en) * | 2021-03-15 | 2022-09-15 | Sensormatic Electronics, LLC | Object counting system for high volume traffic |
US11676383B2 (en) | 2021-03-15 | 2023-06-13 | Sensormatic Electronics, LLC | Object counting system for high volume traffic |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016117600A1 (en) * | 2015-01-22 | 2016-07-28 | 日本電気株式会社 | Product shelf allocation management device and product shelf allocation management method |
US9992977B2 (en) * | 2015-06-03 | 2018-06-12 | Keltronix, Inc. | Agricultural monitoring system using image analysis |
KR102691020B1 (en) * | 2016-08-19 | 2024-08-01 | 삼성전자주식회사 | Electronic device and method for providing information of work and life |
CN107871111B (en) * | 2016-09-28 | 2021-11-26 | 苏宁易购集团股份有限公司 | Behavior analysis method and system |
WO2019025938A1 (en) | 2017-08-04 | 2019-02-07 | 3M Innovative Properties Company | Confined space configuration and operations management system |
US10867161B2 (en) * | 2017-09-06 | 2020-12-15 | Pixart Imaging Inc. | Auxiliary filtering device for face recognition and starting method for electronic device |
US10565439B2 (en) | 2017-10-10 | 2020-02-18 | Caterpillar Inc. | Method and system for tracking workers at worksites |
US11328513B1 (en) * | 2017-11-07 | 2022-05-10 | Amazon Technologies, Inc. | Agent re-verification and resolution using imaging |
US11367041B2 (en) * | 2018-06-25 | 2022-06-21 | Robert Bosch Gmbh | Occupancy sensing system for custodial services management |
CN112930292A (en) | 2018-09-07 | 2021-06-08 | 看门人系统公司 | Shopping basket monitoring using computer vision and machine learning |
US11203370B2 (en) * | 2020-03-11 | 2021-12-21 | Gatekeeper Systems, Inc. | Shopping cart monitoring using computer vision |
US20230154224A1 (en) * | 2021-11-12 | 2023-05-18 | Microsoft Technology Licensing, Llc | Machine-vision person tracking in service environment |
WO2024076997A1 (en) * | 2022-10-03 | 2024-04-11 | Sensormatic Electronics, LLC | Computer vision systems and methods for detecting person dwell time |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8429088B2 (en) * | 2003-01-13 | 2013-04-23 | Scott P. Kaplan | On-location electronics troubleshooting services system |
US9165304B2 (en) * | 2009-10-23 | 2015-10-20 | Service Management Group, Inc. | Analyzing consumer behavior using electronically-captured consumer location data |
US20140122483A1 (en) * | 2012-10-26 | 2014-05-01 | Palo Alto Research Center Incorporated | System and method for determining a duration for user activities based on social-network events |
-
2014
- 2014-05-31 US US14/292,832 patent/US10180321B2/en not_active Expired - Fee Related
-
2018
- 2018-12-11 US US16/216,436 patent/US20190107394A1/en not_active Abandoned
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220292287A1 (en) * | 2021-03-15 | 2022-09-15 | Sensormatic Electronics, LLC | Object counting system for high volume traffic |
US11676384B2 (en) * | 2021-03-15 | 2023-06-13 | Sensormatic Electronics, LLC | Object counting system for high volume traffic |
US11676383B2 (en) | 2021-03-15 | 2023-06-13 | Sensormatic Electronics, LLC | Object counting system for high volume traffic |
Also Published As
Publication number | Publication date |
---|---|
US10180321B2 (en) | 2019-01-15 |
US20150345942A1 (en) | 2015-12-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190107394A1 (en) | Tracking movement of physical objects through a confined space | |
US20190235555A1 (en) | System and method for managing energy | |
US9949085B2 (en) | System for collection, analytics, and display of indoor positioning data | |
US10410048B2 (en) | System and method for detecting, tracking and counting human objects of interest using a counting system and a data capture device | |
US10229322B2 (en) | Apparatus, methods and computer products for video analytics | |
US10641604B1 (en) | Method of tracking moveable objects by combining data obtained from multiple sensor types | |
US9760852B2 (en) | Surveillance tracking system and related methods | |
US20160078264A1 (en) | Real time electronic article surveillance and management | |
US20150006243A1 (en) | Digital information gathering and analyzing method and apparatus | |
US20030048926A1 (en) | Surveillance system, surveillance method and surveillance program | |
US20170053326A1 (en) | System for reducing waiting time | |
US9576371B2 (en) | Busyness defection and notification method and system | |
EP2008458A2 (en) | Still image queue analysis system and method | |
US20160063610A1 (en) | Real-Time Congestion Avoidance In A Retail Environment | |
US20150058049A1 (en) | Systems and methods for identifying and analyzing a customer queue | |
US10762525B2 (en) | Method and system for presenting a promotional offer based on detected data | |
CN109508586B (en) | Passenger flow statistical method, device and equipment | |
GB2495193A (en) | Method and system for counting and tracking defined and anonymous objects | |
EP3530009B1 (en) | Computing analytics based on indoor location data streams | |
US9412098B1 (en) | Systems and methods for daily task optimization | |
Karunarathne et al. | Understanding a public environment via continuous robot observations | |
TWI613601B (en) | System and method for intelligent image recognition dynamic programming | |
CN115641548A (en) | Abnormality detection method, apparatus, device and storage medium | |
US11676225B1 (en) | System and method of automated real estate management | |
US10872235B2 (en) | Tracking shoppers and employees |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: IDENTIV, INC., CALIFORNIA Free format text: MERGER;ASSIGNOR:3VR SECURITY, INC.;REEL/FRAME:068470/0924 Effective date: 20181129 |