CN111369583B - Tracking loss compensation method, system and computer equipment - Google Patents

Tracking loss compensation method, system and computer equipment Download PDF

Info

Publication number
CN111369583B
CN111369583B CN202010145976.3A CN202010145976A CN111369583B CN 111369583 B CN111369583 B CN 111369583B CN 202010145976 A CN202010145976 A CN 202010145976A CN 111369583 B CN111369583 B CN 111369583B
Authority
CN
China
Prior art keywords
label
tracked object
attribute
tag
space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010145976.3A
Other languages
Chinese (zh)
Other versions
CN111369583A (en
Inventor
李涛
刘澍
冀怀远
蒋涛
王东峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suning Cloud Computing Co Ltd
Original Assignee
Suning Cloud Computing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suning Cloud Computing Co Ltd filed Critical Suning Cloud Computing Co Ltd
Priority to CN202010145976.3A priority Critical patent/CN111369583B/en
Publication of CN111369583A publication Critical patent/CN111369583A/en
Application granted granted Critical
Publication of CN111369583B publication Critical patent/CN111369583B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30232—Surveillance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a tracking loss compensation method, a system and computer equipment, wherein the method comprises the following steps: before a tracked object enters a space to be detected, setting a first label for the tracked object according to a first attribute of the tracked object, and storing the first label in a first label library; setting second tags for tracked objects in a space to be detected in real time, wherein each tracked object only corresponds to one second tag at the same time; when the tracked object leaves the space to be detected, checking the first label of the tracked object according to the first attribute of the tracked object and compensating the missing first label; and associating all second tags corresponding to the tracked object according to the first tag. The method can compensate the tracked object after being lost, ensures the tracking accuracy, and has wide application fields relating to the fields of storage, unmanned stores and the like.

Description

Tracking loss compensation method, system and computer equipment
Technical Field
The invention belongs to the technical field of object tracking, and particularly relates to a tracking loss compensation method, a system and computer equipment.
Background
Tracking of moving objects or human bodies is required in logistics storage, "unmanned stores". The judgment and behavior analysis of the moving track of the mobile terminal is realized through tracking.
The 'unmanned shop' without cashiers integrates multiple technologies such as artificial intelligence, big data, cloud computing and the like, intelligent automatic processing is carried out through technical means, manual intervention does not exist in the whole process, millisecond-level checkout can be achieved, namely the customer can take the customer away, and the payment time of the customer is greatly shortened. The 'unmanned shop' relates to the combined use of a plurality of new technologies in the operation process, including a gravity recognition commodity technology, a human face image recognition technology, a human body tracking technology in a visual three-dimensional space and the like.
The problem that human body tracking is lost exists in the process of tracking the human body in the three-dimensional space by means of vision, the accuracy of the whole free shopping process is directly influenced, and therefore the goods loss of an unmanned store is increased. In the field of unmanned warehousing, the robot also needs to be tracked and positioned, and in the tracking and positioning process, the problem that the robot is lost in tracking is solved. Therefore, when the prior art tracks a moving object, the situation of tracking loss is often encountered.
Disclosure of Invention
The invention aims to provide a tracking loss compensation method, a tracking loss compensation system and computer equipment.
The technical solution for realizing the purpose of the invention is as follows: a tracking loss compensation method, comprising the steps of:
before a tracked object enters a space to be detected, setting a first label for the tracked object according to a first attribute of the tracked object, and storing the first label in a first label library;
setting second tags for tracked objects in a space to be detected in real time, wherein each tracked object only corresponds to one second tag at the same time;
when the tracked object leaves the space to be detected, checking a first label of the tracked object according to the first attribute of the tracked object and compensating the missing first label;
and associating all second tags corresponding to the tracked object according to the first tag.
A tracking loss compensation system, comprising:
the first label setting module is used for setting a first label for the tracked object according to the first attribute of the tracked object before the tracked object enters the space to be detected and storing the first label in a first label library;
the second label setting module is used for setting a second label for the tracked object in the space to be detected in real time, and each tracked object corresponds to only one second label at the same time;
the first label verification compensation module is used for verifying the first label of the tracked object and compensating the missing first label according to the first attribute of the tracked object when the tracked object leaves the space to be detected;
and the tag association module is used for associating all the second tags corresponding to the tracked object according to the first tag.
Compared with the prior art, the invention has the following remarkable advantages: 1) The method can compensate the tracked object after being lost, ensures the tracking accuracy, and has wide application field, relating to the fields of storage, unmanned stores and the like; 2) The method adopts two sets of labels to identify the tracked object, and binds the tracked object according to the corresponding relation of the labels, thereby ensuring the whole tracking process to be controllable; 3) According to the embodiment of the invention, the problem that the ID is lost in the tracking process in the visual three-dimensional space is compensated through the face recognition and visual ID management method, the main-free visual ID generated again in a shop can be bound to a customer again, the commodity is prevented from being omitted in order settlement, and the goods loss is reduced; 4) According to the embodiment of the invention, the whole shopping experience is improved by compensating the human body tracking in the visual three-dimensional space, the missing of commodities in order settlement is prevented, the rate of losing orders is reduced, and the goods loss of an unmanned shop is reduced.
The present invention is described in further detail below with reference to the attached drawing figures.
Drawings
Fig. 1 is a flowchart of a tracking loss compensation method of the present invention.
Fig. 2 is a schematic diagram of the tracking loss compensation system of the present invention.
Fig. 3 is a tracking compensation flow chart according to an embodiment of the present invention.
Detailed Description
Referring to fig. 1, a tracking loss compensation method of the present invention includes the following steps:
before a tracked object enters a space to be detected, setting a first label for the tracked object according to a first attribute of the tracked object, and storing the first label in a first label library; the first attribute comprises a human face feature attribute, a respiration heartbeat attribute and/or an iris attribute; the first label corresponding to the first attribute comprises a face ID, a breath heartbeat ID and/or an iris ID. The first attribute may also be other attributes related to the human body, and the corresponding first tag may also be other IDs related to the human body.
Setting second tags for tracked objects in a space to be detected in real time, wherein each tracked object only corresponds to one second tag at the same time; an initial second tag of a tracked object is automatically associated with the first tag of the tracked object. The second label is a visual three-dimensional space human body ID.
When the tracked object leaves the space to be detected, checking a first label of the tracked object according to the first attribute of the tracked object and compensating the missing first label; the method specifically comprises the following steps: and calling a first label of the tracked object from a first label library according to the first attribute of the tracked object, and compensating the lost first label by using the called first label.
And associating all second tags corresponding to the tracked object according to the first tag. Thereby realizing the tracking compensation of the tracked object.
With reference to fig. 2, a tracking loss compensation system, comprising:
the first label setting module is used for setting a first label for the tracked object according to the first attribute of the tracked object before the tracked object enters the space to be detected and storing the first label in the first label library;
the second label setting module is used for setting a second label for the tracked object in the space to be detected in real time, and each tracked object corresponds to only one second label at the same time; the tracked object initial second label set by the second label setting module is automatically associated with the first label of the tracked object.
The first label checking and compensating module is used for checking the first label of the tracked object and compensating the missing first label according to the first attribute of the tracked object when the tracked object leaves the space to be detected; the method specifically comprises the following steps: and calling a first label of the tracked object from a first label library according to the first attribute of the tracked object, and compensating the lost first label by using the called first label.
And the tag association module is used for associating all the second tags corresponding to the tracked object according to the first tag.
A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor when executing the computer program performing the steps of:
before a tracked object enters a space to be detected, setting a first label for the tracked object according to a first attribute of the tracked object, and storing the first label in a first label library; the first attribute comprises a human face feature attribute, a breathing heartbeat attribute and/or an iris attribute; the first label corresponding to the first attribute comprises a face ID, a breathing heartbeat ID and/or an iris ID. The first attribute may also be other attributes related to the human body, and the corresponding first tag may also be other IDs related to the human body.
Setting second tags for tracked objects in a space to be detected in real time, wherein each tracked object only corresponds to one second tag at the same time; an initial second tag of a tracked object is automatically associated with the first tag of the tracked object. The second label is a visual three-dimensional space human body ID.
When the tracked object leaves the space to be detected, checking the first label of the tracked object according to the first attribute of the tracked object and compensating the missing first label; the method comprises the following specific steps: and calling a first label of the tracked object from a first label library according to the first attribute of the tracked object, and compensating the lost first label by using the called first label.
And associating all second tags corresponding to the tracked object according to the first tag.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, performs the steps of:
before a tracked object enters a space to be detected, setting a first label for the tracked object according to a first attribute of the tracked object, and storing the first label in a first label library; the first attribute comprises a human face feature attribute, a breathing heartbeat attribute and/or an iris attribute; the first label corresponding to the first attribute comprises a face ID, a breathing heartbeat ID and/or an iris ID. The first attribute may also be other attributes related to the human body, and the corresponding first tag may also be other IDs related to the human body.
Setting second tags for tracked objects in a space to be detected in real time, wherein each tracked object only corresponds to one second tag at the same time; an initial second tag of a tracked object is automatically associated with the first tag of the tracked object. The second label is a visual three-dimensional space human body ID.
When the tracked object leaves the space to be detected, checking a first label of the tracked object according to the first attribute of the tracked object and compensating the missing first label; the method comprises the following specific steps: and calling a first label from a first label library according to the first attribute of the tracked object, and compensating the lost first label by using the called first label.
And associating all second tags corresponding to the tracked object according to the first tag.
The method can compensate the tracked object after being lost, ensures the tracking accuracy, and has wide application field, relating to the fields of storage, unmanned stores and the like.
The present invention will be described in further detail with reference to examples.
Examples
The present embodiment takes an unmanned store as a scene. The problem of tracking loss exists in the process of tracking the human body in the three-dimensional space by means of vision, the accuracy of the whole free shopping process is directly influenced, and therefore the goods loss of the unmanned store is increased. The embodiment is a compensation method for solving the problem, and realizes certain compensation for the tracking loss condition in the human body tracking process in the three-dimensional space.
With reference to fig. 3, a face acquisition device is added to the store entrance and exit gate, and the specific application steps are as follows:
the method comprises the following steps: when a customer A enters a store, face information is collected on a face collecting device on a store entrance gate;
step two: registering the collected face information into a face library of the shop to generate a face ID; in an unmanned store, a person visually performs human body tracking in a three-dimensional space, and assigns a human body ID1 to a customer a in the store in real time, wherein the human body ID1 of the customer a and a human face ID are associated with each other. If the loss occurs in the process of tracking the human body in the three-dimensional space, the human body ID2 is automatically allocated to the customer A, and the related shopping activity is recorded, wherein the human body ID2 cannot be automatically associated with the face ID and is a no-main ID.
Step three: acquiring face information by face acquisition equipment on a store exit gate;
step four: when the customer A goes out of the store, the face information collected by the store-out gate is compared in a face library, and a face ID is identified;
step five: checking the face ID in the store-out personnel information by the identified face ID;
step six: if the face ID exists in the information of the personnel out of the store, the phenomenon of tracking loss does not occur, and subsequent settlement is directly carried out; and if the person information out of the store lacks the face ID, which indicates that tracking loss occurs in the store, the identified face ID is used for compensation, the face ID is associated with the human body ID2, which indicates that the human body ID1 and the human body ID2 are the same person, and then settlement is performed.
The embodiment is a compensation mechanism for the problem that the human body tracking process in the visual three-dimensional space loses the ID through the face image recognition technology. By the method, the non-main visual ID generated again in the store can be analyzed, and the non-main visual ID can be bound to a customer again when the local mechanism condition is met, so that the commodity omission in order settlement is prevented, and the goods loss is reduced.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct Rambus Dynamic RAM (DRDRAM), and Rambus Dynamic RAM (RDRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, and these are all within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.

Claims (8)

1. A tracking loss compensation method, comprising the steps of: before a tracked object enters a space to be detected, setting a first label for the tracked object according to a first attribute of the tracked object, and storing the first label in a first label library; the first attribute comprises a human face feature attribute, a breathing heartbeat attribute and/or an iris attribute; the first label corresponding to the first attribute comprises a face ID, a breath heartbeat ID and/or an iris ID; setting second tags for tracked objects in a space to be detected in real time, wherein each tracked object only corresponds to one second tag at the same time; when the tracked object leaves the space to be detected, checking a first label of the tracked object according to the first attribute of the tracked object and compensating the missing first label; the method specifically comprises the following steps: according to the first attribute of the tracked object, calling a first label from a first label library, and compensating the lost first label by using the called first label; and associating all second tags corresponding to the tracked object according to the first tag.
2. The tracking loss compensation method according to claim 1, wherein the compensation for the missing first tag is specifically:
and calling a first label of the tracked object from a first label library according to the first attribute of the tracked object, and compensating the lost first label by using the called first label.
3. The tracking loss compensation method of claim 1, wherein an initial second tag of a tracked object is automatically associated with the first tag of the tracked object.
4. The tracking loss compensation method of claim 1, 2 or 3, wherein the second tag is a visual three-dimensional space human body ID.
5. A tracking loss compensation system, comprising:
the first label setting module is used for setting a first label for the tracked object according to the first attribute of the tracked object before the tracked object enters the space to be detected and storing the first label in a first label library; the first attribute comprises a human face feature attribute, a breathing heartbeat attribute and/or an iris attribute; the first label corresponding to the first attribute comprises a face ID, a breath heartbeat ID and/or an iris ID;
the second label setting module is used for setting a second label for the tracked object in the space to be detected in real time, and each tracked object corresponds to only one second label at the same time;
the first label verification compensation module is used for verifying the first label of the tracked object and compensating the missing first label according to the first attribute of the tracked object when the tracked object leaves the space to be detected; the method specifically comprises the following steps: according to the first attribute of the tracked object, calling a first label from a first label library, and compensating the lost first label by using the called first label;
and the tag association module is used for associating all the second tags corresponding to the tracked object according to the first tag.
6. The tracking loss compensation system of claim 5, wherein the tracked object initial second tag set by the second tag setting module is automatically associated with the tracked object first tag.
7. A computer arrangement comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 4 when executing the computer program.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
CN202010145976.3A 2020-03-05 2020-03-05 Tracking loss compensation method, system and computer equipment Active CN111369583B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010145976.3A CN111369583B (en) 2020-03-05 2020-03-05 Tracking loss compensation method, system and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010145976.3A CN111369583B (en) 2020-03-05 2020-03-05 Tracking loss compensation method, system and computer equipment

Publications (2)

Publication Number Publication Date
CN111369583A CN111369583A (en) 2020-07-03
CN111369583B true CN111369583B (en) 2023-01-06

Family

ID=71206525

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010145976.3A Active CN111369583B (en) 2020-03-05 2020-03-05 Tracking loss compensation method, system and computer equipment

Country Status (1)

Country Link
CN (1) CN111369583B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060054691A1 (en) * 2004-09-16 2006-03-16 International Business Machines Corporation Radio frequency identification (RFID) household system for tracking and managing RFID tag containing household possessions within short range RF limited boundaries of a household facility
CN109389343A (en) * 2018-09-14 2019-02-26 上海物联网有限公司 Intelligence manufacture cargo locating and tracking and system for tracing and managing based on UWB technology

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060054691A1 (en) * 2004-09-16 2006-03-16 International Business Machines Corporation Radio frequency identification (RFID) household system for tracking and managing RFID tag containing household possessions within short range RF limited boundaries of a household facility
CN109389343A (en) * 2018-09-14 2019-02-26 上海物联网有限公司 Intelligence manufacture cargo locating and tracking and system for tracing and managing based on UWB technology

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
The Technology of Deviation Compensation for Radar Phantom Tracks;Xiang Liu 等;《2017 17th IEEE International Conference on Communication Technology》;20180517;全文 *
基于补偿跟踪的低轨预警资源调度方法研究;孙立远 等;《装备学院学报》;20150331;全文 *

Also Published As

Publication number Publication date
CN111369583A (en) 2020-07-03

Similar Documents

Publication Publication Date Title
Venkataramanan et al. Attention guided anomaly localization in images
CN109767322B (en) Suspicious transaction analysis method and device based on big data and computer equipment
US11205276B2 (en) Object tracking method, object tracking device, electronic device and storage medium
US11055874B2 (en) Image processing for tracking actions of individuals
CN109767327A (en) Customer information acquisition and its application method based on anti money washing
US20130022234A1 (en) Object tracking
CN111445501A (en) Multi-target tracking method, device and storage medium
CN108596056A (en) A kind of taxi operation behavior act recognition methods and system
DE112006002966T5 (en) Determining a condition for an object identified by an RFID tag
CN110111173A (en) Insurance products push control method, device, computer equipment and storage medium
CN111553234A (en) Pedestrian tracking method and device integrating human face features and Re-ID feature sorting
CN109767326A (en) Suspicious transaction reporting generation method, device, computer equipment and storage medium
CN113468914B (en) Method, device and equipment for determining purity of commodity
US10223232B2 (en) System and method for recording the beginning and ending of job level activity in a mainframe computing environment
CN111369583B (en) Tracking loss compensation method, system and computer equipment
CN110189108A (en) Laboratory sample management method, apparatus, computer equipment and storage medium
CN116110548B (en) Emergency first-aid integrated management method and system
CN111241995B (en) Loss compensation method and system for tracked object and computer equipment
CN115587769A (en) Method and device for detecting commodity out-of-stock state, computer equipment and storage medium
CN115661591A (en) Intelligent cabinet dynamic identification method and device
CN114742506A (en) Management system suitable for multiple warehouses
CN110211161B (en) Method and device for multi-camera track coincidence analysis
CN113269483A (en) Management method, device, medium and electronic equipment of intelligent vault system
CN108874846A (en) A kind of intelligent control method and system
CN114676406A (en) Method and system for studying and judging co-operation relation people

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant