CN115171040B - Method, device and system for pushing information based on security check information and face information - Google Patents
Method, device and system for pushing information based on security check information and face information Download PDFInfo
- Publication number
- CN115171040B CN115171040B CN202210746397.3A CN202210746397A CN115171040B CN 115171040 B CN115171040 B CN 115171040B CN 202210746397 A CN202210746397 A CN 202210746397A CN 115171040 B CN115171040 B CN 115171040B
- Authority
- CN
- China
- Prior art keywords
- information
- face
- current
- image
- passing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000007689 inspection Methods 0.000 claims abstract description 129
- 230000008569 process Effects 0.000 claims abstract description 26
- 230000002452 interceptive effect Effects 0.000 claims abstract description 17
- 230000003993 interaction Effects 0.000 claims description 32
- 238000012098 association analyses Methods 0.000 claims description 20
- 238000013507 mapping Methods 0.000 claims description 18
- 230000000875 corresponding effect Effects 0.000 description 39
- 241000287107 Passer Species 0.000 description 28
- 230000000474 nursing effect Effects 0.000 description 14
- 230000002596 correlated effect Effects 0.000 description 10
- 230000001815 facial effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 239000003814 drug Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 239000008267 milk Substances 0.000 description 2
- 210000004080 milk Anatomy 0.000 description 2
- 235000013336 milk Nutrition 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9035—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9038—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Finance (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Development Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Analysing Materials By The Use Of Radiation (AREA)
Abstract
The invention discloses an information pushing method based on security inspection information and face information, which comprises the following steps of S1, acquiring a current associated image pair; s2, extracting the current face feature to be detected from the current associated image pair; s3, carrying out object category identification from the current associated image pair to obtain a corresponding current object category; s4, matching the current character label according to the current article type; s5, matching current pushing information according to the current character label, and associating the current face feature to be detected with the current pushing information; s6, acquiring the passing face features of the current passing face image, S7, responding to the passing face features of the current passing face image, matching out the corresponding passing face features and the corresponding pushing information thereof, and S8, organizing the pushing information into a pushing message sent to the face card swiping interactive terminal. The invention overlaps the processes of passing inspection and passing gate with the triggering pushing process of information, thereby increasing the user friendliness and enabling passers-by to obtain accurate and individual pushing information in the riding process.
Description
Technical Field
The invention relates to the technical field of information pushing, in particular to a method, a device and a system for pushing information based on security check information and face information.
Background
In order to facilitate the passers-by to know information, generally in a subway platform, a poster machine is arranged, and various groups of information needing to be concerned is published on the poster machine, wherein the information comprises: subway policy information, subway navigation information, subway surrounding information, subway warning information and advertisement information.
For example, when a transit person is a nursing mother, the transit person generally wants to quickly know the position of a nursing room in a subway, and needs to go to a poster machine to inquire subway navigation information.
For example, when a tourist is a passer, it is generally desired to quickly understand the exit position and surrounding information of the subway, which requires a query operation of surrounding information of the subway to a poster machine.
For example, when a subway system needs to issue subway policy information and subway alarm information, the subway policy information and the subway alarm information are generally imported on a poster machine and need to be actively checked by passers-by to obtain the subway policy information and the subway alarm information.
The information pushing mode of the poster machine has the following problems:
first, the poster machine is relatively fixed in position and located in different places.
Second, information of the poster is generally obtained in a scrolling manner or actively operated.
Therefore, the existing information pushing mode by using the poster machine is unfriendly to passers-by, can be obtained by the passers-by actively inquiring, and is complex in operation. Therefore, the utilization rate, pushing efficiency, precision and friendliness of the existing poster machine are not high.
In order to improve the effective, accurate, quick and friendly pushing of subway information, the information pushing of the traditional active query type is required to be changed into the information pushing of a passive receiving type. How to achieve this with the equipment in the subway is therefore a great difficulty faced in the art.
Disclosure of Invention
The invention aims to provide a method, a device and a system for pushing information based on security check information and face information.
On the one hand, the information pushing method based on the security check information and the face information comprises the following steps:
s1, acquiring a current associated image pair, wherein the associated image pair comprises: the image information of the related package X-ray pictures and the security check point areas is converted into S2 and S3;
s2, extracting the characteristics of the current over-detected face from the image information of the security inspection point area of the current associated image pair, and turning to S5;
s3, carrying out object category identification from the package X-ray pictures of the current associated image pair to obtain the current object category corresponding to the package X-ray pictures, and turning to S4;
s4, matching the current character label from the article category-character label mapping table according to the current article category; according to the current character label, matching the current push information from a character label-push information mapping table, and turning to S5;
s5, associating the current over-detected face features with the current push information to form a face push information association pair;
s6, acquiring the characteristics of the gate passing face of the current gate passing face image, and turning to S7;
s7, responding to the passing face features of the current passing face image, matching the corresponding passing face features and the corresponding pushing information thereof from the face pushing information association pair according to the matching degree of the passing face features and the passing face features, and turning to S8;
s8, organizing the pushing information of the characteristics of the passgate face responding to the current passgate face image into a pushing message which is sent to the corresponding face card swiping interaction terminal of the current passgate face image.
In a subway station, passers-by generally need to perform actions such as security check, entering and passing through a gate, getting on and off a car, and exiting and passing through a gate, security check information is generally generated during security check, face information is generally generated during entering and exiting and passing through a gate (face card swiping mode), and in patent application 2021115011988, security check information is recorded, and the security check information includes: the image information of the package X-ray picture and the security inspection point area is generally the image information of the area opposite to the area with the package channel, and the patent application proposes how to correlate the image information of the package X-ray picture and the security inspection point area, which outputs a correlated image pair of the image information of the package X-ray picture and the security inspection point area correlated with each other, wherein the correlated image pair is a correlated image pair of a person package. Meanwhile, for a conventional face card swiping mode, a face card swiping interaction terminal is generally arranged on a gate, a face camera on the face card swiping interaction terminal shoots a gate passing face image of a passer, and then the gate is informed to pass after gate passing face features are generated by face recognition and compared with pre-stored face features of a system for authentication. Therefore, the face information mainly including the face image and the face feature of the passing gate is generated.
The passive information pushing mode of the invention is as follows: by utilizing the security check information and the face information generated by the pass gate to realize pushing of the information to be pushed, the aim that a system actively pushes the information to a single passer is achieved, the single passer can receive the pushed information at the face card swiping interaction terminal during the pass gate, the passer does not need any operation in the whole process, only needs to passively receive the information, the stay time of the pass gate can be set to be the information pushing time, and the pass gate interaction device can be set to be the information pushing device, so that the single passer, the effective, quick, accurate and friendly information receiving function is achieved, and the face card swiping interaction terminal has the triggering and new information receiving functions.
Specifically, in the present invention, firstly, the association between the information to be pushed and the passer is to be established, and in order to realize accurate pushing, the present invention presets: an "article category-person tag map" and a "person tag-push information map". In the security inspection process, security inspection information can be generated: and wrapping the X-ray picture and the image information of the security inspection point area. The package X-ray pictures are generally identified by the intelligent picture identifying box to identify the types of the objects in the pictures, so the package X-ray pictures can be the package X-ray pictures after the original pictures are marked by the intelligent picture identifying box. Thus, for a parcel X-ray image, its corresponding, additional item class information may be obtained, whereas a general item class may reflect the attributes of a person, and thus its person tag may be derived from the item class. For example, if a certain package X-ray image identifies a milk bottle, a person tag may be marked on the package X-ray image as: a nursing mother. For example, when a certain package X-ray picture identifies a toothbrush, a towel, and clothes, a person tag may be marked on the package X-ray picture as follows: and (5) tourists. For example, when a certain package X-ray picture identifies a medicine or a film, a person label may be marked on the package X-ray picture as follows: and (3) a patient. Therefore, the invention establishes an article category-character label mapping table, and corresponding push information can be configured on the character label, for example: the character label is as follows: nursing mother, push information is: position navigation information of the nursing room; the character label is as follows: tourists push information as follows: navigation information of hotels around the subway; the character label is as follows: patient, push information is: and the navigation information of hospitals around the subway.
Under the media of the item category-character tag mapping table and the character tag-pushing information mapping table, the invention passes through security check information: the image information of the security inspection point area and the push information can be associated by wrapping the X-ray image, the image information of the security inspection point area and the association relation (current association image pair), meanwhile, the face feature extraction technology is utilized to extract the face features of the image information of the security inspection point area, finally, the association of the face features and the push information can be established, namely, the association of the current over-inspection face features and the current push information is established, the face push information association pair is formed, and the establishment of the face push information association pair means that the association of the information to be pushed and the passers is established.
Then, triggering of pushing information needs to be executed, in order to accurately, effectively and friendly push the pushing information to a passer in an individual state, the method and the device utilize the triggering of the passer when a face swipes a card to pass a gate, simultaneously utilize the reading of the pushing information by the passer when the face swipes the card to pass the gate, and simultaneously utilize an interaction terminal of the passer when the face swipes the card to pass the gate as a receiving object for receiving the pushing information. Specifically, when a passer goes in or goes out of the passer-by, when the passer-by triggers a face card swiping function, the passer-by face feature of the current passer-by face image is generated, and the process is used as the trigger of the face card swiping and also as the trigger of pushing information, so that the system matches the corresponding over-detected face feature from the face pushing information association pair to be matched based on the passer-by face feature, and correspondingly sends the pushing information to the face card swiping interaction terminal corresponding to the over-detected face feature, and at the moment, the corresponding passer-by person receives the pushing information at the corresponding face card swiping interaction terminal.
Preferably, the specific process of obtaining the characteristics of the gate face of the current gate face image is as follows:
s61, acquiring a current passing-gate face image from a face camera of the face card swiping interactive terminal,
s62, carrying out face recognition on the current passing face image to obtain the passing face characteristics of the current passing face image.
Preferably, the face card swiping interactive terminal is an electronic device which is arranged on the gate and is provided with a push information playing display or/and a push information playing loudspeaker and a face camera.
Preferably, the category of the push information includes: at least 1 of text, video, picture, sound, color.
Preferably, the content of the push information includes: at least one of subway warning information, subway navigation information, subway policy information, surrounding navigation information and advertisement information.
Preferably, the specific process of acquiring the current associated image pair is as follows:
s11, acquiring image information of a security inspection point area from a security inspection camera of the security inspection point area;
s12, acquiring a package X-ray picture from an X-ray luggage inspection machine;
s13, carrying out packet association analysis on the image information of the security inspection point area and the package X-ray image to obtain the image information of the package X-ray image and the security inspection point area which are associated with each other, wherein the image information of the package X-ray image and the security inspection point area which are associated with each other form a current association image pair.
Preferably, the specific process of acquiring the current associated image pair is as follows:
s11, continuously receiving image information of the security inspection point area sent by the security inspection camera from the security inspection point area, and storing the image information into a database according to time periods;
s12, receiving a package X-ray picture from an X-ray luggage inspection machine, extracting shooting time of the package X-ray picture, and recording the shooting time as a time point t 2 ；
S13, according to the time point t 2 And the optional time interval x to obtain (t 2 -x，t 2 ) A time period;
s14, calling the time point t in the database 2 Corresponding (t) 1 ,t n ) Image information of a time period, said (t 1 ,t n ) The time period is the time point t 2 Is a time period of (2);
s15, obtaining (t) 1 ,t n ) Time axis of image information in time period, and (t) 2 -x，t 2 ) Image information in a time period, wherein the image information is final person packet associated image information;
s16, carrying out pedestrian package association binding on the package data and the pedestrian package association image information to obtain the image information of the package X-ray picture and the security check point area which are associated with each other.
On the other hand, carry out information pushing device based on security check information and face information, include:
one or more processors;
and the storage unit is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors can realize an information pushing method based on the security information and the face information.
On the other hand, the information pushing device is based on the security information and the face information, and the information pushing device is a face card swiping interactive terminal;
the face card swiping interactive terminal executes the following steps:
a current passing-gate face image is obtained,
organizing a face card swiping request containing a current passing face image,
obtaining a push message responding to the current passing-gate face image,
the push message is parsed into push information,
and playing the analyzed push information.
On the other hand, the information pushing system is based on the security check information and the face information, the information pushing system is an information pushing server,
the information pushing server is connected with the security inspection camera and the X-ray baggage inspection machine in the security inspection point area at the same time and is used for acquiring security inspection information provided by the security inspection camera and the X-ray baggage inspection machine in the security inspection point area; the security information comprises: image information for forming mutually associated package X-ray pictures and security check point areas; the package X-ray image is from an X-ray baggage inspection machine, and the image information of the security inspection point area is from a security inspection camera;
the information pushing server is connected with the human face card swiping interaction terminal and is used for acquiring human face information for swiping cards provided by the human face card swiping interaction terminal; the face information comprises a current passing face image;
the information push server includes:
one or more processors;
the storage unit is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors can be enabled to realize the information pushing method based on the security information and the face information.
On the other hand, based on security check information and face information, carry out information push system, information push system includes: the system comprises an information pushing server, a face card swiping control system and a person packet association analysis system, wherein the face card swiping control system and the person packet association analysis system are interacted with the information pushing server at the same time;
the face card swiping control system provides the information pushing server with the passing face features of the current passing face image;
the personal packet association analysis system provides an association image pair for the information push server;
the information push server includes:
the module for acquiring the current associated image pair comprises: image information of the mutually-associated package X-ray pictures and security check point areas;
a module for extracting the characteristics of the current over-detected face from the image information of the security inspection point area of the current associated image;
the module is used for identifying the object type from the package X-ray pictures of the current associated image pair to obtain the current object type corresponding to the package X-ray pictures;
a module for matching the current character tag from the article category-character tag mapping table according to the current article category and matching the current push information from the character tag-push information mapping table according to the current character tag;
a module for associating the current over-detected face features with the current push information to form a face push information association pair;
a module for obtaining the characteristics of the gate passing face of the current gate passing face image;
responding to the passing gate face features of the current passing gate face image, and matching corresponding passing gate face features and corresponding push information modules from the face push information association pairs according to the matching degree of the passing gate face features and the passing gate face features;
and a module for organizing the pushing information of the passing face features responding to the current passing face image into a pushing message which is sent to the corresponding face card swiping interaction terminal of the current passing face image.
A face card swiping control system;
a module for acquiring the current passing-gate face image from the face camera of the face card swiping interactive terminal,
the module is used for carrying out face recognition on the current passing face image to obtain the passing face characteristics of the current passing face image;
the man-package association analysis system comprises:
a module for acquiring image information of the security inspection point area from the security inspection camera of the security inspection point area;
a module for obtaining a package X-ray picture from an X-ray baggage inspection machine;
and carrying out packet association analysis on the image information of the security inspection point area and the package X-ray image to obtain the mutually associated package X-ray image and the image information of the security inspection point area, wherein the mutually associated package X-ray image and the image information of the security inspection point area form a current association image pair.
The invention has the beneficial effects that: the scheme is only aimed at passers-by with bags and using a face card swiping mode for passing the gate. The advantage of this scheme lies in: the accurate pushing information is matched according to the article category, the passing time is used for triggering, receiving and reading the pushing information, and the whole process can realize accurate, quick, effective and friendly pushing without adding hardware cost and information.
Drawings
Fig. 1 is an information function diagram of a poster machine.
Fig. 2 is a schematic diagram of a system layout according to the present invention.
FIG. 3 is a schematic diagram of the data flow according to the present invention.
Fig. 4 is a flow chart of the method of the present invention.
The reference numerals in the drawings are respectively: 1. passersby, 2, wait to examine the parcel, 3, X-ray baggage inspection machine, 4, security inspection camera, 5, security inspection door, 6, floodgate machine, 7, human face interactive terminal that punches a card.
Detailed Description
The present invention will be described in further detail with reference to examples and drawings, but embodiments of the present invention are not limited thereto.
Example 1
See fig. 1-4.
The information pushing method based on the security check information and the face information comprises the following steps:
s1, acquiring a current associated image pair, wherein the associated image pair comprises: the image information of the related package X-ray pictures and the security check point areas is converted into S2 and S3;
s2, extracting the characteristics of the current over-detected face from the image information of the security inspection point area of the current associated image pair, and turning to S5;
s3, carrying out object category identification from the package X-ray pictures of the current associated image pair to obtain the current object category corresponding to the package X-ray pictures, and turning to S4;
s4, matching the current character label from the article category-character label mapping table according to the current article category; according to the current character label, matching the current push information from a character label-push information mapping table, and turning to S5;
s5, associating the current over-detected face features with the current push information to form a face push information association pair;
s6, acquiring the characteristics of the gate passing face of the current gate passing face image, and turning to S7;
s7, responding to the passing face features of the current passing face image, matching the corresponding passing face features and the corresponding pushing information thereof from the face pushing information association pair according to the matching degree of the passing face features and the passing face features, and turning to S8;
s8, organizing the pushing information of the characteristics of the passgate face responding to the current passgate face image into a pushing message which is sent to the corresponding face card swiping interaction terminal of the current passgate face image.
In a subway station, a passer-by 1 generally needs to perform actions such as security check, entering and passing a gate, getting on/off a car, getting off and passing a gate, security check information is generally generated during security check, face information is generally generated during entering and passing a gate (face card swiping mode), and in patent application 2021115011988, security check information is described, and includes: the image information of the package X-ray picture and the security inspection point area is generally the image information of the area opposite to the area with the package channel, and the patent application proposes how to correlate the image information of the package X-ray picture and the security inspection point area, which outputs a correlated image pair of the image information of the package X-ray picture and the security inspection point area correlated with each other, wherein the correlated image pair is a correlated image pair of a person package. Meanwhile, for a conventional face card swiping mode, a face card swiping interaction terminal is generally arranged on a gate, a face camera on the face card swiping interaction terminal shoots a gate passing face image of a passer, and then the gate is informed to pass after gate passing face features are generated by face recognition and compared with pre-stored face features of a system for authentication. Therefore, the face information mainly including the face image and the face feature of the passing gate is generated.
The passive information pushing mode of the invention is as follows: by utilizing the security check information and the face information generated by the pass gate to realize pushing of the information to be pushed, the aim that a system actively pushes the information to a single passer is achieved, the single passer can receive the pushed information at the face card swiping interaction terminal during the pass gate, the passer does not need any operation in the whole process, only needs to passively receive the information, the stay time of the pass gate can be set to be the information pushing time, and the pass gate interaction device can be set to be the information pushing device, so that the single passer, the effective, quick, accurate and friendly information receiving function is achieved, and the face card swiping interaction terminal has the triggering and new information receiving functions.
Specifically, in the present invention, firstly, the association between the information to be pushed and the passer is to be established, and in order to realize accurate pushing, the present invention presets: an "article category-person tag map" and a "person tag-push information map". In the security inspection process, security inspection information can be generated: and wrapping the X-ray picture and the image information of the security inspection point area. The package X-ray pictures are generally identified by the intelligent picture identifying box to identify the types of the objects in the pictures, so the package X-ray pictures can be the package X-ray pictures after the original pictures are marked by the intelligent picture identifying box. Thus, for a parcel X-ray image, its corresponding, additional item class information may be obtained, whereas a general item class may reflect the attributes of a person, and thus its person tag may be derived from the item class. For example, if a certain package X-ray image identifies a milk bottle, a person tag may be marked on the package X-ray image as: a nursing mother. For example, when a certain package X-ray picture identifies a toothbrush, a towel, and clothes, a person tag may be marked on the package X-ray picture as follows: and (5) tourists. For example, when a certain package X-ray picture identifies a medicine or a film, a person label may be marked on the package X-ray picture as follows: and (3) a patient. Therefore, the invention establishes an article category-character label mapping table, and corresponding push information can be configured on the character label, for example: the character label is as follows: nursing mother, push information is: position navigation information of the nursing room; the character label is as follows: tourists push information as follows: navigation information of hotels around the subway; the character label is as follows: patient, push information is: and the navigation information of hospitals around the subway.
Under the media of the item category-character tag mapping table and the character tag-pushing information mapping table, the invention passes through security check information: the image information of the security inspection point area and the push information can be associated by wrapping the X-ray image, the image information of the security inspection point area and the association relation (current association image pair), meanwhile, the face feature extraction technology is utilized to extract the face features of the image information of the security inspection point area, finally, the association of the face features and the push information can be established, namely, the association of the current over-inspection face features and the current push information is established, the face push information association pair is formed, and the establishment of the face push information association pair means that the association of the information to be pushed and the passers is established.
Then, triggering of pushing information needs to be executed, in order to accurately, effectively and friendly push the pushing information to a passer in an individual state, the method and the device utilize the triggering of the passer when a face swipes a card to pass a gate, simultaneously utilize the reading of the pushing information by the passer when the face swipes the card to pass the gate, and simultaneously utilize an interaction terminal of the passer when the face swipes the card to pass the gate as a receiving object for receiving the pushing information. Specifically, when a passer goes in or goes out of the passer-by, when the passer-by triggers a face card swiping function, the passer-by face feature of the current passer-by face image is generated, and the process is used as the trigger of the face card swiping and also as the trigger of pushing information, so that the system matches the corresponding over-detected face feature from the face pushing information association pair to be matched based on the passer-by face feature, and correspondingly sends the pushing information to the face card swiping interaction terminal corresponding to the over-detected face feature, and at the moment, the corresponding passer-by person receives the pushing information at the corresponding face card swiping interaction terminal.
Preferably, the specific process of obtaining the characteristics of the gate face of the current gate face image is as follows:
s61, acquiring a current passing-gate face image from a face camera of the face card swiping interactive terminal,
s62, carrying out face recognition on the current passing face image to obtain the passing face characteristics of the current passing face image.
Preferably, the face card swiping interaction terminal 7 is an electronic device provided with a push information playing display or/and a push information playing loudspeaker and a face camera and arranged on the gate 6.
Preferably, the category of the push information includes: at least 1 of text, video, picture, sound, color.
Preferably, the content of the push information includes: at least one of subway warning information, subway navigation information, subway policy information, surrounding navigation information and advertisement information.
Preferably, the specific process of acquiring the current associated image pair is as follows:
s11, acquiring image information of a security inspection point area from a security inspection camera 4 of the security inspection point area;
s12, acquiring a package X-ray picture from an X-ray baggage inspection machine 3;
s13, carrying out packet association analysis on the image information of the security inspection point area and the package X-ray image to obtain the image information of the package X-ray image and the security inspection point area which are associated with each other, wherein the image information of the package X-ray image and the security inspection point area which are associated with each other form a current association image pair.
Preferably, the specific process of acquiring the current associated image pair is as follows:
s11, continuously receiving image information of the security inspection point area sent by the security inspection camera from the security inspection point area, and storing the image information into a database according to time periods;
s12, receiving the package X-ray picture from the X-ray baggage inspection machine 3, extracting the shooting time of the package X-ray picture, and recording the shooting time as a time point t 2 ；
S13, according to the time point t 2 And the optional time interval x to obtain (t 2 -x，t 2 ) A time period;
s14, calling the time point t in the database 2 Corresponding (t) 1 ,t n ) Image information of a time period, said (t 1 ,t n ) Time ofThe segment including a time point t 2 Is a time period of (2);
s15, obtaining (t) 1 ,t n ) Time axis of image information in time period, and (t) 2 -x，t 2 ) Image information in a time period, wherein the image information is final person packet associated image information;
s16, carrying out pedestrian package association binding on the package data and the pedestrian package association image information to obtain the image information of the package X-ray picture and the security check point area which are associated with each other.
Referring to figures 2, 3 and 4 of the drawings,
in the first mode, an information pushing system is arranged, the information pushing system directly interacts with the X-ray baggage inspection machine 3, the security inspection camera 4 and the face card swiping interaction terminal 7,
the information push system is internally provided with:
the image information of the package X-ray picture and the security check point area are correlated into a current correlated image pair,
a module for identifying the object type of the package X-ray picture,
a module for extracting the facial features of the image information of the security inspection point area to form the facial features of the inspected person,
a module for matching the character labels according to the object categories and pushing information according to the character labels,
module for forming face pushing information association pair of detected face features and current pushing information association
A module for carrying out face recognition on the current passing face image to form the passing face characteristics,
a module for responding the corresponding over-detected face characteristics and the corresponding push information according to the passing gate face characteristics,
and organizing the push information into a push message module of the human face card swiping interactive terminal.
Referring to figures 2, 3 and 4 of the drawings,
in a second mode of operation, the first mode,
an information pushing system is arranged, the information pushing system directly interacts with the existing face card swiping control system and the existing personal packet association analysis system,
the information push system is internally provided with:
a module for acquiring the current associated image pair associated with the image information of the package X-ray picture and the security check point area distributed by the personnel package association analysis system,
a module for identifying the object type of the package X-ray picture,
a module for extracting the facial features of the image information of the security inspection point area to form the facial features of the inspected person,
a module for matching the character labels according to the object categories and pushing information according to the character labels,
module for forming face pushing information association pair of detected face features and current pushing information association
A module for obtaining the characteristics of the passing gate face distributed by the face card swiping control system,
a module for responding the corresponding over-detected face characteristics and the corresponding push information according to the passing gate face characteristics,
and organizing the push information into a push message module of the human face card swiping interactive terminal.
With reference to figure 2 of the drawings,
taking a nursing mother and a guest as examples, both passers-by carry the luggage.
In the security inspection stage:
in the security inspection point area, the security inspection point area and the security inspection point area sequentially pass through the package channel, 2 package X-ray pictures are sequentially obtained by the X-ray baggage inspection machine on the time sequence, meanwhile, the security inspection camera obtains the image information of the corresponding security inspection point area according to the time sequence, and 2 current associated image pairs can be obtained according to the person package association technology.
Through the data analysis process of the invention, on the basis of 2 current associated image pairs, a 'face push information associated pair of the over-detected face characteristics associated with the current push information' of the nursing mother and a 'face push information associated pair of the over-detected face characteristics associated with the current push information' of the tourist are respectively obtained; for the nursing mother, the current push information is the nursing room navigation information of the subway station, and for the tourist, the current push information is the surrounding navigation information of the subway station.
In the passing stage:
the 2 passers-by can enter any gate optionally without time constraint, when a face card-swiping passer-by request is adopted, a passer-by face image and corresponding passer-by face features are triggered to be generated, the passer-by face features are utilized for matching, and corresponding 'face push information association relation of the over-detection face features and the current push information' is responded, so that the corresponding push information is responded to the face card-swiping interaction terminal on the passer-by gate, namely, the nursing room navigation information of the subway station is pushed to the face card-swiping interaction terminal on the gate of the nursing mother passer-by, and the peripheral navigation information of the subway station is pushed to the face card-swiping interaction terminal on the gate of the tourist passer-by. So far, when the pass gate is completed, the information pushing is triggered.
Example 2
Information pushing device based on security check information and face information, includes:
one or more processors;
the storage unit is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors can be enabled to realize the information pushing method based on the security information and the face information.
Example 3
The information pushing device is based on the security information and the face information and is a face card swiping interactive terminal;
the face card swiping interactive terminal executes the following steps:
a current passing-gate face image is obtained,
organizing a face card swiping request containing a current passing face image,
obtaining a push message responding to the current passing-gate face image,
the push message is parsed into push information,
and playing the analyzed push information.
Example 4
An information pushing system is carried out based on the security check information and the face information, the information pushing system is an information pushing server,
the information pushing server is connected with the security inspection camera 4 and the X-ray baggage inspection machine 3 in the security inspection point area at the same time and is used for acquiring security inspection information provided by the security inspection camera 4 and the X-ray baggage inspection machine 3 in the security inspection point area; the security information comprises: image information for forming mutually associated package X-ray pictures and security check point areas; the X-ray picture of the package comes from an X-ray baggage inspection machine 3, and the image information of the security inspection point area comes from a security inspection camera 4;
the information pushing server is connected with the human face card swiping interaction terminal and is used for acquiring human face information for swiping cards provided by the human face card swiping interaction terminal; the face information comprises a current passing face image;
the information push server includes:
one or more processors;
the storage unit is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors can be enabled to realize the information pushing method based on the security information and the face information.
Example 5
The information pushing system is based on security check information and face information, and comprises: the system comprises an information pushing server, a face card swiping control system and a person packet association analysis system, wherein the face card swiping control system and the person packet association analysis system are interacted with the information pushing server at the same time;
the face card swiping control system provides the information pushing server with the passing face features of the current passing face image;
the personal packet association analysis system provides an association image pair for the information push server;
the information push server includes:
the module for acquiring the current associated image pair comprises: image information of the mutually-associated package X-ray pictures and security check point areas;
a module for extracting the characteristics of the current over-detected face from the image information of the security inspection point area of the current associated image;
the module is used for identifying the object type from the package X-ray pictures of the current associated image pair to obtain the current object type corresponding to the package X-ray pictures;
a module for matching the current character tag from the article category-character tag mapping table according to the current article category and matching the current push information from the character tag-push information mapping table according to the current character tag;
a module for associating the current over-detected face features with the current push information to form a face push information association pair;
a module for obtaining the characteristics of the gate passing face of the current gate passing face image;
responding to the passing gate face features of the current passing gate face image, and matching corresponding passing gate face features and corresponding push information modules from the face push information association pairs according to the matching degree of the passing gate face features and the passing gate face features;
and a module for organizing the pushing information of the passing face features responding to the current passing face image into a pushing message which is sent to the corresponding face card swiping interaction terminal of the current passing face image.
A face card swiping control system;
a module for acquiring the current passing-gate face image from the face camera of the face card swiping interactive terminal,
the module is used for carrying out face recognition on the current passing face image to obtain the passing face characteristics of the current passing face image;
the man-package association analysis system comprises:
a module for acquiring image information of the security inspection point area from the security inspection camera 4 of the security inspection point area;
a module for acquiring a package X-ray picture from the X-ray baggage inspection machine 3;
and carrying out packet association analysis on the image information of the security inspection point area and the package X-ray image to obtain the mutually associated package X-ray image and the image information of the security inspection point area, wherein the mutually associated package X-ray image and the image information of the security inspection point area form a current association image pair.
It should be noted that:
the face features in the invention are divided into: the invention relates to a gate passing face feature and a gate passing face feature, so that the face feature only plays a role in triggering, the information push of the invention does not have a corresponding relation with the appearance feature of a passer, and the invention takes the face information generated in the gate passing stage and the gate passing stage as a triggering criterion.
The invention relies on the article category generated in the over-inspection stage to determine what information the passer should push, i.e. the invention uses the derived article category of the security inspection information to determine the content and category of the push information.
The push of the invention utilizes the association relation of the human package association technology, associates the human face with the push information, organizes the association relation of the human face and the push information in advance, and waits for the trigger of the crossing human face information.
The invention effectively organizes the relations among the passing face, the over-detected face, the information to be pushed, the over-detected object, the over-detected face and the over-detected object together, and the whole process is divided into a process of organizing the push information and a process of triggering the push information.
According to the invention, the process of passing through inspection and gate passing is overlapped with the triggering pushing process of information, so that the user friendliness is improved, and accurate and individualized pushing information is obtained by the passers in the riding process.
The foregoing description of the preferred embodiment of the invention is not intended to limit the invention in any way, but rather to cover all modifications, equivalents, improvements and alternatives falling within the spirit and principles of the invention.
Claims (9)
1. The information pushing method based on the security check information and the face information is characterized by comprising the following steps of:
s1, acquiring a current associated image pair, wherein the associated image pair comprises: the image information of the related package X-ray pictures and the security check point areas is converted into S2 and S3;
s2, extracting the characteristics of the current over-detected face from the image information of the security inspection point area of the current associated image pair, and turning to S5;
s3, carrying out object category identification from the package X-ray pictures of the current associated image pair to obtain the current object category corresponding to the package X-ray pictures, and turning to S4;
s4, matching the current character label from the article category-character label mapping table according to the current article category; according to the current character label, matching the current push information from a character label-push information mapping table, and turning to S5;
s5, associating the current over-detected face features with the current push information to form a face push information association pair;
s6, acquiring the characteristics of the gate passing face of the current gate passing face image, and turning to S7;
s7, responding to the passing face features of the current passing face image, matching the corresponding passing face features and the corresponding pushing information thereof from the face pushing information association pair according to the matching degree of the passing face features and the passing face features, and turning to S8;
and S8, organizing the push information of the characteristics of the passgate face responding to the current passgate face image into a push message which is sent to the corresponding face card swiping interaction terminal of the current passgate face image.
2. The method for pushing information based on security information and face information according to claim 1, wherein,
the specific process for obtaining the characteristics of the gate passing face of the current gate passing face image comprises the following steps:
s61, acquiring a current passing-gate face image from a face camera of the face card swiping interactive terminal,
s62, carrying out face recognition on the current passing face image to obtain the passing face characteristics of the current passing face image.
3. The method for pushing information based on security information and face information according to claim 2, wherein,
the human face card swiping interactive terminal (7) is an electronic device which is arranged on the gate (6) and is provided with a push information playing display or/and a push information playing loudspeaker and a human face camera.
4. The method for pushing information based on security information and face information according to claim 1, wherein,
the categories of the push information comprise: at least 1 of text, video, picture, sound, color;
the content of the push information comprises: at least one of subway warning information, subway navigation information, subway policy information, surrounding navigation information and advertisement information.
5. The method for pushing information based on security information and face information according to claim 1, wherein,
the specific process for acquiring the current associated image pair is as follows:
s11, acquiring image information of a security inspection point area from a security inspection camera (4) of the security inspection point area;
s12, acquiring a package X-ray picture from an X-ray baggage inspection machine (3);
s13, carrying out packet association analysis on the image information of the security inspection point area and the package X-ray image to obtain the image information of the package X-ray image and the security inspection point area which are associated with each other, wherein the image information of the package X-ray image and the security inspection point area which are associated with each other form a current association image pair.
6. The method for pushing information based on security information and face information according to claim 1, wherein,
the specific process for acquiring the current associated image pair is as follows:
s11, continuously receiving image information of the security inspection point area sent by the security inspection camera from the security inspection point area, and storing the image information into a database according to time periods;
s12, receiving a package X-ray picture from an X-ray baggage inspection machine (3), extracting the shooting time of the package X-ray picture, and recording the shooting time as a time point t 2 ；
S13, according to the time point t 2 And the optional time interval x to obtain (t 2 -x，t 2 ) A time period;
s14, calling the time point t in the database 2 Corresponding (t) 1 ，t n ) Image information of a time period, said (t 1 ，t n ) The time period is the time point t 2 Is a time period of (2);
s15, obtaining (t) 1 ，t n ) Time axis of image information in time period, and (t) 2 -x，t 2 ) Image information in a time period, wherein the image information is final person packet associated image information;
s16, carrying out pedestrian package association binding on the package X-ray picture and the pedestrian package association image information to obtain the image information of the package X-ray picture and the security check point area which are associated with each other.
7. Carry out information pusher based on security check information and face information, its characterized in that includes:
one or more processors;
a storage unit, configured to store one or more programs, where the one or more programs, when executed by the one or more processors, enable the one or more processors to implement the method for pushing information based on security information and face information according to any one of claims 1 to 6.
8. The information pushing system based on the security check information and the face information is characterized in that the information pushing system is an information pushing server,
the information pushing server is connected with the security inspection camera (4) and the X-ray baggage inspection machine (3) in the security inspection point area at the same time and is used for acquiring security inspection information provided by the security inspection camera (4) and the X-ray baggage inspection machine (3) in the security inspection point area; the security information comprises: image information for forming mutually associated package X-ray pictures and security check point areas; the X-ray picture of the package comes from an X-ray baggage inspection machine (3), and the image information of the security inspection point area comes from a security inspection camera (4);
the information pushing server is connected with the human face card swiping interaction terminal and is used for acquiring human face information for swiping cards provided by the human face card swiping interaction terminal; the face information comprises a current passing face image;
the information push server includes:
one or more processors;
a storage unit, configured to store one or more programs, where the one or more programs, when executed by the one or more processors, enable the one or more processors to implement the method for pushing information based on security information and face information according to any one of claims 1 to 6.
9. The information pushing system based on the security check information and the face information is characterized by comprising: the system comprises an information pushing server, a face card swiping control system and a person packet association analysis system, wherein the face card swiping control system and the person packet association analysis system are interacted with the information pushing server at the same time;
the face card swiping control system provides the information pushing server with the passing face features of the current passing face image;
the personal packet association analysis system provides an association image pair for the information push server;
the information push server includes:
the module for acquiring the current associated image pair comprises: image information of the mutually-associated package X-ray pictures and security check point areas;
a module for extracting the characteristics of the current over-detected face from the image information of the security inspection point area of the current associated image;
the module is used for identifying the object type from the package X-ray pictures of the current associated image pair to obtain the current object type corresponding to the package X-ray pictures;
a module for matching the current character tag from the article category-character tag mapping table according to the current article category and matching the current push information from the character tag-push information mapping table according to the current character tag;
a module for associating the current over-detected face features with the current push information to form a face push information association pair;
a module for obtaining the characteristics of the gate passing face of the current gate passing face image;
responding to the passing gate face features of the current passing gate face image, and matching corresponding passing gate face features and corresponding push information modules from the face push information association pairs according to the matching degree of the passing gate face features and the passing gate face features;
the module organizes pushing information responding to the characteristics of the passing-gate face of the current passing-gate face image into pushing messages which are sent to the corresponding face card swiping interactive terminal of the current passing-gate face image;
a face card swiping control system;
a module for acquiring the current passing-gate face image from the face camera of the face card swiping interactive terminal,
the module is used for carrying out face recognition on the current passing face image to obtain the passing face characteristics of the current passing face image;
the man-package association analysis system comprises:
a module for acquiring image information of the security inspection point area from the security inspection camera (4) of the security inspection point area;
a module for acquiring a package X-ray picture from an X-ray baggage inspection machine (3);
and carrying out packet association analysis on the image information of the security inspection point area and the package X-ray image to obtain the mutually associated package X-ray image and the image information of the security inspection point area, wherein the mutually associated package X-ray image and the image information of the security inspection point area form a current association image pair.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210746397.3A CN115171040B (en) | 2022-06-29 | 2022-06-29 | Method, device and system for pushing information based on security check information and face information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210746397.3A CN115171040B (en) | 2022-06-29 | 2022-06-29 | Method, device and system for pushing information based on security check information and face information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115171040A CN115171040A (en) | 2022-10-11 |
| CN115171040B true CN115171040B (en) | 2023-05-02 |
Family
ID=83488790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210746397.3A Active CN115171040B (en) | 2022-06-29 | 2022-06-29 | Method, device and system for pushing information based on security check information and face information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115171040B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115331346B (en) * | 2022-08-30 | 2024-02-13 | 深圳市巨龙创视科技有限公司 | Campus access control management method and device, electronic equipment and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111768536A (en) * | 2019-04-02 | 2020-10-13 | 杭州海康威视数字技术股份有限公司 | Luggage consignment system, luggage consignment management method and device |
| CN110749934A (en) * | 2019-10-15 | 2020-02-04 | 北京中盾安民分析技术有限公司 | Automatic matching remote centralized interpretation system and method for intelligent passage of travel inspection |
| CN111665572A (en) * | 2020-05-30 | 2020-09-15 | 中国船舶重工集团公司第七一三研究所 | Airport passenger security inspection intelligent auxiliary system and method based on X-ray machine image |
| CN212460651U (en) * | 2020-07-03 | 2021-02-02 | 湖南视觉伟业智能科技有限公司 | Advertising screen access control equipment based on face recognition |
| CN114187612B (en) * | 2021-12-09 | 2024-09-03 | 成都轨道交通集团有限公司 | Method and system for associating person bags |
-
2022
- 2022-06-29 CN CN202210746397.3A patent/CN115171040B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115171040A (en) | 2022-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202948697U (en) | Advertisement machine | |
| CN115171040B (en) | Method, device and system for pushing information based on security check information and face information | |
| CN105956960A (en) | College physical education equipment management system | |
| CN108734003A (en) | Auth method, device, equipment, storage medium and program | |
| CN108153881A (en) | Teaching monitoring and managing method based on Intelligent campus management | |
| US9607094B2 (en) | Information communication method and information communication apparatus | |
| US11397976B2 (en) | Durable memento method | |
| CN112911324B (en) | Content display method and device for live broadcast room, server and storage medium | |
| CN103455142A (en) | Image recognition real-time three-dimensional interaction device and image recognition real-time three-dimensional interaction method | |
| JP2002344946A (en) | Monitoring system | |
| Andrejevic et al. | “Smart” cameras and the operational enclosure | |
| WO2001095187A1 (en) | Portable browsing terminal ordering system | |
| KR100814510B1 (en) | Entrance and exit certifying system and method thereof | |
| CN207752530U (en) | A kind of meeting signature device | |
| Lei et al. | “I Shake The Package To Check If It’s Mine” A Study of Package Fetching Practices and Challenges of Blind and Low Vision People in China | |
| WO2015003287A1 (en) | Behavior recognition and tracking system and operation method therefor | |
| CN109947239A (en) | A kind of air imaging system and its implementation | |
| US20130124240A1 (en) | System and Method for Student Activity Gathering in a University | |
| CN206097251U (en) | Self -service visitor of law court machine | |
| CN113298590A (en) | Information viewing method and device | |
| CN208737584U (en) | A kind of unmanned retail robot | |
| TW200849143A (en) | Patrol tracking system utiliting RFID tag and fingerprint identing device | |
| Mishra et al. | Multimodal Biometric Attendance System | |
| CN111797133A (en) | Information issuing system based on intelligent perception technology | |
| CN208110672U (en) | Library borrowing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Method, device, and system for information push based on security information and facial information Granted publication date: 20230502 Pledgee: Chengdu Rural Commercial Bank Co.,Ltd. Qingyang Branch Pledgor: CHENGDU ZHIYUANHUI INFORMATION TECHNOLOGY CO.,LTD. Registration number: Y2024980023713 |