CN113486911A - Self-service verification passage control monitoring system and method based on face recognition - Google Patents
Self-service verification passage control monitoring system and method based on face recognition Download PDFInfo
- Publication number
- CN113486911A CN113486911A CN202010185040.3A CN202010185040A CN113486911A CN 113486911 A CN113486911 A CN 113486911A CN 202010185040 A CN202010185040 A CN 202010185040A CN 113486911 A CN113486911 A CN 113486911A
- Authority
- CN
- China
- Prior art keywords
- module
- verification
- face
- data
- ticket
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012795 verification Methods 0.000 title claims abstract description 220
- 238000012544 monitoring process Methods 0.000 title claims abstract description 55
- 238000000034 method Methods 0.000 title claims description 16
- 230000004044 response Effects 0.000 claims description 26
- 238000004891 communication Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 10
- 230000008859 change Effects 0.000 description 5
- 238000013524 data verification Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000001680 brushing effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07B—TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
- G07B11/00—Apparatus for validating or cancelling issued tickets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Devices For Checking Fares Or Tickets At Control Points (AREA)
Abstract
A self-service verification traffic control monitoring system based on face recognition comprises a self-service verification gate machine system, a background data server and a real-time front-end monitoring system, wherein the self-service verification gate machine system comprises a gate machine, a gate control module, a camera module, a face verification module, an identity card module, a two-dimensional code module, a main control module and a voice module; the background data server comprises a network module and a database module; the implementation front-end monitoring system is used for displaying the passenger identity and the ticket verification information transmitted by the data server on a webpage in a dynamic refreshing display mode after receiving the passenger identity and the ticket verification information; and counting and managing the data in the form of interface call by accessing to the back end. The invention ensures the management efficiency and order safety of station personnel and improves the convenience of passenger travel.
Description
Technical Field
The application relates to the technical field of automatic control, in particular to a self-service verification passage control monitoring system and method based on face recognition.
Background
In recent years, with the development of internet technology and biometric technology, the innovation of automatic ticket selling and checking systems has entered a new stage. The increase of hub stations of road traffic in the future and the increase of passenger flow are accompanied by the improvement of personnel cost and high error of personnel identification, so that the passenger travel experience needs to be optimized, and the management efficiency and the service quality of a long-distance bus are improved.
The application field of the biological recognition technology represented by the human face recognition is more and more extensive, the biological recognition technology utilizes the inherent physiological characteristics of the human body to identify the personal identity, and the technology is combined with the modern computer technology, so that the automatic management is easily realized by matching with a computer, a monitoring and management system.
In intelligent transportation, the management of the long-distance passenger transport industry is behind compared with the management of the railway industry, the technology of assisting ticket checking and identifying the identity of personnel also stays in, and the technology also comes from the lack of a uniform verification system in all regions of the country.
Disclosure of Invention
In order to overcome the defects of the prior art, the application provides a self-service verification pass control monitoring system and method based on face recognition, the unification of testimony of a witness can be verified based on passenger face image information and identity card data, the authenticity of ticket buying certificates is verified, meanwhile, a station management party monitors the condition of personnel passing position information of the whole station in real time, the personnel management efficiency and the order safety of the station are guaranteed, and the convenience of passenger traveling is improved.
In order to solve the technical problems, the invention provides the following technical scheme:
a self-service verification traffic control monitoring system based on face recognition comprises a self-service verification gate machine system, a background data server and a real-time front-end monitoring system, wherein the self-service verification gate machine system comprises a gate machine, a gate control module, a camera module, a face verification module, an identity card module, a two-dimensional code module, a main control module and a voice module; the background data server comprises a network module and a database module; the implementation front-end monitoring system is used for displaying the passenger identity and the ticket verification information transmitted by the data server on a webpage in a dynamic refreshing display mode after receiving the passenger identity and the ticket verification information; and counting and managing the data in the form of interface call by accessing to the back end.
Further, in the self-service check gate system, the camera module is used for shooting a video image of an identifiable area which can be captured by the gate;
the human face checking module is used for detecting the human face in real time in a video image shot by the camera module in the standby state of the gate system and performing dynamic human face frame selection on the human face; in the second aspect, three images with effective face frames are captured after receiving a capturing instruction of the main control module; thirdly, performing face similarity verification on the captured effectively recognized face image and face head portrait data in the identity card chip transmitted by the main control module;
the identity card module is used for acquiring the identity card and the face image data in the chip when the passenger places the identity card and transmitting the data to the main control module;
the two-dimension code module is used for acquiring the two-dimension code data of the physical ticket and the electronic ticket and transmitting the two-dimension code data to the main control module;
the main control module is used for sending a command to the face verification module to snapshot an effective face detected by a video image shot by a camera after acquiring the identity data transmitted by the identity card module and the information of the two-dimensional code data transmitted by the two-dimensional code module, and if an effective face picture is not acquired within the set effective waiting time of the system, the system judges that the verification is failed and prompts a passenger to re-verify; otherwise, the face verification module acquires an effective face image within effective waiting time, and the face verification module performs similarity verification on the chip photo acquired by the identity card module and the face image; after the similarity of the face verification module is judged through a set similarity threshold value, the main control module transmits the identity data and the ticket order data to the background data server; after receiving the ticket service verification result returned by the background server, sending a control signal to the gate control module;
and the gate control module is used for driving the gate switch after receiving the control signal.
Furthermore, in the background data server, on one hand, the network module is configured to receive the identity and the ticket data sent by the self-service check gate system, store the identity and the ticket data in the database module, and forward the ticket data to the ticket server; returning a ticket verification result to the check gate system after the verification result of the ticket service server is obtained; finally, the passenger identity, the ticket data and the verification result are actively pushed to the real-time front-end monitoring together, and on the other hand, the passenger identity, the ticket data and the verification result are used for making data response to the established interface request sent by the real-time front-end monitoring; the database module is used for storing the passenger identity data information sent by the self-service check gate system;
furthermore, the self-service check gate system also comprises a display module, wherein the display module is used for displaying a system display interface and is connected with the main control module; in the main control module, when the identity data is not acquired, the display module is controlled to prompt a passenger to provide certificate data and prompt the passenger to face the direction of the camera; after the main control module acquires the identity data, when the face verification module does not detect a face, the main control module controls the display module to prompt a passenger to face the direction of the camera, and within the effective waiting verification time set by the system, the main control module detects an effective face image and carries out snapshot verification; and the display module displays the authentication result to the passenger after obtaining the verification result of the background server.
The self-service check gate system also comprises a loudspeaker module, and the voice module is connected with the loudspeaker module; the voice module is used for receiving the identity data or the ticket data when the main control module receives the identity data or the ticket data, the face verification module does not acquire an effective face image, the main control module controls the voice module to prompt a passenger to face the camera so as to take a snapshot, and the voice module directly drives the loudspeaker module to play specific voice prompt information after receiving a voice command of the main control module.
The self-service check gate system also comprises a power supply module; the power supply module is respectively connected with any one of the system and the server and used for supplying power to other modules.
The face verification module detects a face in the video image, automatically selects a face position in a red frame in the video if an effective face image is detected, displays the face position on a display, and automatically captures the face image in the red frame and stores the face image when the capturing condition is met in the passenger verification process.
Preferably, the communication among the self-service check gate system, the background data server and the real-time front-end monitoring system is accessed to a wired public transit network based on an HTTP protocol of a TCP/IP protocol.
A self-service verification passing control monitoring method based on face recognition comprises the following steps:
s101, a main control module of a gate waits for an identity card module and a two-dimensional code module to acquire identity card data and two-dimensional code data and controls to acquire video image information captured by a visual field of a camera module;
s102, the master control module acquires identity document data, and starts a timer to wait for the two-dimension code module to acquire ticket information; otherwise, acquiring the ticket information, starting a timer to wait for the identity card module to acquire the identity card data, wherein if the two-dimensional code timer is overtime and still does not acquire the ticket data, verifying the ticket data according to whether the identity card data can be passed or not, and if the identity card data cannot be passed as a ticket verification certificate, judging that the verification fails by the self-service check gate system; if the system is set to check the ticket information through the identity card data, the main control module controls the face check module to capture a current effective face frame image through a camera video image, and if the identity card timer is overtime, the main control module judges that the verification fails;
and S103, after the main control module acquires complete identity information and ticket information, informing the face verification module to carry out face detection on each frame of image of the video stream image, and starting a face image timer to wait for the face verification module to acquire a face snapshot image which is effectively recognized in the camera image. Here, if the main control module does not receive the information of the captured effective face image of the face verification module, a signal is sent to inform the voice module and the display module to cooperatively prompt the passenger to correct the head position so that the camera module can shoot a clear video stream with the face image. Meanwhile, if the effective face image is not captured within the overtime waiting time set by the face image timer, the main control module judges that the verification fails;
s104, the main control module transmits the image information of the identity chip to the face verification module; the face verification module compares the captured effective face image with the identity document chip photo in similarity and obtains the similarity. If the similarity does not reach the similarity threshold preset by the system, the face verification module conducts similarity verification on a plurality of face snapshot images captured simultaneously again, and if the similarity is not verified for more than three times, the face verification module informs the main control module that the face verification fails. After receiving the signal of the face verification failure, the main control module judges that the verification fails;
s105, the face verification module returns the dynamically captured face image and the identity document chip head portrait face verification result to the main control module: if the verification result fails, the main control module judges that the verification fails at this time according to the verification result; if the master control module acquires the result of successful verification of the personnel identity card, the identity data and the ticket data are transmitted to a background data server through an HTTP network requests, the verification result of the ticket data is waited to be acquired, and response is waited;
s106, the background data server receives a ticket verification request of the self-service check gate system, the request data comprises each field of the identity document data and each field of the ticket data, and relevant management data are stored in a database according to a set interface so as to be convenient for later monitoring and inquiring a passage record through a front end; meanwhile, the data server forwards the ticket data to request the ticket server to verify the ticket purchasing voucher information through the HTTP interface request and waits for a response;
s107, the ticket server receives the ticket data requested by the background data server, checks the ticket data in real time, and returns a response of successful or failed response of the background data server;
and S108, the background data server returns the response result of the ticket server as the request response result of the main control module in the self-service check gate system. The main control module receives a ticket data verification result returned by the network module, and if the ticket data verification result fails, the main control module judges that the ticket verification fails and judges that the verification fails; if the verification result is successful, the main control module controls the display module to display the page passing the authentication, and simultaneously sends a control signal to the gate control module, and the gate control module drives the gate machine to open the gate;
s109, after the system is initialized, the front-end real-time monitoring system initiatively initiates a websocket request connection to a background data server and establishes a continuous connection; when the background data server receives the response result of the ticketing server, the passenger identity information, the ticketing data and the ticketing verification result are broadcast and pushed to all connected front-end real-time monitoring system clients through the websocket which establishes the long connection; and the front-end real-time monitoring system receives the data pushed by the background and displays the running state of each gate and the passing state of all passengers in real time in a webpage.
Compared with the prior art, the invention has the beneficial effects that: the problem of self-service verification of testimony of a witness uniformity is solved, the work management pressure of related enterprise and public institution personnel is relieved, and convenience and good interactive experience are brought to passengers. Based on the requirement of consistency of 'people, certificate and ticket', the real-name ticket checking efficiency can be improved, the railway and long-distance passenger traffic service is promoted to be developed in a mode of only 'face brushing', and the feasibility of the technical scheme provides technical support for implementing safety guarantee of full face brushing for arrival in the future of intelligent traffic and intelligent traffic.
Drawings
Fig. 1 is a schematic structural diagram of a self-service verification passage control monitoring system based on face recognition according to an embodiment of the present application;
FIG. 2 is a schematic structural diagram of a self-service check gate system according to an embodiment of the present disclosure;
fig. 3 is an overall schematic diagram of a self-service verification passage control monitoring system including a self-service verification gate system, a background data server and a front-end monitoring implementation provided in the embodiment of the present application;
fig. 4 is a schematic structural diagram of a self-service verification gate system based on face recognition in an application scenario provided in an embodiment of the present application;
fig. 5 is a flowchart of a self-service verification passage control monitoring method based on face recognition according to an embodiment of the present application.
Icon: 101. a gate machine; 102. a gate control module; 103. a camera module; 104 face verification modules, 108, voice modules, 109 and a display module; 107. a two-dimensional code module; 106. an identity card module; 105. a main control module; 110. a speaker module; 111. and a power supply module.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. The embodiments described herein are merely illustrative of implementations of design element concepts and the scope of the invention should not be considered limited to the specific forms set forth herein, but rather by the claims that follow the summary of the invention and equivalents thereof as may be realized by those skilled in the art based on the teachings herein.
Referring to fig. 1 to 5, a self-service verification traffic control and monitoring system based on face recognition guarantees the stable order and the promotion of real-time management efficiency of a passenger station of a moving bus or a passenger train by providing relevant certificates in front of a gate by a passenger and performing identity verification on face information of the passenger. The self-service check gate system in the system can be used in an off-line function, and can meet the basic check of personnel identity card information as a single closed-loop system so as to prevent lawless persons from confusing audio and video and avoid influencing order to cause safety problems under the condition of external public information network interruption.
As shown in fig. 1, the present application provides a self-service verification passage control monitoring system based on face recognition, which includes a self-service verification gate system 10, a background data server 20, a real-time front-end monitor 30 and a ticketing server 40; the self-service check gate system 10 includes: the gate 101, the gate control module 102, the camera module 103, the face verification module 104, the identity card module 106, the two-dimensional code module 107, the main control module 105 and the voice module 108:
the camera module 103 is used for shooting a video image of a recognizable area which can be captured by the gate;
the face verification module 104 is used for detecting a real-time face in a video image shot by the camera module 103 when the gate system is in a standby state and performing red frame selection in the video on the one hand; in the second aspect, after receiving the snapshot instruction of the main control module 105, three images with valid face frames are simultaneously snapshot from valid face images with red face frames in the video image stream transmitted by the camera module 103; in the third aspect, face similarity verification is performed on the captured effectively recognized face image and the face head portrait data in the identity card chip transmitted by the main control module 105.
The identity card module 106 is used for acquiring the identity card and the face image data in the chip when the passenger places the identity card and transmitting the data to the main control module 105;
the two-dimensional code module 107 is used for acquiring two-dimensional code data such as physical tickets, electronic tickets and the like and transmitting the two-dimensional code data to the main control module 105;
the voice module 108 is used for voice prompt of the gate in the user operation process;
the main control module 105 is configured to send an instruction to the face verification module 104 to capture an effective face detected by a video image captured by the camera 103 after acquiring information of the identity data transmitted by the identity card module 106 and the two-dimensional code data transmitted by the two-dimensional code module 107, and if an effective face image is not acquired within an effective waiting time set by the system, the system determines that the verification is failed at this time, and prompts a passenger to perform re-verification; otherwise, the face verification module 104 acquires an effective face image within an effective waiting time, and the face verification module 104 performs similarity verification on the identity card head portrait chip photo acquired by the identity card module 106 and the captured effective face image; after the similarity determination of the face verification module 104 is performed through a predetermined similarity threshold, the main control module 105 transmits the identity data and the ticket order data to the background data server 20; after receiving the ticket validation result returned by the background server 20, sending a control signal to the gate control module 102;
and the gate control module 102 is configured to drive the gate 101 to open and close after receiving the control signal.
The background data server 20 comprises a network module 202 and a database module 201; the network module 202 is configured to, on one hand, receive the identity and the ticket data sent by the self-service check gate system 10, store the identity and the ticket data in the database module 201, and forward the ticket data to the ticket server 40 at the same time; returning a ticket verification result to the check gate system 10 after the verification result of the ticket service server is obtained; finally, the passenger identity, the ticket data and the verification result are actively pushed to the real-time front-end monitor 30, and on the other hand, the passenger identity, the ticket data and the verification result are used for making a data response to a predetermined interface request sent by the real-time front-end monitor 30.
The front-end monitoring system 30 is configured to display the passenger identity and the ticket verification information transmitted by the data server 20 on a web page in a dynamic refresh display manner after receiving the passenger identity and ticket verification information; and counting and managing the data in the form of interface call by accessing to the back end.
In the embodiment of the present application, as shown in fig. 3, the self-service check gate system 10, the background data server 20, the real-time front-end monitor 30, and the ticket server 40 are connected to each other through the communication network 50 by using HTTP technology based on the TCP protocol to transmit data. After the self-service check gate system 10 successfully acquires the identity document data, the data including the chip photo, and the ticket order data, and successfully verifies the integration of the person and the certificate on the basis that the face check module 104 captures the effectively recognized frame-selected face image, the main control module 105 sends the acquired ticket and identity data to the background data server 20 in a requestBody format through an HTTP protocol via an interface requesting a verification result. After receiving the request, the background data server 20 verifies and sends a request command to the ticketing server 40 through the HTTP response request by using the network module 202, and simultaneously stores the identity data in the database 201, waits for the ticketing server 40 to return the ticketing verification result to the background data server 20, and simultaneously returns the verification result to the self-service check gate 10 in the form of a response, and meanwhile, pushes the identity information and the ticket checking result related to the passenger to each user logging in the online front-end monitoring system 30 by using the Websocket technology based on the HTTP protocol through the communication network 50.
The master control module 105 includes a number of functions: firstly, coordinating the normal operation of the whole work flow for the control and management functions of each module in the self-service check gate system 10; secondly, the main control module 105 sends a door opening and closing instruction to the gate control module 102 after receiving the pass verification signal returned by the background data server 20. The gate control module 102 is used for performing corresponding operations after receiving the control signal of the main control module 105, and controlling the gate 101 to open and prohibit from opening.
In this embodiment of the application, the self-service gate checking system 10 further includes a display module 109, configured to display real-time data such as identity data and authentication data pushed by the background data server, station-related device information, and pedestrian volume. When the main control module 105 does not acquire the identity card data signal of the identity card module 106, controlling the display module 109 to prompt the passenger to provide the identity card data and prompt the passenger to face the camera direction; after the main control module 105 acquires the identity data transmitted from the identity card module 106 and the face verification module 104 does not detect a face, the main control module 105 controls the display module 109 to prompt the passenger to face the camera, and within the effective waiting verification time set by the system, the passenger can not check the face image until the face verification module 104 detects an effective face image and takes a snapshot for verification; the display module 109 switches to display the authentication result after obtaining the verification result of the background server 20.
In this embodiment, the self-service check gate system 10 further includes a speaker module 110, the voice module 108 is connected to the speaker module 110, when the main control module 105 receives the identity data from the identity card module 106 or the ticket data from the two-dimensional code module 107, the face check module 104 returns that the main control module 105 does not capture the face information when not acquiring the valid face image within the valid waiting time, the main control module controls the voice module 108 to prompt the passenger to have his head facing the camera for capturing, and the voice module 108 drives the speaker module 110 to play the voice prompt information established by the system after receiving the voice command of the main control module 105; when the main control module receives the verification result from the background data server, the voice module 108 is controlled to prompt the voice prompt of successful completion of verification or failure of verification, the voice module 108 drives the loudspeaker module to play the sound file, and the sound file is defined by different situations preset and designated by the system.
In the embodiment of the present application, the self-service check gate system 10, the background data server 20, and the front-end real-time monitor 30 all include a power module 111 for supplying power to the system and ensuring basic operation.
In the embodiment of the present application, the video stream acquired by the camera module 103 can be displayed on the display module 109; meanwhile, the face verification module 104 identifies the video stream acquired by the camera module 103, identifies the face image in the effective distance in the image frame, and makes dynamic frame selection. At this time, the main control module 105 does not take a snapshot actively, and only when the main control module receives an effective data signal from the id card module 106 or the two-dimensional code module 107, sends a signal to control the face verification module 104; at this time, the face verification module 104 passively captures a face image detected in the video stream from the camera module 103; when the framed face image exists, capturing the image and storing three effective images; if the face verification module fails to capture the valid framing face image within the delay time, the main control module 105 is signaled that face information is not obtained, and after receiving the signal, the main control module 105 controls the voice module 108 to play voice to prompt a passenger to stop in an effective range or correct the standing posture and other error operations; in the process, the face verification module 104 obtains and completes verification of the identity card chip photo and the captured face image.
In the embodiment of the present application, the gate 101 includes a gate motor rotating device 1011 and a gate wing 1012; the gate motor rotating means 1011 is connected to the gate wing 1012 for opening or closing the passage, and is located at the middle of the gate 101 as two hardware parts connected.
The main control module 105 is further configured to control the display module 109 to display time and prompt a passenger to swipe an identity card and a ticket when the face verification module does not detect a face in a standby state; when the face is detected to appear in the video image, the main control module 105 controls the display 109 to display the currently captured face image and dynamically prompts red face framing lines; and under the condition that the face verification fails, controlling the display module 109 to prompt that the face verification fails; and after receiving the ticket authentication result responded from the background data server 20, controlling the display module 109 to switch from displaying the face image to displaying the authentication result.
Further, as shown in fig. 4, in the embodiment of the present application, a gate status display lamp 1013 is further installed, and when the self-service check gate system 10 is in standby operation, the gate status display lamp module displays a green arrow to indicate passable verification in the direction of the channel; when someone does not meet the passing condition of the verification system and forcibly enters the channel, the main control module 105 sends a signal to change the gate state display lamp 1013 to display red; meanwhile, the main control module 105 sends a signal to notify the voice module 108 of an alarm and voice prompt of a person running the gate;
further, in this embodiment of the application, the face verification module 104 detects whether a face exists in a frame image in a real-time video stream captured by the camera module 103, and needs to capture the face within an effective distance, generally presets a numerical threshold range meeting requirements, such as an inter-eye distance range and an eye distance and mouth distance, and extracts a feature value of the face image from the detected face in the video image frame, and determines a range in the middle of the captured face image according to the head image coordinates and the relative position of the image; meanwhile, when the face image in the image frame conforms to the reasonable eye distance range, the face verification module judges that the face image belongs to the personnel in the effective verification range in front of the equipment, at the moment, the snapshot action cannot be performed, and the face verification module 104 selects the effective face range along with the change of the video frame and dynamically changes along with the image change in the video for the personnel in the reasonable verification range. After the main control module 105 receives the identification card data and the ticket data, the face verification module 104 is controlled to capture the effective face image as a comparison object within a preset waiting time, so that the captured face image is ensured to belong to a correct face picture to be verified, and the situation that any person who is identified as a comparison person appears in front of the camera 104 is avoided, so that misjudgment is made, and the self-service verification efficiency is influenced.
In the embodiment of the application, the self-service check gate system 10 is developed based on the QT platform, is compiled by using the C + + language, develops a corresponding graphic user application program, combines a convenient GUI design interface, and utilizes a mechanism of a signal and a slot function to enable communication among all modules in the system to be very convenient, so that the interface class and the logic processing class are convenient to interact directly, and the program problem caused by calling of the conventional parent class subclass project can be avoided ingeniously.
In the embodiment of the application, the background data server 20 is directly connected with the self-service check gate system 10, and includes a network module 202 and a database module 201; the database module 201 stores the passenger identity data information sent by the self-service check gate system 10; the network module 202 forwards the relevant data of the ticket business sent by the self-service check gate system 10 to the ticket business server 40; and sending data to the self-service check gate system 10 after obtaining the verification result; meanwhile, the passenger identity data and the ticket authentication result are pushed to the real-time front-end monitor 30 in real time. The background data server 20 is developed by using an IDEA tool, takes springboot as a framework, combines a database access framework of myBatis, uses a lightweight database MySQL, and is integrated into a software serving as a data server to serve other systems.
In the embodiment of the application, the front-end monitoring 30 is directly connected with the background data server 20 and is not connected with the self-service check gate 10, the situation that dozens of gates exist possibly in an actual use scene, the data volume is very large, the data is uniformly controlled in one server and data, the control and the management are easier, the clearing and the auditing are convenient for the same party, the service pressure of the front-end connection background is reduced as much as possible, and the situation that the memory is insufficient at the front end is reduced.
In the embodiment of the application, the ticketing server 40 as third-party software can flexibly change the structure and the data verification rule according to the actual use scene, and the basic purpose is to decrypt the encrypted information for the third party, so that the technical confidentiality and the system security are ensured, and unnecessary troubles caused by bugs are avoided.
As shown in fig. 5, a self-service verification passage control monitoring method based on face recognition provided in the embodiments of the present application is introduced in combination with the above self-service verification passage control monitoring system based on face recognition, and is applied to a self-service verification gate system, a background data server, and a front-end real-time monitoring system, and the method includes the following steps:
s101, a main control module of the gate waits for the identity card module and the two-dimensional code module to acquire identity card data and two-dimensional code data, and controls to acquire video image information captured by a visual field of the camera module.
S102, the master control module acquires identity document data, and starts a timer to wait for the two-dimension code module to acquire ticket information; otherwise, acquiring the ticket information, starting a timer to wait for the identity card module to acquire the identity card data. If the two-dimensional code timer is overtime and ticket data are not acquired, whether the ticket data can be verified through identity document data or not is set, and if the identity document data cannot be passed as a ticket verification certificate, the self-service check gate system judges that the verification fails; if the system setting can check the ticket information through the identity document data, the main control module controls the face checking module to capture the current effective face frame image through the camera video image. Here, it is sometimes sent that if the id card timer times out, the main control module determines that the authentication has failed this time.
And S103, after the main control module acquires complete identity information and ticket information, informing the face verification module to carry out face detection on each frame of image of the video stream image, and starting a face image timer to wait for the face verification module to acquire a face snapshot image which is effectively recognized in the camera image. Here, if the main control module does not receive the information of the captured effective face image of the face verification module, a signal is sent to inform the voice module and the display module to cooperatively prompt the passenger to correct the head position so that the camera module can shoot a clear video stream with the face image. Meanwhile, if the capturing of the effective face image is not finished within the overtime waiting time set by the face image timer, the main control module judges that the verification fails.
S104, the main control module transmits the image information of the identity chip to the face verification module; the face verification module compares the captured effective face image with the identity document chip photo in similarity and obtains the similarity. If the similarity does not reach the similarity threshold preset by the system, the face verification module conducts similarity verification on a plurality of face snapshot images captured simultaneously again, and if the similarity is not verified for more than three times, the face verification module informs the main control module that the face verification fails. And after receiving the signal of the face verification failure, the main control module judges that the verification fails.
S105, the face verification module returns the dynamically captured face image and the identity document chip head portrait face verification result to the main control module: if the verification result fails, the main control module judges that the verification fails at this time according to the verification result; and if the master control module acquires the result of successful verification of the personnel identity card, transmitting the identity data and the ticket data to a background data server through an HTTP network requests, waiting for acquiring the verification result of the ticket data, and waiting for response.
S106, the background data server receives a ticket verification request of the self-service check gate system, the request data comprises each field of the identity document data and each field of the ticket data, and relevant management data are stored in a database according to a set interface so as to be convenient for later monitoring and inquiring a passage record through a front end; meanwhile, the data server forwards the ticket data to request the ticket server to verify the ticket purchasing voucher information through the HTTP interface request and waits for a response;
and S107, the ticket server receives the ticket data requested by the background data server, checks the ticket data in real time, and returns a response of successful or failed response of the background data server.
And S108, the background data server returns the response result of the ticket server as the request response result of the main control module in the self-service check gate system. The main control module receives a ticket data verification result returned by the network module, and if the ticket data verification result fails, the main control module judges that the ticket verification fails and judges that the verification fails; if the verification result is successful, the main control module controls the display module to display the page passing the authentication, and simultaneously sends a control signal to the gate control module, and the gate control module drives the gate machine to open the gate.
S109, after the system is initialized, the front-end real-time monitoring system initiatively initiates a websocket request connection to a background data server and establishes a continuous connection; when the background data server receives the response result of the ticketing server, the passenger identity information, the ticketing data and the ticketing verification result are broadcast and pushed to all connected front-end real-time monitoring system clients through the websocket which establishes the long connection; and the front-end real-time monitoring system receives the data pushed by the background and displays the running state of each gate and the passing state of all passengers in real time in a webpage.
Compared with the prior art, the self-service verification passing control monitoring system and method based on face recognition can improve real-name ticket verification and ticket checking efficiency based on the requirement of consistency of 'people, certificates and tickets', solves the problem of self-service verification of the consistency of the certificates and the tickets, improves the real-time performance of corresponding passengers of a gate, integrates a manageable real-time monitoring front end, relieves the work management pressure of related enterprise and public institution personnel, and brings convenience and good interactive experience for the passengers.
The above-mentioned embodiments are merely specific embodiments of the present application, which are used for illustrating the technical solutions of the present application and not for limiting the same, and the protection scope of the present application is not limited thereto, although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or change the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the techniques within the technical scope disclosed in the present application; such modifications, changes and substitutions do not depart from the spirit and scope of the present application. Are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (9)
1. A self-service verification traffic control monitoring system based on face recognition is characterized by comprising a self-service verification gate machine system, a background data server and a real-time front-end monitoring system, wherein the self-service verification gate machine system comprises a gate machine, a gate control module, a camera module, a face verification module, an identity card module, a two-dimensional code module, a main control module and a voice module; the background data server comprises a network module and a database module; the implementation front-end monitoring system is used for displaying the passenger identity and the ticket verification information transmitted by the data server on a webpage in a dynamic refreshing display mode after receiving the passenger identity and the ticket verification information; and counting and managing the data in the form of interface call by accessing to the back end.
2. The self-service verification traffic control and monitoring system based on face recognition as claimed in claim 1, wherein in the self-service verification gate system, the camera module is used for shooting a video image of a recognizable area which can be captured by the gate;
the human face checking module is used for detecting the human face in real time in a video image shot by the camera module in the standby state of the gate system and performing dynamic human face frame selection on the human face; in the second aspect, three images with effective face frames are captured after receiving a capturing instruction of the main control module; thirdly, performing face similarity verification on the captured effectively recognized face image and face head portrait data in the identity card chip transmitted by the main control module;
the identity card module is used for acquiring the identity card and the face image data in the chip when the passenger places the identity card and transmitting the data to the main control module;
the two-dimension code module is used for acquiring the two-dimension code data of the physical ticket and the electronic ticket and transmitting the two-dimension code data to the main control module;
the main control module is used for sending a command to the face verification module to snapshot an effective face detected by a video image shot by a camera after acquiring the identity data transmitted by the identity card module and the information of the two-dimensional code data transmitted by the two-dimensional code module, and if an effective face picture is not acquired within the set effective waiting time of the system, the system judges that the verification is failed and prompts a passenger to re-verify; otherwise, the face verification module acquires an effective face image within effective waiting time, and the face verification module performs similarity verification on the chip photo acquired by the identity card module and the face image; after the similarity of the face verification module is judged through a set similarity threshold value, the main control module transmits the identity data and the ticket order data to the background data server; after receiving the ticket service verification result returned by the background server, sending a control signal to the gate control module;
and the gate control module is used for driving the gate switch after receiving the control signal.
3. The self-service verification passage control monitoring system based on face recognition as claimed in claim 1 or 2, wherein in the background data server, on one hand, the network module is configured to receive the identity and ticket data sent by the self-service verification gate system and store the identity and ticket data in the database module, and at the same time, forward the ticket data to the ticket server; returning a ticket verification result to the check gate system after the verification result of the ticket service server is obtained; finally, the passenger identity, the ticket data and the verification result are actively pushed to the real-time front-end monitoring together, and on the other hand, the passenger identity, the ticket data and the verification result are used for making data response to the established interface request sent by the real-time front-end monitoring; and the database module is used for storing the passenger identity data information sent by the self-service check gate system.
4. The self-service verification passing control and monitoring system based on the face recognition as claimed in claim 1 or 2, wherein the self-service verification gate system further comprises a display module, the display module is used for displaying a system display interface and is connected with the main control module; in the main control module, when the identity data is not acquired, the display module is controlled to prompt a passenger to provide certificate data and prompt the passenger to face the direction of the camera; after the main control module acquires the identity data, when the face verification module does not detect a face, the main control module controls the display module to prompt a passenger to face the direction of the camera, and within the effective waiting verification time set by the system, the main control module detects an effective face image and carries out snapshot verification; and the display module displays the authentication result to the passenger after obtaining the verification result of the background server.
5. The self-service verification passing control monitoring system based on the face recognition as claimed in claim 1 or 2, wherein the self-service verification gate system further comprises a speaker module, and the voice module is connected with the speaker module; the voice module is used for receiving the identity data or the ticket data when the main control module receives the identity data or the ticket data, the face verification module does not acquire an effective face image, the main control module controls the voice module to prompt a passenger to face the camera so as to take a snapshot, and the voice module directly drives the loudspeaker module to play specific voice prompt information after receiving a voice command of the main control module.
6. The self-service verification passing control and monitoring system based on the face recognition as claimed in claim 1 or 2, wherein the self-service verification gate system further comprises a power supply module; the power supply module is respectively connected with any one of the system and the server and used for supplying power to other modules.
7. The self-service verification passing control monitoring system based on the face recognition as claimed in claim 1 or 2, wherein the face verification module detects a face in the video image, if a valid face image is detected, the face position is automatically selected by red frame in the video, the face position is displayed on a display, and when the passenger verification process meets the snapshot condition, the face image is automatically snapshot and stored.
8. The self-service verification passage control and monitoring system based on the face recognition as claimed in claim 1 or 2, wherein the communication among the self-service verification gate system, the background data server and the real-time front-end monitoring system is accessed to a wired public passage network based on an HTTP protocol of a TCP/IP protocol.
9. The method for implementing the self-service verification passage control monitoring system based on the face recognition according to claim 1, wherein the method comprises the following steps:
s101, a main control module of a gate waits for an identity card module and a two-dimensional code module to acquire identity card data and two-dimensional code data and controls to acquire video image information captured by a visual field of a camera module;
s102, the master control module acquires identity document data, and starts a timer to wait for the two-dimension code module to acquire ticket information; otherwise, acquiring the ticket information, starting a timer to wait for the identity card module to acquire the identity card data, wherein if the two-dimensional code timer is overtime and still does not acquire the ticket data, verifying the ticket data according to whether the identity card data can be passed or not, and if the identity card data cannot be passed as a ticket verification certificate, judging that the verification fails by the self-service check gate system; if the system is set to check the ticket information through the identity card data, the main control module controls the face check module to capture a current effective face frame image through a camera video image, and if the identity card timer is overtime, the main control module judges that the verification fails;
s103, after the main control module acquires complete identity information and ticket information, the main control module informs the face verification module to perform face detection on each frame of image of a video stream image, and starts a face image timer to wait for the face verification module to acquire a face snapshot image which is effectively recognized in a camera image, wherein if the main control module does not receive effective face image information captured by the face verification module, a signal is sent to inform the voice module and the display module to cooperatively prompt a passenger to correct the head position so that the camera module can shoot a clear video stream with the face image, and meanwhile, if the main control module does not finish capturing the effective face image within the overtime waiting time set by the face image timer, the main control module judges that the verification fails;
s104, the main control module transmits the image information of the identity chip to the face verification module; the face verification module compares the captured effective face image with the identity document chip photo in similarity, and obtains the similarity, wherein if the similarity does not reach a similarity threshold preset by a system, the face verification module conducts similarity verification on a plurality of face snapshot images captured simultaneously, if the similarity is not verified for more than three times, the face verification module informs the main control module that the face verification fails, and after the main control module receives a signal of the face verification failure, the main control module judges that the verification fails;
s105, the face verification module returns the dynamically captured face image and the identity document chip head portrait face verification result to the main control module: if the verification result fails, the main control module judges that the verification fails at this time according to the verification result; if the master control module acquires the result of successful verification of the personnel identity card, the identity data and the ticket data are transmitted to a background data server through an HTTP network requests, the verification result of the ticket data is waited to be acquired, and response is waited;
s106, the background data server receives a ticket verification request of the self-service check gate system, the request data comprises each field of the identity document data and each field of the ticket data, and relevant management data are stored in a database according to a set interface so as to be convenient for later monitoring and inquiring a passage record through a front end; meanwhile, the data server forwards the ticket data to request the ticket server to verify the ticket purchasing voucher information through the HTTP interface request and waits for a response;
s107, the ticket server receives the ticket data requested by the background data server, checks the ticket data in real time, and returns a response of successful or failed response of the background data server;
s108, the background data server returns the response result of the ticket server as the request response result of the main control module in the self-service check gate system, the main control module receives the ticket data check result returned by the network module, and if the ticket data check result fails, the main control module judges that the ticket verification fails and judges that the verification fails; if the verification result is successful, the main control module controls the display module to display the page passing the authentication, and simultaneously sends a control signal to the gate control module, and the gate control module drives the gate machine to open the gate;
s109, after the system is initialized, the front-end real-time monitoring system initiatively initiates a websocket request connection to a background data server and establishes a continuous connection; when the background data server receives the response result of the ticketing server, the passenger identity information, the ticketing data and the ticketing verification result are broadcast and pushed to all connected front-end real-time monitoring system clients through the websocket which establishes the long connection; and the front-end real-time monitoring system receives the data pushed by the background and displays the running state of each gate and the passing state of all passengers in real time in a webpage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010185040.3A CN113486911A (en) | 2020-03-17 | 2020-03-17 | Self-service verification passage control monitoring system and method based on face recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010185040.3A CN113486911A (en) | 2020-03-17 | 2020-03-17 | Self-service verification passage control monitoring system and method based on face recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113486911A true CN113486911A (en) | 2021-10-08 |
Family
ID=77932561
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010185040.3A Pending CN113486911A (en) | 2020-03-17 | 2020-03-17 | Self-service verification passage control monitoring system and method based on face recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113486911A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113988827A (en) * | 2021-10-29 | 2022-01-28 | 成都智元汇信息技术股份有限公司 | Information interaction method, device and system of face recognition terminal and gate |
| CN117854191A (en) * | 2024-01-10 | 2024-04-09 | 北京中航智信建设工程有限公司 | Airport isolation remote self-help checking system and method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109035426A (en) * | 2018-08-16 | 2018-12-18 | 安徽超清科技股份有限公司 | Real name ticketing and ticket-checking system based on recognition of face |
| CN109410347A (en) * | 2018-10-18 | 2019-03-01 | 深圳晟道科技有限公司 | A kind of high-speed rail gate passing method and system |
| CN109448139A (en) * | 2018-10-18 | 2019-03-08 | 深圳晟道科技有限公司 | A kind of gate passing method and system |
-
2020
- 2020-03-17 CN CN202010185040.3A patent/CN113486911A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109035426A (en) * | 2018-08-16 | 2018-12-18 | 安徽超清科技股份有限公司 | Real name ticketing and ticket-checking system based on recognition of face |
| CN109410347A (en) * | 2018-10-18 | 2019-03-01 | 深圳晟道科技有限公司 | A kind of high-speed rail gate passing method and system |
| CN109448139A (en) * | 2018-10-18 | 2019-03-08 | 深圳晟道科技有限公司 | A kind of gate passing method and system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113988827A (en) * | 2021-10-29 | 2022-01-28 | 成都智元汇信息技术股份有限公司 | Information interaction method, device and system of face recognition terminal and gate |
| CN117854191A (en) * | 2024-01-10 | 2024-04-09 | 北京中航智信建设工程有限公司 | Airport isolation remote self-help checking system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12073654B1 (en) | Method for identifying a user entering an autonomous vehicle | |
| CN110213522B (en) | Video data processing method and device and related equipment | |
| US8264520B2 (en) | Communication system, connection controller, terminal, and control method | |
| CN110096974A (en) | A kind of sight spot tourist based on recognition of face enters the method and system of garden veritification | |
| US11074327B2 (en) | Methods and systems for ensuring that an individual is authorized to conduct an activity | |
| CN109509131A (en) | Wisdom certificates handling convenience service method, apparatus, system, certificates handling terminal and medium | |
| CN108122314A (en) | A kind of doorbell call processing method, Cloud Server, medium and system | |
| CN105913358A (en) | Self-service service system for basic service of public security organization | |
| CN113486911A (en) | Self-service verification passage control monitoring system and method based on face recognition | |
| CN108280919B (en) | Quick pass gate for verifying personnel and control method thereof | |
| CN112991604A (en) | Health information-based access control management system and method | |
| CN109194906B (en) | Video conference authentication system, method, device and storage medium | |
| CN106845368A (en) | Airport boarding safety check based on recognition of face confirms system and method again | |
| JP2012086348A (en) | Autonomous mobile service providing system | |
| CN110210935B (en) | Security authentication method and device, storage medium and electronic device | |
| CN107426499A (en) | Unattended gate inhibition's guest system and access control method | |
| CN110675537A (en) | Method and system for access control management of restricted area | |
| KR20200092608A (en) | Entrance certification system of Common porch and undergound parking lot and entrance certification method using the same | |
| KR101515943B1 (en) | System Managing going to School Using Mobile Device Management and Method thereof | |
| CN110349310B (en) | Customized reminding cloud platform service system for park enterprises | |
| CN108182419A (en) | Vehicle-mounted recognition of face terminal, system, method, apparatus and storage medium | |
| CN107093236A (en) | A kind of double access control systems recognized based on fuzzy video | |
| JP5957130B2 (en) | Parking lot management system | |
| KR20220067918A (en) | Apparatus and Method for Face Authentication using Digital ID | |
| WO2018014346A1 (en) | Method and apparatus for visitor management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |