CN118097829A

CN118097829A - Multi-person drive-free self-service checking method and checking system

Info

Publication number: CN118097829A
Application number: CN202410517953.9A
Authority: CN
Inventors: 程连强; 赖时伍; 华振胜; 陈崇楷; 陈蓉; 欧邯; 范福川
Original assignee: Maxvision Technology Corp
Current assignee: Maxvision Technology Corp
Priority date: 2024-04-28
Filing date: 2024-04-28
Publication date: 2024-05-28

Abstract

The application discloses a multi-person get-off-free self-service checking method, which comprises the steps of planning a plurality of vehicle checking stations at each lane, arranging a certificate automatic checking device at each vehicle checking station, and ensuring orderly passing of vehicles in the checking process through arrangement of an entrance and an exit between the vehicle checking stations and the lanes; the method comprises the steps of identifying and checking passing vehicles through a first-level barrier gate, discharging the passing vehicles through the cooperation of three barrier gates, and carrying out certificate information identification, certificate labeling and certificate stamping checking on certificates of all passengers in vehicles parked at preset positions in a vehicle checking station through a certificate checking module in a certificate automatic checking device in an idle state distributed and guided by a background monitoring system, wherein the flat plate on the certificate automatic checking device of the vehicle checking station is used for acquiring passenger biological characteristic information so as to be compared with certificate passenger information acquired in a certificate information identification process. The application also provides a multi-person get-off-free self-service checking system.

Description

Multi-person drive-free self-service checking method and checking system

Technical Field

The application relates to the technical field of security inspection, in particular to a multi-person drive-free self-service inspection method and an inspection system.

Background

When the vehicles are inspected in a traffic way, the vehicles and all passengers on the vehicles need to be inspected in a related way, in general, a driver drives the vehicles to inspect the vehicles through inspection lanes, and usually only one inspection position is set on each lane of the traffic way, so that when a plurality of vehicles pass through the lane, the vehicles need to be queued one by one, and when the vehicles pass through more, the vehicle queuing time is overlong and the vehicle congestion phenomenon are easily caused in the inspection process, and the congestion time is easily increased. In addition, other passengers on the vehicle need to get off the vehicle to the checking hall to check related certificates, the passengers carry certificates to check the passenger information of the data pages of the certificates, paste certificate visa labels, seal related seals, collect fingerprint information of faces and other checking operations at different positions of the checking hall, so that the passengers need to check the passengers in a queuing way at different positions, the inconvenience of the passengers in passing the vehicle is easy to cause, and the phenomenon of missing a certain checking operation is likely to occur, and meanwhile, the inconvenience is brought to the passing checking by separating the checking modes of the passengers.

Disclosure of Invention

Aiming at the prior art, the technical problem solved by the application is to provide a multi-person get-off-free self-service checking method and a multi-person get-off-free self-service checking system which can realize one-lane multi-vehicle checking at the same time so as to accelerate the checking speed and reduce the congestion risk, and realize the simultaneous checking of vehicle certificates at one checking station so as to improve the checking convenience.

To solve the above technical problems, in a first aspect, the present application provides a multi-person drive-free self-service inspection system, which is communicatively connected to a background monitoring system and includes:

the first-stage barrier gate is arranged at the entrance of each lane and is used for identifying passing vehicles and releasing the successfully identified vehicles to enter the lane;

The vehicle inspection stations are arranged on the same side of each lane at intervals and are arranged in a queue, each vehicle inspection station is provided with a number, a station entrance and a station exit which are stored in a background monitoring system, the station entrance of one vehicle inspection station on each lane is communicated with the lane, and the station exit of the vehicle inspection station is communicated with the other lane on the right side of the traffic flow direction of the lane;

The automatic certificate checking device is connected with the background monitoring platform and comprises a shell, a certificate checking module, a flat plate and a control module, wherein the certificate checking module is connected with the shell and used for automatically turning pages, identifying certificate information, labeling certificates and stamping certificates;

The secondary barrier gate is arranged at the station outlet of each vehicle checking station and is used for controlling and releasing the checked vehicles of all the passenger certificates; and

And the three-stage barrier gate is arranged at the outlet of each lane and is used for identifying and releasing the inspected vehicle to pass through the lane.

Based on the first aspect, in one possible implementation manner, all vehicle inspection stations on a plurality of lanes are distributed in an array, and the certificate automatic inspection device further comprises a printer arranged on the shell and used for printing inspection certificates, and a sentry box positioned at an exit of each lane.

Based on the first aspect, in one possible implementation manner, the shell is provided with a checking port; the certificate checking module comprises a rack positioned in the shell, a mechanical arm group which is arranged on the rack and can stretch from the checking port, a bearing piece which is arranged on the rack in a sliding manner, a mechanical clamp which is arranged on the rack and is used for clamping certificates on the mechanical arm group onto the bearing piece one by one, a page turner, a certificate identifier, a labeling machine and a stamping machine, wherein the page turner, the certificate identifier, the labeling machine and the stamping machine are distributed along the movement track of the bearing piece; the mechanical arm group comprises a bottom frame seat, a telescopic arm which slides on the bottom frame seat in a telescopic manner, a certificate evidence collecting module used for sucking certificates on the telescopic arm, a first identification camera and a second identification camera which are positioned on two adjacent sides of the telescopic arm and used for collecting side views of sucked certificates, a first rotating module which is connected with the certificate evidence collecting module and used for adjusting the page opening side of the sucked certificates of the certificate evidence collecting module to a first preset direction, a conveying piece which is arranged up and down with the mechanical arm group, a third identification camera which is used for collecting the certificates and is arranged towards the conveying piece, and a second rotating module which is arranged on the mechanical arm group and used for adjusting the front sides of the certificates on the conveying piece to a second preset direction.

In a second aspect, the present application provides a multi-person get-off-free self-service inspection method of the multi-person get-off-free self-service inspection system, which includes:

Station binding: binding each vehicle checking station with the certificate automatic checking device belonging to the vehicle checking station, the lane to which the vehicle checking station belongs, the first-stage barrier gate at the entrance of the lane to which the vehicle checking station belongs, and the second-stage barrier gate at the station exit of the vehicle checking station, and storing the binding result in a background monitoring system;

First-level release of the vehicle: the first-stage barrier gate is controlled to identify the vehicle and pass the identification to enter the lane through the background monitoring system;

and (3) checking: matching and searching all the vehicle checking stations in the idle state in the lane through a background monitoring system, guiding the vehicle to drive into the vehicle checking station in any idle state by voice, updating the vehicle checking station in the idle state to be in a busy green state, and driving a certificate checking module of a certificate automatic checking device of the vehicle checking station to perform certificate information identification, certificate labeling and certificate checking operation on all the passenger certificates in the vehicle driven into the preset position; after the certificate checking operation, sequentially collecting biological characteristic information of all passengers by using a flat plate of the automatic certificate checking device, and verifying the biological characteristic information through a background monitoring system; marking the vehicle state after the inspection operation is inspected in the background monitoring system;

And (3) secondary release of the vehicle: the secondary barrier gate is controlled to be opened through the background monitoring system, vehicles are guided to leave the secondary barrier gate and enter another lane on the right side of the traffic flow direction of the lane, and the checking station state of the vehicles to which the secondary barrier gate belongs is changed into an idle state; and

Three-stage release of the vehicle: and controlling the opening of the three-level barrier gate through the background monitoring system to release the inspected vehicle to leave the lane.

Based on the second aspect, in one possible implementation manner, the certificate checking operation includes:

the mechanical arm group in the shell of the automatic certificate checking device is driven to extend towards the vehicle from a checking port on the shell, and the mechanical arm group in which all the certificates of passengers are placed in a stacked mode is driven to retract into the shell;

Driving a certificate collecting module to suck certificates on the mechanical arm group one by one; the method comprises the steps that based on a first side view acquired by a first identification camera, a second side view acquired by a second identification camera and an open page side of a document rotationally sucked up by a first rotation module, the open page side faces a first preset direction;

Uploading the certificate subjected to the first preset direction adjustment to a conveying piece, and adjusting the front surface of the certificate on the conveying piece to a second preset direction based on the top view obtained by the third identification camera and the second rotation module;

driving a mechanical clamp to clamp the certificate subjected to the second preset direction adjustment onto a support piece on the rack;

driving the bearing piece to move on the frame to carry out page turning, information identification, labeling and stamping certificate checking operations through a page turning machine, a certificate identifier, a labeling machine and a stamping machine on the frame;

and then driving the mechanical clamp to clamp the certificate subjected to the checking operation onto the mechanical arm group.

Based on the second aspect, in one possible implementation manner, rotating the open page side of the sucked certificate towards a first preset direction based on the first side view acquired by the first recognition camera, the second side view acquired by the second recognition camera and the first rotation module includes;

Step S321: judging which side view of the first side view and the second side view belongs to a side image F of a side connecting the page opening side and the hinge side of the certificate;

Step S322: and adjusting the page opening side of the certificate to a first preset direction through a first rotating module and a side recognition camera J for collecting the side image F, wherein the side recognition camera J can be a first recognition camera or a second recognition camera.

Based on the second aspect, in one possible implementation manner, determining which side view of the first side view and the second side view belongs to the side image F that connects the side of the document on the open page side and the hinge side includes:

Performing a straight line detection on the document area with respect to the first side view and the second side view;

acquiring a first contour formed by all straight lines intersecting in a first side view;

acquiring a second contour formed by all straight lines intersecting in the second side view;

If the first outline is in the shape of a fan-shaped opening, the first side view collected by the first recognition camera is a side image F of a side connecting the page opening side and the hinge side of the certificate;

if the first outline is in the shape of a fan-shaped opening, the second side view collected by the second recognition camera is a side image F of a side connecting the page opening side and the hinge side of the certificate.

Based on the second aspect, in one possible implementation manner, assuming that the open page side of the document faces the first recognition camera when the open page side of the document faces the first preset direction, the adjusting of the open page side of the document based on the first recognition camera and the first rotation module includes:

establishing a first right angle coordinate system: establishing a first right-angle coordinate system by taking an intersection point of a plurality of intersecting lines in the first side view as an origin, taking a line L contacted with the certificate when the certificate is sucked by the certificate collecting module as an X-axis and taking a straight line perpendicular to the line L as a Y-axis, wherein the positive direction of a transverse axis of the image coordinate system is taken as the positive direction of the X-axis, and the positive direction of a longitudinal axis of the image coordinate system is taken as the positive direction of the Y-axis;

When the sector cambered surface of the certificate is judged to be in a first quadrant in the first right-angle coordinate system, the first rotating module is utilized to drive the certificate evidence obtaining module to rotate 90 degrees along a first direction so that the page opening side faces the first identification camera;

And when the sector cambered surface of the certificate is judged to be in the second quadrant in the first right-angle coordinate system, the first rotating module is utilized to drive the certificate evidence obtaining module to rotate 90 degrees along the second direction.

Based on the second aspect, in one possible implementation manner, the adjusting of the page opening side orientation of the certificate based on the second identification camera and the first rotation module includes:

Establishing a second rectangular coordinate system: establishing a second rectangular coordinate system by taking the intersection point of a plurality of intersecting lines in the second side view as an origin, taking a line L contacted with the certificate when the certificate is sucked by the certificate collecting module as an X axis and taking a straight line perpendicular to the line L as a Y axis, wherein the positive direction of the transverse axis of the image coordinate system is taken as the positive direction of the X axis, and the positive direction of the longitudinal axis of the image coordinate system is taken as the positive direction of the Y axis;

when the sector cambered surface of the certificate is judged to be in a first quadrant in the second rectangular coordinate system, the first rotating module is utilized to drive the certificate evidence obtaining module to rotate 180 degrees along a first direction;

and when the sector cambered surface of the certificate is judged to be in the second quadrant in the second rectangular coordinate system, the first rotating module is utilized to drive the certificate evidence obtaining module to rotate for 0 degree.

Based on the second aspect, in one possible implementation manner, when the page turning, information identification, labeling and seal certificate checking operations are performed, the sensed piece on the supporting piece is sensed by the sensing piece on the rack so as to sense the sliding position of the supporting piece on the rack.

The multi-person get-off-free self-service checking method and the checking system provided by the application have the beneficial effects that: the functions of simultaneously checking a plurality of vehicles in one lane can be realized by planning a plurality of vehicle checking stations in each lane, arranging a certificate automatic checking device in each vehicle checking station, and ensuring orderly passing of the vehicles in the checking process through the position relation of the entrance and the exit between the vehicle checking stations and the lanes so as to reduce the congestion risk, thereby being beneficial to shortening the queuing time of the vehicles in the checking process and reducing the vehicle congestion risk; the method comprises the steps of identifying and checking passing vehicles through a first-level barrier gate, discharging the passing vehicles through the cooperation of three barrier gates, distributing certificate checking modules at a certificate checking station in an idle state of guide through a background monitoring system, performing certificate information identification, certificate labeling, certificate stamping and other checking operations on certificates of all passengers in the vehicle at a preset position in the vehicle checking station, and comparing on-site passenger biological characteristic information with certificate information acquired in a certificate information identification process through a flat plate of an automatic certificate checking device in the vehicle checking station so as to realize personnel verification. Therefore, the multi-person get-off-free self-service checking method and the checking system can realize the checking of the personal and vehicle certificates in the process that the vehicle runs in the lane, so that the inconvenience of customs clearance checking caused by a separate checking mode of the personal and vehicle is effectively prevented.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic layout diagram of a multi-person drive-free self-service inspection system in a clearance lane according to an embodiment of the present application.

Fig. 2 is a perspective view of an automatic certificate checking device at a vehicle checking station of the multi-person drive-free self-service checking system according to an embodiment of the present application.

Fig. 3 is a perspective view of a document inspection module of the automatic document inspection device according to an embodiment of the present application.

Fig. 4 is a perspective view of a document inspection module of the automatic document inspection device according to an embodiment of the present application.

Fig. 5 is a flowchart of steps of a multi-person drive-in-free self-service inspection method according to an embodiment of the present application.

FIG. 6 is a block diagram of a mechanical gripper of a credential verification module in accordance with an embodiment of the present application.

Fig. 7 is a block diagram of a first recognition camera, a second recognition camera, a third recognition camera, a transmission member, and a first rotation module of a mechanical arm group of a certificate checking module according to an embodiment of the present application.

Fig. 8 is a block diagram of a certificate collecting module and a second rotating module of a mechanical arm group of a certificate checking module according to an embodiment of the present application.

FIG. 9 is a flowchart illustrating steps performed by the credential verification module based on the credential verification operation in accordance with an embodiment of the present application.

Fig. 10 is a schematic side view of a certificate sucked by a evidence sucking disc and a schematic certificate in an open state according to an embodiment of the present application.

FIG. 11 is a side view of a document in an open position in an image coordinate system and a first rectangular coordinate system in accordance with an embodiment of the present application.

Detailed Description

In order to make the technical problems, technical schemes and beneficial effects to be solved more clear, the application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.

It will be understood that when an element is referred to as being "mounted" or "disposed" on another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element.

It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are merely for convenience in describing and simplifying the description based on the orientation or positional relationship shown in the drawings, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus are not to be construed as limiting the application.

Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.

The multi-person drive-free self-service checking method and the checking system of the application are specifically described with reference to the accompanying drawings.

Referring to fig. 1 to 4 in combination, a multi-person get-off-free self-service inspection system 100 provided by the embodiment of the application is connected with a background monitoring system and includes a first-stage barrier gate 10 disposed at an entrance of each lane, a plurality of vehicle inspection stations 20 disposed at the same side of each lane at intervals and arranged in a queue, a plurality of certificate automatic inspection devices 30 disposed in one-to-one correspondence with the plurality of vehicle inspection stations 20, a second-stage barrier gate 70 disposed in one-to-one correspondence with the plurality of vehicle inspection stations 20, and a third-stage barrier gate 80 disposed at an exit of each lane.

The first-stage barrier gate 10 at the entrance of each lane is used for identifying passing vehicles and releasing successfully identified vehicles to enter the lane. Each vehicle inspection station 20 has a number, station entry and station exit stored in the background monitoring system, the station entry of a vehicle inspection station 20 on each lane communicating with that lane and the station exit of that vehicle inspection station 20 communicating with another lane to the right of the lane traffic direction. Each certificate automatic checking device 30 is connected with the background monitoring platform and comprises a shell 40, a certificate checking module 50 and a flat plate 60 movably arranged on the shell 40 and used for acquiring biological characteristic information; the document inspection module 50 is connected to the housing 40 and is configured to perform an inspection operation for automatically turning pages of the document, identifying document information, labeling the document, and stamping the document. The secondary barrier 70 disposed at the station exit of each vehicle inspection station 20 is used to regulate and release all inspected vehicles for passenger certificates.

It should be noted that, as shown in fig. 1, a row of vehicle inspection stations 20 are provided on the right side of each lane in terms of the direction of traffic flow. In contrast, for each lane, the plurality of vehicle inspection stations 20 belonging to the lane are arranged in a row in an inclined manner, the station entrance of each vehicle inspection station 20 is connected to the lane, and the station exit of the vehicle inspection station 20 is connected to the other lane on the right side of the traffic direction of the lane, so that during the running process of the lane passing vehicle for inspection, the vehicle inspection station is: the vehicles go straight, turn right after, enter another lane on the right side, and finally exit in another lane, so that for a row of vehicle inspection stations 20 of each lane, the vehicles enter and exit from the left side and the right side, and orderly passing of a plurality of vehicles entering and exiting a plurality of vehicle inspection stations 20 on each lane can be ensured advantageously, and no disorder and congestion can be caused.

For the primary barrier 10, the secondary barrier 70 and the tertiary barrier 80, each barrier includes a camera in communication with the background monitoring system and a gate in communication with the background monitoring system. It can be understood that before the clearance, the clearance vehicle needs to be declared, that is, clearance vehicle information and driver information are filled in a system of a clearance unit to be declared in advance, the vehicle information includes but is not limited to information such as a vehicle license plate number, a vehicle type and the like, the driver information includes but is not limited to information such as a driver face, an identity card number and the like, and the declared information is stored in a background monitoring system. When a vehicle runs to the primary barrier gate 10, after the camera at the primary barrier gate 10 shoots license plate information of the identified clearance vehicle, the identification information is identified with the license plate number in the background monitoring system, and after the identification is successful, the background monitoring system controls the gate of the primary barrier gate 10 to be opened so as to release the vehicle into a lane.

In an embodiment of the application, referring to fig. 5, the method for self-service inspection of a multi-person drive-in-car is based on the above-mentioned self-service inspection system 100 of a multi-person drive-in-car, and the method includes the following steps S100 to S500.

Step S100: station binding: each vehicle checking station is bound with a certificate automatic checking device belonging to the vehicle checking station, a lane to which the vehicle checking station belongs, a primary barrier gate at the entrance of the lane to which the vehicle checking station belongs, and a secondary barrier gate at the station exit of the vehicle checking station, and the binding result is stored in a background monitoring system.

It should be noted that, the binding result may be stored in the background in the form of an array. The multiple lanes may be numbered, each vehicle inspection station 20 of each lane also has a unique number, each lane corresponds to a primary barrier gate 10 and a tertiary barrier gate 80, each vehicle inspection station 20 is correspondingly provided with a unique certificate automatic inspection device 30 and a secondary barrier gate 70, after the above step S100 station binding, the devices on one lane, each vehicle inspection station 20 on the lane, and the devices at the vehicle inspection station 20 are information-bound and stored in the background monitoring system, that is, the background monitoring system knows which primary barrier gate 10 of which lane enters the vehicle inspection station 20 as soon as which vehicle inspection station 20 is entered, and also knows which certificate automatic inspection device will be used for performing certificate inspection later, and also knows which secondary barrier gate 70 will be exited after the inspection is successful.

Step S200: first-level release of the vehicle: the first-level barrier gate 10 is controlled by the background monitoring system to identify the vehicle and release the successfully identified vehicle into the lane.

It is worth noting that license plate information of successfully identified vehicles is stored in a background monitoring system.

Step S300: and (3) checking: matching and searching all the vehicle checking stations in the idle state in the lane through a background monitoring system, guiding the vehicle to drive into the vehicle checking station in any idle state by voice, updating the vehicle checking station in the idle state to be in a busy green state, and driving a certificate checking module of a certificate automatic checking device of the vehicle checking station to perform certificate information identification, certificate labeling and certificate checking operation on all the passenger certificates in the vehicle driven into the preset position; after checking the certificates, sequentially collecting biological characteristic information of all passengers by using a flat plate of the automatic certificate checking device, and checking the biological characteristic information through a background monitoring system; the vehicle state marked as having completed the inspection operation in the background monitoring system is inspected.

It should be noted that, after the station binding in the step S100 is performed, and after the vehicle enters the lane through the first-stage barrier gate 10, the background monitoring system may learn which lane is about to enter, because the working state of the lane checking station of each lane is stored in the background monitoring system, all the vehicle checking stations 20 in the idle state in the lane are searched out through matching of the background monitoring system, a voice broadcasting device may be set at the first-stage barrier gate 10, after the matching search, the background monitoring system controls the voice broadcasting device to send "please enter the XX lane XX vehicle checking station 20", each lane checking station has a station number identifier, and the driver may enter the vehicle checking station 20 according to the voice prompt, so as to avoid the collision of the vehicle and the traffic jam in the lane, the working state of the vehicle checking station 20 that has been broadcasted for use should be modified from the idle state to the busy state.

It should be noted that the vehicle inspection station 20 defines a visible preset position, the multi-person drive-free self-service inspection system 100 further includes at least one sensor disposed at the preset position in each vehicle inspection station 20, the sensor is configured to detect whether a vehicle enters the preset position, and when the sensor senses that a vehicle enters the preset position, the background monitoring system starts to drive the document inspection module 50 of the document automatic inspection device 30 in the vehicle inspection station 20 to perform the document information recognition, the document labeling and the document inspection operation of the document stamping. After the certificate checking operation, the certificate checking module 50 has acquired information of all the passenger certificates of the vehicle, and the certificate label refers to label sticking, and the seal is a seal of a customs clearance unit related to the seal of the certificate.

For further verification of the person's credentials, it is necessary to compare the on-site passengers with the credentials identified in the credentials verification module 50 to verify that the credentials are in agreement, and the panel 60 of the automated credentials verification device 30 is used to sequentially collect the biometric information of all the passengers after the credentials verification operation as follows: sequentially voice broadcasting passenger names, such as broadcasting 'please XX collect face fingerprint information', according to the passenger sequence identified by the certificate identifier of the automatic certificate checking device 30 at the vehicle checking station 20 through a background monitoring system; sequentially acquiring passenger biological characteristic information according to the name of the passenger by using the flat plate 60; the biometric information collected by the tablet 60 is verified against the document information identified by the document identifier during the document verification process. Understandably, when the certificate information is identified, the name, identity information and hotel guest face information of the traveler in the certificate are identified, the identified certificate information is sequentially stored in a background monitoring system according to the identification sequence, the name of the traveler collecting the biological characteristic information can be sequentially broadcast in sequence according to the storage sequence, and the broadcast voice can be directly sent by the tablet 60 computer. The biometric information collected by the tablet 60 is compared with the biometric information identified by the credential verification module 50 and stored in the background monitoring system to complete the credential verification. After the verification of all the persons is completed, in order to ensure that the secondary barrier 70 is released whether the vehicle is a checked vehicle, the checked vehicle status should be marked in the background monitoring system, and the license plate information is identified in the primary barrier 10 in step S200, and the vehicle status information and the license plate information identified by the primary barrier 10 are stored in an array in a combined form.

Step S400: and (3) secondary release of the vehicle: the secondary barrier gate is controlled to be opened through the background monitoring system, the vehicles are guided to leave the secondary barrier gate and enter another lane on the right side of the traffic flow direction of the lane, and the checking station state of the vehicles to which the secondary barrier gate belongs is changed into an idle state.

As described above, since the checking state of the vehicle has been marked in the foregoing steps, the camera of the secondary barrier 70 recognizes the vehicle to determine whether the vehicle to be passed is checked, and releases the vehicle after the checking, and changes the state of the vehicle checking station 20 to the idle state after the vehicle exits the vehicle checking station 20 for the work deployment of the vehicle checking station 20.

Step S500: three-stage release of the vehicle: and controlling the opening of the three-level barrier gate through the background monitoring system to release the inspected vehicle to leave the lane.

Further, all of the vehicle inspection stations 20 on a plurality of said lanes are distributed in an array, and said automatic document inspection device 30 further comprises a printer mounted on the housing 40 for printing inspection receipt and a kiosk located at the exit of each of said lanes.

It should be noted that, after the checking step of the step S300 is performed, the certificate automatic checking device 30 prints the checked receipt through a printer, for example, the receipt is written with information indicating whether the check is successful, the number of people is checked, the vehicle information is checked, the passenger information is checked, and two-dimensional code information representing whether the check is successful, etc., and when the following vehicle arrives at the sentry box of the lane, the check receipt is checked by staff in the sentry box.

Further, the number of the certificate automatic checking devices 30 corresponding to one of the vehicle checking stations 20 is two, the two certificate automatic checking devices 30 are respectively arranged on two opposite sides of the vehicle entering the preset position of the vehicle checking station 20, and one of the two certificate automatic checking devices is opposite to the vehicle window of the driving position of the vehicle at the preset position; all of the vehicle inspection stations 20 of the plurality of lanes are distributed in an array.

Referring to fig. 2,3,4, 6 and 7 in combination, the housing 40 is provided with a checking opening 41. The certificate checking module 50 comprises a frame 51 positioned in the shell 40, a mechanical arm group 52 which is arranged on the frame 51 and can extend and retract from the self-checking port 41, a supporting piece 53 which is arranged on the frame 51 in a sliding manner, a mechanical clamp 54 which is arranged on the frame 51 and is used for clamping certificates on the mechanical arm group 52 onto the supporting piece 53 one by one, a page turner 55 which is distributed along the movement track of the supporting piece, a certificate identifier 56, a labeling machine 57 and a stamping machine 58. The mechanical arm set 52 includes a base frame 521, a telescopic arm 522 that slides telescopically on the base frame 521, a document forensic module 523 for sucking up a document on the telescopic arm 522, a first recognition camera 524 and a second recognition camera 525 that are located at two adjacent sides of the telescopic arm 522 and are used for collecting a side view of the sucked up document, a first rotation module 526 that is connected to the document forensic module and is used for adjusting an open page side of the sucked up document of the document forensic module to a first preset direction, a conveying member 527 that is disposed up and down with the mechanical arm set 52, a third recognition camera 528 that is disposed toward the conveying member 527 and a second rotation module 529 that is disposed on the mechanical arm set 52 and is used for adjusting a front side of the document on the conveying member 527 to a second preset direction.

It is understood that after the vehicle is parked at the preset position, the vehicle in the vehicle driving position may face the inspection port 41, and after the driver collects the certificates of all the personnel in the vehicle, the certificates are placed on the telescopic arm 522 in the closed state and in a vertically stacked manner, at this time, the background monitoring system may control the telescopic arm 522 to extend from the inspection port 41 towards the vehicle, and the telescopic arm 522 retracts into the housing 40 to perform the certificate inspection operation with the certificates. The telescopic arm 522 can be telescopic through a motor arranged on the bottom frame 521, and can be realized by adopting the driving principle of the existing motor, driving wheel and synchronous belt, which is not described herein. The support 53 can likewise be realized by means of the drive principle of the motor, drive wheel and timing belt.

It should be noted that, the page turner 55 is a device for turning pages of a certificate, for example, the page turner 55 may be, but not limited to, an automatic page turner 55 with publication number CN1562642a, the automatic page turner 55 may turn pages in both forward and reverse directions, the certificate identifier 56 may be an identifier for performing OCR character recognition and image recognition, the seal machine 58 is a device for automatically sealing a certificate, the seal machine 57 is a device for printing a label and the seal machine 57 is a device for printing a label, and the page turner 55, the certificate identifier 56, the seal machine 58 and the seal machine 57 may be any of the prior art devices, which are not described herein. The working devices such as the page turner 55, the certificate identifier 56, the seal machine 58, the labeler 57 and the like can be arranged on the sliding rod, and the devices can move relative to the conducted supporting member 53, so that each working device approaches to the certificate on the supporting member 53, and the supporting member 53 acts as a plate for placing the certificate of each working device. The labeling machine 57 is a device for printing labels, and in general, the labeling of visa labels is required, and the labeling machine 57 is a device for printing visa labels. The page turner 55, the labeler 57 and the stamping machine 58 can be provided with cameras, and the situation of page turner 55 turning can be identified by the cameras, whether page turner turns to a data page, page turner turns to a blank page and the blank stamping position can be identified.

As shown in fig. 7 and 8, the document forensic module 523 includes a first bracket 5231 slidably disposed on the bottom frame 521, a first connecting plate 5232 slidably disposed on the first bracket 5231, and at least one forensic suction cup 5233. The first rotation module 526 includes a first driving device 5261 disposed on the first connecting plate 5232 and a rotation plate 5262 connected to the first driving device 5261 and rotated by the first driving device 5261, and each forensic suction cup 5233 is disposed on the rotation plate 5262. The document forensics module 523 and the second rotation module 529 are disposed at opposite ends of the transport 527. Further, a synchronous belt capable of turnover is arranged in the telescopic arm 522, and the certificate placed on the telescopic arm 522 is positioned on the synchronous belt, and the synchronous belt transmits the certificate to the lower part of the certificate evidence obtaining module 523 of the bottom frame 521 so that the certificate is absorbed by the subsequent evidence obtaining sucker 5233; the first bracket 5231 is provided with a through hole penetrating through the first bracket 5231, the first recognition camera 524 is located at one side of the first bracket 5231 and faces to the through hole, and the first recognition camera 524 can collect images of the certificates sucked up by the evidence sucking disc 5233 through the through hole.

Wherein, the conveying member 527 is a synchronous belt capable of turning over, the first driving device 5261 may be a motor or an electric cylinder, and the first connecting plate 5232 drives the evidence collecting suction cups 5233 to suck up the certificates on the telescopic arms 522 one by one when moving downwards along the first bracket 5231 towards the telescopic arms 522. After the first recognition camera 524 and the second recognition camera 525 recognize the direction of the open page side of the certificate sucked up by the evidence sucking disc 5233, the first driving device 5261 drives the rotating plate 5262 to rotate so as to drive the evidence sucking disc 5233 to rotate, thereby driving the open page side of the certificate sucked up by the evidence sucking disc 5233 to a first preset direction; thereafter, the first support 5231 moves toward the conveying member 527 along the bottom frame 521, so that the document carried by the forensic suction cup 5233 and adjusted in the first preset direction moves above the conveying member 527, the first connecting plate 5232 slides on the first support 5231 to drive the forensic suction cup 5233 to move downward toward the conveying member 527, and finally the forensic suction cup 5233 releases the document onto the conveying member 527.

As further shown in fig. 7 and 8, the conveying member 527 includes two parallel conveying belts which are arranged at intervals and turn around synchronously, and the second rotating module 529 includes a second support 5291 on which the bottom frame 521 can slide back and forth, a second connecting plate 5292 on which the second support 5291 can slide up and down, a second driving device 5293 arranged on the second connecting plate 5292, a turntable 5294 connected with the second driving device 5293 and driven to rotate by the second driving device 5293, and a plurality of suction cups 5295 arranged on the turntable 5294. The turntable 5294 is movably disposed in the gap between the two conveyor belts. The second driving device 5293 may be a motor.

It should be noted that, since the document is disposed on two conveyor belts, when the turntable 5294 with the suction cup 5295 is disposed in a gap between the two conveyor belts, the rotating force of the turntable 5294 is in the middle of the document, so that the overturning can be better realized, and the document is conveyed by the conveying member 527, so that the space avoiding effect is realized, when the turntable 5294 does not rotate, the turntable 5294 is disposed between the two conveyor belts, so that the turntable 5294 does not block the conveying of the conveying member 527, and space is saved.

As can be appreciated, the third recognition camera 528 recognizes and captures images of the document, the document does not need to be turned over by the second rotation module 529 when recognized as positive, the document is sucked in the gap between the two conveyor belts by the suction cup 5295 when recognized as negative, and then turned over by the rotation of the turntable 5294 located in the gap between the two conveyor belts, so that the document faces upward. It should be noted that, the page opening sides and the document front sides of all documents adjusted by the first rotation module 526 and the second rotation module 529 are unified, so that the subsequent control flow of the subsequent document automatic checking process is simpler and unified. In order to keep the direction of the previously adjusted open side from being disturbed by the first rotation module 526, the rotation direction of the dial 5294 must be rotated from one side of the document to the other, which would otherwise cause: the front and back turning is completed, so that the direction of the page opening side which is adjusted is disturbed again.

As shown in fig. 6 to 8, the mechanical gripper 54 includes a suction rail 541 that spans the mechanical arm group 52, a rotation driving device 542 that is movable along the suction rail 541, a rotation arm 543 that is connected to the rotation driving device 542 and is driven to rotate by the rotation driving device 542, a pressing driving device 544 that is disposed on the rotation arm 543, and at least one material taking suction cup 545 that is connected to the pressing driving device 544. The pressing-down driving device 544 is configured to drive the material taking suction cup 545 to move up and down relative to the mechanical arm group 52. Wherein the rotary driving device 542 is a motor, and the pressing driving device 544 may be an electric cylinder.

Further, the bottom frame 521 of the robot arm assembly 52 may extend through the frame 51, and the support 53 may pass through two ends of the suction rail 541 during sliding along the frame 51, so that the material taking suction cups 545 sliding on the suction rail 541 along with the rotation driving device 542 may perform unloading of the documents sucked from the conveying member 527 onto the support 53 or retrieving of the documents on the support 53 onto the conveying member 527 at the two ends.

Further, a plurality of sensing elements are arranged on the frame 51 along the sliding path of the supporting element 53 at intervals, and the sensing elements sensed by the plurality of sensing elements are arranged on the supporting element 53, so that when each sensing element senses the sensing element of the sliding supporting element 53, the sliding specific position of the supporting element 53 can be known, and it can be understood that sensing elements are also arranged at the corresponding positions of the page turner 55, the certificate identifier 56, the labeling machine 57 and the stamping machine 58 on the frame 51, so that the position of the page turner 55, the certificate identifier 56, the labeling machine 57 and the stamping machine 58 can be known whether the supporting element 53 moves in place or not through the cooperation of the sensing elements and the sensing elements. In one embodiment, the sensing element is a two-dimensional code identifier, and the sensed element is a two-dimensional code; in another embodiment, the sensing element is a receiver of an correlation sensor and the sensed element is a transmitter of the correlation sensor.

In an embodiment of the application, referring to fig. 9, the certificate checking operation in step S300 is performed based on the certificate checking module, which includes:

Step S310: the mechanical arm group in the shell of the automatic certificate checking device is driven to extend towards the vehicle from a checking port on the shell, and the mechanical arm group in which all the certificates of passengers are placed in a stacked mode is driven to retract into the shell;

step S320: driving a certificate collecting module to suck certificates on the mechanical arm group one by one; the method comprises the steps that based on a first side view acquired by a first identification camera, a second side view acquired by a second identification camera and an opening side of a document rotationally sucked up by a first rotation module, the opening side faces a first preset direction;

Step S330: uploading the certificate subjected to the first preset direction adjustment to a conveying piece, and obtaining a top view based on a third recognition camera and adjusting the front surface of the certificate on the conveying piece to a second preset direction by a second rotation module;

Step S340: driving a mechanical clamp to clamp the certificate subjected to the second preset direction adjustment onto a support piece on the rack;

Step S350: driving the bearing piece to move on the frame to carry out page turning, information identification, labeling and stamping certificate checking operations through a page turning machine, a certificate identifier, a labeling machine and a stamping machine on the frame;

Step S360: and then driving the mechanical clamp to clamp the certificate subjected to the checking operation onto the mechanical arm group.

Because the certificate page turning operation is involved in the certificate checking process, the identification of the certificate information is usually carried out by turning pages from the front side to the back side of the certificate, visa labels are pasted on the blank pages of the certificate, and finally the certificate seal is carried out. In this way, in order to smoothly and automatically turn pages and save the page turning time, it is necessary to ensure that the open side and the front side of the document are uniformly oriented in a set direction before the pages are turned by the page turning machine 55. However, when the document is placed on the telescopic arm 522, the passenger may face up or face down when placing the document, and at the same time, the direction of the open page side may appear front and back or left and right, that is, when the passenger places the document, it is difficult to ensure that the directions of the faces are uniform, so in order to ensure the smooth proceeding of the subsequent document checking process, the directions of the front and the open page side of the document need to be adjusted.

Further, step S320 is as follows: the method comprises the steps of rotating an open page side of a sucked certificate towards a first preset direction based on a first side view acquired by a first identification camera, a second side view acquired by a second identification camera and a first rotating module, wherein the first preset direction comprises the following steps of;

It should be noted that, according to the present application, the direction of the open side is judged by the image recognition mode, the document is in a scattering state under the action of gravity while the document is sucked up by the document collecting module 523, the document is in a scattering state, the orientation of the open side is difficult to judge by the front image line of the open side, and the hinge side is also the same, so that the orientation of the open side can be judged by the document line of the side of the document only after the side of the open side and the hinge side are collected by the camera, then the situation of placing the document is difficult to be determined when the passenger document is placed, so that the first recognition camera 524 and the second recognition camera 525 are required to be configured on adjacent sides of the telescopic arm 522, namely, when the document is located on the telescopic arm 522, the two cameras can maintain such states: one of the cameras is located on the open side or hinge side of the document, and the other camera is located on one of the side edges of the document, so that there is always one camera capable of capturing a side image F of the side edge of the document.

Further, for step S321: determining which of the first side view and the second side view belongs to the side image F connecting the side of the document on the open side and the hinge side, comprising:

Step S3211: determining which of the first side view and the second side view belongs to the side image F connecting the side of the document on the open side and the hinge side, comprising:

step S3212: performing a straight line detection on the certificate area on the first side view and the second side view;

Step S3213: acquiring a first contour formed by all straight lines intersecting in a first side view;

Step S3214: acquiring a second contour formed by all straight lines intersecting in the second side view;

Step S3215: if the first outline is in the shape of a fan-shaped opening, the first side view collected by the first recognition camera is a side image F of a side connecting the page opening side and the hinge side of the certificate;

step S3216: if the first outline is in the shape of a fan-shaped opening, the second side view collected by the second recognition camera is a side image F of a side connecting the page opening side and the hinge side of the certificate.

Wherein the fan-shaped opening shape may be understood as resembling a mathematical less-than-symbol "<" or a mathematical greater-than-symbol ">" shape. The document area refers to four area images of the document open side, the document hinge side and the side edge connecting the open side and the hinge side in the open side scattering state of the document when the document is sucked by the suction cup, and can be detected by adopting a target detection model, for example, based on YOLOX learning network model, four area image data of the document open side, the document hinge side and the side edge connecting the open side and the hinge side in the open side scattering state of the document are collected, and the target detection model is obtained by training YOLOX the learning network model based on the image data.

In an embodiment of the present application, referring to fig. 7, 10 and 11 in combination, for step S322, assume that the open side of the document faces the first recognition camera when the open side of the document faces the first preset direction, and for the above document inspection module, the open side of the document faces the first recognition camera and the hinge side of the document faces the second rotation module; carry out the adjustment of certificate open page side orientation based on first discernment camera and first rotary module, include:

When the sector cambered surface of the certificate is judged to be in the first quadrant in the first right-angle coordinate system, the first rotating module 526 is utilized to drive the certificate evidence obtaining module 523 to rotate 90 degrees along the first direction so as to enable the page opening side to face the first identification camera 524;

When the sector cambered surface of the certificate is judged to be in the second quadrant in the first right-angle coordinate system, the first rotating module 526 is utilized to drive the certificate evidence obtaining module 523 to rotate 90 degrees along the second direction, and the page opening side faces the first identification camera 524.

In the above step, the first direction and the second direction are opposite to each other. The upper left corner of the image is an image coordinate system origin O, an intersection point of a plurality of intersecting lines is taken as the origin, a line L which is contacted with the certificate when the certificate is sucked by the suction piece is taken as a Y-axis, and a rectangular coordinate system is established; the origin of the rectangular coordinate system is O1. It will be appreciated that the sector curvature of the document side of the side image F will be in either the first quadrant or the second quadrant, depending on the location of the first recognition camera 524 on the document side and the first rectangular coordinate system described above.

In another embodiment of the application, for step S322, assuming that the open side of the document faces the first recognition camera when the open side of the document faces the first preset direction, adjusting the open side of the document based on the second recognition camera and the first rotation module includes:

Establishing a second rectangular coordinate system: establishing a second rectangular coordinate system by taking an intersection point of a plurality of intersecting lines in the second side view as an origin, taking a line L contacted with the certificate when the certificate is sucked by the certificate collecting module as an X axis and taking a straight line perpendicular to the line L as a Y axis, wherein the positive direction of a transverse axis of the image coordinate system is taken as the positive direction of the X axis, and the positive direction of a longitudinal axis of the image coordinate system is taken as the positive direction of the Y axis;

When the sector cambered surface of the certificate is judged to be in the first quadrant in the second rectangular coordinate system, the first rotating module is utilized to drive the certificate evidence obtaining module to rotate 180 degrees along the first direction, so that the page opening side faces the first identification camera;

When the sector cambered surface of the certificate is judged to be in the second quadrant in the second rectangular coordinate system, the first rotating module is utilized to drive the certificate evidence collecting module to rotate for 0 degrees, and in this case, the page opening side of the certificate faces the first identification camera, so that the rotation is not needed.

Further, the step S330: uploading the certificate subjected to the second preset direction adjustment to the conveying piece, and adjusting the front surface of the certificate on the conveying piece to the second preset direction based on the top view obtained by the third identification camera and the second rotation module. The method comprises the following steps: the front and back sides of the certificate are judged by recognizing characters, symbols and patterns on the certificate image, and the certificate is adjusted to a second preset direction by a second rotating module. In this embodiment of the present application, the second preset direction is: the document is right side up when the document is on the transport.

The front surface of the certificate is generally provided with identification information, for example, characters indicating what certificate is, the country to which the certificate belongs, or characters corresponding to the country are written on the front surface, and it is understood that the certificate is generally provided with recognizable characters, characters or patterns on the front surface, so that the front surface of the certificate can be used for judging whether the certificate image of the second identification device is the front surface or the back surface according to the unique identification information on the front surface of the certificate. The character, symbol and pattern recognition method can adopt the existing image recognition method.

Further, in step S350, during the document checking operation of turning pages, information identification, labeling and stamping, the sensed member on the supporting member 53 is sensed by the sensing member on the frame 51 to sense the sliding position of the supporting member 53 on the frame 51.

Further, in the inspection operation of the document in which the page turning, the information recognition, the labeling and the stamping are performed in step S350, the inspection status of the document is marked in the inspection process, the document automatically turned to the data page by the page turning machine 55 is marked as "turned to the data page", the document after the information of the data page is recognized by the document recognizer 56 is marked as "information recognition", the document completed by the labeling machine 57 is marked as "labeled", and the document completed by the stamping machine 58 is marked as "stamped". Typically, a traveler who has previously passed through a customs clearance unit will have stored the traveler information in the background, and the credential identifier 56 can identify the traveler information on the credential data page, and then, by matching the traveler information with the corresponding traveler information in the background monitoring system, it can be obtained that: whether the passenger of the certificate needs to paste a visa label or not. Because if the passenger passes through the clearance before, the visa label is already processed and the visa is still in the effective period, the certificate of the passenger can be not pasted with the label, the state of the certificate can be directly marked as 'information identification and no need of labeling' after the identification of the data page, and the follow-up stamping and checking can be directly carried out without driving the labeling machine 57 to work when the passenger passes through the labeling machine 57.

The foregoing description of the preferred embodiments of the application is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the application.

Claims

1. The utility model provides a many people exempt from to drive by oneself inspection system which characterized in that, with backstage monitored control system communication connection, and include:

2. The automated inspection system of claim 1, wherein all of the vehicle inspection stations on a plurality of the lanes are distributed in an array, the automated inspection system further comprising a printer disposed on the housing for printing inspection receipt and a kiosk at the exit of each of the lanes.

3. The multi-person drive-free self-service inspection system according to claim 1 or 2, wherein the housing is provided with an inspection port; the certificate checking module comprises a rack positioned in the shell, a mechanical arm group which is arranged on the rack and can stretch from the checking port, a supporting piece which is arranged on the rack in a sliding manner, a mechanical clamp which is arranged on the rack and is used for clamping certificates on the mechanical arm group onto the supporting piece one by one, a page turner, a certificate identifier, a labeling machine and a stamping machine which are distributed along the movement track of the supporting piece; the mechanical arm group comprises a bottom frame seat, a telescopic arm which slides on the bottom frame seat in a telescopic manner, a certificate evidence collecting module used for sucking up certificates on the telescopic arm, a first identification camera and a second identification camera which are positioned on adjacent sides of the mechanical arm group and used for collecting side views of sucked up certificates, a first rotating module which is connected with the certificate evidence collecting module and used for adjusting the page opening side of the sucked up certificates of the certificate evidence collecting module to a first preset direction, a conveying piece which is arranged up and down with the mechanical arm group, a third identification camera which is used for collecting the certificates facing the conveying piece, and a second rotating module which is arranged on the mechanical arm group and used for adjusting the front and back sides of the certificates on the conveying piece to the second preset direction.

4. A multi-person drive-in-free self-service inspection method, characterized in that it is based on the multi-person drive-in-free self-service inspection system according to claim 3 and comprises:

And (3) checking: matching and searching all the vehicle checking stations in the idle state in the lane through a background monitoring system, guiding the vehicle to drive into the vehicle checking station in any idle state by voice, updating the vehicle checking station in the idle state to be in a busy green state, and driving a certificate automatic checking device of the vehicle checking station to perform certificate checking operations of mobile page turning, certificate information identification, certificate labeling and certificate stamping on all the passenger certificates in the vehicle driven into the preset position; after the certificate checking operation, sequentially collecting the biological characteristic information of all passengers by using a flat plate of the certificate automatic checking device, and verifying the biological characteristic information through a background monitoring system; marking the vehicle state after the inspection operation is inspected in the background monitoring system;

and (3) secondary release of the vehicle: the second-level barrier gate is controlled to be opened through the background monitoring system, and the vehicles are guided to leave the second-level barrier gate and enter another lane on the right side of the traffic flow direction of the lane; and

5. The method of automated inspection of multiple person drive-thru as claimed in claim 4, wherein said document inspection operation comprises:

6. The method of self-help inspection of a multiple person drive-in-the-drive as claimed in claim 5, wherein rotating the open side of the sucked-up document toward a first preset direction based on the first side view acquired by the first recognition camera, the second side view acquired by the second recognition camera, and the first rotation module comprises;

7. The automated inspection method of claim 6, wherein determining which of the first side view and the second side view belongs to the side image F connecting the sides of the open side and the hinge side of the document assuming that the open side of the document is oriented in the first predetermined direction is oriented to the first recognition camera, comprises:

8. The method of claim 7, wherein the adjusting the opening side orientation of the document based on the first recognition camera and the first rotation module comprises:

9. The method of claim 7, wherein the adjusting the opening side orientation of the document based on the second recognition camera and the first rotation module comprises:

10. The automated inspection method of claim 5, wherein the collecting biometric information of all passengers sequentially using a panel of the automated inspection device for parallel identification comprises:

sequentially voice broadcasting the names of the passengers according to the sequence of the passengers identified by the certificate identifier of the automatic certificate checking device at the vehicle checking station by a background monitoring system;

Sequentially collecting passenger biological characteristic information by using a flat plate according to the name of the passenger broadcasted;

and verifying the biological characteristic information acquired by the flat plate and the certificate information identified by the certificate identifier in the certificate checking process.

11. The method for self-help inspection without getting off a car for multiple persons according to claim 5, wherein when the inspection operation of turning pages, identifying information, labeling and stamping certificates is performed, the sensed member on the supporting member is sensed by the sensing member on the frame to sense the sliding position of the supporting member on the frame.