CN111260953A - In-road parking management method, device and system - Google Patents
In-road parking management method, device and system Download PDFInfo
- Publication number
- CN111260953A CN111260953A CN202010031455.5A CN202010031455A CN111260953A CN 111260953 A CN111260953 A CN 111260953A CN 202010031455 A CN202010031455 A CN 202010031455A CN 111260953 A CN111260953 A CN 111260953A
- Authority
- CN
- China
- Prior art keywords
- information
- binding
- vehicle
- parking
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/145—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas
- G08G1/147—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas where the parking area is within an open public zone, e.g. city centre
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07B—TICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
- G07B15/00—Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
- G07B15/02—Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
- G08G1/0175—Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas
- G08G1/145—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas
- G08G1/146—Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas where the parking area is a limited parking space, e.g. parking garage, restricted space
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Finance (AREA)
- Traffic Control Systems (AREA)
Abstract
The method comprises the steps of obtaining license plate information and face information of vehicles in a lane area according to vehicle monitoring information of the lane area, binding the license plate information and the face information of the vehicles in the lane area to obtain first binding information, obtaining parking position information and face information of the vehicles in a parking position area according to the vehicle monitoring information of the parking position area, binding the parking position information and the face information of the vehicles in the parking position area to obtain second binding information, matching the face information in the first binding information and the second binding information, binding the license plate information and the parking position information which are successfully matched to obtain third binding information, and realizing parking management according to the third binding information. And respectively aiming at the monitoring information of the lane area and the parking area, associating the parking information with the license plate information according to the face information obtained by image recognition, thereby realizing the unmanned management and automatic fee calculation of the on-road parking with higher accuracy.
Description
Technical Field
The invention relates to the technical field of vehicle management, in particular to a method, a device and a system for managing in-road parking.
Background
With the rapid development of urban economic scale and the continuous improvement of the living standard of citizens, the holding amount of various vehicles in cities, especially private vehicles, is continuously increased, so that the problem of difficult parking in cities is more and more serious. In order to improve the convenience of people in travel, in-road parking is the best way for relieving the problem of difficult parking at present.
The current in-road parking management scheme mainly comprises the following two schemes:
the toll is manually managed, and the entry of vehicle information and the calculation and collection of parking fee are manually completed by a toll collector in a road. The scheme has the following defects: the manual management charging efficiency is low, about 30 parking spaces can be managed by people, and the labor cost is high; the vehicle information is not recorded in time, the phenomena of charge calculation error or artificial private settlement and the like are easy to occur, and cash flow cannot be monitored.
A geomagnetic induction coil is installed on a parking space in a road, after a vehicle enters a parking space, a vehicle owner inputs information such as vehicle information and parking space ID through a mobile phone APP, the state of the vehicle entering, exiting and parking space is judged through geomagnetic induction, and settlement is carried out through a cloud platform. The scheme has the following defects: the intelligent parking system has the advantages that manual participation of car owners is required, intelligentization is low, a geomagnetic induction coil needs to be installed in each parking space, construction quantity is large, and manufacturing cost and maintenance cost are high.
Disclosure of Invention
The invention mainly solves the technical problem of how to realize the intelligentization of the in-road parking management charging, save a large amount of manpower and material resources and improve the parking experience of car owners.
According to a first aspect, there is provided in one embodiment an in-road parking management method, comprising:
acquiring license plate information and vehicle face information of vehicles in a lane area according to vehicle monitoring information of the lane area, and binding the license plate information and the vehicle face information of the vehicles in the lane area to obtain first binding information;
acquiring parking information and face information of vehicles in a parking area according to vehicle monitoring information of the parking area, and binding the parking information and the face information of the vehicles in the parking area to obtain second binding information;
matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the license plate information in the first binding information and the parking position information in the second binding information which are successfully matched to obtain third binding information;
and realizing parking management according to the third binding information.
In one possible implementation manner, the implementing parking management according to the third binding information includes:
if an idle berth is detected in the berth area and the last state of the idle berth is a vehicle occupation state, obtaining corresponding license plate information from the third binding information corresponding to the berth information of the idle berth;
and determining a user account according to the license plate information.
In one possible implementation manner, after determining the user account according to the license plate information, the method further includes:
carrying out fee deduction processing on the user account;
when the user account is detected to have unpaid payment, notifying the user in a preset notification mode;
and when the unpaid time or amount of the user account is detected to exceed a preset threshold value, a traffic police platform is informed so as to check the traffic police platform.
In one possible implementation, the first binding information includes ingress binding information and egress binding information;
the entrance binding information is obtained by binding license plate information and face information of entrance vehicles in the lane area, and the license plate information and the face information of the entrance vehicles are obtained according to entrance monitoring information of the lane area;
the exit binding information is obtained by binding license plate information and face information of exit vehicles in the lane area, and the license plate information and the face information of the exit vehicles are obtained according to exit monitoring information in the lane area.
In one possible implementation manner, after obtaining the entry binding information, the method further includes: storing the entry binding information in a vehicle monitoring database;
after the outlet binding information is obtained, corresponding inlet binding information is searched in the vehicle monitoring database according to the license plate information in the outlet binding information, and the inlet binding information is deleted from the vehicle monitoring database.
In one possible implementation, the vehicle face information includes vehicle face depth features;
matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the license plate information in the first binding information and the parking position information in the second binding information which are successfully matched to obtain third binding information, wherein the third binding information comprises:
performing feature similarity matching according to the car face depth features in the first binding information and the car face depth features in the second binding information;
and binding license plate information in the first binding information with the highest feature similarity with the parking position information in the second binding information to obtain third binding information.
In one possible implementation manner, obtaining license plate information and face information of a vehicle in a lane area according to vehicle monitoring information in the lane area includes:
receiving monitoring information of a vehicle by a camera device arranged on a lane area;
and aiming at each vehicle in the lane area, recognizing license plate information and extracting depth features of the vehicle face according to the monitoring information, and obtaining the license plate information and the vehicle face information of each vehicle.
In one possible implementation manner, the obtaining of the parking information and the vehicle face information of the vehicle in the parking area according to the vehicle monitoring information of the parking area and the binding of the parking information and the vehicle face information of the vehicle in the parking area to obtain the second binding information includes:
receiving monitoring information of a vehicle by a camera device arranged on a berth area;
and aiming at each vehicle in the parking area, recognizing license plate information and extracting the depth feature of the vehicle face according to the monitoring information to obtain the parking information and the vehicle face information of each vehicle.
According to a second aspect, there is provided in one embodiment an in-road parking management apparatus comprising:
the first binding module is used for acquiring license plate information and face information of vehicles in a lane area according to vehicle monitoring information of the lane area, and binding the license plate information and the face information of the vehicles in the lane area to obtain first binding information;
the second binding module is used for acquiring parking information and face information of vehicles in the parking area according to the vehicle monitoring information of the parking area, and binding the parking information and the face information of the vehicles in the parking area to obtain second binding information;
the third binding module is used for matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the successfully matched license plate information in the first binding information with the parking position information in the second binding information to obtain third binding information;
and the management module is used for realizing parking management according to the third binding information.
According to a third aspect, an embodiment provides an in-road parking management system, comprising:
the first camera device is arranged in the lane area and used for monitoring the vehicle in the lane area to obtain vehicle monitoring information of the lane area;
the second camera device is arranged in the parking area and used for monitoring the vehicles in the parking area to obtain vehicle monitoring information of the parking area;
the processor is used for obtaining license plate information and face information of vehicles in the lane area according to vehicle monitoring information of the lane area, binding the license plate information and the face information of the vehicles in the lane area to obtain first binding information, obtaining parking position information and face information of the vehicles in the parking area according to the vehicle monitoring information of the parking area, binding the parking position information and the face information of the vehicles in the parking area to obtain second binding information, matching the face information in the first binding information with the face information in the second binding information, binding the license plate information in the first binding information with the parking position information in the second binding information successfully, obtaining third binding information, and realizing parking management according to the third binding information.
According to the method, the device and the system for managing the in-road parking in the embodiment, firstly, the license plate information and the face information of the vehicle in the lane area are obtained according to the vehicle monitoring information of the lane area, and the license plate information and the face information of the vehicles in the lane area are bound to obtain first binding information, obtaining the parking information and the face information of the vehicles in the parking area according to the vehicle monitoring information of the parking area, binding parking position information and face information of vehicles in the parking area to obtain second binding information, matching the face information in the first binding information with the face information in the second binding information, and binding the license plate information in the first binding information and the parking position information in the second binding information which are successfully matched to obtain third binding information, and realizing parking management according to the third binding information. In the embodiment of the invention, the parking position information and the vehicle license plate information are associated based on the face information obtained by artificial intelligence image recognition respectively aiming at the monitoring information of the lane area and the parking position area, so that the in-road parking unmanned management and automatic fee calculation can be realized with higher accuracy.
Drawings
Fig. 1 is a schematic flow chart of an on-road parking management method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a method for acquiring first binding information according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of another method for acquiring first binding information according to an embodiment of the present invention;
fig. 4 is a schematic diagram of first binding information according to an embodiment of the present invention;
fig. 5 is a schematic view of an unattended in-road parking management monitoring scene provided in an embodiment of the present invention;
FIG. 6 is a diagram illustrating a first binding information processing operation according to an embodiment of the present invention;
fig. 7 is a flowchart illustrating a method for obtaining second binding information according to an embodiment of the present invention;
fig. 8 is a flowchart illustrating another method for acquiring second binding information according to an embodiment of the present invention;
fig. 9 is a flowchart illustrating a method for acquiring third binding information according to an embodiment of the present invention;
fig. 10 is a flowchart illustrating a parking management method according to an embodiment of the present invention;
FIG. 11 is a flow chart illustrating another parking management method according to an embodiment of the present invention;
fig. 12 is a schematic flow chart of another in-road parking management method according to an embodiment of the present invention;
fig. 13 is a schematic structural diagram of an in-road parking management device according to an embodiment of the present invention;
fig. 14 is a schematic structural diagram of an in-road parking management system according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the following detailed description and accompanying drawings. Wherein like elements in different embodiments are numbered with like associated elements. In the following description, numerous details are set forth in order to provide a better understanding of the present application. However, those skilled in the art will readily recognize that some of the features may be omitted or replaced with other elements, materials, methods in different instances. In some instances, certain operations related to the present application have not been shown or described in detail in order to avoid obscuring the core of the present application from excessive description, and it is not necessary for those skilled in the art to describe these operations in detail, so that they may be fully understood from the description in the specification and the general knowledge in the art.
Furthermore, the features, operations, or characteristics described in the specification may be combined in any suitable manner to form various embodiments. Also, the various steps or actions in the method descriptions may be transposed or transposed in order, as will be apparent to one of ordinary skill in the art. Thus, the various sequences in the specification and drawings are for the purpose of describing certain embodiments only and are not intended to imply a required sequence unless otherwise indicated where such sequence must be followed.
The conventional image-based video detection scheme can be divided into the following two cases according to the type and installation of the camera:
in the first situation, the parking state of the vehicle is identified through linkage of a gun-shaped camera and a spherical camera, wherein the gun-shaped camera is responsible for collecting panoramic video information, and the spherical camera tracks the vehicle in a scene according to the panoramic video information and captures interested vehicle information. However, the mechanical motion response speed of the dome camera is not enough, so that the problems of video triggering delay and gathering delay are easily caused, and the captured images are unclear. And when multiple vehicles enter and exit simultaneously, the multiple vehicles cannot be tracked simultaneously. Monitoring the panorama using a gun camera can also result in too low a pixel of the vehicle being obtained, making algorithmic analysis difficult. In addition, for the continuous multi-parking-place scene, a plurality of L-shaped vertical rods are needed, the attractiveness is affected, the cost is increased, and the parking places right below the rod piece are in visual dead angles, so that the license plate and the vehicle track cannot be clearly seen.
In the second situation, the management of continuous multi-stall in-road parking can be realized through one rod, namely the in-road parking state is monitored by monitoring the difference of the installation angle and the height of the camera. The problem that the parking space below the upright rod cannot be detected and identified is solved by installing a large number of cameras with different angles and heights, and a license plate identification function is required to be provided for each camera, so that the equipment cost and the maintenance cost are increased, and the cameras cannot achieve high identification accuracy on license plates with different angles.
The invention idea of the application applies the deep learning technology and the license plate recognition technology to the in-road parking management system, and realizes the in-road parking management system which can realize the non-perception of parking of the car owner in the whole course and can automatically calculate the fee under the condition of low cost input. The method comprises the steps of monitoring the vehicle coming direction in a lane area, utilizing artificial intelligence and deep learning methods to realize vehicle detection, vehicle license plate recognition and vehicle face depth feature extraction of vehicles running in a road, binding vehicle license plate information and vehicle face depth features according to recognition results, monitoring the vehicle coming direction in a berth area in the road, utilizing artificial intelligence and deep learning methods to realize vehicle detection and vehicle face depth feature extraction of vehicles at berths, associating berth information states with the vehicle face depth features on the berths according to the recognition results, completing binding of the vehicle license plate information and the berth state information through vehicle face depth feature matching, and realizing confirmation of parking information of the vehicles at the berths. The method comprises the steps of recording parking information of vehicles on a parking space (including parking space ID information, vehicle license plate information, vehicle entrance time and scene picture information, vehicle exit time and scene picture information), automatically calculating the cost, and finally finishing the parking management in an unattended road.
Example one
Referring to fig. 1, an embodiment provides an intra-road parking management method, which may be performed by an intra-road parking management apparatus, including steps S10 to S40, described in detail below.
Step S10: the method comprises the steps of obtaining license plate information and vehicle face information of vehicles in a lane area according to vehicle monitoring information of the lane area, and binding the license plate information and the vehicle face information of the vehicles in the lane area to obtain first binding information.
In one possible implementation manner, referring to fig. 2, the step S10 of obtaining license plate information and vehicle face information of the vehicle in the lane area according to the vehicle monitoring information of the lane area includes steps S11 to S12, which are described in detail below.
Step S11: monitoring information of a vehicle by a camera device arranged on a lane area is received.
Step S12: and aiming at each vehicle in the lane area, recognizing license plate information and extracting depth features of the vehicle face according to the monitoring information, and obtaining the license plate information and the vehicle face information of each vehicle.
Specifically, referring to fig. 3, a camera device may be selectively installed in a fixed lane area on the lane area, the incoming direction of the lane area which can be monitored by the camera device is monitored by the camera device, a corresponding monitoring video image is obtained, license plate information recognition and face depth feature extraction are performed according to the obtained monitoring video image, license plate and face information binding is completed, whether license plate and face binding is successful or not is detected, when the license plate and face binding is unsuccessful, the incoming direction of a preset driving road area is monitored, and when the license plate and face binding is successful, license plate and face information is uploaded. The lane area may be an area (e.g., a high speed service area) of an urban road, a suburban road, or an expressway, and the present invention is not particularly limited thereto.
It should be noted that the main factor influencing the license plate recognition rate is that the shooting angle between the camera and the license plate is large, and the accuracy is higher the more the camera is aligned to the license plate. The cameras are arranged at the entrance and exit of the road in the lane area in the incoming direction, and the license plate is shot in the forward direction as far as possible, so that the license plate recognition accuracy can be guaranteed. However, the vehicles in the parking area are not directly opposite to the cameras, the deviation angle between the vehicles and the cameras on the roadside is often large, and the license plate information of the vehicles in the parking area cannot be accurately identified, so that the accuracy of associating the vehicles in the lane area and the parking area through license plate identification is low.
In the embodiment of the present invention, the berthing area includes a plurality of berths, and the specific number may be determined according to a shooting range of a camera in the berthing area, which is not specifically limited in the present invention.
In the embodiment of the invention, the car face is identified by a deep learning artificial intelligence technology, the car face depth characteristic is extracted, the association of the car face information of the cars in a car road area and a parking area is realized based on the car face depth characteristic, because the area of the car face is much larger than that of the license plate, in addition, the car face has many characteristics, such as the car type, the car color, the car headlight, the car window, the driver in the car and the like, the cameras shoot from the left front, the right front and the right front of the car, the finally extracted car face characteristics have little difference, and the car can be identified from the left front, the right front and the right front, therefore, the robustness of the car face depth characteristic is high, the identification of the car face by the installation angle of the camera for shooting the car face information has little influence, the accuracy of associating the vehicles in the lane area and the parking area through license plate recognition is high, and the method is also the greatest advantage of vehicle face recognition relative to license plate recognition.
In one of the possible implementations, referring to fig. 4, the first binding information includes ingress binding information and egress binding information.
When a vehicle enters an entrance of a lane area, a camera facing the entrance of the lane area shoots a monitoring image of the vehicle, and a server or an industrial personal computer installed on the same support with the entrance camera recognizes license plate information and vehicle face information of the vehicle according to the monitoring image and binds the license plate information and the vehicle information of the vehicle to obtain entrance binding information.
When the vehicle is ready to leave the exit of the lane area, the camera facing the exit of the lane area shoots the monitoring image of the vehicle, and the server or the industrial personal computer installed on the same support with the camera at the exit identifies the license plate information and the face information of the vehicle according to the monitoring image and binds the license plate information and the vehicle information of the vehicle to obtain exit binding information.
In the embodiment of the present invention, corresponding cameras may be respectively disposed at an entrance and an exit of the lane area, for example, a first camera is disposed at the entrance, a second camera is disposed at the exit, the first camera monitors a vehicle about to enter the lane area to take a picture or an image, and the second camera monitors a vehicle about to leave the lane area to take a picture or an image.
Referring to fig. 5, the lane area is generally divided into two types, a bidirectional lane and a unidirectional lane. Taking the lane area of the urban area as an example, a one-way lane may be set as one lane area, and a street of a two-way lane may be set as two independent lane areas. The method comprises the steps of monitoring the incoming direction of a vehicle driving channel area, completing the functions of license plate recognition and face depth feature extraction of driving vehicles in free flow, corresponding license plate information and face information of each vehicle one by one, and transmitting the license plate information and the face information to a server or an industrial personal computer in-road parking data management module. In the lane area, the vehicle entering area and the vehicle exiting area are monitored in the vehicle entering direction of the lane area, and the selectable specific implementation steps are as follows:
at an entrance of a lane area in a vehicle-coming direction, for example, a camera may be arranged at the entrance of the lane area in the vehicle-coming direction, a monitoring image is obtained through the camera, vehicle detection, license plate recognition and face depth feature extraction are performed on a plurality of entering vehicles in the monitoring image one by one, in the monitoring image, a vehicle, for example, 5 vehicles are detected first, after the positions of the 5 vehicles in the image are determined through the vehicle detection, the vehicle features of the 5 vehicles are intercepted, 5 vehicle pictures are obtained, then license plate recognition is performed on the 1 st vehicle picture, a license plate number is obtained, and then the face feature extraction is performed on the 1 st picture, so as to obtain the face depth feature. Therefore, the license plate and the face characteristic of the 1 st vehicle can be bound, the same principle is applied to the rest 4 vehicles, and then the license plate information and the face depth characteristic information of each vehicle are bound to obtain the entrance binding information. It should be noted that, in the actual operation, the license plate is identified first or the vehicle face feature is extracted first, which is not specifically limited in the present invention. And finally, uploading the binding information LFa of the fixed vehicle a to an in-road parking data management module of a server or an industrial personal computer. Wherein the information LFa includes: the license plate information La of the vehicle a and the face depth feature Fa of the vehicle a.
At an exit of a vehicle-coming direction in a lane area, exemplarily, a camera may be arranged at the exit of the vehicle-coming direction in the lane area, a monitoring image is obtained through the camera, vehicle detection, license plate recognition and face depth feature extraction are performed one by one on a plurality of vehicles exiting from the monitoring image, and the recognition result is bound with license plate information and face depth feature information according to each vehicle to obtain exit binding information. The principle of obtaining the outlet binding information is similar to that of obtaining the inlet binding information, and the description of the invention is omitted. And finally, uploading the binding information LFb of the fixed vehicle b to a server or an in-road parking data management module in an industrial personal computer. Wherein the information LFb includes: the license plate information Lb of the vehicle b and the face depth feature Fb of the vehicle b.
It should be noted that the implementation manner of extracting the license plate or the car face information includes, but is not limited to: a machine learning method of conventional image processing, a deep learning method, and the like. The vehicle face depth feature learning model is based on but not limited to a Resnet network model, the vehicle face depth feature is not the features such as directional gradient histogram feature in a traditional image, the vehicle face depth feature is the depth feature extracted through a convolutional neural network under a depth learning framework, the feature has good response to colors, vehicle types, annual inspection labels, vehicle lamps, drivers, vehicle logos, exhaust grids, interior decorations and the like of vehicles entering and exiting, and the vehicle face depth feature learning model has the characteristics of good robustness, high precision, strong environmental interference resistance and the like.
In one possible implementation, referring to fig. 6, after obtaining the entry binding information, the method further includes steps S13 to S14, which are described in detail below.
Step S13: storing the entry binding information in a vehicle monitoring database.
Step S14: after the outlet binding information is obtained, corresponding inlet binding information is searched in the vehicle monitoring database according to the license plate information in the outlet binding information, and the inlet binding information is deleted from the vehicle monitoring database.
In the embodiment of the invention, when a vehicle is detected to drive into a lane area, an in-road parking data management module of a server or an industrial personal computer acquires license plate and face binding information LFa, the LFa is recorded into a vehicle monitoring database in the server or the industrial personal computer, when the vehicle is detected to drive out of the lane area, license plate and face binding information LFb is acquired, license plate information Lb is matched with LFb data in the vehicle monitoring database, and the license plate and face binding information matched with the corresponding vehicle b is deleted from the vehicle monitoring database. In an on-road parking scene, vehicles come and go very frequently, if the license plate information and the face information of each vehicle are stored without timely deletion, the retrieval efficiency of the vehicle monitoring database is greatly reduced, and the storage burden of the vehicle monitoring database is increased. In the embodiment of the invention, after the vehicle leaves, the corresponding data is deleted in time, so that the data query efficiency can be effectively improved, and the storage burden of the database can be reduced.
Step S20: and acquiring parking information and face information of the vehicles in the parking area according to the vehicle monitoring information of the parking area, and binding the parking information and the face information of the vehicles in the parking area to obtain second binding information.
In one possible implementation manner, referring to fig. 7, the step S20 includes steps S21 to S22, where the steps S21 and S22 are specifically described below, in order to obtain the parking information and the face information of the vehicle in the parking area according to the vehicle monitoring information of the parking area.
Step S21: and receiving monitoring information of the vehicle by a camera device arranged on the berth area.
Step S22: and aiming at each vehicle in the parking area, recognizing license plate information and extracting the depth feature of the vehicle face according to the monitoring information to obtain the parking information and the vehicle face information of each vehicle.
Referring to fig. 8, the incoming direction of the parking area is monitored to obtain a corresponding monitoring video image, parking face information binding is performed according to the obtained monitoring video image, whether parking face binding is successful or not is detected, the incoming direction of the parking area is monitored when the parking face binding is unsuccessful, parking face information is uploaded when parking face binding is successful, the parking area is monitored at the same time, and parking information related to the parking area, including empty parking information, is uploaded.
As shown in fig. 5, a plurality of parking areas may be included, and the specific number of parking areas depends on the length layout of the street, etc. The single berth area can comprise a plurality of continuous berths in a road, the vehicle coming direction of the plurality of continuous berths is monitored, and the extraction of the face depth features of the vehicles on the fixed berths is completed. The parking space information of each parking space and the face depth characteristics of the vehicles on the parking space are in one-to-one correspondence. Exemplary, alternative implementation steps are as follows:
and (4) advanced vehicle detection. For monitoring a plurality of continuous parking areas monitored by a single parking area, for example, one camera may cover a plurality of parking positions, for example, 4 parking positions, 100 parking positions are located on one side of one parking area, 25 parking cameras are required for monitoring, a monitoring image is obtained through the camera, vehicle identification is performed according to the monitoring image, and position coordinate information of the vehicle c in an image coordinate system is obtained. Since the position coordinate information of the multiple continuous berths in the image coordinate system in the camera view range is preset (can be obtained through the initial configuration file), the berth position information and the position information of the vehicle c are fused and judged, the berth ID information of the parked vehicle c can be obtained, the face depth feature information of the parked vehicle is extracted, and the binding information PFc of the berth ID information and the face depth feature of the vehicle is obtained. Wherein the PFc information includes: the parking space information Pc of the vehicle c, the face information Fc of the vehicle c, the time tag and the scene graph of the parking vehicle. And then uploading the binding information PFc and the parking information P0 with the empty parking state to a server or an in-road parking data management module of the industrial personal computer. The empty berth state P0 information includes: an empty berth scene graph and a time tag.
It should be noted that, the installation mode of the camera for monitoring the vehicle in the lane area is not limited to the installation on the same side of the road, the installation mode of the camera for monitoring the vehicle in the parking area is not limited to the installation on the opposite side of the road, and the specific installation mode is not limited to that shown in fig. 5 either, when monitoring the direction of the vehicle coming from the vehicle road area, the camera can be installed on the portal frame or the high-pole L-shaped frame, so that the vehicle license plate is shot right, the recognition rate is highest, or the side installation mode that the camera is right opposite to the vehicle license plate as shown in fig. 5 is also available. The specific situation can be set according to the road condition of the street. The same is true for the installation mode of the berth camera. In fig. 5, the image is a bidirectional lane, and in order to ensure the accuracy of license plate recognition, a camera provided in a lane area detects only a license plate and a face of a vehicle in an incoming direction, and does not detect a vehicle in an opposite parking area. For example, when there is only one lane, the cameras in the lane area may be installed at only two locations of the entrance, that is, only two cameras, which are responsible for photographing the license plate. If the vehicle is a single lane and the two sides of the vehicle are provided with berths, the cameras for shooting license plates are respectively arranged at the entrance and the exit, and the cameras for shooting the berths are respectively arranged at the two sides of the lane in the middle berth area to shoot opposite berths. Because the camera for shooting the parking is arranged on one side, due to the installation angle, the opposite camera can completely cover the parking vehicle in the monitoring area in the visual field, but the parking on the same side of the camera cannot be completely covered, and the complete vehicle face characteristic cannot be obtained. The above-described mounting method is not particularly limited in this regard.
Step S30: and matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the license plate information in the first binding information and the parking position information in the second binding information which are successfully matched to obtain third binding information.
In one possible implementation, the vehicle face information includes vehicle face depth features.
Referring to fig. 9, step S30 matches the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binds the license plate information in the first binding information and the parking space information in the second binding information that are successfully matched, so as to obtain third binding information, which includes steps S31 to S32, which will be described in detail below.
Step S31: and matching the feature similarity according to the car face depth feature in the first binding information and the car face depth feature in the second binding information.
Step S32: and binding license plate information in the first binding information with the highest feature similarity with the parking position information in the second binding information to obtain third binding information.
In the embodiment of the invention, when a server or an industrial personal computer in-road parking data management module receives parking position car face binding data PFc, car face depth feature matching is carried out in a car monitoring database according to car face depth features F in data PFc. For example: obtaining the most similar license plate face binding information LFa, determining that the license plate information of a parking vehicle c on the parking space is license plate information La in the LFa through the parking space information of PFc, namely finishing one-to-one correlation between the parking space information and the license plate information, obtaining PLc information after the parking space information and the license plate information are bound, wherein the PLc information is third binding information, and inputting the PLc information into a parking space fee calculation database of a server or an industrial personal computer.
Step S40: and realizing parking management according to the third binding information.
In one possible implementation manner, referring to fig. 10, the implementation of parking management according to the third binding information in step S40 includes steps S41 to S42, which are described in detail below.
Step S41: and if an idle berth is detected in the berth area and the last state of the idle berth is a vehicle occupation state, obtaining corresponding license plate information from the third binding information corresponding to the berth information of the idle berth.
Step S42: and determining a user account according to the license plate information.
In one possible implementation, referring to fig. 11, after determining the user account according to the license plate information, the method further includes steps S43 to S45, which are described in detail below.
Step S43: and carrying out fee deduction processing on the user account.
Step S44: and when detecting that the user account is unpaid, notifying the user in a preset notification mode.
Step S45: and when the unpaid time or amount of the user account is detected to exceed a preset threshold value, a traffic police platform is informed so as to check the traffic police platform.
In the embodiment of the invention, data fusion is carried out according to the received license plate car face binding information (LFa, LFb) and the parking position car face binding information (PFc), and the determination of the car on the parking position is completed. And then, the operations such as automatic fee calculation, cloud fee deduction and the like are realized on the basis of determining the vehicle. The alternative operations are as follows: and judging whether the account corresponding to the license plate information has unpaid payment or not according to the determined license plate information, and if the account has unpaid payment, informing the owner of the license plate information in a communication mode such as short message and the like. And when the unpaid fee exceeds a certain set threshold value, defining the phenomenon of malicious fee evasion, and informing the traffic police platform to check the traffic police platform.
The method comprises the following specific implementation steps: after a server or an in-road parking data management module of the industrial personal computer receives the parking information of the empty parking position state P0, a parking position fee calculation database is inquired, whether a vehicle drives away from the parking position or not is judged, if the vehicle drives away, automatic parking position fee calculation work is carried out on the vehicle according to the parking position fee calculation database data, and cloud fee deduction work is carried out on an account corresponding to a license plate of the vehicle. Whether vehicles drive away from the parking area can be judged by comparing the parking condition of the face of the parking area with the monitoring information at the exit of the lane area.
Referring to fig. 12, after receiving parking space car face information, according to monitoring of a parking space area, judging whether there is empty parking space information, searching a parking space fee database when there is empty parking space information, judging whether there is a car running out of the parking space, when it is judged that there is no car running out, continuing to receive the parking space car face information, when it is judged that there is a car running out, determining license plate information corresponding to the car running out of the car, determining a rear user account according to the determined license plate information, calculating parking fee for the user account pair, and the cloud deducts fee from the account corresponding to the license plate, judging whether the balance of the account is sufficient, and when it is judged that the balance of the account is insufficient, notifying the car owner of the insufficient balance; and when the balance of the account is judged to be sufficient, informing the vehicle owner of successful fee deduction. When a parking area is monitored, and empty parking information is not obtained, a corresponding vehicle monitoring database is searched, namely vehicle monitoring data obtained by monitoring a lane area and/or the parking area are matched, vehicle face characteristics are determined, license plate information of the parking is bound, the bound data are uploaded, whether non-payment exists in an account corresponding to the license plate is judged, if the non-payment exists, whether the amount of the non-payment exceeds a threshold value is judged, a traffic police platform is informed when the amount of the non-payment exceeds the preset value, so that the traffic police can check the non-payment, or whether the non-payment exceeds a preset time threshold value is judged, and the traffic police platform is informed when the non-payment exceeds the preset time threshold value, so that the traffic police can check the non-payment and continuously receive the license plate vehicle face information.
The embodiment of the invention has the following characteristics:
in the embodiment of the invention, the parking position information and the vehicle license plate information are associated based on the face information obtained by artificial intelligence image recognition respectively aiming at the monitoring information of the lane area and the parking position area, so that the in-road parking unmanned management and automatic fee calculation can be realized with higher accuracy.
Example two
Referring to fig. 13, an embodiment provides an in-road parking management apparatus, which includes a first binding module 10, a second binding module 20, a third binding module 30, and a management module 40, which are described in detail below.
The first binding module 10 is configured to obtain license plate information and vehicle face information of a vehicle in a lane area according to vehicle monitoring information of the lane area, and bind the license plate information and the vehicle face information of the vehicle in the lane area to obtain first binding information;
the second binding module 20 is configured to obtain parking information and vehicle face information of a vehicle in a parking area according to vehicle monitoring information of the parking area, and bind the parking information and the vehicle face information of the vehicle in the parking area to obtain second binding information;
the third binding module 30 is configured to match the vehicle face information in the first binding information with the vehicle face information in the second binding information, and bind the license plate information in the first binding information and the parking position information in the second binding information that are successfully matched, so as to obtain third binding information;
and the management module 40 is used for realizing parking management according to the third binding information.
The embodiment of the invention has the following characteristics:
in the embodiment of the invention, the parking position information and the vehicle license plate information are associated based on the face information obtained by artificial intelligence image recognition respectively aiming at the monitoring information of the lane area and the parking position area, so that the in-road parking unmanned management and automatic fee calculation can be realized with higher accuracy.
EXAMPLE III
Referring to fig. 14, in one embodiment there is provided an in-road parking management system comprising:
the first imaging device 141 is disposed in the lane area, and is configured to monitor a vehicle in the lane area to obtain vehicle monitoring information in the lane area.
The second camera 142 is disposed in the parking area, and is configured to monitor vehicles in the parking area to obtain vehicle monitoring information in the parking area.
The processor 143 is configured to obtain license plate information and face information of a vehicle in a lane region according to vehicle monitoring information in the lane region, bind the license plate information and the face information of the vehicle in the lane region to obtain first binding information, obtain parking position information and face information of the vehicle in the parking position region according to vehicle monitoring information in the parking position region, bind the parking position information and the face information of the vehicle in the parking position region to obtain second binding information, match the face information in the first binding information with the face information in the second binding information, bind the license plate information in the first binding information and the parking position information in the second binding information that are successfully matched to obtain third binding information, and implement parking management according to the third binding information.
In an embodiment of the present invention, a peripheral accessory includes: camera, installing support, industrial computer, data network transmission equipment etc.. The camera acquired by the first binding information is installed on the same side of the road, and the camera acquired by the second binding information is installed on the different side of the road.
The embodiment of the invention has the following characteristics:
in the embodiment of the invention, the parking position information and the vehicle license plate information are associated based on the face information obtained by artificial intelligence image recognition respectively aiming at the monitoring information of the lane area and the parking position area, so that the in-road parking unmanned management and automatic fee calculation can be realized with higher accuracy.
Those skilled in the art will appreciate that all or part of the functions of the various methods in the above embodiments may be implemented by hardware, or may be implemented by computer programs. When all or part of the functions of the above embodiments are implemented by a computer program, the program may be stored in a computer-readable storage medium, and the storage medium may include: a read only memory, a random access memory, a magnetic disk, an optical disk, a hard disk, etc., and the program is executed by a computer to realize the above functions. For example, the program may be stored in a memory of the device, and when the program in the memory is executed by the processor, all or part of the functions described above may be implemented. In addition, when all or part of the functions in the above embodiments are implemented by a computer program, the program may be stored in a storage medium such as a server, another computer, a magnetic disk, an optical disk, a flash disk, or a removable hard disk, and may be downloaded or copied to a memory of a local device, or may be version-updated in a system of the local device, and when the program in the memory is executed by a processor, all or part of the functions in the above embodiments may be implemented.
The present invention has been described in terms of specific examples, which are provided to aid understanding of the invention and are not intended to be limiting. For a person skilled in the art to which the invention pertains, several simple deductions, modifications or substitutions may be made according to the idea of the invention.
Claims (10)
1. An in-road parking management method, comprising:
acquiring license plate information and vehicle face information of vehicles in a lane area according to vehicle monitoring information of the lane area, and binding the license plate information and the vehicle face information of the vehicles in the lane area to obtain first binding information;
acquiring parking information and face information of vehicles in a parking area according to vehicle monitoring information of the parking area, and binding the parking information and the face information of the vehicles in the parking area to obtain second binding information;
matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the license plate information in the first binding information and the parking position information in the second binding information which are successfully matched to obtain third binding information;
and realizing parking management according to the third binding information.
2. The method of claim 1, wherein said implementing parking management according to the third binding information comprises:
if an idle berth is detected in the berth area and the last state of the idle berth is a vehicle occupation state, obtaining corresponding license plate information from the third binding information corresponding to the berth information of the idle berth;
and determining a user account according to the license plate information.
3. The method of claim 2, wherein after determining the user account based on the license plate information, the method further comprises:
carrying out fee deduction processing on the user account;
when the user account is detected to have unpaid payment, notifying the user in a preset notification mode;
and when the unpaid time or amount of the user account is detected to exceed a preset threshold value, a traffic police platform is informed so as to check the traffic police platform.
4. The method of claim 3, wherein the first binding information comprises ingress binding information and egress binding information;
the entrance binding information is obtained by binding license plate information and face information of entrance vehicles in the lane area, and the license plate information and the face information of the entrance vehicles are obtained according to entrance monitoring information of the lane area;
the exit binding information is obtained by binding license plate information and face information of exit vehicles in the lane area, and the license plate information and the face information of the exit vehicles are obtained according to exit monitoring information in the lane area.
5. The method of claim 4,
after obtaining the entry binding information, the method further comprises: storing the entry binding information in a vehicle monitoring database;
after the outlet binding information is obtained, corresponding inlet binding information is searched in the vehicle monitoring database according to the license plate information in the outlet binding information, and the inlet binding information is deleted from the vehicle monitoring database.
6. The method of claim 1,
the car face information comprises car face depth features;
matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the license plate information in the first binding information and the parking position information in the second binding information which are successfully matched to obtain third binding information, wherein the third binding information comprises:
performing feature similarity matching according to the car face depth features in the first binding information and the car face depth features in the second binding information;
and binding license plate information in the first binding information with the highest feature similarity with the parking position information in the second binding information to obtain third binding information.
7. The method of any one of claims 1 to 6, wherein obtaining license plate information and face information of vehicles in a lane area according to vehicle monitoring information of the lane area comprises:
receiving monitoring information of a vehicle by a camera device arranged on a lane area;
and aiming at each vehicle in the lane area, recognizing license plate information and extracting depth features of the vehicle face according to the monitoring information, and obtaining the license plate information and the vehicle face information of each vehicle.
8. The method of any one of claims 1 to 6, wherein the obtaining of the parking information and the face information of the vehicles in the parking area according to the vehicle monitoring information of the parking area comprises:
receiving monitoring information of a vehicle by a camera device arranged on a berth area;
and aiming at each vehicle in the parking area, recognizing license plate information and extracting the depth characteristics of the vehicle face according to the monitoring information to obtain the parking information and the vehicle face information of each vehicle.
9. An in-road parking management device, comprising:
the first binding module is used for acquiring license plate information and face information of vehicles in a lane area according to vehicle monitoring information of the lane area, and binding the license plate information and the face information of the vehicles in the lane area to obtain first binding information;
the second binding module is used for acquiring parking information and face information of vehicles in the parking area according to the vehicle monitoring information of the parking area, and binding the parking information and the face information of the vehicles in the parking area to obtain second binding information;
the third binding module is used for matching the vehicle face information in the first binding information with the vehicle face information in the second binding information, and binding the successfully matched license plate information in the first binding information with the parking position information in the second binding information to obtain third binding information;
and the management module is used for realizing parking management according to the third binding information.
10. An in-road parking management system, comprising:
the first camera device is arranged in the lane area and used for monitoring the vehicle in the lane area to obtain vehicle monitoring information of the lane area;
the second camera device is arranged in the parking area and used for monitoring the vehicles in the parking area to obtain vehicle monitoring information of the parking area;
the processor is used for obtaining license plate information and face information of vehicles in the lane area according to vehicle monitoring information of the lane area, binding the license plate information and the face information of the vehicles in the lane area to obtain first binding information, obtaining parking position information and face information of the vehicles in the parking area according to the vehicle monitoring information of the parking area, binding the parking position information and the face information of the vehicles in the parking area to obtain second binding information, matching the face information in the first binding information with the face information in the second binding information, binding the license plate information in the first binding information with the parking position information in the second binding information successfully, obtaining third binding information, and realizing parking management according to the third binding information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010031455.5A CN111260953A (en) | 2020-01-15 | 2020-01-15 | In-road parking management method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010031455.5A CN111260953A (en) | 2020-01-15 | 2020-01-15 | In-road parking management method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111260953A true CN111260953A (en) | 2020-06-09 |
Family
ID=70945203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010031455.5A Pending CN111260953A (en) | 2020-01-15 | 2020-01-15 | In-road parking management method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111260953A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112185129A (en) * | 2020-11-13 | 2021-01-05 | 重庆盘古美天物联网科技有限公司 | Parking management method based on urban auxiliary road bayonet snapshot |
| CN112382104A (en) * | 2020-11-13 | 2021-02-19 | 重庆盘古美天物联网科技有限公司 | Roadside parking management method based on vehicle track analysis |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160110999A1 (en) * | 2014-10-15 | 2016-04-21 | Xerox Corporation | Methods and systems for parking monitoring with vehicle identification |
| CN107945521A (en) * | 2017-11-20 | 2018-04-20 | 青岛比特信息技术有限公司 | A kind of rifle ball linkage trackside is parked detecting system and method |
| CN108520236A (en) * | 2018-04-09 | 2018-09-11 | 迪蒙智慧交通（深圳）有限公司 | It drives into and outgoing vehicles information collecting method, device and information of vehicles processing system |
| CN108717800A (en) * | 2018-04-08 | 2018-10-30 | 郑州轻工业学院 | A kind of management system and method for intelligent parking lot |
| CN108806268A (en) * | 2018-06-13 | 2018-11-13 | 智慧互通科技有限公司 | A kind of parking management method and system based on biometric image |
| CN108961822A (en) * | 2018-08-01 | 2018-12-07 | 扬州大学 | Berth intelligent parking management method and system in road |
| KR101988540B1 (en) * | 2017-05-12 | 2019-06-12 | 주식회사 대영아이오티 | System and method for managing parking |
| CN110163985A (en) * | 2019-06-20 | 2019-08-23 | 广西云高智能停车设备有限公司 | A kind of curb parking management charge system and charging method based on the identification of vehicle face |
| CN110298928A (en) * | 2019-06-04 | 2019-10-01 | 深圳市金溢科技股份有限公司 | Unattended parking lot fee collection management method, system |
-
2020
- 2020-01-15 CN CN202010031455.5A patent/CN111260953A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160110999A1 (en) * | 2014-10-15 | 2016-04-21 | Xerox Corporation | Methods and systems for parking monitoring with vehicle identification |
| KR101988540B1 (en) * | 2017-05-12 | 2019-06-12 | 주식회사 대영아이오티 | System and method for managing parking |
| CN107945521A (en) * | 2017-11-20 | 2018-04-20 | 青岛比特信息技术有限公司 | A kind of rifle ball linkage trackside is parked detecting system and method |
| CN108717800A (en) * | 2018-04-08 | 2018-10-30 | 郑州轻工业学院 | A kind of management system and method for intelligent parking lot |
| CN108520236A (en) * | 2018-04-09 | 2018-09-11 | 迪蒙智慧交通（深圳）有限公司 | It drives into and outgoing vehicles information collecting method, device and information of vehicles processing system |
| CN108806268A (en) * | 2018-06-13 | 2018-11-13 | 智慧互通科技有限公司 | A kind of parking management method and system based on biometric image |
| CN108961822A (en) * | 2018-08-01 | 2018-12-07 | 扬州大学 | Berth intelligent parking management method and system in road |
| CN110298928A (en) * | 2019-06-04 | 2019-10-01 | 深圳市金溢科技股份有限公司 | Unattended parking lot fee collection management method, system |
| CN110163985A (en) * | 2019-06-20 | 2019-08-23 | 广西云高智能停车设备有限公司 | A kind of curb parking management charge system and charging method based on the identification of vehicle face |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112185129A (en) * | 2020-11-13 | 2021-01-05 | 重庆盘古美天物联网科技有限公司 | Parking management method based on urban auxiliary road bayonet snapshot |
| CN112382104A (en) * | 2020-11-13 | 2021-02-19 | 重庆盘古美天物联网科技有限公司 | Roadside parking management method based on vehicle track analysis |
| CN112185129B (en) * | 2020-11-13 | 2021-06-25 | 重庆盘古美天物联网科技有限公司 | Parking management method based on urban auxiliary road bayonet snapshot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108765976B (en) | Roadside parallel parking information management system and method | |
| CN108986539B (en) | Parking management system, method, vehicle information acquisition device and management server | |
| CN111739335B (en) | Parking detection method and device based on visual difference | |
| CN106781675A (en) | A kind of system and method for collecting parking lot information | |
| CN111540072B (en) | Parking space management service method, equipment and system | |
| CN110634306A (en) | Method and device for determining vehicle position, storage medium and computing equipment | |
| CN105046966A (en) | System and method for automatically detecting illegal parking behaviors in drop-off areas | |
| CN109993978B (en) | Vehicle snapshot method and device and gate sentry system | |
| CN111353369A (en) | Application method and system of high-order video of urban roadside parking in assisting criminal investigation | |
| CN110930764A (en) | Roadside parking detection method based on inspection method | |
| CN111951600A (en) | Parking space and vehicle identification information automatic matching method and parking system | |
| CN111260953A (en) | In-road parking management method, device and system | |
| WO2023179416A1 (en) | Method and apparatus for determining entry and exit of vehicle into and out of parking space, device, and storage medium | |
| CN116469185A (en) | Urban parking management system and method based on mobile vision inspection | |
| CN108510744B (en) | System and method for realizing semi-closed parking lot management based on long and short focal length cameras | |
| CN112927556B (en) | Monitoring system for high-order video curb parking | |
| CN113112813B (en) | Illegal parking detection method and device | |
| CN112884927A (en) | Based on electronic parking charge communication system | |
| CN111785068A (en) | Garage management system | |
| CN112712626A (en) | Vehicle verification method and device based on license plate information, computer equipment and storage medium | |
| CN113593247B (en) | Parking management system | |
| CN114038227B (en) | Parking and charging management method and system based on intelligent charging ground lock | |
| CN115761915A (en) | Parking arrearage following payment method and system based on parking big data | |
| US11145204B2 (en) | Snow removal apparatus operating system and snow removal apparatus operating method | |
| CN111666784A (en) | Intelligent parking device based on visual image algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200609 |
|
| RJ01 | Rejection of invention patent application after publication |