CN103914896A - Fault tolerance system for vehicle access and exit control, and control method adopting fault tolerance system - Google Patents
Fault tolerance system for vehicle access and exit control, and control method adopting fault tolerance system Download PDFInfo
- Publication number
- CN103914896A CN103914896A CN201310005665.7A CN201310005665A CN103914896A CN 103914896 A CN103914896 A CN 103914896A CN 201310005665 A CN201310005665 A CN 201310005665A CN 103914896 A CN103914896 A CN 103914896A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- control
- gate
- unit
- gateway
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Traffic Control Systems (AREA)
- Devices For Checking Fares Or Tickets At Control Points (AREA)
Abstract
The invention provides a fault tolerance system for vehicle access and exit control, and a control method adopting the fault tolerance system. The system comprises a first verification module, a second verification module, a verification mode control unit and a gate control unit, a second verification mode likes a wireless verification technology and can be used as an auxiliary means for a first verification mode, and the system can select a verification mode through verification mode management, or combines different verification modes in order to realize fault tolerance. The first verification mode likes vehicle license plate identification, a license plate is identified through image processing in order to verify, and a gate is opened when a vehicle reaches a gateway if the verification result is successful; and if the first verification mode result is failure, a driver can verify in a wireless manner through an identification card. In the invention, license plate number identification and verification is completed before the vehicle reaches the corresponding gate, so the gate is opened before the vehicle passing the verification reaches the corresponding gate in order to let the vehicle through, and the waiting for verification and access of the vehicle can be avoided.
Description
Technical field
The present invention is the tolerant system and the method for control that adopts this tolerant system that a kind of vehicles while passing enters control, particularly provides at least two kinds of verification method control to enter and exit system and the method for vehicle.
Background technology
Known technology provides the mode of various parking lots vehicles while passing management, its object is nothing more than being cause for safety, and checking enter vehicle identity, particularly private parking place, general management method comprises that manpower judges, the hand-held permit identification of driver is bright, vehicle license plate is taken identification, and may be applied the way to manage of RFID tag (RFID).
Known technology can be with reference to No. I246321st, the TaiWan, China patent (day for announcing: 2005/12/21) containedly utilize the long-range technology with selecting video monitoring system as parking lot management, utilize Video Supervision Technique as crossing monitoring, gate inhibition's monitoring, parking lot monitoring etc., major technique is to utilize the mode of filming image, the picture of monitoring occasion is stored in specific storage device, in the time having any situation to produce, can have access to, or provide personnel to carry out telemonitoring by webpage mode.
Separately there is known technology as No. I271667 (day for announcing: 2007/01/21) of TaiWan, China patent, it discloses the unmanned managing system of car parking of a kind of middle controlled, namely in the time judging that vehicle arrives, take automobile image identification car plate, whether compare whereby vehicle and be allowed to enter, this system mainly utilizes car plate automatic Identification technology to reach the object of vehicle management.According to disclosed content, when vehicle is in the time passing in and out parking lot, can be detected vehicle by wagon detector arrives, by video camera, vehicle is carried out to capture to carry out number plate recognition afterwards, the result of number plate recognition will be compared with the qualified vehicle data storehouse of image identification computing machine, as the basis for estimation of whether opening fence.
Mostly the regulation model that known technology enters for parking lot vehicles while passing is the verification mode that application is single, or is aided with the artificial practice, lacks fault-tolerant mechanism.
Summary of the invention
Be different from known technology enters management technology at parking lot vehicles while passing, the present invention proposes a kind of vehicles while passing and enters the tolerant system of control and adopt the vehicles while passing of this tolerant system to enter method of control, this tolerant system adopts at least two kinds of verification modes simultaneously, wherein a kind ofly verify that means adopt a video camera with wide-angle photography function, shooting enters the vehicle in vehicular control place and carries out long-range identification car plate, the gateway time that this vehicle of sensing enters again afterwards, and energy starting gate in time, allow vehicle needn't under the situation of stagnation of movement, just can enter smoothly vehicular control place.Then, if this vehicle cannot, by checking, cannot enter smoothly after number plate recognition, can verify means aided verification with the second, such as passing through wireless recognition technique, or other authentication modes of arranging in pairs or groups are verified.
According to embodiment, the tolerant system that vehicles while passing of the present invention enters control mainly includes the first authentication module and second authentication module of different two kinds of verification techniques,
Wherein in the first authentication module, be provided with camera unit, camera unit can be one especially can contain multiple wide-angle cameras that enter the track before gateway, or the video camera that can be combined by multiple image acquisition units, object is to take the continuous image of the scope that comprises one or more track.Continuous image then can be temporary in image buffer unit.System utilizes a number plate recognition unit to seek through one car plate the identification license number of after process on limit, judging each vehicle.
Afterwards, the car plate picking out to verify obtained each vehicle license number, particularly can verify whether vehicle allows to enter by the authentication unit comparison list that enters control system through vehicles while passing before vehicle enters gateway.Then by intrasystem gate control module obtain authentication unit to the access admittance information of each vehicle after, the gateway entering according to each vehicle, with the gate opening of controlling gateway with close.Specifically, the vehicular control program producing according to said system, can allow and arrive before corresponding gate starting gate by one or more vehicle of checking and allow current, vehicle can stop just entering, being different from known technology needs stagnation of movement before gate, then the mode that just can enter after verifying.
In other words, the invention provides a kind of vehicles while passing and enter the tolerant system of control, described tolerant system comprises: one first authentication module, comprising: a camera unit, comprises one or more continuous images that enter the track scope before gateway in order to take; One image buffer unit, is electrically connected this camera unit, in order to store by the captured continuous image of this camera unit; One number plate recognition unit, be electrically connected this image buffer unit, obtain stored continuous image by this image buffer unit, through scanning each width image of this continuous image, judge car plate position the identification license number of each vehicle according to vehicle license plate characteristic to seek after process on limit; One vehicle authentication unit, is electrically connected this number plate recognition unit, and comparison one list is to verify obtained each vehicle license number; One second authentication module that system is included, it comprises: an information reading unit, is loaded on this vehicle or by driver or the hand-held contained identifying information of a wireless-identification device of other users of this vehicle in order to read; One aided verification unit, is electrically connected this information reading unit, in order to receive this identifying information, verifies to compare this list; One Validation Mode control module, be electrically connected this first authentication module and this second authentication module, enter the regulatory model of the tolerant system of control in order to set this vehicles while passing, receive the result that this first authentication module and this second authentication module produce, judge whether checking, and judged whether to open a gate; And a gate control module, be electrically connected this Validation Mode control module, through obtaining the result of this Validation Mode control module judgement, when this gate is opened in judgement, the gate opening of this gateway of gateway control entering according to each vehicle with close.
According to embodiment, if vehicle is not by above-mentioned first proving program, the fault tolerant mechanism of system will start second proving program, particularly read another identity identification information by an information reading unit, as the information of less radio-frequency label, and after empirical tests, judge whether to enter relevant place.Can assist whereby when the unsuccessful state of first proving program, the first proving program of also can arranging in pairs or groups is as safer vehicular control means.
Moreover, if system is located at the place of multiple gateway, need to learn which gateway vehicle enters, therefore vehicles while passing enters the gateway that control system can utilize the set each vehicle of vehicle perception unit perception of each gateway to enter, to confirm which gate should open or close.
According to invention the disclosed embodiments, the step that the method for control that adopts above-mentioned vehicles while passing to enter the tolerant system of control comprises is first carried out first proving program, as the above-mentioned proving program that is identified as basis with vehicle license plate, if do not pass through, then using wireless recognition technique as auxiliary measure of control.
In other words, the present invention also provides a kind of method of control that adopts vehicles while passing to enter the tolerant system of control, described method of control comprises: start one first authentication module, to carry out first proving program, the license board information that this first proving program enters a vehicle of a gateway according to identification is verified; Judge that whether this vehicle is by this first proving program, wherein: if be proved to be successful, allow this vehicle pass-through; If verify unsuccessful, start one second authentication module; Carry out this second authentication module to carry out second proving program, this second proving program is verified according to a wireless recognition technique; Judge that whether this vehicle is by this second proving program, wherein: if be proved to be successful, allow this vehicle pass-through; If verify unsuccessfully, refuse this vehicle pass-through.
According to embodiments of the invention, the first or second proving program all can reach before vehicle arrives corresponding gate and complete license number identification and checking, the vehicle that therefore can make empirical tests pass through arrives before corresponding gate starting gate and allows currently, and therefore vehicle can just can enter without to be verified after stagnation of movement etc.
Brief description of the drawings
Fig. 1 is that the scene that vehicles while passing of the present invention enters the tolerant system embodiment mono-of control arranges figure;
Fig. 2 is that the scene that vehicles while passing of the present invention enters the tolerant system embodiment bis-of control arranges figure;
Fig. 3 is that the scene that vehicles while passing of the present invention enters the tolerant system embodiment of control arranges schematic diagram;
Fig. 4 is the associated schematic diagram in the each unit of tolerant system that vehicles while passing of the present invention enters control;
Fig. 5 is for being applied to wide-angle photography module diagram of the present invention;
Fig. 6 is each unit module embodiment schematic diagram of the vehicles while passing of the present invention tolerant system that enters control;
Fig. 7 is one of the present invention's embodiment step of adopting the method for control of the tolerant system that vehicles while passing enters;
Fig. 8 is two of the present invention's embodiment step of adopting the method for control of the tolerant system that vehicles while passing enters;
Fig. 9 is three of the present invention's embodiment step of adopting the method for control of the tolerant system that vehicles while passing enters.
[main element description of reference numerals]
Vehicle 10 car plates 101
Coverage 12 video cameras 103
Vehicle perceptron 14 gateways 105
Gate driver 107 gates 109
Wireless-identification device 111
Vehicle 20 car plates 201
Coverage 22 video cameras 203
Vehicle perceptron 24,26 gateways 207,208
Gate driver 209,210 gates 211,212
Wireless-identification device 213,214
Vehicle 30 car plates 301
Vehicle perceptron 303 gate control modules 305
Control system 307 vehicle license plate recognition module 311
Wireless identity module 312 gate drivers 309
Gate 310
Vehicles while passing enters control core 40
Gate control module 401 vehicle perception unit 403
Number plate recognition unit 405 camera units 407
Storage element 409 vehicle authentication units 411
Aided verification unit 413 Validation Mode control modules 415
Camera unit 50 image acquisition units 501,502,503
Image combining unit 51 buffer units 53
Number plate recognition unit 55 authentication units 57
The first authentication module 61 wide-angle photography modules 601
Image buffer unit 603 databases 605
Number plate recognition unit 609
Vehicle authentication unit 611 lists 613
The second authentication module 62 information reading units 615
Aided verification unit 617 Validation Mode control modules 619
Message unit 621 gate control modules 623
Vehicle perception unit 625
One of method of control flow process of the tolerant system that step S701 ~ S715 employing vehicles while passing enters
Two of the method for control flow process of the tolerant system that step S801 ~ S811 employing vehicles while passing enters
Three of the method for control flow process of the tolerant system that step S901 ~ S915 employing vehicles while passing enters
Embodiment
In order to provide a vehicles while passing with fault tolerant mechanism to enter control system, the open one of the present invention is applied in vehicular control place (as parking lot, have place entering and exiting at gate etc.) the shutdown control tolerant system entering and exiting, the technical characteristics of system is, the vehicular control place that just can enter after needing identification especially, in the time having this turnover entrance of vehicle approach, system proposed by the invention is provided with a video camera, can pick out the car plate of vehicle to pick out car plate content (as license number), in the time not yet entering gateway, complete checking, therefore the vehicle by checking can be because of early the time have been confirmed to allow to enter, the first starting gate of gateway (having the embodiment of multiple gateways) that system enters basis, vehicle can be stopped just can directly sailing into.In the time that vehicle does not pass through the first proving program, tolerant system will start the second proving program, such as the means of utilizing wireless identification label as second checking.
Embodiment can first consult the scene that vehicles while passing of the present invention shown in Fig. 1 enters the tolerant system embodiment mono-of control figure is set.
Shown in Fig. 1, system shows a vehicle 10 that enters vehicular control place, vehicle 10 can be the various vehicles that are provided with number plate recognition, vehicle 10 is provided with car plate 101, the video camera 103 coverage 12(that system provides are as indicated with dotted line the scope containing in Fig. 1) contain the track that vehicle enters, track is herein defined as and enters the front vehicle route of gateway (position before gate), therefore, this video camera 103 can be at vehicle have been obtained image when the position beyond the certain distance, thereby can the real-time identification number-plate number.
According to embodiment mono-, when gateway 105 before vehicle 10 enters gate 109, if identification car plate before proving program complete, and confirm that this vehicle is to allow the vehicle that enters, can enter the front starting gate 109 of gateway 105 at vehicle, vehicle can directly be sailed into smoothly, and need not stop waiting for the result completely, or utilize another technical identification identity before stopping at gate 109, as the wireless-identification device 111 in the present embodiment Fig. 1.
This wireless-identification device 111 adopts a kind of technology of wireless identification label, as RFID tag (RFID), in the time that above-mentioned first utilizes the proving program failure of number plate recognition, driver still can continue to sail gateway 105 into, utilizes the technology of this wireless identification to carry out second proving program.
On the ground of gateway 105, can be provided with induction through the vehicle perceptron 14 of vehicle when vehicle 10 enters and exits control system, particularly at multiple gateway 105(as Fig. 2) system in need to know that by vehicle perceptron 14 which bar the gateway 105 that vehicle will enter is.The object of vehicle perceptron 14 is that perception vehicle arrives the time of gateway, the mode using comprises utilizes inductive coil, the pressure-sensitive circuit etc. of being located at ground, do not get rid of in embodiments of the present invention and use other perceptrons, such as infrared ray blocking induction, radio influence etc.
When there being vehicle 10 to enter before the track before gateway 105, in above-mentioned first proving program, use video camera 103 to continue (or starting by induction) floor picture, can grasp fast the vehicle entering, and and then carries out image processing find car plate position, and provide the function of number plate recognition.Afterwards, through confirming that the number-plate number is the list that allows to enter this vehicular control place, drive the opportunity in the time that vehicle perceptron 14 senses vehicle 10 gate driver 107 to open as fence type gate 109, this first proving program can allow vehicle can in the situation that need not stopping, entering vehicular control place.
If but first proving program failure, vehicle 10 continues to sail into gateway 105, sense that through vehicle perceptron 14 vehicle 10 has entered, start second to proving program, start the wireless-identification device 111 of being located at gateway mouth, hand-held or be located at the recognition device (as identification card, identification paster etc.) of ad-hoc location on car so as to reading driver, finally determine whether to allow the identity entering.If during by second proving program, vehicle 10 allows to enter this vehicular control place equally.
It is worth mentioning that, the system proposing due to invention provides two kinds or above proving program simultaneously, can reach whereby the object of System Fault Tolerance, wherein means include different Validation Modes, comprise when passing through one of twice proving program, comprise that vehicle can enter taking the first verification method as master, the second verification method are as auxiliary; Or in another pattern, the proving program that simultaneously carry out by two verification methods, vehicle could allow to enter.
In the embodiment shown in fig. 1, because be only provided with a gateway 105, therefore, can be at vehicle by when checking starting gate 109, but still can adopt above-mentioned vehicle perceptron 14 to confirm that vehicle enters the opportunity of gateway 105, at optimal time starting gate 109.The embodiment of gate 109 comprises the gate of fence type, also can be and be located at dog catch, door on the ground, or other has the mode that stops vehicle effect.System proposed by the invention is still applicable to the place with two or more gateways.
Fig. 2 is that the scene that vehicles while passing of the present invention enters the tolerant system embodiment bis-of control arranges figure.
In the present embodiment, show equally a vehicle 20 that enters this vehicular control place, be provided with car plate 201, enter the coverage 22 of video camera 203, by processing the continuous filmed image of video camera 203, then find the position of car plate 201 by the technology of image edge searching, and carry out identification.
In the present embodiment, vehicular control place is provided with two gateways 207,208, and is respectively equipped with two vehicle perceptrons 24,26, but this quantity is not for limiting implementation content of the present invention.Two vehicle perceptron 24,26 fundamental purposes are which the gateway 207,208 that sense vehicle 20 will enter is.
Content as shown in Figure 1, the coverage 22 that enters video camera 203 when vehicle 20, the image processor system of system will draw car plate 201 positions, and identification car plate 201 numbers, when empirical tests is crossed the vehicle 20 that allows to enter and entered the sensing range of above-mentioned vehicle perceptron 24,26, can judge the gateway 207 or 208 entering, produce again control signal, control corresponding gate driver 209 or 210 starting gates 211 or 212.
In the present embodiment, system has the means of another aided verification simultaneously in this number plate recognition technology, as the embodiment that Fig. 2 shows, can be respectively equipped with the second demo plant near of gate driver 209 or 210, if icon is in order to read the wireless-identification device 213,214 of identification card.
Wireless-identification device 213,214 provide not the vehicle 20 of the proving program by utilizing car plate identification to carry out second proving program, when this vehicle 20 enters gateway 207 or 208, and sense and enter vehicle by vehicle perceptron 24 or 26, wireless-identification device 213 or 214 corresponding to gateways and starting entering according to vehicle 20.For instance, when after the proving program that vehicle 20 is identified by number plate recognition by first, system utilizes vehicle perceptron 24,26 to judge the track that vehicle 20 enters, and after vehicle 20 enters a certain gateway (as 207), opens corresponding gate (as the gate 211 of corresponding gateway 207); If when the first proving program that vehicle 20 is not identified by car plate, in the time that vehicle 20 enters a certain gateway (as 207), start corresponding wireless-identification device (as 213), carry out second proving program.If when vehicle 20 passes through one of twice proving program, will open corresponding gate driver (as 209), and can allow vehicle 20 pass through fast in good time; Or must just can enter through second proving program again.
In above-mentioned described embodiment, known the present invention first verifies by the mode such as filming image, identification whether enter vehicle is allowed to enter vehicular control place, therefore can before entering gateway, vehicle verify, if checking is not passed through, will send information warning, comprise the mode such as cresset, sound, and follow automatic or require or point out driver to carry out second proving program, if twice checking all fails to pass through, should notify related personnel; If first is verified, except sending suitable prompting message, can also be near vehicle approach gateway time, starting gate, vehicle can directly be entered in the situation that need not stopping, except simpler save from damage necessary authentication program, or province's motor vehicle fuel, the mode that saves time.
It is worth mentioning that, the better technology that adopts wireless identification of second proving program, this is similarly contactless checking means, is also can complete checking beyond a segment distance, therefore, can before vehicle not yet stops, can starting gate passes through by vehicle.
Fig. 3 is that the scene that vehicles while passing of the present invention enters the tolerant system embodiment of control arranges schematic diagram, and this embodiment shows the vehicle 30 that is provided with car plate 301 and enter the illustration of a turnover entrance.In the time having vehicle 30 to enter, first carry out as above-mentioned first proving program, carry out vehicle checking by the vehicle license plate recognition module 311 of utilizing number plate recognition identification vehicle 30, obtain car plate 301 images of vehicle 30 and carry out identification through this vehicle license plate recognition module 311, the information that receives identification by the control system 307 that connects this vehicle license plate recognition module 311 in Fig. 3 afterwards determines whether to allow the vehicle 30 entering with comparison list.
Judge through control system 307 whether vehicle 30 is allowed to enter, the result of checking can produce a signal that whether drives the gate control module 305 that control gate 310 opens and closes, if by checking, the information producing can drive gate control module 305 to utilize gate driver 309 starting gates 310; If not, by this first proving program, can not produce any signal to gate control module 305 in this stage, and replace with other information warning, and in the present invention, start second proving program.
When not listing in the list that can allow to enter control place after vehicle 30 car plate 301 identifications, or when other wrong errors that produce by first proving program, vehicle 30 at once starts wireless identity module 312 in the time of vehicle perceptron 303, to read the wireless identification label arranging on vehicle 30, or the recognition device held of the people in driver or any car, read wherein contained identifying information, and still can compare list and be confirmed whether to allow to enter.
The identification data reading through wireless identity module 312, same by connecting the control system 307 execution comparisons and judgement of this wireless identity module 312, after confirming person that has come's identity, will produce signal and drive gate driver 309 starting gates 310 by gate control module 305.
Above-mentioned first proving program is realized by different verification methods respectively from second proving program, wherein second proving program is better realizes with wireless label recognition technology, because can be a kind of identification label that is attached to vehicle body, also can be hand-held identification card etc., but also do not get rid of the technology of other identifications, comprise the recognition technology of the various biological characteristics to this driver, as face, palm fingerprint, iris, vein etc.
In the contained embodiment of Fig. 3, vehicle 30 by checking will be by 303 perception of vehicle perceptron, therefore can produce signal notice gate control module 305, gate control module 305 produces because also obtain control system 307 information being verified, therefore can in the time that vehicle 30 is perceived, at once drive gate driver 309 starting gates 310, and will in vehicle 30 completely by time closed shutter 310.
The vehicles while passing disclosing in the embodiment of the present invention enters in the tolerant system of control, in order to reach the contained technology of the present invention, to be provided with the various functional modules that realized with hardware circuit or software program, can consult vehicles while passing of the present invention shown in Fig. 4 and enter the associated schematic diagram in each unit of the tolerant system of control.
Fig. 4 shows a vehicles while passing and enters control core 40, this is the processing core of a signal, comprise and can utilize the settling mode of various software and hardwares to carry out each circuit, software signal, vehicles while passing enters the various functional modules of control core below 40 can show respectively gate control module 401, vehicle perception unit 403, number plate recognition unit 405, camera unit 407, storage element 409, vehicle authentication unit 411, aided verification unit 413 and the Validation Mode control module 415 as coupled.
According to embodiment, camera unit 407 enters control core 40 with the vehicles while passing of processing core as signal and is electrically connected, can be especially the video camera of taking wide viewing angle, can whole day or by taking the continuous image in one or more tracks (entering the road surface before gateway) after triggering, and coordinate image processing can obtain mobile object, and utilize number plate recognition unit 405 to find car plate, and pick out the number-plate number.
Wherein number plate recognition utilizes image to process according to the image feature of car plate, such as being a significant square frame, pure color background color (as white, yellow, green etc.) and obvious English and digital combination license number, can obtain car plate position by the technology of seeking limit (edge finder).The above-mentioned technology of seeking limit and looking for the identification of special object position and license number and can adopt known image identification, does not repeat at this.
Afterwards, vehicle authentication unit 411 enters control core 40 from vehicles while passing and obtains the information of car plate, and the consideration of saving from damage if having will be compared with default list, confirms whether this vehicle exists in a white list, judges whether to allow to enter.The result that produces afterwards checking, vehicles while passing enters control core 40 control gate control module 401 is started to gate, or closed shutter.Vehicles while passing enters the electrical chain of control core 40 and is connected to a storage element 409, can be in order to contents such as the image of storage car (for inquiry in the future), model data storehouse, lists.
If system is located at entering and exiting of multiple gateway, can confirm that vehicle enters gateway according to vehicle perception unit 403, reinform gate control module 401 and open corresponding gate.According to fault tolerant mechanism proposed by the invention, if above-mentioned first utilizes the proving program failure of number plate recognition technology, driver still can enter vehicular control place by another ancillary method of system, namely second proving program proposed by the invention, in Fig. 4, show as aided verification unit 413, the technology of aided verification can verification technique as known in some, and better system adopts the technology of wireless identification, as is loaded with card or the device etc. of radio frequency recognition volume label.
The identifying information producing by above-mentioned aided verification unit 413 is sent to equally vehicles while passing and enters control core 40, the judgement that whether can sail into as vehicle.Therefore in the time that vehicles failed passes through above-mentioned first proving program, expression vehicle is not listed in list or lists in a blacklist, but driver is still for allowing the people that enters, the second verification method that such situation still can system provides enters vehicular control place.
The vehicles while passing of this tolerant system enters control core 40 and processes the identifying information that vehicle authentication unit 411 and aided verification unit 413 produce simultaneously, fault-tolerant mechanism can adopt different Validation Modes, by the Validation Mode control module 415 in Fig. 4 according to default pattern.The pattern setting producing through this Validation Mode control module 415 can include multiple vehicles while passing and enter regulatory model, comprise order and the combination of above-mentioned two kinds of proving programs, as pattern one: in the time of the authentication failed of car plate identification, start wireless identification (or claiming radio-frequency (RF) identification) technology and assist number plate recognition; Pattern two: when after wireless recognition technique failure, can be aided with number plate recognition technology; Pattern three: car plate image identification and wireless identification meet simultaneously, just can enter this vehicular control place.
It is worth mentioning that, the license plate recognition technology that the present invention adopts has just completed proving program can not enter gateway on vehicle time, therefore can be in the time that vehicle enters gateway immediate unlock gate, make vehicle without stop travelling again completely into; Moreover another proving program that the present invention adopts adopts wireless recognition technique, for an a kind of specific range can complete the technology of identification and verification outward, therefore can reach equally at vehicle and enter gateway and just can not allow to enter by starting gate when stagnation of movement completely.
It is worth mentioning that, with other known systematic comparisons, the technology of general image identification causes identification speed slower because being limited to the calculation process ability of system, thereby cannot meet the demand of real-time and Fast Identification, so need various vehicle perceptrons to assist, to reduce the burden of system.But it is the direct whole image picture of scanning that vehicles while passing of the present invention enters number plate recognition mode that control system adopts, utilize the significant feature of car plate directly to obtain car plate position wherein content of identification, without first judging vehicle vehicle originally in finding out car plate, therefore, on image is processed, omitted many computing work, General System is enough to process the presentation content of video streaming (more than 25 width per second) according to the method.System is always all in detecting under the state of car plate.Therefore,, according to above-mentioned technical characteristic, vehicles while passing of the present invention enters control system can process the number plate recognition of multilane.
Vehicles while passing of the present invention enters video camera that control system adopts and is preferably a video camera with wide viewing angle camera lens, and object is to take wider scope, especially for the turnover entrance that is provided with multiple gateway.Separately there is embodiment can consult the contained wide-angle photography module diagram of Fig. 5.
As shown in Figure 5, this embodiment shows a camera unit 50, is wherein provided with multiple image acquisition units 501,502,503, and the circuit component of image capture, as CCD, CMOS etc., is not even got rid of known analog camera.In the present embodiment, the track of different angles can be separately taken in the design of multiple image acquisition units 501,502,503, and can obtain the coverage compared with wide viewing angle by the technology of image combination, as being electrically connected the image combining unit 51 of camera unit 50 in Fig. 5.
The image combining unit 51 of this embodiment seamlessly combines the image of the multiple different visual angles that obtain from camera unit 50 by image by the relevance of image edge, relevance comprises synchronous image, the object pixel of image edge etc. according to the time, therefore can produce the effect that expands visual angle.To take whereby the image in multiple tracks in the embodiment of the present invention.
The image of processing through image combining unit 51 will change and be stored to buffer unit 53, provide number plate recognition unit, rear end 55 to carry out Real-time Vehicle License Plate image identification, comprise that the technology of following the trail of by car plate continues identification, then list comparison or registration are carried out in the license number empirical tests unit 57 drawing.
Fig. 6 is then described vehicles while passing of the present invention and is entered the tolerant system of control by the function square of various unit modules, the fault tolerant mechanism that system provides adopts two kinds of different verification methods simultaneously, and circuit box wherein shows the first authentication module 61 and the second authentication module 62 as Fig. 6.
In the first authentication module 61, include wide-angle photography module 601, image buffer unit 603, number plate recognition unit 609 and the vehicle authentication unit 611 of mutual electric connection; In the second authentication module 62, be provided with the information reading unit 615 and aided verification unit 617 of mutual electric connection.
Above-mentioned the first authentication module 61 is in particular the verification technique realizing by the technology of automobile image and number plate recognition, wherein there is wide-angle photography module 601, realize as the above-mentioned video camera with a wide-angle lens, or by produce the camera unit of the function of wide viewing angle in conjunction with multiple image acquisition unit institute pick-up image, its objective is in order to take and comprise that one or more enters the continuous image of the track scope before gateway, these continuous images are stored to database 605 for have access in the future by first keep in/being stored to an image buffer unit 603, comprising.
Then, system will obtain continuous image in the number plate recognition unit 609 self imaging buffer units 603 of realizing with software program or circuit engineering, in the time that system is located at the place of turnover entrance of multiple gateway, can grasp multiple car plate images that enter vehicle simultaneously, and then carry out the identification of car plate license number with number plate recognition unit 609.
Number plate recognition unit 609 scans by width (frame) carry out image according to the feature of car plate itself, can obtain frame as above, shape, color, English/letters such as numeral, pick out license number, therefore can judge car plate position with a kind of technology of processing on limit of seeking, then pick out again license number.To give vehicle authentication unit 611 to compare to carry out list 613 through the license number of identification, verify whether this vehicle is the vehicle being allowed to enter.List 613 can be stored in above-mentioned database 605.According to one of embodiment, this routine number plate recognition unit 609 is after drawing each vehicle license plate position, can drive above-mentioned wide-angle photography module 601, follow the trail of and take each vehicle license plate with the means of image processing, until license number identification completes, its objective is and guarantee can complete checking before vehicle enters gateway.And in the present embodiment, provide a Validation Mode control module 619, be electrically connected the first above-mentioned authentication module 61, the result of verifying through vehicle authentication unit 611 will give Validation Mode control module 619 to judge whether checking, and then produce the whether instruction of starting gate.
The second 62 of authentication modules are to read and be loaded on car or by driver or the hand-held contained identifying information of wireless-identification device (as label, card) of other users with information reading unit 615, whether allow as this vehicle of checking the judgement basis entering, identifying information transfers to aided verification unit 617 to compare after list 613, equally the result is passed to the Validation Mode control module 619 that connects this second authentication module 62, judge whether checking by Validation Mode control module 619, and then produced the whether instruction of starting gate.
In the present embodiment, Validation Mode control module 619 is except the result that is received from the first authentication module 61 and the second authentication module 62 and transmits, can also determine that vehicles while passing enters the regulatory model of fault tolerant mechanism in the tolerant system of control, comprise the front and back order of the performed proving program of the first authentication module 61 and the second authentication module 62 and whether allow to enter by arbitrary proving program, or need two kinds of proving programs all will meet and just allow to enter, rely on the safety requirements in set vehicular control place and determine.
Validation Mode control module 619 is judged by received verification msg and the Validation Mode that sets, comprise and judged whether checking and judged whether starting gate, and can be provided as the message unit 621 of transmitting messages with system and be sent information, comprise the prompting being proved to be successful or verify unsuccessful alarm signal, can cresset, the sound and various information mode send, and can notify related personnel to come to process.
The unsuccessful vehicle of empirical tests, Validation Mode control module 619 can produce the not information of starting gate, or do not send any signal, therefore gate control module 623 can't be received the instruction of starting gate, or in the time that gate is unlatching, gate control module 623 can the notified upper lock gate that closes at once.
Otherwise through the vehicle of confirming to be proved to be successful, system produces one by the information producing according to Validation Mode control module 619 and controls signal to gate control module 623, with starting gate in the time that vehicle enters gateway.In the present embodiment, the gateway annex that vehicles while passing enters in control system is provided with a vehicle perception unit 625, can obtain whereby vehicle and enter the time of gateway, and therefore gate control module 623 can be according to sensing time of vehicle and On/Off gate.Particularly, in the turnover entrance that is provided with multiple gateway, this vehicle perception unit 625 is by the gateway that can be used for confirming that vehicle enters, and the time entering.Whereby, due to above-mentioned Validation Mode control module 619 can before one or more vehicle arrives corresponding gate, complete above-mentioned the first authentication module 61 and the second authentication module 62 both one of or the proving program of combination, therefore, this gate control module 623 before arriving corresponding gate by one or more vehicle of checking starting gate allow currently, represent that vehicle can obtain checking and also can enter smoothly the in the situation that of stagnation of movement completely.
The present invention also discloses a kind of vehicular control method that adopts the tolerant system that above-mentioned vehicles while passing enters control.As the flow process of Fig. 7, wherein step S701 represents this vehicles while passing of startup to enter the tolerant system of control.
Then system, as step S703, carry out the first verification method, be preferably the first authentication module 61 starting in above-mentioned Fig. 6, by the above-mentioned camera unit with wide visual angle function, according to vehicle continuous image identification car plate, judge according to identifying information whether this vehicle has by checking, as step S705.If confirm by checking (YES), as step S707, starting gate or other forms of measure of control, allow vehicle to pass through.
If verify unsuccessful (no), continue as step S709, carry out the second verification method, start the second authentication module 62 showing as Fig. 6, better is by the technology of wireless identification reads on vehicle or the wireless-identification device that driver holds, whether identifying information will be through contrast judgement by checking, as step S711.If be judged as NO, represent that this vehicle is not by one of above-mentioned two kinds of proving programs, therefore refusal is current, as step S715, its Program can comprise and detects that vehicle enters gateway, if gate was opening at that time, need to drive strobe control circuit closed shutter, and produce alarm signal.
If by this second proving program (YES), as step S713, will allow current.According to above-described embodiment, system can detect that vehicle enters gateway by perceptron, obtains the time that enters gateway, can drive strobe control circuit starting gate.
According to above-mentioned flow process, the embodiment of the present invention can reach the effect that has completed license number identification and checking before one or more vehicle arrives corresponding gate, make one or more vehicle that empirical tests is passed through arrive before corresponding gate starting gate and allow currently, represent that vehicle can (need not stop, need not stopping carrying out checking completely) more efficiently and enter in vehicular control place.
Fig. 8 be the present invention adopt vehicles while passing enter control tolerant system method of control above-mentioned first checking flow process embodiment step.The technology of the number plate recognition that wherein adopted can be utilized the known technology judging for the image of special characteristic, particularly can first obtain the position of vehicle license plate, then carries out identification according to the image feature of car plate, embodiment flow process step as shown in Figure 8.
The first checking flow process starts, and as step S801, first obtains vehicle and enters the continuous image of track (entering before gateway), as step S801 by above-mentioned camera unit.According to one of above-described embodiment, system is utilized the virtual object box of software approach, continues scanning in each width of image, as step S803, system judges whether to detect car plate by the result of scanning, if not, show and not yet have vehicle to enter, continue step S801; If so, represent to pick out in object box to there is the image consistent with vehicle license plate characteristic, can judge according to the edge of object the position of car plate, and mode that can image tracing locks car plate position, to continue identification car plate, as step S805, follow the trail of car plate until identification car plate.
Through comparison car plate, as step S807, judge whether by this first checking flow process according to comparison result? if not, represent that as step S809, system will produce alarm signal, and enter the second checking flow process according to fault-tolerant mechanism not by checking; If so, represent that this vehicle is through checking, as S811, in the present embodiment, system will be confirmed can starting gate.Or in the pattern of another embodiment, still need to carry out the second checking flow process, just allow to enter by the vehicle of twice proving program.
Then as shown in Figure 9, Fig. 9 is the embodiment step that the present invention adopts the second checking flow process of the method for control of the tolerant system that vehicles while passing enters.
When vehicles failed is by the first checking flow process, as step S901, start the second checking flow process, as step S903, the relevant circuit of the second proving program is carried out when smooth and easy and without startup at the first proving program, and can after the first checking flow process failure, just start.
Now, relevant circuit will be started successively, as step S905, opening information reading unit, can read identification data, as step S907, such as being the contained identifying information of less radio-frequency label, identifying information will be in order to compare list, as step S909, be proved to be successful judging whether, as step S911.
Finally, at this embodiment, if "No" represents that this vehicle, not by first and second checking flow process, as step S913, will produce alarm signal, and refusal enters; If by this proving program (YES), as step S915, system will be confirmed starting gate.
It is worth mentioning that, system is not yet being set up and is being allowed under the original state of the database that enters vehicle, can automatically set up the comparison database of vehicle license plate and another wireless identification information, such as entering after control system, vehicle (enters track), carry out number plate recognition simultaneously, when confirmation can enter, can read radio-frequency (RF) tag simultaneously, set up whereby the correspondence database of car plate and radio frequency identifiers
In sum, through above-mentioned number plate recognition, the proving program that vehicle enters, gate control, second aided verification flow process etc., a kind of vehicles while passing involved in the present invention enters the tolerant system of control and the principal character of management method is to provide two kinds of different types of vehicle verification techniques, and one of its advantage is for providing fault-tolerant mechanism, also having another advantage is to have completed identification and checking before vehicle arrives gate, therefore can allow vehicle enter in continuing to travel, being different from known technology needs to carry out the process of verifying after stagnation of movement, provide smooth and easy, vehicular control measure easily.
But, the foregoing is only better possible embodiments of the present invention, non-ly therefore limit to protection scope of the present invention, therefore the equivalent structure that all utilizations instructions of the present invention and accompanying drawing content are done changes, be all in like manner contained in scope of the present invention explanation hereby.
Claims (10)
1. vehicles while passing enters a tolerant system for control, it is characterized in that, described tolerant system comprises:
One first authentication module, comprising:
One camera unit, comprises one or more continuous images that enter the track scope before gateway in order to take;
One image buffer unit, is electrically connected this camera unit, in order to store by the captured continuous image of this camera unit;
One number plate recognition unit, be electrically connected this image buffer unit, obtain stored continuous image by this image buffer unit, through scanning each width image of this continuous image, judge car plate position the identification license number of each vehicle according to vehicle license plate characteristic to seek after process on limit;
One vehicle authentication unit, is electrically connected this number plate recognition unit, and comparison one list is to verify obtained each vehicle license number;
One second authentication module, comprising:
One information reading unit, is loaded on this vehicle or by driver or the hand-held contained identifying information of a wireless-identification device of other users of this vehicle in order to read;
One aided verification unit, is electrically connected this information reading unit, in order to receive this identifying information, verifies to compare this list;
One Validation Mode control module, be electrically connected this first authentication module and this second authentication module, enter the regulatory model of the tolerant system of control in order to set this vehicles while passing, receive the result that this first authentication module and this second authentication module produce, judge whether checking, and judged whether to open a gate; And
One gate control module, is electrically connected this Validation Mode control module, through obtaining the result of this Validation Mode control module judgement, when this gate is opened in judgement, the gate opening of this gateway of gateway control entering according to each vehicle with close.
2. vehicles while passing as claimed in claim 1 enters the tolerant system of control, it is characterized in that, described camera unit is to be provided with a coverage to contain multiple wide-angle photographic lens that enter the track before gateway.
3. vehicles while passing as claimed in claim 1 enters the tolerant system of control, it is characterized in that, described camera unit is the camera being made up of multiple image acquisition units, and utilizes the multiple images of an image combining unit seamless combination by the obtained different visual angles of the plurality of image acquisition unit.
4. vehicles while passing enters the tolerant system of control as claimed in claim 2 or claim 3, it is characterized in that, draws behind each vehicle license plate position in this number plate recognition unit, drives this camera unit to follow the trail of and takes each vehicle license plate, until license number identification completes.
5. vehicles while passing as claimed in claim 1 enters the tolerant system of control, it is characterized in that, described Validation Mode control module is electrically connected a message unit, to send information according to the result.
6. vehicles while passing as claimed in claim 1 enters the tolerant system of control, it is characterized in that, each gateway is provided with a vehicle perception unit, be electrically connected this gate control module, the gateway entering in order to the each vehicle of perception, this gate control module is according to the corresponding gate opening of the signal controlling of this vehicle perception unit or close; Wherein, starting gate permission is current before arriving corresponding gate by this one or more vehicle of checking for this gate control module.
7. adopt vehicles while passing to enter a method of control for the tolerant system of control, it is characterized in that, described method of control comprises:
Start one first authentication module, to carry out first proving program, the license board information that this first proving program enters a vehicle of a gateway according to identification is verified;
Judge that whether this vehicle is by this first proving program, wherein:
If be proved to be successful, allow this vehicle pass-through;
If verify unsuccessful, start one second authentication module;
Carry out this second authentication module to carry out second proving program, this second proving program is verified according to a wireless recognition technique;
Judge that whether this vehicle is by this second proving program, wherein:
If be proved to be successful, allow this vehicle pass-through;
If verify unsuccessfully, refuse this vehicle pass-through.
8. method of control as claimed in claim 7, is characterized in that, described first proving program comprises:
Obtain that a camera unit is captured comprises one or more continuous images that enter the track scope before gateway;
By the each vehicle license plate of identification position in this continuous image, and the each car plate content of identification;
And carry out checking according to each car plate content.
9. method of control as claimed in claim 8, is characterized in that, confirms the access admittance of this one or more vehicle after checking, also comprises:
Detect the gateway that each vehicle enters, to open gate that should gateway;
Wherein, this verification step has completed license number identification and checking before this one or more vehicle arrives corresponding gate, and before this one or more vehicle that empirical tests is passed through arrives corresponding gate, starting gate permission is current.
10. method of control as claimed in claim 8, is characterized in that, after authentication failed, carries out this second proving program, and this second proving program comprises:
Open an information reading unit;
Read and be loaded on this vehicle or by this vehicle driver or the hand-held contained identifying information of a wireless-identification device of other users; And
Receive this identifying information with an aided verification unit, to verify.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310005665.7A CN103914896B (en) | 2013-01-08 | 2013-01-08 | Vehicles while passing enters the tolerant system of control and the method for control using this tolerant system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310005665.7A CN103914896B (en) | 2013-01-08 | 2013-01-08 | Vehicles while passing enters the tolerant system of control and the method for control using this tolerant system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103914896A true CN103914896A (en) | 2014-07-09 |
| CN103914896B CN103914896B (en) | 2016-08-31 |
Family
ID=51040547
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310005665.7A Active CN103914896B (en) | 2013-01-08 | 2013-01-08 | Vehicles while passing enters the tolerant system of control and the method for control using this tolerant system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103914896B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104601854A (en) * | 2014-12-31 | 2015-05-06 | 苏州佳世达电通有限公司 | Image recognition module, electronic device, and image recognition verification and scan correction method |
| CN106558115A (en) * | 2015-09-28 | 2017-04-05 | 西安艾润物联网技术服务有限责任公司 | Parking lot vehicles while passing control method and device |
| CN108520288A (en) * | 2018-03-12 | 2018-09-11 | 广东弘栎电子设备有限公司 | Less radio-frequency acquisition method and its system with video acquisition function |
| CN111275984A (en) * | 2020-02-20 | 2020-06-12 | 三一重工股份有限公司 | Vehicle detection method and device and server |
| CN111583656A (en) * | 2020-04-03 | 2020-08-25 | 北京博研中能科技有限公司 | Fill electric pile parking stall intelligence prevention and control system suitable for new forms of energy car |
| CN115996239A (en) * | 2021-10-18 | 2023-04-21 | 财团法人资讯工业策进会 | Vehicle positioning system and vehicle positioning method for container yard vehicle |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE4225943A1 (en) * | 1992-08-06 | 1994-02-10 | Barbara Hoettler | Automatic entry and exit control for road vehicles to car park - has ticket issued with 4 digit number at entry with exit control based upon charge determined when number is entered |
| TW517212B (en) * | 2002-03-27 | 2003-01-11 | Chunghwa Telecom Co Ltd | Vehicle entry control system |
| US20070229218A1 (en) * | 2006-03-15 | 2007-10-04 | Shary Nassimi | Wireless Gate Control and Communication System |
| CN101369353A (en) * | 2007-08-15 | 2009-02-18 | 郑州大学 | Anti-electricity theft unpacking recording instrument |
| CN101593378A (en) * | 2008-05-28 | 2009-12-02 | 云昱投资股份有限公司 | The video camera of built-in license plate identification function |
| CN102324124A (en) * | 2011-08-29 | 2012-01-18 | 苏州盛世华安智能科技有限公司 | Vehicle access management system |
-
2013
- 2013-01-08 CN CN201310005665.7A patent/CN103914896B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE4225943A1 (en) * | 1992-08-06 | 1994-02-10 | Barbara Hoettler | Automatic entry and exit control for road vehicles to car park - has ticket issued with 4 digit number at entry with exit control based upon charge determined when number is entered |
| TW517212B (en) * | 2002-03-27 | 2003-01-11 | Chunghwa Telecom Co Ltd | Vehicle entry control system |
| US20070229218A1 (en) * | 2006-03-15 | 2007-10-04 | Shary Nassimi | Wireless Gate Control and Communication System |
| CN101369353A (en) * | 2007-08-15 | 2009-02-18 | 郑州大学 | Anti-electricity theft unpacking recording instrument |
| CN101593378A (en) * | 2008-05-28 | 2009-12-02 | 云昱投资股份有限公司 | The video camera of built-in license plate identification function |
| CN102324124A (en) * | 2011-08-29 | 2012-01-18 | 苏州盛世华安智能科技有限公司 | Vehicle access management system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104601854A (en) * | 2014-12-31 | 2015-05-06 | 苏州佳世达电通有限公司 | Image recognition module, electronic device, and image recognition verification and scan correction method |
| CN104601854B (en) * | 2014-12-31 | 2017-12-01 | 苏州佳世达电通有限公司 | Image identification module, electronic installation, image identification checking and scanning bearing calibration |
| CN106558115A (en) * | 2015-09-28 | 2017-04-05 | 西安艾润物联网技术服务有限责任公司 | Parking lot vehicles while passing control method and device |
| CN106558115B (en) * | 2015-09-28 | 2020-11-10 | 西安艾润物联网技术服务有限责任公司 | Parking lot vehicle access control method and device |
| CN108520288A (en) * | 2018-03-12 | 2018-09-11 | 广东弘栎电子设备有限公司 | Less radio-frequency acquisition method and its system with video acquisition function |
| CN111275984A (en) * | 2020-02-20 | 2020-06-12 | 三一重工股份有限公司 | Vehicle detection method and device and server |
| CN111275984B (en) * | 2020-02-20 | 2022-04-15 | 三一重工股份有限公司 | Vehicle detection method and device and server |
| CN111583656A (en) * | 2020-04-03 | 2020-08-25 | 北京博研中能科技有限公司 | Fill electric pile parking stall intelligence prevention and control system suitable for new forms of energy car |
| CN115996239A (en) * | 2021-10-18 | 2023-04-21 | 财团法人资讯工业策进会 | Vehicle positioning system and vehicle positioning method for container yard vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103914896B (en) | 2016-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10582163B2 (en) | Monitoring an area using multiple networked video cameras | |
| CN103914896A (en) | Fault tolerance system for vehicle access and exit control, and control method adopting fault tolerance system | |
| KR20220070581A (en) | Vehicle door unlocking method and device, system, vehicle, electronic equipment and storage medium | |
| CN103914898B (en) | Vehicles while passing enters control system and method for control | |
| JP7024396B2 (en) | Person search system | |
| CN109243005A (en) | The traveling of the police supervision and management of bicycle and intelligent city's management records system | |
| CN109840973B (en) | Face recognition-based shared bicycle automatic unlocking method and control system | |
| CN202110591U (en) | Intelligent banister system employing embedded vehicle license plate recognition | |
| US11279321B2 (en) | Imaging apparatus having a reduced power consumption mode and mode that generates a captured image | |
| CN108986539A (en) | Parking management system, method, vehicle information collecting device and management server | |
| RU2741449C1 (en) | Automated parking system and server | |
| CN112820137B (en) | Parking lot management method and device | |
| CN107645653A (en) | A kind of method, apparatus, equipment and the storage medium of Camera location shooting | |
| CN105184873A (en) | Intelligent parking lot management system | |
| CN103914980A (en) | Photographing device and image acquisition method | |
| CN108038920A (en) | Parking lot management method, system and the server to parking lot management | |
| CN111223303B (en) | Charging pile parking space management method, device and system | |
| KR101522686B1 (en) | Method for monitoring access control of vehicle and system thereof | |
| WO2019047803A1 (en) | Vehicle stopping system for identifying angular distance of vehicle parking to tactile paving path and road shoulder | |
| KR20150061160A (en) | Robot for providing vehicle location, and system and method for guiding parking location employing the same | |
| CN203232469U (en) | Vehicle in-out system | |
| JP2011197728A (en) | Shared vehicle management device | |
| CN108062520A (en) | A kind of driver identification system and method | |
| CN203232472U (en) | Fault tolerant system for controlling vehicle to pass in and out | |
| TWI467517B (en) | Access control system and method for vehicles |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |